1ea56576dc
Merge branch 'master' into devel_google_videos
2019-01-04 22:27:05 +01:00
aeb6dab187
Merge branch 'master' into master
2019-01-04 22:14:40 +01:00
5b81f7c2cc
Merge branch 'master' into bugfix_startpage
2019-01-04 22:03:00 +01:00
cf26aba93b
[FIX] google videos thumbnails
2019-01-04 15:48:22 +01:00
73ec2ba74e
Update bing image engine with new image json format
2018-12-19 11:12:25 +01:00
44ce51f0c5
restore startpage search results
2018-12-14 21:38:48 +01:00
4a127b19de
Merge branch 'master' into engines/unsplash
2018-12-14 07:06:19 +01:00
0d86ed9c7e
update startpage.py
2018-12-11 21:45:47 +03:00
442772a6c5
remove findx engine ( #1452 )
2018-12-02 22:39:04 +01:00
0bdf090ed7
[fix] google videos engine
2018-11-22 13:00:34 +01:00
b9ada93b3a
Removes what looks like tracking parameters
2018-10-08 14:56:20 +02:00
72d063d27d
Uses the raw url for the image result, rather than the full
...
size result.
2018-10-08 14:01:35 +02:00
cd7849ffc8
Adds the Unsplash image engine
2018-10-08 09:18:42 +02:00
052a71d05a
Merge pull request #1368 from aliceinwire/gentoo_engine
...
Add Gentoo wiki search engine
2018-08-21 16:24:34 +02:00
d24c58cf4e
Fix pep8 errors
2018-08-21 22:55:51 +09:00
ff2eac9f6b
Fix choosing languges function
...
Searching for english is now giving all pages results.
Instead searching for a specific language different from english
is correctly returning only translated pages for the selected language.
2018-08-21 22:55:39 +09:00
baacfac32b
[fix] remove publicly unavailable 500px engine - #1338
2018-08-19 15:06:59 +02:00
b575f898c0
duden.de engine
2018-08-18 19:24:02 +02:00
845ba79e75
[fix] update qwant search url
...
thx to @dalf for the fix (#1365 )
2018-08-13 12:38:19 +02:00
5f0888b8f4
added languages to Gentoo engine
2018-08-12 23:00:57 +09:00
b7886bb15c
gentoo engine test
2018-08-12 23:00:57 +09:00
d51732c0e5
Merge pull request #1303 from MarcAbonce/bing
...
Fix bing "garbage" results
2018-07-09 11:00:37 +02:00
7a474db61b
Fix formatting
2018-07-06 10:31:01 +02:00
acaef6600e
Update path to wikidata image
2018-07-05 10:11:45 +02:00
f82ead3e30
[fix] add py3 compatibility to base engine - closes #1319
2018-06-14 11:50:03 +02:00
57e7e9da98
[fix] use html result page in google images (previous endpoint stopped working)
2018-06-14 11:40:39 +02:00
16915116e0
fix piratebay url
...
Closes #1229
2018-05-21 16:58:39 +02:00
75b276f408
fix bing "garbage" results (issue #1275 )
2018-05-20 18:13:32 -05:00
b843c1351a
add missing parameter to gigablast search url
...
Closes #1293
2018-05-16 22:26:32 +02:00
059c2ccb95
Fix acgsou encoding error on python2 and add unicode characters to unit testt
2018-05-05 23:41:13 +03:00
3b89ce9bfa
Switch acgsou to http
2018-05-03 08:34:21 +03:00
1a1f9852f1
Merge pull request #1283 from rinpatch/acgsou-engine
...
[Feature] Acgsou as a searchable engine
2018-04-28 22:42:35 +02:00
f6695cea59
Fix nyaa to use https
2018-04-27 17:55:42 +03:00
f17e54a396
Forgot to remove print command used for debugging
2018-04-27 15:40:42 +03:00
dcc9fdb47f
Added unit test
2018-04-27 15:36:15 +03:00
e3bd2670d7
Traling whitespace
2018-04-27 08:36:11 +03:00
86f47689fe
Hopefully fix code style errors(again)(again)
2018-04-27 08:32:43 +03:00
b8b23d8006
Hopefully fix code style errors(again)
2018-04-27 08:29:17 +03:00
fb364ffae7
Hopefully fix code style errors
2018-04-27 08:23:58 +03:00
3ec35a06f7
Added Engine
2018-04-26 22:42:31 +03:00
cd1374d2f2
added whitespaces
2018-04-22 14:12:32 +03:00
a305dae9d8
switched currency convert to duckduckgo and added Bitcoin to currency list
2018-04-22 13:46:13 +03:00
25b48143ea
fix findx engine
2018-04-21 20:02:52 +02:00
f7f9c50393
[fix] force English results in Google when using en-US
2018-04-18 23:29:48 -05:00
b12857a70d
[fix] make search requests on wikidata more accurate
2018-04-08 21:17:00 -05:00
835d1edd58
[fix] google news xpath
2018-04-08 20:56:05 -05:00
343e555ee9
[fix] append http if no scheme is provided in xpath's extact_url
...
This solves a bug with Yahoo where some results don't specify
a protocol.
2018-04-08 20:35:34 -05:00
283f6c9053
Merge pull request #1252 from MarcAbonce/search-languages
...
[mod] Refactor engine's search language handling
2018-04-05 17:27:07 +02:00
772c048d01
refactor engine's search language handling
...
Add match_language function in utils to match any user given
language code with a list of engine's supported languages.
Also add language_aliases dict on each engine to translate
standard language codes into the custom codes used by the engine.
2018-03-27 00:08:03 -06:00
8cc529e9a3
forward category to engine without highlighting on the ui
2018-03-22 11:02:24 +01:00
d04e471ce5
add findx engine for general, images and videos
2018-03-22 10:02:37 +01:00
d1eae9359f
fix fetch_langauges to be more accurate
...
Add languages supported by either all default general engines or 10 engines.
2018-03-20 17:58:20 -06:00
216716db70
[fix] change duckduckgo url to avoid error response
2018-03-14 23:18:42 -06:00
03d7a8f065
[fix] pep8
2018-02-18 23:24:59 +01:00
b4c657d227
[enh] add asksteem engine - closes #1163
2018-02-18 22:42:32 +01:00
988cf38196
fix Microsoft Academic engine
2018-02-17 21:39:49 +01:00
2f69eaeb2f
[fix] fix engine initialization
2018-02-17 14:30:06 +01:00
c645915171
fix bing videos engine
2018-02-10 19:44:07 +01:00
829032f306
[fix] read utf-8 files (settings, languages, currency) with python3.5
...
Related to discussion in #1124
The io.open import is necessary for python2
2018-01-16 23:26:10 -06:00
8511e64f35
Merge pull request #1124 from JosephKiranBabu/python3-unicode-support
...
Make Python 3 able to read settings files with Unicode characters
2018-01-12 10:58:23 +01:00
f3aa5ea47d
fix yacy result url
...
Closes #1064
2018-01-06 14:52:14 +01:00
bdc803e185
Make Python 3 able to read settings files with Unicode characters
...
SearX currently doesn't start up when run with Python 3 as it tries to parse the
settings.yml file with ASCII codecs.
There are similar problems with engines_languages.json and currencies.json
Python 3 requires that files with Unicode characters be read with a 'b' flag.
This also works with Python 2 and hence can be integrated into the main source
code.
Tested with the latest Python 3.6.4rc1 on Debian unstable.
Signed-off-by: Joseph Nuthalapati <njoseph@thoughtworks.com>
2017-12-21 17:33:19 +05:30
2d5eed9b59
send constant cookie with query to Google
2017-12-18 21:38:52 +01:00
7752b0a807
[fix] gigablast url parameter change - fixes #1107
2017-12-09 21:00:08 +01:00
4d1770398a
remove 'all' option from search languages
2017-12-06 01:20:15 -06:00
1613c6319e
[fix] handle /sorry redirects
2017-12-05 20:38:34 +01:00
1088c2a75d
[fix] do not crash if publication date is missing in pubmed engine
2017-12-01 20:54:12 +01:00
801b5a56ad
[fix] multiple fixes in pdbe engine
2017-12-01 20:54:12 +01:00
0969e50c5b
[fix] convert json engine result attributes to string - closes #1006
2017-12-01 20:54:12 +01:00
6eb9503896
[fix] use english in google engine if no language was set - this prevents guessing the language by the IP of the instance
2017-11-22 22:56:47 +01:00
6fdb6640d9
[fix] revert language changes to prevent CAPTCHAs
2017-11-22 22:50:48 +01:00
9ab8536479
[fix] fix language support of google
2017-11-21 16:28:53 +01:00
4340c0b16c
Fixed typos.
2017-11-07 14:14:20 +00:00
2231b02add
Fixed the currency_convert engine.
2017-11-07 13:29:17 +00:00
00a7041daa
Merge pull request #1068 from Apply55gx/genius
...
Continuation of PR #1004 (seems abandoned)
2017-11-03 20:21:25 +01:00
7a9b18e9e9
[mod] add more error handling to json engine II.
2017-11-02 01:08:15 +01:00
181f1c6305
[mod] add more error handling to json engine
2017-11-02 00:43:29 +01:00
5954a8e16a
minor fix of BASE engine
2017-11-01 17:02:38 +01:00
d20bba6dc7
minor fixes of pubmed engine
...
Closes #1045
2017-11-01 17:02:38 +01:00
df0d915806
[add] pubmed engine
2017-11-01 17:02:38 +01:00
9c2b7a82f0
minor fixes of arxiv
...
Closes #1050
2017-11-01 14:22:22 +01:00
e391b2d970
[fix] remove .encode for python3 compatibility
2017-11-01 11:54:55 +01:00
5278fa666c
[enh] use format to concatenate strings
2017-11-01 11:54:38 +01:00
3e3672e079
[add] arxiv engine
2017-11-01 11:54:16 +01:00
d800e3fcfa
Merge pull request #1 from asciimoo/master
...
-
2017-10-25 10:44:28 +02:00
18a4e7035f
removed unused indicies array
2017-10-25 10:42:37 +02:00
44085e31d0
update engines_languages.json and languages.py
...
Also, fix fetch_languages.py so it can run on python3.
2017-10-10 16:53:28 -05:00
a524dbb823
[fix] language support for bing images and videos
2017-10-10 16:49:49 -05:00
33fd938016
[mod] int_or_zero refactored to searx_utils
2017-09-04 20:05:04 +02:00
c3232b0e1a
Merge branch 'master' into nyaa
2017-09-04 17:48:25 +02:00
234366b900
Merge pull request #1018 from misnyo/generalfile
...
[mod]generalfile engine removed
2017-09-03 23:09:49 +02:00
c505c3c1ca
Merge pull request #1019 from misnyo/gigablast
...
[fix] gigablast api fix
2017-09-03 23:09:33 +02:00
b91772eff1
[fix] gigablast pep8 fix
2017-08-31 21:49:19 +02:00
01330f71cd
[fix] nyaa.si fixed
2017-08-31 21:32:30 +02:00
1e2b60f380
[mod] tokyotoshokan dependecy to other engine removed
2017-08-31 21:31:40 +02:00
3182ba7069
[fix] google news dom xpath fix
2017-08-31 17:48:07 +02:00
8849606e5f
[fix] gigablast api fix
2017-08-31 16:57:57 +02:00
2d66df0548
[mod]generalfile engine removed
2017-08-31 15:51:16 +02:00
e74aaa781e
Merge pull request #1016 from misnyo/blekko
...
[mod]blekko images removed
2017-08-30 21:48:36 +02:00
610117d054
Merge pull request #1015 from misnyo/digg
...
[fix] digg now requires cookie for search
2017-08-30 21:35:12 +02:00
6e92fb383a
[fix] digg cookie characters created in module import
2017-08-30 21:14:12 +02:00
20d2d4dab1
[fix] pep8 fix for faroo engine
2017-08-30 21:09:03 +02:00
0607b167f8
[fix] faroo json api and image layout fixed
2017-08-30 21:09:03 +02:00
a49cc18f9c
[fix] digg now requires cookie for search
2017-08-30 19:51:33 +02:00
f139f9cfdb
[mod]blekko images removed
2017-08-30 16:47:56 +02:00
d14e2781b2
[fix]torrentz search engine fixed for new version
2017-08-25 00:52:35 +02:00
2434c29dc5
New engine: Genius (lyrics)
2017-08-19 19:05:17 -05:00
3ca9cad927
add bing videos engine
2017-08-05 20:35:57 -05:00
856dfc3018
add google videos
2017-07-26 15:49:16 +02:00
077d8efed8
[fix] use poolrequests in ddg engines
2017-07-21 16:23:20 +02:00
0f6612bb40
[mod] separate engine load and initialization
2017-07-21 14:27:25 +02:00
1794f6a4d3
[enh] add "inactive" attribute to engines
...
This modification allows us to deactivate engines in settings.yml
without commenting them out
2017-07-20 13:32:20 +02:00
405e5c8f24
[fix] duckduckgo images doesn't fail with countryless language
2017-07-10 18:41:50 +02:00
9b82cb1908
[fix] is_valid_lang fixed for new languages.py + dictzone engine encoding
2017-06-25 18:29:19 +02:00
5835ebf955
fix github url
2017-06-18 21:53:10 +04:00
c361811cb5
[fix] fix xpath of google images
2017-06-13 19:47:56 +02:00
343ac7197d
[fix] pep8
2017-06-06 23:37:42 +02:00
78365ffb8a
[enh] add init function to engines which loads parallel
2017-06-06 22:20:20 +02:00
3b950929b1
[fix] fix duckduckgo's offset
...
First page now starts with 0 offset,
rather than starting on the 30th result.
DuckDuckGo returns 30 results on each page.
2017-05-27 21:12:39 -05:00
c65a409f0d
add duckduckgo images engine
2017-05-23 20:07:09 +02:00
1972a044a3
[fix] produce valid urls if scheme is missing
2017-05-22 15:48:37 +02:00
8db527c1d2
[fix] use raw response with etree.parsefromstring - Unicode strings with encoding declaration are not supported
2017-05-22 15:36:52 +02:00
a4f7046b8f
[fix] pep8
2017-05-18 22:19:44 +02:00
2a9339f4b7
[fix] add more description on possible search tpyes
2017-05-18 22:04:31 +02:00
2db807368c
[enh] make search type of mediawiki configurable
2017-05-18 21:34:54 +02:00
9ee8e552da
[fix] bing images
2017-05-17 15:45:55 +02:00
c233bf0df9
[fix] framalibre : remove result['thumbnail'] (not used)
2017-05-15 17:28:21 +02:00
f5128c7cb9
[mod] add/modify image fetching for bing_news, qwant and twitter engines
2017-05-15 17:28:21 +02:00
52e615dede
[enh] py3 compatibility
2017-05-15 12:02:30 +02:00
46a2c63f8e
[fix] yahoo news date parsing
2017-04-08 19:45:04 +02:00
12d91c1d67
[mod] searx doesn't crash at startup when an engine can't be loaded (see #884 )
2017-04-08 17:38:46 +02:00
45d15bd6f0
Add framalibre engine
...
framalibre.org is a catalogue of Free Software, edited by Framasoft.
For now we pass the thumbnail as img_src as it doesn't seem to be used
for IT...
2017-03-22 00:18:23 +01:00
fd65c12921
make search language handling less strict
...
languages.py can change, so users may query on a language that is not
on the list anymore, even if it is still recognized by a few engines.
also made no and nb the same because they seem to return the same,
though most engines will only support one or the other.
2017-03-18 23:44:21 +01:00
805fb02ed1
add language support for qwant
...
closes issue #863
2017-03-18 23:44:21 +01:00
742e4dfdcc
[fix] fix paging of duckduckgo
2017-02-01 20:54:13 +01:00
52d1087202
[enh] add result number parsing to google engine
2017-01-27 00:18:46 +01:00
57149661e4
Merge pull request #830 from davidar/se
...
Semantic Scholar
2017-01-18 23:50:11 +01:00
b1d49bacb0
Merge pull request #827 from davidar/spell
...
[enh] show spelling corrections
2017-01-18 23:49:01 +01:00
7492997c51
[fix] allow empty content
2017-01-17 21:14:33 +10:00
1d30141c20
[enh] show spelling corrections
2017-01-16 13:31:16 +10:00
39a97825d9
Add torrent infos
2017-01-15 16:13:23 +01:00
4776abd1ac
Remove categories
2017-01-15 16:13:23 +01:00
a320328dda
Fix test
2017-01-15 16:13:23 +01:00
0549fb40d2
Add 1337x.to engine
2017-01-15 16:13:23 +01:00
108392f8da
[fix] skip non-complete google news results
2017-01-10 11:03:05 +01:00
0d4da30c7f
[enh] add instant answers to google engine
2017-01-05 17:20:12 +01:00
525e5d275c
Merge pull request #801 from dalf/extract_text
...
[fix] extract_text: use html.tostring instead html_to_text.
2017-01-02 12:36:50 +01:00
90e1db3e5c
[fix] extract_text: use html.tostring instead html_to_text. Fix #711
2016-12-31 13:56:09 +01:00
6bf9c398a7
[fix] use english as default language in bing
...
If no language is specified, bing returns results with multiple languages
for one query which isn't really useful. Setting english as default
insted if nothing.
2016-12-30 18:17:14 +01:00
1175b3906f
change language list to only include languages with a minimum of engines
...
that support them.
users can still query lesser supported through the :lang_code bang.
2016-12-29 01:55:30 -06:00
Noémi Ványi
Venca24
Léo Bourrel
Michael Pfitzner
d-tux
dimqua
dimqua
Adam Tauber
Alice Ferrazzi
dadosch
Alice Ferrazzi
Noémi Ványi
Marc Abonce Seguin
rinpatch
Joseph Nuthalapati
marc
pyrrh0n1c
jibe-b
Apply55gx
misnyo
misnyo
woorst
potato
vache asatryan
Dalf
François Revol
David A Roberts
jcherqui