1057e42cfd
[fix] update digg engine
2019-10-16 15:11:42 +02:00
7177c9e12f
[fix] update devianart engine
2019-10-16 14:42:31 +02:00
6ca1622378
[fix] update 1x engine
2019-10-16 13:27:05 +02:00
c98a2df36d
[fix] enable paging support for arxiv engine
2019-10-16 13:12:17 +02:00
ed1c1bdb04
[fix] pep8
2019-10-14 15:09:39 +02:00
77a70fe541
[fix] update startpage engine - closes #1601
2019-10-14 14:18:41 +02:00
94ea9d6622
[fix] duckduckgo paging - closes #1677
2019-10-14 13:52:15 +02:00
bb4d223770
[fix] google images
2019-08-26 21:54:01 -07:00
88261e111c
Fix bing engine results count ( #1387 )
...
This PR fixes the result count from bing which was throwing an (hidden) error and add a validation to avoid reading more results than avalaible.
For example :
If there is 100 results from some search and we try to get results from 120 to 130, Bing will send back the results from 0 to 10 and no error. If we compare results count with the first parameter of the request we can avoid this "invalid" results.
2019-08-05 16:15:40 +02:00
1cee2c1796
[fix] bing engine
...
before this commit, sometimes there are no results
use a generic user-agent instead of one with the OS "Windows NT 6.3; WOW64"
2019-08-05 15:46:40 +02:00
fcc9587ee9
[fix] fdroid engine
2019-08-05 15:44:02 +02:00
fbf6b689dd
[fix] dictzone engine
2019-08-05 15:43:21 +02:00
9ff5001816
[fix] arxiv engine
2019-08-05 15:43:01 +02:00
2179079a91
[fix] fix flickr_noapi decoding ( #1655 )
...
Characters that were not ASCII were incorrectly decoded.
Add an helper function: searx.utils.ecma_unescape (Python implementation of unescape Javascript function).
2019-08-02 13:37:13 +02:00
4dc792e1e2
[enh] add invidious engine. ( #1657 )
...
closes #1372
2019-08-02 13:25:25 +02:00
b2e1ee8d35
Fix some more errors with none/wrong credentials
2019-07-31 21:09:02 +02:00
275b37cc7c
Fix error if the user hasn't set api credentials
2019-07-31 21:01:24 +02:00
c329ea135e
Fix spotify engine
2019-07-31 20:44:41 +02:00
0c032c8429
[fix] youtube_noapi engine: fix the title
2019-07-31 08:39:40 +02:00
8b7ac56669
[fix] google_videos engine: some results don't a thumbnail
2019-07-31 08:38:45 +02:00
d44677e226
[fix] dailymotion engine: remove HTML tags from the description
2019-07-31 08:37:51 +02:00
6e0285b2db
[fix] wikidata engine: faster processing, remove one HTTP redirection.
...
* Search URL is https://www.wikidata.org/w/index.php?{query}&ns0=1 (with ns0=1 at the end to avoid an HTTP redirection)
* url_detail: remove the disabletidy=1 deprecated parameter
* Add eval_xpath function: compile once for all xpath.
* Add get_id_cache: retrieve all HTML with an id, avoid the slow to procress dynamic xpath '//div[@id="{propertyid}"]'.replace('{propertyid}')
* Create an etree.HTMLParser() instead of using the global one (see #1575 )
2019-07-29 07:39:39 +02:00
cbc5e13275
[enh] flickr_noapi: use complete JSON data block, add 'content', 'img_format', 'source', etc. ( #1571 )
...
Fetch complete JSON data block, use legend to extract images.
Unquote urlencoded strings.
Add image description as 'content'.
Add 'img_format' and 'source' data (needs PR #1567 to enable this data to be displayed).
Show images which lack ownerid instead of discarding them.
2019-07-28 10:42:00 +02:00
204a2cbbf0
[fix] bing_videos ( #1579 )
...
use JSON where possible, compose 'content' using all available data, use correct 'url' (direct to source instead of redirect through bing)
2019-07-27 17:49:30 +02:00
23611897ec
[fix] make sure then engine name is lower case
...
Minor fix: "%s engine initialized" display the right engine name
2019-07-27 08:52:30 +02:00
11fc9913e9
[enh] bing_images: use data from embedded JSON to improve results (e.g. real page title) ( #1568 )
...
use data from embedded JSON to improve results (e.g. real page title), add image format and source info (see PR #1567 ), improve paging logic (it now works)
2019-07-27 08:22:02 +02:00
f34b5cedb1
[fix] fixes google play engines ( #1651 )
...
update commit 87baa74a86
2019-07-25 09:31:47 +02:00
eb182df132
[mod] restore btdigg engine as btdig.com ( #1515 )
2019-07-25 08:40:48 +02:00
3b1122c5fa
[fix] fix duden engine ( #1594 )
2019-07-25 08:17:45 +02:00
87baa74a86
[fix] fixes google play engines and adds thumbnails to their results ( #1612 )
...
fix google play apps, google play apps, google play music engines
xpath engine: thumbnail_xpath can define an optional thumbnail
2019-07-25 07:46:41 +02:00
da0ce5880f
[fix] fix soundcloud engine, speed up searx start time
2019-07-19 08:59:11 +02:00
45702b77ca
embedded iframe (youtube, dailymotion, vimeo): use https
2019-07-13 15:49:59 +02:00
cbd1ebdce8
[fix] Force Google old UI ( #1597 )
2019-05-29 10:05:57 +09:00
4b7332286a
Use string formatter to create source and img_format labels ( #1566 )
...
google_images : use JSON embedded in HTML (engine expected pure JSON)
2019-05-28 12:33:31 +09:00
ffe0972f91
Remove some engines : subtitleseeker, seedpeer, swisscows
...
http://www.subtitleseeker.com and http://www.seedpeer.eu don't exist anymore.
https://swisscows.ch/ has change : the engine needs to be updated
2019-05-28 04:06:35 +02:00
df2b9a76f7
Merge branch 'master' into ne/fix-google-image-search
2019-04-14 13:55:00 +02:00
1c6ab79b9f
Fix google image search
...
- Because there is not full image url in the dom, we replace "image_url" with the same url as the "url" (url of source).
See example HTML https://gist.github.com/Nachtalb/2dea8a4d2c723c49226ad9645838121f
- Remove unused import
- Fix google image search title
- Keep google image safe value up to date
2019-04-14 12:03:25 +02:00
3e1c2153f7
[fix] duckduckgo images requests
2019-04-13 00:38:37 -05:00
f2d49a6971
[fix] get youtube results from js object
...
Results are not appearing in the html document anymore,
instead they are found inside an object embedded in a script.
2019-03-26 21:09:15 -06:00
f7bdd827c4
[enh] adds apkmirror search engine
2019-02-13 00:37:29 +01:00
bf4a38ad66
Remove asksteem
2019-01-28 11:02:43 +01:00
f1814079f0
Merge branch 'master' into engines/unsplash
2019-01-14 13:40:57 +01:00
626a8e9ac9
[fix] unicode error with WolframAlpha API engine
2019-01-08 21:02:23 -06:00
329172f66e
Merge branch 'master' into engines/unsplash
2019-01-08 09:24:45 +01:00
97351a2c72
fix after rebase
2019-01-07 21:28:58 +01:00
b63d645a52
Revert "remove 'all' option from search languages"
...
This reverts commit 4d1770398a
2019-01-07 21:19:00 +01:00
0169b63e84
[fix] fetch google's supported languages
2019-01-06 21:31:45 -06:00
51111c2594
[fix] always set langauge_aliases even if it's empty
2019-01-06 20:49:56 -06:00
5568f24d6c
[fix] check language aliases when setting search language
2019-01-06 20:31:57 -06:00
2456b8f571
[mod] google videos
2019-01-05 12:12:09 +01:00
1ea56576dc
Merge branch 'master' into devel_google_videos
2019-01-04 22:27:05 +01:00
aeb6dab187
Merge branch 'master' into master
2019-01-04 22:14:40 +01:00
5b81f7c2cc
Merge branch 'master' into bugfix_startpage
2019-01-04 22:03:00 +01:00
cf26aba93b
[FIX] google videos thumbnails
2019-01-04 15:48:22 +01:00
73ec2ba74e
Update bing image engine with new image json format
2018-12-19 11:12:25 +01:00
44ce51f0c5
restore startpage search results
2018-12-14 21:38:48 +01:00
4a127b19de
Merge branch 'master' into engines/unsplash
2018-12-14 07:06:19 +01:00
0d86ed9c7e
update startpage.py
2018-12-11 21:45:47 +03:00
442772a6c5
remove findx engine ( #1452 )
2018-12-02 22:39:04 +01:00
0bdf090ed7
[fix] google videos engine
2018-11-22 13:00:34 +01:00
b9ada93b3a
Removes what looks like tracking parameters
2018-10-08 14:56:20 +02:00
72d063d27d
Uses the raw url for the image result, rather than the full
...
size result.
2018-10-08 14:01:35 +02:00
cd7849ffc8
Adds the Unsplash image engine
2018-10-08 09:18:42 +02:00
052a71d05a
Merge pull request #1368 from aliceinwire/gentoo_engine
...
Add Gentoo wiki search engine
2018-08-21 16:24:34 +02:00
d24c58cf4e
Fix pep8 errors
2018-08-21 22:55:51 +09:00
ff2eac9f6b
Fix choosing languges function
...
Searching for english is now giving all pages results.
Instead searching for a specific language different from english
is correctly returning only translated pages for the selected language.
2018-08-21 22:55:39 +09:00
baacfac32b
[fix] remove publicly unavailable 500px engine - #1338
2018-08-19 15:06:59 +02:00
b575f898c0
duden.de engine
2018-08-18 19:24:02 +02:00
845ba79e75
[fix] update qwant search url
...
thx to @dalf for the fix (#1365 )
2018-08-13 12:38:19 +02:00
5f0888b8f4
added languages to Gentoo engine
2018-08-12 23:00:57 +09:00
b7886bb15c
gentoo engine test
2018-08-12 23:00:57 +09:00
d51732c0e5
Merge pull request #1303 from MarcAbonce/bing
...
Fix bing "garbage" results
2018-07-09 11:00:37 +02:00
7a474db61b
Fix formatting
2018-07-06 10:31:01 +02:00
acaef6600e
Update path to wikidata image
2018-07-05 10:11:45 +02:00
f82ead3e30
[fix] add py3 compatibility to base engine - closes #1319
2018-06-14 11:50:03 +02:00
57e7e9da98
[fix] use html result page in google images (previous endpoint stopped working)
2018-06-14 11:40:39 +02:00
16915116e0
fix piratebay url
...
Closes #1229
2018-05-21 16:58:39 +02:00
75b276f408
fix bing "garbage" results (issue #1275 )
2018-05-20 18:13:32 -05:00
b843c1351a
add missing parameter to gigablast search url
...
Closes #1293
2018-05-16 22:26:32 +02:00
059c2ccb95
Fix acgsou encoding error on python2 and add unicode characters to unit testt
2018-05-05 23:41:13 +03:00
3b89ce9bfa
Switch acgsou to http
2018-05-03 08:34:21 +03:00
1a1f9852f1
Merge pull request #1283 from rinpatch/acgsou-engine
...
[Feature] Acgsou as a searchable engine
2018-04-28 22:42:35 +02:00
f6695cea59
Fix nyaa to use https
2018-04-27 17:55:42 +03:00
f17e54a396
Forgot to remove print command used for debugging
2018-04-27 15:40:42 +03:00
dcc9fdb47f
Added unit test
2018-04-27 15:36:15 +03:00
e3bd2670d7
Traling whitespace
2018-04-27 08:36:11 +03:00
86f47689fe
Hopefully fix code style errors(again)(again)
2018-04-27 08:32:43 +03:00
b8b23d8006
Hopefully fix code style errors(again)
2018-04-27 08:29:17 +03:00
fb364ffae7
Hopefully fix code style errors
2018-04-27 08:23:58 +03:00
3ec35a06f7
Added Engine
2018-04-26 22:42:31 +03:00
cd1374d2f2
added whitespaces
2018-04-22 14:12:32 +03:00
a305dae9d8
switched currency convert to duckduckgo and added Bitcoin to currency list
2018-04-22 13:46:13 +03:00
25b48143ea
fix findx engine
2018-04-21 20:02:52 +02:00
f7f9c50393
[fix] force English results in Google when using en-US
2018-04-18 23:29:48 -05:00
b12857a70d
[fix] make search requests on wikidata more accurate
2018-04-08 21:17:00 -05:00
835d1edd58
[fix] google news xpath
2018-04-08 20:56:05 -05:00
343e555ee9
[fix] append http if no scheme is provided in xpath's extact_url
...
This solves a bug with Yahoo where some results don't specify
a protocol.
2018-04-08 20:35:34 -05:00
283f6c9053
Merge pull request #1252 from MarcAbonce/search-languages
...
[mod] Refactor engine's search language handling
2018-04-05 17:27:07 +02:00
772c048d01
refactor engine's search language handling
...
Add match_language function in utils to match any user given
language code with a list of engine's supported languages.
Also add language_aliases dict on each engine to translate
standard language codes into the custom codes used by the engine.
2018-03-27 00:08:03 -06:00
8cc529e9a3
forward category to engine without highlighting on the ui
2018-03-22 11:02:24 +01:00
Adam Tauber
Marc Abonce Seguin
Léo Bourrel
Dalf
cy8aer
0xhtml
Frank de Lange
volth
rachmadani haryono
Venca24
Emilien Devos
Nick Espig
Jonas Zohren
d-tux
Noémi Ványi
Venca24
Noémi Ványi
Michael Pfitzner
dimqua
dimqua
Alice Ferrazzi
dadosch
Alice Ferrazzi
rinpatch