c98a2df36d
[fix] enable paging support for arxiv engine
2019-10-16 13:12:17 +02:00
ed1c1bdb04
[fix] pep8
2019-10-14 15:09:39 +02:00
77a70fe541
[fix] update startpage engine - closes #1601
2019-10-14 14:18:41 +02:00
94ea9d6622
[fix] duckduckgo paging - closes #1677
2019-10-14 13:52:15 +02:00
88261e111c
Fix bing engine results count ( #1387 )
...
This PR fixes the result count from bing which was throwing an (hidden) error and add a validation to avoid reading more results than avalaible.
For example :
If there is 100 results from some search and we try to get results from 120 to 130, Bing will send back the results from 0 to 10 and no error. If we compare results count with the first parameter of the request we can avoid this "invalid" results.
2019-08-05 16:15:40 +02:00
1cee2c1796
[fix] bing engine
...
before this commit, sometimes there are no results
use a generic user-agent instead of one with the OS "Windows NT 6.3; WOW64"
2019-08-05 15:46:40 +02:00
fcc9587ee9
[fix] fdroid engine
2019-08-05 15:44:02 +02:00
fbf6b689dd
[fix] dictzone engine
2019-08-05 15:43:21 +02:00
9ff5001816
[fix] arxiv engine
2019-08-05 15:43:01 +02:00
2179079a91
[fix] fix flickr_noapi decoding ( #1655 )
...
Characters that were not ASCII were incorrectly decoded.
Add an helper function: searx.utils.ecma_unescape (Python implementation of unescape Javascript function).
2019-08-02 13:37:13 +02:00
4dc792e1e2
[enh] add invidious engine. ( #1657 )
...
closes #1372
2019-08-02 13:25:25 +02:00
0c032c8429
[fix] youtube_noapi engine: fix the title
2019-07-31 08:39:40 +02:00
8b7ac56669
[fix] google_videos engine: some results don't a thumbnail
2019-07-31 08:38:45 +02:00
d44677e226
[fix] dailymotion engine: remove HTML tags from the description
2019-07-31 08:37:51 +02:00
6e0285b2db
[fix] wikidata engine: faster processing, remove one HTTP redirection.
...
* Search URL is https://www.wikidata.org/w/index.php?{query}&ns0=1 (with ns0=1 at the end to avoid an HTTP redirection)
* url_detail: remove the disabletidy=1 deprecated parameter
* Add eval_xpath function: compile once for all xpath.
* Add get_id_cache: retrieve all HTML with an id, avoid the slow to procress dynamic xpath '//div[@id="{propertyid}"]'.replace('{propertyid}')
* Create an etree.HTMLParser() instead of using the global one (see #1575 )
2019-07-29 07:39:39 +02:00
cbc5e13275
[enh] flickr_noapi: use complete JSON data block, add 'content', 'img_format', 'source', etc. ( #1571 )
...
Fetch complete JSON data block, use legend to extract images.
Unquote urlencoded strings.
Add image description as 'content'.
Add 'img_format' and 'source' data (needs PR #1567 to enable this data to be displayed).
Show images which lack ownerid instead of discarding them.
2019-07-28 10:42:00 +02:00
204a2cbbf0
[fix] bing_videos ( #1579 )
...
use JSON where possible, compose 'content' using all available data, use correct 'url' (direct to source instead of redirect through bing)
2019-07-27 17:49:30 +02:00
23611897ec
[fix] make sure then engine name is lower case
...
Minor fix: "%s engine initialized" display the right engine name
2019-07-27 08:52:30 +02:00
11fc9913e9
[enh] bing_images: use data from embedded JSON to improve results (e.g. real page title) ( #1568 )
...
use data from embedded JSON to improve results (e.g. real page title), add image format and source info (see PR #1567 ), improve paging logic (it now works)
2019-07-27 08:22:02 +02:00
f34b5cedb1
[fix] fixes google play engines ( #1651 )
...
update commit 87baa74a86
2019-07-25 09:31:47 +02:00
eb182df132
[mod] restore btdigg engine as btdig.com ( #1515 )
2019-07-25 08:40:48 +02:00
3b1122c5fa
[fix] fix duden engine ( #1594 )
2019-07-25 08:17:45 +02:00
87baa74a86
[fix] fixes google play engines and adds thumbnails to their results ( #1612 )
...
fix google play apps, google play apps, google play music engines
xpath engine: thumbnail_xpath can define an optional thumbnail
2019-07-25 07:46:41 +02:00
da0ce5880f
[fix] fix soundcloud engine, speed up searx start time
2019-07-19 08:59:11 +02:00
45702b77ca
embedded iframe (youtube, dailymotion, vimeo): use https
2019-07-13 15:49:59 +02:00
cbd1ebdce8
[fix] Force Google old UI ( #1597 )
2019-05-29 10:05:57 +09:00
4b7332286a
Use string formatter to create source and img_format labels ( #1566 )
...
google_images : use JSON embedded in HTML (engine expected pure JSON)
2019-05-28 12:33:31 +09:00
ffe0972f91
Remove some engines : subtitleseeker, seedpeer, swisscows
...
http://www.subtitleseeker.com and http://www.seedpeer.eu don't exist anymore.
https://swisscows.ch/ has change : the engine needs to be updated
2019-05-28 04:06:35 +02:00
df2b9a76f7
Merge branch 'master' into ne/fix-google-image-search
2019-04-14 13:55:00 +02:00
1c6ab79b9f
Fix google image search
...
- Because there is not full image url in the dom, we replace "image_url" with the same url as the "url" (url of source).
See example HTML https://gist.github.com/Nachtalb/2dea8a4d2c723c49226ad9645838121f
- Remove unused import
- Fix google image search title
- Keep google image safe value up to date
2019-04-14 12:03:25 +02:00
3e1c2153f7
[fix] duckduckgo images requests
2019-04-13 00:38:37 -05:00
f2d49a6971
[fix] get youtube results from js object
...
Results are not appearing in the html document anymore,
instead they are found inside an object embedded in a script.
2019-03-26 21:09:15 -06:00
f7bdd827c4
[enh] adds apkmirror search engine
2019-02-13 00:37:29 +01:00
bf4a38ad66
Remove asksteem
2019-01-28 11:02:43 +01:00
f1814079f0
Merge branch 'master' into engines/unsplash
2019-01-14 13:40:57 +01:00
626a8e9ac9
[fix] unicode error with WolframAlpha API engine
2019-01-08 21:02:23 -06:00
329172f66e
Merge branch 'master' into engines/unsplash
2019-01-08 09:24:45 +01:00
97351a2c72
fix after rebase
2019-01-07 21:28:58 +01:00
b63d645a52
Revert "remove 'all' option from search languages"
...
This reverts commit 4d1770398a
2019-01-07 21:19:00 +01:00
0169b63e84
[fix] fetch google's supported languages
2019-01-06 21:31:45 -06:00
51111c2594
[fix] always set langauge_aliases even if it's empty
2019-01-06 20:49:56 -06:00
5568f24d6c
[fix] check language aliases when setting search language
2019-01-06 20:31:57 -06:00
2456b8f571
[mod] google videos
2019-01-05 12:12:09 +01:00
1ea56576dc
Merge branch 'master' into devel_google_videos
2019-01-04 22:27:05 +01:00
aeb6dab187
Merge branch 'master' into master
2019-01-04 22:14:40 +01:00
5b81f7c2cc
Merge branch 'master' into bugfix_startpage
2019-01-04 22:03:00 +01:00
cf26aba93b
[FIX] google videos thumbnails
2019-01-04 15:48:22 +01:00
73ec2ba74e
Update bing image engine with new image json format
2018-12-19 11:12:25 +01:00
44ce51f0c5
restore startpage search results
2018-12-14 21:38:48 +01:00
4a127b19de
Merge branch 'master' into engines/unsplash
2018-12-14 07:06:19 +01:00
Adam Tauber
Léo Bourrel
Dalf
cy8aer
Frank de Lange
volth
rachmadani haryono
Venca24
Emilien Devos
Nick Espig
Marc Abonce Seguin
Jonas Zohren
d-tux
Noémi Ványi
Venca24
Noémi Ványi
Michael Pfitzner