Commit Graph

2735 Commits

Author SHA1 Message Date
shortcutme 2e9cff928c
Skip commit if already commiting 2020-01-28 16:58:14 +01:00
shortcutme 46210b2f04
Use peer ip in peer exchange if no active connection 2020-01-28 16:57:20 +01:00
shortcutme 6dae187e22
More detailed logging on write error 2020-01-28 16:56:35 +01:00
shortcutme 11415fe082
Log mock ws caller to get more detail on random test fail 2020-01-24 16:05:19 +01:00
shortcutme ac8aaaff75
Rev4399 2020-01-22 16:37:48 +01:00
shortcutme 238ede9419
Only correct time if we have at least 9 connected peers 2020-01-22 16:37:07 +01:00
shortcutme 835174270e
Less wait for closing cursors 2020-01-22 16:36:52 +01:00
shortcutme 62a2ec7254
Make sure to commit before vacuum 2020-01-22 16:36:33 +01:00
shortcutme a9368bb3c8
Don't allow parallel sites.json loading 2020-01-22 16:35:40 +01:00
shortcutme 224093b3dd
Rev4397, Fix big file invalid path errors 2020-01-09 16:35:05 +01:00
Ivanq 77c3e43978 Detect content encoding based on query string (#2385) 2020-01-07 10:34:14 +01:00
shortcutme 03350d7454
Rev4394 2020-01-04 16:56:42 +01:00
shortcutme c5d51c9cab
Verify cert in separate function 2020-01-04 16:54:34 +01:00
shortcutme 0dbcec8092
Merge wrapper 2020-01-04 16:54:20 +01:00
shortcutme 76e4b75c2d
Fix removing loading screen without loaded content 2020-01-04 16:54:13 +01:00
shortcutme c1ad7914f1
Always update loading screen site too large message with site info received 2020-01-04 16:53:49 +01:00
shortcutme 9085a4b0cc
Less frequent update of progress bar 2020-01-04 16:53:11 +01:00
shortcutme 820346c98d
More logging to wrapper 2020-01-04 16:52:51 +01:00
shortcutme 995d87c167
Don't add escaping iframe message for link without target=_top 2020-01-04 16:52:18 +01:00
shortcutme fe739fa848
Log tasks with larger priority 2020-01-04 16:48:56 +01:00
shortcutme b6d0bf8f6b
Use msvcrt 110 and 120 when 110 is not avaliable 2020-01-04 16:48:37 +01:00
shortcutme feb58e4b0e
Rev4382, Fix is_prev_builtin startup error 2019-12-31 18:15:17 +01:00
shortcutme 163825c03e
Rev4381 2019-12-31 12:56:10 +01:00
shortcutme 3fc80f834d
New tests for worker task manager 2019-12-31 12:55:09 +01:00
shortcutme 20b0db7ddb
Thread safe task remove in failTask 2019-12-31 12:54:45 +01:00
shortcutme b2e7cbb927
Refactor task adding with less locking 2019-12-31 12:51:52 +01:00
shortcutme 5987274edf
Name task adding lock 2019-12-31 12:50:39 +01:00
shortcutme ba218974c4
Task remove optimization 2019-12-31 12:50:21 +01:00
shortcutme 721d4a22f1
Remove unnecessary log from worker task manager 2019-12-31 12:49:59 +01:00
shortcutme 32b0153d34
Log site address with getfile error 2019-12-31 12:46:01 +01:00
shortcutme 71d32d7414
Less slow query loggin 2019-12-31 12:45:36 +01:00
shortcutme 796ee572ce
Fix verify invalid json 2019-12-31 12:44:47 +01:00
shortcutme 60146a083c
Fix ui_websocket test result with None 2019-12-21 03:30:27 +01:00
shortcutme df87bd41b4
Log WsMock sent data itself to figure out random Crypt test fail 2019-12-21 03:22:37 +01:00
shortcutme 48124e12d9
Rev4372 2019-12-21 03:05:49 +01:00
shortcutme 17fb740c51
Don't try to download bad files again in tests to avoid random test fails 2019-12-21 03:05:19 +01:00
shortcutme c6b07f1294
Wait until checkmodification spawned pools are finishing 2019-12-21 03:04:36 +01:00
shortcutme 3ccce46314
Wait until downloadContent pool finishes 2019-12-21 03:03:49 +01:00
shortcutme 7c1da5da52
Abilty to disable file bad file retry at end of download 2019-12-21 03:03:32 +01:00
shortcutme c5de1447c8
onComplete will be triggered by WorkerManager 2019-12-21 03:02:53 +01:00
shortcutme e16ace433c
Better logging in site download content 2019-12-21 03:02:36 +01:00
shortcutme 975f53b95b
New logging format for tests 2019-12-21 03:01:45 +01:00
shortcutme 8a994b5559
Ask before UiWebsocket server shutdown action 2019-12-21 02:59:50 +01:00
shortcutme 2acf24c336
Fix ipv4 checking regexp 2019-12-21 02:59:18 +01:00
shortcutme 2c3f1ba7ad
Check if all task are complete on fail task 2019-12-21 02:59:04 +01:00
shortcutme c01245a4e0
Log task fail 2019-12-21 02:58:48 +01:00
shortcutme f119f7d0d2
Use faster and thread safe way to re-sort tasks 2019-12-21 02:58:35 +01:00
shortcutme 62d4edadf6
Fail task if no peer left to try 2019-12-21 02:57:53 +01:00
shortcutme 8bf17d3a69
Add reason for Worker actions 2019-12-21 02:57:25 +01:00
shortcutme 0881e274a9
Log lock waits for task adding in WorkerManager 2019-12-21 02:56:42 +01:00
shortcutme 7ca09ba75b
Fix updating key 0 in WorkerTaskManager 2019-12-21 02:55:22 +01:00
shortcutme 69eb831c7e
Rev4361 2019-12-19 02:17:21 +01:00
shortcutme 99e6326974
More compact stack logging 2019-12-19 02:17:13 +01:00
shortcutme 50bbe47bf2
Better logging on file update 2019-12-19 02:17:00 +01:00
shortcutme 8bfef12ad4
Don't try to pack unknown peer addresses 2019-12-19 02:16:41 +01:00
ZeroNet 6085cfd1a7
Merge pull request #2364 from Zaefarani/patch-1
Add Farsi (Persian) Translation to ZeroNet
2019-12-18 19:29:26 +01:00
shortcutme d660a268e8
Rev4360 2019-12-18 16:43:58 +01:00
shortcutme c161140a90
Add locking for db cursor 2019-12-18 16:43:46 +01:00
shortcutme 7af8d1cd93
Save last lock time 2019-12-18 16:42:47 +01:00
shortcutme 845b50915d
Rev4358 2019-12-18 15:32:50 +01:00
shortcutme 7ecf09a496
Allow to change test log dir with environmental variable 2019-12-18 15:24:05 +01:00
shortcutme c0639fef75
Lock task adding to avoid race condition when getFileInfo switches 2019-12-18 15:23:16 +01:00
Hamid reza Zaefarani 1fe7127082
Rename fa,json to fa.json 2019-12-18 14:35:54 +03:30
shortcutme 9c08e41b9e
Rev4355 2019-12-17 21:03:01 +01:00
shortcutme abee87bbec
Wait for threadpool kill with 1s timeout to fix memory leak test 2019-12-17 21:02:48 +01:00
shortcutme a7c26f893f
Rev4354 2019-12-17 20:46:29 +01:00
Hamid reza Zaefarani 24b8cdf87a
Add Farsi (Persian) Translation to ZeroNet
Persian Translation of ZeroNet Site
2019-12-17 23:15:51 +03:30
shortcutme 77869830c5
Fix shutdown hang 2019-12-17 20:36:52 +01:00
shortcutme 87fc8ced5e
Accept only my exception when testing Noparallel 2019-12-17 16:06:13 +01:00
shortcutme e7e8e59c1e
Rev4353 2019-12-17 15:08:42 +01:00
shortcutme f3665b172f
Avoid unnecessary pool call 2019-12-17 15:07:32 +01:00
shortcutme 23b3cd3986
Better rebuild log message 2019-12-17 15:07:00 +01:00
shortcutme f7ee6744af
Db busy event waited in getDb 2019-12-17 15:06:36 +01:00
shortcutme ac45217816
Add reason for db close and rebuilds 2019-12-17 15:05:59 +01:00
shortcutme 8c51e81a0b
Fix double opening of dbs 2019-12-17 15:05:21 +01:00
shortcutme 98c98fbac7
Thread safe method to create directory for db 2019-12-17 15:02:18 +01:00
shortcutme 9b1f6337c3
Wait for cursor finish on db close 2019-12-17 15:02:04 +01:00
shortcutme 2019093431
Fix testing on slower storage 2019-12-17 15:01:15 +01:00
shortcutme eac25caf28
Log packing peer arrors as debug 2019-12-17 15:00:23 +01:00
shortcutme b421893434
Return timer greenet 2019-12-17 15:00:09 +01:00
shortcutme f1b19f5fc7
Fix DbQuery logging 2019-12-17 14:59:54 +01:00
shortcutme 61f1a741fc
Test main loop caller 2019-12-17 14:52:58 +01:00
shortcutme f01d335835
Test noparallel multi thread compatibility 2019-12-17 14:52:13 +01:00
shortcutme 5c1b34387c
Noparallel multi thread compatibility 2019-12-17 14:51:57 +01:00
shortcutme dfd55c3957
Fix memory leak when using sleep in threads 2019-12-17 14:50:38 +01:00
shortcutme b21895fa78
Kill threadpool properly 2019-12-17 14:50:10 +01:00
shortcutme 495d695c5a
Fix threadpool apply and spawn when threadpool is full 2019-12-17 14:49:50 +01:00
shortcutme 3309489c24
Only call the function in separate thread when in the main loop 2019-12-17 14:48:11 +01:00
shortcutme 8a5a75e68f
Allow pass calls to the main loop 2019-12-17 14:47:27 +01:00
shortcutme c1df78b97f
Name threadpools 2019-12-17 14:43:33 +01:00
shortcutme 4c31aae97b
Refactor worker, fix concurrent write errors 2019-12-17 14:42:33 +01:00
shortcutme 0839fdfc5e
Add reason for db close 2019-12-17 14:35:49 +01:00
shortcutme d062f01127
Log temp site events under different name 2019-12-17 14:34:53 +01:00
shortcutme e91fb90a45
Fix tests when running for long time 2019-12-17 14:34:29 +01:00
shortcutme 6539ca5eb0
Log spy actions to file when running tests 2019-12-17 14:33:06 +01:00
shortcutme b138ebc519
Capture fd for pytest 2019-12-17 14:32:43 +01:00
shortcutme 79c1cd15ab
Use libev when running test 2019-12-17 14:32:17 +01:00
shortcutme 10c1986c54
Fix site list changing during listing 2019-12-17 14:31:55 +01:00
shortcutme d7cabb47ca
Log task numbers on content.json start 2019-12-17 14:31:41 +01:00
shortcutme 8de1714f08
Fix onComplete call when donwload end 2019-12-17 14:31:12 +01:00
shortcutme 20ba9cd589
Log site download time 2019-12-17 14:30:29 +01:00
shortcutme af1ac9bce8
Try to find already running task for file before start a new one 2019-12-17 14:30:14 +01:00
shortcutme 31a6e3ee9a
Don't allow clone to run in parallel 2019-12-17 14:29:48 +01:00
shortcutme dca1dcdd2d
Use always active connection in DbCursor 2019-12-17 14:28:52 +01:00
shortcutme a54f5f3e9f
Change trackers to more stable onces 2019-12-17 14:26:14 +01:00
shortcutme 51f49cd45a
Always use libev if possible 2019-12-17 14:25:04 +01:00
shortcutme eb63eb7b1d
Log startup errors in log file 2019-12-17 14:24:44 +01:00
shortcutme b4f7e51e96
Limit stack size on formatting 2019-12-17 14:24:08 +01:00
shortcutme c2d2189039
Log content init failed as info 2019-12-17 14:23:47 +01:00
shortcutme 1eda3258de
Always raise error on verify error 2019-12-17 14:23:31 +01:00
shortcutme 0171cb0844
Avoid get db_inner_path for every file on signing 2019-12-17 14:23:18 +01:00
shortcutme 08a0a63631
Create ssl contexts only once 2019-12-17 14:22:29 +01:00
shortcutme 8ed7d0385d
If possible use loaded db to get db file inner_path 2019-12-17 14:21:47 +01:00
shortcutme 02d45e9c39
Use separate threadpool for batch site storage operations 2019-12-17 14:20:49 +01:00
shortcutme 2a402a0674
Use thread-safe mode to create directories 2019-12-17 14:18:54 +01:00
shortcutme 958882c1c5
Revert "Switch to sslcrypto for cryptography tasks (#2338)"
This reverts commit fbc7b6fc4f.
2019-12-15 18:30:42 +01:00
ZeroNet 2f7323043f
Merge pull request #2358 from imachug/bencode
Switch to bencode_open
2019-12-15 12:49:04 +01:00
Ivanq fbc7b6fc4f Switch to sslcrypto for cryptography tasks (#2338)
* Use sslcrypto instead of pyelliptic and pybitcointools

* Fix CryptMessage

* Support Python 3.4

* Fix user creation

* Get rid of pyelliptic and pybitcointools

* Fix typo

* Delete test file

* Add sslcrypto to tree

* Update sslcrypto

* Add pyaes to src/lib

* Fix typo in tests

* Update sslcrypto version

* Use privatekey_bin instead of privatekey for bytes objects

* Fix sslcrypto

* Fix Benchmark plugin

* Don't calculate the same thing twice

* Only import sslcrypto once

* Handle fallback sslcrypto implementation during tests

* Fix sslcrypto fallback implementation selection
2019-12-15 12:46:06 +01:00
Ivanq 3178b69172 Switch to bencode_open 2019-12-12 17:46:16 +03:00
shortcutme 28fcf3c1ea
Rev4327 2019-12-11 20:04:50 +01:00
shortcutme 71939097b0
Make execution order test more predictable 2019-12-11 20:04:39 +01:00
shortcutme 2fd337bb55
Add wasm content type 2019-12-11 20:03:28 +01:00
shortcutme 5e26161e84
Rev4325 2019-12-04 17:16:08 +01:00
shortcutme 04ecb89e9a
Avoid sending too many publish request to an outdated client 2019-12-04 17:15:42 +01:00
shortcutme 23f851343f
Fix exception when params is an iterator 2019-12-04 17:15:08 +01:00
shortcutme 5ce1782d05
Change journal and foreign keys mode on db connect 2019-12-04 17:14:50 +01:00
ZeroNet 31f505b309
Merge pull request #2339 from ethernetcat/py3
Update jp.json
2019-12-04 15:40:51 +01:00
shortcutme c8214bf3ea
Fix threadpool test premature end on some platforms 2019-12-04 12:47:47 +01:00
shortcutme 1935a69c04
Add session based log disable at test 2019-12-04 12:46:44 +01:00
shortcutme ea5f64bfea
Only log at start of the test cases 2019-12-04 12:46:13 +01:00
ethernetcat 901ccf2d14 Update jp.json 2019-12-04 17:52:33 +09:00
shortcutme aa9fe09337
Remove unnecessary line from config 2019-11-30 02:19:18 +01:00
shortcutme bdb655243f
Rev4322 2019-11-30 02:16:29 +01:00
shortcutme 566c29363f
Slower progress bar animation 2019-11-30 02:15:17 +01:00
shortcutme 37b8c0241f
Db threads modify in config interface 2019-11-30 02:14:54 +01:00
shortcutme 1a17645e93
Remove unnecessary import 2019-11-30 02:14:08 +01:00
shortcutme 5fba850d74
Don't close connection if it's already closed 2019-11-30 02:13:58 +01:00
shortcutme bd90e0ce52
Add Db id to logging identifier 2019-11-30 02:13:39 +01:00
shortcutme c24cfa721b
Lock db while connecting 2019-11-30 02:13:17 +01:00
shortcutme 1670d96908
Execute db commit in separate thread 2019-11-30 02:12:33 +01:00
shortcutme ec3c44c5b3
Use ThreadPool lock in Db 2019-11-30 02:11:34 +01:00
shortcutme 12bfad8fe6
Don't execute query while commiting 2019-11-30 02:11:11 +01:00
shortcutme 594edc6e9a
Commit after executemany 2019-11-30 02:10:40 +01:00
shortcutme 99304a09ca
Log long db queries 2019-11-30 02:10:11 +01:00
shortcutme 5c93aadce3
Gevent block time resolution log to ms 2019-11-30 02:09:14 +01:00
shortcutme f0c10efca6
Progress meter for site delete 2019-11-30 02:08:29 +01:00
shortcutme c10dd5239e
Log test case start/end and debug message 2019-11-30 02:08:11 +01:00
shortcutme fa0d1a50b5
Better test of threadpool 2019-11-30 02:07:40 +01:00
shortcutme 66a1c4d242
Multi-process and gevent loop friendly lock 2019-11-30 02:07:30 +01:00
shortcutme b7c6b84826
Don't log killed worker write as error 2019-11-30 02:05:20 +01:00