Commit Graph

2735 Commits

Author SHA1 Message Date
shortcutme 7ca09ba75b
Fix updating key 0 in WorkerTaskManager 2019-12-21 02:55:22 +01:00
shortcutme 69eb831c7e
Rev4361 2019-12-19 02:17:21 +01:00
shortcutme 99e6326974
More compact stack logging 2019-12-19 02:17:13 +01:00
shortcutme 50bbe47bf2
Better logging on file update 2019-12-19 02:17:00 +01:00
shortcutme 8bfef12ad4
Don't try to pack unknown peer addresses 2019-12-19 02:16:41 +01:00
ZeroNet 6085cfd1a7
Merge pull request #2364 from Zaefarani/patch-1
Add Farsi (Persian) Translation to ZeroNet
2019-12-18 19:29:26 +01:00
shortcutme d660a268e8
Rev4360 2019-12-18 16:43:58 +01:00
shortcutme c161140a90
Add locking for db cursor 2019-12-18 16:43:46 +01:00
shortcutme 7af8d1cd93
Save last lock time 2019-12-18 16:42:47 +01:00
shortcutme 845b50915d
Rev4358 2019-12-18 15:32:50 +01:00
shortcutme 7ecf09a496
Allow to change test log dir with environmental variable 2019-12-18 15:24:05 +01:00
shortcutme c0639fef75
Lock task adding to avoid race condition when getFileInfo switches 2019-12-18 15:23:16 +01:00
Hamid reza Zaefarani 1fe7127082
Rename fa,json to fa.json 2019-12-18 14:35:54 +03:30
shortcutme 9c08e41b9e
Rev4355 2019-12-17 21:03:01 +01:00
shortcutme abee87bbec
Wait for threadpool kill with 1s timeout to fix memory leak test 2019-12-17 21:02:48 +01:00
shortcutme a7c26f893f
Rev4354 2019-12-17 20:46:29 +01:00
Hamid reza Zaefarani 24b8cdf87a
Add Farsi (Persian) Translation to ZeroNet
Persian Translation of ZeroNet Site
2019-12-17 23:15:51 +03:30
shortcutme 77869830c5
Fix shutdown hang 2019-12-17 20:36:52 +01:00
shortcutme 87fc8ced5e
Accept only my exception when testing Noparallel 2019-12-17 16:06:13 +01:00
shortcutme e7e8e59c1e
Rev4353 2019-12-17 15:08:42 +01:00
shortcutme f3665b172f
Avoid unnecessary pool call 2019-12-17 15:07:32 +01:00
shortcutme 23b3cd3986
Better rebuild log message 2019-12-17 15:07:00 +01:00
shortcutme f7ee6744af
Db busy event waited in getDb 2019-12-17 15:06:36 +01:00
shortcutme ac45217816
Add reason for db close and rebuilds 2019-12-17 15:05:59 +01:00
shortcutme 8c51e81a0b
Fix double opening of dbs 2019-12-17 15:05:21 +01:00
shortcutme 98c98fbac7
Thread safe method to create directory for db 2019-12-17 15:02:18 +01:00
shortcutme 9b1f6337c3
Wait for cursor finish on db close 2019-12-17 15:02:04 +01:00
shortcutme 2019093431
Fix testing on slower storage 2019-12-17 15:01:15 +01:00
shortcutme eac25caf28
Log packing peer arrors as debug 2019-12-17 15:00:23 +01:00
shortcutme b421893434
Return timer greenet 2019-12-17 15:00:09 +01:00
shortcutme f1b19f5fc7
Fix DbQuery logging 2019-12-17 14:59:54 +01:00
shortcutme 61f1a741fc
Test main loop caller 2019-12-17 14:52:58 +01:00
shortcutme f01d335835
Test noparallel multi thread compatibility 2019-12-17 14:52:13 +01:00
shortcutme 5c1b34387c
Noparallel multi thread compatibility 2019-12-17 14:51:57 +01:00
shortcutme dfd55c3957
Fix memory leak when using sleep in threads 2019-12-17 14:50:38 +01:00
shortcutme b21895fa78
Kill threadpool properly 2019-12-17 14:50:10 +01:00
shortcutme 495d695c5a
Fix threadpool apply and spawn when threadpool is full 2019-12-17 14:49:50 +01:00
shortcutme 3309489c24
Only call the function in separate thread when in the main loop 2019-12-17 14:48:11 +01:00
shortcutme 8a5a75e68f
Allow pass calls to the main loop 2019-12-17 14:47:27 +01:00
shortcutme c1df78b97f
Name threadpools 2019-12-17 14:43:33 +01:00
shortcutme 4c31aae97b
Refactor worker, fix concurrent write errors 2019-12-17 14:42:33 +01:00
shortcutme 0839fdfc5e
Add reason for db close 2019-12-17 14:35:49 +01:00
shortcutme d062f01127
Log temp site events under different name 2019-12-17 14:34:53 +01:00
shortcutme e91fb90a45
Fix tests when running for long time 2019-12-17 14:34:29 +01:00
shortcutme 6539ca5eb0
Log spy actions to file when running tests 2019-12-17 14:33:06 +01:00
shortcutme b138ebc519
Capture fd for pytest 2019-12-17 14:32:43 +01:00
shortcutme 79c1cd15ab
Use libev when running test 2019-12-17 14:32:17 +01:00
shortcutme 10c1986c54
Fix site list changing during listing 2019-12-17 14:31:55 +01:00
shortcutme d7cabb47ca
Log task numbers on content.json start 2019-12-17 14:31:41 +01:00
shortcutme 8de1714f08
Fix onComplete call when donwload end 2019-12-17 14:31:12 +01:00
shortcutme 20ba9cd589
Log site download time 2019-12-17 14:30:29 +01:00
shortcutme af1ac9bce8
Try to find already running task for file before start a new one 2019-12-17 14:30:14 +01:00
shortcutme 31a6e3ee9a
Don't allow clone to run in parallel 2019-12-17 14:29:48 +01:00
shortcutme dca1dcdd2d
Use always active connection in DbCursor 2019-12-17 14:28:52 +01:00
shortcutme a54f5f3e9f
Change trackers to more stable onces 2019-12-17 14:26:14 +01:00
shortcutme 51f49cd45a
Always use libev if possible 2019-12-17 14:25:04 +01:00
shortcutme eb63eb7b1d
Log startup errors in log file 2019-12-17 14:24:44 +01:00
shortcutme b4f7e51e96
Limit stack size on formatting 2019-12-17 14:24:08 +01:00
shortcutme c2d2189039
Log content init failed as info 2019-12-17 14:23:47 +01:00
shortcutme 1eda3258de
Always raise error on verify error 2019-12-17 14:23:31 +01:00
shortcutme 0171cb0844
Avoid get db_inner_path for every file on signing 2019-12-17 14:23:18 +01:00
shortcutme 08a0a63631
Create ssl contexts only once 2019-12-17 14:22:29 +01:00
shortcutme 8ed7d0385d
If possible use loaded db to get db file inner_path 2019-12-17 14:21:47 +01:00
shortcutme 02d45e9c39
Use separate threadpool for batch site storage operations 2019-12-17 14:20:49 +01:00
shortcutme 2a402a0674
Use thread-safe mode to create directories 2019-12-17 14:18:54 +01:00
shortcutme 958882c1c5
Revert "Switch to sslcrypto for cryptography tasks (#2338)"
This reverts commit fbc7b6fc4f.
2019-12-15 18:30:42 +01:00
ZeroNet 2f7323043f
Merge pull request #2358 from imachug/bencode
Switch to bencode_open
2019-12-15 12:49:04 +01:00
Ivanq fbc7b6fc4f Switch to sslcrypto for cryptography tasks (#2338)
* Use sslcrypto instead of pyelliptic and pybitcointools

* Fix CryptMessage

* Support Python 3.4

* Fix user creation

* Get rid of pyelliptic and pybitcointools

* Fix typo

* Delete test file

* Add sslcrypto to tree

* Update sslcrypto

* Add pyaes to src/lib

* Fix typo in tests

* Update sslcrypto version

* Use privatekey_bin instead of privatekey for bytes objects

* Fix sslcrypto

* Fix Benchmark plugin

* Don't calculate the same thing twice

* Only import sslcrypto once

* Handle fallback sslcrypto implementation during tests

* Fix sslcrypto fallback implementation selection
2019-12-15 12:46:06 +01:00
Ivanq 3178b69172 Switch to bencode_open 2019-12-12 17:46:16 +03:00
shortcutme 28fcf3c1ea
Rev4327 2019-12-11 20:04:50 +01:00
shortcutme 71939097b0
Make execution order test more predictable 2019-12-11 20:04:39 +01:00
shortcutme 2fd337bb55
Add wasm content type 2019-12-11 20:03:28 +01:00
shortcutme 5e26161e84
Rev4325 2019-12-04 17:16:08 +01:00
shortcutme 04ecb89e9a
Avoid sending too many publish request to an outdated client 2019-12-04 17:15:42 +01:00
shortcutme 23f851343f
Fix exception when params is an iterator 2019-12-04 17:15:08 +01:00
shortcutme 5ce1782d05
Change journal and foreign keys mode on db connect 2019-12-04 17:14:50 +01:00
ZeroNet 31f505b309
Merge pull request #2339 from ethernetcat/py3
Update jp.json
2019-12-04 15:40:51 +01:00
shortcutme c8214bf3ea
Fix threadpool test premature end on some platforms 2019-12-04 12:47:47 +01:00
shortcutme 1935a69c04
Add session based log disable at test 2019-12-04 12:46:44 +01:00
shortcutme ea5f64bfea
Only log at start of the test cases 2019-12-04 12:46:13 +01:00
ethernetcat 901ccf2d14 Update jp.json 2019-12-04 17:52:33 +09:00
shortcutme aa9fe09337
Remove unnecessary line from config 2019-11-30 02:19:18 +01:00
shortcutme bdb655243f
Rev4322 2019-11-30 02:16:29 +01:00
shortcutme 566c29363f
Slower progress bar animation 2019-11-30 02:15:17 +01:00
shortcutme 37b8c0241f
Db threads modify in config interface 2019-11-30 02:14:54 +01:00
shortcutme 1a17645e93
Remove unnecessary import 2019-11-30 02:14:08 +01:00
shortcutme 5fba850d74
Don't close connection if it's already closed 2019-11-30 02:13:58 +01:00
shortcutme bd90e0ce52
Add Db id to logging identifier 2019-11-30 02:13:39 +01:00
shortcutme c24cfa721b
Lock db while connecting 2019-11-30 02:13:17 +01:00
shortcutme 1670d96908
Execute db commit in separate thread 2019-11-30 02:12:33 +01:00
shortcutme ec3c44c5b3
Use ThreadPool lock in Db 2019-11-30 02:11:34 +01:00
shortcutme 12bfad8fe6
Don't execute query while commiting 2019-11-30 02:11:11 +01:00
shortcutme 594edc6e9a
Commit after executemany 2019-11-30 02:10:40 +01:00
shortcutme 99304a09ca
Log long db queries 2019-11-30 02:10:11 +01:00
shortcutme 5c93aadce3
Gevent block time resolution log to ms 2019-11-30 02:09:14 +01:00
shortcutme f0c10efca6
Progress meter for site delete 2019-11-30 02:08:29 +01:00
shortcutme c10dd5239e
Log test case start/end and debug message 2019-11-30 02:08:11 +01:00
shortcutme fa0d1a50b5
Better test of threadpool 2019-11-30 02:07:40 +01:00
shortcutme 66a1c4d242
Multi-process and gevent loop friendly lock 2019-11-30 02:07:30 +01:00
shortcutme b7c6b84826
Don't log killed worker write as error 2019-11-30 02:05:20 +01:00
shortcutme 1c587bde25
Avoid write race on same file 2019-11-30 02:04:59 +01:00
shortcutme e1dc29c374
Rev4308 2019-11-27 03:08:20 +01:00
shortcutme fca9db7972
Try fix Recursive use of cursors ProgrammingError by creating new cursor for every execute and move Lock to db 2019-11-27 03:07:08 +01:00
shortcutme afd23849a6
Log site delete as info 2019-11-27 03:04:49 +01:00
shortcutme 1b2eee058c
Log test case start and end 2019-11-27 03:03:31 +01:00
shortcutme 777486a5be
Try new way to avoid pytest io errors 2019-11-27 03:03:22 +01:00
shortcutme 8b6f221e22
Formatting 2019-11-27 03:02:18 +01:00
shortcutme 97ecb7e3aa
Rev4303 2019-11-25 14:50:16 +01:00
shortcutme 5df5e25d68
Better logging of recent peers 2019-11-25 14:49:40 +01:00
shortcutme 66a950a481
New, much faster worker task sorting 2019-11-25 14:43:28 +01:00
shortcutme 29346cdef5
Faster, async local ip discovery 2019-11-25 14:40:52 +01:00
shortcutme 4f8e941e39
Fix err type logging 2019-11-25 14:39:24 +01:00
shortcutme 7b210429b5
Multi threaded eciesDecrypt 2019-11-25 14:37:55 +01:00
shortcutme c52d47b15f
Don't show notifications when testing 2019-11-25 14:35:31 +01:00
shortcutme 9a43626aa6
When testing don't register shutdown functions 2019-11-25 14:35:16 +01:00
shortcutme c14e722303
Fix bug that someomes blocked plugins accessing connectionserver sitelist 2019-11-25 14:34:46 +01:00
shortcutme 07633ba79d
Fix local peers dropping out from recent peers 2019-11-25 14:33:18 +01:00
shortcutme 6ff7fe55fc
Make sure we use local peers if possible 2019-11-25 14:32:06 +01:00
shortcutme a14c36cd3e
Add peer's site to str represetntation 2019-11-25 14:31:12 +01:00
shortcutme c21fe3d23a
Prefer connecting to non-onion peers 2019-11-25 14:30:51 +01:00
d9xr92 89e8fd3d3a potential fix for #2323 (#2324)
* potential fix for #2323

* Update DbCursor.py

* replaced RLock with Lock
2019-11-23 13:22:36 +01:00
shortcutme 966f393e20
Rev4290 2019-11-20 14:08:49 +01:00
shortcutme 9299e5b614
Kill greenlets with notify 2019-11-20 14:07:33 +01:00
shortcutme 6c31a3b77e
Change fs thread number on config interface 2019-11-20 14:07:04 +01:00
shortcutme 5aa115c88a
Heavier task in thread pool test to make sure it will pass 2019-11-19 02:25:28 +01:00
shortcutme 511587dd8b
Allow images from data uris 2019-11-19 02:19:14 +01:00
shortcutme 5d34bb9062
Rev4287 2019-11-19 02:17:32 +01:00
shortcutme 4025d753e3
Don't print errors happened in thread 2019-11-19 02:16:44 +01:00
shortcutme 58214c0ac3
Move file writes and reads to separate thread 2019-11-19 02:16:20 +01:00
shortcutme 5d113757df
Stop greenlets when deleting a site in test 2019-11-19 02:15:47 +01:00
shortcutme b41a03674f
New configuration options for fs write and read thread count 2019-11-19 02:15:00 +01:00
shortcutme 8c1f64243f
Test CLI action parser 2019-11-19 02:14:29 +01:00
shortcutme cdd9dd4f6f
Fix duplicate content_db connecting 2019-11-19 02:12:24 +01:00
shortcutme 57f2a43864
Formatting 2019-11-19 02:11:19 +01:00
shortcutme 74d7fb7835
Less verbose logging in site storage 2019-11-19 02:10:42 +01:00
shortcutme dd61429e2f
Handle announcer thread killing properly 2019-11-19 02:09:55 +01:00
shortcutme 8f27f50b34
Log SQL statements in progress as warning 2019-11-19 02:09:36 +01:00
shortcutme 96e7fbdca1
Don't try to commit if no db connection 2019-11-19 02:08:30 +01:00
shortcutme 39352eb97e
Fix test function listing name 2019-11-19 02:08:03 +01:00
shortcutme 1c607645c7
Track and stop site connected greenlets on delete 2019-11-19 02:07:51 +01:00
shortcutme 16162955af
New cli test action 2019-11-19 01:47:06 +01:00
shortcutme e8af5db2e8
Keep track gevent block number, remove Benchmark from stats plugin 2019-11-19 01:43:39 +01:00
shortcutme 9d048371b7
Better way to patch gevent error handling 2019-11-19 01:42:00 +01:00
shortcutme a187726ba8
Formatting 2019-11-19 01:40:39 +01:00
shortcutme 0ff1bcfd19
Remove not used variable and module import 2019-11-19 01:40:00 +01:00
shortcutme 08fee35bcf
Fix pytest output capturing error 2019-11-19 01:39:16 +01:00
shortcutme 08574bf676
Handle unkown variables when rendering template 2019-11-19 01:38:22 +01:00
shortcutme 5c27a0efcc
Rev4260, Fix UiConfig pt-br language json 2019-11-15 19:43:56 +01:00
Natalia Fenclová 456e330854 Replace usage of deprecated API 'cgi.parse_qsl'
Python 3.8.0 removed this deprecated API. We already use the replacement
`urllib.parse.parse_qsl` in `UIRequest.py`
2019-11-14 17:22:39 +01:00
ZeroNet 8d95eb937f
Longer timeout to close connections in ssl connection test 2019-11-11 17:14:36 +01:00
shortcutme 2f50fef787
Rev4259 2019-11-11 16:18:33 +01:00
shortcutme e8b0a3d1c4
Fix loading screen scrolling on smaller screens 2019-11-11 16:18:01 +01:00
shortcutme fce24cedbd
Rev4257 2019-11-07 02:48:17 +01:00
shortcutme f9b62564ca
Fix logging in non-debug mode 2019-11-07 02:47:45 +01:00
shortcutme d569d9488a
Deny invalid files on Windows 2019-11-07 02:47:19 +01:00
shortcutme f172751df3
Test utf8 filename download 2019-11-07 02:44:54 +01:00
shortcutme 13233d47bd
Fix long running test 2019-11-07 02:44:33 +01:00
Josh 74d7d92a4d Allow all valid filenames to be added to content.json (#2141)
* Allow all valid filenames to be added to content.json

* Replace hex version of regex with non-hex version

* Add basic test for path validation with ASCII and UTF-8 filenames

* Amend path validation test to meet standards
2019-11-07 02:18:27 +01:00
Lola Dam 1bfe328a1b No restart after update (#2242) 2019-11-01 19:36:43 +01:00
shortcutme 1f453b6c13
Rev4253, Hotfix siteCreate CLI 2019-10-30 03:09:28 +01:00
shortcutme ee8e3c3c9c
Use master_seed for siteCreate CLI by default 2019-10-30 03:07:06 +01:00
shortcutme 37f315dfc2
Rev4252 2019-10-30 02:31:04 +01:00
shortcutme 1e1e560795
Use master seed to create new site from cli 2019-10-30 02:30:01 +01:00
shortcutme 8d88cfcd68
Fix notification width calculation 2019-10-30 02:28:37 +01:00
shortcutme 74badf9c9c
Rev4250 2019-10-28 16:44:40 +01:00
shortcutme 86087550f1
Log ConnectionResetError as warning 2019-10-28 16:44:14 +01:00
shortcutme 8dfc200f24
Update cachable type list 2019-10-28 16:43:37 +01:00
shortcutme cb4a4bd707
Add utf-8 charset header to more types 2019-10-28 16:43:19 +01:00
shortcutme 24ba2a150b
Remove limitations for img, font, media, style src in raw mode 2019-10-28 16:42:28 +01:00
shortcutme e1d92bf0ec
Changing allow-origin to js files looks no longer necessary 2019-10-28 16:41:55 +01:00
shortcutme 270f3e9ffd
Use host to check same origin if referrer looks trimmed to host 2019-10-28 16:41:08 +01:00
shortcutme e1f73697ff
Extend built-in content types list 2019-10-28 16:11:45 +01:00
shortcutme e82155aac4
Rev4245, Fix target=_blank links 2019-10-26 20:36:53 +02:00
shortcutme d7669413af
Log ConnectionAbortedError as warning 2019-10-26 20:17:09 +02:00
shortcutme 28d4fc5d12
Update location of bundled OpenSSL on macOS 2019-10-24 12:22:54 +02:00
shortcutme 6bae1f8a4b
Rev4243 2019-10-24 03:09:38 +02:00
shortcutme 10ceeb7f02
Remove no longer necessary files after cert generation 2019-10-24 03:09:28 +02:00
shortcutme 448bb3ce98
Fix OpenSSL cert generation using LibreSSL 2019-10-24 03:09:16 +02:00
shortcutme 0531d47721
Fix shutdown errors on macOS 2019-10-24 03:08:45 +02:00
shortcutme b21719e2f2
Fix OpenSSL lib loading on macOS 2019-10-24 03:08:27 +02:00
shortcutme fa7013fdf7
Rev4241 2019-10-16 15:44:56 +02:00
shortcutme 608a411d97
Db table rebuild as debug message 2019-10-16 15:43:28 +02:00
shortcutme 20c63c73b3
Support silent loading of verify lib 2019-10-16 15:43:07 +02:00
shortcutme 127fa5fa82
Rev4238 2019-10-06 03:27:47 +02:00
shortcutme 63fd0a9fa1
Put the infopanel lower to avoid console interruption 2019-10-06 03:21:35 +02:00
shortcutme 344ad44854
Fix reload if there is hash in the url 2019-10-06 03:20:58 +02:00
shortcutme 43a5742258
Resolve domain in parsePath function 2019-10-06 03:20:16 +02:00
shortcutme 924a61309a
Cached isDomain / resolveDomain functions 2019-10-06 03:18:14 +02:00
shortcutme 9dd5c88da4
Monospace font when displaying errors 2019-10-06 03:15:57 +02:00
shortcutme 0598bcf332
Fix utf8 post data parsing 2019-10-06 03:15:20 +02:00
shortcutme ead1b3e5f5
Log 403 as warning 2019-10-06 03:14:45 +02:00
shortcutme dd493c87fa
Display WSGI errors to the browser 2019-10-06 03:13:32 +02:00
shortcutme 29640e614c
Admin API call to list server errors 2019-10-06 03:12:47 +02:00
shortcutme 73e0aa17c4
Don't encode byte responses 2019-10-06 03:10:43 +02:00
shortcutme 917a2e59ce
Fix compacting large json files 2019-10-06 03:10:20 +02:00
shortcutme 119e1a9bf0
Simple cache decorator 2019-10-06 03:09:48 +02:00
shortcutme 6eb79ba75e
Don't annunce site if not serving 2019-10-06 03:08:54 +02:00
shortcutme bb436f9931
Rev4223 2019-09-28 17:17:47 +02:00
shortcutme 3682f0aed4
Wait for db close on tests 2019-09-28 17:03:43 +02:00
shortcutme b21b885aa9
Move site add to separate function 2019-09-28 17:01:37 +02:00