Commit Graph

110 Commits

Author SHA1 Message Date
shortcutme 8e79a7da63
Fix incomplete loading of dbschema.json 2020-02-07 16:37:37 +01:00
shortcutme f3665b172f
Avoid unnecessary pool call 2019-12-17 15:07:32 +01:00
shortcutme 23b3cd3986
Better rebuild log message 2019-12-17 15:07:00 +01:00
shortcutme f7ee6744af
Db busy event waited in getDb 2019-12-17 15:06:36 +01:00
shortcutme ac45217816
Add reason for db close and rebuilds 2019-12-17 15:05:59 +01:00
shortcutme 8c51e81a0b
Fix double opening of dbs 2019-12-17 15:05:21 +01:00
shortcutme c1df78b97f
Name threadpools 2019-12-17 14:43:33 +01:00
shortcutme 8ed7d0385d
If possible use loaded db to get db file inner_path 2019-12-17 14:21:47 +01:00
shortcutme 02d45e9c39
Use separate threadpool for batch site storage operations 2019-12-17 14:20:49 +01:00
shortcutme 2a402a0674
Use thread-safe mode to create directories 2019-12-17 14:18:54 +01:00
shortcutme f0c10efca6
Progress meter for site delete 2019-11-30 02:08:29 +01:00
shortcutme 58214c0ac3
Move file writes and reads to separate thread 2019-11-19 02:16:20 +01:00
shortcutme 57f2a43864
Formatting 2019-11-19 02:11:19 +01:00
shortcutme 74d7fb7835
Less verbose logging in site storage 2019-11-19 02:10:42 +01:00
shortcutme 0ff1bcfd19
Remove not used variable and module import 2019-11-19 01:40:00 +01:00
shortcutme 5e90cd9714
Move advanced json formatter to helper.py 2019-08-02 14:05:14 +02:00
Ivanq 743f92d15e Allow some paths to contain .. but not ../ 2019-07-01 18:17:42 +03:00
Lola Dam 753396ac0c Try and catch block for dbRebuild (#2047)
* Try and catch block for dbRebuild

* Use self.log.error and not logging

* Use self.log.error and not logging in SiteStorage also

* Check if the rebuild is working
2019-06-23 14:21:50 +02:00
shortcutme 8cb629fb55
Return True on rebuildDb success 2019-06-06 02:27:59 +02:00
Lola Dam 9cda561091 Show error message when db failed to rebuild (#2043)
* Show error message when db failed to rebuild; fix #1908;

* Forgot file
2019-06-04 13:54:35 +02:00
shortcutme 8e2a7c2b2d
Respect optionalHelp when checking files 2019-05-30 04:28:41 +02:00
shortcutme e688671972
Fix rename error variable problem in site storage 2019-04-23 01:59:59 +02:00
radfish f6e3a74567 [setuptools packaging] access modules via imports (#1969) 2019-04-15 12:31:33 +02:00
shortcutme 002303a765
Db rebuilding error display, reconnect bug fix 2019-03-16 00:11:52 +01:00
shortcutme 59426c31f7
SiteStorage Py3 compatibility 2019-03-16 00:10:49 +01:00
shortcutme b0b9a4d33c
Change to Python3 coding style 2019-03-15 21:06:59 +01:00
shortcutme 4fe6ae9811
Allow only SELECT in storage.query 2018-12-15 17:45:17 +01:00
shortcutme 8cf30893f2
Don't close idle db connection during rebuild 2018-11-08 01:20:33 +01:00
shortcutme 4fe33268ac
Don't allow parallel rebuild 2018-09-02 02:24:07 +02:00
shortcutme 37fcf2fed7
Fix deletion with missing content.json files 2018-04-28 21:49:12 +02:00
shortcutme 0459c75dc0
Make file verification process handle correctly different files with same has_id by using new isDownloaded function 2018-03-29 03:19:26 +02:00
shortcutme d61cd96d8f
VerifyFiles call returns more detailed statistics 2018-03-29 02:49:06 +02:00
shortcutme 866947c445
Fix symlinked data site deletion 2018-02-08 18:03:55 +01:00
shortcutme 005358f4bf
Use separate db connection for rebuilding 2018-01-19 02:31:46 +01:00
shortcutme ccd002b97f
Rev3177, Import missing SafeRe module 2017-12-20 23:35:49 +01:00
shortcutme c7d067ea3c
Rev3176, Skip listing ignored directories on signing 2017-12-20 23:25:25 +01:00
shortcutme 90ff9ac7fb
Rev3155, Avoid UI hang during db rebuild 2017-12-02 02:38:17 +01:00
shortcutme 9d511ba165
Rev3122, Auto ignore database file 2017-10-22 11:13:09 +02:00
shortcutme 468fe8f266
Move json formatting to separate function 2017-10-03 15:30:10 +02:00
shortcutme 9f762a0230
Bootstrapper use python date functions instead of sqlite 2017-08-18 14:43:28 +02:00
shortcutme b503d59c49
Support gzip compressed database files 2017-08-09 14:19:39 +02:00
shortcutme ff69b04216
Catch verify exceptions on manual site files verification process 2017-06-19 15:57:02 +02:00
shortcutme f506ac9701
Faster getPath 2017-06-15 13:30:36 +02:00
shortcutme 6167dda01d
Compact json list output 2017-06-03 00:53:59 +02:00
shortcutme 728e497057
Display database rebuilding progressbar 2017-05-07 18:14:13 +02:00
shortcutme 169cf2e6ae
Support optional db files 2017-04-12 17:36:03 +02:00
shortcutme 909b9da9da
Unnecessary log and comment 2017-03-06 15:30:42 +01:00
mishfit 656c818211 rename SiteStorage.list to SiteStorage.walk
also, add SiteStorage.list as non-recursive
directory listing (`os.listdir`)
2017-02-24 21:58:46 -07:00
shortcutme cfad85b30e
Log file object on db load 2017-02-13 16:12:56 +01:00
shortcutme 56efa02820
GetDbFiles return inner path 2017-02-09 01:57:12 +01:00