New in v0.7.07 (2016/04/10)
---------------------------
* Merged in lp:~matthew-t-bentley/duplicity/b2
- Fix import and error typos.
- Allow multiple backups in the same bucket.
- Fixes bug #1523498.
- A couple fixes allowing multiple backups to be hosted in different
folders in the same bucket as well as some logging for -v9.
* Random stuff:
- remove RPM stuff from makedist
- have makedist pull directly from VCS, not local dir
- update po translation directory and build process
- clean up some odd error messages
- move Pep8 ignores to tox.ini
- supply correct path for pydevd under Mac
- fix some tests to run under Linux and Mac
* Partial fix for bug #1529606 - shell code injection in lftpbackend
- still need to fix the other backends that spawn shell commands
* Make test_restart compatible with both GNUtar and BSDtar
* Fix stupid issue with functional test path for duplicity
* Applied patch from shaochun to fix bug #1531154,
- --file-changed failed when file contains spaces
* Applied patch from abeverly to fix bug #1475890
- allow port to be specified along with hostname on S3
- adjusted help text and man page to reflect the change
* Undo changes to test_restart.py. GNU tar is needed.
* Fix minor pep8 nit in collections.py
* Applied changes from ralle-ubuntu to fix bug 1072130.
- duplicity does not support ftpes://
* Fixed bug #1296793 - Failed to create bucket
- use S3Connection.lookup() to check bucket exists
- skips Boto's Exception processing for this check
- dupe of bug #1507109 and bug #1537185
* Merged in lp:~mifchip/duplicity/duplicity
- fix bug #1313964, absolute path doesn't work for FTP
* Merged in lp:~fpytloun/duplicity/webdav-gssapi
- support GSSAPI authentication in webdav backend
* Add more pylint ignore warnings tags
* Adjust so test_restart.py can run on Mac as well
* Fix for bug #1538333 - assert filecount == len(self.files_changed)
- added flush after every write for all FileobjHooked files which
should prevent some errors when duplicity is forcibly closed.
* Fix bug #1540279 - mistake in --help
* Applied patch from kay-diam to fix error handling in ssh pexpect,
fixes bug #1541314
* Fixed a patching error in ssh_pexpect_backend.py
* Merged in lp:~fpytloun/duplicity/webdav-gssapi-fix
- Make kerberos optional for webdav backend
* Merged in lp:~harningt/duplicity/multibackend-mirror
- This changeset addresses multibackend handling to permit a
mirroring option in addition to its "stripe" mode to make it
a redundancy tool vs space-expansion tool. To do this without
changing the configuration too much, I used the query string
that would generally go unused for files to specify behavior
that applies to all items inside the configuration file.
* Added acdclibackend.py from Stefan Breunig and Malay Shah
- renamed from amazoncloudbackend to stress use of acd_cli
* Fixed some 2to3 and Pep8 issues that had crept in
* Backed out changes made by patching for bug #1541314. These
patches should not have been applied to the 0.7 series.
* Merged in lp:~rye/duplicity/mediafire
- Backend for https://www.mediafire.com
- Requires https://pypi.python.org/pypi/mediafire/ installed.
* Reverted changes made in rev 1164 w.r.t. getting the source from
VCS rather than local directory. Fixes bug #1548080.
* More fixes to dist/makedist to make it more OS agnostic.
* Merged in lp:~ed.so/duplicity/webdav.lftp.ssl-overhaul
duplicity.1, commandline.py, globals.py
- added --ssl-cacert-path parameter
backend.py
- make sure url path component is properly url decoded,
in case it contains special chars (eg. @ or space)
lftpbackend.py
- quote _all_ cmd line params
- added missing lftp+ftpes protocol
- fix empty list result when chdir failed silently
- added ssl_cacert_path support
webdavbackend.py
- add ssl default context support for python 2.7.9+
(using system certs eg. in /etc/ssl/certs)
- added ssl_cacert_path support for python 2.7.9+
- gettext wrapped all log messages
- minor refinements
* Applied patch from Dmitry Nezhevenko to upgrade dropbox backend:
- update to SDK v2
- use chunked upload
* Merged in lp:~aaron-whitehouse/duplicity/improve_present_get_sf_man_page
- Improve man page entry for --exclude-if-present
* Merged in lp:~aaron-whitehouse/duplicity/split_glob_matching_from_select
- Move glob matching code out of selection.py's Select function and
into globmatch.py.
* Fix bug reported on the mailing list from Mark Grandi (assertion error
while backing up). In file_naming.parse() the filename was being lower
cased prior to parsing. If you had used a prefix with mixed case, we
were writing the file properly, but could not find it in the backend.
* Merged in lp:~duplicity-team/duplicity/po-updates
New in v0.7.06 (2015/12/07)
---------------------------
* Merged in lp:~mnjul/duplicity/s3-infreq-access
- This adds support for AWS S3's newly announced Infrequent Access
storage class and is intended to implement Blueprint:
https://blueprints.launchpad.net/duplicity/+spec/aws-s3-std-ia-class .
- A new command line option, --s3-use-ia, is added, and boto backend
will automatically use the correct storage class value depending on
whether --s3-use-rrs and --s3-use-ia is set. Command line parser will
prompt error if both --s3-use-ia and --s3-use-rrs are used together,
as they conflict with each other.
- The manpage has been updated giving a short explanation on the new
option. Its wording derives from Amazon's official announcement:
https://aws.amazon.com/about-aws/whats-new/2015/09/announcing-new-\
amazon-s3-storage-class-and-lower-glacier-prices/
* The ptyprocess module no longer supports Python 2.6, so fix tox.ini to
use an older version. Make explicit environs for all tests.
* Upgrade to newest version of pep8 and pylint. Add three ignores
to test_pep8 and one to test_pylint to get the rest to pass. They
* Applied patch from Alexander Zangerl to update to changes in lockfile
API 0.9 and later. Updated README to notify users.
* Modded tox.ini to use the latest lockfile.
* Merged in lp:~ed.so/duplicity/setup.shebang
- Having the python interpreter searched in the PATH is much more
flexible than the /usr/bin/python inserted into our scripts shebang
by setuptools. This patch prevents that. don't touch my shebang! :)
* Cleanup issues around Launchpad build, mainly lockfile >= 0.9.
* Merged in lp:~michal-s/duplicity/duplicity
- WindowsAzureMissingResourceError and WindowsAzureConflictError
changed due to SDK changes.
are all valid in our case.
* Reversed previous changes to lockfile. Now it will take any version
extant in the LP build repository. (PyPi is not avail in LP build).
* Merged in lp:~ed.so/duplicity/tempfile.tempdir
- make sure packages using python's tempfile create temp files in
duplicity's temp dir
* Fixed bug #1511308 - Cannot restore no-encryption, no-compression backup
- Corrected code to include plain file in write_multivolume()
- Added PlainWriteFile() to gpg.py
* Merged in lp:~michal-s/duplicity/duplicity
- Fix azurebackend storage class import
* Merged in lp:~feraudet/duplicity/fix
- Fix missing SWIFT_ENDPOINT_TYPE env var, bug 1519694.
* Fix bug #1520691 - Shell Code Injection in hsi backend
- Replace use of os.popen3() with subprocess equivalent.
- Added code to expand relative program path to full path.
- Fix hisbackend where it expected a list not a string.
* Merged in lp:~noizyland/duplicity/azurebackend-fixes
- Support new version of Azure Storage SDK
- Refactor _list method to support containers with >5000 blobs
* Merged in lp:~matthew-t-bentley/duplicity/b2
- Adds a backed for BackBlaze's (currently beta) B2 backup service.
- This adds backends/b2backend.py, modifies log.py to add an
error code and modifies commandline.py to add the b2://
example to the help text.
* Pep8 corrections for recently released code.
* Fixed bug #1260666 universally by splitting the filelist for
delete before passing to backend.
* Fixed bug #1369243 by adjusting messages to be more readable.
* Fixed bug #1375019 with patch from Eric Bavier (home to tmp).
* Fixed bug #1379575 with patch from Tim Ruffing (shorten webdav response).
* Fixed bug #1492301 with patch from askretov (manually refresh oauth).
New in v0.7.05 (2015/09/15)
---------------------------
* Merged in lp:~aaron-whitehouse/duplicity/fix_patch_error
- Change use of mock.patch in unit tests to accommodate the obsolete
version of python-mock on the build server.
* Fixed Bug 1476019 S3 storage bucket not being automatically created
with patch from abeverley
* Merged in lp:~aaron-whitehouse/duplicity/launchpad_tox_profile
- Add tox testing profile that mimics the packages installed on the
Launchpad build server, to reduce the likelihood of tests passing
our test suite, but failing on the build server (e.g. because of
the out-of-date mock version).
* Merged in lp:~aaron-whitehouse/duplicity/disable_code_tests_for_lpbuildd
- Set RUN_CODE_TESTS to 0 for lpbuildd tox profile, reflecting its value
on the Launchpad build server (and therefore skipping PEP8, 2to3 and
pylint). More accurately reflects the system we are mimicking and saves
approximately 1 minute per test run.
* Fixed Bug 1438170 duplicity crashes on resume when using gpg-agent with
patch from Artur Bodera (abodera). Applied the same patch to incremental
resumes as well.
* Merged in lp:~w.baranowski/duplicity/selection_debug
- This little patch logs debug messages concerning path selection process,
and so allows users to debug their include/exclude configuration.
* Merged in lp:~germar/duplicity/par2removefix
- After reorganisation in revision 981 and the fix for bug #1406173 the
par2backend does not remove .par2 files anymore when removing
duplicity-*.gpg files.
- This banch adds an unfiltered_list() method which is used in
delete() and delete_list()
* Updated man pages to reflect more contributors.
* Fix bug #1493573. Correct option typo in man page.
* Fix bug #1494228 CygWin: TypeError: basis_file must be a (true) file
- The problem that caused the change to tempfile.TemporaryFile was due
to the fact that os.tmpfile always creates its file in the system
temp directory, not in the directory specified. The fix applied was
to use os.tmpfile in cygwin/windows and tempfile.TemporaryFile in all
the rest. This means that cygwin is now broken with respect to temp
file placement of this one file (deleted automatically on close).
* Merged in lp:~bmerry/duplicity/pydrive-id-cache
- This fixes the issue a number of users (including myself) have been
having with duplicity creating files with duplicate filenames on
Google Drive. It keeps a runtime cache of filename to object ID
mappings, so that once it has uploaded an object it won't be fooled
by weakly consistent directory listings.
* Merged in lp:~duplicity-team/duplicity/po-updates
New in v0.7.04 (2015/08/02)
---------------------------
* Merged in lp:~noizyland/duplicity/fix-progress
- Fixes bug 1264744. selection.filelist_globbing_get_sfs leaves the
filelist file object's position at the end of the file. When the
--progress option is used the filelists need to be read twice. On
the second read nothing is read from the file because file has
already been read and the position is EOF. This patch calls seek(0)
on the filelist to reset the position to BOF so that subsequent
read() calls will return data.
* Added pylint ignore error in webdavbackend.py.
* Merged in lp:~bmerry/duplicity/pydrive-regular
- This implements the proposal made by somebody else
(http://lists.gnu.org/archive/html/duplicity-talk/2015-02/msg00037.html)
to allow the pydrive backend to work with a normal drive account instead
of a service account. It seems to be working for me: I was able to migrate
seamlessly from the gdocs backend. It's set up so that a service account
can still be used, depending on which environment variable is set.
The man page is updated to describe how to use the new functionality.
* Merged in lp:~ed.so/duplicity/gdocs.pydrive
- make pydrive new gdocs default backend
- keep gdata backend as gdata+gdocs://
* Merged in lp:~raymii/duplicity/fix-swiftbackend-max-10000-files-in-list
- Swiftclient by default returns at max 10000 files. By adding
full_listing=True we make sure all objects are returned.
Ref: https://lists.nongnu.org/archive/html/duplicity-talk/2015-05/msg00060.html
and http://docs.openstack.org/developer/python-swiftclient/swiftclient.html#swiftclient.client.get_container
* Fix a couple of PEP8 glitches.
* Fixed bug 791794 - description of --gpg-options is misleading, Simply
needed to add the '--' before the options as in "--opt1 --opt2=parm".
* Fixed bug 1465335 - pydrive still use files in trash can - with patch
from Kuang-che Wu to ignore trashed files.
* Fixed bug 1452263 - par2 option not working on small processors - with patch
from Kuang-che Wu to ignore default 30 second timeout.
* Fixed bug 1466160 - pydrive backend is slow to remove old backup set - with
patch from Kuang-che Wu to implement _delete_list().
* Fixed bug 1466582 - reduce unnecessary syscall with --exclude-if-present - with
patch from Kuang-che Wu to make sure resulting path is a directory.
* Merged in lp:~ed.so/duplicity/gpg.binary
- new parameter --gpg-binary allows user to point to a different gpg binary,
not necessarily in path
* Merged in lp:~aaron-whitehouse/duplicity/fix_POTFILES.in_and_run-tests
- Fixed two filename references in po/POTFILES.in, a mistake which crept in in
rev 1093 and caused testing/run-tests to fail with "IndexError: list index
out of range".
* Merged in lp:~aaron-whitehouse/duplicity/reactivate_progress_test
- Re-enable the test of the --progress option (test_exclude_filelist_progress_option),
which was marked as an expected failure. The issue causing this test to fail was
fixed in revision 1095 and the test now passes.
* Fixed bug 1471348 Multi back-end doesn't work with hubiC
- added init of appropriate superclass in both cases.
* Fixed bug 1471348 Multi back-end doesn't work with hubiC (again)
- hubiC should reach up to duplicity.backend.__init__
* Merged in lp:~aaron-whitehouse/duplicity/bug_884371
- Fixed Bug #884371 - Stopped an exclude glob trumping an earlier scan glob, but also
ensured that an exclude glob is not trumped by a later include. This fix is important,
as without it files that are specified to be included are not being backed up as expected.
- Fixed Bug #932482 - a trailing slash at the end of globs no longer prevents them working
as expected.
* Merged in lp:~aaron-whitehouse/duplicity/reenable_tests
- Re-enable unit.test_selection tests that had been temporarily commented out.
* Merged in lp:~aaron-whitehouse/duplicity/trailing_slash_match_dirs
- Made globs with trailing slashes only match directories, not files, fixing Bug #1479545.
* Merged in lp:~aaron-whitehouse/duplicity/improve_tox_and_python2-6_testing
- Testing improvements, particularly in relation to testing against Python version 2.6:
* tox.ini fixed so that it is possible to run individual tests against both Python 2.6 and 2.7;
* updated test_code.py to use unittest2 for Python versions < 2.7 (instead of failing);
* ./run-tests now correctly runs all tests against both Python 2.6 and 2.7; and
* improved testing directions in README-REPO.
* Merged in lp:~dag-stenstad/duplicity/swift_authversion_3_support
- Added support for Openstack Identity v3 in the Swift backend.
* Merged in lp:~aaron-whitehouse/duplicity/fix_2to3_issues
- Fixed 2to3 issues. Updated README-REPO with more test information. Updated pylint and
test_diff2 descriptions to make it clear these require packages to be installed on the
sytem to pass. All tests pass on Python 2.6 and Python 2.7 as at this revision.
New in v0.7.03 (2015/05/11)
---------------------------
* Merged in lp:~aaron-whitehouse/duplicity/filelist_combine
- Merged globbing and non-globbing filelists to use the same code path
and all accept globbing characters. Added deprecation warning to the
--exclude-globbing-filelist and include-globbing-filelist options in
commandline.py and hid them from help output. Updated the manual
(and unit tests) accordingly.
- Note that this does trigger a change in behaviour for duplicity.
Previously, include patterns in include-filelist did not match files
in a directory that was included, so /usr/local in an include file
would not have matched /usr/local/doc. Now, this folder would be
included, as would occur if --include or the old
--include-globbing-filelist was used. Additional lines will therefore
need to be added to filelists to unambiguously exclude unwanted
subfolders, if this is intended.
- Mark --include-filelist-stdin and --exclude-fielist-stdin for
deprecation and hide from --help output.
* Fix bug 1432999 with hint from Antoine Afalo.
- '/'s at end of destination cause problems with onedrivebackend.
* Fix bug 1434702 with help from Robin Nehls
- incorrect response BackendException while downloading signatures file.
* Fix bug 1437789 with patch from pdf
- par2backend.py incorrect syntax in get()
* Merge in lp:~stynor/duplicity/multi-backend
- A new backend that allows use of more than one backend stores (e.g. to
combine the available space from more than one cloud provider to make
a larger store available to duplicity).
* Move requirements section lower in manpage.
* Merge in lp:~cemsbr/duplicity/duplicity
- Fix bug 1432229 in Copy.com backend:
Reply header has no content-type for JSON detection. Now, we also check
whether the content starts with '{'.
* Fixed bug 1444404 with patch from Samu Nuutamo
- rdiffdir patch crashes if a regular file is changed to a non-regular
file (symlink, fifo, ...)
* Fixed bug 1448249 and bug 1449151 thanks to David Coppit.
- When patching, close base file before renaming
- Enable --ignore-errors flag in rdiffdir
* Added ability to get single file status from collection-status with
patch from jitao (bug 1044715), like so:
$ duplicity collection-status --file-changed c1 file://./foo
* Merge in lp:~sjakthol/duplicity/onedrive-error-message
- Add proper error message for OneDrive backend when python-requests or
python-requests-oauthlib is not installed (bug 1453355).
New in v0.7.02 (2015/03/10)
---------------------------
* Merged in lp:~vincegt/duplicity/swift_regionname
- Fixes bug #1376628
- Add mapping of SWIFT_REGIONNAME to select region inside SWIFT when a
provider proposes more than one region.
* Merged in lp:~aaron-whitehouse/duplicity/progress_option_error
- Added test_exclude_globbing_filelist_progress_option into
functional/test_selection.py, which shows the error reported in
Bug #1264744 - that the --exclude-globbing-filelist does not backup
the correct files if the --progress option is used. Test is marked as
an expected failure so as not to cause the test suite to fail.
* Merged in lp:~noizyland/duplicity/fix_azurebackend_container_names
- Azure Backend examples have underscores in the container names. These
are not valid Azure container names. The underscores have been replaced
with hypens and a note about valid container names added to the man page.
- Also corrects a problem where Azure Exceptions were returing unicode
strings that were not being handled correctly.
* Merged in lp:~user3942934/duplicity/pydrive
- Currently duplicity uses gdocs backend for Google Drive backups.
gdocs uses deprecated API and don't allow backups for managed Google
accounts. (see https://bugs.launchpad.net/duplicity/+bug/1315684)
- Added pydrive backend that solves both of those problems. Published
also on https://github.com/westerngateguard/duplicity-pydrive-backend.
* Fixed some tabs/spaces problems that were causing install failures.
* Fixed variable typo in commandline.py that was causing build fails.
* Merged in lp:~duplicity-team/duplicity/po-updates
* Remove 'gs' and 's3+http' from uses_netloc[]. Fixes Bug 1411803.
* Fixed bug # 1414418
- Aligned commandline.py options and help display contents.
- Aligned commandline.py options and manpage contents.
* Changed --s3_multipart_max_timeout to --s3-multipart-max-timeout to be
consistent with commandline option naming conventions.
* Applied patch from Adam Reichold to fix bug # 1413792.
* Merged in lp:~angusgr/duplicity/exclude-older-than
- Add "--exclude-older-than" commandline option, that allows you to only
back up files with a modification date newer than a particular threshold.
* Merged in lp:~aaron-whitehouse/duplicity/bug_884371_asterisks_in_includes
- Added tests to unit/test_selection.py and funtional/test_selection.py
to show the behaviour reported in Bug #884371, i.e. that selection is
incorrect when there is a * or ** on an include line of a filelist or
commandline --include.
* Merged in lp:~aaron-whitehouse/duplicity/bug_932482_trailing_slashes_and_wildcards_error
- Added functional and unit tests to show Bug #932482 - that selection does
not work correctly when excludes (in a filelist or in a commandline option)
contain both a single or double asterisk and a trailing slash.
* Misc fixes for the following PEP8 issues:
- E111, E121, E122, E124, E125, E126, E127, E128, E201, E202, E203,
E231, E241, E251, E261, E262, E271, E272, E301, E302, E303, E401,
E502, E701, E702, E703, E711, E721, W291, W292, W293, W391
- to run pep8 on duplicity use 'pep8 --ignore=E501'
- see http://pep8.readthedocs.org
* Fixes for 2to3 issues
* Fix spelling error in manpage, bug 1419314.
* Fix _librsyncmodule.c compilation, bug 1416344, thanks to Kari Hautio.
* Really fix bug 1416344 based on comment #5 by Roman Tereshonkov.
* Fix for --pydevd debug environment and location under Eclipse.
* Fix for bug where scp was actually working as scp and not working with
rsync.net because of using extraneous test command in restricted shell.
Was trying "test -d 'foo' || mkdir -p 'foo'", now only "mkdir -p foo".
* remove extraneous string format arg in previous scp fix.
New in v0.7.01 (2015/01/11)
---------------------------
Enhancements:
* Undid move of testing/test_code.py. Instead I fixed it
so that it would not run during PPA build. It now needs
the setting RUN_CODE_TESTS=1 in the environment which is
supplied in the tox.ini file.
* Moved testing/test_code.py to testing/manual/code_test.py
so PPA builds would succeed. Should be moved back later.
* Remove valid_extension() check from file_naming.py. It was
causing failed tests for short filenames. Thanks edso.
* Partial fix for PPA build failures, new backend name.
* Merged in lp:~ed.so/duplicity/fix.dpbx.import
- fix dpbx import error import lazily
* Merged in lp:~hooloovoo/duplicity/fix-typo-in-test-description
- Fixed spelling mistake/typo in a description of a test.
* Merged in lp:~mterry/duplicity/missing-unicode-escape
- Convert restore_dir to unicode before printing.
* Merged in lp:~ed.so/duplicity/lftp.ncftp.and.prefixes
- retire --ssh-backend, --use-scp parameters
- introduce scheme prefixes for alternative backend selection
e.g. ncftp+ftp://, see manpage
- scp is now selected via scheme e.g. scp://
- added lftp fish, webdav(s), sftp support
* Merged in lp:~mterry/duplicity/code-nits
- Fix some pylint/pep8 nits that prevented the test_code.py test from passing.
* Merged in lp:~mterry/duplicity/debian-dir
- Add a debian/ directory to make it easier to manage the PPAs for duplicity.
* In webdavbackend.py:
- Fixed bug 1396106 with change by Tim Ruffing, mispelled member.
- Added missing 'self.' before member in error message.
* Merged in lp:~adrien-delhorme/duplicity/hubic
- Add Hubic support through pyrax and a custom pyrax_identity module.
* Fixed bug 1385599 with changes by Yannick Molin. SSL settings are now
conditioned on protocol ftp or ftps.
* Partial fix of bug 1236248 with changes by az, manpage warning about
--extra-clean, however, recovery with missing sig files is broken.
* Fixed bug 1255453 with changes by Gaudenz Steinlin, report backend import
results, both normal and failed, at INFO log level.
* Manually merged in lp:~m4ktub/duplicity/0.6-reliability
- Per fix proposed in Bug #1395341.
* Modded .bzrignore to ignore *.egg test dependencies, normalized, sorted.
* Merged in lp:~ed.so/duplicity/paramiko.identyfile
- fix identity file parsing of --ssh-options for paramiko
- manpage fixes
* Source formatted, using PyDev, all source files to fix some easily fixed
PEP8 issues. Use ignore space when comparing against previous versions.
* Merge in lp:~andol/duplicity/signkeyformat
- Allow --sign-key to use short format, long format alt. full fingerprint.
* Merge in lp:~hooloovoo/duplicity/verify-not-check-source
- Tests to validate that duplicity does not check filesystem source during
verify unless --compare-data is specified
* Merge in lp:~ed.so/duplicity/move_netloc
- move netloc usage definitions into respective backends
- fix "[Question #259173]: rsync backend fails"
https://answers.launchpad.net/duplicity/+question/259173
* Make ssh an unsupported backend scheme
* Temporarily disable RsyncBackendTest and test_verify_changed_source_file
* Merge in lp:~hooloovoo/duplicity/test-verify-improvements
- Fix up test_verify, which was a bit of a mess:
- Simplify test_verify.py to just do a simple backup and verify on a
single file in each test.
- Modify tests to correctly use --compare-data option.
- Add tests for when the source files have atime/mtime manipulated.
* Fix duplicity verify to ignore the file system when globals.compare_data is
False. This means that verify only validates the viability of the backup
itself unless --compare-data is specified.
* Reenable test_verify_changed_source_file test
* Merged in lp:~hooloovoo/duplicity/add-additional-verify-tests-for-corrupted-archives
- Add tests to test_verify.py to test that verify fails if the archive
file is corrupted. Changed file objects to use the with keyword to ensure
that the file is properly closed.
- Small edit to find statement in verify_test.sh to make it work as
expected (enclose string in quotes).
* Merged in lp:~hooloovoo/duplicity/add-else-to-badupload-try-except
- Badupload test previously did not have an else in the try-except. The
test passed if the except was triggered, but would also pass if the
test did not trigger an error at all.
* Fixed bug 1406173 by applying patch supplied in report
- Ignore .par2 files in remote file list
* Removed redundant shell test testing/verify_test.sh
* Misc fixes for the following PEP8 issues:
- E211, E221, E222, E225, E226, E228
- see http://pep8.readthedocs.org
* Fixed bug 1278529 by applying patch supplied in report
- Use get_bucket() rather than lookup() on S3 to get proper error msg.
* Merged in lp:~stapelberg+ubuntu/duplicity/add-onedrive-backend
- Add a Microsoft OneDrive backend
* Merged in lp:~hooloovoo/duplicity/filelist_select_bug_1408411
- Adds functional test cases that fail because of Bug #1408411 (commented
out), to assist in fixing that bug.
* Merged in lp:~hooloovoo/duplicity/process_filelists_for_spaces_etc
- Process filelists to remove imperfections such as blank lines, comments
and leading/trailing whitespace. Also correctly processes quoted folders
containing spaces in their names. Extensive unit and functional tests to
test these changes (and selection more generally).
- The branch does add an additional folder to testfiles.tar.gz called
select2. This included a folder with a trailing space, to test the quote
test. The subfolders also have clearer names than in the "select" folder
(eg "1sub2sub3") which makes it easier to keep track of issues in tests.
* Merged in lp:~9-sa/duplicity/FixBug1408289
- Fix bug #1408289
- Wrong attribute name prevented raise of client exception, working now
* Merged in lp:~noizyland/duplicity/azurebackend
- Add backend for Azure Blob Storage Service
New in v0.7.00 (2014/10/23)
---------------------------
Enhancements:
* Adjust unit tests to expect single FTP backend
* Merged in lp:~moritzm/duplicity/duplicity
- Use lftp for both FTP and FTPS
* Merged in lp:~ed.so/duplicity/0.7-dpbx.importfix
- fix this showstopper with the dropbox backend
"NameError: global name 'rest' is not defined"
* Merged in lp:~jflaker/duplicity/BugFix1325215
- The reference to "--progress_rate" in the man page as a parameter is
incorrect. Should be "--progress-rate".
* Merged in lp:~hooloovoo/duplicity/updated-README-REPO
- Changes to README-REPO to reflect the restructuring of the directories.
* Fixed bug 1375304 with patch supplied by Aleksandar Ivanovic
* Merged in lp:~ed.so/duplicity/webdav200fix-0.7
- webdav backend fix "BackendException: Bad status code 200 reason OK. " when
restarting an interrupted backup and overwriting partially uploaded volumes.
* Merged in lp:~mterry/duplicity/require-2.6
- Require at least Python 2.6.
- Our code base already requires 2.6, because 2.6-isms have crept in. Usually
because we or a contributor didn't think to test with 2.4. And frankly,
I'm not even sure how to test with 2.4 on a modern system.
* Merged in lp:~mterry/duplicity/drop-pexpect
- Drop our local copy of pexpect in favor of a system version.
- It's only used by the pexpect ssh backend (and if you're opting into that,
you probably can expect that you will need pexpect) and the tests.
- I've done a quick smoketest (backed up and restored using
--ssh-backend=pexpect) and it seemed to work fine with a modern version
of pexpect.
* Merged in lp:~mterry/duplicity/2.6isms
- Here's a whole stack of minor syntax modernizations that will become
necessary in python3. They all work in python2.6.
- I've added a new test to keep us honest and prevent backsliding on these
modernizations. It runs 2to3 and will fail the test if 2to3 finds anything
that needs fixing (with a specific set of exceptions carved out).
- This branch has most of the easy 2to3 fixes, the ones with obvious and
safe syntax changes.
- We could just let 2to3 do them for us, but ideally we use 2to3 as little
as possible, since it doesn't always know how to solve a given problem.
I will propose a branch later that actually does use 2to3 to generate
python3 versions of duplicity if they are requested. But this is a first
step to clean up the code base.
* Merged in lp:~mterry/duplicity/drop-static
- Drop static.py.
- This is some of the oldest code in duplicity! A bzr blame says it is
unmodified (except for whitespace / comment changes) since revision 1.
- But it's not needed anymore. Not really even since we updated to python2.4,
which introduced the @staticmethod decorator. So this branch drops it and
its test file.
* Merged in lp:~mterry/duplicity/py3-map-filter
- In py3, map and filter return iterable objects, not lists. So in each case
we use them, I've either imported the future version or switched to a list
comprehension if we really wanted a list.
* Merged in lp:~mterry/duplicity/backend-unification
- Reorganize and simplify backend code. Specifically:
- Formalize the expected API between backends and duplicity. See the new
file duplicity/backends/README for the instructions I've given authors.
- Add some tests for our backend wrapper class as well as some tests for
individual backends. For several backends that have some commands do all
the heavy lifting (hsi, tahoe, ftp), I've added fake little mock commands
so that we can test them locally. This doesn't truly test our integration
with those commands, but at least lets us test the backend glue code.
- Removed a lot of duplicate and unused code which backends were using (or
not using). This branch drops 700 lines of code (~20%)
in duplicity/backends!
- Simplified expectations of backends. Our wrapper code now does all the
retrying, and all the exception handling. Backends can 'fire and forget'
trusting our wrappers to give the user a reasonable error message.
Obviously, backends can also add more details and make nicer error
messages. But they don't *have* to.
- Separate out the backend classes from our wrapper class. Now there is no
possibility of namespace collision. All our API methods use one
underscore. Anything else (zero or two underscores) are for the backend
class's use.
- Added the concept of a 'backend prefix' which is used by par2 and gio
backends to provide generic support for "schema+" in urls -- like par2+
or gio+. I've since marked the '--gio' flag as deprecated, in favor of
'gio+'. Now you can even nest such backends like
par2+gio+file://blah/blah.
- The switch to control which cloudfiles backend had a typo. I fixed this,
but I'm not sure I should have? If we haven't had complaints, maybe we
can just drop the old backend.
- I manually tested all the backends we have (except hsi and tahoe -- but
those are simple wrappers around commands and I did test those via mocks
per above). I also added a bunch more manual backend tests to
./testing/manual/backendtest.py, which can now be run like the above to
test all the files you have configured in config.py or you can pass it a
URL which it will use for testing (useful for backend authors).
* Merged in lp:~mterry/duplicity/py2.6.0
- Support python 2.6.0.
- Without this branch, we only support python >= 2.6.5 because that's when
python's urlparse.py module became its more modern incarnation. (I won't
get into the wisdom of them making such a change in the middle of the
2.6 lifecycle.)
- Also, the version of lockfile that I have (0.8) doesn't work with python
2.6.0 or 2.6.1 due to their implementation of
threading.current_thread().ident returning None unexpectedly. So this
branch tells lockfile not to worry about adding the current thread's
identifier to the lock filename (we don't need a separate lock per thread,
since our locking is per process).
- I've tested with 2.6.0 and 2.7.6 (both extremes of our current support).
* Update shebang line to python2 instead of python to avoid confusion.
* Merged in lp:~3v1n0/duplicity/copy.com-backend
- I've added a backend for Copy.com cloud storage, this supports all the
required operations and works as it should from my tests.
- You can use it by calling duplicity with something like:
copy://account@email.com:your-password@copy.com/duplicity
- The only thing I've concerns with is the optimized support for _delete_list
which can't be enabled here because the test_delete_list tries also to
delete a not-existing files, and it requires the backend not to raise an
exception in that case (is this somewhat wanted or could we do the same as
for _delete or _query?)
* Merged in lp:~ed.so/duplicity/webdav200fix-0.7
- webdav backend fix "BackendException: Bad status code 200 reason OK. " when
restarting an interrupted backup and overwriting partially uploaded volumes.
* Merged in lp:~mterry/duplicity/webdav-fixes
- This branch fixes two issues I saw when testing the webdav backend:
- 1) Errors like the following: "Attempt 1 failed. BackendException: File
/tmp/duplicity-LQ1a0i-tempdir/mktemp-u2aiyX-2 not found locally after get
from backend". These were caused by the _get() method not calling setdata()
on the local path object, so the rest of the code thought it didn't exist.
- 2) Some odd issues from stale responses/data. We have a couple places in
webdavbackend.py where we close the connection before making a request
because of this problem. But I've changed it to do it every time, more
reliably, by putting a _close() call inside the request() method.
- With this, the webdav backend seems fine to me.
* Merged in lp:~antmak/duplicity/0.7-par2-fix
- Useful fix for verbatim par2cmdline options (like "-t" in par2-tbb version)
* Fixed bug 1327550: OverflowError: signed integer is greater than maximum
- Major and minor device numbers are supposed to be one byte each. Someone
has crafted a special system image using OpenVZ where the major and minor
device numbers are much larger (ploop devices). We treat them as (0,0).
* Added sxbacked.py, Skylable backend. Waiting on man page updates.
* Merged in lp:~ed.so/duplicity/manpage.verify
- Clarify verify's functionality as wished for by a user surprised with a big
bandwidth bill from rackspace.
* Merged in lp:~jeffreydavidrogers/duplicity/duplicity
- This change fixes two small typos in the duplicity man page.
* Merged in lp:~johnleach/duplicity/1315437-swift-container-create
- Check to see if the swift container exists before trying to create it,
in case we don't have permissions to create containers. Fixes#1315437
* Merged in lp:~ed.so/duplicity/manpage.blocksize
- add --max_blocksize doc
- reorder 'a note on filename prefixes' into alphabetical order
Enhancements:
* Merged in lp:~m4ktub/duplicity/0.6-reliability
- Per fix proposed in Bug 1395341.
* Modded .bzrignore to ignore *.egg test dependencies, normalized, sorted.
* Backport fix for bug 1278529
- Use try/except around get_bucket() rather than bare lookup()
* Backport _librsyncmodule.c compilation bug
Changes from previous:
New in v0.6.25 (2014/10/20)
---------------------------
Enhancements:
* Add deprecation warning for 0.6 series
* Merged in lp:~ed.so/duplicity/0.6-dpbx.importfix
- fix this showstopper with the dropbox backend
"NameError: global name 'rest' is not defined"
* Merged in lp:~jflaker/duplicity/BugFix1325215
- The reference to "--progress_rate" in the man page as a parameter is
incorrect. Should be "--progress-rate".
* Merged in lp:~hooloovoo/duplicity/updated-README-REPO
- Changes to README-REPO to reflect the restructuring of the directories.
* Fixed bug 1375304 with patch supplied by Aleksandar Ivanovic
* Merged in lp:~ed.so/duplicity/webdav200fix-0.6
- webdav backend fix "BackendException: Bad status code 200 reason OK. " when
restarting an interrupted backup and overwriting partially uploaded volumes.
* Merged in lp:~antmak/duplicity/0.6-par2-fix
- Useful fix for verbatim par2cmdline options (like "-t" in par2-tbb version)
* Merged in lp:~jon-haggblad/duplicity/ftps-fix
- Minor bugfix for ftps backend where lftp needs host prefixed by "ftps://".
* Fixed bug 1327550: OverflowError: signed integer is greater than maximum
- Major and minor device numbers are supposed to be one byte each. Someone
has crafted a special system image using OpenVZ where the major and minor
device numbers are much larger (ploop devices). We treat them as (0,0).
* Merged in lp:~jon-haggblad/duplicity/ftps-fix (2nd try)
- Minor bugfix for ftps backend where lftp needs host prefixed by "ftps://".
* Merged in lp:~johnleach/duplicity/1315437-swift-container-create
- Check to see if the swift container exists before trying to create it,
in case we don't have permissions to create containers. Fixes#1315437
- improved support for Amazon Glacier
- removed support for Ubuntu One, which is closing shop
- new locking mechanism to avoid concurrent execution with same cache
- many other bugfixes and minor improvements. See CHANGELOG.
changes:
-many fixes
-new option: Generate encrypted backups without revealing the user's
key id via option --hidden-encrypt-key
-translation updates
-cleanup, doc improvement
pkgsrc changes:
-added option to use gnupg2
-drop py-boto dependency -- if we had a dependency for each possible
backend, it would be just too much. add a MESSAGE pointing to
some options and information
-minor cleanup
New in v0.6.19 (2012/05/22)
---------------------------
Enhancements:
- lots of work on the man page to clean up requirements, etc.
- use empty listbody for enhanced webdav compatibility
- initial folder creation on backend does not result in a ResponseNotReady anymore
- add ssh_config support (/etc/ssh/ssh_config + ~/.ssh/config) to paramiko sshbackend
- add missing_host_key prompt to new sshbackend similar to ssh procedure
- added --ssh-backend parameter to switch between paramiko,pexpect
- allow answering gio mount questions (albeit naively)
- if the gio backend wants to ask a question during its mount phase, it previously just aborted.
- a couple more warning error codes that Deja Dup is interested in noticing.
- ssh paramiko backend respects --num-retries now
- set retry delay for ssh backends to 10s
- ssh pexpect backend
+ sftp part does not claim 'Invalid SSH password' although it's only 'Permission denied' now
+ sftp errors are now more talkative
- gpg.py
+ commented assert which broke otherwise working verify run
Bugs closed in this release:
588541 Connection failed, please check your password: Login dialog cancelled
Merges:
lp:~ed.so/duplicity/0.6-manpage
lp:~ed.so/duplicity/0.6-webdav_fixes
lp:~carlos-abalde/duplicity/gdocs-backend-gdata-2.0.16.-upgrade.
lp:~ed.so/duplicity/0.6-ssh_add_missinghostkey
lp:~ed.so/duplicity/0.6-readd_sshpexpect
New in v0.6.18 (2012/02/29)
---------------------------
Enhancements:
- fix extraneous '.py' in botobackend.py include
- tests: add delay between backups to avoid assertion error
- tests: use backup source that is more likely to be larger than 1M compressed
- tests: make other-filesystem check more robust against certain directories being mounts or not
- resuming an incremental results in a 'Restarting backup, but current encryption settings do not match original settings' error because curtime is incorrectly set away from previous incremental value
- added option to not compress the backup, when no encryption is selected
- always delay a little bit when a backend gives us errors
- Don't cache TarInfo files. Tests still pass, so I don't believe we need the members cache (and in the old tarfile.py, we didn't cache either).
- Adding --file-prefix option so different sets of backups can be stored in the same bucket. See blueprint at https://blueprints.launchpad.net/duplicity/+spec/file-prefix-option
- two changes that help the test suite pass
- raise log level on backend import failure so it will be visible under default conditions
- file /etc/motd may not exist in test environment. Use __file__ instead to point to a known plaintext source file.
- some code/import changes to make the ssh and boto backends compatible with Python 2.4.
- some changes to make roottest.py compatible with the new dir structure.
Bugs closed in this release:
884638 Python 2.5 / boto error
908228 possible memory leak
909031 SSH-Backend: Creating dirs separately causes a permissons-problems
916689 multipart upload fails on python 2.7.2
929465 UnsupportedBackendScheme: scheme not supported in url: scp://u123@u123.example.com/foo/
930727 ftpsbackend should respect num_retries for ftp commands
931175 duplicity crashes when PYTHONOPTIMIZE is set
Merges:
lp:~mterry/duplicity/always-delay
lp:~mterry/duplicity/memleak
lp:~mterry/duplicity/nopexpect
lp:~mterry/duplicity/resume-inc
lp:~mterry/duplicity/testfixes
lp:~nguyenqmai/duplicity/file-prefix-option
lp:~tobias-genannt/duplicity/nocompress
New in v0.6.17 (2011/11/25)
---------------------------
Enhancements:
- Added --rsync-options flag to allow user to pass options to rsync at will
- Added --s3-use-multiprocessing to select the new s3 multiprocessing backend.
Default is to use the single processing backend. A helper, filechunkio.py,
requires Python 2.6+, so this option is not usable in earlier versions.
Bugs closed in this release:
411145 Misleading error message: "Invalid SSH password"
871875 File ... was corrupted during upload.
878220 UnsupportedBackendScheme: scheme not supported in url: s3+http
878964 Resuming a backup with a different password should throw an error
881070 Bugfix for S3 multipart upload on 0.6.16
881727 duplicity 0.6.16 lists all backup sets as incomplete
885670 Duplicity fails to add incremental backups to chain...
Merges:
lp:~mterry/duplicity/check-passphrase-on-restart
lp:~moss-d/duplicity/rsync-options
while here,
* LICENSE=gnu-gpl-v2
* no need to buildlink with py-boto, simple DEPENDS is sufficient.
* no need to depend on py-gnupg, this package contains own one.
* fixes locale dir.
* distutils package, register egg-info.
New in v0.6.16 (2011/10/16)
----------------------------
Enhancements:
- Usability enhancement: sign passphrase prompt has no second
verification prompt anymore, symmetric passphrases are
still verified
- Fixed Unicode errors when translations are used.
- Replaced old tarfile.py with Python 2.7 version, modded
to support Python 2.4 syntax.
Bugs closed in this release:
485219 Fixed fields are not fixed, leading to buffer overflows...
676109 Amazon S3 backend multipart upload support
690549 uid and guid setting adversely affects integrity
739438 Local backend should always try renaming instead of copying
832149 Uploads to Rackspace fail silently
835892 duplicity crash: "AssertionError: rb None None"
838162 Duplicity URL Parser is not parsing IPv6 properly
838264 Duplicity thinks partial encrypted backups are not encrypted
870116 Duplicity does not handle UIDs higher than 60001
Merges:
lp:~ed.so/duplicity/reuse-passphrase-for-signing-fix
lp:~mterry/duplicity/cloudfiles-10k
lp:~duplicity-team/duplicity/check-volumes
lp:~mterry/duplicity/tarfile
lp:~mterry/duplicity/partial-encryption
lp:~mterry/duplicity/fix-local-backend-validation
lp:~ross-ross-williams/duplicity/gpg-agent-fix
lp:~mterry/duplicity/rbNoneNone
lp:~ed.so/duplicity/UnicodeDecodeError
New in v0.6.15 (2011/08/19)
----------------------------
Enhancements:
- Ignore 404 errors when deleting a file on Ubuntu One.
- Ignore ENOENT (file missing) errors where it is safe.
- Set minimum Python version to 2.4 in README.
- introduce --numeric-owner parameter
patch courtesy of Lukas Anzinger <l.anzinger AT gmail.com>
- duplicity:restore_check_hash
"Invalid data - *** hash mismatch" lists the offending filename
- fixes to unit tests to support SIGN_PASSPHRASE
Bugs closed in this release:
524922 duplicity does not have numeric uid/gid support
703142 AssertionError: assert len(chain_list) == 2
794576 Transport endpoint is not connected
815635 Bad passphrase can leave bogus sigtar in archive
818178 Shouldn't try to delete files it knows don't exist
821368 Error doing backup of the .evolution folder
823556 sftp errors after rev 740 change
824678 0.6.14 Fails to install on 8.04 LTS (Hardy)
Merges:
lp:~mterry/duplicity/u1-ignore-404
lp:~mterry/duplicity/guard-tarinfo
lp:~mterry/duplicity/enotconn
lp:~mterry/duplicity/look-at-partials-during-sync
lp:~mterry/duplicity/more-accurate-sync
lp:~mterry/duplicity/report-encrypted-chains
lp:~mterry/duplicity/815635
lp:~mterry/duplicity/retry-u1
lp:~mterry/duplicity/818178
lp:~ed.so/duplicity/encr-sign-key2
lp:~mterry/duplicity/u1-fixes
lp:~carlos-abalde/duplicity/google-docs
lp:~ed.so/duplicity/numowner+hashverbose
New in v0.6.14 (2011/06/18)
----------------------------
Enhancements:
452342 Provide Ubuntu One integration
Bugs closed in this release:
433591 AttributeError: FileobjHooked instance has no attribute 'name'
487720 Restore fails with "Invalid data - SHA1 hash mismatch"
507904 Cygwin: Full Backup fails with "IOError: [Errno 13] Permission denied"
512628 --exclude-filelist-stdin and gpg error with/without PASSPHRASE
680425 Endless retype passphrase when typo
705499 "include-filelist-stdin" not implemented on version 0.6.11
739438 [PATCH] Local backend should always try renaming instead of copying
753858 cannot import name S3ResponseError
761688 Difference found: File X has permissions 666, expected 666
777377 collection-status asking for passphrase
778215 ncftpls file delete fails in ftpbackend.py
782294 create tomporary files with sftp
782321 duplicity sftp backend should ignore removing a file which is not there
792704 Webdav(s) url scheme lacks port support
782294 create tomporary files with sftp
782337 sftp backend cannot create new subdirs on new backup
794123 Timeout on sftp command 'ls -1'
797758 Duplicity ignores some FatalErrors
793096 Allow to pass different passwords for --sign-key and --encrypt-key
Merges:
lp:~ed.so/duplicity/0.6-add_sftp
lp:~ed.so/duplicity/0.6-nonfatal-exclude
lp:~lekensteyn/duplicity/multipass
lp:~mterry/duplicity/797758
lp:~mterry/duplicity/gio-name
lp:~mterry/duplicity/levelName
lp:~mterry/duplicity/retry-decorator
lp:~mterry/duplicity/u1-status
New in v0.6.13 (2011/04/02)
----------------------------
Enhancements added this release:
New manual test to make Ctrl-C issues easier to replicate.
Use python-virtualenv to make testing multiple Python versions easier.
In boto backend check for existing bucket before trying to create.
Bugs closed in this release:
579958 Assertion error "time not moving forward at appropriate pace"
613244 silent data corruption with checkpoint/restore
731905 File "/usr/bin/duplicity", error after upgrade from 6.11 to 6.12
New in v0.6.12 (2011/03/08)
----------------------------
Enhancements added this release:
626915 ftps support using lftp (ftpsbackend)
Bugs closed in this release:
486489 Only full backups done on webdav
578663 Use log codes for common backend errors
581054 Inverted "Current directory" "Previous directory" in error message
620163 OSError: [Errno 2] No such file or directory
629136 sslerror: The read operation timed out with cf
629984 boto backend uses Python 2.5 conditional
655797 symbolic link ownership not preserved
670891 Cygwin: TypeError: basis_file must be a (true) file ...
681980 Duplicity 0.6.11 aborts if RSYNC_RSH not set
700390 Backup fails silently when target is full (sftp, verbosity=4)
704314 Exception in log module
Merges:
lp:~mterry/duplicity/backend-log-codes3
lp:~blueyed/duplicity/path-enodev-bugfix
New in v0.6.11 (2010/11/20)
----------------------------
Bugs closed in this release:
433970 Add an option to connect to S3 with regular HTTP (and not HTTPS)
578663 Use log codes for common backend errors
631275 missing ssh on rsyncd url - rsync: Failed to exec ssh: ...
635494 backed up to S3, wiped drive, reinstalled, unable to restore backup
637556 os.execve should get passed program as first argument
669225 sftp: "Couldn't delete file: Failure'" only logged on level 9
655468 0.6.10 does not work with S3
674506 RsyncBackend instance has no attribute 'subprocess_popen_persist'
Merges:
lp:~blueyed/duplicity/bug-669225
lp:~duplicity-team/duplicity/po-updates
lp:~ed.so/duplicity/0.6.10-backend_fixes
lp:~ed.so/duplicity/RSYNC_RSH-fix
lp:~ed.so/duplicity/sign_symmetric2
lp:~ed.so/duplicity/survive_spaces
lp:~l2g/duplicity/use-py.test
lp:~mbp/duplicity/433970-non-ssl
New in v0.6.10 (2010/09/19)
----------------------------
Bugs closed in this release:
542482 Offer command to remove old incremental backups from target
578663 Use log codes for common backend errors
589495 duplicity --short-filenames crashes with TypeError
612714 NameError: global name 'parsed_url' is not defined
613448 ftpbackend fails if target directory doesn't exist
615449 Command-line verbosity parsing crash
New in v0.6.09 (2010/07/25)
----------------------------
Bugs closed in this release:
502609 Unknown error while uploading duplicity-full-signatures
539393 Duplicity returns 1 when continuing an interrupted backup
550455 duplicity doesn't handle with large files well
567738 --ssh-options options passing options to ssh do not work
576564 username not url decoded in backend (at least rsync)
579958 Assertion error "time not moving forward at appropriate pace"
582962 Diminishing performance on large files
Upgraded tahoebackend to new parse_url.
Fix to warning message in sshbackend.
New in v0.6.08b (2010/03/11)
----------------------------
Fix bug where encrypted backup without --gpg-options crashes.
This was a followup issue to bug 490619 released in 0.6.07.
This is attempt #2 -- not sure what happened to the patch,
but it did not show up in 0.6-series like it should have.
New in v0.6.08a (2010/03/11)
----------------------------
Fix bug where encrypted backup without --gpg-options crashes.
This was a followup issue to bug 490619 released in 0.6.07.
New in v0.6.08 (2010/03/07)
---------------------------
Bugs closed in this release:
519110 Need accurate man page info on use of scp/sftp usage.
532051 rdiffdir attempts to reference undefined variables with some command arguments
529869 TypeError: unsupported operand type(s) for -: 'NoneType' and 'int'
530910 TypeError: unsupported operand type(s) for +: 'NoneType' and 'str'
New in v0.6.07 (2010/02/28)
---------------------------
Bugs closed in this release:
459511 --tempdir option doesn't override TMPDIR
467391 [PATCH] WebDAV backend doesn't work
487686 re-add scp backend and make available via command line option
490619 Use optparse not getopt
497243 0.6.06, archive dir: cache desynchronization caused by remove*
501093 SSHBackend doesn't handle spaces in path
505739 "sslerror: The read operation timed out" with S3
520470 Don't Warn when there's old backup to delete
522544 OSError: [Errno 40] Too many levels of symbolic links
388673 Allow renaming paths as they are restored
New in v0.6.06 (2009/10/29)
---------------------------
Merged in lp:~mterry/duplicity/list-old-chains
List/keep old signature chains
Applied patches from Kasper Brand that fixed device file handling.
http://lists.gnu.org/archive/html/duplicity-talk/2009-09/msg00001.html
Merged in lp:~l2g/duplicity/flag-transl-comments which cleared up how
translation comments should be passed to the translators cleanly now.
Applied 422477; [PATCH] IMAP Backend Error in delete()
Merged in lp:~mterry/duplicity/iterate-warnings
Add machine codes to various warnings when iterating over source files
Fix problems with unittests under Jaunty. It appears that redirection
in os.system() has changed for the worse, so a workaround for now.
Fix problem in restart where there were no manifest entries and no
remote volumes stored. We clean out the partial and restart.
Fixed 435975 gpg asks for password in 0.6.05, but not in 0.5.18
New in v0.6.05 (2009/08/28)
---------------------------
Merged in lp:~l2g/duplicity/test-compat from Larry Gilbert which made
the testing compatible across more systems. Also fixed the remaining
collectionstest bug which was trying to test with no cache present.
Bugs fixed this release:
407968 GIO backend can't restore
408059 Failure due to _logger.log failure for content with special
characters: TypeError decoding Unicode not supported
409593 deja-dup (or duplicity) deletes all signatures
412667 "duplicity remove-older-than" asks for passphrase even though
not required
418170 [PATCH] file names longer then 512 symbols are not supported
New in v0.6.04 (2009/08/01)
---------------------------
One major and one minor change. The "No such file or directory" error
is bad enough that this should be released quickly. For those of you
using encryption, this is not a problem, but for those of you that do
not use encryption (--no-encryption), then this will manifest itself if
the local cache gets out of sync with the remote store.
Bugs fixed this release:
405734 duplicity fails to restore files that contain a newline character
403790 Backup error: No such file or directory
New in v0.6.03 (2009/07/29)
---------------------------
Lots of small changes and some bug fixes.
* Restart error handling has been smoothed out a great deal and it
"does what is right" in order to keep going.
* Backends are now optional, if they fail an Info message is put out
to notify of the failure and why.
* There was more work on translations and internationalization.
Thanks to everyone!
Bugs fixed this release:
377528 --file-to-restore doesn't work with trailing slash
394757 Backend imports should be made optional
398230 Deja-dup backup fails with message: "Unable to locate last file"
401303 0.6.2 manpage inconsistent wrt. archive-dir/name
405646 Small i18n error
405975 duplicity.gpg.gpg_failed() breaks and spews on GnuPG error
402794 duplicity public-key-only incompatible with gnupg 2.0.11
New in v0.6.02 (2009/07/07)
---------------------------
Duplicity will now remove any spurious files left in the cache from
a previous run. This will keep the metadata cache in sync with the
remote storage metadata.
Bugs fixed this release:
394629 Hang on first collection-status
379386 Fix 'list-current-files' with missing archive dir
395826 "No such file or directory" when backing up second time
394627 User-friendly archive dir print
388699 Manifest mismatch error
New in v0.6.01 (2009/07/01)
---------------------------
Fixed issues in Checkpoint/Restart:
* The --name backupname" option was added to allow the
user to separate one archive from another. If not
specified, the default is an MD5 hash of the target
URL, which should suffice for most uses.
* The archive_dir (cache) is now stored in a standard
location, defaulting to ~/.cache/duplicity. See
http://standards.freedesktop.org/basedir-spec/latest/
* The interaction between the --archive-dir option and
the --name option allows for four possible results
for the location of the archive dir.
- neither specified (default)
~/.cache/duplicity/hash-of-url
- --archive-dir=~/arch, no --name
~/arch/hash-of-url
- no --archive-dir, --name=foo
~/.cache/duplicity/foo
- --archive-dir=~/arch, --name=foo
~/arch/foo
* duplicity will now copy needed metadata from the
remote store to the local cache as needed. This
means that the first use after upgraded from 0.5.x
will have the metadata copied to the local archive
dir in order to sync both.
* cleanup will now work correctly with the archive
dir and separates the local from the remote files.
Bugs fixed this release:
* 388034 Unable to backup
* 378940 python2-6 issue / UTF-8 charset / Ubuntu 9.04
* 379386 Fix list-current-files w/ missing archive dir
* 387102 Asynchronous upload not working properly
* 387218 Make scp/ssh into sftp-only backend
* 388992 List of Orphaned Files Growing
* 392905 NoneType object has no attribute 'startswith'
* 393372 Error creating directory
* 383412 Add InfoCodes for upload events
* 383419 Add gio backend
New in v0.6.00 (2009/06/08)
---------------------------
Checkpoint/Restart capability added. Checkpoint is
done at every volume written and Restart is done at
start of the next volume in the set. Changes to
normal operations include a permanent duplicity
archive-dir at ~/.duplicity to save state.
To accomplish this, the signature and archive files
in the archive-dir now have three states:
1) temporary until the first volume has been written,
2) partial until the final volume has been written and
sent to remote storage,
3) permanent with the same name as always.
Assumptions are made that if a restart is needed, then
all arguments are the same as before and that no files
have been removed from the file system between runs.
From now on, the --archive-dir option can be used to
change the location of the archive dir, but you are
responsible for moving the files if you change it.
Other fixes:
Unicode filenames in log messages are now OK.
Fixed problem where Cygwin was returning -1 for the
hard max open file limit.
New in v0.5.20 (2009/08/28)
---------------------------
Bugs fixed this release:
408059 Failure due to _logger.log failure for content with special
characters: TypeError decoding Unicode not supported
412667 "duplicity remove-older-than" asks for passphrase even though
not required
418170 [PATCH] file names longer then 512 symbols are not supported
New in v0.5.19 (2009/08/06)
---------------------------
Fixed problem where Cygwin was returning -1 for the
hard max open file limit.
On process that complete before waitpid(), log them
and return zero as the process return status.
Make sure 'invalid packet (ctb=14)' from gpg is not
a fatal error.
Copy changes from trunk for duplicity translation.
Allow handling of unicode filenames in log messages.
Ignore unicode() translation errors in log messsages.
New in v0.5.18 (2009/05/20)
---------------------------
Added support for RackSpace's CloudFiles, cf+http.
Added support for Tahoe-LAFS
patch #6743: Tahoe backend for duplicity
Only half of this bug is fixed but it's still useful.
bug #21792: pipe call fails with an error OSError:
[Errno 24] Too many open files
Changed from using ulimit external command to
resource.getrlimit to check open files limit.
New in v0.5.17 (2009/05/04)
---------------------------
Removed one line of code left from some testing that I
did that caused a crash when the target dir was empty
and collection-status was requested.
Moved from using the df command to get temp space
availability to Python's os.statvfs() call. Not all
df commands work the same way.
patch #6813: Making changelist easy to read
patch #6814: Ignore comments in filelists
New in v0.5.16 (2009/04/21)
---------------------------
bug #24825: duplicity warn on insufficient TMPDIR
space availability and low max open
file limits pre-backup.
bug #25594: wrong backup statistics
bug #25976: Password requested when not needed.
patch #6806: More graceful handling of old
--short-filename files
Added tilde and variable expansion to the source or
target argument that is not a URL.
New in v0.5.15 (2009/04/09)
---------------------------
FTP backend was failing on PureFTPd when the "-x ''"
option was removed from the second ncftpls popen, a fix
that was implemented due to bug #24741. This fix does
the ls in one pass by extracting the last entry on the
'ls -l' listing.
If a file is unreadable due to access rights or other
non-fatal errors, put out error message and continue
rather than dying messily with a traceback.
Added tilde '~' expansion and variable expansion in the
options that require a filename. You can now have this
"--archive-dir=~/ArchDir/$SYSNAME" if you need it. No
expansion is applied to the source or target URL's.
Fixed problem I caused, again, where sys.exit() was
trapping instead of exiting. Added big note to not
to do that again.
New in v0.5.14 (2009/04/02)
---------------------------
After email voting among known duplicity contributors,
the decision was reached to revert to the GPL Version 2
license, so with their consensus, duplicity is now under
GPL Version 2.
Revert to calling NcFTP utilities (ls, get, put) directly
rather than scripting ncftp via pexpect by reverting to the
0.5.07 version of ftpbackend.py.
Changed fatal error regarding version 3.2.0 of ncftpput to
warning level since it has been reported that the problem
does not occur on most distributions.
Changed from log.Log with numbered log levels to log.Debug,
log.Info, log.Notice, log.Warn, log.FatalError.
The -vN option has not changed. Verbosity may also be one
of: character [ewnid], or word ['error', 'warning', 'notice',
'info', 'debug']. The default is 4 (Notice). The options
-v4, -vn, and -vnotice are functionally equivalent, as are
the mixed-case versions, -vN, -vNotice, -vNOTICE.
Normalized include statements and tried to insure that all
duplicity includes were from the duplicity module.
patch #6790: Add --exclude-if-present
New in v0.5.13 (2009/03/26)
---------------------------
Add more error detection to FTP backend.
Fix backends so sleep does not occur after last retry.
Fix so BackendException does not cause traceback except when
verbosity is at level 5 or higher (Info level).
Adjust log levels so some errors show up with default verbosity.
Fixed bug where an extra comma caused a traceback during a warning
about unnecessary sig files. Plus fixed print so the real filename
would show up and not a Python object representation.
Add Changelog.GNU to website and distribution to add a bit of detail
showing the CVS changes via rcs2log. Added dist/mkGNUChangelog.sh.
bug #22908: Don't block gpg-agent
To fix the above, --use-agent was added as a command line option.
When this is specified and asymetric encryption is enabled, then all
GnuPG passphrases will come from the gpg-agent or equivalent program
and no passphrase prompt will be issued.
bug #25787: Usernames with escaped @-sign are not handled properly
bug #25976: Password requested when not needed.
patch #6787: import duplicity.GnuPGInterface explicitly
New in v0.5.12 (2009/03/15)
---------------------------
bug #25838: Backup fails / ncftp - remote file already exists
With this fix we also get resume in ftp get/put. If a put or
get fails part of the way through, ncftp will resume on the
next retry.
bug #25853: duplicity fails with boto passwords coming from ~/.boto
patch #6773: Make user name optional in rsync backend
GPG errors will no longer cause tracebacks, but will produce a
log entry, from gpg, similar to the following:
===== Begin GnuPG log =====
gpg: BAD0BAD0: skipped: public key not found
gpg: [stdin]: encryption failed: public key not found
===== End GnuPG log =====
This will let the user know what really caused the GPG process
to fail, and what really caused errors like 'broken pipe'.
New in v0.5.11 (2009/03/08)
---------------------------
bug #25787: Usernames with @-sign are not handled properly
Bug #333057: GnuPGInterface prints exit statuses incorrectly
bug #25696: ncftp error w/0.5.09 -- nested target directories
bug #15664: When restoring backup: "OverflowError:
long int too large to convert to int"
patch #6761: More robust pexpect handling of SSH authentication
patch #6762: Wrong exit() used for 2.3/2.4 Python
New in v0.5.10 (2009/03/01)
---------------------------
The default filename format has changed from W3 style to a long
numeric style, YYYYMMDDTHHMMSSZ, with no delimiters, thus is now
compatible with Windows/Samba filesystems. The time is UTC, not
local, so there will be no timezone or daylight savings time issues.
Duplicity still recognizes the old long filename format, and will
continue incremental backup chains if found. The old format is
still available via the --old-filenames option (pending deprecation).
Users of --short-filenames or --time-separator should stop using these
options on their next full backup. The new filenames are compatible
with your system.
The following options are pending deprecation and will be removed in a
future release:
--time-separator
--short-filenames
--old-filenames
bug #19988: Incompatibility to Samba/SMB share
bug #25097: Allow listing files from any time, not just current time
bug #25550: Error codes do not propagate from log to exit status
bug #25308: Signatures orphaned if from another time zone
Bug #229826: duplicity crashed with ValueError in port()
New in v0.5.09 (2009/02/17)
---------------------------
FTP is now driven with pexpect rather than NcFTP utilities.
This closes the following bugs (and solves other problems):
bug #24741: ncftpls -x '' causes failure on Yahoo FTP server
bug #23516: duplicity/ncftpget not closing unlinked files, ...
bug #25509: Logic error in imapbackend.py [IMAP_SERVER]
bug #25512: [Patch] Retry on Imap failure
bug #25530: commandline passwd not working
New in v0.5.08 (2009/02/02)
---------------------------
Turns out going backwards in the license is not as easy as
forwards. Restoring GPLv3 license until consensus reached.
New in v0.5.07 (2009/01/31)
---------------------------
bug #25293: IOError: [Errno 22] Invalid argument
bug #25379: sys.exit() causes traceback and should not
bug #25403: 0.5.06 "manifests not equal, different volume numbers"
patch #6729: New imap backend. Replaces current gmail backend
patch #6730: Fix timing out for SSH backend
patch #6733: Improve error handling in imapbackend.py
Increase default volume size (--volsize) to 25M from 5M. This
reduces the number of volumes to accomodate larger backups.
Reworked patch 6701 to list collection one at a time rather than
writing all as one huge list. Was causing memeory problems when
the collections got large.
Fix backendtest.py so that empty URL's in config.py cause the
backend test to be skipped rather than erroring. Added notes
in config.py.tmpl explaining the change.
Add/update copyright statements in all distribution source files
and revert duplicity to GPL version 2 license.
Original fix to disallow use of ncftpput 3.2.0 mistyped the ErrorCode
used and resulted in an error rather than an explanation.
New in v0.5.06 (2009/01/09)
---------------------------
Fix to deprecation warnings about sha and md5 modules.
Uses hashlib if available, otherwise original module.
Added loop to run-all-tests.sh to run all tests against all supported
versions of Python if available. Looks for 2.3, 2.4, 2.5, 2.6.
Noah Spurrier has given us permission to distribute pexpect.py along
with duplicity, so this will no longer be an install requirement.
NcFTP version 3.2.0 will not work with duplicity since we require the
use of both -f and -C options on ncftpput. 3.1.9, 3.2.1+ work fine.
I put in error checks for this situation in the FTP backend code.
bug #25230: --include-globbing-filelist only including first entry.
bug #25239: Error during clean, wrong case in duplcicity
patch #6709: Report correct number of volumes when restoring
sr #106583: document the need to use the --force option
New in v0.5.05 (2008/12/30)
---------------------------
bug #25194: Duplicity 5.04 requires python-distutils-extra...
New in v0.5.04 (2008/12/27)
---------------------------
patch #6678: Add progress metering
patch #6686: Add error codes for all fatal errors
bug #25090: Typos and trailing whitespace in duplicity manpage
bug #24889: NCFTP cannot deal with some FTP servers
patch #6692: Print collection status in a machine-readable way
patch #6693: Some FatalError's don't have codes still
patch #6694: Log exceptions
patch #6695: Log filenames
patch #6696: Consolidate get_delta_iter and get_delta_iter_w_sig
patch #6697: Always log at least one progress during dry run
patch #6700: Make duplicity translatable
patch #6701: Make current-list command machine-readable
patch #6702: handle unknown errnos in robust.py
GPG was throwing "gpg: [don't know]: invalid packet (ctb=14)" and apparently
this is non-fatal. There is a fix for this being rolled into GPG 2.x.
http://lists.gnupg.org/pipermail/gnupg-devel/2006-September/023180.html
Copied from collections.py. Fix supplied by Simon Blandford <simon@onepointltd.com>
New in v0.5.03 (2008/11/17)
---------------------------
bug #24731: Documentation error: "if... if" in remove-older-than paragraph
bug #24775: Digest Auth for WebDAV backend
patch #6676: Raw delta stats aren't right for multivolumes
patch #6675: Add modelines
patch #6674: Add --log-* options to man page
patch #6673: Add --dry-run option
patch #6672: makedist doesn't ship util.py
patch #6670: Machine Readable Output
patch #6662: improve s3 backend error reporting
patch #6652: improve asynch scheduler (including the synchronous case)
patch #6642: make ParsedUrl() thread-safe with respect to itself
patch #6638: correct typo in reporting lack of sufficiently new boto backend
sr #106496: put install-from-cvs-notes in CVS-README
sr #106534: GMail backups aren't stored in the correct location
New in v0.5.02 (2008/09/21)
---------------------------
- Add -h option for help
- Change gpg logging so that logs are always collected.
The log is printed in the case of gpg IO errors. Also,
verbosity level 5 or above (-v5) will print the logs.
patch #6297: Add IMAP/s/gmail support
bug #24260: backend.py missing re import
bug #24274: asyncscheduler.py missing sys import
New in v0.5.01 (2008/09/11)
---------------------------
bug #24234: Tabs Present In Source Files
bug #24223: WebDAV backend broken in 0.5.00
bug #24226: WebDAV Does Not Create Collection If Needed
New in v0.5.00 (2008/09/06)
---------------------------
Changes to unit tests:
- resolve circular imports after backend reorg
- resolve exception error import - now in errors.py
- remove need for temp2.tar to be in CVS repository
bug #23988: scp destination fails if no username is specified
bug #23985: --no-encryption option does not work in 0.4.12
patch #6623: slightly augment tempdir cleanup logging
patch #6596: re-organize backend module structure
patch #6589: S3 european bucket support
patch #6353: Concurrency for volume encryption and upload.
New in v0.4.10 (2008/03/27):
bug #22728: FTP backend fails on empty directory
patch #6374: Duplicity --tempdir patch documentation.
patch #6375: Duplicity reports the epoch for a nonexistant last full backup date
patch #6380: add additional named logging levels
patch #6389: Possible Fix for pagefile.sys on Win32 systems
patch #6403: Restore by overwriting files/directories by using --force option
patch #6449: add additional debug level logging
patch #6453: handle absolute urls in webdav backend
${WRKSRC}/CHANGES. With this update comes Amazon S3 support provided
by the newly imported net/py-boto package. This has not been tested yet,
however, as I do not have an S3 account. Please let me know if this update
has resulted in any untoward effects. Thanks.
Move get_password() to Backend class to standardize.
- Fix problem with ftpBackend to create target directory
if needed. Note: this creates only one level.
- Dropped ssh-command and added ssh-options to allow users
to add options to the scp and sftp commmands.
- Removed use of tempfile.TemporaryFile(). This fixes the
restore problem on Windows that was due to Python bug
1776696 reported on Sourceforge.
- Fixed Debian Bug#437694: Make bzip2 compression optional.
The default is not to do bzip2 compression. To use bzip2
add the following command line option:
--gpg-options='--compress-algo=bzip2 --bzip2-compress-level=9'
Note: do not add spaces in the string value.
- Fixed bug 20764 - unable to use port in ssh backend.
https://savannah.nongnu.org/bugs/?20764
- Remove ssh_command option, add ssh_options. This adds
options to the scp and sftp commands that are used by
the ssh backend.
- Change ssh backend to send 'quit' instead of EOF when
using sftp. This allows it to run under cron as long
as the password is supplied non-interactively.
- Change ssh backend to not pass :port part of URL to
scp or sftp. We already supply -oPort=xx for port.
bsiegert
adam
joerg
hiramatsu
riz
drochner
wiz
obache
tnn
bjs
tron
agc
wennmach