While there also add patches for security issues XSA-172, XSA-173 and XSA-179
(others between 170 and 179 are either not yet public, or linux-only).
Upstream changes since 4.5.2:
- security issues up to XSA-170 are fixed (these were already patched
in pkgsrc).
- other minor performances and functionality fixes.
full changelog at:
http://www.xenproject.org/downloads/xen-archives/xen-45-series/xen-453.html
Date 2016-05-07
Summary: smartmontools release 6.5
-----------------------------------------------------------
- Experimental support for NVMe devices on FreeBSD, Linux and Windows.
- smartctl '-i', '-c', '-H' and '-l error': NVMe support.
- smartctl '-l nvmelog': New option for NVMe.
- smartd.conf '-H', '-l error' and '-W': NVMe support.
- Optional NVMe device scanning support on Linux and Windows.
- configure option '--with-nvme-devicescan' to include NVMe in
default device scanning result.
- Device scanning now allows to specify multiple '-d TYPE' options.
- ATA: Added new POWER MODE values introduced in ATA ACS-2.
- ATA: SCT commands are no longer issued if ATA Security is locked.
- SCSI: LB provisioning improvements.
- SCSI: Fixed GLTSD bit set/cleared info messages.
- SCSI: Solid State media log page is no longer checked for tapes.
- SCSI: Improved handling when no tape cartridge in drive.
- SCSI: Workaround for buggy Seagate firmware.
- SAT: Improved heuristics to detect bogus sense data from SAT layer.
- smartd: Fixed crash on missing argument to '-s' directive.
- update-smart-drivedb: Now uses HTTPS for download by default.
- update-smart-drivedb: New options to select URL and download tool.
- update-smart-drivedb: New download tool 'svn'.
- configure option '--without-update-smart-drivedb' to disable
update-smart-drivedb script.
- configure options '--disable-drivedb', '--enable-savestates',
'--enable-attributelog' and '--with-docdir' are no longer supported.
- autoconf < 2.60 and automake < 1.10 are no longer supported.
- Drive database file now also includes the DEFAULT setting
for each attribute.
- HDD, SSD and USB additions to drive database.
- Darwin: New support files for package installer.
New makefile target 'install-darwin' builds DMG image.
- Solaris: Auto detection of SATA devices behind SAT layer.
- Solaris SPARC: Legacy ATA support disabled by default.
New configure option '--with-solaris-sparc-ata' enables it.
File os_solaris_ata.s is no longer included in source tarball.
- Windows: Auto detection of USB devices specified by drive letter.
- Windows: Device scanning does no longer ignore unknown USB devices.
- Windows: Prevent drive spin up by '-n standby' check.
- Windows: New application manifests indicating Win 10 support.
- Windows smartd: '-m [sys]msgbox' is no longer supported.
- Windows installer: Defaults to 64-bit version on 64-bit Windows.
- Various code changes suggested by Clang Static Analyser and Cppcheck.
Update to 2.0.0 from coypu in wip, updated by myself to 2.0.1.
What's new in version 2.0.1
* OpenBSD: Various fixes and improvements
(thanks to Michael McConville and Juan Francisco Cantero Hurtado)
* FreeBSD: fix CPU and memory readings
(thanks to Tim Creech, Hung-Yi Chen, Bernard Spil, Greg V)
* FreeBSD: add battery support
(thanks to Greg V)
* Linux: Retain last-obtained name of a zombie process
* Mac OS X: Improve portability for OS X versions
(thanks to Michael Klein)
* Mac OS X: Fix reading command-line arguments and basename
* Mac OS X: Fix process state information
* Mac OS X: Fix tree view collapsing/expanding
* Mac OS X: Fix tree organization
* Mac OS X: Fix memory accounting
* Fix crash when emptying a column of meters
* Make Esc key more responsive
* Plus assorted fixes
What's new in version 2.0.0
* Platform abstraction layer
* Initial FreeBSD support
* Initial Mac OS X support
(thanks to David Hunt)
* Swap meter for Mac OSX
(thanks to Ștefan Rusu)
* OpenBSD port
(thanks to Michael McConville)
* FreeBSD support improvements
(thanks to Martin Misuth)
* Support for NCurses 6 ABI, including mouse wheel support
* Much improved mouse responsiveness
* Process environment variables screen
(thanks to Michael Klein)
* Higher-resolution UTF-8 based Graph mode
(Thanks to James Hall from vtop for the idea!)
* Show program path settings
(thanks to Tobias Geerinckx-Rice)
* BUGFIX: Fix crash when scrolling an empty filtered list.
* Use dynamic units for text display, and several fixes
(thanks to Christian Hesse)
* BUGFIX: fix error caused by overflow in usertime calculation.
(thanks to Patrick Marlier)
* Catch all memory allocation errors
(thanks to Michael McConville for the push)
* Several tweaks and bugfixes
(See the Git log for details and contributors!)
0.111 2016-05-01
- Release 0.110_003 without further changes
0.110_003 2016-04-21
- add missing prove whether requested row exists in stat or not for
fetchrow_hashref and fetchrow_arrayref calls
0.110_002 2016-04-20
- harden passing strings from libstatgrab to perl when fetching stats
as array
0.110_001 2016-04-14
- harden tests
* eval around all statgrab calls & don't prove result when exception catched
* check for result and error, if no result received
- harden passing strings from libstatgrab to perl when fetching stats
as hash
- improve author tests and so improve documentation
$LOCALBASE/gnu/bin/oldfind and its manpage is missing.
Indeed, oldfind was obsoleted in findutils 4.4.2.
PLIST and symlink generation is updated to reflect this.
bump PKGREVISION to pick up the change.
Version 1.0.2
-------------
Bug fixes:
- fix malfunction and potential corruption on (nowadays rather rare) big-endian
architectures or bi-endian archs in (rare) BE mode. #886, #889
cache resync / index merge was malfunctioning due to this, potentially
leading to data loss. borg info had cosmetic issues (displayed wrong values).
note: all (widespread) little-endian archs (like x86/x64) or bi-endian archs
in (widespread) LE mode (like ARMEL, MIPSEL, ...) were NOT affected.
- add overflow and range checks for 1st (special) uint32 of the hashindex
values, switch from int32 to uint32.
- fix so that refcount will never overflow, but just stick to max. value after
a overflow would have occured.
- borg delete: fix --cache-only for broken caches, #874
Makes --cache-only idempotent: it won't fail if the cache is already deleted.
- fixed borg create --one-file-system erroneously traversing into other
filesystems (if starting fs device number was 0), #873
- workround a bug in Linux fadvise FADV_DONTNEED, #907
Other changes:
- better test coverage for hashindex, incl. overflow testing, checking correct
computations so endianness issues would be discovered.
- reproducible doc for ProgressIndicator*, make the build reproducible.
- use latest llfuse for vagrant machines
- docs:
- use /path/to/repo in examples, fixes#901
- fix confusing usage of "repo" as archive name (use "arch")
4.1.0 - 2016-03-12
==================
**Enhancements**
- #777: [Linux] Process.open_files() on Linux return 3 new fields: position,
mode and flags.
- #779: Process.cpu_times() returns two new fields, 'children_user' and
'children_system' (always set to 0 on OSX and Windows).
- #789: [Windows] psutil.cpu_times() return two new fields: "interrupt" and
"dpc". Same for psutil.cpu_times_percent().
- #792: new psutil.cpu_stats() function returning number of CPU ctx switches
interrupts, soft interrupts and syscalls.
**Bug fixes**
- #774: [FreeBSD] net_io_counters() dropout is no longer set to 0 if the kernel
provides it.
- #776: [Linux] Process.cpu_affinity() may erroneously raise NoSuchProcess.
(patch by wxwright)
- #780: [OSX] psutil does not compile with some gcc versions.
- #786: net_if_addrs() may report incomplete MAC addresses.
- #788: [NetBSD] virtual_memory()'s buffers and shared values were set to 0.
- #790: [OSX] psutil won't compile on OSX 10.4.
4.0.0 - 2016-02-17
==================
**Enhancements**
- #523: [Linux, FreeBSD] disk_io_counters() return a new "busy_time" field.
- #660: [Windows] make.bat is smarter in finding alternative VS install
locations. (patch by mpderbec)
- #732: Process.environ(). (patch by Frank Benkstein)
- #753: [Linux, OSX, Windows] Process USS and PSS (Linux) "real" memory stats.
(patch by Eric Rahm)
- #755: Process.memory_percent() "memtype" parameter.
- #758: tests now live in psutil namespace.
- #760: expose OS constants (psutil.LINUX, psutil.OSX, etc.)
- #756: [Linux] disk_io_counters() return 2 new fields: read_merged_count and
write_merged_count.
- #762: new scripts/procsmem.py script.
**Bug fixes**
- #685: [Linux] virtual_memory() provides wrong results on systems with a lot
of physical memory.
- #704: [Solaris] psutil does not compile on Solaris sparc.
- #734: on Python 3 invalid UTF-8 data is not correctly handled for process
name(), cwd(), exe(), cmdline() and open_files() methods resulting in
UnicodeDecodeError exceptions. 'surrogateescape' error handler is now
used as a workaround for replacing the corrupted data.
- #737: [Windows] when the bitness of psutil and the target process was
different cmdline() and cwd() could return a wrong result or incorrectly
report an AccessDenied error.
- #741: [OpenBSD] psutil does not compile on mips64.
- #751: [Linux] fixed call to Py_DECREF on possible Null object.
- #754: [Linux] cmdline() can be wrong in case of zombie process.
- #759: [Linux] Process.memory_maps() may return paths ending with " (deleted)"
- #761: [Windows] psutil.boot_time() wraps to 0 after 49 days.
- #764: [NetBSD] fix compilation on NetBSD-6.x.
- #766: [Linux] net_connections() can't handle malformed /proc/net/unix file.
- #767: [Linux] disk_io_counters() may raise ValueError on 2.6 kernels and it's
broken on 2.4 kernels.
- #770: [NetBSD] disk_io_counters() metrics didn't update.
Major changes in 3.20.0
=======================
- Translation updates
Major changes in 3.19.92
========================
- Add a setting to enable caret mode
- Translation updates
Major changes in 3.19.90
========================
- Update desktop file IDs for search providers
- Translation updates
Major changes in 3.19.3
=======================
- Remove scroll-method key, and add edge-scroll-enabled key
for touchpads
- Revert natural scrolling being applies to non-touchpad devices
by default
- Translation updates
Major changes in 3.19.2
=======================
- Add setting to show battery percentage
- Translation updates
Major changes in 3.18.1
=======================
- Add instructions and scripts for building on Win32
- Translation updates
Major changes in 3.18.0
=======================
- Translation updates
Major changes in 3.17.92
========================
- Fix typographical errors
- Translation updates
Major changes in 3.16.1
=======================
- Use system font in titlebar by default
- Translation updates
Major changes in 3.16.0
=======================
- Translation updates
Major changes in 3.15.92
========================
- Add a way to turn off "PC-style" right-click for touchpads
- Translation updates
Major changes in 3.15.90
========================
- Use intltool to translate GSettings schema files directly
- Translation updates
Major changes in 3.15.4
=======================
- Adopt peripherals' gschemas from gnome-settings-daemon
- Change the default focus-tracking key
- Update docs for org.gnome.desktop.wm.preferences.raise-on-click
- Deprecate window manager theme key
- Add report-technical-problems key to privacy
Major changes in 3.14.1
=======================
- Disable default action on middle-click on titlebar
- Translation updates
Major changes in 3.14.0
=======================
- Disable location service by default
- Translation updates
Major changes in 3.13.92
========================
- Translation updates
Major changes in 3.13.91
========================
- Add a whitelist in addition to a black list for search providers
Major changes in 3.13.90
========================
* Add Location settings
* Add default bindings for "backward" keyboard shortcuts
* Windows build bug fix
* Fix location of the default backgrounds
Major changes in 3.13.2
=======================
* Switch default icon theme to Adwaita
* Remove minimize and maximize from default button layout
* Translation updates
Major changes in 3.13.1
========================
* Add switch to last/first workspace keybindings
* Translation updates
Major changes in 3.12.0
=======================
* Translation updates
Major changes in 3.11.91
========================
* Disable 'send-software-usage-stats' by default
* Translation updates
Major changes in 3.11.90
========================
* Add 'send-software-usage-stats' key
* Translation updates
Major changes in 3.11.5
=======================
* Extend app folder schema
* Translation updates
Major changes in 3.11.4
=======================
* Add an app folder setting
* Translation updates
Major changes in 3.11.3
=======================
* Add 'Always on Top' key
* Add keybindings to move windows between monitors
* Translation updates
Version 8.18.0 [v8-stable] 2016-04-19
- testbench: When running privdrop tests testbench tries to drop
user to "rsyslog", "syslog" or "daemon" when running as root and
you don't explict set RSYSLOG_TESTUSER environment variable.
Make sure the unprivileged testuser can write into tests/ dir!
- templates: add option to convert timestamps to UTC
closes https://github.com/rsyslog/rsyslog/issues/730
- omjournal: fix segfault (regression in 8.17.0)
- imptcp: added AF_UNIX support
Thanks to Nathan Brown for implementing this feature.
- new template options
* compressSpace
* date-utc
- redis: support for authentication
Thanks to Manohar Ht for the patch
- omkafka: makes kafka-producer on-HUP restart optional
As of now, omkafka kills and re-creates kafka-producer on HUP.
This is not always desirable. This change introduces an action param
(reopenOnHup="on|off") which allows user to control re-cycling of
kafka-producer.
It defaults to on (for backward compatibility). Off allows user to
ignore HUP as far as kafka-producer is concerned.
Thanks to Janmejay Singh for implementing this feature
- imfile: new "FreshStartTail" input parameter
Thanks to Curu Wong for implementing this.
- omjournal: fix libfastjson API issues
This module accessed private data members of libfastjson
- ommongodb: fix json API issues
This module accessed private data members of libfastjson
- testbench improvements (more tests and more thourough tests)
among others:
- tests for omjournal added
- tests for KSI subsystem
- tests for priviledge drop statements
- basic test for RELP with TLS
- some previously disabled tests have been re-enabled
- dynamic stats subsystem: a couple of smaller changes
they also involve the format, which is slightly incompatible to
previous version. As this was out only very recently (last version),
we considered this as acceptable.
Thanks to Janmejay Singh for developing this.
- foreach loop: now also iterates over objects (not just arrays)
Thanks to Janmejay Singh for developing this.
- improvements to the CI environment
- enhancement: queue subsystem is more robst in regard to some
corruptions
It is now detected if a .qi file states that the queue contains more
records than there are actually inside the queue files. Previously this
resulted in an emergency switch to direct mode, now the problem is only
reported but processing continues.
- enhancement: Allow rsyslog to bind UDP ports even w/out specific
interface being up at the moment.
Alternatively, rsyslog could be ordered after networking, however,
that might have some negative side effects. Also IP_FREEBIND is
recommended by systemd documentation.
Thanks to Nirmoy Das and Marius Tomaschewski for the patch.
- cleanup: removed no longer needed json-c compatibility layer
as we now always use libfastjson, we do not need to support old
versions of json-c (libfastjson was based on the newest json-c
version at the time of the fork, which is the newest in regard
to the compatibility layer)
- new External plugin for sending metrics to SPM Monitoring SaaS
Thanks to Radu Gheorghe for the patch.
- bugfix imfile: fix memory corruption bug when appending @cee
Thanks to Brian Knox for the patch.
- bugfix: memory misallocation if position.from and position.to is used
a negative amount of memory is tried to be allocated if position.from
is smaller than the buffer size (at least with json variables). This
usually leads to a segfault.
closes https://github.com/rsyslog/rsyslog/issues/915
- bugfix: fix potential memleak in TCP allowed sender definition
depending on circumstances, a very small leak could happen on each
HUP. This was caused by an invalid macro definition which did not rule
out side effects.
- bugfix: $PrivDropToGroupID actually did a name lookup
... instead of using the provided ID
- bugfix: small memory leak in imfile
Thanks to Tomas Heinrich for the patch.
- bugfix: double free in jsonmesg template
There has to be actual json data in the message (from mmjsonparse,
mmnormalize, imjournal, ...) to trigger the crash.
Thanks to Tomas Heinrich for the patch.
- bugfix: incorrect formatting of stats when CEE/Json format is used
This lead to ill-formed json being generated
- bugfix omfwd: new-style keepalive action parameters did not work
due to being inconsistently spelled inside the code. Note that legacy
parameters $keepalive... always worked
see also: https://github.com/rsyslog/rsyslog/issues/916
Thanks to Devin Christensen for alerting us and an analysis of the
root cause.
- bugfix: memory leaks in logctl utility
Detected by clang static analyzer. Note that these leaks CAN happen in
practice and may even be pretty large. This was probably never detected
because the tool is not often used.
- bugfix omrelp: fix segfault if no port action parameter was given
closes https://github.com/rsyslog/rsyslog/issues/911
- bugfix imtcp: Messages not terminated by a NL were discarded
... upon connection termination.
Thanks to Tomas Heinrich for the patch.
New in v0.7.07 (2016/04/10)
---------------------------
* Merged in lp:~matthew-t-bentley/duplicity/b2
- Fix import and error typos.
- Allow multiple backups in the same bucket.
- Fixes bug #1523498.
- A couple fixes allowing multiple backups to be hosted in different
folders in the same bucket as well as some logging for -v9.
* Random stuff:
- remove RPM stuff from makedist
- have makedist pull directly from VCS, not local dir
- update po translation directory and build process
- clean up some odd error messages
- move Pep8 ignores to tox.ini
- supply correct path for pydevd under Mac
- fix some tests to run under Linux and Mac
* Partial fix for bug #1529606 - shell code injection in lftpbackend
- still need to fix the other backends that spawn shell commands
* Make test_restart compatible with both GNUtar and BSDtar
* Fix stupid issue with functional test path for duplicity
* Applied patch from shaochun to fix bug #1531154,
- --file-changed failed when file contains spaces
* Applied patch from abeverly to fix bug #1475890
- allow port to be specified along with hostname on S3
- adjusted help text and man page to reflect the change
* Undo changes to test_restart.py. GNU tar is needed.
* Fix minor pep8 nit in collections.py
* Applied changes from ralle-ubuntu to fix bug 1072130.
- duplicity does not support ftpes://
* Fixed bug #1296793 - Failed to create bucket
- use S3Connection.lookup() to check bucket exists
- skips Boto's Exception processing for this check
- dupe of bug #1507109 and bug #1537185
* Merged in lp:~mifchip/duplicity/duplicity
- fix bug #1313964, absolute path doesn't work for FTP
* Merged in lp:~fpytloun/duplicity/webdav-gssapi
- support GSSAPI authentication in webdav backend
* Add more pylint ignore warnings tags
* Adjust so test_restart.py can run on Mac as well
* Fix for bug #1538333 - assert filecount == len(self.files_changed)
- added flush after every write for all FileobjHooked files which
should prevent some errors when duplicity is forcibly closed.
* Fix bug #1540279 - mistake in --help
* Applied patch from kay-diam to fix error handling in ssh pexpect,
fixes bug #1541314
* Fixed a patching error in ssh_pexpect_backend.py
* Merged in lp:~fpytloun/duplicity/webdav-gssapi-fix
- Make kerberos optional for webdav backend
* Merged in lp:~harningt/duplicity/multibackend-mirror
- This changeset addresses multibackend handling to permit a
mirroring option in addition to its "stripe" mode to make it
a redundancy tool vs space-expansion tool. To do this without
changing the configuration too much, I used the query string
that would generally go unused for files to specify behavior
that applies to all items inside the configuration file.
* Added acdclibackend.py from Stefan Breunig and Malay Shah
- renamed from amazoncloudbackend to stress use of acd_cli
* Fixed some 2to3 and Pep8 issues that had crept in
* Backed out changes made by patching for bug #1541314. These
patches should not have been applied to the 0.7 series.
* Merged in lp:~rye/duplicity/mediafire
- Backend for https://www.mediafire.com
- Requires https://pypi.python.org/pypi/mediafire/ installed.
* Reverted changes made in rev 1164 w.r.t. getting the source from
VCS rather than local directory. Fixes bug #1548080.
* More fixes to dist/makedist to make it more OS agnostic.
* Merged in lp:~ed.so/duplicity/webdav.lftp.ssl-overhaul
duplicity.1, commandline.py, globals.py
- added --ssl-cacert-path parameter
backend.py
- make sure url path component is properly url decoded,
in case it contains special chars (eg. @ or space)
lftpbackend.py
- quote _all_ cmd line params
- added missing lftp+ftpes protocol
- fix empty list result when chdir failed silently
- added ssl_cacert_path support
webdavbackend.py
- add ssl default context support for python 2.7.9+
(using system certs eg. in /etc/ssl/certs)
- added ssl_cacert_path support for python 2.7.9+
- gettext wrapped all log messages
- minor refinements
* Applied patch from Dmitry Nezhevenko to upgrade dropbox backend:
- update to SDK v2
- use chunked upload
* Merged in lp:~aaron-whitehouse/duplicity/improve_present_get_sf_man_page
- Improve man page entry for --exclude-if-present
* Merged in lp:~aaron-whitehouse/duplicity/split_glob_matching_from_select
- Move glob matching code out of selection.py's Select function and
into globmatch.py.
* Fix bug reported on the mailing list from Mark Grandi (assertion error
while backing up). In file_naming.parse() the filename was being lower
cased prior to parsing. If you had used a prefix with mixed case, we
were writing the file properly, but could not find it in the backend.
* Merged in lp:~duplicity-team/duplicity/po-updates
New in v0.7.06 (2015/12/07)
---------------------------
* Merged in lp:~mnjul/duplicity/s3-infreq-access
- This adds support for AWS S3's newly announced Infrequent Access
storage class and is intended to implement Blueprint:
https://blueprints.launchpad.net/duplicity/+spec/aws-s3-std-ia-class .
- A new command line option, --s3-use-ia, is added, and boto backend
will automatically use the correct storage class value depending on
whether --s3-use-rrs and --s3-use-ia is set. Command line parser will
prompt error if both --s3-use-ia and --s3-use-rrs are used together,
as they conflict with each other.
- The manpage has been updated giving a short explanation on the new
option. Its wording derives from Amazon's official announcement:
https://aws.amazon.com/about-aws/whats-new/2015/09/announcing-new-\
amazon-s3-storage-class-and-lower-glacier-prices/
* The ptyprocess module no longer supports Python 2.6, so fix tox.ini to
use an older version. Make explicit environs for all tests.
* Upgrade to newest version of pep8 and pylint. Add three ignores
to test_pep8 and one to test_pylint to get the rest to pass. They
* Applied patch from Alexander Zangerl to update to changes in lockfile
API 0.9 and later. Updated README to notify users.
* Modded tox.ini to use the latest lockfile.
* Merged in lp:~ed.so/duplicity/setup.shebang
- Having the python interpreter searched in the PATH is much more
flexible than the /usr/bin/python inserted into our scripts shebang
by setuptools. This patch prevents that. don't touch my shebang! :)
* Cleanup issues around Launchpad build, mainly lockfile >= 0.9.
* Merged in lp:~michal-s/duplicity/duplicity
- WindowsAzureMissingResourceError and WindowsAzureConflictError
changed due to SDK changes.
are all valid in our case.
* Reversed previous changes to lockfile. Now it will take any version
extant in the LP build repository. (PyPi is not avail in LP build).
* Merged in lp:~ed.so/duplicity/tempfile.tempdir
- make sure packages using python's tempfile create temp files in
duplicity's temp dir
* Fixed bug #1511308 - Cannot restore no-encryption, no-compression backup
- Corrected code to include plain file in write_multivolume()
- Added PlainWriteFile() to gpg.py
* Merged in lp:~michal-s/duplicity/duplicity
- Fix azurebackend storage class import
* Merged in lp:~feraudet/duplicity/fix
- Fix missing SWIFT_ENDPOINT_TYPE env var, bug 1519694.
* Fix bug #1520691 - Shell Code Injection in hsi backend
- Replace use of os.popen3() with subprocess equivalent.
- Added code to expand relative program path to full path.
- Fix hisbackend where it expected a list not a string.
* Merged in lp:~noizyland/duplicity/azurebackend-fixes
- Support new version of Azure Storage SDK
- Refactor _list method to support containers with >5000 blobs
* Merged in lp:~matthew-t-bentley/duplicity/b2
- Adds a backed for BackBlaze's (currently beta) B2 backup service.
- This adds backends/b2backend.py, modifies log.py to add an
error code and modifies commandline.py to add the b2://
example to the help text.
* Pep8 corrections for recently released code.
* Fixed bug #1260666 universally by splitting the filelist for
delete before passing to backend.
* Fixed bug #1369243 by adjusting messages to be more readable.
* Fixed bug #1375019 with patch from Eric Bavier (home to tmp).
* Fixed bug #1379575 with patch from Tim Ruffing (shorten webdav response).
* Fixed bug #1492301 with patch from askretov (manually refresh oauth).
New in v0.7.05 (2015/09/15)
---------------------------
* Merged in lp:~aaron-whitehouse/duplicity/fix_patch_error
- Change use of mock.patch in unit tests to accommodate the obsolete
version of python-mock on the build server.
* Fixed Bug 1476019 S3 storage bucket not being automatically created
with patch from abeverley
* Merged in lp:~aaron-whitehouse/duplicity/launchpad_tox_profile
- Add tox testing profile that mimics the packages installed on the
Launchpad build server, to reduce the likelihood of tests passing
our test suite, but failing on the build server (e.g. because of
the out-of-date mock version).
* Merged in lp:~aaron-whitehouse/duplicity/disable_code_tests_for_lpbuildd
- Set RUN_CODE_TESTS to 0 for lpbuildd tox profile, reflecting its value
on the Launchpad build server (and therefore skipping PEP8, 2to3 and
pylint). More accurately reflects the system we are mimicking and saves
approximately 1 minute per test run.
* Fixed Bug 1438170 duplicity crashes on resume when using gpg-agent with
patch from Artur Bodera (abodera). Applied the same patch to incremental
resumes as well.
* Merged in lp:~w.baranowski/duplicity/selection_debug
- This little patch logs debug messages concerning path selection process,
and so allows users to debug their include/exclude configuration.
* Merged in lp:~germar/duplicity/par2removefix
- After reorganisation in revision 981 and the fix for bug #1406173 the
par2backend does not remove .par2 files anymore when removing
duplicity-*.gpg files.
- This banch adds an unfiltered_list() method which is used in
delete() and delete_list()
* Updated man pages to reflect more contributors.
* Fix bug #1493573. Correct option typo in man page.
* Fix bug #1494228 CygWin: TypeError: basis_file must be a (true) file
- The problem that caused the change to tempfile.TemporaryFile was due
to the fact that os.tmpfile always creates its file in the system
temp directory, not in the directory specified. The fix applied was
to use os.tmpfile in cygwin/windows and tempfile.TemporaryFile in all
the rest. This means that cygwin is now broken with respect to temp
file placement of this one file (deleted automatically on close).
* Merged in lp:~bmerry/duplicity/pydrive-id-cache
- This fixes the issue a number of users (including myself) have been
having with duplicity creating files with duplicate filenames on
Google Drive. It keeps a runtime cache of filename to object ID
mappings, so that once it has uploaded an object it won't be fooled
by weakly consistent directory listings.
* Merged in lp:~duplicity-team/duplicity/po-updates
New in v0.7.04 (2015/08/02)
---------------------------
* Merged in lp:~noizyland/duplicity/fix-progress
- Fixes bug 1264744. selection.filelist_globbing_get_sfs leaves the
filelist file object's position at the end of the file. When the
--progress option is used the filelists need to be read twice. On
the second read nothing is read from the file because file has
already been read and the position is EOF. This patch calls seek(0)
on the filelist to reset the position to BOF so that subsequent
read() calls will return data.
* Added pylint ignore error in webdavbackend.py.
* Merged in lp:~bmerry/duplicity/pydrive-regular
- This implements the proposal made by somebody else
(http://lists.gnu.org/archive/html/duplicity-talk/2015-02/msg00037.html)
to allow the pydrive backend to work with a normal drive account instead
of a service account. It seems to be working for me: I was able to migrate
seamlessly from the gdocs backend. It's set up so that a service account
can still be used, depending on which environment variable is set.
The man page is updated to describe how to use the new functionality.
* Merged in lp:~ed.so/duplicity/gdocs.pydrive
- make pydrive new gdocs default backend
- keep gdata backend as gdata+gdocs://
* Merged in lp:~raymii/duplicity/fix-swiftbackend-max-10000-files-in-list
- Swiftclient by default returns at max 10000 files. By adding
full_listing=True we make sure all objects are returned.
Ref: https://lists.nongnu.org/archive/html/duplicity-talk/2015-05/msg00060.html
and http://docs.openstack.org/developer/python-swiftclient/swiftclient.html#swiftclient.client.get_container
* Fix a couple of PEP8 glitches.
* Fixed bug 791794 - description of --gpg-options is misleading, Simply
needed to add the '--' before the options as in "--opt1 --opt2=parm".
* Fixed bug 1465335 - pydrive still use files in trash can - with patch
from Kuang-che Wu to ignore trashed files.
* Fixed bug 1452263 - par2 option not working on small processors - with patch
from Kuang-che Wu to ignore default 30 second timeout.
* Fixed bug 1466160 - pydrive backend is slow to remove old backup set - with
patch from Kuang-che Wu to implement _delete_list().
* Fixed bug 1466582 - reduce unnecessary syscall with --exclude-if-present - with
patch from Kuang-che Wu to make sure resulting path is a directory.
* Merged in lp:~ed.so/duplicity/gpg.binary
- new parameter --gpg-binary allows user to point to a different gpg binary,
not necessarily in path
* Merged in lp:~aaron-whitehouse/duplicity/fix_POTFILES.in_and_run-tests
- Fixed two filename references in po/POTFILES.in, a mistake which crept in in
rev 1093 and caused testing/run-tests to fail with "IndexError: list index
out of range".
* Merged in lp:~aaron-whitehouse/duplicity/reactivate_progress_test
- Re-enable the test of the --progress option (test_exclude_filelist_progress_option),
which was marked as an expected failure. The issue causing this test to fail was
fixed in revision 1095 and the test now passes.
* Fixed bug 1471348 Multi back-end doesn't work with hubiC
- added init of appropriate superclass in both cases.
* Fixed bug 1471348 Multi back-end doesn't work with hubiC (again)
- hubiC should reach up to duplicity.backend.__init__
* Merged in lp:~aaron-whitehouse/duplicity/bug_884371
- Fixed Bug #884371 - Stopped an exclude glob trumping an earlier scan glob, but also
ensured that an exclude glob is not trumped by a later include. This fix is important,
as without it files that are specified to be included are not being backed up as expected.
- Fixed Bug #932482 - a trailing slash at the end of globs no longer prevents them working
as expected.
* Merged in lp:~aaron-whitehouse/duplicity/reenable_tests
- Re-enable unit.test_selection tests that had been temporarily commented out.
* Merged in lp:~aaron-whitehouse/duplicity/trailing_slash_match_dirs
- Made globs with trailing slashes only match directories, not files, fixing Bug #1479545.
* Merged in lp:~aaron-whitehouse/duplicity/improve_tox_and_python2-6_testing
- Testing improvements, particularly in relation to testing against Python version 2.6:
* tox.ini fixed so that it is possible to run individual tests against both Python 2.6 and 2.7;
* updated test_code.py to use unittest2 for Python versions < 2.7 (instead of failing);
* ./run-tests now correctly runs all tests against both Python 2.6 and 2.7; and
* improved testing directions in README-REPO.
* Merged in lp:~dag-stenstad/duplicity/swift_authversion_3_support
- Added support for Openstack Identity v3 in the Swift backend.
* Merged in lp:~aaron-whitehouse/duplicity/fix_2to3_issues
- Fixed 2to3 issues. Updated README-REPO with more test information. Updated pylint and
test_diff2 descriptions to make it clear these require packages to be installed on the
sytem to pass. All tests pass on Python 2.6 and Python 2.7 as at this revision.
New in v0.7.03 (2015/05/11)
---------------------------
* Merged in lp:~aaron-whitehouse/duplicity/filelist_combine
- Merged globbing and non-globbing filelists to use the same code path
and all accept globbing characters. Added deprecation warning to the
--exclude-globbing-filelist and include-globbing-filelist options in
commandline.py and hid them from help output. Updated the manual
(and unit tests) accordingly.
- Note that this does trigger a change in behaviour for duplicity.
Previously, include patterns in include-filelist did not match files
in a directory that was included, so /usr/local in an include file
would not have matched /usr/local/doc. Now, this folder would be
included, as would occur if --include or the old
--include-globbing-filelist was used. Additional lines will therefore
need to be added to filelists to unambiguously exclude unwanted
subfolders, if this is intended.
- Mark --include-filelist-stdin and --exclude-fielist-stdin for
deprecation and hide from --help output.
* Fix bug 1432999 with hint from Antoine Afalo.
- '/'s at end of destination cause problems with onedrivebackend.
* Fix bug 1434702 with help from Robin Nehls
- incorrect response BackendException while downloading signatures file.
* Fix bug 1437789 with patch from pdf
- par2backend.py incorrect syntax in get()
* Merge in lp:~stynor/duplicity/multi-backend
- A new backend that allows use of more than one backend stores (e.g. to
combine the available space from more than one cloud provider to make
a larger store available to duplicity).
* Move requirements section lower in manpage.
* Merge in lp:~cemsbr/duplicity/duplicity
- Fix bug 1432229 in Copy.com backend:
Reply header has no content-type for JSON detection. Now, we also check
whether the content starts with '{'.
* Fixed bug 1444404 with patch from Samu Nuutamo
- rdiffdir patch crashes if a regular file is changed to a non-regular
file (symlink, fifo, ...)
* Fixed bug 1448249 and bug 1449151 thanks to David Coppit.
- When patching, close base file before renaming
- Enable --ignore-errors flag in rdiffdir
* Added ability to get single file status from collection-status with
patch from jitao (bug 1044715), like so:
$ duplicity collection-status --file-changed c1 file://./foo
* Merge in lp:~sjakthol/duplicity/onedrive-error-message
- Add proper error message for OneDrive backend when python-requests or
python-requests-oauthlib is not installed (bug 1453355).
New in v0.7.02 (2015/03/10)
---------------------------
* Merged in lp:~vincegt/duplicity/swift_regionname
- Fixes bug #1376628
- Add mapping of SWIFT_REGIONNAME to select region inside SWIFT when a
provider proposes more than one region.
* Merged in lp:~aaron-whitehouse/duplicity/progress_option_error
- Added test_exclude_globbing_filelist_progress_option into
functional/test_selection.py, which shows the error reported in
Bug #1264744 - that the --exclude-globbing-filelist does not backup
the correct files if the --progress option is used. Test is marked as
an expected failure so as not to cause the test suite to fail.
* Merged in lp:~noizyland/duplicity/fix_azurebackend_container_names
- Azure Backend examples have underscores in the container names. These
are not valid Azure container names. The underscores have been replaced
with hypens and a note about valid container names added to the man page.
- Also corrects a problem where Azure Exceptions were returing unicode
strings that were not being handled correctly.
* Merged in lp:~user3942934/duplicity/pydrive
- Currently duplicity uses gdocs backend for Google Drive backups.
gdocs uses deprecated API and don't allow backups for managed Google
accounts. (see https://bugs.launchpad.net/duplicity/+bug/1315684)
- Added pydrive backend that solves both of those problems. Published
also on https://github.com/westerngateguard/duplicity-pydrive-backend.
* Fixed some tabs/spaces problems that were causing install failures.
* Fixed variable typo in commandline.py that was causing build fails.
* Merged in lp:~duplicity-team/duplicity/po-updates
* Remove 'gs' and 's3+http' from uses_netloc[]. Fixes Bug 1411803.
* Fixed bug # 1414418
- Aligned commandline.py options and help display contents.
- Aligned commandline.py options and manpage contents.
* Changed --s3_multipart_max_timeout to --s3-multipart-max-timeout to be
consistent with commandline option naming conventions.
* Applied patch from Adam Reichold to fix bug # 1413792.
* Merged in lp:~angusgr/duplicity/exclude-older-than
- Add "--exclude-older-than" commandline option, that allows you to only
back up files with a modification date newer than a particular threshold.
* Merged in lp:~aaron-whitehouse/duplicity/bug_884371_asterisks_in_includes
- Added tests to unit/test_selection.py and funtional/test_selection.py
to show the behaviour reported in Bug #884371, i.e. that selection is
incorrect when there is a * or ** on an include line of a filelist or
commandline --include.
* Merged in lp:~aaron-whitehouse/duplicity/bug_932482_trailing_slashes_and_wildcards_error
- Added functional and unit tests to show Bug #932482 - that selection does
not work correctly when excludes (in a filelist or in a commandline option)
contain both a single or double asterisk and a trailing slash.
* Misc fixes for the following PEP8 issues:
- E111, E121, E122, E124, E125, E126, E127, E128, E201, E202, E203,
E231, E241, E251, E261, E262, E271, E272, E301, E302, E303, E401,
E502, E701, E702, E703, E711, E721, W291, W292, W293, W391
- to run pep8 on duplicity use 'pep8 --ignore=E501'
- see http://pep8.readthedocs.org
* Fixes for 2to3 issues
* Fix spelling error in manpage, bug 1419314.
* Fix _librsyncmodule.c compilation, bug 1416344, thanks to Kari Hautio.
* Really fix bug 1416344 based on comment #5 by Roman Tereshonkov.
* Fix for --pydevd debug environment and location under Eclipse.
* Fix for bug where scp was actually working as scp and not working with
rsync.net because of using extraneous test command in restricted shell.
Was trying "test -d 'foo' || mkdir -p 'foo'", now only "mkdir -p foo".
* remove extraneous string format arg in previous scp fix.
New in v0.7.01 (2015/01/11)
---------------------------
Enhancements:
* Undid move of testing/test_code.py. Instead I fixed it
so that it would not run during PPA build. It now needs
the setting RUN_CODE_TESTS=1 in the environment which is
supplied in the tox.ini file.
* Moved testing/test_code.py to testing/manual/code_test.py
so PPA builds would succeed. Should be moved back later.
* Remove valid_extension() check from file_naming.py. It was
causing failed tests for short filenames. Thanks edso.
* Partial fix for PPA build failures, new backend name.
* Merged in lp:~ed.so/duplicity/fix.dpbx.import
- fix dpbx import error import lazily
* Merged in lp:~hooloovoo/duplicity/fix-typo-in-test-description
- Fixed spelling mistake/typo in a description of a test.
* Merged in lp:~mterry/duplicity/missing-unicode-escape
- Convert restore_dir to unicode before printing.
* Merged in lp:~ed.so/duplicity/lftp.ncftp.and.prefixes
- retire --ssh-backend, --use-scp parameters
- introduce scheme prefixes for alternative backend selection
e.g. ncftp+ftp://, see manpage
- scp is now selected via scheme e.g. scp://
- added lftp fish, webdav(s), sftp support
* Merged in lp:~mterry/duplicity/code-nits
- Fix some pylint/pep8 nits that prevented the test_code.py test from passing.
* Merged in lp:~mterry/duplicity/debian-dir
- Add a debian/ directory to make it easier to manage the PPAs for duplicity.
* In webdavbackend.py:
- Fixed bug 1396106 with change by Tim Ruffing, mispelled member.
- Added missing 'self.' before member in error message.
* Merged in lp:~adrien-delhorme/duplicity/hubic
- Add Hubic support through pyrax and a custom pyrax_identity module.
* Fixed bug 1385599 with changes by Yannick Molin. SSL settings are now
conditioned on protocol ftp or ftps.
* Partial fix of bug 1236248 with changes by az, manpage warning about
--extra-clean, however, recovery with missing sig files is broken.
* Fixed bug 1255453 with changes by Gaudenz Steinlin, report backend import
results, both normal and failed, at INFO log level.
* Manually merged in lp:~m4ktub/duplicity/0.6-reliability
- Per fix proposed in Bug #1395341.
* Modded .bzrignore to ignore *.egg test dependencies, normalized, sorted.
* Merged in lp:~ed.so/duplicity/paramiko.identyfile
- fix identity file parsing of --ssh-options for paramiko
- manpage fixes
* Source formatted, using PyDev, all source files to fix some easily fixed
PEP8 issues. Use ignore space when comparing against previous versions.
* Merge in lp:~andol/duplicity/signkeyformat
- Allow --sign-key to use short format, long format alt. full fingerprint.
* Merge in lp:~hooloovoo/duplicity/verify-not-check-source
- Tests to validate that duplicity does not check filesystem source during
verify unless --compare-data is specified
* Merge in lp:~ed.so/duplicity/move_netloc
- move netloc usage definitions into respective backends
- fix "[Question #259173]: rsync backend fails"
https://answers.launchpad.net/duplicity/+question/259173
* Make ssh an unsupported backend scheme
* Temporarily disable RsyncBackendTest and test_verify_changed_source_file
* Merge in lp:~hooloovoo/duplicity/test-verify-improvements
- Fix up test_verify, which was a bit of a mess:
- Simplify test_verify.py to just do a simple backup and verify on a
single file in each test.
- Modify tests to correctly use --compare-data option.
- Add tests for when the source files have atime/mtime manipulated.
* Fix duplicity verify to ignore the file system when globals.compare_data is
False. This means that verify only validates the viability of the backup
itself unless --compare-data is specified.
* Reenable test_verify_changed_source_file test
* Merged in lp:~hooloovoo/duplicity/add-additional-verify-tests-for-corrupted-archives
- Add tests to test_verify.py to test that verify fails if the archive
file is corrupted. Changed file objects to use the with keyword to ensure
that the file is properly closed.
- Small edit to find statement in verify_test.sh to make it work as
expected (enclose string in quotes).
* Merged in lp:~hooloovoo/duplicity/add-else-to-badupload-try-except
- Badupload test previously did not have an else in the try-except. The
test passed if the except was triggered, but would also pass if the
test did not trigger an error at all.
* Fixed bug 1406173 by applying patch supplied in report
- Ignore .par2 files in remote file list
* Removed redundant shell test testing/verify_test.sh
* Misc fixes for the following PEP8 issues:
- E211, E221, E222, E225, E226, E228
- see http://pep8.readthedocs.org
* Fixed bug 1278529 by applying patch supplied in report
- Use get_bucket() rather than lookup() on S3 to get proper error msg.
* Merged in lp:~stapelberg+ubuntu/duplicity/add-onedrive-backend
- Add a Microsoft OneDrive backend
* Merged in lp:~hooloovoo/duplicity/filelist_select_bug_1408411
- Adds functional test cases that fail because of Bug #1408411 (commented
out), to assist in fixing that bug.
* Merged in lp:~hooloovoo/duplicity/process_filelists_for_spaces_etc
- Process filelists to remove imperfections such as blank lines, comments
and leading/trailing whitespace. Also correctly processes quoted folders
containing spaces in their names. Extensive unit and functional tests to
test these changes (and selection more generally).
- The branch does add an additional folder to testfiles.tar.gz called
select2. This included a folder with a trailing space, to test the quote
test. The subfolders also have clearer names than in the "select" folder
(eg "1sub2sub3") which makes it easier to keep track of issues in tests.
* Merged in lp:~9-sa/duplicity/FixBug1408289
- Fix bug #1408289
- Wrong attribute name prevented raise of client exception, working now
* Merged in lp:~noizyland/duplicity/azurebackend
- Add backend for Azure Blob Storage Service
New in v0.7.00 (2014/10/23)
---------------------------
Enhancements:
* Adjust unit tests to expect single FTP backend
* Merged in lp:~moritzm/duplicity/duplicity
- Use lftp for both FTP and FTPS
* Merged in lp:~ed.so/duplicity/0.7-dpbx.importfix
- fix this showstopper with the dropbox backend
"NameError: global name 'rest' is not defined"
* Merged in lp:~jflaker/duplicity/BugFix1325215
- The reference to "--progress_rate" in the man page as a parameter is
incorrect. Should be "--progress-rate".
* Merged in lp:~hooloovoo/duplicity/updated-README-REPO
- Changes to README-REPO to reflect the restructuring of the directories.
* Fixed bug 1375304 with patch supplied by Aleksandar Ivanovic
* Merged in lp:~ed.so/duplicity/webdav200fix-0.7
- webdav backend fix "BackendException: Bad status code 200 reason OK. " when
restarting an interrupted backup and overwriting partially uploaded volumes.
* Merged in lp:~mterry/duplicity/require-2.6
- Require at least Python 2.6.
- Our code base already requires 2.6, because 2.6-isms have crept in. Usually
because we or a contributor didn't think to test with 2.4. And frankly,
I'm not even sure how to test with 2.4 on a modern system.
* Merged in lp:~mterry/duplicity/drop-pexpect
- Drop our local copy of pexpect in favor of a system version.
- It's only used by the pexpect ssh backend (and if you're opting into that,
you probably can expect that you will need pexpect) and the tests.
- I've done a quick smoketest (backed up and restored using
--ssh-backend=pexpect) and it seemed to work fine with a modern version
of pexpect.
* Merged in lp:~mterry/duplicity/2.6isms
- Here's a whole stack of minor syntax modernizations that will become
necessary in python3. They all work in python2.6.
- I've added a new test to keep us honest and prevent backsliding on these
modernizations. It runs 2to3 and will fail the test if 2to3 finds anything
that needs fixing (with a specific set of exceptions carved out).
- This branch has most of the easy 2to3 fixes, the ones with obvious and
safe syntax changes.
- We could just let 2to3 do them for us, but ideally we use 2to3 as little
as possible, since it doesn't always know how to solve a given problem.
I will propose a branch later that actually does use 2to3 to generate
python3 versions of duplicity if they are requested. But this is a first
step to clean up the code base.
* Merged in lp:~mterry/duplicity/drop-static
- Drop static.py.
- This is some of the oldest code in duplicity! A bzr blame says it is
unmodified (except for whitespace / comment changes) since revision 1.
- But it's not needed anymore. Not really even since we updated to python2.4,
which introduced the @staticmethod decorator. So this branch drops it and
its test file.
* Merged in lp:~mterry/duplicity/py3-map-filter
- In py3, map and filter return iterable objects, not lists. So in each case
we use them, I've either imported the future version or switched to a list
comprehension if we really wanted a list.
* Merged in lp:~mterry/duplicity/backend-unification
- Reorganize and simplify backend code. Specifically:
- Formalize the expected API between backends and duplicity. See the new
file duplicity/backends/README for the instructions I've given authors.
- Add some tests for our backend wrapper class as well as some tests for
individual backends. For several backends that have some commands do all
the heavy lifting (hsi, tahoe, ftp), I've added fake little mock commands
so that we can test them locally. This doesn't truly test our integration
with those commands, but at least lets us test the backend glue code.
- Removed a lot of duplicate and unused code which backends were using (or
not using). This branch drops 700 lines of code (~20%)
in duplicity/backends!
- Simplified expectations of backends. Our wrapper code now does all the
retrying, and all the exception handling. Backends can 'fire and forget'
trusting our wrappers to give the user a reasonable error message.
Obviously, backends can also add more details and make nicer error
messages. But they don't *have* to.
- Separate out the backend classes from our wrapper class. Now there is no
possibility of namespace collision. All our API methods use one
underscore. Anything else (zero or two underscores) are for the backend
class's use.
- Added the concept of a 'backend prefix' which is used by par2 and gio
backends to provide generic support for "schema+" in urls -- like par2+
or gio+. I've since marked the '--gio' flag as deprecated, in favor of
'gio+'. Now you can even nest such backends like
par2+gio+file://blah/blah.
- The switch to control which cloudfiles backend had a typo. I fixed this,
but I'm not sure I should have? If we haven't had complaints, maybe we
can just drop the old backend.
- I manually tested all the backends we have (except hsi and tahoe -- but
those are simple wrappers around commands and I did test those via mocks
per above). I also added a bunch more manual backend tests to
./testing/manual/backendtest.py, which can now be run like the above to
test all the files you have configured in config.py or you can pass it a
URL which it will use for testing (useful for backend authors).
* Merged in lp:~mterry/duplicity/py2.6.0
- Support python 2.6.0.
- Without this branch, we only support python >= 2.6.5 because that's when
python's urlparse.py module became its more modern incarnation. (I won't
get into the wisdom of them making such a change in the middle of the
2.6 lifecycle.)
- Also, the version of lockfile that I have (0.8) doesn't work with python
2.6.0 or 2.6.1 due to their implementation of
threading.current_thread().ident returning None unexpectedly. So this
branch tells lockfile not to worry about adding the current thread's
identifier to the lock filename (we don't need a separate lock per thread,
since our locking is per process).
- I've tested with 2.6.0 and 2.7.6 (both extremes of our current support).
* Update shebang line to python2 instead of python to avoid confusion.
* Merged in lp:~3v1n0/duplicity/copy.com-backend
- I've added a backend for Copy.com cloud storage, this supports all the
required operations and works as it should from my tests.
- You can use it by calling duplicity with something like:
copy://account@email.com:your-password@copy.com/duplicity
- The only thing I've concerns with is the optimized support for _delete_list
which can't be enabled here because the test_delete_list tries also to
delete a not-existing files, and it requires the backend not to raise an
exception in that case (is this somewhat wanted or could we do the same as
for _delete or _query?)
* Merged in lp:~ed.so/duplicity/webdav200fix-0.7
- webdav backend fix "BackendException: Bad status code 200 reason OK. " when
restarting an interrupted backup and overwriting partially uploaded volumes.
* Merged in lp:~mterry/duplicity/webdav-fixes
- This branch fixes two issues I saw when testing the webdav backend:
- 1) Errors like the following: "Attempt 1 failed. BackendException: File
/tmp/duplicity-LQ1a0i-tempdir/mktemp-u2aiyX-2 not found locally after get
from backend". These were caused by the _get() method not calling setdata()
on the local path object, so the rest of the code thought it didn't exist.
- 2) Some odd issues from stale responses/data. We have a couple places in
webdavbackend.py where we close the connection before making a request
because of this problem. But I've changed it to do it every time, more
reliably, by putting a _close() call inside the request() method.
- With this, the webdav backend seems fine to me.
* Merged in lp:~antmak/duplicity/0.7-par2-fix
- Useful fix for verbatim par2cmdline options (like "-t" in par2-tbb version)
* Fixed bug 1327550: OverflowError: signed integer is greater than maximum
- Major and minor device numbers are supposed to be one byte each. Someone
has crafted a special system image using OpenVZ where the major and minor
device numbers are much larger (ploop devices). We treat them as (0,0).
* Added sxbacked.py, Skylable backend. Waiting on man page updates.
* Merged in lp:~ed.so/duplicity/manpage.verify
- Clarify verify's functionality as wished for by a user surprised with a big
bandwidth bill from rackspace.
* Merged in lp:~jeffreydavidrogers/duplicity/duplicity
- This change fixes two small typos in the duplicity man page.
* Merged in lp:~johnleach/duplicity/1315437-swift-container-create
- Check to see if the swift container exists before trying to create it,
in case we don't have permissions to create containers. Fixes#1315437
* Merged in lp:~ed.so/duplicity/manpage.blocksize
- add --max_blocksize doc
- reorder 'a note on filename prefixes' into alphabetical order
Version 1.0.1
-------------
New features:
Usually there are no new features in a bugfix release, but these were added
due to their high impact on security/safety/speed or because they are fixes
also:
- append-only mode for repositories, #809, #36 (see docs)
- borg create: add --ignore-inode option to make borg detect unmodified files
even if your filesystem does not have stable inode numbers (like sshfs and
possibly CIFS).
- add options --warning, --error, --critical for missing log levels, #826.
it's not recommended to suppress warnings or errors, but the user may decide
this on his own.
note: --warning is not given to borg serve so a <= 1.0.0 borg will still
work as server (it is not needed as it is the default).
do not use --error or --critical when using a <= 1.0.0 borg server.
Bug fixes:
- fix silently skipping EIO, #748
- add context manager for Repository (avoid orphan repository locks), #285
- do not sleep for >60s while waiting for lock, #773
- unpack file stats before passing to FUSE
- fix build on illumos
- don't try to backup doors or event ports (Solaris and derivates)
- remove useless/misleading libc version display, #738
- test suite: reset exit code of persistent archiver, #844
- RemoteRepository: clean up pipe if remote open() fails
- Remote: don't print tracebacks for Error exceptions handled downstream, #792
- if BORG_PASSPHRASE is present but wrong, don't prompt for password, but fail
instead, #791
- ArchiveChecker: move "orphaned objects check skipped" to INFO log level, #826
- fix capitalization, add ellipses, change log level to debug for 2 messages,
#798
Other changes:
- update llfuse requirement, llfuse 1.0 works
- update OS / dist packages on build machines, #717
- prefer showing --info over -v in usage help, #859
- docs:
- fix cygwin requirements (gcc-g++)
- document how to debug / file filesystem issues, #664
- fix reproducible build of api docs
- RTD theme: CSS !important overwrite, #727
- Document logo font. Recreate logo png. Remove GIMP logo file.
Version 1.0.0
-------------
The major release number change (0.x -> 1.x) indicates bigger incompatible
changes, please read the compatibility notes, adapt / test your scripts and
check your backup logs.
Compatibility notes:
- drop support for python 3.2 and 3.3, require 3.4 or 3.5, #221#65#490
note: we provide binaries that include python 3.5.1 and everything else
needed. they are an option in case you are stuck with < 3.4 otherwise.
- change encryption to be on by default (using "repokey" mode)
- moved keyfile keys from ~/.borg/keys to ~/.config/borg/keys,
you can either move them manually or run "borg upgrade <REPO>"
- remove support for --encryption=passphrase,
use borg migrate-to-repokey to switch to repokey mode, #97
- remove deprecated --compression <number>,
use --compression zlib,<number> instead
in case of 0, you could also use --compression none
- remove deprecated --hourly/daily/weekly/monthly/yearly
use --keep-hourly/daily/weekly/monthly/yearly instead
- remove deprecated --do-not-cross-mountpoints,
use --one-file-system instead
- disambiguate -p option, #563:
- -p now is same as --progress
- -P now is same as --prefix
- remove deprecated "borg verify",
use "borg extract --dry-run" instead
- cleanup environment variable semantics, #355
the environment variables used to be "yes sayers" when set, this was
conceptually generalized to "automatic answerers" and they just give their
value as answer (as if you typed in that value when being asked).
See the "usage" / "Environment Variables" section of the docs for details.
- change the builtin default for --chunker-params, create 2MiB chunks, #343
--chunker-params new default: 19,23,21,4095 - old default: 10,23,16,4095
one of the biggest issues with borg < 1.0 (and also attic) was that it had a
default target chunk size of 64kiB, thus it created a lot of chunks and thus
also a huge chunk management overhead (high RAM and disk usage).
please note that the new default won't change the chunks that you already
have in your repository. the new big chunks do not deduplicate with the old
small chunks, so expect your repo to grow at least by the size of every
changed file and in the worst case (e.g. if your files cache was lost / is
not used) by the size of every file (minus any compression you might use).
in case you want to immediately see a much lower resource usage (RAM / disk)
for chunks management, it might be better to start with a new repo than
continuing in the existing repo (with an existing repo, you'ld have to wait
until all archives with small chunks got pruned to see a lower resource
usage).
if you used the old --chunker-params default value (or if you did not use
--chunker-params option at all) and you'ld like to continue using small
chunks (and you accept the huge resource usage that comes with that), just
explicitly use borg create --chunker-params=10,23,16,4095.
- archive timestamps: the 'time' timestamp now refers to archive creation
start time (was: end time), the new 'time_end' timestamp refers to archive
creation end time. This might affect prune if your backups take rather long.
if you give a timestamp via cli this is stored into 'time', therefore it now
needs to mean archive creation start time.
New features:
- implement password roundtrip, #695
Bug fixes:
- remote end does not need cache nor keys directories, do not create them, #701
- added retry counter for passwords, #703
Other changes:
- fix compiler warnings, #697
- docs:
- update README.rst to new changelog location in docs/changes.rst
- add Teemu to AUTHORS
- changes.rst: fix old chunker params, #698
- FAQ: how to limit bandwidth
Version 1.0.0rc2
----------------
New features:
- format options for location: user, pid, fqdn, hostname, now, utcnow, user
- borg list --list-format
- borg prune -v --list enables the keep/prune list output, #658
Bug fixes:
- fix _open_rb noatime handling, #657
- add a simple archivename validator, #680
- borg create --stats: show timestamps in localtime, use same labels/formatting
as borg info, #651
- llfuse compatibility fixes (now compatible with: 0.40, 0.41, 0.42)
Other changes:
- it is now possible to use "pip install borgbackup[fuse]" to automatically
install the llfuse dependency using the correct version requirement
for it. you still need to care about having installed the FUSE / build
related OS package first, though, so that building llfuse can succeed.
- Vagrant: drop Ubuntu Precise (12.04) - does not have Python >= 3.4
- Vagrant: use pyinstaller v3.1.1 to build binaries
- docs:
- borg upgrade: add to docs that only LOCAL repos are supported
- borg upgrade also handles borg 0.xx -> 1.0
- use pip extras or requirements file to install llfuse
- fix order in release process
- updated usage docs and other minor / cosmetic fixes
- verified borg examples in docs, #644
- freebsd dependency installation and fuse configuration, #649
- add example how to restore a raw device, #671
- add a hint about the dev headers needed when installing from source
- add examples for delete (and handle delete after list, before prune), #656
- update example for borg create -v --stats (use iso datetime format), #663
- added example to BORG_RSH docs
- "connection closed by remote": add FAQ entry and point to issue #636
Version 1.0.0rc1
----------------
New features:
- borg migrate-to-repokey ("passphrase" -> "repokey" encryption key mode)
- implement --short for borg list REPO, #611
- implement --list for borg extract (consistency with borg create)
- borg serve: overwrite client's --restrict-to-path with ssh forced command's
option value (but keep everything else from the client commandline), #544
- use $XDG_CONFIG_HOME/keys for keyfile keys (~/.config/borg/keys), #515
- "borg upgrade" moves the keyfile keys to the new location
- display both archive creation start and end time in "borg info", #627
Bug fixes:
- normalize trailing slashes for the repository path, #606
- Cache: fix exception handling in __init__, release lock, #610
Other changes:
- suppress unneeded exception context (PEP 409), simpler tracebacks
- removed special code needed to deal with imperfections / incompatibilities /
missing stuff in py 3.2/3.3, simplify code that can be done simpler in 3.4
- removed some version requirements that were kept on old versions because
newer did not support py 3.2 any more
- use some py 3.4+ stdlib code instead of own/openssl/pypi code:
- use os.urandom instead of own cython openssl RAND_bytes wrapper, #493
- use hashlib.pbkdf2_hmac from py stdlib instead of own openssl wrapper
- use hmac.compare_digest instead of == operator (constant time comparison)
- use stat.filemode instead of homegrown code
- use "mock" library from stdlib, #145
- remove borg.support (with non-broken argparse copy), it is ok in 3.4+, #358
- Vagrant: copy CHANGES.rst as symlink, #592
- cosmetic code cleanups, add flake8 to tox/travis, #4
- docs / help:
- make "borg -h" output prettier, #591
- slightly rephrase prune help
- add missing example for --list option of borg create
- quote exclude line that includes an asterisk to prevent shell expansion
- fix dead link to license
- delete Ubuntu Vivid, it is not supported anymore (EOL)
- OS X binary does not work for older OS X releases, #629
- borg serve's special support for forced/original ssh commands, #544
- misc. updates and fixes
Version 0.30.0
--------------
Compatibility notes:
- you may need to use -v (or --info) more often to actually see output emitted
at INFO log level (because it is suppressed at the default WARNING log level).
See the "general" section in the usage docs.
- for borg create, you need --list (additionally to -v) to see the long file
list (was needed so you can have e.g. --stats alone without the long list)
- see below about BORG_DELETE_I_KNOW_WHAT_I_AM_DOING (was:
BORG_CHECK_I_KNOW_WHAT_I_AM_DOING)
Bug fixes:
- fix crash when using borg create --dry-run --keep-tag-files, #570
- make sure teardown with cleanup happens for Cache and RepositoryCache,
avoiding leftover locks and TEMP dir contents, #285 (partially), #548
- fix locking KeyError, partial fix for #502
- log stats consistently, #526
- add abbreviated weekday to timestamp format, fixes#496
- strip whitespace when loading exclusions from file
- unset LD_LIBRARY_PATH before invoking ssh, fixes strange OpenSSL library
version warning when using the borg binary, #514
- add some error handling/fallback for C library loading, #494
- added BORG_DELETE_I_KNOW_WHAT_I_AM_DOING for check in "borg delete", #503
- remove unused "repair" rpc method name
New features:
- borg create: implement exclusions using regular expression patterns.
- borg create: implement inclusions using patterns.
- borg extract: support patterns, #361
- support different styles for patterns:
- fnmatch (`fm:` prefix, default when omitted), like borg <= 0.29.
- shell (`sh:` prefix) with `*` not matching directory separators and
`**/` matching 0..n directories
- path prefix (`pp:` prefix, for unifying borg create pp1 pp2 into the
patterns system), semantics like in borg <= 0.29
- regular expression (`re:`), new!
- --progress option for borg upgrade (#291) and borg delete <archive>
- update progress indication more often (e.g. for borg create within big
files or for borg check repo), #500
- finer chunker granularity for items metadata stream, #547, #487
- borg create --list now used (additionally to -v) to enable the verbose
file list output
- display borg version below tracebacks, #532
Other changes:
- hashtable size (and thus: RAM and disk consumption) follows a growth policy:
grows fast while small, grows slower when getting bigger, #527
- Vagrantfile: use pyinstaller 3.1 to build binaries, freebsd sqlite3 fix,
fixes#569
- no separate binaries for centos6 any more because the generic linux binaries
also work on centos6 (or in general: on systems with a slightly older glibc
than debian7
- dev environment: require virtualenv<14.0 so we get a py32 compatible pip
- docs:
- add space-saving chunks.archive.d trick to FAQ
- important: clarify -v and log levels in usage -> general, please read!
- sphinx configuration: create a simple man page from usage docs
- add a repo server setup example
- disable unneeded SSH features in authorized_keys examples for security.
- borg prune only knows "--keep-within" and not "--within"
- add gource video to resources docs, #507
- add netbsd install instructions
- authors: make it more clear what refers to borg and what to attic
- document standalone binary requirements, #499
- rephrase the mailing list section
- development docs: run build_api and build_usage before tagging release
- internals docs: hash table max. load factor is 0.75 now
- markup, typo, grammar, phrasing, clarifications and other fixes.
- add gcc gcc-c++ to redhat/fedora/corora install docs, fixes#583
D-Bus Python Bindings 1.2.4 (2016-03-06)
========================================
The “75,000 microchips” release.
Enhancements:
• Continous integration metadata for travis-ci.org is now available.
Similar to dbus, this is split into .travis.yml (Travis-specifics)
and tools/ci-build.sh (intended to be useful for any CI framework,
although it does include various workarounds for travis-ci oddities).
(Simon McVittie)
Fixes:
• Make dbus.version a tuple again, not a list, for consistent sorting.
This was a regression in 1.2.2. (Debian #816729, Simon McVittie)
• Use inspect.signature() instead of inspect.getargspec() on Python
versions that have it. inspect.getargspec() is deprecated in recent
Python 3 and seems to have disappeared from 3.6 nightly builds.
(Simon McVittie)
• Make the tests pass in "narrow" Python builds where unicode objects
are UTF-16, rather than the UCS-4 used in Linux distributions.
(fd.o #57140, Simon McVittie)
• Always include headers in a consistent order (Debian #749133, Simon McVittie)
• Include config.h in all C code that we compile. This is necessary
on platforms where it might contain something like "#define _GNU_SOURCE"
or "#define inline __inline".
(Simon McVittie)
This release brings:
- re-license as 3-clause BSD
- minor performance improvements (refreshing, thumbnails)
- improved image rendering in view(1) and the "preview" plug-in
- manual pages build reproducibly
- more portable build as PIE
- fix build with multiple jobs
- fix crash when closing windows in embedded mode
Version 4.8.16
- Core
* Support for ash + bugfixes for bash, fish (#2742)
* Find file: empty file name matches any file name (#3593)
* Find file: empty value of "Content" is used instead of "Search for content" checkbox to disable search for content (#3594)
* Listbox: don't wraparound on mouse scroll (#3554)
* Internals:
* Listbox: various fixups (#3569: #3562, #3563, #3565, #3161)
* Split MSG_ACTION into MSG_ACTION and MSG_NOTIFY (#3566)
- VFS
* Support lzip compression format (#2673, #1541)
* Support lz4 compression format (#3523)
* patchfs: support xz compression (#3443)
* Update uc1541 version (#3527)
* Add mc.ext patterns for initramfs / initrd (#3115)
- Editor
* Add golang syntax (MidnightCommander/mc#84)
* Update Puppet syntax (MidnightCommander/mc#86)
- Misc
* Code cleanup (#3555, #3547, #3587)
* Better subshell documentation (#3556)
* Fixes to the English man pages by Denys Vlasenko
- Fixes
* Insufficient quoting in `mc.menu` (#2947)
* Broken ./configure --without-internal-edit (#3601)
* Memory leaks (#3547, #3561, #3567, #3572)
* No preallocation if appending during file copy (#3577)
* Cannot set mini-format for "brief" listing type (#3588)
* Info panel: incorrect inode information in some cases (#3214)
* Info panel: wrong device name with symbolic link (#3412)
* Info panel: buffer overflow (#3582)
* Regression: match filename, not full path in mc.ext (#3578)
* Broken case insensitive search in non-unicode locale (#3491)
* Error message prefixed with no sense "0:" (#3269)
* mcedit: buffer overflow (#3579)
* mcedit: "Lower case selection" command in User Menu (#3586)
* mcedit: close on ctrl-g (#3557)
* mcview: "Not found" result isn't reported in some cases (#3543)
* VFS: isofs doesn't show .dotfiles (#3537)
* VFS: isofs: cannot copy file from iso when Joliet without RockRidge is used (#2851)
* VFS: extfs/unzip: enter into zip file fails with "inconsistent extfs archive" (#3433)
* VFS: SFTP: various bugs (#3581)
* VFS: FISH: provide major/minor info for block/char devices (#3599)
* Bashism in gitfs+ extfs helper (#3379)
* Non-portable invocation of man (#3509)
* mc-wrapper leaves MC_USER set (#3550)
* Broken silent opening of files in background (#3574)
* Run `identify` on JPEGs even if `exif` is not installed (#3568)
Major changes in 0.12.11
========================
* protocol: add support for the VP8 and h264 video codecs
* protocol: add unix GL scanout messages
* remove code generation scripts, moved back to spice-common
* macros improvements, more type safety
Behaviour changes:
- classesmatching(): order of classes changed
- Suppress standard services noise on SUSE
Fixes:
- Reduce verbosity of yum package module
- Reduce verbosity of apt_get package module
- Upgrade dependencies to latest patch versions.
Upgraded libraries:
- curl 7.47.0
- libxml2 2.9.3
- LMDB 0.9.18
- MySQL 5.1.72
- OpenLDAP 2.4.44
- OpenSSL 1.0.2g
- PCRE 8.38
- PostgreSQL 9.3.11
- Redis 2.8.24
- rsync 3.1.2
PHP was kept at 5.6.17 because of problems with the 5.6.19 version.
- parse def.json vars, classes in C
- Namespaced classes can now be specified on the command line.
- getvalues() will now return a list also for data containers,
and will descend recursively into the containers.
- @if minimum_version now correctly ignores lines starting with '@'
- Fix definition of classes from augments file
- Don't follow symbolic links when copying extended attributes.
- Fix ps options for FreeBSD to check processes only in current
host and not in jails
- Fix cf-serverd error messages with classic protocol clients
- The isvariable() function call now correctly accepts all
array variables when specified inline. Previously it would not
accept certain special characters, even though they could be
specified indirectly by using a variable to hold it.
- Show errors regarding failure to copy extended attributes
when doing a local file copy. Errors could happen when copying
across two different mount points where the support for extended
attributes is different between the mount points.
- Fix bad option nlwp to vzps on Proxmox / OpenVZ.
- Fix file descriptor leak when there are network errors.
- Fix a regression which would sometimes cause "Permission
denied" errors on files inside directories with very restricted
permissions.
- Check for empty server response in RemoteDirList after
decryption
- Allow def.json up to 5MB instead of 4K.
- Add guard for binary upgrade during bootstrap
- Fix HP-UX specific bug that caused a lot of log output to
disappear.
- Fix a bug which sometimes caused package promises to be
skipped with "XX Another cf-agent seems to have done this since
I started" messages in the log, most notably in long running
cf-agent runs (longer than one minute).
- Define (bootstrap|failsafe)_mode during update.cf when triggerd
from failsafe.cf
- Fix two cases where action_policy warn still produces errors
- Fix classes being set because of hash collision in the
implementation.
- fix build failure on FreeBSD 7.1
- Installing packages containing version numbers using yum
now works correctly.
