This 5.0.3 version is significant bug fix update to version 5.0.2.
It includes new code and some new features.
There is no database change since prior versions of 5.0.
Compatibility:
--------------
As always, both the Director and Storage daemon must be upgraded at
the same time.
Older 5.0.x and 3.0.x File Daemons are compatible with the 5.0.3
Director and Storage daemons. There should be no need to upgrade older File
Daemons.
Changes and New Features:
- If a VSS (Windows) snapshot fails, the whole Job is failed, previously
it printed a warning message and continued.
- New editing codes %b = Job Bytes and %f = Job Files for runscripts
- Any non-Bacula project plugins (i.e. third party plugins)
must be upgraded to specify AGPLv3 in place of the GPLv2 used previously
for the PLUGIN_LICENSE.
- The bat Media page text columns can be sorted by clicking on the column.
- If possible, the SD will automatically update the catalog Volume size if
it does not match the Volume size. The mismatch between the Volume sizes
typically occurs when the FD has a comm line drop or the FD crashes.
- Add lmgr_is_locked() function to test if a thread own a mutex
- Remove comment field added in last patch
- Check if sql backend is thread-safe
- Fix cancel crash reported by Stephen Thompson
- fix grant_postgresql_privileges doesn t grant permissions on jobhisto_jobid_seq
- Add lock position info to volume manager
- Permits to use lock manager with file/line from outside
- Replace ASSERT in block.c with fail Job
- Use uint32_t for max_concurrent_jobs
- Use file and line for rwlock and lmgr in db_lock()
- Add File and Line info to rw_lock for lmgr
- Fix database locking calling db_lock and returning from function without
calling db_unlock.
- Add missing db_unlock to bvfs_update_cache.
- Allow users to build bat without static QT if desired.
- Fix for qt mkspecs location on Fedora 12.
- Another fix for OpenSSLv1
- Add -lrt to Solaris links
- Fix tls.c for OpenSSLv1
- Fix plugin load not to stop if one plugin bad -- pointed out by James
- Remove --without-qwt from configure statement.
- Fix bug in bvfs_update function, should work much better now
- Lets not generate the ingres code automatically when the .sc or .sh files
changes as it seems these files get outdated on some systems and then this
rule kicks in on systems that don't have the esqlcc ingres compiler installed.
- Fix CentOS detection in regression get-os script
- Create subroutines to add exclusion for plugins
- This adds sql debugging to these classes that Eric wrote.
- This is a 1/2 fix of the issue. It allows for the sorting of the two non
graphic columns, but still does not allow for sorting the graphic columns.
The issue is with last. By setting the sort value, you are setting the value
on the last. To experiment with what I mean, use the set background that I
have commented out in this commit.
- Fix OpenSSL 1.x problem in crypto.c on Fedora 12
- Display AllowCompress warning message only if compression used in FileSet
- Added comment on dbi backend needing a recent version of libdbi from CVS as
the version currently released 0.8.3 wont work for compiling the code.
- Add Warning check to SQL
- Fix readline to use TERM_LIB found for conio
- Move bacula shared objects in separate bacula-libs package.
- Fix for termcap lib on suse.
- Fix for shared objects name convention change.
- Remove mandrive and suse bacula.spec from configure
- Fix compile link flags for gigaslam
- Add missing defines for gccver.
* We believe that we have resolved most of the problems
concerning canceled or failed jobs being "stuck" in the
Director. There is one outstanding problem in the SD when
canceling jobs that we will fix in the next major release.
If you see jobs that seem to be stuck, in general issuing
a cancel command in bconsole should now make them go away.
Directives:
* The default for "Allow Duplicate Jobs" has been changed from
no to yes. If you use this directive, please check your
conf file, and note the next two items!
* AllowHigherDuplicates disabled. It did not work as documented
and was confusing.
* New directive "CancelLowerLevelDuplicates" See New Features
section in the manual.
* Truncate on Purge rewritten. See New Features section in the manual.
* Bug fixes
* Ensure SD asks for help when looping even if poll set.
* Fix three-pool regress bug
* This version fixes an issue where the console window would start out
docked. It is fixed by initiating the variables in the Pages class wi
constructor.
* Fix make_catalog_backup.pl fails when catalog db is on other host
* Fix 1352 about double free with regexp and big filenames on windows
* Apply Graham's idea for recovering from disk full by recursing
when doing fixup_write_error ...
* Make fix for VirtualFull changing device
* Fix concurrent Job recycle bug 1288
* Backport part of one possible fix from bug 1346
* Fix bug 1382 newly created disk volumes -> file not found warning
* Fix Alpha ifdefing -- should fix bug 1359
* Use old code for selecting file during restore.
* tweak space on projects file
* Fix seg fault in ignoredir code
* Apply Frank's slash patch
* Add more info when SD-connection refused
* Fixes bug 1371 about segfault in SD
* Fixes bug 1355 Director crashes with double free in Accurate SQL query
* Fixes bug 1365 and 1366 about MacOSX resource forks.
* Fixes bug 1369 about "Exclude Dir Containing" fileset option
* Fixes bug 1368 ASSERT Failure on MacOS.
* Fixes bug 1364 and 1363 about compression buffer error.
* Fix 1323 about a problem when mounting a requested volume during a restore.
* Add more example SD Device configurations.
* Force the client_encoding to SQL_ASCII when database is already using this
mode.
* Fix 1335 about postgresql error message during copy session
* Cleanup old job records when starting the director (Created/Running -> Failed)
* Apply patch in bug 1315 by McMichaeli that fixes scripts/logwatch
* Add more output when spooling and no space left
* Fix postgresql driver bug that displayed <NULL> rows from time to time.
* Implement the project 'restore' menu: enter a JobId, automatically
select dependents
* Should fix 1323 about verify accurate jobs and deleted files.
* more...
* Bug fixes.
* Check for job_canceled() in fd_plugin code.
* Update Win32 table creation to have new DB version 11 format
* Remove illegal Options in Exclude of default Win32/64 bacula-dir.conf
* Remove "Reposition" message when restoring
* Update projects file
* Modify insertion of read Volumes in SD to be done before the
drive reservation. This ensures that a Volume to be read will not
be reserved for writing. Significant enhancement.
Changes 3.0.0:
* Fix Win32 make clean to clean correctly
* Separate object/binaries in Win32 and Win64 builds. More to be done.
* Add bconsole to Win64 installer.
* Enhance Job messages from SD when the FD->SD protocol is incorrect
and the SD hangs up. Previously this looked like a comm error.
* Fixed problem in xattr and acl code trying to send empty acl or xattr
streams.
* Fix for bug #1261 where we send out a null stream when a file only an
acl and xattr support is also turned on.
* Added some warnings to configure when using libtool and static in
one configure.
* Fix small memory leak in fileregexp bsr code
* Correct bacula32.def entry point as specified by James.
* Add code to FD plugin driver to make a copy of the plugin
filename to be saved to avoid save_file from zaping it.
* Directly mark all files saved by plugin as being seen for Accurate.
* more...
* Fix bug: inappropriate Volume purging.
* Modify sql_update.c to edit zeros rather than NULL in unset fields.
* Backport most recent changes to compat.h and compat.cpp
attempt to fix restore problem with accents in path. This
works in version 2.5.x but is not tested in 2.4.4.
* Create and apply 2.4.3-migrate2.patch, which fixes two bugs
- sql error when there are no files to migrate.
- Job catalog log is not migrated during migration.
* Remove extra db_lock() in get_prune_list_for_volume()
* Apply 2.4.3-prune-deadlock.patch that fixes a problem when
using Catalog as message backend.
* Apply 2.4.3-win32-runscript-unicode-path.patch for a problem when
executing a program with Unicode path.
* Apply 2.4.3-unique-inchanger.patch fix bad slot number if the volume
is not in autochanger.
* Fix for bug where Volume is purged while writing on it.
* Get message enhancement to avoid job name lookup.
* Fix bug with job name duplication if more than 60 jobs created
during a minute.
* Correct some bugs of cleanup in SD if the FD connection fails.
* Fix orphaned jobs (possible deadlock) while pruning.
* Backport of the btraceback script that keeps trace file on working dir
* Migrate DB Log records too.
* Modify SQL so that jobs that failed will not be migrated.
* Correct bug where long retention periods caused immediate pruning.
* Apply 2.4.2-cancel-non-running-jobs.patch to be able to cancel
a non created job faster.
* Fix typo in configure.in that breaks --with-db-password option
* Remove all double quotes from SQLite creating script and
replace by single quotes as suggested by John Huttley.
* Fix SQL case problem that may cause the failure of DiskToCatalog.
* Copy missing storage name into edit buffer. As far as I can tell
this never caused a bug.
* Remove catalog dependency for bcopy
* Modify catalog scripts to have an easier packaging integration,
using default variables.
Make difference between SQLite3 and SQLite in db_get_type()
job when reading from one autochanger and writing to another.
* Add more information to SD acquire.c INFO messages.
* Fix NULL Volume name error when reading and the drive must
be switched.
* Fix a Verify InitCatalog problem where in certain cases
a garbage filename may be entered in the verification database.
* Add space after version before date in bat about dialog.
* Fix seg fault in Dir during estimate command with no level value given.
* Add message to migration job when the target job is already migrated.
These fix a handful of bugs the most serious being a potential data loss
bug. Committed during the freeze since a data loss bug in backup
software is no good!
See http://marc.info/?l=bacula-announce&m=119109399004039&w=2 for
the announcement on the bacula-announce mailing list about this bug.
kes Increase size of name string when FD making connection to SD.
May fix bug #953.
kes Add code to try to fix bug #908.
kes Add waits to multiple exit detection code to try to force pid
file to always be deleted.
kes Restore good dev.tar.gz to rescue set appropriate binary property.
This fixes bug #950.
kes Fix seg fault in error exit of acquire_for_read after unsuccessfully
trying to switch drives by checking for blocking before unblocking.
Fixes bug #906.
kes Cancel storage daemon in all cases where FD reports error. This
should fix virtually all cases of bug #920.
kes Fix error message that was clobbered when Dir tells SD it does not
have write permission on Volume. This should fix a minor point
in bug #942, but not the main problem.
kes Add code to cancel job in SD if FD connection fails. This should
fix bug #920.
kes Add code in FD exit to prevent loops and a crash on FreeBSD.
kes Fix migration code to get correct Volume name with multiple volumes
by skipping |. Fixes bug #936.
kes Implement patch supplied by Landon to fix bug #944 where using
TLS with bconsole uses 99+% of the CPU.
kes Note, you need GTK >= 2.10 to be able to link the Tray Monitor
program.
kes Move patches into patches directory.
ebl Fix bug #946 about "bacula-dir -t" which doesn't works
as expected.
ebl Using "m" in bconsole will show messages like before,
and not memory usage.
the 2.0.x series. Major new features include:
- Much faster insertion of attributes (somewhere around 10 times),
many thanks to Eric Bollengier and Marc Cousin.
- First release of bat (Bacula Administration Tool). Note to build
bat you must explicitly enable it on the ./configure line, you
must have the Qt4 version 4.2 or later libraries loaded, the qwt
(Qt Graphics) package loaded, and qmake and the other Qt4 tools
must be available. Most of the implementation was done by Dirk Bartley.
- Red/Black restore in memory tree (500 times faster loading).
- The Regex Where code to allow easier relocation of restored files
thanks to Eric.
- Socket level heartbeat for all connections (untested).
- posix_fadvise() use in the FD to improve performance reduces
swapping due to opening/reading lots of files. Win32 equivalent
implemented.
- Much improved Volume reservation code that should eliminate most
conflicts experienced in multiple drive autochangers.
- Simpler locking in the SD in the reservation system.
- Detection of file size/date change during backup if enabled.
- New Recycle Pool feature -- thanks to Eric.
- Efficient implementation of very large include/exclude lists.
- Volumes are no longer pruned during 'status dir'
- Pruning is now more efficient, and if a Volume is purged,
during pruning, it is immediately discovered.
- License is now GPL v2 without modifications, fix a few copyright
mistakes made when adding FSFE copyright notice.
Important upgrade notes are mentioned in the MESSAGE file.
XXX Not (functionally) tested by myself, but Peter Eisch <peter@boku.net>
(via pkgsrc-users@NetBSD.org) verified the patch in his setup.
the owner of all installed files is a non-root user. This change
affects most packages that require special users or groups by making
them use the specified unprivileged user and group instead.
(1) Add two new variables PKG_GROUPS_VARS and PKG_USERS_VARS to
unprivileged.mk. These two variables are lists of other bmake
variables that define package-specific users and groups. Packages
that have user-settable variables for users and groups, e.g. apache
and APACHE_{USER,GROUP}, courier-mta and COURIER_{USER,GROUP},
etc., should list these variables in PKG_USERS_VARS and PKG_GROUPS_VARS
so that unprivileged.mk can know to set them to ${UNPRIVILEGED_USER}
and ${UNPRIVILEGED_GROUP}.
(2) Modify packages to use PKG_GROUPS_VARS and PKG_USERS_VARS.
5Mar07
kes File migrate bug with Pool Occupancy using mediaid instead
of jobids. Fixes bug #795.
kes Fix orphaned buffers in filed backup and verify due to
crypto buffers not freed during errors. Fixes bug #789.
04Mar07
kes Add smartctl call to bacula-sd.conf as an example of getting
tape alert info.
02Mar07
kes Add Client Connect Wait to Storage daemon to permit users to
modify the time the SD waits for a FD connection.
28Feb07
kes Apply Command ACL filter to JobId list in restore command.
kes Correct typeo in var.c patch.
27Feb07
kes Don't let Bacula prune File or Job records for the current Job.
kes Fix variable substitution pad + inc bug reported (with patch)
in bug #791.
26Feb07
kes Correct SQLite log table index as reported by Luca Berra.
24Feb07
ebl Fix FIFO stuff, bacula tries to rewind the FIFO... Thanks to Andreas
22Feb07
kes Fix a few places in lib/message.c where the open fd may
not be zeroed.
21Feb07
kes Add LANG=C to autoconf/randpass so it works with languages other
than English. Fixes bug #788.
20Feb07
ebl Revert ClientRunBeforeJob as it was in 1.38.x
This fixes bug #780
You will not be able to generate Include/Exclude list any more.
If you want to use this, you can apply
trunk/bacula/patches/testing/clientrunbeforejob_can_generate_include_exclude_list.patch
19Feb07
kes Restore of sockets created false error messages because Bacula
no longer restores sockets, but the code was still trying to
set the attributes on a non-existent file. Reported by a user.
16Feb07
kes Fix encryption deblocking bug, which caused some restored files
to be truncated. This fixes bug #763.
kes Add FD event sequence order prepared by Eric -- for RunScripts.
kes Fix 12am/pm bug as reported in bug #782.
15Feb07
kes Add quick disconnect FD code from 2.1.4 to 2.0.3. This code
causes the SD to release the FD as soon as the FD has sent
all the data to the SD. After that the SD will do any final
despooling (data and attributes) that are necessary. This
allows laptops to disconnect much quicker from the network
after a backup.
13Feb07
kes Apply Eric's ClientRunScriptAfter patch to 2.0 and 2.1.
11Feb07
kes Optimize the use of the database a bit in the Status dir command.
Only open it when needed, ensure that if any previous database
was opened, it is closed.
10Feb07
kes Modify dbcheck to handle orphaned JobMedia, Path, Filename,
and File records in 300K chunks to be more efficient. This
idea came from Juan Luis Frances (if I remember right).
09Feb07
kes Update projects list.
08Feb07
kes Fix dird/ua_cmds.c so that a cancel command checks if the
console is authorized to cancel the job. This fixes bug
#767.
kes Modify SD so that the VolCatJobs medium record is updated
at the beginning of a Job rather than the end. This
fixes bug #775 where exceeding MaxVolJobs caused jobs
to fail.
kes Added a mutex around getting and setting Volume information
so that multiple simultaneous jobs will single thread.
07Feb07
Switch to using Subversion
kes Remove src/pygtk-console/ from configure
06Feb07
kes Delete src/lib/btree.c from win32 build, then add rblist.c
plus the entrypoints.
kes Apply patch supplied that corrects debug print
in canceling jobs for max run time. Supplied as
part of bug #621, which was previously fixed.
05Feb07
kes Test on job_canceled() and sd_msg_thread_done inside
loop starting the message thread to avoid a race condition.
Fixes bug #771.
kes Remove rl_catch_signal from console.c as it conflicted
with the header definition. Fixes bug #765.
ebl Fixes bug #766 about RunsOnClient = Yes (case sensitive)
04Feb07
kes Clarify some stored/acquire messages to indicate if the
problem is with read or append.
02Feb07
kes Fix memory leak with storage ids in cats/sql_get.c
kes Terminate watchdog earlier to avoid reference to released
memory -- reported by Jason Austin.
kes Move closing the database from jobq.c to the director daemon
termination routine. This fixes memory leaks for shadow jobs
(i.e. migration jobs).
kes Free up the unique jobid chain items in migrate.c. This fixes
a memory leak problem.
kes Convert some ugly looking for statements to use foreach_alist
in findlib/find.c. This will facilitate converting the structures
to use dlist (for large include/exclude lists).
kes Fix a bug in the btree.c and btree.h routines, then rename them
rblist and add them to be built in src/lib. Include some new
methods written by Rudolf Cejka that make the code more readable
(hides some of the ugly casting).
26Jan07 (back port)
kes Implement item #12 on project list -- quick release of FD by
the SD. This is noted in more detail above.
