Commit graph

182 commits

Author SHA1 Message Date
wiz
ea868f230b pbulk: make rsync dependency a default-on option 2021-12-06 11:21:19 +00:00
nia
aad16b4dcc pbulk: update default pkgdb location 2021-08-20 06:38:31 +00:00
riastradh
32ddee07dd pbulk: Avoid cleaning $prefix on every bulk build in master mode.
Whatever is in $prefix shouldn't affect the result -- both scanning
and building happen in the workers -- and it is a bit of a nasty
surprise for merely issuing bulkbuild-restart to nuke all the host's
installed packages.

ok joerg
2021-01-02 21:54:46 +00:00
joerg
52ba11c46f pbulk-0.70: store end of build in epoche format too
This is nicer for using bulk builds as benchmark as it doesn't require
parsing dates.
2020-08-09 23:18:30 +00:00
tnn
19c9aa59c8 pbulk: fix typo in error message 2020-08-04 02:35:09 +00:00
riastradh
47c5a1e893 Bump version for pbulk script fixes. 2020-04-04 20:44:36 +00:00
riastradh
c92a9b3913 Fix typo: $client_prepare_chroot, not clients_prepare_chroot. 2020-04-04 15:17:48 +00:00
riastradh
4880294ca4 Fix order of assignments so we set path as intended, not to empty. 2020-04-04 15:17:36 +00:00
wiz
1e368078b4 pbulk: add missing backslash 2020-01-16 13:49:57 +00:00
joerg
2f25ee0443 Fix pkg_admin expansion due to lost local change. 2020-01-15 19:14:01 +00:00
joerg
ff7043b64c pbulk-0.67: Support both $NetBSD$ style RCS IDs and digests in +BUILD_INFO.
Bump configuration version for the new pkg_admin field.
2020-01-12 23:35:01 +00:00
joerg
c604a8dab6 pbulk-0.66: make it simpler to compute the duration of the scan phase
This is handy when benchmarking whole system performance.
2020-01-08 15:12:01 +00:00
wiz
3cebc398f4 pbulk-base: fix double free().
Debugged by dillo & myself.

Bump version.
2019-03-12 15:37:51 +00:00
jperkin
5393242c73 *: Move SUBST_STAGE from post-patch to pre-configure
Performing substitutions during post-patch breaks tools such as mkpatches,
making it very difficult to regenerate correct patches after making changes,
and often leading to substituted string replacements being committed.
2018-07-04 13:40:07 +00:00
wiz
05aea20e3a Fix typo in status message. 2018-02-19 12:03:00 +00:00
joerg
8ad27ea5ce Deal with stupid GCC warnings on Linux due to glibc deciding that
write's return value must be used at all times.
2017-02-25 21:21:53 +00:00
joerg
114f76a09f pbulk-0.65: Add basic support for specifying chroot'd clients by
absolute path. Introduce hook for setting up the chroot
(client_prepare_chroot) similar to client_prepare_action for ssh
clients.
2016-12-18 22:59:35 +00:00
joerg
60337d0d7a pbulk-0.64:
Ensure to reset port after each loop, so that "client" and "client:port"
notation can be mixed.
2016-12-18 22:41:12 +00:00
joerg
da31c10d9c pbulk-0.63:
Introduce a separate client-prepare script. The default configuration
runs the renamed client_prepare_action for each scan/build client once,
dropping duplicates in the list. Clients are prepared in parallel, but
the master waits for all before starting the actual scan. Make
bulkbuild-restart re-prepare the clients, i.e. in case they have a
pkgsrc tree in a local tmpfs.
2016-12-18 22:38:16 +00:00
joerg
16ca8d25dd pbulk-0.62: cleanup if either the initial pkg_add round or the package
upload failed.
2016-12-18 09:36:38 +00:00
joerg
29777c2322 Adjust comment to reflect reality. 2016-10-07 13:22:49 +00:00
joerg
34599e08d1 pbulk-base-0.53:
After processing the tree-scan job, reassign jobs to all idle clients.
Before, this was only necessary at the very start of the build.
2016-06-23 15:07:39 +00:00
joerg
9fb46a3b44 pbulk-base-0.52:
Move the tree iteration logic from the master to the client. This
matters primarily when using the additional package list in the top
level makefile and ensures that the client configuration is used
consistently.
2016-06-20 17:54:43 +00:00
joerg
42dd6c95bf pbulk-0.61: don't create category symlinks in the default package sync
implementation.
2016-05-09 00:08:21 +00:00
joerg
051b5b5127 Drop support for USE_DESTDIR=no. Bump version. 2016-04-10 17:00:33 +00:00
joerg
0b6285ee53 pbulk-base-0.51: Extend network support for name resolution and IPv6
(where applicable).
2015-12-07 16:52:39 +00:00
joerg
b3bce06c92 Revert. Committer was explicitly asked to not commit that change as it
is incompletely and incorrect.
2015-11-30 22:38:16 +00:00
asau
bcc1b4be8b pbulk-base-0.51: Allow symbolic host names in distributed case. 2015-11-30 20:46:57 +00:00
joerg
bc48e3b92f pbulk-base-0.50: Don't go into master mode if there is nothing to do. 2015-11-03 19:06:47 +00:00
joerg
ad40275cd0 Fix missing change from the machine the scan change was tested on. 2015-10-22 19:57:47 +00:00
joerg
f05a09bbf6 pbulk-base-0.49:
When shutting down the master after all jobs are done, send a zero
length request to the clients and wait a second for them to shutdown the
connection. Calling shutdown on the server side doesn't avoid TIME_WAIT
as originally intended.
2015-10-21 23:03:17 +00:00
joerg
4bdd56fb47 pbulk-0.59: Belatedly bump PBULK_CONFIG_VERSION to ensure that
sync_packages etc are present.
2015-10-18 13:32:13 +00:00
joerg
2ef22f9a96 pbulk-0.58: Create All if it doesn't exist yet. Noticed by asau@ 2015-10-15 11:47:46 +00:00
tnn
b32f026f53 The warning message contained herein is not relevant.
pbulk has safeguards against mismatching config version.
2015-09-20 16:23:30 +00:00
joerg
907b09319a pbulk-0.57: Reorder build phases slightly to make better use of destdir
builds. Introduce hooks for sending bulklog and package explicitly the
master. The default bulklog action is a nop and the package action
mirrors the normal package step, i.e. copying to ${packages}/All and
adding the category symlinks.
2015-09-13 11:45:36 +00:00
joerg
68bfe531ae When copying the meta directory, preserve time stamps. Otherwise changes
won't be picked up correctly.
2015-09-12 23:04:30 +00:00
joerg
6adcaa3a2a pbulk-0.55: Add option for running the checksum phase unprivileged. This
makes it easy to use DISTDIR=${WRKDIR}/.distfiles or so. Not the default
as it changes the required permissions on ${DISTDIR}.
2015-09-08 17:35:06 +00:00
joerg
267f3d0186 Allow having bulklog and bulklog.old as separate mount points.
When removing bulklog.old fails, try to remove everything but meta and
copy the content.
2015-09-08 17:33:26 +00:00
joerg
84a557a460 Be nicer to broken musl headers that insist on providing warning
headers.
2015-09-08 13:57:36 +00:00
sevan
7d2818bbd3 Use details about variants when applicable instead of common names, this means
that the illumos variants such as SmartOS & OmniOS will be labelled accordingly
rather than being lumped in under the SunOS 5.11 banner.

This was put together with the help of Joerg @ pkgsrcCon 2015

Reviewed by joerg@ bsiegert@
2015-07-25 15:14:54 +00:00
joerg
b8d3c06e36 Allow clients to be specified with port number, simplifying multi-chroot
setups.
2015-06-07 22:49:04 +00:00
asau
feab860359 Bump version for package list format change. 2014-11-24 01:08:02 +00:00
asau
319319615c Allow empty lines, blank space, and "#"-delimited comments in list of packages to build. 2014-11-24 00:52:09 +00:00
abs
a20f99ea74 HTML police (semantics division):
Add some <thead> and <tbody> tags
2014-05-14 14:45:26 +00:00
jperkin
af8ad5bd88 pbulk-base-0.48: Fix pbulk-scan on OSX.
On OSX pbulk-scan can fail to bind with EADDRNOTAVAIL due to sin_zero being
used uninitialised.  Ensure the sockaddr_in is cleared before use.
2014-03-14 09:45:31 +00:00
obache
200b2838ca Note "used by" 2014-03-03 04:38:43 +00:00
obache
34637a70ac Just define PKGNAME and use it. 2014-03-03 03:30:52 +00:00
jperkin
c8e937c121 pbulk-0.52: ensure sort(1) is called with LC_ALL=C
Without this, a LANG of e.g. en_US.UTF-8 would sort "- *" before "+ <file>",
resulting in no packages being uploaded.
2014-02-22 00:35:41 +00:00
joerg
13e53eb4e7 Format string annotations. 2014-01-15 13:52:10 +00:00
dholland
6bc842729f Minor tidyup to error reporting. (This has been sitting in one of my trees
for a year and a half and I don't remember the context.) ok'd by joerg
2013-04-14 17:03:30 +00:00