Commit graph

149 commits

Author SHA1 Message Date
joerg
52ba11c46f pbulk-0.70: store end of build in epoche format too
This is nicer for using bulk builds as benchmark as it doesn't require
parsing dates.
2020-08-09 23:18:30 +00:00
tnn
19c9aa59c8 pbulk: fix typo in error message 2020-08-04 02:35:09 +00:00
riastradh
c92a9b3913 Fix typo: $client_prepare_chroot, not clients_prepare_chroot. 2020-04-04 15:17:48 +00:00
riastradh
4880294ca4 Fix order of assignments so we set path as intended, not to empty. 2020-04-04 15:17:36 +00:00
joerg
ff7043b64c pbulk-0.67: Support both $NetBSD$ style RCS IDs and digests in +BUILD_INFO.
Bump configuration version for the new pkg_admin field.
2020-01-12 23:35:01 +00:00
joerg
c604a8dab6 pbulk-0.66: make it simpler to compute the duration of the scan phase
This is handy when benchmarking whole system performance.
2020-01-08 15:12:01 +00:00
wiz
3cebc398f4 pbulk-base: fix double free().
Debugged by dillo & myself.

Bump version.
2019-03-12 15:37:51 +00:00
wiz
05aea20e3a Fix typo in status message. 2018-02-19 12:03:00 +00:00
joerg
8ad27ea5ce Deal with stupid GCC warnings on Linux due to glibc deciding that
write's return value must be used at all times.
2017-02-25 21:21:53 +00:00
joerg
114f76a09f pbulk-0.65: Add basic support for specifying chroot'd clients by
absolute path. Introduce hook for setting up the chroot
(client_prepare_chroot) similar to client_prepare_action for ssh
clients.
2016-12-18 22:59:35 +00:00
joerg
60337d0d7a pbulk-0.64:
Ensure to reset port after each loop, so that "client" and "client:port"
notation can be mixed.
2016-12-18 22:41:12 +00:00
joerg
da31c10d9c pbulk-0.63:
Introduce a separate client-prepare script. The default configuration
runs the renamed client_prepare_action for each scan/build client once,
dropping duplicates in the list. Clients are prepared in parallel, but
the master waits for all before starting the actual scan. Make
bulkbuild-restart re-prepare the clients, i.e. in case they have a
pkgsrc tree in a local tmpfs.
2016-12-18 22:38:16 +00:00
joerg
16ca8d25dd pbulk-0.62: cleanup if either the initial pkg_add round or the package
upload failed.
2016-12-18 09:36:38 +00:00
joerg
29777c2322 Adjust comment to reflect reality. 2016-10-07 13:22:49 +00:00
joerg
34599e08d1 pbulk-base-0.53:
After processing the tree-scan job, reassign jobs to all idle clients.
Before, this was only necessary at the very start of the build.
2016-06-23 15:07:39 +00:00
joerg
9fb46a3b44 pbulk-base-0.52:
Move the tree iteration logic from the master to the client. This
matters primarily when using the additional package list in the top
level makefile and ensures that the client configuration is used
consistently.
2016-06-20 17:54:43 +00:00
joerg
42dd6c95bf pbulk-0.61: don't create category symlinks in the default package sync
implementation.
2016-05-09 00:08:21 +00:00
joerg
051b5b5127 Drop support for USE_DESTDIR=no. Bump version. 2016-04-10 17:00:33 +00:00
joerg
0b6285ee53 pbulk-base-0.51: Extend network support for name resolution and IPv6
(where applicable).
2015-12-07 16:52:39 +00:00
joerg
b3bce06c92 Revert. Committer was explicitly asked to not commit that change as it
is incompletely and incorrect.
2015-11-30 22:38:16 +00:00
asau
bcc1b4be8b pbulk-base-0.51: Allow symbolic host names in distributed case. 2015-11-30 20:46:57 +00:00
joerg
bc48e3b92f pbulk-base-0.50: Don't go into master mode if there is nothing to do. 2015-11-03 19:06:47 +00:00
joerg
ad40275cd0 Fix missing change from the machine the scan change was tested on. 2015-10-22 19:57:47 +00:00
joerg
f05a09bbf6 pbulk-base-0.49:
When shutting down the master after all jobs are done, send a zero
length request to the clients and wait a second for them to shutdown the
connection. Calling shutdown on the server side doesn't avoid TIME_WAIT
as originally intended.
2015-10-21 23:03:17 +00:00
joerg
2ef22f9a96 pbulk-0.58: Create All if it doesn't exist yet. Noticed by asau@ 2015-10-15 11:47:46 +00:00
joerg
907b09319a pbulk-0.57: Reorder build phases slightly to make better use of destdir
builds. Introduce hooks for sending bulklog and package explicitly the
master. The default bulklog action is a nop and the package action
mirrors the normal package step, i.e. copying to ${packages}/All and
adding the category symlinks.
2015-09-13 11:45:36 +00:00
joerg
68bfe531ae When copying the meta directory, preserve time stamps. Otherwise changes
won't be picked up correctly.
2015-09-12 23:04:30 +00:00
joerg
6adcaa3a2a pbulk-0.55: Add option for running the checksum phase unprivileged. This
makes it easy to use DISTDIR=${WRKDIR}/.distfiles or so. Not the default
as it changes the required permissions on ${DISTDIR}.
2015-09-08 17:35:06 +00:00
joerg
267f3d0186 Allow having bulklog and bulklog.old as separate mount points.
When removing bulklog.old fails, try to remove everything but meta and
copy the content.
2015-09-08 17:33:26 +00:00
joerg
84a557a460 Be nicer to broken musl headers that insist on providing warning
headers.
2015-09-08 13:57:36 +00:00
sevan
7d2818bbd3 Use details about variants when applicable instead of common names, this means
that the illumos variants such as SmartOS & OmniOS will be labelled accordingly
rather than being lumped in under the SunOS 5.11 banner.

This was put together with the help of Joerg @ pkgsrcCon 2015

Reviewed by joerg@ bsiegert@
2015-07-25 15:14:54 +00:00
joerg
b8d3c06e36 Allow clients to be specified with port number, simplifying multi-chroot
setups.
2015-06-07 22:49:04 +00:00
asau
319319615c Allow empty lines, blank space, and "#"-delimited comments in list of packages to build. 2014-11-24 00:52:09 +00:00
abs
a20f99ea74 HTML police (semantics division):
Add some <thead> and <tbody> tags
2014-05-14 14:45:26 +00:00
jperkin
af8ad5bd88 pbulk-base-0.48: Fix pbulk-scan on OSX.
On OSX pbulk-scan can fail to bind with EADDRNOTAVAIL due to sin_zero being
used uninitialised.  Ensure the sockaddr_in is cleared before use.
2014-03-14 09:45:31 +00:00
jperkin
c8e937c121 pbulk-0.52: ensure sort(1) is called with LC_ALL=C
Without this, a LANG of e.g. en_US.UTF-8 would sort "- *" before "+ <file>",
resulting in no packages being uploaded.
2014-02-22 00:35:41 +00:00
joerg
13e53eb4e7 Format string annotations. 2014-01-15 13:52:10 +00:00
dholland
6bc842729f Minor tidyup to error reporting. (This has been sitting in one of my trees
for a year and a half and I don't remember the context.) ok'd by joerg
2013-04-14 17:03:30 +00:00
jperkin
5e67cd4147 pbulk-base-0.47: Portability fixes
- Prefer fcntl FD_CLOEXEC to ioctl FIOCLEX.

 - Reset SIGPIPE action to default for the build child, avoids 'yes' spinning
   indefinitely on EPIPE in Solaris builds, notably for print/pdf2djvu.
2013-01-14 14:33:28 +00:00
jperkin
df44cc14a3 Fix a couple of typos. 2013-01-07 14:15:35 +00:00
joerg
8a16e0811e Make GCC happy and set s_start and s_end explicitly. 2012-11-30 16:22:49 +00:00
joerg
13b6f43825 Update pbulk to 0.51 and pbulk-base to 0.46. Add support for reusing old
scan results to speed up the process. Fix a bug that overwrote the
package.log during installation.
2012-11-23 12:13:34 +00:00
jperkin
93ab156fde pbulk-0.50: Portability fix, use 'id' instead of 'whoami'. 2012-06-19 13:40:07 +00:00
joerg
e73e24e9bd pbulk-0.49: Fix a bug in the computation of the restricted subset. 2012-05-20 20:12:02 +00:00
joerg
4ff3985282 pbulk-0.45: make order function stable 2012-03-19 12:17:15 +00:00
joerg
3fc8d211eb Shut up cast warning. 2012-01-19 18:53:32 +00:00
joerg
4900ea76d8 pbulk-base-0.44: Fix hash function to actually do proper hashing.
Do some further tweaking to improve matching by storing string size.
While here, add the necessary .WAIT to allow parallel builds.
2011-11-27 19:53:30 +00:00
joerg
eb1b3b9290 Simplify to not trigger non-literal format string warnings. 2011-09-24 12:58:55 +00:00
joerg
b7e0ba370b pbulk-base-0.43: Explicitly re-run make clean after create-usergroup, if
it was run before configure. This ensures that the work directory gets
the correct owner. Fixes strange error in qmail build.
2011-09-21 11:55:15 +00:00
seanb
69f6c2d377 - pass fullpath in argv[0] when pkg-scan spawns bmake so that
the same gets inherited across a sub make.
2011-03-06 02:23:32 +00:00