Commit graph

245 commits

Author SHA1 Message Date
Joe Marcus Clarke
cc72b419cc Fix up the ordering and remove some duplicates so the resulting summary is
more accurate:

* The tests for "Cannot stat", "can't cd", and "tar command failed" are moved
  to the bottom.  This will sacrifice a little bit of performance for a gain
  in accuracy
* The tests for "configuration errors" needed to be combined and tweaked to
  better identify errors that are architecture-specific (usuallly the
  "all pointers are ints" assumption)
* The detection of chown was buggy
* There were some duplicate test cases
* As an experiment, another test for dependency problems is added

PR:		61914
Submitted by:	linimon
2004-02-04 05:31:52 +00:00
Joe Marcus Clarke
377ca431d9 Comment out the munmap reason since it is quite unlikely this will be
encountered again, nad having it in there slows performance.  However,
I'm leaving it in the file in case a bad bindist slips back in, and it
becomes convenient to uncomment this for purposes of seeing what build
failures are cluster-related.

Requested by:	kris
2004-01-21 16:11:18 +00:00
Joe Marcus Clarke
5b279805c7 * Refactor processlogs so that new error types can be added easily to a new
processonelog script, that contains all the per-errorlog logic [1]
* Add new error checks, one for detecting CPU problems, and the other for
  checking for broken libgnugetopt support [2]
* Add a new "munmap" error type to check for broken bindists
* Add imake and pthread detection to processonelog [3]
* Add errortype column to the bento "New Build Failures" report [4]

PR:		50258 56859 [1]
		54406 [2]
		57067 [3]
		59272 [4]
Submitted by:	linimon [1] [2] [3] [4]
2004-01-19 22:30:53 +00:00
Joe Marcus Clarke
24f64c924d * Add support for linprocfs (needed for JDK ports) [1]
* Be smarter about adding directories to ldconfig
* Add code to test package integrity [1]

Submitted by:	kris [1]
2004-01-19 22:13:17 +00:00
Joe Marcus Clarke
5b6ccde0d9 Use editors/openoffice-1.1 instead of editors/openoffice since the latter is
now gone.
2004-01-15 21:56:23 +00:00
Kris Kennaway
a36c5cd9ad Condense the table a bit 2003-10-13 06:33:04 +00:00
Kris Kennaway
2f9f9b16c8 The newfailure file is no longer updated by builds 2003-10-13 02:59:19 +00:00
Kris Kennaway
0c4ee12a72 Script for migrating from old-style to new-style failure log file. 2003-10-13 02:58:38 +00:00
Kris Kennaway
cc8e11aa6b * newfailure is no longer updated, no need to prune it
* Update failure file format with both original and latest failure date
2003-10-13 02:56:21 +00:00
Kris Kennaway
f1200b6ecc * Generate newfailure file (sorted list by original failure date) from failure
* Enhance HTML output to include both original and latest failure date, and
  number of times the build has failed.
2003-10-13 02:54:56 +00:00
Kris Kennaway
6c56f2eb95 * Try to be more careful when writing the failure file in case the disk
is full
* The newfailure file is no longer maintained, but generated as-needed
  by the processfail script
* Update format of failure file (records both initial failure date and
  most recent failure date)
2003-10-13 02:52:58 +00:00
Kris Kennaway
e444895601 Add a script that prunes the contents of the failure and newfailure files
of stale entries (removed ports, ports listed in duds that were mistakenly
built, malformed entries) and refreshes the version of entries to the
latest in INDEX.  This must be run under lockf (see the comments in the
script) to avoid racing with portbuild which also tries to write to
these files.
2003-10-13 00:06:09 +00:00
Kris Kennaway
b815980215 Teach this script about different architectures. 2003-09-12 20:50:44 +00:00
Kris Kennaway
6e13e8bdb5 Add amd64 to the list of architectures to poll. 2003-09-12 20:49:08 +00:00
Kris Kennaway
6ee0cd092e Add a couple of amd64 failure messages. 2003-09-12 20:48:28 +00:00
Kris Kennaway
7052589b03 Remove some ldconfig -R's that were apparently confusing things, coalesce
some ldconfig -m's into one command, and run buildscript niced in the
chroot build case, not just the (currently unused) jailed case.
2003-09-12 20:47:51 +00:00
Kris Kennaway
7bc2b19585 Set PACKAGE_BUILDING before making the duds file to prevent listing of
ports that are buildable conditionally on this variable.
2003-09-12 20:44:50 +00:00
Kris Kennaway
71769ad1c7 Export MASTER_SITE_OVERRIDE with DIST_SUBDIR correctly escaped 2003-09-12 20:43:09 +00:00
Kris Kennaway
d5a1ecd1eb Catch up to makefile changes: build in etc/ before trying to install
from it.

Submitted by:	ru
2003-09-12 20:42:14 +00:00
Kris Kennaway
d6e37c8332 Add a -fetch-original switch to dopackages that fetches the distfiles from
the listed MASTER_SITES instead of ftp-master.  Pass the FETCH_ORIGINAL
environment variable to pdispatch and as a command-line switch to
portbuild.
2003-05-18 00:04:28 +00:00
Kris Kennaway
ce395d3474 Only transfer the build distfiles to bento if requested.
Switch back to chroot builds until I can debug the remaining problems with
jail builds.
2003-05-17 00:27:27 +00:00
Kris Kennaway
116e3b3e87 Pass down the request to keep distfiles if appropriate. 2003-05-17 00:25:59 +00:00
Kris Kennaway
a7924a9308 Add a -distfiles flag to specify that we should retain distfiles for later
processing (e.g. transfer to ftp site).  It was taking up too much disk
space to collect distfiles for 14 architecture/version combinations
(including the backup set from the previous run).

Put the cvsdone files in the arch/branch subdirectory, not arch/.
2003-05-17 00:25:14 +00:00
Kris Kennaway
10e3ce1cdc Switch to polling the clients with netcat to collect load stats, instead
of having the clients scp their loads to bento every 10 seconds.  Fix
some indentation and add some sleeps to make sure the startup script
doesn't run too early in the boot process.
2003-05-17 00:20:53 +00:00
Kris Kennaway
393bb456a9 Update sed pattern used to process logs 2003-04-06 05:42:41 +00:00
Kris Kennaway
26bf92a496 Zap some old/non-useful code
Add some new command-line options:
  * -continue : restart the build without rebuilding ports that have
                already failed
  * -nofinish : don't run the post-processing steps when the build finishes
  * -finish : run the post-processing steps only
Reorder some code sections appropriately
2003-04-06 05:40:27 +00:00
Kris Kennaway
e006d25643 - Define __MAKE_CONF to allow per-arch make.conf files in buildworld
- Set the UNAME_* variables to make use of the override support in uname(1)
  This allows us to get rid of the uname shell script in the build chroots
- Collect some variables that are probably old and mouldy, for later GCing
- If FETCH_ORIGINAL is set in the environment, don't fetch from ftp-master
2003-03-23 01:26:42 +00:00
Kris Kennaway
c5150864d9 Instead of pushing the load data to the master with scp every 10 seconds,
just report it via an inetd service.
2003-02-22 22:26:23 +00:00
Kris Kennaway
e0d90467e6 * Allow port builds to be started with a certain niceness ('nice' parameter
in portbuild.conf). [1]

* Build stage 2 builds in a jail instead of a chroot.  This allows us to
  detect ports that attempt IP communication during the build, as well as
  allowing clean termination of the port build (packages built in a chroot
  can leave processes hanging around after the build finishes).  There
  are some caveats with this approach which will be worked around in a
  future commit.

Requested by:	peter [1]
2003-02-22 22:25:12 +00:00
Kris Kennaway
c5c0032536 If ${buildworld}=1 in mkbindist.conf, then use the makeworld script to
build world and populate the chroot.  Otherwise, if ${ftp}=1 then
fetch it from the ftp site as before.
2003-02-22 22:22:12 +00:00
Kris Kennaway
2629774416 Simplify the collection of load statistics for the cluster. Loads
are now collected by polling a small server on the client (using netcat)
instead of having the client scp the load files to the master every 10
seconds (!!!)
2003-02-22 22:21:00 +00:00
Kris Kennaway
6f6a583bc7 Store dates in +%s format 2003-02-22 22:19:03 +00:00
Kris Kennaway
4e20fd729d Search for a lot of new failure strings to reduce the number of build
failures listed as '???'.

Submitted by:	Mark Linimon <linimon@lonesome.com>
PR:		www/44919
2003-02-14 09:28:42 +00:00
Kris Kennaway
182d4cc46d Work around broken rand() in -current by changing the way we pick a
random build host.
2003-02-14 09:26:20 +00:00
Kris Kennaway
efc1842637 - If ${ftp} = 0 in mkbindist.conf, then use the makeworld script to build
a world instead.
2003-02-14 09:25:47 +00:00
Kris Kennaway
afda0ec7a9 - Correct usage message
- Don't try and use buildenv, it's useless
- Set TARGET_ARCH instead
2003-02-14 09:24:36 +00:00
Kris Kennaway
04a23345d0 If the port directory contains a file called .keep, then tar up the
${WRKDIR} after the port build completes and copy it to
${arch}/${branch}/wrkdirs/${pkgname}.tbz.
2003-01-24 11:01:37 +00:00
Kris Kennaway
b60d2dcc1e These scripts have been replaced by .c versions that do not require perl. 2003-01-24 05:05:38 +00:00
Kris Kennaway
dda0014b14 - Use ${arch} and rename html files accordingly
- Call processfail to produce 'new port failures' page
- Comment out the 'comparelogs' calls for now until I make them aware
  of architectures that don't have 4.x support
2003-01-24 05:04:16 +00:00
Kris Kennaway
934f3cece0 First cut at a script to process the logfile maintained by 'buildsuccess'
and 'buildfailure' and produce a HTML output listing ports with the date
they became broken.  The output can surely be made more useful (e.g. it
always links to the ${branch}-latest logs, which may not exist when the
build-in-progress has not yet attempted the build of that port).
2003-01-24 05:03:08 +00:00
Kris Kennaway
df64a01f68 These scripts are run when a build completes (successfully or not). They
keep track of the number of times a port has failed to build, resetting
the counter when it builds successfully.  There are still some bugs to be
worked out, but this will be used as the basis for maintainer notification
of port failures.
2003-01-24 05:01:24 +00:00
Kris Kennaway
220758235c Simple script to check the number of packages built on the various
architectures, for a given branch.
2003-01-24 04:59:03 +00:00
Kris Kennaway
a4ad73ca23 Script to automate the process of cvs updating the build tree, performing
the buildworld, installworld and 'make distribute' necessary for preparing
a bindist.
2003-01-24 04:57:21 +00:00
Kris Kennaway
6d119d605f - Use ${arch} 2003-01-24 04:55:31 +00:00
Kris Kennaway
6ab268ded7 Determine client architecture using /etc/arch 2003-01-24 04:55:15 +00:00
Kris Kennaway
069c3c3e0f - Use ${arch}
- Support builds as non-privileged user
2003-01-24 04:54:45 +00:00
Kris Kennaway
55e6f3bab5 Check status of multiple architecture client machines 2003-01-24 04:54:01 +00:00
Kris Kennaway
b715744cfd - Use ${arch}
- Increase timeout to 2 hours (needs to be arch-specific)
- Mount nfs filesystems with nfsv3,intr (the latter so that clients do
  not hang if bento panics)
- Run pnohang.${arch} on clients instead of pnohang
- Support builds as non-privileged user
2003-01-24 04:52:29 +00:00
Kris Kennaway
b26c9f68bd - Use ${arch}
- Increase timeout to 8 hours (this needs to be made per-arch so it
  doesn't overly pessimize fast client machines)
- Support building as a non-privileged user
2003-01-24 04:49:09 +00:00
Kris Kennaway
225546e3a1 - Use ${arch}
- Mount on ${master} instead of localhost
2003-01-24 04:47:17 +00:00