Commit graph

696 commits

Author SHA1 Message Date
Vasil Dimov
101df1b468 Use echo instead of printf because external commands cannot be executed
with very long arguments (>400000 characters).

The problem reveals for example if
/usr/ports/Tools/scripts/rmport -d print/ghostscript-gnu
is executed - it does
printf "%s\n" "... 451109 chars ..."

Spotted by:	rafan
2007-03-28 20:39:18 +00:00
Mark Linimon
43ad8e0f95 Add a column for 'build logs'. This is larger than the number of the
packages due to packages being trimmed by RESTRICTED.

While here, note that the 'missing' column will be off by the number of
duplicates in the other columns.  This happens when partial builds are
restarted.
2007-03-23 05:49:49 +00:00
Mark Linimon
9d6f970760 Workaround for the fact that 4/ports is no longer populated on pointyhat. 2007-03-09 02:43:55 +00:00
Vasil Dimov
eed3828ab1 * Run cvs update just before cvs commit to sync a potentially changed files
in the repository. Suggested by: gabor@
* Fix typo in the output
2007-02-19 07:24:36 +00:00
Kris Kennaway
7379c7f034 Increase resource limits to 400MB filesize and 2 hours CPU limit per
process.  Thankyou openoffice!

Pass in the jail IP address in the JAIL_ADDR environment variable
2007-02-18 09:05:28 +00:00
Kris Kennaway
ae0d1702e9 Default to -nocopy when using -norsync 2007-02-18 09:03:52 +00:00
Kris Kennaway
f400f2bb03 Also filter out gconf leftover files from /usr/local as well as /usr/X11R6.
Set DISPLAY to the IP address instead of using the :<...> implied form.
This is required for jails.
2007-02-18 09:03:21 +00:00
Kris Kennaway
ac6a452879 Don't require arch to be passed in on the command line, query it using
uname
2007-02-18 08:59:51 +00:00
Kris Kennaway
b21c917ce8 Don't play silly games trying to guess the arch, we are passed it in on
the command line
2007-02-18 08:59:22 +00:00
Kris Kennaway
bc7eeeee96 Increase global build timeout to 100 hours 2007-02-18 08:58:46 +00:00
Kris Kennaway
487025d7c8 Improved sanitization of the build environment 2007-02-18 08:58:24 +00:00
Kris Kennaway
da57eeaeb0 Don't require an /etc/arch file, we can obtain the information from uname 2007-02-18 08:58:07 +00:00
Kris Kennaway
d48df213cd Also attempt to clean /root/.ccache in case it is in use. When cleaning
on a machine that has use_md_swap=1, allow for the possibility of reusing
a md between builds if md_persistent=1.  This requires a patch from pjd
to support BIO_DELETE in md devices, but it is a big optimization when
it can be used.
2007-02-18 08:57:20 +00:00
Kris Kennaway
21c449a7fa Index building needs to happen before prunefailures is run, otherwise it
will completely erase the list.

When using -continue, don't append to the duds.errors, we don't want to
preserve the old cruft from a previous build
2007-02-18 08:55:39 +00:00
Kris Kennaway
56b6a0b170 Increase cleanup timeout to 5 days from 48 hours, the openoffice builds
now regularly take longer than this :(
2007-02-18 08:53:21 +00:00
Mark Linimon
e472b6f28c Fix late typo in previous commit. 2007-02-14 08:24:23 +00:00
Mark Linimon
385bfc1533 Eliminate some false positives for missing_header, sometimes seen in the
configure step.
2007-02-14 04:16:30 +00:00
Mark Linimon
b0904b6955 Combine all like terms to get another 10% speedup in processing time.
There is no change in any of the individual terms; this is merely a
rearrangement.

This change undoes what I was trying to do back in 2004 of breaking up
each individual test into a grep, for readability.  The performance of
the script has continued to suffer as new greps were added over time,
to the point where this is now a bad tradeoff.
2007-02-13 21:58:21 +00:00
Mark Linimon
f95f03392e Move two more cases into the 'uncommon' section. 2007-02-10 09:19:24 +00:00
Mark Linimon
87143d71d6 Append one character to the gcc4 case (missed during cut-and-paste). 2007-02-10 06:59:13 +00:00
Mark Linimon
8bff98fdb9 Move the uncommon cases below the common ones. A 10% improvement on large
directories, but a 5% loss on smaller ones.

No code changes (yet) except for the deletion of one duplicate
("fetch: transfer timed out" -> "fetch_timeout".
2007-02-10 06:57:53 +00:00
Mark Linimon
31e52eb01c Remove the other 2 cases of apxs. 2007-02-09 21:49:11 +00:00
Mark Linimon
4dd06f27ed Speed up by removing the following obsolete tags:
alignment apxs assert CATEGORIES cgi-bin forbidden stl
2007-02-09 20:55:43 +00:00
Mark Linimon
db8225268f Add a new case, 'gcc4', to try to catch the majority of the exceptions that
we are seeing on the latest -current runs.  Saves 40 seconds of time on
those runs, at the cost of 4 on the others.
2007-02-09 04:50:10 +00:00
Mark Linimon
4a1e61ae9c Fix up the code for amd64-6-exp; add a column to label builds that
still have processes running, and add that into the highlight logic.
2007-02-07 08:00:20 +00:00
Kris Kennaway
2c759cf3d0 Retire PORTOBJFORMAT 2007-02-01 03:28:03 +00:00
Erwin Lansing
f3f3875210 Drop the build on RELENG_4 2007-01-30 14:49:21 +00:00
Vasil Dimov
92615ddfc4 A bunch of cosmetic changes - add one empty line to make the output more
readable and use double quotes everywhere.
2007-01-26 14:25:39 +00:00
Vasil Dimov
a62c886fca Make output messages more useful 2007-01-26 10:19:23 +00:00
Vasil Dimov
0d451e0598 * Make it possible to skip existing dependencies and ports references in LEGAL
and continue with removal anyway. Requested by miwi@
* Pipe dependencies information (if any) through a PAGER because INDEX lines
  are very long and hard to read when wrapped
2007-01-19 15:49:49 +00:00
Mark Linimon
c43f8047ea Eliminate more false positives for install_error. Very noticeable on
latest gcc test build.
2006-12-25 18:09:34 +00:00
Vasil Dimov
59a026b0f1 Query Gnats for PRs by using the query-pr command on freefall instead of the
web-interface becase the later is not reliable.
2006-12-20 13:18:25 +00:00
Vasil Dimov
e2f1d375a7 Add check for existing non-closed PRs related to the port being removed.
If any are found then ask if the port should be skipped from removal or
removed regardless of the PRs.
2006-12-13 07:32:58 +00:00
Dirk Meyer
3ac2f4749e - add check sysvipc
happens when security.jail.sysvipc_allowed=0
2006-12-03 17:59:09 +00:00
Mark Linimon
2830a3d3df Work around the fact that 5-exp, these days, is really another 6-exp,
except in disguise.
2006-11-25 15:51:02 +00:00
Erwin Lansing
596b15845d Replace a simple call to localtime() to strftime() to include the
timezone.
2006-11-23 14:04:52 +00:00
Erwin Lansing
bdbae3ea52 eik@ has been inactive for quite some time and as I am running
these scripts on the cluster, transfer maintainership of these
to myself.
2006-11-23 12:16:59 +00:00
Erwin Lansing
6e65d26f6e Include a time when the script was started in the mail templates.
This script can sometimes take several hours to run on builder,
and thus leading to confusing of why it still reports an error
that was fixed in cvs some time ago.  Including the time when
the ports tree was updated should reduce some of this confusion.
2006-11-23 11:59:04 +00:00
Vasil Dimov
9125407be5 Add deprecated reason to the output of -F 2006-11-02 09:20:10 +00:00
Vasil Dimov
e1bcb99398 * Create custom commit message template and populate it with the ports
to be removed, possibly with the expiration date and deprecated reason
* If port is not marked for expiration than put "Removed" in ports/MOVED
  entry instead of "Has expired"
* Implement -a option to remove all expired ports
* Ask if the cvs diff output should be recreated/reviewed again thus
  giving the committer a chance to edit files by hand and view diff
  results afterwards
* Cosmetic changes
2006-11-01 09:57:36 +00:00
Vasil Dimov
1854c2ed1d When checking for dependencies of foocategory/barport also find constructs
like .../barport/something e.g. expect either space, slash or eol after
port's name
2006-10-05 10:40:29 +00:00
Mark Linimon
3c741dc25b Since we already have the data from the grep, go ahead and make the 'latest
log' cell a link to it.  My weak awk/sh skills are evident here, but it
does the job.
2006-09-23 07:44:34 +00:00
Mark Linimon
c5e446540c Add links to cvsdone and INDEX files. Add some whitespace. 2006-09-23 05:39:53 +00:00
Vasil Dimov
800d19da74 When checking dependencies also look for portname references in Mk/*.mk
in addition to */*/Makefile* and ignore references in comments
2006-09-14 09:13:39 +00:00
Kris Kennaway
81aca5b157 * Back up duds to duds.old before, not after we create the new one
* Add more XXX comments for future work

* Only record a cvsdone timestamp if we updated cvs

* When building with -trybroken, it's safe (and desirable) to run the
  prunefailure script

* Reorganise a few things for better parallelism

* Instead of keeping a duplicate copy of the previous logs and errors
  under bak/, just store a symlink to the archival location

* When doing an incremental build, also cycle out the old logs to avoid
  broken links on the website (the logs from the previous build are
  removed until the packages are rebuilt).  Use cpio to create
  hardlinked copies of the previous logs.  XXX when these are bzipped
  by cron to save space the links will be broken and it might actually
  take more space.

* Don't bother bunzipping old logs, now that the processlogs scripts
  can handle it.  This was a waste of time anyway since they'd all be
  rebzipped by the next nightly cron job.

* When the build is complete, stash a copy of the restricted ports in
  bak/restricted/ before deleting them from packages/, and restore from
  here when doing an incremental build to avoid needlessly rebuilding
  them each time.
2006-09-14 05:43:23 +00:00
Kris Kennaway
b7cf9de7e5 * When calculating the IP address to use for the jail, don't use
127.0.0.0 or 127.0.0.1

* Don't use chroot to mount the linprocfs, or it won't be visible
  within the jail.
2006-09-14 05:33:12 +00:00
Kris Kennaway
8dcaefb8ab * Support bzipped logfiles
* More robust extraction of the header values (copes with the addition of
  the build uname to the header)
2006-09-14 05:30:04 +00:00
Kris Kennaway
db6e3408a5 * If .force exists, rebuild index unconditionally
* Support .log.bz2 files

* Clarify that BROKEN ports are not frequently rebuilt so probably
  won't appear
2006-09-14 05:26:08 +00:00
Kris Kennaway
d35698c80e Correct typo in previous commit 2006-09-14 05:24:31 +00:00
Kris Kennaway
57407fb769 * Drop alpha support
* Increase sparc64 build timeout to 24 hours (we have so few build
  machines that we cannot afford to tie them up for longer)

* Increase other arch build timeout to 100 hours (hello openoffice!)

* If we successfully build a formerly broken package, touch errors/.force
  which will kick off a rebuild of the html files
2006-09-14 05:24:09 +00:00