Commit graph

390 commits

Author SHA1 Message Date
Akinori MUSHA
ac6314f977 Add sunshar, a "secure unshar" for ports committers, which:
- Does not execute unknown commands nor call sh(1) at all.
  - Does not overwrite existing files by default.
  - Does not extract files into upper directories.
  - Does have a dry run (-n) flag to see what would have been extracted.
  - Does have a strip (-p N) flag to strip any number of levels from
    pathnames.

It (so far) only supports shell archives made with BSD shar.
2004-02-28 14:29:09 +00:00
Brian Feldman
d7e662de4c Update "plist" to understand the rest of the mtree(5) file format,
thus fixing the extra-@dirrm-problem once the base mtree files
document the extra symlinks that are part of the local/etc. trees.
2004-02-27 21:01:02 +00:00
Joe Marcus Clarke
cc72b419cc Fix up the ordering and remove some duplicates so the resulting summary is
more accurate:

* The tests for "Cannot stat", "can't cd", and "tar command failed" are moved
  to the bottom.  This will sacrifice a little bit of performance for a gain
  in accuracy
* The tests for "configuration errors" needed to be combined and tweaked to
  better identify errors that are architecture-specific (usuallly the
  "all pointers are ints" assumption)
* The detection of chown was buggy
* There were some duplicate test cases
* As an experiment, another test for dependency problems is added

PR:		61914
Submitted by:	linimon
2004-02-04 05:31:52 +00:00
Alex Dupre
0374da0b6e - Fix synopsis
- Add 'ports/' PR category to commit log

Approved by:	will
2004-01-23 07:28:54 +00:00
Joe Marcus Clarke
377ca431d9 Comment out the munmap reason since it is quite unlikely this will be
encountered again, nad having it in there slows performance.  However,
I'm leaving it in the file in case a bad bindist slips back in, and it
becomes convenient to uncomment this for purposes of seeing what build
failures are cluster-related.

Requested by:	kris
2004-01-21 16:11:18 +00:00
Joe Marcus Clarke
83c1f7ffe2 Add domakedescribe and doportlint, two scripts that iterate over the ports
tree, and run "make describe" and portlint respectively.  They can be useful
as automated linting tools.

PR:		59226
Submitted by:	linimon
2004-01-19 22:35:58 +00:00
Joe Marcus Clarke
5b279805c7 * Refactor processlogs so that new error types can be added easily to a new
processonelog script, that contains all the per-errorlog logic [1]
* Add new error checks, one for detecting CPU problems, and the other for
  checking for broken libgnugetopt support [2]
* Add a new "munmap" error type to check for broken bindists
* Add imake and pthread detection to processonelog [3]
* Add errortype column to the bento "New Build Failures" report [4]

PR:		50258 56859 [1]
		54406 [2]
		57067 [3]
		59272 [4]
Submitted by:	linimon [1] [2] [3] [4]
2004-01-19 22:30:53 +00:00
Joe Marcus Clarke
63f09d3369 Add security-check.awk, a more efficient implementation of the ports
system's security checking algorithm.  This will be used in the upcoming
changes to bsd.*.mk.

PR:		55331
Submitted by:	Eugene M. Kim <ab@astralblue.com>
2004-01-19 22:19:00 +00:00
Joe Marcus Clarke
24f64c924d * Add support for linprocfs (needed for JDK ports) [1]
* Be smarter about adding directories to ldconfig
* Add code to test package integrity [1]

Submitted by:	kris [1]
2004-01-19 22:13:17 +00:00
Joe Marcus Clarke
5b6ccde0d9 Use editors/openoffice-1.1 instead of editors/openoffice since the latter is
now gone.
2004-01-15 21:56:23 +00:00
Dmitry Sivachenko
cb132627e5 When suggesting to add new port's submitter to Contributors' List,
also print the exact location of the file to checkout.
This is for those who rarely adds new ports and do not remember the
location of Additional FreeBSD Contributors article.

Approved by:	will
2004-01-07 20:03:52 +00:00
Pete Fritchman
6160a79b6c Refactor how we format the autofill message. With the slightly questionable
Perl before, sometimes we would word wrap too soon.  Now we should never
generate a line more than 72 characters long (but as close to 72 characters
long as we can without breaking up a word).

Approved by:	will (maintainer)
2004-01-06 06:04:31 +00:00
David E. O'Brien
5dda2933f1 There is nothing "future" about 'addport'. 2004-01-02 23:27:29 +00:00
Dmitry Sivachenko
75122bde71 Use 'make master-sites-all' instead of 'make -V MASTER_SITES' to obtain the list
of master sites.
Before that %SUBDIR% was not expanded and the resulting URL was malformed.

L-o-o-o-ng maintainer timeout waiting for review of a slightly different
solution.
2003-12-17 10:28:32 +00:00
Dag-Erling Smørgrav
cc1020551b fetch(1)'s -b and -t options were deprecated years ago, so stop using them. 2003-11-12 15:09:12 +00:00
Kris Kennaway
a36c5cd9ad Condense the table a bit 2003-10-13 06:33:04 +00:00
Kris Kennaway
2f9f9b16c8 The newfailure file is no longer updated by builds 2003-10-13 02:59:19 +00:00
Kris Kennaway
0c4ee12a72 Script for migrating from old-style to new-style failure log file. 2003-10-13 02:58:38 +00:00
Kris Kennaway
cc8e11aa6b * newfailure is no longer updated, no need to prune it
* Update failure file format with both original and latest failure date
2003-10-13 02:56:21 +00:00
Kris Kennaway
f1200b6ecc * Generate newfailure file (sorted list by original failure date) from failure
* Enhance HTML output to include both original and latest failure date, and
  number of times the build has failed.
2003-10-13 02:54:56 +00:00
Kris Kennaway
6c56f2eb95 * Try to be more careful when writing the failure file in case the disk
is full
* The newfailure file is no longer maintained, but generated as-needed
  by the processfail script
* Update format of failure file (records both initial failure date and
  most recent failure date)
2003-10-13 02:52:58 +00:00
Kris Kennaway
e444895601 Add a script that prunes the contents of the failure and newfailure files
of stale entries (removed ports, ports listed in duds that were mistakenly
built, malformed entries) and refreshes the version of entries to the
latest in INDEX.  This must be run under lockf (see the comments in the
script) to avoid racing with portbuild which also tries to write to
these files.
2003-10-13 00:06:09 +00:00
Alexander Nedotsukov
23ee68125d Fix -l option comment removing obsolete pkg-comment reference.
Approved by: will
2003-09-29 02:39:50 +00:00
Kris Kennaway
b815980215 Teach this script about different architectures. 2003-09-12 20:50:44 +00:00
Kris Kennaway
6e13e8bdb5 Add amd64 to the list of architectures to poll. 2003-09-12 20:49:08 +00:00
Kris Kennaway
6ee0cd092e Add a couple of amd64 failure messages. 2003-09-12 20:48:28 +00:00
Kris Kennaway
7052589b03 Remove some ldconfig -R's that were apparently confusing things, coalesce
some ldconfig -m's into one command, and run buildscript niced in the
chroot build case, not just the (currently unused) jailed case.
2003-09-12 20:47:51 +00:00
Kris Kennaway
7bc2b19585 Set PACKAGE_BUILDING before making the duds file to prevent listing of
ports that are buildable conditionally on this variable.
2003-09-12 20:44:50 +00:00
Kris Kennaway
71769ad1c7 Export MASTER_SITE_OVERRIDE with DIST_SUBDIR correctly escaped 2003-09-12 20:43:09 +00:00
Kris Kennaway
d5a1ecd1eb Catch up to makefile changes: build in etc/ before trying to install
from it.

Submitted by:	ru
2003-09-12 20:42:14 +00:00
Mathieu Arnold
dd5899bd4d When using addport on freefall, there's no need to ssh freefall once more to
use modulesupdate.

Approved by:	will
2003-09-02 15:33:46 +00:00
Kris Kennaway
d6e37c8332 Add a -fetch-original switch to dopackages that fetches the distfiles from
the listed MASTER_SITES instead of ftp-master.  Pass the FETCH_ORIGINAL
environment variable to pdispatch and as a command-line switch to
portbuild.
2003-05-18 00:04:28 +00:00
Kris Kennaway
ce395d3474 Only transfer the build distfiles to bento if requested.
Switch back to chroot builds until I can debug the remaining problems with
jail builds.
2003-05-17 00:27:27 +00:00
Kris Kennaway
116e3b3e87 Pass down the request to keep distfiles if appropriate. 2003-05-17 00:25:59 +00:00
Kris Kennaway
a7924a9308 Add a -distfiles flag to specify that we should retain distfiles for later
processing (e.g. transfer to ftp site).  It was taking up too much disk
space to collect distfiles for 14 architecture/version combinations
(including the backup set from the previous run).

Put the cvsdone files in the arch/branch subdirectory, not arch/.
2003-05-17 00:25:14 +00:00
Kris Kennaway
10e3ce1cdc Switch to polling the clients with netcat to collect load stats, instead
of having the clients scp their loads to bento every 10 seconds.  Fix
some indentation and add some sleeps to make sure the startup script
doesn't run too early in the boot process.
2003-05-17 00:20:53 +00:00
Maxim Sobolev
1ddaf006e0 Previous delta was:
Submitted by:	ru
2003-04-18 13:52:50 +00:00
Maxim Sobolev
a346c15b29 Clean up empty dirs. 2003-04-18 13:51:49 +00:00
Maxim Sobolev
d684f40af6 Speed-up a bit when user keeps his working directories in the ports tree
(doesn't use WRKDIRPREFIX).

Submitted by:	ru
2003-04-08 13:36:45 +00:00
Kris Kennaway
393bb456a9 Update sed pattern used to process logs 2003-04-06 05:42:41 +00:00
Kris Kennaway
26bf92a496 Zap some old/non-useful code
Add some new command-line options:
  * -continue : restart the build without rebuilding ports that have
                already failed
  * -nofinish : don't run the post-processing steps when the build finishes
  * -finish : run the post-processing steps only
Reorder some code sections appropriately
2003-04-06 05:40:27 +00:00
Edwin Groothuis
452a17f4c0 This tool parses the output of kdump to generate a list of added
and removed files.

This can be used as the basis of a pkg-plist, or even just for
curiosity about what files something is touching.

Fairly raw at the moment, and doubtless inefficient, but it should
make a useful tool for port creators.

PR:		ports/47424
Submitter:	Daniel O'Connor <doconnor@gsoft.com.au>
2003-04-04 12:20:54 +00:00
Joe Marcus Clarke
bd948000d0 Sort the non-dirrm entries, and reverse sort the dirrm entries.
Reviewed by:	green
2003-03-28 05:08:03 +00:00
Kris Kennaway
e006d25643 - Define __MAKE_CONF to allow per-arch make.conf files in buildworld
- Set the UNAME_* variables to make use of the override support in uname(1)
  This allows us to get rid of the uname shell script in the build chroots
- Collect some variables that are probably old and mouldy, for later GCing
- If FETCH_ORIGINAL is set in the environment, don't fetch from ftp-master
2003-03-23 01:26:42 +00:00
Will Andrews
7ac6ca52e1 Make modulesupdate actually work in light of split. You can't use a
CVSROOT that's readonly.
2003-03-02 17:29:12 +00:00
Peter Wemm
796330dcfb Update for post-repo-split. s/ncvs/pcvs/ so that the default root is
pcvs.freebsd.org:/home/pcvs
2003-02-28 19:49:31 +00:00
Steve Price
c2e4cc1ce9 Do a better job of stating which port we had problems with while
mapping directories to package names.
2003-02-24 16:07:07 +00:00
Mario Sergio Fujikawa Ferreira
2dc2732c98 Another try at fixing the "adding to CVSROOT/modules from remote
hosts (non-freefall)" bug: add '-A' argument to ssh(1) command line
for accessing host cointaining modules file. This should fix the
bug for ssh-agent(1) users. Others can just switch to using
ssh-agent(1).

Approved by:	will (maintainer)
2003-02-23 20:06:06 +00:00
Kris Kennaway
c5150864d9 Instead of pushing the load data to the master with scp every 10 seconds,
just report it via an inetd service.
2003-02-22 22:26:23 +00:00
Kris Kennaway
e0d90467e6 * Allow port builds to be started with a certain niceness ('nice' parameter
in portbuild.conf). [1]

* Build stage 2 builds in a jail instead of a chroot.  This allows us to
  detect ports that attempt IP communication during the build, as well as
  allowing clean termination of the port build (packages built in a chroot
  can leave processes hanging around after the build finishes).  There
  are some caveats with this approach which will be worked around in a
  future commit.

Requested by:	peter [1]
2003-02-22 22:25:12 +00:00