Commit graph

1105 commits

Author SHA1 Message Date
Mark Linimon
3fcbbb8d24 Add some definitions to try to limit the number of times we let builds
fail before we stop.  This should help avoid spamming people's mboxes.
2011-04-22 18:32:13 +00:00
Mark Linimon
9fd443c7ba Allow the top-level build to be destroyed. This is useless for
pointyhat, but is intended for pointyhat-[west|east] to be able to
remove no longer needed specialized -exp runs.  (They remain in the
errorlog archive; they can merely be removed from zfs.)

Replace this test with an anti-foot-shooting measure so that you cannot
remove 'latest' unless you have already removed 'previous'.
2011-03-24 06:24:04 +00:00
Pav Lucistnik
95f63674f3 - Stop caring about src-6 snaps and expire checkout snaps rather more
aggresively
2011-03-21 21:43:58 +00:00
Mark Linimon
068948ee07 Add an error entry for gmake. 2011-03-08 22:03:18 +00:00
Mark Linimon
547dbc0a08 Add a test for gmake 3.82 regressions. (3.82 is not in the tree yet).
While here, move segfault down: sometimes this is a false positive for
a config failure.
2011-03-08 21:53:53 +00:00
Mark Linimon
46a7d368e1 Add an alternate spelling for a link. 2011-03-04 06:11:51 +00:00
Mark Linimon
4a3b759d6b Add an overly-large regexp to isolate "packages that fail to build with
clang".  This will probably need to be trimmed down some so as to not
pessimize processing time.

At this time this change will be restricted to pointyhat-west.
2011-02-27 07:08:01 +00:00
Mark Linimon
f7fd413b58 One more pass through this file to bring it up to the latest processonelog:
- deprecate assert, chown, perl5, python, stdio, sysvipc, varargs

 - add the existing nested_declaration, termios, utmp_x

While here, fix formatting.

Pointy hat to:	linimon, for letting this get so far out of sync
2011-02-27 06:55:38 +00:00
Mark Linimon
e4a1d6f3b8 For efficiency's sake, deprecate the following error types, which we no longer see:
chown, perl5, python, stdio, struct changes, sysvipc, USE_XLIB, varargs

Add the following new error types that we are now seeing:

  clang-bug, cpusetsize, sem_wait

Tweak the definitions for linker_error and threads to be more accurate.
2011-02-27 06:33:45 +00:00
Mark Linimon
7b36c962d5 Sheesh. The errors "f77" and "uname" were never even documented. Add
the into the section for obsolete errors.
2011-02-27 06:16:01 +00:00
Mark Linimon
0b94659e59 Move some of the error types that were removed from the script some time
ago to the "obsolete" section.
2011-02-27 06:01:20 +00:00
Mark Linimon
5d2451c2a6 Add the following new error classifications, to sync with upcoming work
to processonelog (not yet committed):

  clang
  clang-bug
  cpusetsize
  sem_wait

The former two will show up if an -exp run is done with clang as the default
ports compiler, instead of gcc.  The latter two seem to be ports regressions
in 9-CURRENT.
2011-02-24 22:28:22 +00:00
Mark Linimon
2fc5780a86 Remove 6.x links since it is EOL. (For now, the error logs remain).
While here, change the misnomer Full to Previous, but leave the links
alone until we upgrade pointyhat to the latest codebase.
2011-02-22 03:07:11 +00:00
Erwin Lansing
90b43d628c Make table headers more selfexplanatory
Submitted by:	gerald
Feature safe:	yes
2011-02-05 16:42:00 +00:00
Erwin Lansing
7b3fc2c221 7.1 runs EOL today, start building against 7.3
Feature safe:	yes
2011-01-31 09:29:22 +00:00
Mark Linimon
e93f4465dc Change the "unclean build" handling case to not retry. Previously, it
was handled the same as "waiting for chroot" and retried.  In certain
circumstances (e.g. a prerequisite package shown as being avaialable
when it really wasn't), this would cause a package build to loop
forever.

Note to future generations: I did not write this code.

Feature safe:	yes
2011-01-26 10:41:53 +00:00
Mark Linimon
4ddc8569cb Fix typo in fixed-up tar command to suppress a whoooole lot of junk
output on package builds.

Pointy hat:	self
Feature safe:	yes
2011-01-24 01:58:21 +00:00
Mark Linimon
2d9bb86df0 Add an entry for the 'dirent' error.
Noticed by:	Anton Shterenlikht
Feature safe:	yes
2011-01-24 00:44:53 +00:00
Mark Linimon
c53373e936 Add anti-foot-shooting measure.
Feature safe:	yes
2011-01-23 03:06:44 +00:00
Mark Linimon
883391196b Export BACKUP_FTP_SITE for the generalized make.conf files in
bindist-*.tar (so that they can be shared between pointyhat and
pointyhat-west without modification.)

Feature safe:	yes
2011-01-23 02:39:54 +00:00
Mark Linimon
d2628e1ceb Add CLIENT_BACKUP_FTP_SITE as part of a generalization push between
bindist-*.tar files on pointyhat and pointyhat-west.

Feature safe:	yes
2011-01-23 02:34:58 +00:00
Mark Linimon
be8848c7d8 Force the copy of portbuild.* files as files, not symlinks. Adjust
the comment for bindist-* to match.

Feature safe:	yes
2011-01-23 02:26:14 +00:00
Erwin Lansing
4f169b63af Revert to RELENG_7_1 after consultation with re@
Feature safe:	yes (this time for real)
Approved by:	portmgr,re
2011-01-18 15:57:00 +00:00
Erwin Lansing
8e2ba39faf Bump 7-stable to RELENG_7_4 due to a major library version increase
in libcrypto.

Feature safe:	yes (really, really not, but we don't have any other option)
2011-01-14 22:36:32 +00:00
Erwin Lansing
b40874d29c rmdir(1) does not take -f. 2011-01-05 18:34:17 +00:00
Erwin Lansing
fa2e0c2cef Drop support for 6.x and bump 8.x to 8.1-RELEASE 2010-12-21 08:25:08 +00:00
Mark Linimon
6dad2ee054 Remove debugging code that crept in. 2010-12-17 01:34:38 +00:00
Mark Linimon
6f337f74cd Refactor the client-side. It turns out that the evaluation of param.h
was being done before the src tree had been mounted.

This was not a problem in the old codebase, since it simply got the
wrong src tree to start with.

This actually simplifies the code.
2010-12-16 07:38:18 +00:00
Mark Linimon
b0a015135a If the logfile was not correctly copied from the client back to the server,
do not attempt to process it.
2010-12-16 07:34:58 +00:00
Mark Linimon
2935ba5fee Make sure that PKGSUFFIX and LOCALBASE are really defined. (Things work
_very_ badly if they aren't.)

Also, track the refactoring of buildenv so that the proper src tree
bits are picked up.
2010-12-16 07:32:22 +00:00
Erwin Lansing
34b70fee7a Drop support for FreeBSD 6.x. 2010-12-14 14:16:37 +00:00
Mark Linimon
5bc0ea6f26 common.conf has to be copied over as well as client.conf. 2010-12-09 00:50:02 +00:00
Mark Linimon
28905d9035 Refactor some variables that need to be in sync between the server-side
and client-side definitions into common.conf.

While here, slide the 7-stable release to 7.3.  This was driving me
crazy while trying to debug the INDEX and duds problems.
2010-12-01 02:38:04 +00:00
Mark Linimon
5cfbfdffd1 It turns out that some variables have to be shared between the server-side
definitions and the client-side definitions.

While here, add ARCHS_SUPPORTING_COMPAT_IA32, which is needed to get
linux emulation ports to be properly detected on head nodes that are
build from first principles (e.g. !pointyhat).
2010-12-01 02:35:20 +00:00
Mark Linimon
c836d9acad Canonicalize the use of SRC_BASE to fix INDEX and duds builds on head
nodes that don't have /usr/src.  On pointyhat, this "just happens to
work"; on a cleanly installed system like pointyhat-west, it didn't.

Add overrides for Linux compatibility (again, it "just happened to work"
on pointyhat).

Move the code that sets PORTSDIR and SRC_BASE to the server side only.
The code that overrides OSVERSION, OSREL, and BRANCH _must_ remain in
the common code.
2010-12-01 02:32:49 +00:00
Mark Linimon
ac775267a0 Canonicalize the use of SRC_BASE to fix INDEX and duds builds on head
nodes that don't have /usr/src.  On pointyhat, this "just happens to
work"; on a cleanly installed system like pointyhat-west, it didn't.
2010-12-01 02:30:14 +00:00
Mark Linimon
d072a14cd7 Make an rm command quieter; add some debug comments. 2010-12-01 02:28:19 +00:00
Mark Linimon
08037129f0 Although I was going to try to avoid it, it turns out that it is
impossble to have merely "server.conf" and "client.conf" control
everything on a head node.  Some pieces must be refactored into
"common.conf".
2010-12-01 02:27:35 +00:00
Mark Linimon
03f4604fe0 Rename internal variables to correspond to their actual uses; automatically
create the links for the webserver; add some comments.
2010-12-01 02:24:35 +00:00
Mark Linimon
439a77bd90 Add some debug code to attempt to work around the "too many stale chroots"
problem, until it can be correctly understood and fixed.
2010-12-01 02:23:14 +00:00
Mark Linimon
93015147a5 Add a debug setting (commented out). 2010-11-29 05:08:50 +00:00
Mark Linimon
22443fff64 Move the override of PKG_DBDIR to the right place. This keeps INDEX
from being contaminated by the packages installed on pointyhat-*.
2010-11-29 03:30:17 +00:00
Pav Lucistnik
309d07b77b - Switch to SHA256 checksums
PR:		ports/152358
Submitted by:	Volodymyr Kostyrko <c.kworr@gmail.com>
2010-11-18 11:28:05 +00:00
Mark Linimon
695771c5f0 Retire the broken fenner distfile survey in favor of the new one
being maintained by ehaupt.
2010-10-07 13:13:35 +00:00
Mark Linimon
ab41033501 Attempt to shut down some whining when the resultant script is run. 2010-10-07 10:25:32 +00:00
Philip M. Gollucci
4f0ae25a44 - s/make/may/
Reported by:    wxs
2010-09-23 17:22:45 +00:00
Philip M. Gollucci
71e4661dfa -use a tab not a space 2010-09-22 19:02:47 +00:00
Philip M. Gollucci
6d823cc849 /8/9/ as the default 2010-09-22 18:58:18 +00:00
Philip M. Gollucci
2070dd3325 blanket approval 2010-09-22 18:56:44 +00:00
Philip M. Gollucci
9a38c1b8b9 check for repocopy snafus 2010-09-14 06:13:10 +00:00
Mark Linimon
324dff7a25 Fix it for real this time. 2010-08-16 23:59:32 +00:00
Mark Linimon
f149057e10 Restore the display of statistics for non-mainline runs. 2010-08-16 09:17:05 +00:00
Mark Linimon
8153ebd48c Add some missing error handling. 2010-08-16 06:22:37 +00:00
Mark Linimon
856a21b160 Handle yet another error case. 2010-08-15 09:16:51 +00:00
Mark Linimon
ff7f1257bf Correct some misleading documentation. 2010-08-10 05:39:57 +00:00
Mark Linimon
3a3eb397af Fix braino from production. 2010-08-02 07:11:11 +00:00
Mark Linimon
2e418d3548 Fix mishandling of root/all case. 2010-07-30 03:18:21 +00:00
Mark Linimon
2c4d0a67a8 Push PACKAGE_BUILDING and MALLOC_OPTIONS up a level.
Feature safe:	yes
2010-06-30 14:51:47 +00:00
Mark Linimon
aadc9bb5d1 Remove now-redundant setting of PACKAGE_BUILDING.
Feature safe:	yes
2010-06-30 14:50:06 +00:00
Mark Linimon
bcb18c7e0b Fix up usage of buildenv.client to deal with overenthusiastic
refactoring.  Pick up new CLIENT_MALLOC_OPTIONS parameter.  Clean
up comments.

Feature safe:	yes
2010-06-30 14:48:57 +00:00
Mark Linimon
937750f8bc Add CLIENT_MALLOC_OPTIONS.
Feature safe:	yes
2010-06-30 14:46:27 +00:00
Mark Linimon
bc2d32d595 The previous refactoring was too agressive. SRCBASE and friends are used
on both the client side and server side.

Pointy hat to:	self
Feature safe:	yes
2010-06-30 14:43:12 +00:00
Mark Linimon
090587b616 Correct the URLs; 'http://' is not included in MASTER_URL.
Feature safe:	yes
2010-06-28 01:59:25 +00:00
Mark Linimon
08115cf45a Document some hard-coded stuff in the scripts.
Feature safe:	yes
2010-06-25 23:45:38 +00:00
Mark Linimon
15fff60e91 A script that can be remotely run on package build clients to attempt to
clean up problems with squid.

Feature safe:	yes
2010-06-25 23:44:39 +00:00
Mark Linimon
2ca917890d Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

NOTE: these scripts are not yet parameterized, so this is WIP.

Feature safe:	yes
2010-06-25 23:43:24 +00:00
Mark Linimon
90089c9f17 Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

Several bugs are fixed and improvements are made:

 - parameterize everything.
 - switch to csup.  (This necessitates pushing the repos down one
   directory level, e.g. ports-head/ports and src/src-8.  However,
   this will give us the flexibility to have e.g. src/src-8.1 in
   the future.)
 - note that the misnomer filename 'cvsdone', which was created
   here, is now changed to '.updated'.

Feature safe:	yes
2010-06-25 23:42:51 +00:00
Mark Linimon
2fe59a537a Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

While here, do some refactoring.

Feature safe:	yes
2010-06-25 23:39:54 +00:00
Mark Linimon
a588885b10 Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

Note the change of the misnomer filename 'cvsdone' to '.updated'.

Feature safe:	yes
2010-06-25 23:38:01 +00:00
Mark Linimon
18d0ec2618 Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

Several bugs are fixed and improvements are made:

 - suppress error message if there are no logs yet.
 - change the misnomer filename 'cvsdone' to '.updated'.
 - fix a bug by un-escaping '_' in the timestamp.

Feature safe:	yes
2010-06-25 23:37:19 +00:00
Mark Linimon
5b3b7d003e Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

While here, fix error messages displayed on new runs.

Feature safe:	yes
2010-06-25 23:31:11 +00:00
Mark Linimon
b88965abda Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

*very* carefully note where the exported variables are consumed.

Several bugs are fixed and improvements are made:

 - the file UNAME_VERSION appears unused, so it is removed.  The
   information is passed in overrides to uname(1).
 - parameterize arch-specific setup code.

Feature safe:	yes
2010-06-25 23:30:20 +00:00
Mark Linimon
2e131db722 Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

Feature safe:	yes
2010-06-25 23:27:16 +00:00
Mark Linimon
2cff86f1e9 Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

Note the removal of the hard-coding of INDEX.N, where N has to be
a single digit, and also have no '.' in it.

Feature safe:	yes
2010-06-25 23:25:36 +00:00
Mark Linimon
338c392806 Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

Note the very special handling of cvs tag.

Feature safe:	yes
2010-06-25 23:24:23 +00:00
Mark Linimon
8784a39301 Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

Fix the sed script to correctly handle '.' in branch directory names.

Feature safe:	yes
2010-06-25 23:23:17 +00:00
Mark Linimon
3d5c2cff29 Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

Gracefully handle the case of INDEX failing to build.  This helps the
calling script to exit instead of spewing errors.

Feature safe:	yes
2010-06-25 23:22:45 +00:00
Mark Linimon
f1c9dc80e7 Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

Add the copying over of client.conf to the clients, and take care
to force the file copy regardless of whether it is a symlink.

Feature safe:	yes
2010-06-25 23:21:46 +00:00
Mark Linimon
6cbd9ecd57 Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

Several bugs are fixed and improvements are made:

 - the name of the journal is changed from 'make' (ew) to 'journal'.
 - 'cvsdate' is replaced by the more accurate name '.updated' and
   documentation adjusted to match.
 - make it more clear that '.updated' means 'ports tree updated'
   instead of 'src tree updated' (although the same filename is
   used for both).
 - correctly handle the general case of non-mainstream branches
   (e.g. "7-exp") without hardcoding "-exp".

Feature safe:	yes
2010-06-25 23:20:14 +00:00
Mark Linimon
31f34112f9 Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

Note: the major change is to require branch as an argument.  The
silly code that expected the branch to be passed via a symlinked
command such as 'dopackages.7' is removed.

Several bugs are fixed and improvements are made:

 - make the separation of 'date' and 'datestamp' clearer.
 - make handling of error conditions (e.g. for a first-time run
   where 'build create' has been forgotten) more obvious.

Feature safe:	yes
2010-06-25 23:16:46 +00:00
Mark Linimon
80e1a07ccb Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

Several bugs are fixed and improvements are made:

 - the name of the journal file is changed from 'make' (ew) to
   'journal'.
 - the 'date' parameter becomes 'datestamp' to delinate the script's
   uses of the date command vs. the parameter.  This is mostly for
   readability.
 - add the -nochecksubdirs option.  This is only useful for restarted
   or incremental runs.
 - refactor the error returns a bit.
 - exit gracefully if no INDEXFILE.
 - fix a bug in the 'packages built' logic that would return -2 if no
   packages were actually built.
 - change the misnamed 'cvsdone' file to '.updated'.
 - clean up the 'task waiting' logic.

Feature safe:	yes
2010-06-25 23:14:13 +00:00
Mark Linimon
f06078517f Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

Note that this script will now figure out 'branches' by itself, thus
removing the special-casing for '-exp'.

Feature safe:	yes
2010-06-25 23:08:14 +00:00
Mark Linimon
21fd819842 Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

Note: it is still not clear to me if this script is currently used.

Feature safe:	yes
2010-06-25 23:05:49 +00:00
Mark Linimon
ecc847e0d6 Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

While here, rework the code a bit to parameterize arch-specific tasks.

Feature safe:	yes
2010-06-25 23:04:53 +00:00
Mark Linimon
1629562d00 Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

While here, carefully document the origin of the values of the
environment variables that are passed in.

Feature safe:	yes
2010-06-25 23:03:11 +00:00
Mark Linimon
381f8cb94b Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

While here, do some cleanup.

Feature safe:	yes
2010-06-25 23:02:09 +00:00
Mark Linimon
75fda7ac40 Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

Several bugs are fixed and improvements are made:

 - the definitions for valid 'arch' and 'branch' are moved to
   server.conf.
 - the script is broken up into two pieces; the old 'buildenv' name
   becomes the server side, and 'buildenv.client' is add for the
   client side.  'buildenv.common' is what you would expect.  This
   makes the separation of what controls what more clear.
 - the concept of 'branch base' is generalized to match any pattern
   postpended with '-', thus removing the specialness of '-exp'.  More
   work remains on the other scripts to best take advantage of this.
 - as a corollary, 'branch' can also have '.' in it, e.g., 6.4.
 - the obsolete variables FTP_PASSIVE_MODE, PKGZIPCMD, and X_WINDOW_SYSTEM
   are removed.

Feature safe:	yes
2010-06-25 23:01:05 +00:00
Mark Linimon
2173088340 Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

Several bugs are fixed and improvements are made:

 - archive directories are created  if they do not exist.
 - the location of ZFS-based directories is generalized.
 - the special string "-exp" disappears.
 - handling of buildid is made more robust.

Feature safe:	yes
2010-06-25 22:55:00 +00:00
Mark Linimon
11ad804e71 Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

While here, fix a but in the handling of the 'all' case.

Feature safe:	yes
2010-06-25 22:51:05 +00:00
Mark Linimon
ae733423e0 Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

This first set of files only gets the *.conf files and some cleanup.

Feature safe:	yes
2010-06-25 22:49:56 +00:00
Mark Linimon
73d56dd444 Variant of the allgohans script that does locking. This has been in
use on pointyhat for a while.

Feature safe:	yes
2010-06-25 22:31:00 +00:00
Mark Linimon
7f02f37b5d Note the files that shouldn't be checked into the repository (they
may contain private information).

Feature safe:	yes
2010-06-25 21:42:24 +00:00
Mark Linimon
0f99ddce2e Remove obsolete cruft that has not been used in several years.
Feature safe:	yes
2010-06-22 23:55:31 +00:00
Mark Linimon
e8f9e57eca A new file to document some generalization of scripts on a package
building server.  For security reasons, the scripts themselves will
not be checked in to this repository.

Please do not commit to this file without the approval of portmgr.

Feature safe:	yes
2010-06-22 23:48:07 +00:00
Mark Linimon
408042ec04 Some configuration information that is shipped to the clients of a
package building cluster.

Please do not commit to this file without the approval of portmgr.

Feature safe:	yes
2010-06-22 23:46:55 +00:00
Mark Linimon
8a1c53277f A new file to centralize definitions that apply to the the package nodes
used from a package building cluster.  This is part of a rewrite to remove
a great deal of hardcoding.

Please do not commit to this file without the approval of portmgr.

Feature safe:	yes
2010-06-22 23:46:06 +00:00
Mark Linimon
536fd89955 A new file to centralize definitions that apply to the server-side of
a package building cluster.  This is part of a rewrite to remove a great
deal of hardcoding.

Please do not commit to this file without the approval of portmgr.

Feature safe:	yes
2010-06-22 23:45:27 +00:00
Mark Linimon
aa7717e661 Catch up with master copy on pointyhat.
Note: all 3 of these files will be changing radically in the near future.
This is the last checkin from the "classic" codebase installation.

Feature safe:	yes
2010-06-22 02:51:54 +00:00
Mark Linimon
7ce566ebb0 These appear to no longer be used.
Feature safe:	yes
2010-06-22 02:45:41 +00:00
Romain Tartière
4a54a88a4f - Unbreak the -n flag;
- Remove invalid reference to freefall.

Approved by:	garga
2010-06-06 09:30:54 +00:00
Mark Linimon
666d694375 Restore line dropped in revision 1.21.
Pointyhat to:		linimon
2010-06-03 07:01:35 +00:00
Mark Linimon
fa2be9ee8b Sigh. This had already been done, just not checked out on production.
Pointy hat:	self
2010-05-31 20:06:08 +00:00
Mark Linimon
dcabe96b55 Get rid of the remnants of X11BASE. 2010-05-31 20:01:31 +00:00
Mark Linimon
69105de3df Remove some hardcoding. 2010-05-31 19:33:22 +00:00
Mark Linimon
74affe36b5 Add a comment. 2010-05-31 19:29:25 +00:00
Mark Linimon
05e815f4bd Eliminate some more hardcoding. Expand the pattern for "non-mainstream"
builds to also catch \., not just \-.
2010-05-25 20:08:56 +00:00
Mark Linimon
ed6716f76f Remove the hard-coding of '-exp'. While here, factor out some other
hardcoding to defines.
2010-05-25 07:37:48 +00:00
Mark Linimon
9672ea0555 Remove obsolete cruft. 2010-05-23 03:09:09 +00:00
Mark Linimon
a9c84913e9 Cronjob that runs on pointyhat to cleanup stale chroots on clients. 2010-05-22 00:58:11 +00:00
Mark Linimon
4a1e5c660e Trim backup files a bit; make the emails a bit more verbose. 2010-05-20 04:07:13 +00:00
Mark Linimon
b5b4dafb6f Refactor things a bit. 2010-05-20 04:04:24 +00:00
Mark Linimon
44bd147989 Improve error handling a bit. 2010-05-20 03:58:50 +00:00
Erwin Lansing
ad1b924b23 Revert the clang part of rev 1.12, which is now default in clangbsd. 2010-05-10 15:05:59 +00:00
Mark Linimon
7fc55a84af Add a case to detect a transient problem that shows up on all package
nodes, but most regularly on sparc64.  (Occasionally, on amd64 and ia64).

For reasons I haven't been quite able to track down, on some occasions
a pkg_add command is unable to extract a dependency; the tarfile shows
up as being truncated.  This does not seem to be due to disk-low or
memory-low conditions, nor is it a problem with scp; the md5 on the file
is fine when examined afterwards.

The only clue so far is that it seems to happen on systems with the most
package builds running simultaneously -- and thus, possibly more than one
pkg_add running in parallel.
2010-03-30 21:19:36 +00:00
Mark Linimon
5c7fe20b5f Add an entry for the "truncated distfiles" problem; improve one other entry. 2010-03-30 21:14:16 +00:00
Dirk Meyer
5e55949069 - allow addport to work in ports-mgnt again
Approved by:	garga, drso, flz
2010-03-25 15:44:17 +00:00
Mark Linimon
81ee5011c8 Catch up with production.
Feature safe:	yes
2010-02-19 16:27:24 +00:00
Mark Linimon
2492e191ee Bring this up to date with what is in production: add 'queue length'
column from pav; fix first-column formatting.

Feature safe:	yes
2010-02-19 16:15:58 +00:00
Mark Linimon
261bae1be6 Bah, another few references to "8-current", which no longer exists. 2010-02-05 18:09:52 +00:00
Jun Kuriyama
e2f30d68c5 - Add a script to check unneeded dependencies for perl modules. 2010-01-29 14:52:45 +00:00
Mark Linimon
d1c3f4ddd2 Add some new error cases to handle regressions in -current. (Not yet
analyzed for how much they will slow this script down; consider this a
rush-job.)

 - dirent denotes some change in the usage of dirent.h.
 - termios denotes the deprecation of <sys/termios.h>.
 - uname denotes the hiding of the uname symbol.  This has been backed
   out in src so let's hope this case can go away soon.
 - utmp_x denotes the replacement of utmp.h with utmpx.h.

Together these catch ~150 new errors on i386-9.  However, there are more
that are not caught (second-order effects.)
2010-01-20 09:08:55 +00:00
Mark Linimon
99e391bf77 Note that we are at 9-CURRENT now. Also, ia64 builds have resumed. 2009-12-19 14:05:51 +00:00
Pav Lucistnik
931cab63a3 - Remove use of X11BASE from pointyhat scripts 2009-12-18 14:25:58 +00:00
Maxim Sobolev
4ba8d15977 Correct depreciation warning with Python 2.6 and fix several warnings
from the pytchecker.
2009-11-21 00:40:59 +00:00
Mark Linimon
7676829042 A few more loose ends.
Testing by:	miwi
2009-11-19 06:47:05 +00:00
Mark Linimon
a7e34a9e41 Make the create command more robust by making even more directories
and checking more error results.
2009-11-19 03:25:47 +00:00
Mark Linimon
4bf33692a7 Properly supppress empty buildenvs. 2009-11-17 04:49:41 +00:00
Mark Linimon
1263d0c3a0 Refactor this to minimize hard-coding. When our support for branches
changes, now you only need to change 2 lines.
2009-11-16 00:17:05 +00:00
Mark Linimon
b5923ad846 Harden these a bit: make them identify on which host they were running;
skip unncessary steps.
2009-11-16 00:16:08 +00:00
Mark Linimon
8d20989476 Fix up the problems that can happen when 2 copies of makeworld are
running simultaneously for separate buildenvs.
2009-11-13 04:24:35 +00:00
Mark Linimon
8b562a8a84 Make more robust. 2009-11-12 23:48:36 +00:00
Mark Linimon
6b924aa4a6 Parameterize. 2009-11-12 23:48:22 +00:00
Mark Linimon
7c3e5b64a5 Harden this script so it will DTRT if any subdirectories of a new build,
or pieces of a pre-existing build, are missing.  These are both the case
when dopackages follows 'build create'.
2009-11-10 08:02:37 +00:00
Mark Linimon
debe14542f Remove a trailing slash on a directory name, that merely gets doubled
later in the code.
2009-11-10 07:54:50 +00:00
Mark Linimon
5b7f7f4aeb Finally fix the 'build create' command to DTRT by reusing some already-
working code.  While here, clean up a bit.
2009-11-10 00:18:04 +00:00
Mark Linimon
2d1dcdcd60 Reflect the fact that src-HEAD is now just a symlink to src-9. This
dance-step prevents having to introduce some special-case code into
the build script.
2009-11-10 00:17:20 +00:00
Mark Linimon
75ee9174fa Fix permissions and 'latest' link. 2009-11-09 09:09:19 +00:00
Mark Linimon
c01dff508b Remove a doubled slash. 2009-11-09 08:52:36 +00:00
Mark Linimon
9203344875 Implement the "build create" command. 2009-11-09 08:37:36 +00:00
Mark Linimon
99dc659674 Remove cruft. 2009-11-08 02:25:19 +00:00
Mark Linimon
661c4bdb3a Allow for the possibility of powerpc builds. Since these are not yet
set up, add error handling to gracefully handle missing directories.
2009-11-08 00:27:14 +00:00
Mark Linimon
551b5a7617 Allow for the possibility of powerpc builds. 2009-11-08 00:25:37 +00:00
Mark Linimon
4d6a33b6fa Remove dead code. 2009-11-08 00:25:03 +00:00
Mark Linimon
50b2db3470 Reflect reality on pointyhat. While here, clean up a bit. 2009-11-08 00:24:50 +00:00
Greg Larkin
e49ea39cc3 - Fixed "permission denied" error
- Prevented full ports tree build when operating with ~/.cvsrc

PR:		ports/139121
2009-10-06 00:48:13 +00:00
Gerald Pfeifer
413c1b6ad3 Correctly bump PORTREVISION?= instead of always resetting to 1 in this case.
PR:		138774
Approved by:	edwin
2009-09-15 09:34:08 +00:00
Mark Linimon
6700e1cbe7 Add links for 9-current. (note: 8-current is not 8-stable ... yet.)
While here, remove some staleness.
2009-08-24 02:32:52 +00:00
Mark Linimon
3fba981253 Generalize this script to remove the necessity of editing it every time
we create a new src branch.  While here, garbage collect some code that
hasn't been run for years.
2009-08-24 01:57:30 +00:00
Mark Linimon
99e14e14ec I believe that this script is obsolete. Retire it. 2009-08-23 15:30:24 +00:00
Mark Linimon
03def879af Add 9 and 9-exp to this sample file. Delete 6-exp2. 2009-08-23 14:38:17 +00:00