2
0
Fork 0
mirror of git://git.savannah.gnu.org/guix/maintenance.git synced 2023-12-14 03:33:04 +01:00
Commit graph

124 commits

Author SHA1 Message Date
Mathieu Othacehe
45f9303c9f
build-machines: Allow concurrent jobs.
For now build machines have guix-daemon "--max-jobs" option unset, which means
that at most one job is allowed to be built by the daemon. By setting max-jobs
to 20, we should be able to make better use of berlin build-machines.

* hydra/modules/sysadmin/build-machines.scm (berlin-new-build-machine-os): Add
max-jobs, max-cores and build-accounts-to-max-jobs-ratio arguments. Pass them
to "guix-configuration" record.
* hydra/berlin-nodes.scm: Adapt accordingly to allow at most 20 concurrent
jobs.
2020-08-05 10:39:56 +02:00
Ludovic Courtès
a47ab3b77e
services: cleanup-cuirass-roots: Remove roots for "genimage.cfg".
* hydra/modules/sysadmin/services.scm (cleanup-cuirass-roots)[handle-gc-root]:
Add "genimage.cfg" since it refers to "partition.img".
2020-07-26 15:59:16 +02:00
Ludovic Courtès
d4baf6ea6a
services: cleanup-cuirass-roots: Remove roots for "partition.img".
* hydra/modules/sysadmin/services.scm (cleanup-cuirass-roots)[handle-gc-root]:
Add "partition.img".
2020-07-22 00:35:55 +02:00
Ludovic Courtès
00d4ca69d6
services: cleanup-cuirass-roots: Add more candidate file names.
* hydra/modules/sysadmin/services.scm (cleanup-cuirass-roots)[handle-gc-root]:
Add "iso-image-installer" and "guix-binary.tar.xz".
2020-07-15 15:19:00 +02:00
Mathieu Othacehe
c25447056b
sysadmin: web: Use latest Guile to generate the website.
* hydra/modules/sysadmin/web.scm (build-program): Use the latest Guile as we
are including Guix modules, which are compiled with a later Guile than the one
used by "program-file".
2020-07-06 11:39:30 +02:00
Jan (janneke) Nieuwenhuizen
a47ab98077
hydra/berlin-nodes: Add Childhurd service to nodes 101, 102.
* hydra/modules/sysadmin/build-machines.scm (childhurd-ip?): New
procedure.
(berlin-new-build-machine-os): Add #:childhurd parameter.  If set, add
a Childhurd service.
* hydra/machines-for-berlin.scm (x86_64->childhurd): New procedure.
(x86_64): Use them to define childhurd offload machines.
* hydra/berlin-nodes.scm: Add Childhurd service to the first two
nodes.
2020-06-29 07:20:30 +02:00
Ludovic Courtès
fc972528d9
hydra: services: Run Goggles in a UTF-8 locale.
* hydra/modules/sysadmin/services.scm (goggles-shepherd-services): Pass
 #:environment-variables to 'make-forkexec-constructor/container'.
2020-06-27 14:42:48 +02:00
Ludovic Courtès
4b23c09a11
hydra: services: /var/log/goggles.log is rotated.
* hydra/modules/sysadmin/services.scm (%goggles-log-rotations): New variable.
(goggles-service-type): Extend ROTTLOG-SERVICE-TYPE.
2020-06-27 14:15:27 +02:00
Ludovic Courtès
3ac9bfe5a5
hydra: services: Goggles services maps /var/www/.well-known/all-logs.
* hydra/modules/sysadmin/services.scm (%goggles-irc-log-directory): New
varaible.
(%goggles-activation): Create it and chmod it.
(goggles-shepherd-services): Add it to #:mappings.
2020-06-27 14:11:31 +02:00
Ludovic Courtès
5b61819f14
hydra: services: Run Goggles index job as user "goggles".
* hydra/modules/sysadmin/services.scm (goggles-mcron-jobs): Pass #:user.
2020-06-27 12:18:18 +02:00
Ludovic Courtès
19520372a2
hydra: services: Add an mcron job to update the Goggles index.
* hydra/modules/sysadmin/services.scm (goggles-mcron-jobs): New procedure.
(goggles-service-type): Extend MCRON-SERVICE-TYPE.
2020-06-26 17:49:43 +02:00
Ludovic Courtès
2bb7289f01
hydra: services: Goggles has access to its cache directory.
* hydra/modules/sysadmin/services.scm (%goggles-cache-directory)
(%goggles-activation): New variables.
(goggles-shepherd-services): Pass #:mappings to
'make-forkexec-constructor/container'.
(goggles-service-type): Extend ACTIVATION-SERVICE-TYPE.
2020-06-26 17:37:51 +02:00
Ludovic Courtès
6d3cd42d53
hydra: services: Add Goggles service.
* hydra/modules/sysadmin/services.scm (goggles, %goggles-accounts)
(goggles-shepherd-services, goggles-service-type): New variables.
2020-06-26 15:01:26 +02:00
Mathieu Othacehe
d28529b4b3
hydra: services: Add hurd-barebones-disk-image to build products.
* hydra/modules/sysadmin/services.scm (cuirass-specs): Add
"hurd-barebones-disk-image" to "guix-master" specification build products.
2020-06-25 14:57:58 +02:00
Ludovic Courtès
289ae44ba7
sysadmin/web: Update to new 'update-cached-checkout' interface.
* hydra/modules/sysadmin/web.scm (build-program): Expect three value
from 'update-cached-checkout'.
2020-06-15 13:56:27 +02:00
Mathieu Othacehe
9b3918c355
services: cuirass: Set iso9660-image type.
* hydra/modules/sysadmin/services.scm (cuirass-specs): Set iso9660-image build
output type to "ISO-9660". It will now be displayed by Cuirass in the Web
interface.
2020-06-14 13:04:50 +02:00
Mathieu Othacehe
c8e4117b18
hydra: services: Add build output support to Cuirass.
Cuirass recently gained build output support. This means that it is possible
to indicate from the specifications which files from a job output should be
made available for download via the Web UI.

Use it to make ISO9660 images available for download.

* hydra/modules/sysadmin/services.scm (cuirass-specs): Add build-outputs
support.
2020-06-10 18:16:38 +02:00
Ricardo Wurmus
f6c1ecaf0b
hydra/build-machines: Update serial console settings.
* hydra/modules/sysadmin/build-machines.scm (berlin-new-build-machine-os):
Update serial console settings in kernel arguments and agetty service.
2020-06-05 09:41:45 +02:00
Ricardo Wurmus
59b2db11a6
hydra/build-machines: Use Guile 3.0 load path.
* hydra/modules/sysadmin/build-machines.scm (berlin-new-build-machine-os):
Set global load path to Guile 3.0 directories.
2020-06-05 09:39:33 +02:00
Christopher Baines
9299aa53f8
hydra: services: Fix brackets in cuirass-specs.
* hydra/modules/sysadmin/services.scm (cuirass-specs): Fix brackets.
2020-05-30 00:03:13 +01:00
Christopher Baines
9a202eabe2
hydra: services: Support selecting Cuirass specifications.
Support selecting specifications by branch, so that Bayfront can be
configured only to build master.

* hydra/modules/sysadmin/services.scm (cuirass-specs): Support
selecting specifications by branch.
(frontend-services): Add a #:branches parameter, and pass this to
cuirass-specs.
2020-05-28 20:45:51 +01:00
Ludovic Courtès
4eca21f4bd
hydra: berlin: Ensure we have 3 TiB free each day.
* hydra/modules/sysadmin/services.scm (%gc-jobs): Rename to...
(gc-jobs): ... this, and add a 'threshold' parameter.
(KiB, MiB, GiB, TiB): New variables.
(frontend-services): Add #:gc-threshold and pass it to 'gc-jobs'.
* hydra/berlin.scm (services): Pass #:gc-threshold.
2020-05-12 21:55:04 +02:00
Mathieu Othacehe
27d0f44b30
hydra: services: Add iso9660-image to cleanup-cuirass-roots.
* hydra/modules/sysadmin/services.scm (cleanup-cuirass-roots): Add
iso9660-image derivations to clean-up.

This is a follow-up of f19cf27c2b9ff92e2c0fd931ef7fde39c376adaa0..
2020-05-12 11:14:10 +02:00
Christopher Baines
56c87ce712
sysadmin/services: Make the build accounts ratio configurable.
So that bayfront can have more build accounts.

* hydra/modules/sysadmin/services.scm (guix-daemon-config): Add
 #:build-accounts-to-max-jobs-ratio as a parameter.
(frontend-services): Add #:build-accounts-to-max-jobs-ratio as a
parameter, and pass the value to guix-daemon-config.
2020-04-26 20:01:36 +01:00
Ricardo Wurmus
61656c1ff2
hydra: services: Delete all os and os-encrypted roots.
* hydra/modules/sysadmin/services.scm (cleanup-cuirass-roots): Replace
"-installed-os" and "-installed-os-encrypted" with "-os" and
"-os-encrypted".
2020-04-24 14:07:06 +02:00
Ludovic Courtès
4b01f03282
hydra: services: Add missing module to 'cleanup-cuirass-roots'.
* hydra/modules/sysadmin/services.scm (cleanup-cuirass-roots): Add (guix
derivations).
2020-04-24 12:08:37 +02:00
Ludovic Courtès
aff8df6bf3
hydra: services: "cleanup-cuirass-roots" deletes roots for referrers.
* hydra/modules/sysadmin/services.scm (not-config?): New procedure.
(cleanup-cuirass-roots): Wrap gexp in 'with-extensions' and
'with-imported-modules'.
[root-target, derivation-referrers, delete-gc-root-for-derivation]: New
procedures.  Delete GC roots for the referrers of DELETED.
Arguments to 'file-system-fold' now preserve RESULT.
2020-04-24 11:55:21 +02:00
Ludovic Courtès
60aba43012
hydra: services: Accumulate the list of deleted files.
* hydra/modules/sysadmin/services.scm (cleanup-cuirass-roots)[handle-gc-root]:
Rename last argument to 'deleted'.  Cons FILE to DELETED when it's
actually deleted.
[deleted]: New variable.
Iterate over it to create "/gnu/big-stuff".
2020-04-24 10:56:29 +02:00
Ricardo Wurmus
224fedbef7
hydra/services: Remove roots for system tests and VM launch scripts.
* hydra/modules/sysadmin/services.scm (cleanup-cuirass-roots): Remove
roots ending on "-test" and "-run-vm.sh".
2020-04-23 08:10:26 +02:00
Ricardo Wurmus
8670d16e7d
hydra/services: Remove rottlog-service-type.
* hydra/modules/sysadmin/services.scm (frontend-services): Remove
rottlog-service-type as it is now included in the defaults.
2020-04-22 15:24:54 +02:00
Ricardo Wurmus
9356e3c940
hydra/services: cleanup-cuirass-roots: Collect file names.
* hydra/modules/sysadmin/services.scm (cleanup-cuirass-roots): Write
collected files to /gnu/big-stuff.
2020-04-22 15:24:16 +02:00
Ricardo Wurmus
8f484aa24c
hydra/services: cleanup-cuirass-roots: Delete more large files.
* hydra/modules/sysadmin/services.scm (cleanup-cuirass-roots): Delete
more images and opaque archives.
2020-04-22 15:24:16 +02:00
Ricardo Wurmus
368c8ab616
sysadmin/web: Use Guile 3.0 variant of Guix for GWL.
* hydra/modules/sysadmin/web.scm (gwl-web-shepherd-service)[wrapped-guix]:
Wrap GWL execution in Guile 3.0 variant of Guix.
2020-03-15 21:26:18 +01:00
Ricardo Wurmus
64cb4ae13e
hydra: dns: Add monitor sub-domain.
* hydra/modules/sysadmin/dns.scm (guix.gnu.org.zone): Add entry for
monitor.guix.gnu.org.
2020-03-15 15:42:15 +01:00
Ricardo Wurmus
1446549a6f
hydra: Use default GWL package.
* hydra/modules/sysadmin/web.scm (gwl-snapshot): Remove variable.
(gwl-web-service-type): Use gwl instead of gwl-snapshot.
2020-03-15 11:55:28 +01:00
Ricardo Wurmus
1d8c25fdf7
sysadmin/services: Use cuirass with disabled fibers tests.
* hydra/modules/sysadmin/services.scm (cuirass-without-fiber-tests):
New variable.
(frontend-services)[services]: Use it.
2020-03-06 17:30:48 +01:00
Tobias Geerinckx-Rice
e371ef6a95
hydra: dns: Fix bogus MNAME.
* hydra/modules/sysadmin/dns.scm (primary-ns): New variable.
(guix.gnu.org.zone, guix.gnu.org-zone): Use it.  Bump the serial number.
2020-02-28 03:04:13 +01:00
Ricardo Wurmus
f2b32fa5d8
hydra: sysadmin: Remove old berlin OS procedure.
* hydra/modules/sysadmin/build-machines.scm (berlin-build-machine-os):
Remove procedure.
2020-02-27 12:52:26 +01:00
Ricardo Wurmus
d5d410aad1
hydra: web: Update gwl-snapshot.
* hydra/modules/sysadmin/web.scm (gwl-snapshot): Update to
0.2.0-0.bb85943; inherit from gwl package.
2020-02-16 15:56:41 +01:00
Ludovic Courtès
4a2cd81ff8
hydra: services: Remove GC roots for *-installation.
Reported by Christopher Baines <mail@cbaines.net>.

* hydra/modules/sysadmin/services.scm (cleanup-cuirass-roots):
Remove *-installation in addition to *-disk-image.
2020-02-11 16:53:47 +01:00
Ludovic Courtès
14034ebaff
hydra: services: Double the number of build accounts.
* hydra/modules/sysadmin/services.scm (guix-daemon-config): Set
'build-accounts' to 4 times MAX-JOBS.  Bayfront without offloading was
hitting its max number of build users.
2020-01-27 11:20:37 +01:00
Ricardo Wurmus
16dd24187a
hydra: build-machines: Add configuration for new build nodes.
* hydra/modules/sysadmin/build-machines.scm (berlin-new-build-machine-os):
New procedure.
2019-12-20 20:04:15 +01:00
Christopher Baines
f3880ad3fd
hydra: dns: Change "data" to point at a new IP address.
This is a machine run by Hetzner, managed by Christopher Baines. It
currently runs an instance of the Guix Data Service.

* hydra/modules/sysadmin/dns.scm (guix.gnu.org.zone): Change "data" to
point at 78.47.68.4, and update the serial.
2019-12-16 22:06:31 +00:00
Ludovic Courtès
f7ecef676e
berlin: build-machines: Fix typo.
* hydra/modules/sysadmin/build-machines.scm (berlin-build-machine-os):
Unquote-splice 'modify-services' form.
2019-11-19 12:30:57 +01:00
Ludovic Courtès
f2303c3a9a
berlin: build-machines: Enable 'qemu-binfmt' on the first 10 machines only.
This matches what 'machines-for-berlin.scm' says.

* hydra/modules/sysadmin/build-machines.scm (berlin-build-machine-os):
Add #:emulated-architectures.  Add 'qemu-binfmt-service' only when
EMULATED-ARCHITECTURES is non-empty.
* hydra/berlin-nodes.scm (system-for): Pass #:emulated-architectures to
'berlin-build-machine-os'.
2019-11-19 12:28:00 +01:00
Ludovic Courtès
a01f899735
berlin: build-machines: Refer to SSH keys with 'local-file'.
* hydra/modules/sysadmin/build-machines.scm (berlin-build-machine-os)
[hydra-dir, maintenance-file]: Remove.
[sysadmins]: Use 'local-file' instead.
2019-11-19 12:28:00 +01:00
Ludovic Courtès
553d2fb008
berlin: build-machines: Have 90 GiB free instead of 60 GiB.
* hydra/modules/sysadmin/build-machines.scm (berlin-build-machine-os)[gc-job]:
Collect 90 GiB.
2019-11-19 12:28:00 +01:00
Ricardo Wurmus
16c4bd7162
sysadmin/web: gwl-snapshot: Update to 0.1.1-2.551ec2f.
* hydra/modules/sysadmin/web.scm (gwl-snapshot): Update to
0.1.1-2.551ec2f.
2019-10-22 05:43:42 +02:00
Ricardo Wurmus
5ed79379f8
services: web: Update to newer GWL snapshot.
* hydra/modules/sysadmin/web.scm (gwl-snapshot): Upgrade to
0.1.1-1.e402b3a.
[source]: Remove snippet.
[arguments]: Re-enable tests.
2019-09-28 01:07:24 +02:00
Ludovic Courtès
8e7e08721c
services: web: Log the output of GWL service.
* hydra/modules/sysadmin/web.scm (gwl-web-shepherd-service): Pass
 #:log-file to 'make-forkexec-constructor/container'.  Fix
'documentation'.
2019-09-26 18:47:19 +02:00