Commit Graph

22 Commits

Author SHA1 Message Date
Christopher Baines c3cb04cb80 Use fibers when processing new revisions
Just have one fiber at the moment, but this will enable using fibers for
parallelism in the future.

Fibers seemed to cause problems with the logging setup, which was a bit odd in
the first place. So move logging to the parent process which is better anyway.
2023-11-05 13:46:20 +00:00
Christopher Baines bf41c6ebb1 Set current-guix-package when computing system test derivations
This is a bit ugly, but might speed up computing derivations for system tests.
2023-02-28 10:51:51 +00:00
Christopher Baines 3ba8418656 Allow skipping processing system tests
Generating system test derivations are difficult, since you generally need to
do potentially expensive builds for the system you're generating the system
tests for. You might not want to disable grafts for instance because you might
be trying to test whatever the test is testing in the context of grafts being
enabled.

I'm looking at skipping the system tests on data.guix.gnu.org, because they're
not used and quite expensive to compute.
2023-02-08 14:56:48 +00:00
Christopher Baines 3a90798567 Address a few issues in the load new guix revision tests 2022-03-02 18:23:26 +00:00
Christopher Baines 6023aa8caf Improve select-job-for-commit
It now returns #f or a list, rather than the empty list or a nested list.
2020-10-09 19:31:51 +01:00
Christopher Baines 03ea66cf33 Use the git repository fetch with authentication value 2020-10-07 18:51:30 +01:00
Christopher Baines 1ad581b05a Do some more mocking in the jobs-load-new-guix-revision tests
To help with getting them running on Guile 3.
2020-02-27 21:20:24 +00:00
Christopher Baines 73be24d8ac Remove unused mock-inferior import 2020-02-27 21:13:37 +00:00
Christopher Baines ffdde6ba36 Check that the test database is being used in all the tests 2020-02-24 21:16:41 +00:00
Christopher Baines 0c726b9fe7 Clear a couple of tables in the load-new-guix-revision tests
As entries from incomplete previous runs can effect the test, so clean out any
old data before the test begins.
2020-02-24 16:46:10 +00:00
Christopher Baines f6f51bbe0d Fake the store connection in the tests
So that the tests don't require a store connection.
2020-02-14 09:18:28 +00:00
Christopher Baines 0ef3349ed8 Use a more long lived store connection for loading data
As this will enable registering temporary roots, to avoid store items being
garbage collected.
2020-02-13 23:11:36 +00:00
Christopher Baines 9be7dbac0b Start storing channel instance derivations
These are the ones that relate to Guix pull.
2020-02-11 08:56:24 +00:00
Christopher Baines 876bae182d Update the load-new-revision-job tests 2020-02-11 08:55:16 +00:00
Christopher Baines f23ee71ea7 Insert channel news entries when loading new guix revisions
If the channel-news-for-commit function is present.
2019-11-21 19:56:19 +00:00
Christopher Baines 66d726f1fd Refactor channel handling in the load-new-guix-revision module
To allow for passing the channel to channel-news-for-commit.
2019-11-21 19:56:19 +00:00
Christopher Baines 9e80bda4f9 Avoid erroring when processing emails again
These changes allow processing emails again, and just creating job and branch
entries where data is missing.
2019-08-05 20:59:48 +01:00
Christopher Baines 712dd377a1 Remove test data after the tests have ran
The load-new-guix-revision tests aren't transactional, so truncate some tables
after running the tests.
2019-08-05 20:45:40 +01:00
Christopher Baines 83ef624b97 Switch to processing jobs in parallel
This should speed up processing new revisions, reduce latency between finding
out about new revisions and processing them, as well as help manage memory
usage, by processing each job in a process that then exits.
2019-07-12 23:00:44 +01:00
Christopher Baines 28baed2667 Fix the name for the jobs-load-new-guix-revision test module 2019-07-12 19:50:36 +01:00
Christopher Baines 743cec7cb6 Associate a name with database connections
This helps when working out which connection to the database is doing what.
2019-07-12 19:49:26 +01:00
Christopher Baines 544dc1558f Add a new test to cover some of the loading new revisions code 2019-06-02 22:02:12 +01:00