Commit Graph

68 Commits

Author SHA1 Message Date
Christopher Baines 6387f1bc67 Fetch the list of system values from the database
This removes the need to hardcode some values in the code.
2021-04-23 11:20:36 +01:00
Christopher Baines be2d554aae Support the system-tests page for the latest processed revision 2021-03-05 13:52:32 +00:00
Christopher Baines b0b87cced7 Improve the revision page when a revision hasn't been processed 2021-02-03 12:57:29 +00:00
Christopher Baines 7fbcb3a3c2 Store channel instance derivations in a separate transaction
This means that these derivations are stored, even if a later part of the
process fails. Having the channel instance derivations stored might help work
out why the failure occurred, or better display information about it.
2021-02-02 23:36:56 +00:00
Christopher Baines f58fe208fd Support finding fixed output derivations for packages
This finds all the fixed output derivations in the graph of packages. I'm
planning to use this to queue builds for these derivations on a regular basis,
to monitor when fixed output derivations break (as the thing they download has
disappeared for example).
2020-12-26 13:40:09 +00:00
Christopher Baines 69057b41a7 Support showing package derivations by build status
I'm particularly thinking about listing packages which fail to build.
2020-12-09 19:07:42 +00:00
Christopher Baines 54616bc9e4 Add default "none" target to the package derivation outputs page
This avoids odd results for the links from the package substitute availability
page.
2020-10-31 13:27:06 +00:00
Christopher Baines 941d1af556 Include the revision in the package derivation outputs JSON 2020-10-13 18:52:08 +01:00
Christopher Baines f15dc5ab0b Include package details for the package derivation outputs JSON
So it's easier to match the output back to the package.
2020-10-13 18:51:21 +01:00
Christopher Baines d05a7397fb Improve latest processed revision pages for reproducibility stuff
Support the package-derivation-outputs page, and switch the
package-reproducibility page across to use it.
2020-10-11 17:05:38 +01:00
Christopher Baines efbbac5099 Add a very rough JSON output for the package derivation outputs page 2020-10-11 16:53:29 +01:00
Christopher Baines c3c9c07f9a Completely rework the way db connections are handled during requests
Previously, a connection was passed through the code handling the
request. When queries were performed, this could block the thread though,
potentially leaving the server unable to serve other requests.

Instead, this now runs queries in a pool of threads. This should remove the
possibility of blocking the threads used by the web server, and in doing so,
some of the queries have been parallelised.

I''m still not sure about the naming and syntax, but I think the functionality
is a sort of step forward.
2020-10-03 21:35:31 +01:00
Christopher Baines 84907fe040 Implement the JSON representation for system tests 2020-09-27 12:06:18 +01:00
Christopher Baines 53341c70fc Change the locale codeset representation
From the normalized one, to the one actually contained within glibc. Recent
versions of glibc also contain symlinks linking the normalized codeset to the
locales with the .UTF-8 ending, but older ones do not.

Maybe handling codeset normalisation for queries would be good, but the locale
values ending in .UTF-8 are more compatible and allow the code to be
simplified. For querying, maybe there should be a locales table which handles
different representations.
2020-09-26 11:45:57 +01:00
Danjela Lura 599c621b88 Postpone the execution of the query that displays locale options
Signed-off-by: Christopher Baines <mail@cbaines.net>
2020-08-14 21:55:59 +01:00
Christopher Baines 4b1dc76f18 Improve the revision builds page
Allow specifying how many results to show, and say how many results are being
shown.
2020-07-03 20:33:16 +01:00
Danjela Lura f60c2eabce Add the packages-translation-availability page
Signed-off-by: Christopher Baines <mail@cbaines.net>
2020-06-26 17:54:19 +01:00
Danjela Lura bd3aa98620 Add indications for no translations available in the lint warnings page
Signed-off-by: Christopher Baines <mail@cbaines.net>
2020-06-26 17:54:19 +01:00
Danjela Lura d442d408ee Add locale values in the JSON response for the lint warnings page
Signed-off-by: Christopher Baines <mail@cbaines.net>
2020-06-26 17:54:19 +01:00
Danjela Lura 89aaf984ec Include locale in search-packages-in-revision
Signed-off-by: Christopher Baines <mail@cbaines.net>
2020-06-26 17:54:19 +01:00
Danjela Lura f16fdb44f1 Add indications for no translations available in the packages page
Signed-off-by: Christopher Baines <mail@cbaines.net>
2020-06-26 17:54:19 +01:00
Danjela Lura 5708b81002 Include locale in the JSON response for the packages page
Signed-off-by: Christopher Baines <mail@cbaines.net>
2020-06-26 17:54:19 +01:00
Danjela Lura a3ac33c0e1 Provide the packages page with translations
Signed-off-by: Christopher Baines <mail@cbaines.net>
2020-06-19 16:03:32 +01:00
Danjela Lura d3096de655 Use lint checker related translations on some pages
Signed-off-by: Christopher Baines <mail@cbaines.net>
2020-06-07 20:17:03 +01:00
Christopher Baines e7e5a281ee Support package substitute availability for the latest revision 2020-06-03 20:14:16 +01:00
Christopher Baines 67cda8f9cc Make the package-reproducibility page work for the latest revision 2020-06-03 20:06:26 +01:00
Christopher Baines 11b13edac9 Populate package derivation outputs select options always
Even when the query parameters are invalid, as this is more useful. Thanks to
nckx for reporting.
2020-06-03 20:02:39 +01:00
Christopher Baines b6754c8a4c Add a lookup_builds field to the build_servers table
This is to allow for build servers where only the substitutes should be
queried, and it shouldn't be assumed that they're running Cuirass.
2020-05-24 17:02:53 +01:00
Christopher Baines c5a5684f1d Add a new package substitute availability page 2020-05-03 21:26:47 +01:00
Christopher Baines 6d3e8660bd Allow filtering by substitute availability for derivation outputs 2020-05-03 21:26:47 +01:00
Christopher Baines e4cb3a815a Rename render-revision-derivation-outputs
To mention that this is just for package derivations.
2020-05-03 21:20:22 +01:00
Christopher Baines f83cff7107 Add a JSON output for the revision channel instances 2020-04-24 10:46:20 +01:00
Christopher Baines 7a7dedfa1b Implement the JSON response for the package derivations page 2020-04-24 10:28:44 +01:00
Christopher Baines 68420b1085 Support controlling the fields returned for package derivations
Mostly so that the builds can be avoided when querying for all the
derivations, as that's slow.
2020-04-24 10:17:12 +01:00
Christopher Baines 6fb3892712 Make it clearer that some things relate to package derivations
Rather than derivations in general.
2020-04-24 09:12:39 +01:00
Danjela lura e514471fc9 Add option to change language of lint messages for the revision page
Signed-off-by: Christopher Baines <mail@cbaines.net>
2020-04-04 18:31:26 +01:00
Christopher Baines c44297b615 Generate and store system test derivations for all supported systems
Rather than just the native system. I'm not quite sure of the value here, as I
guess system tests should behave the same regardless of the way the software
is compiled, but this seems like it could be useful, and being explicit about
the system the derivation is for is good.
2020-03-20 08:28:55 +00:00
Christopher Baines 119fd801e1 Fix some functions being called with the wrong number of arguments 2020-02-15 21:38:42 +00:00
Christopher Baines 5758795777 Set a default target for the revision builds page
This solves the build stats showing up incorrectly, as without this there was
no filtering on target.
2020-02-15 21:25:02 +00:00
Christopher Baines 374dc25440 Improve system and target query parameter handling 2020-02-13 23:11:59 +00:00
Christopher Baines 5cf186e5b1 Add a page for channel instance derivations 2020-02-12 08:37:57 +00:00
Christopher Baines c8dec34f33 Switch to using more correct targets on the build page 2020-02-11 22:47:30 +00:00
Christopher Baines f1989e8758 Rework cross derivations support
Stop using the system values as targets, and remove package derivation entries
where this is the case.

Switch the non-cross derivation case to have a target of "", rather than
matching the system, as this makes more sense, and is more consistent now that
the target values no longer match the system values.

Hardcode some more correct target values, and use these instead. Hopefully
this can be better integrated with Guix in the future.

This commit also includes a migration attempting to shrink some indexes.
2020-02-08 11:16:08 +00:00
Christopher Baines 19630014a3 Add a page to show system tests for a revision 2020-02-03 09:58:02 +01:00
Christopher Baines d7036bdd37 Implement the search query input on the derivation outputs page 2020-01-04 22:15:39 +00:00
Christopher Baines 6cb7e92257 Support the search query input on the revision derivations page 2020-01-04 21:46:22 +00:00
Christopher Baines 2f56e59e5b Fix some missing arguments to view-revision-derivations 2020-01-04 21:45:41 +00:00
Christopher Baines 04ab01725b Add a revision header and link to the package reproducibility page
To make it easier to get back to the revision page, as well as setting the
content more in context.
2020-01-04 21:08:39 +00:00
Christopher Baines 8a3b0d97b8 Add a revision header and link on the revision builds page
To make it easier to get back to the revision page, as well as setting the
page content in context.
2020-01-04 21:07:56 +00:00
Christopher Baines f56935a8a6 Change the language around reproducibility/matching outputs
It's more accurate to describe the specifics of the relevant data here through
terms like "matching" and "not matching", as a statement that something built
reproducibility needs to be made alongside the test conditions. So just say
that build outputs matched, or didn't match, as this is more descriptive of
the data available.
2019-12-27 14:05:12 +00:00