guix/data-service
2
0
Fork 0
mirror of git://git.savannah.gnu.org/guix/data-service.git synced 2023-12-14 03:23:03 +01:00
Code Issues Releases Wiki Activity
625 commits 1 branch 0 tags 1.8 MiB
Commit graph

625 commits

This branch
This branch
All branches
Author SHA1 Message Date
Christopher Baines a6302a32ef Make it possible to specify the batch size 
In backfill-derivation-source-file-nars.
 2019-12-31 14:58:31 +00:00
Christopher Baines f2343b5fc9 Switch to using package-supported-systems, not the transitive one 
This seems to work better for both generating the non-cross and cross
derivations. Previously, using the package-transitive-supported-systems
approach didn't generate some cross derivations.
 2019-12-31 10:29:02 +00:00
Christopher Baines df9d0bbdd1 Improve generating derivations for foreign architectures 
Use the second argument to package-transitive-supported-systems to correctly
identify the different bootstrap path for non x86_64 and i686-linux. The
previous implementation did work, but only up until a merge of core-updates
changed the bootstrap approach.
 2019-12-31 10:23:29 +00:00
Christopher Baines 2cb5309851 Display details for the derivation source files 
If the nar file is available.
 2019-12-30 12:32:20 +00:00
Christopher Baines 7881eec315 Add a function to backfill missing derivation source file nars 
If the file exists in the local store, then read it and add an entry to the
derivation_source_file_nars table. This will help to fill in the missing
entries, as currently entries are only added when the derivation source file
isn't in the database when the load new revision job runs.
 2019-12-30 11:26:23 +00:00
Christopher Baines 57ee3c8988 Improve entity handling in the sxml module 
This is useful as stexi->shtml uses *ENTITY* so handling this here means that
the HTML output for texinfo is better.
 2019-12-30 09:51:27 +00:00
Christopher Baines 82b797ee98 Create an index on the hash component of the store path 
For derivation_source_files.
 2019-12-29 17:55:04 +00:00
Christopher Baines 7e7cc1c8f1 Rework insert-derivation-sources to use a helper function 
This means it returns ids properly.
 2019-12-29 16:04:45 +00:00
Christopher Baines d15ba4f25c Serve narinfo files for derivation sources 2019-12-29 16:04:45 +00:00
Christopher Baines 7ca9b11885 Move rendering narinfo responses out of the main controller function 
In preparation for also handling derivation source files.
 2019-12-29 16:04:45 +00:00
Christopher Baines da3a294496 Serve nar files for the derivation source files 2019-12-29 16:04:45 +00:00
Christopher Baines 67af7e17f0 Generate and store nars for derivation source files 
This'll allow serving nars for these derivation source files.
 2019-12-29 16:04:45 +00:00
Christopher Baines c84b21be7c Add a new table to nars for derivation source files 
This will allow serving the nars for derivation source files.
 2019-12-28 22:47:58 +00:00
Christopher Baines f56935a8a6 Change the language around reproducibility/matching outputs 
It's more accurate to describe the specifics of the relevant data here through
terms like "matching" and "not matching", as a statement that something built
reproducibility needs to be made alongside the test conditions. So just say
that build outputs matched, or didn't match, as this is more descriptive of
the data available.
 2019-12-27 14:05:12 +00:00
Christopher Baines 6c1adfa9e6 Fix the help text on the jobs page 2019-12-27 13:14:58 +00:00
Christopher Baines 485b79a6de Add a page to show the public key used to sign substitutes 2019-12-27 13:03:17 +00:00
Christopher Baines 6f8ac2eccc Change indentation in the nar-controller parameters 2019-12-27 13:02:02 +00:00
Christopher Baines 4aa69f1910 Add a link to the derivations page 
From the revision page.
 2019-12-27 10:29:44 +00:00
Christopher Baines 50f550d642 Link to the versions page from the latest revision package page 2019-12-27 10:13:34 +00:00
Christopher Baines 1ce1a405a6 Link to the derivation history page from the branch package page 2019-12-27 10:13:01 +00:00
Christopher Baines 7654877991 Improve the builds info on the revision package version page 
Show multiple builds, and link to the build page.
 2019-12-27 00:09:07 +00:00
Christopher Baines 0e3c28ffbd Fix more cases where equivalent builds were missed 2019-12-26 23:22:54 +00:00
Christopher Baines 5163398e54 Add pagination to the jobs page 2019-12-26 23:03:12 +00:00
Christopher Baines b877b64eb8 Remove reverse from the copy of http-multiple-get 
This makes assumptions about the return value of the provided procedure, and
fails if it doesn't return a list.
 2019-12-26 23:01:34 +00:00
Christopher Baines 8628a68b0f Fix the colspan for the derivation history table chart rows 
It should have been changed to 4 when the builds column was added.
 2019-12-26 18:10:38 +00:00
Christopher Baines 7342280ead Guard against failures when loading the narinfo signing public key 2019-12-26 10:49:14 +00:00
Christopher Baines 54b3d8d93a Fix the option alist element names for the narinfo signing key 2019-12-26 10:47:29 +00:00
Christopher Baines 0cea51cc79 Add copyright and license headers to a bunch of source files 
That were missing them.
 2019-12-26 10:16:55 +00:00
Christopher Baines 9ffe884711 Remove a rogue 1 from the (guix-data-service model nar) module 2019-12-26 10:16:16 +00:00
Christopher Baines a3ea38d545 Serve the /nix-cache-info response 
This should be the last piece of the puzzle for providing substitutes for
derivations.
 2019-12-26 10:07:55 +00:00
Christopher Baines 66e886a6b4 Serve narinfo files for derivations 2019-12-26 09:34:43 +00:00
Christopher Baines 120af42c24 Add a function to fetch references for derivations 
This replicates the store item references for the derivation, through looking
up the inputs which the derivation references, and also the sources.
 2019-12-26 09:34:41 +00:00
Christopher Baines e3d8a23716 Add a function to fetch a derivation by file name hash 2019-12-26 09:34:35 +00:00
Christopher Baines b504094262 Use the returned file name in select-derivation-by-file-name 
They should be the same, but it seems more sensible to return the value from
the database.
 2019-12-26 09:34:08 +00:00
Christopher Baines ff01144e87 Create an index for the hash component of derivation filenames 
This is to aid rendering of narinfo files. They're requested with the path
/HASH.narinfo, so to quickly find the relevant derivation, this index can be
used.
 2019-12-26 09:28:20 +00:00
Christopher Baines a8d58e0541 Sort the web modules in the SOURCES list in Makefile.am 2019-12-26 09:28:12 +00:00
Christopher Baines f78e3126e5 Render nar files for derivations 
In the same manor that Guix publish does. This is working towards being able
to serve substitutes for derivations.
 2019-12-26 09:25:27 +00:00
Christopher Baines 43013fc16b Add a "plain" view for derivations 2019-12-26 09:04:53 +00:00
Christopher Baines 16879a8182 Add a helper function to render text 2019-12-26 09:04:46 +00:00
Christopher Baines a92d4d0cf2 Add a function serialize a derivation 
This effectively duplicates the behaviour in Guix for serializing derivations,
but this uses the database representation in the Guix Data Service, rather
than the records Guix uses.
 2019-12-26 09:04:00 +00:00
Christopher Baines 21e298f68c Ensure output ordering for derivations is correct 
This affects the formatted derivation output.
 2019-12-26 09:03:38 +00:00
Christopher Baines dd94f59acf Fix the representation of the fixed output derivation hashes 
Previously, they were nix-base32-string encoded, but the representation in the
derivations is base16, so it doesn't make sense to use a different
representation in the database.

Therefore, add some code that runs before the start of each job to convert the
data in the database. It was easier to do this in Guile with the existing
support for working with these bytevector representations. After some
migration period, the code for converting the old hashes can be removed.
 2019-12-26 08:53:51 +00:00
Christopher Baines 4eb5a3417c Group derivation input outputs together by derivation 
Both in terms of the code fetching the data from the database, as well as the
formatted and detail outputs. This corrects an error in the formatted output
for derivations where inputs would be duplicated.
 2019-12-26 08:52:04 +00:00
Christopher Baines 566f20a03d Use HTTP pipelining when making requests to build servers 
This removes some overhead in making a connection for each request.
 2019-12-26 08:42:44 +00:00
Christopher Baines 801ebdfa9e Fix the successful builds outputs query where there are no revisions 
As it was erroring before.
 2019-12-26 08:35:33 +00:00
Christopher Baines e359cfea2b Fix the derivations list on the builds page 2019-12-23 22:36:53 +00:00
Christopher Baines 5c643e09e5 Fix the unknown build counts on the builds pages 2019-12-23 21:30:36 +00:00
Christopher Baines 474d942cbb Better handle errors within process-load-new-guix-revision-job 2019-12-23 19:28:13 +00:00
Christopher Baines d2e0fc53c1 Fix an error when updating the package derivation versions table 2019-12-23 19:27:42 +00:00
Christopher Baines 96305ec406 Fix the query-build-servers script when no commits are provided 2019-12-23 19:27:23 +00:00