2016-05-11 19:59:47 +02:00
|
|
|
## Process this file with automake to produce Makefile.in.
|
|
|
|
|
|
2016-11-12 17:58:17 +01:00
|
|
|
# Copyright © 1995-2016 Free Software Foundation, Inc.
|
2017-01-09 00:41:13 +01:00
|
|
|
# Copyright © 2016, 2017 Mathieu Lirzin <mthl@gnu.org>
|
2018-01-22 13:19:55 +01:00
|
|
|
# Copyright © 2018 Ludovic Courtès <ludo@gnu.org>
|
Add support for multiple inputs.
* Makefile.am (dist_sql_DATA): Add src/sql/upgrade-1.sql.
* bin/cuirass.in (show-help, %options, main): Remove the LOAD-PATH option that
was used afterwards as %GUIX-PACKAGE-PATH.
* bin/evaluate.in (absolutize, input-checkout, spec-source, spec-load-path,
spec-package-path, format-checkouts): New procedures.
(%not-colon): Remove variable.
(main): Take the load path, package path and PROC from the checkouts that
result from the inputs. Format the checkouts before sending them to the
procedure. Remove the LOAD-PATH argument.
* doc/cuirass.texi (Overview, Database schema): Document the changes.
* examples/{guix-jobs.scm, hello-git.scm, hello-singleton.scm,
hello-subset.scm, random.scm}: Adapt to the new specification format.
* examples/guix-track-git.scm (package->spec): Rename to PACKAGE->INPUT.
(package->git-tracked): Replace FETCH-REPOSITORY with FETCH-INPUT and handle
the new format of its return value.
* examples/random-jobs.scm (make-random-jobs): Rename RANDOM to CHECKOUT.
Rename the checkout from 'random (which is a specification) to 'cuirass (which
is a checkout resulting from an input).
* src/cuirass/base.scm (fetch-repository): Rename to fetch-input. Rename SPEC
to INPUT. Return a checkout object instead of returning two values.
(evaluate): Take a list of CHECKOUTS and COMMITS as arguments, instead of
SOURCE. Remove TOKENIZE and LOAD-PATH. Pass the CHECKOUTS instead of the
SOURCE to "evaluate". Remove %GUIX-PACKAGE-PATH. Build the EVAL object
instead of getting it from "evaluate".
(compile?, fetch-inputs, compile-checkouts): New procedures.
(process-specs): Fetch all inputs instead of only fetching one repository.
The result of that fetching operation is a list of CHECKOUTS whose COMMITS are
used as a STAMP.
(%guix-package-path, set-guix-package-path): Remove them.
* src/cuirass/database.scm (db-add-input, db-get-inputs): New procedures.
(db-add-specification, db-get-specifications): Adapt to the new specification
format. Add/get all inputs as well.
(db-add-evaluation): Rename REVISION to COMMITS. Store COMMITS as space
separated commit hashes.
(db-get-builds): Rename REPO_NAME to NAME.
(db-get-stamp): Rename COMMIT to STAMP. Return #f when there is no STAMP.
(db-add-stamp): Rename COMMIT to STAMP. Deal with DB-GET-STAMP's new return
value.
(db-get-evaluations): Rename REVISION to COMMITS. Tokenize COMMITS.
* src/cuirass/utils.scm (%non-blocking): Export it.
* src/schema.sql (Inputs): New table that refers to the Specifications table.
(Specifications): Move input related fields to the Inputs table. Rename
REPO_NAME to NAME. Rename ARGUMENTS to PROC_ARGS. Rename FILE to PROC_FILE.
Add LOAD_PATH_INPUTS, PACKAGE_PATH_INPUTS and PROC_INPUT fields that refer to
the Inputs table.
(Stamps): Rename REPO_NAME to NAME.
(Evaluations): Rename REPO_NAME to NAME. Rename REVISION to COMMITS.
(Specifications_index): Replace with Inputs_index.
* src/sql/upgrade-1.sql: New file.
* tests/database.scm (example-spec, make-dummy-eval, sqlite-exec): Adapt to
the new specifications format. Rename REVISION to COMMITS.
* tests/http.scm (evaluations-query-result, fill-db): Idem.
2018-06-26 11:18:23 +02:00
|
|
|
# Copyright © 2018 Clément Lassieur <clement@lassieur.org>
|
Add a web interface.
* Makefile.am (dist_sql_DATA): Add static files.
* src/cuirass/database.scm (assqx-ref): Export it.
(db-get-builds): Add 'evaluation' filter and filters for pagination.
(db-get-evaluations-build-summary, db-get-evaluations-id-min,
db-get-evaluations-id-max, db-get-builds-min, db-get-builds-max): New exported
procedures.
* src/cuirass/http.scm (%static-directory): New parameter.
(%page-size, %file-mime-types, %file-white-list): New variables.
(handle-build-request, handle-builds-request): Move the WITH-CRITICAL-SECTION
call out.
(url-handler): Add RESPOND-HTML, RESPOND-STATIC-FILE and RESPOND-NOT-FOUND
procedures. Call WITH-CRITICAL-SECTION sooner for the '/build',
'/api/latestbuilds' and '/api/queue' routes. Add '/', '/jobset/<name>',
'/eval/<id>', '/static/<path>' routes. Use RESPOND-NOT-FOUND when the route
isn't found.
* src/cuirass/templates.scm: New file.
(html-page, specifications-table, evaluation-info-table,
build-eval-table): New exported procedures.
(pagination): New procedure.
Signed-off-by: Clément Lassieur <clement@lassieur.org>
2018-07-21 15:39:10 +02:00
|
|
|
# Copyright © 2018 Tatiana Sholokhova <tanja201396@gmail.com>
|
2016-11-12 17:58:17 +01:00
|
|
|
#
|
|
|
|
|
# This file is part of Cuirass.
|
|
|
|
|
#
|
|
|
|
|
# Cuirass is free software; you can redistribute it and/or modify
|
|
|
|
|
# it under the terms of the GNU General Public License as published by
|
2017-01-09 00:41:13 +01:00
|
|
|
# the Free Software Foundation; either version 3, or (at your option)
|
2016-11-12 17:58:17 +01:00
|
|
|
# any later version.
|
|
|
|
|
#
|
|
|
|
|
# Cuirass is distributed in the hope that it will be useful,
|
|
|
|
|
# but WITHOUT ANY WARRANTY; without even the implied warranty of
|
|
|
|
|
# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
|
|
|
|
|
# GNU General Public License for more details.
|
|
|
|
|
#
|
|
|
|
|
# You should have received a copy of the GNU General Public License
|
|
|
|
|
# along with Cuirass. If not, see <http://www.gnu.org/licenses/>.
|
|
|
|
|
|
2019-10-21 23:43:16 +02:00
|
|
|
bin_SCRIPTS = bin/cuirass bin/cuirass-send-events bin/evaluate
|
2016-05-11 19:59:47 +02:00
|
|
|
noinst_SCRIPTS = pre-inst-env
|
|
|
|
|
|
2017-05-10 16:32:26 +02:00
|
|
|
guilesitedir = $(datarootdir)/guile/site/@GUILE_EFFECTIVE_VERSION@
|
2017-05-10 16:42:05 +02:00
|
|
|
guileobjectdir = $(libdir)/guile/@GUILE_EFFECTIVE_VERSION@/site-ccache
|
|
|
|
|
|
2016-08-02 17:04:00 +02:00
|
|
|
dist_guilesite_DATA = src/cuirass.scm
|
2017-05-10 16:42:05 +02:00
|
|
|
nodist_guileobject_DATA = $(dist_guilesite_DATA:.scm=.go)
|
2016-08-02 17:04:00 +02:00
|
|
|
|
2017-01-08 18:06:02 +01:00
|
|
|
pkgmoduledir = $(guilesitedir)/$(PACKAGE)
|
2017-05-10 16:42:05 +02:00
|
|
|
pkgobjectdir = $(guileobjectdir)/$(PACKAGE)
|
2018-02-15 10:25:19 +01:00
|
|
|
webmoduledir = $(guilesitedir)/web/server
|
|
|
|
|
webobjectdir = $(guileobjectdir)/web/server
|
Add support for multiple inputs.
* Makefile.am (dist_sql_DATA): Add src/sql/upgrade-1.sql.
* bin/cuirass.in (show-help, %options, main): Remove the LOAD-PATH option that
was used afterwards as %GUIX-PACKAGE-PATH.
* bin/evaluate.in (absolutize, input-checkout, spec-source, spec-load-path,
spec-package-path, format-checkouts): New procedures.
(%not-colon): Remove variable.
(main): Take the load path, package path and PROC from the checkouts that
result from the inputs. Format the checkouts before sending them to the
procedure. Remove the LOAD-PATH argument.
* doc/cuirass.texi (Overview, Database schema): Document the changes.
* examples/{guix-jobs.scm, hello-git.scm, hello-singleton.scm,
hello-subset.scm, random.scm}: Adapt to the new specification format.
* examples/guix-track-git.scm (package->spec): Rename to PACKAGE->INPUT.
(package->git-tracked): Replace FETCH-REPOSITORY with FETCH-INPUT and handle
the new format of its return value.
* examples/random-jobs.scm (make-random-jobs): Rename RANDOM to CHECKOUT.
Rename the checkout from 'random (which is a specification) to 'cuirass (which
is a checkout resulting from an input).
* src/cuirass/base.scm (fetch-repository): Rename to fetch-input. Rename SPEC
to INPUT. Return a checkout object instead of returning two values.
(evaluate): Take a list of CHECKOUTS and COMMITS as arguments, instead of
SOURCE. Remove TOKENIZE and LOAD-PATH. Pass the CHECKOUTS instead of the
SOURCE to "evaluate". Remove %GUIX-PACKAGE-PATH. Build the EVAL object
instead of getting it from "evaluate".
(compile?, fetch-inputs, compile-checkouts): New procedures.
(process-specs): Fetch all inputs instead of only fetching one repository.
The result of that fetching operation is a list of CHECKOUTS whose COMMITS are
used as a STAMP.
(%guix-package-path, set-guix-package-path): Remove them.
* src/cuirass/database.scm (db-add-input, db-get-inputs): New procedures.
(db-add-specification, db-get-specifications): Adapt to the new specification
format. Add/get all inputs as well.
(db-add-evaluation): Rename REVISION to COMMITS. Store COMMITS as space
separated commit hashes.
(db-get-builds): Rename REPO_NAME to NAME.
(db-get-stamp): Rename COMMIT to STAMP. Return #f when there is no STAMP.
(db-add-stamp): Rename COMMIT to STAMP. Deal with DB-GET-STAMP's new return
value.
(db-get-evaluations): Rename REVISION to COMMITS. Tokenize COMMITS.
* src/cuirass/utils.scm (%non-blocking): Export it.
* src/schema.sql (Inputs): New table that refers to the Specifications table.
(Specifications): Move input related fields to the Inputs table. Rename
REPO_NAME to NAME. Rename ARGUMENTS to PROC_ARGS. Rename FILE to PROC_FILE.
Add LOAD_PATH_INPUTS, PACKAGE_PATH_INPUTS and PROC_INPUT fields that refer to
the Inputs table.
(Stamps): Rename REPO_NAME to NAME.
(Evaluations): Rename REPO_NAME to NAME. Rename REVISION to COMMITS.
(Specifications_index): Replace with Inputs_index.
* src/sql/upgrade-1.sql: New file.
* tests/database.scm (example-spec, make-dummy-eval, sqlite-exec): Adapt to
the new specifications format. Rename REVISION to COMMITS.
* tests/http.scm (evaluations-query-result, fill-db): Idem.
2018-06-26 11:18:23 +02:00
|
|
|
sqldir = $(pkgdatadir)/sql
|
Add a web interface.
* Makefile.am (dist_sql_DATA): Add static files.
* src/cuirass/database.scm (assqx-ref): Export it.
(db-get-builds): Add 'evaluation' filter and filters for pagination.
(db-get-evaluations-build-summary, db-get-evaluations-id-min,
db-get-evaluations-id-max, db-get-builds-min, db-get-builds-max): New exported
procedures.
* src/cuirass/http.scm (%static-directory): New parameter.
(%page-size, %file-mime-types, %file-white-list): New variables.
(handle-build-request, handle-builds-request): Move the WITH-CRITICAL-SECTION
call out.
(url-handler): Add RESPOND-HTML, RESPOND-STATIC-FILE and RESPOND-NOT-FOUND
procedures. Call WITH-CRITICAL-SECTION sooner for the '/build',
'/api/latestbuilds' and '/api/queue' routes. Add '/', '/jobset/<name>',
'/eval/<id>', '/static/<path>' routes. Use RESPOND-NOT-FOUND when the route
isn't found.
* src/cuirass/templates.scm: New file.
(html-page, specifications-table, evaluation-info-table,
build-eval-table): New exported procedures.
(pagination): New procedure.
Signed-off-by: Clément Lassieur <clement@lassieur.org>
2018-07-21 15:39:10 +02:00
|
|
|
staticdir = $(pkgdatadir)/static
|
|
|
|
|
cssdir = $(staticdir)/css
|
|
|
|
|
fontsdir = $(staticdir)/fonts
|
|
|
|
|
imagesdir = $(staticdir)/images
|
2017-05-10 16:42:05 +02:00
|
|
|
|
2018-01-22 13:19:55 +01:00
|
|
|
dist_pkgmodule_DATA = \
|
|
|
|
|
src/cuirass/base.scm \
|
|
|
|
|
src/cuirass/database.scm \
|
|
|
|
|
src/cuirass/http.scm \
|
|
|
|
|
src/cuirass/logging.scm \
|
2019-10-21 23:43:16 +02:00
|
|
|
src/cuirass/send-events.scm \
|
2018-01-22 13:19:55 +01:00
|
|
|
src/cuirass/ui.scm \
|
Add a web interface.
* Makefile.am (dist_sql_DATA): Add static files.
* src/cuirass/database.scm (assqx-ref): Export it.
(db-get-builds): Add 'evaluation' filter and filters for pagination.
(db-get-evaluations-build-summary, db-get-evaluations-id-min,
db-get-evaluations-id-max, db-get-builds-min, db-get-builds-max): New exported
procedures.
* src/cuirass/http.scm (%static-directory): New parameter.
(%page-size, %file-mime-types, %file-white-list): New variables.
(handle-build-request, handle-builds-request): Move the WITH-CRITICAL-SECTION
call out.
(url-handler): Add RESPOND-HTML, RESPOND-STATIC-FILE and RESPOND-NOT-FOUND
procedures. Call WITH-CRITICAL-SECTION sooner for the '/build',
'/api/latestbuilds' and '/api/queue' routes. Add '/', '/jobset/<name>',
'/eval/<id>', '/static/<path>' routes. Use RESPOND-NOT-FOUND when the route
isn't found.
* src/cuirass/templates.scm: New file.
(html-page, specifications-table, evaluation-info-table,
build-eval-table): New exported procedures.
(pagination): New procedure.
Signed-off-by: Clément Lassieur <clement@lassieur.org>
2018-07-21 15:39:10 +02:00
|
|
|
src/cuirass/utils.scm \
|
|
|
|
|
src/cuirass/templates.scm
|
2016-06-10 22:27:41 +02:00
|
|
|
|
2017-05-10 16:58:50 +02:00
|
|
|
nodist_pkgmodule_DATA = \
|
|
|
|
|
src/cuirass/config.scm
|
|
|
|
|
|
2017-05-10 16:42:05 +02:00
|
|
|
nodist_pkgobject_DATA = \
|
2016-12-27 12:00:11 +01:00
|
|
|
$(dist_pkgmodule_DATA:.scm=.go) \
|
2016-06-10 18:17:53 +02:00
|
|
|
src/cuirass/config.go
|
2016-05-11 19:59:47 +02:00
|
|
|
|
2018-02-15 10:25:19 +01:00
|
|
|
dist_webmodule_DATA = \
|
|
|
|
|
src/web/server/fiberized.scm
|
|
|
|
|
|
|
|
|
|
nodist_webobject_DATA = \
|
|
|
|
|
$(dist_webmodule_DATA:.scm=.go)
|
|
|
|
|
|
2016-07-16 18:16:39 +02:00
|
|
|
dist_pkgdata_DATA = src/schema.sql
|
|
|
|
|
|
Add support for multiple inputs.
* Makefile.am (dist_sql_DATA): Add src/sql/upgrade-1.sql.
* bin/cuirass.in (show-help, %options, main): Remove the LOAD-PATH option that
was used afterwards as %GUIX-PACKAGE-PATH.
* bin/evaluate.in (absolutize, input-checkout, spec-source, spec-load-path,
spec-package-path, format-checkouts): New procedures.
(%not-colon): Remove variable.
(main): Take the load path, package path and PROC from the checkouts that
result from the inputs. Format the checkouts before sending them to the
procedure. Remove the LOAD-PATH argument.
* doc/cuirass.texi (Overview, Database schema): Document the changes.
* examples/{guix-jobs.scm, hello-git.scm, hello-singleton.scm,
hello-subset.scm, random.scm}: Adapt to the new specification format.
* examples/guix-track-git.scm (package->spec): Rename to PACKAGE->INPUT.
(package->git-tracked): Replace FETCH-REPOSITORY with FETCH-INPUT and handle
the new format of its return value.
* examples/random-jobs.scm (make-random-jobs): Rename RANDOM to CHECKOUT.
Rename the checkout from 'random (which is a specification) to 'cuirass (which
is a checkout resulting from an input).
* src/cuirass/base.scm (fetch-repository): Rename to fetch-input. Rename SPEC
to INPUT. Return a checkout object instead of returning two values.
(evaluate): Take a list of CHECKOUTS and COMMITS as arguments, instead of
SOURCE. Remove TOKENIZE and LOAD-PATH. Pass the CHECKOUTS instead of the
SOURCE to "evaluate". Remove %GUIX-PACKAGE-PATH. Build the EVAL object
instead of getting it from "evaluate".
(compile?, fetch-inputs, compile-checkouts): New procedures.
(process-specs): Fetch all inputs instead of only fetching one repository.
The result of that fetching operation is a list of CHECKOUTS whose COMMITS are
used as a STAMP.
(%guix-package-path, set-guix-package-path): Remove them.
* src/cuirass/database.scm (db-add-input, db-get-inputs): New procedures.
(db-add-specification, db-get-specifications): Adapt to the new specification
format. Add/get all inputs as well.
(db-add-evaluation): Rename REVISION to COMMITS. Store COMMITS as space
separated commit hashes.
(db-get-builds): Rename REPO_NAME to NAME.
(db-get-stamp): Rename COMMIT to STAMP. Return #f when there is no STAMP.
(db-add-stamp): Rename COMMIT to STAMP. Deal with DB-GET-STAMP's new return
value.
(db-get-evaluations): Rename REVISION to COMMITS. Tokenize COMMITS.
* src/cuirass/utils.scm (%non-blocking): Export it.
* src/schema.sql (Inputs): New table that refers to the Specifications table.
(Specifications): Move input related fields to the Inputs table. Rename
REPO_NAME to NAME. Rename ARGUMENTS to PROC_ARGS. Rename FILE to PROC_FILE.
Add LOAD_PATH_INPUTS, PACKAGE_PATH_INPUTS and PROC_INPUT fields that refer to
the Inputs table.
(Stamps): Rename REPO_NAME to NAME.
(Evaluations): Rename REPO_NAME to NAME. Rename REVISION to COMMITS.
(Specifications_index): Replace with Inputs_index.
* src/sql/upgrade-1.sql: New file.
* tests/database.scm (example-spec, make-dummy-eval, sqlite-exec): Adapt to
the new specifications format. Rename REVISION to COMMITS.
* tests/http.scm (evaluations-query-result, fill-db): Idem.
2018-06-26 11:18:23 +02:00
|
|
|
dist_sql_DATA = \
|
database: Merge Derivations into Builds table.
Fixes <https://bugs.gnu.org/32190>.
* Makefile.am (dist_sql_DATA): Add 'src/sql/upgrade-2.sql'.
* doc/cuirass.texi (Derivations): Remove section.
(Builds): Update accordingly. Add columns from the Derivations table.
(Outputs): Replace 'id' with 'derivation'.
* src/cuirass/base.scm (evaluate): Don't add jobs to the Derivations table.
(build-packages): Add columns that were in the Derivations table before. Only
build the derivations that were successfully registered, that is, those that
didn't exist in the Builds table. Give a derivation instead of a build id to
DB-GET-BUILD. Compute the number of failed jobs based on the derivations that
were added to the table, instead of the jobs.
* src/cuirass/database.scm (db-add-derivation, db-get-derivation): Remove
exported procedures.
(db-add-build): Catch SQLITE_CONSTRAINT_PRIMARYKEY error, which means that two
jobs produced the same derivation, and return #f in that case. Add columns
that were in the Derivations table before. Use 'derivation' as primary key
for the Outputs table.
(db-get-outputs): Use 'derivation' as identifier, instead of 'build-id'.
(filters->order): Replace 'id' with 'rowid'.
(db-get-builds): Add a 'derivation' filter. Replace 'id' with 'rowid'.
Remove the 'INNER JOIN Derivations'. Replace Derivations with Builds. Return
'derivation' in first position to make it clear that it's the primary key.
Pass DERIVATION instead of ID to DB-GET-OUTPUTS.
(db-get-build): Allow to take a derivation as argument. Use NUMBER? to
differentiate between derivations and ids.
(db-get-pending-derivations): Remove the 'SELECT DISTINCT' clause now that
derivations are unique. Remove the 'INNER JOIN Builds'.
(db-get-evaluations-build-summary, db-get-builds-min, db-get-builds-max):
Replace 'id' with 'rowid'.
* src/schema.sql (Derivations): Remove table.
(Outputs): Replace Builds.id with Builds.derivation.
(Builds): Use 'derivation' as primary key. Remove the 'id' column. Add
'job_name', 'system', 'nix_name' columns that were in the Derivations table
before.
(Builds_Derivations_index): Rename to Builds_index. Update accordingly.
(Derivations_index): Remove index.
* src/sql/upgrade-2.sql: New file with SQL queries to upgrade the database.
* tests/database.scm (make-dummy-job, make-dummy-derivation): Remove
procedures.
(make-dummy-build): Add columns that were in MAKE-DUMMY-DERIVATION. Get the
DRV parameter to be mandatory because it's a primary key.
(%id): Remove parameter.
("db-add-derivation", "db-get-derivation"): Remove tests.
("db-add-build"): Expect #f, because it adds twice the same derivation. Pass
the derivation argument to MAKE-DUMMY-BUILD.
("db-update-build-status!"): Rename 'id' to 'derivation'. Pass the derivation
argument to MAKE-DUMMY-BUILD. Remove the DB-ADD-DERIVATION call.
("db-get-builds", "db-get-pending-derivations"): Pass the derivation argument
to MAKE-DUMMY-BUILD. Remove the DB-ADD-DERIVATION calls.
* tests/http.scm ("fill-db"): Remove DERIVATION1 and DERIVATION2, and put
their content in BUILD1 and BUILD2. Remove the DB-ADD-DERIVATION calls.
2018-08-01 00:03:12 +02:00
|
|
|
src/sql/upgrade-1.sql \
|
database: Add a Checkouts table.
It is used to know when a new evaluation must be triggered and to display
input changes.
* Makefile.am (dist_sql_DATA): Add 'src/sql/upgrade-3.sql'.
* bin/cuirass.in (main): Call DB-SET-EVALUATION-DONE at startup to clear
'in-progress' evaluations.
* bin/evaluate.in (input-checkout, format-checkouts): Rename '#:name' to
'#:input'.
* doc/cuirass.texi (Stamps): Remove section.
(Checkouts): New section.
* src/cuirass/base.scm (fetch-input, fetch-inputs, compile-checkouts): Rename
'#:name' to '#:input'.
(evaluate): Remove the COMMITS argument. Add an EVAL-ID argument. Don't call
DB-ADD-EVALUATION because it was called sooner. Remove the EVAL-ID argument
to AUGMENT-JOB because it's a closure.
(build-packages): Add an EVAL-ID argument. Call DB-SET-EVALUATION-DONE once
all the derivations are registered.
(process-specs): Replace the stamping mechanism by the primary key constraint
of the Checkouts table: call "evaluate" only when DB-ADD-EVALUATION is true,
which means that at least one checkout was added. Change the EVALUATE and
BUILD-PACKAGES arguments accordingly.
* src/cuirass/database.scm (db-add-stamp, db-get-stamp): Remove procedures.
(db-set-evaluations-done, db-set-evaluation-done): New exported procedure.
(db-add-checkout): New procedure that returns #f if a checkout with the same
revision already exists.
(db-add-evaluation): Replace the EVAL argument with a SPEC-NAME and a
CHECKOUTS arguments. Insert the evaluation only if at least one checkout was
inserted. Return #f otherwise.
(db-get-checkouts): New procedure.
(db-get-evaluations, db-get-evaluations-build-summary): Handle the
'in_progress' column, remove the 'commits' column. Return the result of
DB-GET-CHECKOUTS as part of the evaluation.
* src/cuirass/templates.scm (input-changes, evaluation-badges): New
procedures.
(evaluation-info-table): Rename "Commits" to "Input changes". Use
INPUT-CHANGES to display the input changes that triggered the evaluation. Use
EVALUATION-BADGES to display a message indicating that the evaluation is in
progress.
* src/schema.sql (Stamps): Remove table.
(Checkouts): New table.
(Evaluations): Remove the 'commits' column. Add an 'in_progress' column.
* src/sql/upgrade-3.sql: New file with SQL queries to upgrade the database.
* tests/database.scm (make-dummy-eval): Remove procedure.
(make-dummy-checkouts): New procedure.
("sqlite-exec"): Remove the 'commits' column. Add the 'in_progress' column.
("db-update-build-status!", "db-get-builds", "db-get-pending-derivations"):
Update the arguments of DB-ADD-EVALUATION accordingly.
* tests/http.scm (hash-table=?): Add support for lists of hash tables.
(evaluations-query-result): Replace '#:commits' with '#:checkouts'. Return a
list instead of returning one element, for symmetry.
("fill-db"): Add a new input so that the second checkout can refer to it.
Replace EVALUATION1 and EVALUATION2 with CHECKOUTS1 and CHECKOUTS2. Update
the arguments of DB-ADD-EVALUATION accordingly.
("/api/queue?nr=100"): Take the CAR of the EVALUATIONS-QUERY-RESULT list to
make it symmetrical with the other argument of HASH-TABLE=?.
2018-08-11 20:30:11 +02:00
|
|
|
src/sql/upgrade-2.sql \
|
2018-09-02 09:45:48 +02:00
|
|
|
src/sql/upgrade-3.sql \
|
2019-10-21 23:43:16 +02:00
|
|
|
src/sql/upgrade-4.sql \
|
2020-01-24 20:47:43 +01:00
|
|
|
src/sql/upgrade-5.sql \
|
|
|
|
|
src/sql/upgrade-6.sql
|
Add support for multiple inputs.
* Makefile.am (dist_sql_DATA): Add src/sql/upgrade-1.sql.
* bin/cuirass.in (show-help, %options, main): Remove the LOAD-PATH option that
was used afterwards as %GUIX-PACKAGE-PATH.
* bin/evaluate.in (absolutize, input-checkout, spec-source, spec-load-path,
spec-package-path, format-checkouts): New procedures.
(%not-colon): Remove variable.
(main): Take the load path, package path and PROC from the checkouts that
result from the inputs. Format the checkouts before sending them to the
procedure. Remove the LOAD-PATH argument.
* doc/cuirass.texi (Overview, Database schema): Document the changes.
* examples/{guix-jobs.scm, hello-git.scm, hello-singleton.scm,
hello-subset.scm, random.scm}: Adapt to the new specification format.
* examples/guix-track-git.scm (package->spec): Rename to PACKAGE->INPUT.
(package->git-tracked): Replace FETCH-REPOSITORY with FETCH-INPUT and handle
the new format of its return value.
* examples/random-jobs.scm (make-random-jobs): Rename RANDOM to CHECKOUT.
Rename the checkout from 'random (which is a specification) to 'cuirass (which
is a checkout resulting from an input).
* src/cuirass/base.scm (fetch-repository): Rename to fetch-input. Rename SPEC
to INPUT. Return a checkout object instead of returning two values.
(evaluate): Take a list of CHECKOUTS and COMMITS as arguments, instead of
SOURCE. Remove TOKENIZE and LOAD-PATH. Pass the CHECKOUTS instead of the
SOURCE to "evaluate". Remove %GUIX-PACKAGE-PATH. Build the EVAL object
instead of getting it from "evaluate".
(compile?, fetch-inputs, compile-checkouts): New procedures.
(process-specs): Fetch all inputs instead of only fetching one repository.
The result of that fetching operation is a list of CHECKOUTS whose COMMITS are
used as a STAMP.
(%guix-package-path, set-guix-package-path): Remove them.
* src/cuirass/database.scm (db-add-input, db-get-inputs): New procedures.
(db-add-specification, db-get-specifications): Adapt to the new specification
format. Add/get all inputs as well.
(db-add-evaluation): Rename REVISION to COMMITS. Store COMMITS as space
separated commit hashes.
(db-get-builds): Rename REPO_NAME to NAME.
(db-get-stamp): Rename COMMIT to STAMP. Return #f when there is no STAMP.
(db-add-stamp): Rename COMMIT to STAMP. Deal with DB-GET-STAMP's new return
value.
(db-get-evaluations): Rename REVISION to COMMITS. Tokenize COMMITS.
* src/cuirass/utils.scm (%non-blocking): Export it.
* src/schema.sql (Inputs): New table that refers to the Specifications table.
(Specifications): Move input related fields to the Inputs table. Rename
REPO_NAME to NAME. Rename ARGUMENTS to PROC_ARGS. Rename FILE to PROC_FILE.
Add LOAD_PATH_INPUTS, PACKAGE_PATH_INPUTS and PROC_INPUT fields that refer to
the Inputs table.
(Stamps): Rename REPO_NAME to NAME.
(Evaluations): Rename REPO_NAME to NAME. Rename REVISION to COMMITS.
(Specifications_index): Replace with Inputs_index.
* src/sql/upgrade-1.sql: New file.
* tests/database.scm (example-spec, make-dummy-eval, sqlite-exec): Adapt to
the new specifications format. Rename REVISION to COMMITS.
* tests/http.scm (evaluations-query-result, fill-db): Idem.
2018-06-26 11:18:23 +02:00
|
|
|
|
Add a web interface.
* Makefile.am (dist_sql_DATA): Add static files.
* src/cuirass/database.scm (assqx-ref): Export it.
(db-get-builds): Add 'evaluation' filter and filters for pagination.
(db-get-evaluations-build-summary, db-get-evaluations-id-min,
db-get-evaluations-id-max, db-get-builds-min, db-get-builds-max): New exported
procedures.
* src/cuirass/http.scm (%static-directory): New parameter.
(%page-size, %file-mime-types, %file-white-list): New variables.
(handle-build-request, handle-builds-request): Move the WITH-CRITICAL-SECTION
call out.
(url-handler): Add RESPOND-HTML, RESPOND-STATIC-FILE and RESPOND-NOT-FOUND
procedures. Call WITH-CRITICAL-SECTION sooner for the '/build',
'/api/latestbuilds' and '/api/queue' routes. Add '/', '/jobset/<name>',
'/eval/<id>', '/static/<path>' routes. Use RESPOND-NOT-FOUND when the route
isn't found.
* src/cuirass/templates.scm: New file.
(html-page, specifications-table, evaluation-info-table,
build-eval-table): New exported procedures.
(pagination): New procedure.
Signed-off-by: Clément Lassieur <clement@lassieur.org>
2018-07-21 15:39:10 +02:00
|
|
|
dist_css_DATA = \
|
2020-04-15 19:52:31 +02:00
|
|
|
src/static/css/cuirass.css \
|
Add a web interface.
* Makefile.am (dist_sql_DATA): Add static files.
* src/cuirass/database.scm (assqx-ref): Export it.
(db-get-builds): Add 'evaluation' filter and filters for pagination.
(db-get-evaluations-build-summary, db-get-evaluations-id-min,
db-get-evaluations-id-max, db-get-builds-min, db-get-builds-max): New exported
procedures.
* src/cuirass/http.scm (%static-directory): New parameter.
(%page-size, %file-mime-types, %file-white-list): New variables.
(handle-build-request, handle-builds-request): Move the WITH-CRITICAL-SECTION
call out.
(url-handler): Add RESPOND-HTML, RESPOND-STATIC-FILE and RESPOND-NOT-FOUND
procedures. Call WITH-CRITICAL-SECTION sooner for the '/build',
'/api/latestbuilds' and '/api/queue' routes. Add '/', '/jobset/<name>',
'/eval/<id>', '/static/<path>' routes. Use RESPOND-NOT-FOUND when the route
isn't found.
* src/cuirass/templates.scm: New file.
(html-page, specifications-table, evaluation-info-table,
build-eval-table): New exported procedures.
(pagination): New procedure.
Signed-off-by: Clément Lassieur <clement@lassieur.org>
2018-07-21 15:39:10 +02:00
|
|
|
src/static/css/bootstrap.css \
|
|
|
|
|
src/static/css/open-iconic-bootstrap.css
|
|
|
|
|
dist_fonts_DATA = \
|
|
|
|
|
src/static/fonts/open-iconic.eot \
|
|
|
|
|
src/static/fonts/open-iconic.otf \
|
|
|
|
|
src/static/fonts/open-iconic.svg \
|
|
|
|
|
src/static/fonts/open-iconic.ttf \
|
|
|
|
|
src/static/fonts/open-iconic.woff
|
|
|
|
|
dist_images_DATA = \
|
|
|
|
|
src/static/images/logo.png
|
|
|
|
|
|
2016-07-03 16:50:27 +02:00
|
|
|
TEST_EXTENSIONS = .scm .sh
|
|
|
|
|
AM_TESTS_ENVIRONMENT = \
|
|
|
|
|
env GUILE_AUTO_COMPILE='0' \
|
|
|
|
|
testsrcdir='$(abs_top_srcdir)/tests' \
|
2016-12-24 01:08:04 +01:00
|
|
|
testbuilddir='$(abs_top_builddir)/tests'
|
2016-05-11 19:59:47 +02:00
|
|
|
|
2018-01-07 10:45:06 +01:00
|
|
|
SCM_LOG_DRIVER = \
|
|
|
|
|
$(top_builddir)/pre-inst-env $(GUILE) \
|
|
|
|
|
-L "$(abs_top_srcdir)" -e main \
|
|
|
|
|
$(top_srcdir)/build-aux/test-driver.scm
|
2016-05-11 19:59:47 +02:00
|
|
|
|
2016-07-03 16:50:27 +02:00
|
|
|
SH_LOG_COMPILER = $(top_builddir)/pre-inst-env $(SHELL)
|
|
|
|
|
AM_SH_LOG_FLAGS = -x -e
|
|
|
|
|
|
2016-06-26 15:13:31 +02:00
|
|
|
TESTS = \
|
|
|
|
|
tests/base.scm \
|
2016-07-12 11:42:20 +02:00
|
|
|
## tests/basic.sh # takes too long to execute
|
2016-07-02 03:35:19 +02:00
|
|
|
tests/database.scm \
|
2016-07-30 23:00:41 +02:00
|
|
|
tests/http.scm \
|
2016-07-14 17:56:27 +02:00
|
|
|
tests/ui.scm \
|
2016-07-02 03:35:19 +02:00
|
|
|
tests/utils.scm
|
2016-05-11 19:59:47 +02:00
|
|
|
|
|
|
|
|
# Unset 'GUILE_LOAD_COMPILED_PATH' altogether while compiling. Otherwise, if
|
2016-07-27 11:44:45 +02:00
|
|
|
# $GUILE_LOAD_COMPILED_PATH contains $(pkgmoduledir), we may find .go files in
|
|
|
|
|
# there that are newer than the local .scm files (for instance because the
|
|
|
|
|
# user ran 'make install' recently). When that happens, we end up loading
|
|
|
|
|
# those previously-installed .go files, which may be stale, thereby breaking
|
|
|
|
|
# the whole thing. Set GUILE_AUTO_COMPILE to 0 to avoid auto-compiling guild.
|
2016-05-11 19:59:47 +02:00
|
|
|
#
|
|
|
|
|
# XXX: Use the C locale for when Guile lacks
|
|
|
|
|
# <http://git.sv.gnu.org/cgit/guile.git/commit/?h=stable-2.0&id=e2c6bf3866d1186c60bacfbd4fe5037087ee5e3f>.
|
|
|
|
|
.scm.go:
|
|
|
|
|
$(guilec_verbose)$(MKDIR_P) `dirname "$@"`; \
|
|
|
|
|
export GUILE_AUTO_COMPILE=0 ; unset GUILE_LOAD_COMPILED_PATH; \
|
|
|
|
|
LC_ALL=C \
|
|
|
|
|
$(top_builddir)/pre-inst-env $(GUILD) compile \
|
|
|
|
|
--load-path="$(top_builddir)/src" \
|
|
|
|
|
--load-path="$(top_srcdir)/src" \
|
|
|
|
|
--warn=format --warn=unbound-variable --warn=arity-mismatch \
|
|
|
|
|
--target="$(host)" --output="$@" "$<" $(devnull_verbose)
|
|
|
|
|
|
2018-02-15 10:25:19 +01:00
|
|
|
CLEANFILES = \
|
|
|
|
|
$(nodist_guilesite_DATA) \
|
|
|
|
|
$(dist_pkgmodule_DATA:.scm=.go) \
|
|
|
|
|
$(nodist_webobject_DATA) \
|
2018-02-15 10:27:12 +01:00
|
|
|
$(nodist_guileobject_DATA) \
|
2016-12-25 12:43:45 +01:00
|
|
|
src/cuirass/config.go
|
2016-05-11 19:59:47 +02:00
|
|
|
|
2016-07-21 17:42:55 +02:00
|
|
|
.PHONY: sql-check
|
|
|
|
|
sql-check: src/schema.sql
|
|
|
|
|
@echo "$<"
|
|
|
|
|
$(AM_V_at)sqlite3 tmp-$$$.db < $< ; \
|
|
|
|
|
rm tmp-$$$.db
|
|
|
|
|
|
2016-12-25 12:43:45 +01:00
|
|
|
## -------------- ##
|
|
|
|
|
## Distribution. ##
|
|
|
|
|
## -------------- ##
|
|
|
|
|
|
2016-05-11 19:59:47 +02:00
|
|
|
EXTRA_DIST = \
|
|
|
|
|
.dir-locals.el \
|
2016-11-12 17:36:18 +01:00
|
|
|
bin/cuirass.in \
|
2019-10-21 23:43:16 +02:00
|
|
|
bin/cuirass-send-events.in \
|
2016-11-12 17:36:18 +01:00
|
|
|
bin/evaluate.in \
|
2016-08-02 18:38:39 +02:00
|
|
|
bootstrap \
|
2016-12-29 00:17:27 +01:00
|
|
|
build-aux/guix.scm \
|
2016-11-12 16:23:00 +01:00
|
|
|
src/cuirass/config.scm.in \
|
2016-05-11 19:59:47 +02:00
|
|
|
$(TESTS)
|
|
|
|
|
|
2016-12-25 12:43:45 +01:00
|
|
|
dist-hook: gen-ChangeLog
|
|
|
|
|
$(AM_V_GEN)echo $(VERSION) > $(distdir)/.tarball-version
|
|
|
|
|
|
|
|
|
|
.PHONY: gen-ChangeLog
|
|
|
|
|
gen-ChangeLog:
|
|
|
|
|
$(AM_V_GEN)if test -d $(srcdir)/.git; then \
|
|
|
|
|
log_fix="$(srcdir)/build-aux/git-log-fix"; \
|
|
|
|
|
test -e "$$log_fix" \
|
|
|
|
|
&& amend_git_log="--amend=$$log_fix" \
|
|
|
|
|
|| amend_git_log=; \
|
|
|
|
|
$(top_srcdir)/build-aux/gitlog-to-changelog \
|
|
|
|
|
$$amend_git_log > $(distdir)/cl-t && \
|
|
|
|
|
{ rm -f $(distdir)/ChangeLog && \
|
|
|
|
|
mv $(distdir)/cl-t $(distdir)/ChangeLog; } \
|
|
|
|
|
fi
|
2016-05-11 19:59:47 +02:00
|
|
|
|
2016-11-12 16:23:00 +01:00
|
|
|
## ----------------- ##
|
|
|
|
|
## Generated files. ##
|
|
|
|
|
## ----------------- ##
|
|
|
|
|
|
|
|
|
|
# 'AC_CONFIG_FILES' doesn't fully expand variables that depend on ${prefix}.
|
|
|
|
|
# To use such variables in source files and scripts while following GNU Coding
|
|
|
|
|
# Standards, let 'make' manage their replacement.
|
|
|
|
|
|
|
|
|
|
# Use config.status to substitute the remainder where a single expansion is
|
|
|
|
|
# sufficient. We use a funny notation here to avoid configure substitutions
|
|
|
|
|
# in our text.
|
|
|
|
|
do_subst = ( $(SED) \
|
|
|
|
|
-e "s,@configure_input[@],Generated from $$in. Do not edit by hand.,g" \
|
|
|
|
|
-e 's,@datadir[@],$(datadir),g' \
|
2016-11-12 17:36:18 +01:00
|
|
|
-e 's,@GUILE[@],$(GUILE),g' \
|
2016-11-12 16:23:00 +01:00
|
|
|
-e 's,@localstatedir[@],$(localstatedir),g' \
|
2017-05-10 16:58:50 +02:00
|
|
|
-e 's,@PACKAGE_LOAD_COMPILED_PATH[@],$(guileobjectdir),g' \
|
2016-12-24 01:08:04 +01:00
|
|
|
-e 's,@PACKAGE_LOAD_PATH[@],$(guilesitedir),g' \
|
2016-11-12 16:23:00 +01:00
|
|
|
| $(SHELL) ./config.status --file=- )
|
|
|
|
|
|
|
|
|
|
# Generic instructions to perform the substitution. Generated files shouldn't
|
|
|
|
|
# contain unexpanded '@substitutions@', and should be made read-only, to
|
2016-12-27 12:04:43 +01:00
|
|
|
# prevent them from being edited by mistake instead of the file they are
|
2016-11-12 16:23:00 +01:00
|
|
|
# generated from.
|
|
|
|
|
generate_file = \
|
|
|
|
|
$(AM_V_GEN)rm -f $@ $@-t; \
|
|
|
|
|
$(MKDIR_P) $(@D); \
|
|
|
|
|
in=$@.in && $(do_subst) <$(srcdir)/$$in >$@-t; \
|
|
|
|
|
if LC_ALL=C grep '@[a-zA-Z0-9_][a-zA-Z0-9_]*@' $@-t; then \
|
|
|
|
|
echo "$@ contains unexpanded substitution (see lines above)"; \
|
|
|
|
|
exit 1; \
|
|
|
|
|
fi; \
|
|
|
|
|
chmod a-w $@-t; mv -f $@-t $@
|
|
|
|
|
|
2016-11-12 17:36:18 +01:00
|
|
|
# These files depend on Makefile so they are rebuilt if $(VERSION),
|
2016-11-12 16:23:00 +01:00
|
|
|
# $(datadir) or other do_subst'ituted variables change.
|
2016-11-12 17:36:18 +01:00
|
|
|
bin/cuirass: $(srcdir)/bin/cuirass.in
|
2019-10-21 23:43:16 +02:00
|
|
|
bin/cuirass-send-events: $(srcdir)/bin/cuirass-send-events.in
|
2016-11-12 17:36:18 +01:00
|
|
|
bin/evaluate: $(srcdir)/bin/evaluate.in
|
|
|
|
|
$(bin_SCRIPTS): Makefile
|
|
|
|
|
$(generate_file); chmod +x $@
|
2016-11-12 16:23:00 +01:00
|
|
|
src/cuirass/config.scm: $(srcdir)/src/cuirass/config.scm.in Makefile
|
|
|
|
|
$(generate_file)
|
|
|
|
|
|
2016-11-13 00:46:53 +01:00
|
|
|
# Guile modules require 'src/cuirass/config.scm' to exist before their
|
|
|
|
|
# compilation.
|
2017-01-10 08:59:57 +01:00
|
|
|
BUILT_SOURCES = src/cuirass/config.scm
|
2016-12-25 12:43:45 +01:00
|
|
|
|
|
|
|
|
MOSTLYCLEANFILES = $(bin_SCRIPTS) src/cuirass/config.scm
|
2016-11-12 16:23:00 +01:00
|
|
|
|
2016-12-02 15:57:06 +01:00
|
|
|
## --------------- ##
|
|
|
|
|
## Documentation. ##
|
|
|
|
|
## --------------- ##
|
|
|
|
|
|
|
|
|
|
info_TEXINFOS = doc/cuirass.texi
|
|
|
|
|
doc_cuirass_TEXINFOS = doc/fdl-1.3.texi
|
|
|
|
|
|
2016-12-16 13:39:51 +01:00
|
|
|
# Install the examples.
|
2018-01-29 22:15:51 +01:00
|
|
|
nobase_dist_pkgdata_DATA = \
|
|
|
|
|
examples/random.scm \
|
|
|
|
|
examples/random-jobs.scm \
|
|
|
|
|
examples/gnu-system.scm \
|
|
|
|
|
examples/guix-jobs.scm \
|
|
|
|
|
examples/hello-singleton.scm \
|
2016-12-16 13:39:51 +01:00
|
|
|
examples/hello-subset.scm
|
|
|
|
|
|
2016-11-12 17:36:18 +01:00
|
|
|
## -------------- ##
|
|
|
|
|
## Installation. ##
|
|
|
|
|
## -------------- ##
|
|
|
|
|
|
2016-12-24 01:08:04 +01:00
|
|
|
# Ensure that the scripts will find their module directories.
|
2016-11-12 17:36:18 +01:00
|
|
|
install-exec-hook:
|
|
|
|
|
$(SED) \
|
2016-12-24 01:08:04 +01:00
|
|
|
-e 's,^#GUILE_LOAD,GUILE_LOAD,g' \
|
2016-11-12 17:36:18 +01:00
|
|
|
-i $(DESTDIR)$(bindir)/cuirass
|
|
|
|
|
|
2016-05-11 19:59:47 +02:00
|
|
|
## -------------- ##
|
|
|
|
|
## Silent rules. ##
|
|
|
|
|
## -------------- ##
|
|
|
|
|
|
|
|
|
|
guilec_verbose = $(guilec_verbose_@AM_V@)
|
|
|
|
|
guilec_verbose_ = $(guilec_verbose_@AM_DEFAULT_V@)
|
|
|
|
|
guilec_verbose_0 = @echo " GUILEC " $@;
|
|
|
|
|
|
|
|
|
|
devnull_verbose = $(devnull_verbose_@AM_V@)
|
|
|
|
|
devnull_verbose_ = $(devnull_verbose_@AM_DEFAULT_V@)
|
|
|
|
|
devnull_verbose_0 = >/dev/null
|
