Commit Graph

101 Commits

Author SHA1 Message Date
Jeff 7e92f36b6a disable tests by default
make ci enable tests explicitly
2022-01-25 13:15:37 -05:00
Jeff Becker 8c6bf31c52
paralellize android build much better
* split up configure step and build step so that build steps goes all at once
* update ci to use new build structure for android
2021-11-23 12:43:54 -05:00
Jeff Becker e7d282993a
in static linux ci pipeline disable building lokinet-bootstrap and bundle a bootstrap.signed 2021-11-16 09:43:08 -05:00
Jason Rhinelander 45249422b1 Fetch CI submodules in parallel 2021-10-18 13:50:43 -03:00
Jason Rhinelander 7bc86ff983 Reorder pipelines to put static builds together 2021-10-17 23:44:03 -03:00
Jason Rhinelander 31d2242cc6 Disable ABI warnings on buster/armhf 2021-10-17 23:11:17 -03:00
Jason Rhinelander d27a095f1f Fix arch-specific docker repo names 2021-10-17 18:11:55 -03:00
Jason Rhinelander f71d795f1d Make sure we always pull the latest image 2021-10-17 18:04:34 -03:00
Jason Rhinelander 55356face2 No recommends 2021-10-17 17:33:30 -03:00
Jason Rhinelander 76d69a3d70 Add cached images with debhelper & related tools for deb pipelines 2021-10-17 17:27:40 -03:00
Jason Rhinelander 47d8c95e68 CI docker multiarch
Adds multiarch docker images and starts using them.
2021-10-17 14:46:30 -03:00
Jason Rhinelander 1dccbb5814 Update deb repo dns name 2021-10-16 16:00:27 -03:00
Jason Rhinelander ca9d979361 Docker image updates
- split debian sid into base/sid/clang images
- similarly for debian stable
- add jsonnet to lint
- add `--pull` to docker build so that we always pull the latest images
  (otherwise we were building on whatever local cache we have for
  `debian:sid`, etc., which made the base image update layer much
  larger).
- don't install Recommends by default
- add libzmq3-dev
- split android into android (base) and flutter
- hard-code registry.oxen.rocks into the dockerfile stuff because that
  seems to be the only way to properly depend on other docker builds.
- update a few CI builds that should have been using our images but
  weren't.
- Update a few CI images to bullseye instead of buster

Add openssh-client (for sftp to upload builds)
2021-10-16 15:54:22 -03:00
Jason Rhinelander 6f58648161 Add libzmq3-dev; change deps into arrays
We're currently rebuilding libzmq3-dev all the time in most of the CI
jobs.
2021-10-16 15:16:55 -03:00
Jason Rhinelander 52492c6253 make format 2021-10-16 15:16:55 -03:00
Jason Rhinelander 497c62b586 Update clang build to 13; add full llvm-13 build 2021-10-16 15:16:55 -03:00
Jeff Becker 7d299d1c74
update ci to use main lokinet mobile repo 2021-09-24 17:23:51 -04:00
Jason Rhinelander 53b62857da Disable tests on static bionic
It's failing to link with LTO on bionic because of an internal compiler
error for some random reason, so just disable building the tests there
for now (keeping LTO on is more useful since that is also what gets used
for a static build).
2021-09-03 22:21:45 -03:00
jeff 1272a4fbe1
add dummy sign target for ci when we don't have signing keys
remove static macos from ci pipeline
2021-09-02 14:17:09 -04:00
jeff d24221e67a
make ci run ./contrib/mac.sh with no codesigning 2021-09-02 14:17:09 -04:00
Jeff Becker c39225b3b9
correct lokinet flutter url 2021-09-02 12:03:04 -04:00
Jeff Becker f65ec8e79f
make ci try building the flutter apk in the android apk pipeline 2021-09-02 12:01:36 -04:00
Jeff Becker 2122463d98
pass VERBOSE=1 in ci jobs for full verbosity on builds 2021-06-19 09:35:50 -04:00
Jeff Becker ae186f7000
use $(MAKE) only on makefile generator 2021-06-19 09:35:49 -04:00
Jeff Becker e9a4081451
use make instead of build essential in ci so that it does not conflict with clang builds 2021-06-19 09:35:49 -04:00
Jeff Becker b7485b4b25
* make android ABIS list configurable
* fix android ci jizz, correct typo, upload generated assets
2021-06-19 08:05:05 -04:00
Jeff Becker e5bc34a7b1
[buildsystem] remove use of ninja entirely
* modify contrib/window.sh now uses makefiles
* create contrib/android.sh for building shared libs for android apk
* update drone ci jizz for android
* update cmake/StaticBuild.cmake to use $(MAKE) so that builds can parallelize (super epic)
* remove android directory as it is no longer needed
2021-06-18 11:48:23 -04:00
Jason Rhinelander 4b4d261c02 Limit builds to 6 jobs (4 for arm)
The CI runners don't use fixed CPU cores anymore, so that they can
better allocate jobs across idle cores, but this means ninja's default
is running an insane number of parallel compilations that likely just
makes things slower.

Add 6-job limiting to match the core limits that used to be in place.
2021-04-27 17:34:17 -03:00
Jeff Becker 0c37cc7f60
lokinet-bootstrap native binary 2021-04-15 13:39:45 -04:00
Jason Rhinelander e5aa96ed7c Upgrade to clang-format 11
The formatting changes here are not too large and also nice: in
particular clang-format-11 appears to do better handling of `{...}`
constructor braces/arguments.
2021-03-05 13:36:31 -04:00
Jeff Becker 6c8e5256d6
catchAll -> testAll 2021-03-04 15:45:52 -05:00
lyyn ece91e87fc
Migrate tests from gtest to catch2 2021-03-04 15:41:42 -05:00
Jeff Becker 849c8b6aa8
explicitly turn off setcap on ci builds so they pass 2021-03-04 06:00:03 -05:00
Jason Rhinelander 6c176330a4 Allow multiple gradles to run on the same box
/cache is shared among multiple runners that can potentiall run at
once, but gradle's cache is retarded and just completely blocks anything
from using the cache for the span of the entire build.  Work around it
by sticking the unique builder identifier in the cache path.
2021-03-02 21:23:37 -04:00
Jeff Becker b8d7d0327f
disallow fail on ci pipeline for android builds 2021-03-02 15:21:39 -05:00
Jeff f685d615bf
Merge pull request #1537 from majestrate/android-works-now-2021-02-11
Android
2021-03-02 14:08:40 -05:00
Thomas Winget 4c630e0437 Large collection of changes to make android work
- Previous android java and jni code updated to work, but with much love
  still needed to make it work nicely, e.g. handling when the VPN is
  turned off.

- DNS handling refactored to allow android to intercept and handle DNS
  requests as we can't set the system DNS to use a high port
  (and apparently Chrome ignores system DNS settings anyway)

- add packet router structure to allow separate handling of specific
  intercepted traffic, e.g. UDP traffic to port 53 gets handled by our
  DNS handler rather than being naively forwarded as exit traffic.

- For now, android lokinet is exit-only and hard-coded to use exit.loki
  as its exit.  The exit will be configurable before release, but
  allowing to not use exit-only mode is more of a challenge.

- some old gitignore remnants which were matching to things we don't
  want them to (and are no longer relevant) removed

- some minor changes to CI configuration
2021-03-02 13:18:22 -05:00
Jeff Becker 2655a64da0
redo ci pipeline:
* make cached docker containers for ci
* remove old docker files from root of repo
* use cached docker containers for ci
2021-03-02 07:21:57 -05:00
Jason Rhinelander 231674e5a5 Remove CMAKE_CROSSCOMPILE
We set CMAKE_CROSSCOMPILE in a few places, but that is just a typo for
CMAKE_CROSSCOMPILING.  However we don't need to set it at all: cmake
does so automatically whenever CMAKE_SYSTEM_NAME is set (which is why
our cross compiling actually works currently.)
2021-01-25 13:06:59 -04:00
Jason Rhinelander 60a267a136 Add automake+libtool for libuv static build 2021-01-25 12:58:20 -04:00
Jason Rhinelander b3d2177e73
Fix build server name & path (#1516)
builds.lokinet.dev -> oxen.rocks
/loki-project/ -> /oxen-io/
2021-01-19 07:39:53 -05:00
Jeff Becker f8c0195cfc
add ulimit -n 1024 to mac ci stuff because lol apple 2021-01-12 09:46:44 -05:00
Jason Rhinelander 7ad1030736
Add full-static-deps armhf build (+upload) (#1505)
* Add armhf static build + upload

* openssl build fix for static armhf build

Without this it tries building for arm64.

* Disable LTO for armhf static build

* Fix static lib check for arm
2021-01-04 16:17:29 -05:00
Jason Rhinelander 8e550091ab
Disable LTO on sid for now (#1472) 2020-11-13 09:00:04 -05:00
Jason Rhinelander aa4c4e7453 Install less stuff on windows CI
mingw-w64 is a metapackage that pulls in 4 different compilers
{i686,x86_64}×{-posix,-win32} but we only need x86_64-posix, so just
install that package.
2020-11-10 20:11:29 -04:00
Jason Rhinelander 4eb275324d
Fix deb snapshot builds + misc other CI updates (#1462)
* Remove unneeded libcurl-dev build dep

* Make apt-get operations quieter

* apt repo updates

- store the apt repo gpg pubkey in the repo rather than having to fetch
it every time
- add the apt repo for all the deb builds
- update apt repo URL to deb.loki.network instead of
deb.imaginary.stream

* Use http so that we don't need ca-certificates

The repo packages are already signed so using https really isn't
important.

* Add hack to ignore jsonnet conflicts in deb builds

* Add build machine name to build output

* We don't install any shared libs currently
2020-11-10 05:25:37 -05:00
Jeff 6bca6b3582 Merge remote-tracking branch 'origin/stable' into dev 2020-11-06 13:48:28 -05:00
Jason Rhinelander eea0929077
Move resolvconf from deb branches to contrib/ (#1439)
* Move resolvconf from deb branches to contrib/

This script gets invoked by the systemd service after startup to update
resolvconf with the lokinet dns server.

It was previously living in debian/lokinet-resolvconf in the
debian/ubuntu branches, but really belongs in contrib/ instead.

* Disable LTO on sid gcc/clang-11
2020-10-31 05:21:55 -04:00
Jeff 569bfe14b4
dont do native builds in static linux ci (#1434) 2020-10-30 05:30:23 -04:00
Jason Rhinelander 4f3775c28c
Crank clang version to 11 (#1422) 2020-10-23 18:17:48 -04:00