Commit graph

251 commits

Author SHA1 Message Date
Bryan Drewery
a1ffc5fedd - Update to 3.3.0-253-g531ee09f6
* queue: Fix unqueueable command error message
 * Fix BASEFS error / first-time setup blockers.
 * bulk: Fix non-existent dependencies claiming to be moved.
2020-03-26 20:47:39 +00:00
Bryan Drewery
253a3191ea - Update to 3.3.0-253-g531ee09f6
* Minor perf improvements for builtins.
 * Fix html with port named "latest".
 * testport / bulk -t: Set DEVELOPER in patch phase.
 * image: Make iso images bootable in UEFI
2020-03-24 18:29:22 +00:00
Bryan Drewery
bfb88d1d3b - Update to 3.3.0-229-gce2011f23
* Pass MAKEWORLDARGS during installworld too
  * bulk/testport: Initial support for ports OVERLAYS
  * testport: Show log info on failure exit
  * jail -d: Don't confirm if the jail doesn't exist
  * jail -c: Fix NO_LIB32 support
  * jail -i: Don't show ports tree info if not requested
  * bulk: Compute queued stats after trimming ignored AND trimming queue.
  * Various fixes and expansion of sh mapfile support
  * Always export `LC_COLLATE=C`
2019-12-10 17:58:02 +00:00
Bryan Drewery
dfd51ffcd3 - Update to 3.3.0-164-g122329edc
- distclean: Remove empty directories
 - Fix wrkdir saving with FLAVOR'd ports
 - manpage: Cleanup poudriere-jail and poudriere-bulk
 - image: Warn if MFSROOT is too large
 - bulk: Allow overriding nullfs-mounted paths with NULLFS_PATHS
 - bulk: Add additional cases for kern.securelevel assertion
2019-08-28 20:20:02 +00:00
Bryan Drewery
d77dd60b71 - Update to 3.3.0-126-g12112ee57
- image: Fix error with non-existent /etc/login.conf.orig
2019-08-15 19:58:27 +00:00
Bryan Drewery
5fa772b943 - Update to 3.3.0-125-g0a50192f8
- bulk: Process IGNORE/BLACKLIST before build.
 - Add job status to saving workdir on build failure.
 - ports -u: Add 'ports_update done' hook.
2019-08-03 17:41:29 +00:00
Bryan Drewery
30dafc4625 - Update to 3.3.0-90-gd6f021339
- Add DISALLOW_NETWORKING, fixes #689
 - qemu: Add /usr/bin/wc and /usr/bin/head to HLINK_FILES.
 - image: Add zsnapshot imagetype.
 - Fix pkg 1.11 issue with devfs mount.
 - bulk -a: Don't print ports in summary unless -v is used.
 - Show FLAVOR in more places.
 - ports -l: Fix error when no ports trees exist yet.
 - testport -c: Fix make.conf not being respected for `make config`.
 - image: Add sleep, ls, and ping to miniroot.
2019-07-24 16:21:37 +00:00
Baptiste Daroussin
11ffe03b2c Fix poudriere image with pkg 1.11 2019-06-13 12:49:09 +00:00
Bryan Drewery
aefa286183 Update to 3.3.0-62-g5abf90c67
- Minor updates to blacklist processing (should be NOP)
2019-03-11 20:13:02 +00:00
Bryan Drewery
4116991e7f - Update to 3.3.0-59-g6e1132813
- poudriere: Only pass MAKEOBJDIRPREFIX to 'jail'
 - Document environment fully for poudriere/-jail/-ports.
 - Revert progress indicator
 - poudriere: Fix all environment to be space/quote safe.
 - jail/ports -l: Avoid printing empty columns/trailing whitespace.
 - jail -c -m null/tar/src: Again require -v if newvers.sh is not readable.
 - Show proper errors for missing jail metadata.
 - poudriere-jail.8: jail -m null does NOT null-mount during build.
 - jail -c: Defer pwd_mkdb until bulk's jail_start() call.
 - jail -cu: Stop modifying /etc/login.conf in the jail.
 - Slightly speedup MOVED parsing
2019-03-09 18:51:49 +00:00
Bryan Drewery
af8fe7673b Update to 3.3.0-36-g824cd5d40
* Fix status sed/regex error on 11/head.
 * Fix some bogus 'pwait: No such process' warnings.
 * image -t firmware: Fix installation of /usr/local/etc files (#637).
 * image -f: Fix @flavor support.
 * image: Fix errors calculating IMAGESIZE when not needed (like -t tar).
 * image: Fix cleaning up temporary files properly when USE_TMPFS=all is used.
2019-03-01 00:52:44 +00:00
Bryan Drewery
8e70503ccb Update to 3.3.30 release.
No changes.
2019-02-26 18:22:46 +00:00
Bryan Drewery
884c315c62 - Update to 3.2.8-438-ga95f2cbfe
- Fix symlinked POUDRIERE_DATA unmount bug.
 - testport: Fix ports-mgmt/pkg Latest link leaking into real package repository.
 - bulk/status: Display the progress indicator extracted from build logs.

This will be 3.3.0.
2019-02-25 21:54:32 +00:00
Bryan Drewery
78848ce91e - Update to 3.2.8-432-g070fc33be
- Update sh from head r343981
 - Add a builtin for simple string substitutions
 - Fix some invalid memset(3)
 - mapfile fixes and tests
 - Micro-optimize some hash functions to save around 30%
 - Inline some mapfile checks
 - Manpage updates/fixes
2019-02-12 20:33:54 +00:00
Bryan Drewery
32e7c41f16 - Update to 3.2.8-402-g73eefa2e6
- Replace portsmon links with freshports.
 - Document that hook plugins can provide make.conf, but not with filename patterns.
 - pkgclean: Ensure -j is passed in.
 - Create a dataset for poudriere/data/images during initial setup (#630)
 - image -t zrawdisk: Load the ZFS module at boot, so the filesystem can be
   mounted (#633)
 - image -t zrawdisk: Fix check for IMAGESIZE (#634)
 - image: On failure, don't leave md(4) devices laying around (#635)
 - image: When copying the contents of an overlay, copy symlinks as
   symlinks (#636)
 - Update sh to r338473
 - bulk -cC: Prompt to delete if not in a TTY.
   - Only prompt when ATOMIC_PACKAGE_REPOSITORY is off.
   - Only prompt if there are packages to remove.
 - ATOMIC_PACKAGE_REPOSITORY: Be a bit more verbose about packages directory
   paths.
 - image: Add bytes to bibytes conversion regarding image size (#638)
 - image: Add dump support (#644)
 - Update zsh completion
2018-10-24 22:17:03 +00:00
Bryan Drewery
e56e26d6f9 - Update to 3.2.7-372-g6125e0831
Very minor chase of 3.2.7.

  - HTML: Reset error load counter on successful load
2018-06-01 18:36:06 +00:00
Bryan Drewery
5408e94fa1 - Update to 3.2.6-369-g91f1ddf5f
- jail -u freebsd-update: Auto confirm prompts
  - bulk tests: Don't let system perl interfere with the partial tree used.
  - compute_deps: Determine all errors before bailing out
2018-05-11 17:09:06 +00:00
Joseph Mingrone
5d3b4406b3 ports-mgmt/poudriere-devel: Fix plist issue with completion options 2018-03-28 18:38:20 +00:00
Bryan Drewery
8a4c4fcb59 - Update to 3.2.5-363-g9c2944629
- Add BASH option for completion installation

  - ports_env: set UID=0 to avoid id -u lookups.
  - Remove USE_PTSORT=no support and only use ptsort.
  - Remove POOL_BUCKETS option
  - Only set POOL_BUCKET_DIRS from load_priorities()
  - SIGINFO: Reverse phase and total times to: phase / total
    The original change order was confusing but so is the change.  It may
    ultimately be reverted.
  - USE_CACHED=yes: Block using this as it does not work.
  - Fix '3: Bad file descriptor' on crashed build
  - Format crashed build with JOB_ID if possible
  - MUTABLE_BASE=schg: Exclude immutable paths from mtree comparisons
  - markfs: No need to rewrite the mtree file every time, just share it from
    MASTERMNT
  - Always null-mount ro /usr/lib32
  - Remove references to INDEX - support removed in 0bef52955606412ac64aceddde6
  - MUTABLE_BASE=schg: Need to track flags for mtree
  - MUTABLE_BASE=schg mtree: Don't ignore changes to schg files with testport
    or bulk -t
  - Remove some shash buckets once no longer needed.
  - Fix some error spam in bulk.
  - Exclude /root from build_fs_violation.
  - MUTABLE_BASE=schg: Allow writing new files to /boot.
  - Move ALLOW_MAKE_JOBS_PACKAGES handle to remove misleading DISABLE_MAKE_JOBS
    in buildlog make.conf
  - bulk: Spawn builds in their own process group.
    Block SIGTTOU/SIGTTIN to avoid stopping on tty access.
  - kill_job: Don't show jobid warning.
  - Close stdin at exit in case an interrupted redirection is referencing the
    jail which results in umount warnings.
  - processonelog: Detect pkg's conflict line
  - processonelog: Try to detect immutable base failures
  - Create /home and /usr/home paths in port build startup
  - MUTABLE_BASE=schg: Allow writing to /usr/home
  - poudriere: Default -e to /usr/local/etc for non-install executions
  - options: Don't pass FLAVOR as a make arg - which may break downstream ports
  - testport -c: Don't pass FLAVOR as a make argument
  - testport: Show log summary at the end
  - Support PKG_NOCOMPRESS in make.conf
  - CCACHE_STATIC_PREFIX: Add CCACHE_JAIL_PREFIX for overriding /ccache in jail
  - MUTABLE_BASE=schg + CCACHE_STATIC_PREFIX: Allow ccache-update-links to work
    properly
  - Add bash completion script
  - Don't consider /var/crash/*.core as build_fs_violations
2018-03-28 17:57:02 +00:00
Bryan Drewery
88b736acb1 - Update to 3.2.5-303-g3a844af55
- distclean: Suck in ports_env which brings a big performance improvement.
  - bulk: Add validation to check for dependencies with empty FLAVOR 'foo/bar@'
2018-03-13 17:23:39 +00:00
Bryan Drewery
25d6d64a4c - Update to 3.2.5-300-g71e9aeef4
- Split poudriere.8 into subpages.
      - jail -x: Fix error installing /nxb-bin with HEAD host 11 jail
      - Fix double error when a dependency error is found.
      - testport: Trim away excess '/' as done for bulk and dependencies.
      - Fix finding aarch64 binutils for <head after ports r461058.
2018-03-09 19:52:54 +00:00
Bryan Drewery
c7bd2814f6 - Update to 3.2.4-291-gba0af1a2a
- jail -s: Always start with MUTABLE_BASE=yes
  - Avoid copying or comparing /var/db/etcupdate into the jails.
  - Add a MUTABLE_BASE=schg (rename 'no' to 'nullfs' and default to 'schg')
    for testing.  This will significantly reduce files copied during jail
    rollback between package builds.  It is supported on USE_TMPFS=all and
    NO_ZFS=yes.  It restricts writes to only /boot /etc /root /var and
    /usr/local.  Custom PREFIX/LOCALBASE likely won't work yet.
2018-03-07 17:59:43 +00:00
Bryan Drewery
147417f09c - Update to 3.2.4-282-g49422b58a
- Sort some usage output.
 - Manpage cleanup.
 - bulk: use buffered reads for various operations.
 - timestamp: rewritten.
 - Add more tests.
 - Various performance improvements.
 - TMPFS_ALL: reduce tmpfs lock contention for builder rollbacks.
 - Reduce proctree lock contention.
 - Fix null-mounting of /rescue.
 - Null-mount /usr/share and /usr/tests.
 - Add a foreachport sub-command for running arbitrary commands against ports.
   This is quite new and still under development.
 - Fix shared locks not properly handling stale locks.
 - image: Fix default permissions to cfg and data partitions
2018-03-04 23:00:47 +00:00
Bryan Drewery
71088579f6 Fix jail cleanup waiting too long on HTML JSON process to exit 2018-02-22 05:52:57 +00:00
Bryan Drewery
7674aff6de HTML: Hide harmless shared lock failures 2018-02-13 04:57:22 +00:00
Brad Davis
a32950c90d Fix a missing fi when building an image.
Approved by:	bdrewery (maintainer)
2018-02-06 16:33:15 +00:00
Bryan Drewery
95de9c8195 - bulk: Fix skipping failed packages.
- Add CERTS option to allow disabling ca_root_nss and freebsd-release-manifests
  dependencies.
2018-02-02 18:25:38 +00:00
Bryan Drewery
a39aa5c7cc Minor bug with skipped packages found that is being fixed 2018-02-02 18:08:56 +00:00
Bryan Drewery
4c7e124429 - Update to 3.2.4-148-g1f555127
- Add dialog4ports as a dependency since 'options' requires it. [1]

 - image: Allow hostname to be empty for machines that get their hostname
   from DHCP
 - Force unmount if the non-busy unmount fails
 - bulk: Rework queue handling to avoid hitting 32k link limit on tmpfs on
   older releases.
 - Remove the need for a separate clean.sh to be called for queue cleanup.
 - Update poudriere.conf example to use ZPOOL=zroot as installer has
 - SIGINFO: Show phase time as well
 - Use PKG_EXT in more needed places (working on PKG_NOCOMPRESS still)
 - Avoid two builds stomping on the shared HTML assets directory
 - Fix MOVED handling for new flavor.
 - HTML: Serialize access to jail and top .data.json files

PR:		22547 [1]
Submitted by:	Yasuhiro KIMURA <yasu@utahime.org> [1]
2018-02-02 18:05:09 +00:00
Bryan Drewery
702672ec27 Update to 3.2.4-119-g0da10c68
- timestamp: Don't exit on [EINTR] to kevent(2)
  - timestamp: Support EOF for command usage
  - timestamp: Support buffered modes
  - Add MAX_EXECUTION_TIME_{EXTRACT,INSTALL,PACKAGE,DEINSTALL} overrides
  - Export PACKAGE_BUILDING to environment as well as some ports check there
    (like postfix pkg-install)
  - Fix not showing MOVED entries at start
  - MOVED: Show more information.
  - MOVED: Fix not being recursive.
  - disclean: Handle MOVED.
  - Add some missing COLOR_PORT
  - Fix a dependency lookup bug with FLAVORS by adding a metadata queue.
  - Add an 'rm' builtin for sh.
  - Delay deps_sanity checks until all deps are checked
  - Show user where a bad dependency may have MOVED to
  - ports -B: Disallow branch if not SVN/git
2018-01-29 19:39:05 +00:00
Bryan Drewery
9a32077e0d Update to 3.2.3-85-g190c9bef
- testport: Fix assertion from 0a756b606 to only fire if a FLAVOR is given.
2018-01-05 20:50:33 +00:00
Bryan Drewery
9146130bff Update to 3.2.3-84-g7080656f
- testport: Add missing dependency assertions that bulk was handling.
    - testport: Add missing Invalid Flavor assertion from ec23b9a6c15.
    - testport: Fix missing assertion for port depending on itself via a FLAVOR.
    - pkgclean: Fix creating corrupt repository from the wrong place.
    - Rework bulk pkg-query cache for incremental checks to fix a silent crash.
2018-01-05 17:03:16 +00:00
Bryan Drewery
f7e5e96f39 Update to 3.2.3-66-g83691739
- Improve security of parsing MAX_FILES_<PKGBASE>
2018-01-02 23:23:34 +00:00
Bryan Drewery
fb1737054c Update to 3.2.3-64-gc33e3600
- Fix build of ports with '-' in PKGBASE.
  - Fix some output not being timestamp-prefixed.
2018-01-02 23:01:37 +00:00
Bryan Drewery
16a5938f21 Update to 3.2.3-62-g832b3a1c
- image: Document -m in manpage
  - processonelog: Add case for #error
  - Allow MAX_FILES_<PKGBASE> to override MAX_FILES
2018-01-02 19:47:35 +00:00
Bryan Drewery
65259ed0ca Update to 3.2.3-56-g0d8338bc
- image: Fix miniroot issues.
  - testport -n: Implement as dry-run.
  - bulk: Fix detection of non-existent FLAVOR.
  - poudriere.8: Document FLAVORS
  - testport: Allow -B to work.
2017-12-14 00:21:37 +00:00
Bryan Drewery
d5c9ae81da Update to 3.2.3-44-g55026502
- image: Initial pass at miniroot support
2017-12-09 05:56:11 +00:00
Bryan Drewery
7cdc7f571e Update to 3.2.2-37-gf25a99c8
- jail -c -m null: Fix crashing with existing-dir error after commit 1d0222b696.
  - jail -c -m src: Respect existing .cpignore properly
  - jail -m null -S <path>: Use the -S path for jail source rather than
    expect <jail>/usr/src.
  - jail -c -m null: Assert that the jail is populated already.
  - HTML: Throw explicit error if unknown ports type is encountered. [1]

PR:		224065 [1]
2017-12-04 23:53:18 +00:00
Bryan Drewery
400d9dbf1d Update to 3.2.2-32-gd8cbf566
- bulk: Properly rebuild packages that have moved origins.
2017-12-04 21:10:41 +00:00
Bryan Drewery
55e82b5d36 Update to 3.2.2-25-g8695dfd6
- jail -u: Fix error with freebsd-update.fixed not found.
2017-11-29 20:52:26 +00:00
Bryan Drewery
fe6b4fd8e5 Update to 3.2.0-37-g4775d32f
- HTML: Fix failed origin column
  - testport -c: Don't read host /etc/make.conf.
  - testport: Avoid reading ports files outside jail for FLAVOR/DEPENDS_ARGS
  - Avoid using `injail` on system.
  - ports/jail -c NOZFS: Consider non-empty-already-existing-directory a failure
  - Fix usage printout before system is setup.
  - jail -c: Replace colon in JAILMNT to avoid PATH issues in buildworld.
  - image: Setup PKG ABI properly
  - FORCE_MOUNT_HASH: Support yes/no.
  - FORCE_MOUNT_HASH: Fix due to improper logic.
  - Record lld failures as lld_linker_error.
  - options -p: Warn/confirm if in a TTY about overwriting older options
    directory.
  - poudriere -vv: Show which poudriere.conf files are loaded
2017-11-27 22:26:29 +00:00
Bryan Drewery
6d2e179d82 Release 3.2.0.
This brings FLAVORS support, logclean, image, a ton of optimizations,
and more.

Changes: https://github.com/freebsd/poudriere/wiki/release_notes_32
2017-11-11 17:19:05 +00:00
Bryan Drewery
6c08c2e58f Update to 3.0-2600-g5d5671f7
Last minute fixes for 3.2.  If there are no reports of issues this will
be released as 3.2 tomorrow.

   - Fix maintainer in buildlog missing.
   - bulk/testport: Undocument -s after its removal.
   - DEPENDS_ARGS: Store a PKG_NOTE with the value used for the port
   - delete_old_pkg: Fix some renamed PKGNAME issues.
2017-11-11 01:45:10 +00:00
Bryan Drewery
a892bd32da Update to 3.0-2592-gba53cb5b
This will be likely be 3.2 release very quickly.

    - Remove bulk/testport -s.  It is dangerous, bulk -S remains.
    - jail -u: Update kernel based on what was passed into jail -cK.
    - distclean: Require -a/-f/listed ports.
    - testport: Support MOVED with destination FLAVOR.
    - delete_old_pkg: Fix renamed PKGNAME detection after commit 612e3dc018c8d3.
    - delete_old_pkg: Check for rename PKGNAME before version.
2017-11-10 06:39:02 +00:00
Bryan Drewery
5ed116b7b0 Avoid running git and finding PORTSDIR/.git.
Reported by:	xmj
2017-11-10 06:28:14 +00:00
Bryan Drewery
1fd48df355 - Update to 3.0-2584-g2c19d562
- jail -x: Support 'native-xtools-install'
2017-10-28 19:32:37 +00:00
Bryan Drewery
0e615c283f Update to 3.0-2583-g7913a064
- jail -x: Tell where native-xtools is being built
      - XDEV: Support the fixed native-xtools build target in FreeBSD head
        that builds from the Jail rather than the host system's /usr/src. [1]
      - Add XDEV_SRC_JAIL, if set will use the jail's source for xdev.  This
        should only be used in special cases and will effectively default to
        on for head and soon for stable/11.
      - Record flavor for port build results.
      - jail -c: Fix EMULATOR being unset if ran via poudriered
      - Assert EMULATOR is not empty on use
      - .poudriere.ports.queued: Store flavor for dependencies
      - jail -x: Respect MAKEOBJDIRPREFIX [2]
      - jail -c: Disallow using a colon (:) in jail name.

PR:	216083 [1]
PR:	215541 [2]
2017-10-27 23:11:19 +00:00
Bryan Drewery
54acc56e6c Update to 3.0-2571-gf38f4778
- image: Speed up tar creation by using 'xz -T 0'
    - FLAVORS: Default listed ports to main flavor only, @all to build all,
      bulk -a does all.
    - testport: Disallow testing @all
    - Support loading hooks from POUDRIERED/hooks.d/plugins/<plugin-name>/<hook>.sh
    - Support a plugin make.conf at POUDRIERED/hooks/plugins/<plugin-name>/make.conf
    - bulk -n: Fix 'Ports to build' list to only show what needs to be built.
    - Implement some new hooks for perf profiling
    - run_hook: Pass along logdir as LOG
    - gather_port_vars_ports: Show more information for debug SKIP message
    - gather_port_vars_port: Add verbose output about which flavors will be expanded
    - bulk -n: Show log information at the end
    - Rename .poudriere.deps% to .poudriere.pkg_deps% based on its proper name
    - Store all_pkgs as .poudriere.all_pkgs%
    - QEMU: Allow overriding QEMU_{MAX_EXECUTION_TIME/NOHANG_TIME}
2017-10-19 21:29:48 +00:00
Bryan Drewery
0089e7f610 - Update to 3.0-2548-g4bed266f
- Fix FLAVORS assertion in compute_deps to properly show flavor
  - Add FLAVOR to a few job status outputs
  - Show origin for a FLAVOR assertion
  - Check for and error if
    'security.bsd.hardlink_check_uid' or 'security.bsd.hardlink_check_uid'
    are not set to '0' with BUILD_AS_NON_ROOT=yes to avoid staging errors
2017-10-13 16:26:32 +00:00
Bryan Drewery
aa4eebccea Update to 3.0-2537-gf08534e1
- testport + FLAVORS: Fix incorrectly calling the default flavor for
       dependencies duplicates
     - FLAVORS: Fix non-listed ports being deleted with -C and showing in
       queued list
2017-10-05 19:02:09 +00:00