Commit graph

25 commits

Author SHA1 Message Date
wiz
bb579283d0 *: bump PKGREVISION for egg.mk users
They now have a tool dependency on py-setuptools instead of a DEPENDS
2022-01-04 20:53:26 +00:00
nia
495fc76c70 parallel: Replace RMD160 checksums with BLAKE2s checksums
All checksums have been double-checked against existing RMD160 and
SHA512 hashes
2021-10-26 11:10:35 +00:00
nia
d171eeaf22 parallel: Remove SHA1 hashes for distfiles 2021-10-07 14:46:45 +00:00
adam
1acb82132b py-billiard: updated to 3.6.4.0
3.6.4.0
- Issue 309: Add Python 3.9 support to spawnv_passfds()
- fix 314
2021-05-06 10:36:08 +00:00
adam
36fd36ec4c py-billiard: updated to 3.6.3.0
3.6.1:
- Logging max memory reached at INFO rather than WARNING
- Pass arguments when wrapping sys.exit
- Remove win32/py2k special
- Ensure READY messages sent out by exiting worker are consumed prior to it actually existing.
- Pass max_memory_per_child to child worker process
- Fix compatibility with Python 2.7 on Windows
2020-05-17 19:16:38 +00:00
adam
964776cc40 py-billiard: updated to 3.6.0.0
3.6.0.0:
- Add support of sending parent process death signal.
- Previous fix for handling timeouts caused a problem in warm shutdowns due
  to use of deepcopy.
  We now use a shallow copy of the cache and do so only when it is needed.
- Cleanup old checks and workarounds for Python versions we no longer support.
2019-04-05 13:03:11 +00:00
jperkin
074ea005c9 py-billiard: Set _XOPEN_SOURCE correctly. 2018-02-02 17:16:36 +00:00
wiz
ef141a6b79 Reset maintainer 2017-09-16 19:26:41 +00:00
wiz
5d86518619 Switch github HOMEPAGEs to https. 2017-07-30 22:32:10 +00:00
adam
4d22145d28 3.5.0.3:
- Adds Process._authkey alias to .authkey for 2.7 compat.
- Remove superfluous else clause from max_memory_per_child_check.
- Document and test all supported Python versions.
- Extend 'Process' to be compatible with < Py3.5.
- Use a properly initialized logger in pool.py error logging.
- _trywaitkill can now kill a whole process group if the worker process declares itself as a group leader.
- Fix cpython issue 14881 (See http://bugs.python.org/issue14881).
- Fix for a crash on windows.
- Fix messaging in case of worker exceeds max memory.
2017-07-17 08:03:50 +00:00
adam
1da4eb9b3f Changes 3.5.0.2:
- max_memory_per_child was measured in kilobytes on Linux, but bytes on
*BSD/MacOS, it's now always kilobytes.

- Windows: Adds support for max_memory_per_child, but requires the
``psutil`` package to be installed.

- Fixed bug in ForkingPickler.loadbuf, where it tried to pass
a BytesIO instance directly to ``pickle.loads`` on Python 2.7.
2017-04-09 16:43:03 +00:00
wiz
57199de455 Switch to MASTER_SITES_PYPI. 2016-06-08 17:43:20 +00:00
agc
853757dcb6 Add SHA512 digests for distfiles for parallel category
Existing SHA1 digests verified, all found to be the same on the
machine holding the existing distfiles (morden).  Existing SHA1
digests retained for now as an audit trail.
2015-11-02 23:46:12 +00:00
rodent
9bc8971186 3.3.0.18 - 2014-06-20
---------------------
- Now compiles on GNU/kFreeBSD
- Pool: `AF_PIPE` address fixed so that it works on recent Windows versions
  in combination with Python 2.7.7.
- Pool: Fix for `Supervisor object has no attribute _children` error.
- Pool: Fixed bug with human_status(None).
- Pool: shrink did not work properly if asked to remove more than 1 process.
2014-07-16 23:15:12 +00:00
rodent
bd979ab410 Updated to latest release 3.3.17. Remove py26 incompatibility directive.
This seems to have been fixed in a previous version. At least "import
billiard" works from the interpreter. From CHANGES.txt:

- Fixes SemLock on Python 3.4 (Issue #107) when using
  ``forking_enable(False)``.

- Pool: Include more useful exitcode information when processes exit.
2014-04-19 17:54:28 +00:00
rodent
3b03150375 Use PLIST.py2x as provided by the infrastructure. 2014-02-20 00:47:28 +00:00
rodent
8c773b078e Updated to latest release, 3.3.0.16. Some important changes to note:
1) The shared library isn't installed with py33. The package uses a pure
   python implementation;
2) The connection and reduction functions are installed in different
   directory names depending on python major version. From CHANGES.txt:

3.3.0.16 - 2014-02-11
---------------------
- Previous release was missing the billiard.py3 package from MANIFEST
  so the installation would not work on Python 3.

3.3.0.15 - 2014-02-10
---------------------
- Pool: Fixed "cannot join process not started" error.
- Now uses billiard.py2 and billiard.py3 specific packages that are installed
  depending on the python version used.
    This way the installation will not import version specific modules (and
    possibly crash).

3.3.0.14 - 2014-01-17
---------------------
- Fixed problem with our backwards compatible ``bytes`` wrapper
  (Issue #103).
- No longer expects frozen applications to have a valid ``__file__``
  attribute.
2014-02-18 02:53:37 +00:00
wiz
a505be1b23 Fix PLIST for python-3.x. Remove FETCH_USING, not package-setable. 2014-01-19 18:48:00 +00:00
wiz
14e1e1ba7c Mark as PYTHON_VERSIONS_INCOMPATIBLE=26:
SyntaxError: ('invalid syntax',
('/usr/pkg/lib/python2.6/site-packages/billiard/_connection3.py',
851, 47, '    _ready_errors = {_winapi.ERROR_BROKEN_PIPE,
_winapi.ERROR_NETNAME_DELETED}\n'))
2014-01-17 13:13:28 +00:00
rodent
8c2d663e39 Needs USE_LANGUAGES+=c to compile C extensions and shared library. Fixes
build on NetBSD-6.0/i386, likely.
2013-12-31 15:47:24 +00:00
rodent
abca164ba8 Updated to latest release, 3.3.0.13. Note changes to some files in the
PLIST. From ChangeLog:

3.3.0.13 - 2013-12-13
---------------------

- Fixes compatability with Python < 2.7.6
- No longer attempts to handle ``SIGBUS``
- Non-thread based pool now only handles signals:
    ``SIGHUP``, ``SIGQUIT``, ``SIGTERM``, ``SIGUSR1``,
    ``SIGUSR2``.
- setup.py: Only show compilation warning for build related commands.

3.3.0.12 - 2013-12-09
---------------------

- Fixed installation for Python 3.
- Pool: Fixed bug with maxtasksperchild.
- Pool: Fixed bug in maintain_pool.

3.3.0.11 - 2013-12-03
---------------------

- Fixed Unicode error when installing the distribution (Issue #89).
- Daemonic processes are now allowed to have children.
    But note that it will not be possible to automatically
    terminate them when the process exits.
- Pool:  Would not always be able to detect that a process exited.

3.3.0.10 - 2013-12-02
---------------------

- Windows: Fixed problem with missing ``WAITABANDONED_0``
- Windows: PipeConnection can now be inherited.

3.3.0.9 - 2013-12-02
--------------------

- Temporary workaround for Celery maxtasksperchild issue.

3.3.0.8 - 2013-11-21
--------------------

- Now also sets ``multiprocessing.current_process`` for compatibility
  with loggings ``processName`` field.

3.3.0.7 - 2013-11-15
--------------------

- Fixed compatibility with PyPy 2.1 + 2.2.
- Fixed problem in pypy detection.
- Now uses ``ctypes.find_library`` instead of hardcoded path to find
  the OS X CoreServices framework.

3.3.0.6 - 2013-11-12
--------------------

- Now works without C extension again.
- New ``_billiard.read(fd, buffer, [len, ])` function
  implements os.read with buffer support (new buffer API)
- New pure-python implementation of ``Connection.send_offset``.

3.3.0.5 - 2013-11-11
--------------------

- All platforms except for Windows/PyPy/Jython now requires the C extension.

3.3.0.4 - 2013-11-11
--------------------

- Fixed problem with Python3 and setblocking.

3.3.0.3 - 2013-11-09
--------------------

- Now works on Windows again.

3.3.0.2 - 2013-11-08
--------------------

- ApplyResult.terminate() may be set to signify that the job
  must not be executed.  It can be used in combination with
  Pool.terminate_job.
- Pipe/_SimpleQueue: Now supports rnonblock/wnonblock arguments
  to set the read or write end of the pipe to be nonblocking.
- Pool: Log message included exception info but exception happened
  in another process so the resulting traceback was wrong.
- Pool: Worker process can now prepare results before they are sent
  back to the main process (using ``Worker.prepare_result``).

3.3.0.1 - 2013-11-04
--------------------

- Pool: New ``correlation_id`` argument to ``apply_async`` can be
  used to set a related id for the ``ApplyResult`` object returned:
    >>> r = pool.apply_async(target, args, kwargs, correlation_id='foo')
    >>> r.correlation_id
    'foo'
- Pool: New callback `on_process_exit` is called when a pool
  process exits, with signature ``(pid, exitcode)``.
- Pool: Improved the too many restarts detection.

3.3.0.0 - 2013-10-14
--------------------

- Dual code base now runs on Python 2.6+ and Python 3.
- No longer compatible with Python 2.5
- Includes many changes from multiprocessing in 3.4.
- Now uses ``time.monotonic`` when available, also including
  fallback implementations for Linux and OS X.
- No longer cleans up after receiving SIGILL, SIGSEGV or SIGFPE
- ``Finalize`` and ``register_after_fork`` is now aliases to multiprocessing.
    It's better to import these from multiprocessing directly now
    so that there aren't multiple registries.
- New `billiard.queues._SimpleQueue` that does not use semaphores.
- Pool: Can now be extended to support using multiple IPC queues.
- Pool: Can now use async I/O to write to pool IPC queues.
- Pool: New ``Worker.on_loop_stop`` handler can be used to add actions
  at pool worker process shutdown.
    Note that, like all finalization handlers, there is no guarantee that
    this will be executed.
2013-12-31 13:27:51 +00:00
wiz
e690056146 Remove curl dependency, put file on nbftp. 2013-09-20 12:42:04 +00:00
rodent
fda60a406f Updated to latest release. From CHANGES.txt:
2.7.3.32 - 2012-08-16
---------------------
- Fixed compatibility with Python 3.3
- Process boostrap: Now ignores errors while flushing stdout (Issue #16).
2013-09-20 12:21:48 +00:00
wiz
e3716b5631 Update to 2.7.3.31:
2.7.3.31 - 2012-07-04
---------------------

- Recent changes broke support for running without C extension (Issue #57).
2013-07-28 20:41:41 +00:00
rodent
a86c749e71 Import py27-billiard-2.7.3.30 as parallel/py-billiard.
billiard is a fork of the Python 2.7 multiprocessing package. The
multiprocessing package itself is a renamed and updated version of R Oudkerk's
pyprocessing package. This standalone variant is intended to be compatible with
Python 2.4 and 2.5, and will draw it's fixes/improvements from python-trunk.

 * Also it is a fork of the multiprocessin backport package by Christian Heims;
 * It includes the no-execv patch contributed by R. Oudkerk;
 * And the Pool improvements previously located in Celery;
2013-07-02 11:08:27 +00:00