Commit graph

7773 commits

Author SHA1 Message Date
wiz
000aeb42f1 p5-Fsdb: update to 2.65.
dbmultistats and dbmapreduce now both take a "-F x" option to set
the field separator.
2018-02-25 16:39:23 +00:00
wiz
234e04bc0e p5-DBIx-Class: update to 0.082841.
0.082841 2018-01-29 08:10 (UTC)
    * Test-suite fixup changes only - no reason to upgrade, wait for 0.082850

    * Misc
        - Unblock DBD::SQLite (RT#118395)
        - Fix missing ORDER BY leading to failures of t/prefetch/grouped.t
          under upcoming libsqlite (RT#117271)
        - Temporarily disable a non-critical portion of test failing on
          upcoming libsqlite, proper fix coming in 0.082850 (RT#119845)
        - Add test workaround for ( largely irrelevant ) RT#120129
        - Add temporary test-workaround for a devrel of DBD::SQLite
          RT#124227 / https://twitter.com/dbix_class/status/957271153751527424
        - Add workaround for one of the most damaging "improvements" made
          during the modern-perl-era (RT#120827)
        - Fix malformed README file encoding (RT#122028)
2018-02-25 16:34:23 +00:00
wiz
6626981b17 p5-DBD-postgresql: update to 3.7.4.
Version 3.7.4. Released February 12, 2018 (git tag 3.7.4)

  - Fix typo in META.yml
    [CPAN ticket #124405]
2018-02-25 16:24:02 +00:00
wiz
d2cc59e27f p5-DBD-mysql: update to 4.046.
2018-02-06 Patrick Galbraith, Michiel Beijen, DBI/DBD community (4.045)
* Use API function for reconnect; fixes compilation on MariaDB 10.2.6+.
  Fix provided by Pali.
* Fixed broken link to MySQL download page, provided by Mohammad S Anwar.
* Spelling fixes, provided by Ville Skyttä.
2018-02-25 16:20:04 +00:00
wiz
6d7850c7b7 p5-BDB: update to 1.92.
1.92 Thu Jan 18 17:43:14 CET 2018
	- further USE_SOCKETS_AS_HANDLES fixes (Z59).
	- new requests: db_env_lsn_reset, db_env_fileid_reset.
2018-02-25 16:17:44 +00:00
taca
6fa4e399ea letsencrypt.org: update to 5.5.0
=== 5.5.0 (2018-01-31)

* Make Database#copy_table in the postgres adapter handle errors that occur while processing rows (jeremyevans) (#1470)

* Cache results of changed_columns method in local variables in many places for better performance (jeremyevans)

* Make modification_detection plugin not break column change detection for new objects (jeremyevans) (#1468)

* Make pg_range extension set :ruby_default schema value for recognized range defaults (jeremyevans)

* Make pg_interval extension set :ruby_default schema value for recognized interval defaults (jeremyevans)

* Make pg_json extension set :callable_default schema value for empty json/jsonb array/hash defaults (jeremyevans)

* Make pg_inet extension set :ruby_default schema value for recognized inet/cidr defaults (jeremyevans)

* Make pg_hstore extension set :callable_default schema value for empty hstore defaults (jeremyevans)

* Make pg_array extension set :callable_default schema value for recognized empty array defaults (jeremyevans) (#1466)

* Make defaults_setter plugin prefer :callable_default db_schema values over :ruby_default db_schema values (jeremyevans)

* Add defaults_setter plugin :cache option for caching default values returned (jeremyevans)

* Freeze string values in hashes returned by Database#schema (jeremyevans)

=== 5.4.0 (2018-01-04)

* Enable fractional seconds in timestamps on DB2 (jeremyevans) (#1463)

* Don't attempt to insert a second time if insert_select runs a query that doesn't return results, which can happen when triggers are used (jeremyevans)

* Make Dataset#insert_select on PostgreSQL and MSSQL return false instead of nil if the INSERT query is sent to the database but returns no rows (jeremyevans)

* Add index_caching extension for caching calls to Database#indexes (kenaniah, jeremyevans) (#1461)

* Allow Database#indexes on SQLite, MSSQL, SQLAnywhere, and DB2 to handle SQL::Identifier values (jeremyevans)

* Add pg_timestamptz extension for using timestamptz (timestamp with time zone) as the default timestamp type (jeremyevans)

* Support Sequel.date_{add,sub} :cast option for setting cast type in date_arithmetic extension (jeremyevans)

* Optimize Database#synchronize implementation on ruby 2.5+ (jeremyevans)

* Add class_table_inheritance plugin :ignore_subclass_columns option (brianphillips) (#1459)

* Make Dataset#to_xml in xml_serializer work with eager_graphed datasets (jeremyevans)

* Make Dataset#to_json in json_serializer work with eager_graphed datasets (jeremyevans)

* Cache Dataset#nullify dataset in the null_dataset extension (chanks) (#1456)

* Add datetime_parse_to_time extension, for parsing timestamp strings without offsets using DateTime.parse.to_time (jeremyevans) (#1455)

* Add WHERE NULL filter for Dataset#where calls with no existing filter, no argument, and where the virtual row block returns nil (jeremyevans)
2018-02-25 15:22:31 +00:00
taca
d7f33fc67e databases/ruby-pg: update to 1.0.0
v1.0.0 [2018-01-10] Michael Granger <ged@FaerieMUD.org>

Deprecated:

* Deprecate Ruby older than 2.2.
* Deprecate Connection#socket in favor of #socket_io.

Removed:

* Remove compatibility code for Ruby < 2.0 and PostgreSQL < 9.2.
* Remove partial compatibility with Rubinius.
* Remove top-level constants PGconn, PGresult, and PGError.

Enhancements:

* Update error codes to PostgreSQL-10
* Update Windows binary gems to Ruby-2.5, PostgreSQL 10.1 and OpenSSL 1.1.0g.

Bugfixes:

* Fix URI detection for connection strings. #265 (thanks to jjoos)
* MINGW: Workaround segfault due to GCC linker error in conjunction with
  MSVC. This happens when linking to PostgreSQL-10.0-x64 from EnterpriseDB.

Documentation fixes:

* Add PostgreSQL version since when the given function is supported. #263
* Better documentation to `encoder` and `decoder` arguments of COPY related
  methods.
2018-02-25 14:19:24 +00:00
taca
2b8bb4b6f5 databases/ruby-mysql2: update to 0.4.10.
New Features

* Make sure ssl is enabled if only :sslverify is set (#889)

Fixes

* Cast the BIT(1) type when :cast_booleans is true for prepared statements
  (#883, #903)
* Compilation failures against MariaDB Connector/C 3.0.2 (#878, #888, #895,
  #900, #901, #902)
* MYSQL_SECURE_AUTH has been removed in MySQL 8.0.3 RC (#892, #898)

Changes

* Better specs (#904)
* Extended keyword for the explain statement has been removed (#894)
2018-02-25 14:08:18 +00:00
markd
6bc36e9173 mysql57-{client,server}: support openssl 1.1 2018-02-25 01:15:22 +00:00
taca
bc950aca34 databases/phpmyadmin: fix build problem, PHP 7.1 and later
Use php-pecl-mcrypt with PHP 7.1 and later.
2018-02-24 05:34:19 +00:00
adam
5f0f644e22 py-sqlalchemy: updated to 1.2.4
Release 1.2.4 includes a small series of fixes within the ORM and Core components, three of which are 1.2-specific regressions.
2018-02-23 14:10:32 +00:00
fhajny
5e61148d59 databases/py-peewee: Update to 3.0.20.
3.0.20
- Include schema (if specified) when checking for table-existence.
- Correct placement of ORDER BY / LIMIT clauses in compound select
  queries.
- Fix bug in back-reference lookups when using filter() API.
- Fix bug in SQL generation for ON CONFLICT queries with Postgres

3.0.19
- Support for more types of mappings in insert_many()
- Lots of documentation improvements.
- Fix bug when calling tuples() on a ModelRaw query. This was reported
  originally as a bug with sqlite-web CSV export
2018-02-23 11:39:51 +00:00
adam
254e24fc49 py-sqlalchemy-utils: updated to 0.33.0
0.33.0:
Added support for materialized views in PostgreSQL
Added Ltree.descendant_of and Ltree.ancestor_of
Dropped Python 3.3 support
Fixed EncryptedType padding
2018-02-22 09:56:12 +00:00
adam
3e3515f9ec py-sqlalchemy: updated to 1.2.3
Release 1.2.3 includes fixes for a variety of ORM, Core, and dialect-specific issues.
2018-02-22 09:53:07 +00:00
adam
b207d94ea7 py-asyncpg: updated to 0.15.0
asyncpg v0.15.0

Behavior Changes
asyncpg no longer uses the common statement cache for explicit
prepared statements, so Connection.prepare() always returns a
new prepared statement

Bug Fixes
Initialize statement codecs immediately after Prepare
Fix server version parsing when it contains trailing data
2018-02-22 09:24:16 +00:00
adam
dce08cddf4 py-alembic: updated to 0.9.8
version: 0.9.8
Fixed bug where the :meth:.Script.as_revision_number method
did not accommodate for the 'heads' identifier, which in turn
caused the :meth:.EnvironmentContext.get_head_revisions
and :meth:.EnvironmentContext.get_revision_argument methods
to be not usable when multiple heads were present.
The :meth:.EnvironmentContext.get_head_revisions method returns
a tuple in all cases as documented.

Fixed bug where autogenerate of :class:.ExcludeConstraint
would render a raw quoted name for a Column that has case-sensitive
characters, which when invoked as an inline member of the Table
would produce a stack trace that the quoted name is not found.
An incoming Column object is now rendered as sa.column('name').

Fixed bug where the indexes would not be included in a
migration that was dropping the owning table.   The fix
now will also emit DROP INDEX for the indexes ahead of time,
but more importantly will include CREATE INDEX in the
downgrade migration.

Fixed the autogenerate of the module prefix
when rendering the text_type parameter of
postgresql.HSTORE, in much the same way that
we do for ARRAY's type and JSON's text_type.

Added support for DROP CONSTRAINT to the MySQL Alembic
dialect to support MariaDB 10.2 which now has real
CHECK constraints.  Note this change does **not**
add autogenerate support, only support for op.drop_constraint()
to work.
2018-02-22 09:18:39 +00:00
wiz
9eb1281fc9 mysql57-server: remove reference to non-existing file 2018-02-20 12:57:32 +00:00
fhajny
65a4be3b97 databases/percona-toolkit: Update to 3.0.6.
v3.0.6 released 2018-01-04

New Features
- Improve pt-table-sync support for MyRocks
- pt-stalk now checks the RocksDB status
- pt-mysql-summary contains the RocksDB section
- pt-osc shows a message if trying to set the engine to rocksdb and
  binlog_format != row.
- pt-table-checksum skips RocksDB tables.

Known Issues
- The information message implemented for PT-204 has a typo when
  referring to the --ignore-engines parameter. This problem is planned
  to be fixed in the next release.
- It has been detected that the implementation of PT-205 is not
  complete and pt-osc may fail when altering tables. This problem is
  planned to be fixed in the next release.

Bug Fixes
- The general log parser cannot handle timestamps which include time
  zones
- pt-online-schema-change does not retry on a deadlock error when
  using Percona Server 5.7
- pt-table-checksum ignores generated columns



v3.0.5 released 2017-11-20

New Features
- Improve MongoDB Profiler for PMM and PT
- The mongodb-query-digest supports MongoDB versions lower than 3.2;
  incorrect output was fixed.
- The pt-summary, pt-mysql-summary, pt-mongodb-summary commands
  provide output in the the JSON format.
- pt-mysql-summary shows the output of the Show Slave Hosts command.
- pt-table-sync supports replication channels (requires MySQL version
  5.7.6 or higher)

Bug fixes
- pt-mext fails if the Rsa_public_key variable is empty.
- pt-mongodb-query-digest --version produced incorrect values.
- pt-online-schema-change incorrectly processed virtual columns.
- pt-online-schema-change command reported an error when the name of
  an index contained ‘unique’ as as the prefix or suffix.
- pt-table-checksum did not detect differences on a system with the
  ROW based replication active.
- pt-onine-schema-change --max-load paused if a status variable was
  passed 0 as the value.
- pt-table-checksum reported a misleading error if a column comment
  contained an apostrophe. For more information, see #1708749.
- In some cases, pt-table-checksum did not report that the same table
  contained different values on the master and slave.
- pt-online-schema-change --alter could fail if field names contained
  upper case characters. For more information, see #1705998.
- In some cases pt-mongodb-query-digest could not connect to a db
  using authentication.
- In some cases, pt-kill could ignore the value of the --busy-time
  parameter. For more information, see #1016272.
- When run with the --skip-check-slave-lag, the pt-table-checksum
  could fail in some cases.



v3.0.4 released 2017-08-02

New Features
- Added collection of information about prepared statements by
  pt-stalk when Performance Schema is enabled. For more information,
- Added the --preserve-triggers option for pt-online-schema-change to
  support AFTER triggers.
- Added --output-format option for pt-mongodb-summary to choose
  between JSON format and the default plain text.
- Added the --output-format=csv parameter for pt-archiver to archive
  rows in CSV format.
- Added the --only-same-schema-fks option for pt-online-schema-change
  to check foreigns keys only on tables with the same schema as the
  original table. This should speed up the tool’s execution, but keep in
  mind that if you have foreign keys referencing tables in other
  schemas, they won’t be detected. For more information, see #1690122.
- Added the --check-unique-key-change option for
  pt-online-schema-change to abort if the specified statement for
--alter is trying to add a unique index. This is supposed to avoid
  adding duplicate keys that might lead to silently losing data.
- Added the --truncate-replicate-table option for pt-table-checksum to
  ensure stale data is removed.

Bug fixes
- Fixed pt-table-checksum to support tables that have columns with
  different collations or charsets. For more information, see
  #1674266.
- Fixed primary key handling by pt-archiver. For more information, see
  #1691630.
- Limited constraint name in the new table when running
  pt-online-schema-change. For more information, see #1491674.
- Fixed the --no-check-binlog-format option for pt-table-checksum to
  work as expected.
- Fixed the use of uninitialized value in printf() for
  pt-online-schema-change. For more information, see #1693614.
- Fixed pt-table-sync to prevent field type point to be taken as
  decimal.
- Reverted PT-116 to remove the --use-insert-ignore option from
  pt-online-schema-change.
- Fixed the --skip-check-slave-lag feature for pt-table-checksum to
  safely check for undefined values.
- Fixed regression in --check-slave-lag option for
  pt-online-schema-change.
- Fixed regression in --skip-check-slave-lag option for
  pt-online-schema-change.
- Fixed syntax error in pt-online-schema-change.
2018-02-19 19:22:09 +00:00
fhajny
de820f0d42 databases/py-peewee: Update to 3.0.18.
- Improved error messages when attempting to use a database class
  for which the corresponding driver is not installed.
- Added tests showing the use of custom operator (a-la the docs).
- Fixed indentation issue in docs
- Fixed issue with the SQLite date_part issue
2018-02-19 13:08:52 +00:00
fhajny
e7e8e88072 databases/py-peewee: Update to 3.0.17.
3.0.17
- Fix schema inheritance regression
- Add helper method to postgres migrator for setting search_path

3.0.16
- Improve model graph resolution when iterating results of a query
- Allow Model._meta.schema to be changed at run-time
2018-02-13 15:26:10 +00:00
fhajny
d8c4dda19e databases/sqlrelay*: Skip SSP checks for archives 2018-02-12 19:54:32 +00:00
adam
447d0e61f4 py-psycopg2: updated to 2.7.4
What's new in psycopg 2.7.4
- Moving away from installing the wheel package by default.
  Packages installed from wheel raise a warning on import. Added package
  psycopg2-binary to install from wheel instead.
- Convert fields names into valid Python identifiers in
  ~psycopg2.extras.NamedTupleCursor.
- Fixed Solaris 10 support.
- cursor.mogrify() can be called on closed cursors.
- Fixed setting session characteristics in corner cases on autocommit
  connections.
- Fixed ~psycopg2.extras.MinTimeLoggingCursor on Python 3.
- Fixed parsing of array of points as floats.
- Fixed ~psycopg2.__libpq_version__ building with libpq >= 10.1.
- Fixed ~cursor.rowcount after ~cursor.executemany() with :sql:RETURNING
  statements.
- Fixed compatibility problem with pypy3.
- Wheel packages compiled against PostgreSQL 10.1 libpq and OpenSSL 1.0.2n.
- Wheel packages for Python 2.6 no more available (support dropped from
  wheel building infrastructure).
2018-02-12 08:15:37 +00:00
adam
6dcda92d4a Reset revision 2018-02-08 20:55:03 +00:00
adam
ce1adb2cfc postgresql: updated to 10.2, 9.6.7, 9.5.11, 9.4.16, and 9.3.21
This release fixes two security issues. This release also fixes issues with VACUUM, GIN indexes, and hash indexes that could lead to data corruption, as well as fixes for using parallel queries and logical replication.

Security Issues
* CVE-2018-1052: Fix the processing of partition keys containing multiple expressions
* CVE-2018-1053: Ensure that all temporary files made with "pg_upgrade" are non-world-readable

Bug Fixes and Improvements
* Fix crash and potential disclosure of backend memory when processing partition keys containing multiple expressions
* Fix potential disclosure of temporary files containing database passwords created by pg_upgrade by not allowing these files to be world-accessible
* Fix cases where VACUUM would not remove dead rows if they were updated while "key-share" locked, leading to potential data corruption
* Fix for GIN indexes to prevent bloat by ensuring the pending-insertions list is cleaned up by VACUUM
* Fix potential index corruption with hash indexes due to failure to mark metapages as dirty
* Fix several potential crash scenarios for parallel queries, including when a bitmap heap scan cannot allocate memory
* Fix several potential hang-ups in parallel queries, including when a parallel worker fails to start
* Fix collection of EXPLAIN statistics from parallel workers
* Prevent fake deadlock failures when multiple sessions are running CREATE INDEX CONCURRENTLY
* Fix for trigger behavior when using logical replication
* Several fixes for "walsender" functionality to improve stability as well as visibility into the replication process
* Fix logical decoding to correctly clean up disk files for crashed transactions
* Several fixes for identity columns, including disallowing identity columns on tables derived from composite types and partitions
* Fix handling of list partitioning constraints for partition keys of boolean and array types
* Fix incorrectly generated plans for UPDATE and DELETE queries when a table has a mix of inherited regular and foreign child tables
* Fix incorrect query results from cases involving GROUPING SETS when used with flattened subqueries
* Fix UNION/INTERSECT/EXCEPT over zero columns, e.g. "SELECT UNION SELECT;"
* Several fixes for subqueries within a LATERAL subquery
* Several improvements for query planning estimation
* Allow a client that supports SCRAM channel binding, such as a future version of PostgreSQL or libpq, to connect to a PostgreSQL 10 server
* Fix sample INSTR() functions used to help transition from Oracle(r) PL/SQL to PostgreSQL PL/pgSQL to correctly match Oracle functional behavior
* Fix pg_dump to make permissions (ACL), security label, and comment entries reliably identifiable in archive outputs
* Modify behavior for contrib/cube's "cube ~> int" operator to make it compatible with KNN search. This is a backwards incompatible change and any expression indexes or materialized views using this operator will need to be reindexed and refreshed, respectively.
* Several fixes in contrib/postgres_fdw to prevent query planner errors
* Added modern examples of auto-start scripts for PostgreSQL on macOS in the contrib/start-scripts/macos directory
* Several fixes for Windows, including postmaster startup and compatibility with libperl
* Spinlock fixes and support for Motorola 68K and 88K architectures
2018-02-08 20:53:56 +00:00
fhajny
6f499fcb75 databases/py-peewee: Update to 1.0.5.
1.0.5
- Use same schema used for reflection in generated models.
- Preserve pragmas set on deferred Sqlite database if database is
  re-initialized without re-specifying pragmas.

1.0.4
- Fix bug creating model instances on Postgres when model does not
  have a primary key column.
- Extend postgresql reflection to support array types.
2018-02-08 12:56:10 +00:00
fhajny
95f43e4a4e databases/elasticsearch: Update to 6.2.0.
6.2.0

=== Breaking changes

Aggregations::
- Add a new cluster setting to limit the total number of buckets
  returned by a request

Core::
- Forbid granting the all permission in production

Highlighting::
- Limit the analyzed text for highlighting

Search::
- Introduce limit to the number of terms in Terms Query


=== Breaking Java changes

Java API::
- Remove `operationThreaded` from Java API

Java High Level REST Client::
- REST high-level client: remove index suffix from indices client
  method names


=== Deprecations

Analysis::
- Backport delimited payload filter renaming

Suggesters::
- deprecating `jarowinkler` in favor of `jaro_winkler`
- Deprecating `levenstein` in favor of `levensHtein`


=== New features

Plugin Ingest GeoIp::
- Enable ASN support for Ingest GeoIP plugin.

Plugin Lang Painless::
- Painless: Add spi jar that will be published for extending
  whitelists
- Painless: Add a simple cache for whitelist methods and fields.

Plugins::
- Add the ability to bundle multiple plugins into a meta plugin

Rank Evaluation::
- Backport of ranking evaluation API (#27478)

Recovery::
- Backport for using lastSyncedGlobalCheckpoint in deletion policy

Reindex API::
- Add scroll parameter to _reindex API


=== Enhancements

Allocation::
- Fix cluster.routing.allocation.enable and
  cluster.routing.rebalance.enable case
- Add node id to shard failure message

Analysis::
- Limit the analyzed text for highlighting (#27934)
- Allow TrimFilter to be used in custom normalizers

Circuit Breakers::
- Add accounting circuit breaker and track segment memory usage

Cluster::
- Adds wait_for_no_initializing_shards to cluster health API

Core::
- Introduce elasticsearch-core jar
- Rename core module to server
- Introduce elasticsearch-core jar
- Add Writeable.Reader support to TransportResponseHandler
- Simplify rejected execution exception
- Add node name to thread pool executor name

Discovery::
- Add information when master node left to DiscoveryNodes'
  shortSummary()

Engine::
- Move uid lock into LiveVersionMap
- Optimize version map for append-only indexing

Geo::
- [GEO] Add WKT Support to GeoBoundingBoxQueryBuilder
- [Geo] Add Well Known Text (WKT) Parsing Support to ShapeBuilders

Highlighting::
- Include all sentences smaller than fragment_size in the unified
  highlighter

Ingest::
- Enable convert processor to support Long and Double

Internal::
- Make KeyedLock reentrant
- Make AbstractQueryBuilder.declareStandardFields to be protected
- Tighten the CountedBitSet class
- Avoid doing redundant work when checking for self references.

Java API::
- Add missing delegate methods to NodeIndicesStats
- Java api clean-up : consistency for `shards_acknowledged` getters

Java High Level REST Client::
- add toString implementation for UpdateRequest.
- Add Close Index API to the high level REST client
- Add Open Index API to the high level REST client
- Added Create Index support to high-level REST client
- Add multi get api to the high level rest client
- Add msearch api to high level client

Mapping::
- Allow `_doc` as a type.

Network::
- Add NioGroup for use in different transports
- Add read timeouts to http module
- Implement byte array reusage in `NioTransport`
- Introduce resizable inbound byte buffer
- Decouple nio constructs from the tcp transport

Packaging::
- Extend JVM options to support multiple versions
- Add explicit coreutils dependency
- Detect mktemp from coreutils
- Enable GC logs by default
- Use private directory for temporary files

Percolator::
- also extract match_all queries when indexing percolator queries

Plugin Lang Painless::
- Painless: Add whitelist extensions
- Painless: Modify Loader to Load Classes Directly from Definition
- Clean Up Painless Cast Object
- Painless: Only allow Painless type names to be the same as the
  equivalent Java class.

Plugins::
- Add client actions to action plugin
- Plugins: Add validation to plugin descriptor parsing
- Plugins: Add plugin extension capabilities
- Add support for filtering mappings fields

Rank Evaluation::
- Simplify RankEvalResponse output

Recovery::
- Truncate tlog cli should assign global checkpoint
- Replica starts peer recovery with safe commit
- Primary send safe commit in file-based recovery
- Fail resync-failed shards in subsequent writes
- Introduce promoting index shard state
- Non-peer recovery should set the global checkpoint
- Persist global checkpoint when finalizing a peer recovery
- Rollback a primary before recovering from translog

Rollover::
- Fail rollover if duplicated alias found in templates

Search::
- Use typeName() to check field type in GeoShapeQueryBuilder
- Optimize search_after when sorting in index sort order

Sequence IDs::
- Do not keep 5.x commits when having 6.x commits
- Use lastSyncedGlobalCheckpoint in deletion policy
- Use CountedBitSet in LocalCheckpointTracker
- Only fsync global checkpoint if needed
- Keep commits and translog up to the global checkpoint
- Adjust CombinedDeletionPolicy for multiple commits
- Keeps index commits up to the current global checkpoint
- Dedup translog operations by reading in reverse

Settings::
- Add validation of keystore setting names

Snapshot/Restore::
- Use AmazonS3.doesObjectExist() method in S3BlobContainer
- Remove XContentType auto detection in BlobStoreRepository
- Include include_global_state in Snapshot status API (#22423)

Task Manager::
- Add ability to associate an ID with tasks

Translog::
- Simplify MultiSnapshot#SeqNoset
- Enclose CombinedDeletionPolicy in SnapshotDeletionPolicy


=== Bug fixes

Aggregations::
- Adds metadata to rewritten aggregations
- Fix NPE on composite aggregation with sub-aggregations that need
  scores
- StringTerms.Bucket.getKeyAsNumber detection type
- Fix incorrect results for aggregations nested under a nested
  aggregation
- Fix global aggregation that requires breadth first and scores
- Fix composite aggregation when after term is missing in the shard
- Fix preserving FiltersAggregationBuilder#keyed field on rewrite
- Using DocValueFormat::parseBytesRef for parsing missing value
  parameter
- Fix illegal cast of the "low cardinality" optimization of the
  `terms` aggregation.
- Always include the _index and _id for nested search hits.

Allocation::
- Do not open indices with broken settings

Core::
- Fix lock accounting in releasable lock
- Fixes ByteSizeValue to serialise correctly
- Do not set data paths on no local storage required
- Ensure threadcontext is preserved when refresh listeners are invoked
- Ensure logging is configured for CLI commands

Engine::
- Replica recovery could go into an endless flushing loop
- Use `_refresh` to shrink the version map on inactivity
- Allow resize version map under lock even if there are pending
  operations
- Reset LiveVersionMap on sync commit

Geo::
- Correct two equality checks on incomparable types
- Handle case where the hole vertex is south of the containing
  polygon(s)

Highlighting::
- Fix highlighting on a keyword field that defines a normalizer

Inner Hits::
- Add version support for inner hits in field collapsing (#27822)

Internal::
- Never return null from Strings.tokenizeToStringArray
- Fallback to TransportMasterNodeAction for cluster health retries
- Retain originalIndex info when rewriting FieldCapabilities requests

Java REST Client::
- Do not use system properties when building the HttpAsyncClient

Mapping::
- Ignore null value for range field (#27845)
- Pass `java.locale.providers=COMPAT` to Java 9 onwards
- Allow update of `eager_global_ordinals` on `_parent`.
- Fix merging of _meta field

Network::
- Only bind loopback addresses when binding to local
- Remove potential nio selector leak
- Fix issue where the incorrect buffers are written
- Throw UOE from compressible bytes stream reset
- Bubble exceptions when closing compressible streams

Packaging::
- Allow custom service names when installing on windows

Percolator::
- Avoid TooManyClauses exception if number of terms / ranges is
  exactly equal to 1024

Plugin Analysis ICU::
- Catch InvalidPathException in IcuCollationTokenFilterFactory

Plugin Analysis Phonetic::
- Fix daitch_mokotoff phonetic filter to use the dedicated Lucene
  filter

Plugin Lang Painless::
- Painless: Fix variable scoping issue in lambdas
- Painless: Fix errors allowing void to be assigned to def.

Plugin Repository HDFS::
- Fix SecurityException when HDFS Repository used against HA Namenodes

Plugins::
- Make sure that we don't detect files as maven coordinate when
  installing a plugin
- Fix upgrading indices which use a custom similarity plugin.

Recovery::
- Open engine should keep only starting commit
- Allow shrinking of indices from a previous major
- Set global checkpoint before open engine from store
- Check and repair index under the store metadata lock
- Flush old indices on primary promotion and relocation

Rollover::
- Make index rollover action atomic

Scripting::
- Ensure we protect Collections obtained from scripts from
  self-referencing

Scroll::
- Reject scroll query if size is 0 (#22552)
- Fix scroll query with a sort that is a prefix of the index sort

Search::
- Fix simple_query_string on invalid input
- Use the underlying connection version for CCS connections
- Fix synonym phrase query expansion for cross_fields parsing
- Carry forward weights, etc on rescore rewrite
- Fix routing with leading or trailing whitespace

Sequence IDs::
- Recovery from snapshot may leave seq# gaps
- No longer unidle shard during recovery
- Obey translog durability in global checkpoint sync

Settings::
- Settings: Introduce settings updater for a list of settings
- Fix setting notification for complex setting (affixMap settings)
  that could cause transient settings to be ignored
- Fix environment variable substitutions in list setting
- Allow index settings to be reset by wildcards

Snapshot/Restore::
- Consistent updates of IndexShardSnapshotStatus
- Avoid concurrent snapshot finalizations when deleting an INIT
  snapshot
- Do not start snapshots that are deleted during initialization
- Do not swallow exception in ChecksumBlobStoreFormat.writeAtomic()
- Consistent update of stage and failure message in
  IndexShardSnapshotStatus
- Fail restore when the shard allocations max retries count is reached
- Delete shard store files before restoring a snapshot

Stats::
- Fixes DocStats to properly deal with shards that report -1 index
  size
- Include internal refreshes in refresh stats

Term Vectors::
- Fix term vectors generator with keyword and normalizer


=== Upgrades

Core::
- Dependencies: Update joda time to 2.9.9
- upgrade to lucene 7.2.1
- Upgrade jna from 4.4.0-1 to 4.5.1

Ingest::
- update ingest-attachment to use Tika 1.17 and newer deps





6.1.3

Engine::
- Replica recovery could go into an endless flushing loop

Internal::
- Never return null from Strings.tokenizeToStringArray
- Fallback to TransportMasterNodeAction for cluster health retries

Mapping::
- Allow update of `eager_global_ordinals` on `_parent`.

Scripting::
- Ensure we protect Collections obtained from scripts from
  self-referencing

Settings::
- Fix setting notification for complex setting (affixMap settings)
  that could cause transient settings to be ignored
- Fix environment variable substitutions in list setting

Snapshot/Restore::
- Avoid concurrent snapshot finalizations when deleting an INIT
  snapshot
- Do not start snapshots that are deleted during initialization
2018-02-07 16:26:16 +00:00
fhajny
eda0fe6612 Update databases/py-peewee to 3.0.13
3.0.13
- Fix bug where simple field aliases were being ignored.
- More strict about column type inference for postgres + pwiz.

3.0.12
- Fix queries of the form INSERT ... VALUES (SELECT...) so that
  sub-select is wrapped in parentheses.
- Improve model-graph resolution when selecting from multiple tables
  that are joined by foreign-keys, and an intermediate table is
  omitted from selection.
- Docs update to reflect deletion of post_init signal.

3.0.11
- Add note to changelog about cursor() method.
- Add hash method to postgres indexedfield subclasses.
- Add TableFunction to sqlite_ext module namespace.
- Fix bug regarding NOT IN queries where the right-hand-side is an
  empty set.
- Fallback implementations of bm25f and lucene search ranking
  algorithms.
- Fixed DecimalField issue.
- Fixed issue with BlobField when database is a Proxy object.
2018-02-07 16:12:08 +00:00
jperkin
c6710b230d mysql-cluster: Specify C++03, not C++11 clean. 2018-02-05 18:09:35 +00:00
jperkin
20d1c52468 mysql56-client: Backport comparison fix from upstream. 2018-02-05 16:09:52 +00:00
fhajny
011d585873 databases/redis: Update to 3.0.8.
- Redis 4.0.8 fixes a single critical bug in the radix tree data
  structure used for Redis Cluster keys slot tracking.
2018-02-04 17:13:05 +00:00
fhajny
c65963a545 databases/py-peewee: Update to 3.0.10.
- Fix Database.drop_tables() signature to support cascade argument
- Fix querying documentation for custom functions
- Added len() method to ModelBase for convenient counting.
- Fix bug related to unsaved relation population (thanks @conqp)
- Fix count() on compound select
- Support coerce keyword argument with fn.XXX()
- Support updating existing model instance with dict_to_model-like API
- Fix equality tests with ArrayField
2018-02-04 17:07:18 +00:00
fhajny
83eb6e7eeb databases/py-peewee: Update to 3.0.9.
3.0.9
- Add deprecation notice if passing autocommit as keyword argument to
  the Database initializer.
- Add JSONPath and "J" helpers to sqlite extension.

3.0.8
- Add support for passing cascade=True when dropping tables.
- Fix issues with backrefs and inherited foreign-keys.

3.0.7
- Add select_extend() method to extend existing SELECT-ion.
- Accept set() as iterable value type
- Add test for model/field inheritance and fix bug relating to
  recursion error when inheriting foreign-key field.
- Fix regression where consecutive calls to ModelSelect.select() with
  no parameters resulted in an empty selection.

3.0.6
- Add constraints for ON UPDATE/ON DELETE to foreign-key constraint

3.0.5
- Adds Model.index(), a short-hand method for declaring ModelIndex
  instances.

3.0.4
- Re-add a shim for PrimaryKeyField (renamed to AutoField) and log a
  deprecation warning if you try to use it

3.0.3
- Includes fix for bug where column-name to field-name translation was
  not being done when running select queries on models whose field
  name differed from the underlying column name.

3.0.2
- Fixes missing pysqlite header files, which are needed to compile
  certain C extensions.

3.0.0
- Complete rewrite of SQL AST and code-generation.
- Inclusion of new, low-level query builder APIs.
- List of backwards-incompatible changes since 2.x:

  http://docs.peewee-orm.com/en/latest/peewee/changes.html
2018-02-02 16:00:33 +00:00
wen
d11f93c4da Update to 1.85
Upstream changes:
1.85 - 2018-01-27
    - Restore perl version requirement missed in the Distar port
    - Factor out the SET ... part of UPDATE for subclassability (GH#12)
2018-02-02 10:18:13 +00:00
wen
414f712d2a Update to 1.640
Upstream changes:
Changes in DBI 1.640 - 28th January 2018

    Fix test t/91_store_warning.t for perl 5.10.0
        thanks to pali #57

    Add Perl 5.10.0 and 5.8.1 specific versions to Travis testing
        thanks to pali #57
    Add registration of mariadb_ prefix for new DBD::MariaDB driver
        thanks to pali #56
2018-02-02 02:11:51 +00:00
jperkin
dd37529e87 mysql51-client: Build fix from upstream and limit to C++03. 2018-02-01 23:14:55 +00:00
jperkin
87d168073e mysql57-client: Disable compiler detection on SunOS. 2018-02-01 23:01:38 +00:00
jperkin
a61291a5a5 mysql56-client: Disable compiler detection on SunOS. 2018-02-01 23:01:19 +00:00
fhajny
f8664c5f51 Import mysqlclient 1.3.12 as databases/py-mysqlclient.
Based on https://github.com/joyent/pkgsrc/issues/77 by @wiedi

This is a fork of MySQLdb. This project adds Python 3 support and bug fixes.
2018-02-01 22:20:08 +00:00
jperkin
77d2b78e86 sqlrelay: Specify C++03, not C++17 clean (deprecated-register). 2018-01-30 23:14:45 +00:00
fhajny
fef2349d44 Update databases/redis to 4.0.7.
- Many 32 bit overflows were addressed in order to allow to use Redis with
  a very significant amount of data, memory size permitting.
- MEMORY USAGE fixed for the list type.
- Allow read-only scripts in Redis Cluster.
- Fix AOF pipes setup in edge case.
- AUTH option for MIGRATE.
- HyperLogLogs are no longer converted from sparse to dense in order
  to be merged.
- Fix AOF rewrite dead loop under edge cases.
- Fix processing of large bulk strings (>= 2GB).
- Added RM_UnlinkKey in modules API.
- Fix Redis Cluster crashes when certain commands with a variable number
  of arguments are called in an improper way.
- Fix memory leak in lazyfree engine.
- Fix many potentially successful partial synchronizations that end
  doing a full SYNC, because of a bug destroying the replication
  backlog on the slave. So after a failover the slave was often not able
  to PSYNC with masters, and a full SYNC was triggered. The bug only
  happened after 1 hour of uptime so escaped the unit tests.
- Improve anti-affinity in master/slave allocation for Redis Cluster
  when the cluster is created.
- Improve output buffer handling for slaves, by not limiting the amount
  of writes a slave could receive.
2018-01-30 16:40:13 +00:00
adam
e0832e1932 py-sqlalchemy: updated to 1.2.2
1.2.2:
orm
[orm] [bug] Fixed 1.2 regression regarding new bulk_replace event where a backref would fail to remove an object from the previous owner when a bulk-assignment assigned the object to a new owner.

mysql
[mysql] [bug] Added more MySQL 8.0 reserved words to the MySQL dialect for quoting purposes. Pull request courtesy Riccardo Magliocchetti.

mssql
[mssql] [bug] Added ODBC error code 10054 to the list of error codes that count as a disconnect for ODBC / MSSQL server.

oracle
[oracle] [bug] The cx_Oracle dialect now calls setinputsizes() with cx_Oracle.NCHAR unconditionally when the NVARCHAR2 datatype, in SQLAlchemy corresponding to sqltypes.Unicode(), is in use. Per cx_Oracle’s author this allows the correct conversions to occur within the Oracle client regardless of the setting for NLS_NCHAR_CHARACTERSET.
2018-01-29 13:44:32 +00:00
wiz
bff4597ffc Bump PKGREVISION for gdbm shlib major bump 2018-01-28 20:10:34 +00:00
wiz
7fb1e5e341 gdbm: update to 1.14.1.
Version 1.14.1 - 2018-01-03

* Increment soname current version number.

Version 1.14 - 2018-01-01

* Make sure created databases are byte-for-byte reproducible

This fixes two longstanding bugs: (1) when allocating database file
header blocks, the unused memory is filled with zeroes; (2) when expanding
a mmapped memory area, the added extent is filled with zeroes.

* Fix build with --enable-gdbm-export

* Make gdbm_error global variable thread safe.

* Fix possible segmentation violation in gdbm_setopt

* Fix handling of group headers in --help output.
2018-01-28 19:40:22 +00:00
wiz
58a2a977a7 recursive bump after mpfr shlib major bump 2018-01-28 16:24:10 +00:00
adam
b28413961e py-multidict: updated to 4.1.0
4.1.0:
* Fix key casing in Pure Python implementation of CIMultiDict
2018-01-28 08:46:26 +00:00
wen
ebefd6c3d8 Update to 2.033004
Upstream changes:
2.033004  2018-01-26 09:33:20-08:00 America/Los_Angeles
 - Fix ::RemoveColumns and ::AutoRemoveColumns to not wreak havoc when select/as
   is used (Thanks Vladimir Melnik for test and ribasushi for hint at fix!)
 - Allow easily subclassing types to be skipped in ::ToJSON
   (Thanks Paul Williams!) (closes GH#79 and GH#80)
2018-01-27 07:46:36 +00:00
jperkin
ff48cd7c0a hiredis: Fix SunOS linker flags. 2018-01-26 09:33:31 +00:00
adam
ac53768ec0 py-pymysql: updated to 0.8.0
0.8:
* **BACKWARD INCOMPATIBLE** binary_prefix option is added and off
  by default because of compatibility with mysqlclient.
  When you need PyMySQL 0.7 behavior, you have to pass binary_prefix=True.
* **BACKWARD INCOMPATIBLE** MULTI_STATEMENTS client flag is no longer
  set by default, while it was on PyMySQL 0.7.  You need to pass
  client_flag=CLIENT.MULTI_STATEMENTS when you connect to explicitly
  enable multi-statement mode.
* Fixed AuthSwitch packet handling.
* Raise OperationalError for MariaDB's constraint error.
* executemany() accepts query without space between VALUES and (.
* Support config file containing option without value.
* Fixed Connection.ping() returned unintended value.
2018-01-24 14:19:34 +00:00
adam
27f40ca76f sqlite3: updated to 3.22.0
Release 3.22.0:
The output of sqlite3_trace_v2() now shows each individual SQL statement run within a trigger.
Add the ability to read from WAL mode databases even if the application lacks write permission on the database and its containing directory, as long as the -shm and -wal files exist in that directory.
Added the rtreecheck() scalar SQL function to the R-Tree extension.
Added the sqlite3_vtab_nochange() and sqlite3_value_nochange() interfaces to help virtual table implementations optimize UPDATE operations.
Added the sqlite3_vtab_collation() interface.
Added support for the "^" initial token syntax in FTS5.
New extensions:
The Zipfile virtual table can read and write a ZIP Archive.
Added the fsdir(PATH) table-valued function to the fileio.c extension, for listing the files in a directory.
The sqlite_btreeinfo eponymous virtual table for introspecting and estimating the sizes of the btrees in a database.
The Append VFS is a VFS shim that allows an SQLite database to be appended to some other file. This allows (for example) a database to be appended to an executable that then opens and reads the database.
Query planner enhancements:
The optimization that uses an index to quickly compute an aggregate min() or max() is extended to work with indexes on expressions.
The decision of whether to implement a FROM-clause subquery as a co-routine or using query flattening now considers whether the result set of the outer query is "complex" (if it contains functions or expression subqueries). A complex result set biases the decision toward the use of co-routines.
The planner avoids query plans that use indexes with unknown collating functions.
The planner omits unused LEFT JOINs even if they are not the right-most joins of a query.
Other performance optimizations:
A smaller and faster implementation of text to floating-point conversion subroutine: sqlite3AtoF().
The Lemon parser generator creates a faster parser.
Use the strcspn() C-library routine to speed up the LIKE and GLOB operators.
Improvements to the command-line shell:
The ".schema" command shows the structure of virtual tables.
Added support for reading and writing SQL Archive files using the .archive command.
Added the experimental .expert command
Added the ".eqp trigger" variant of the ".eqp" command
Enhance the ".lint fkey-indexes" command so that it works with WITHOUT ROWID tables.
If the filename argument to the shell is a ZIP archive rather than an SQLite database, then the shell automatically opens that ZIP archive using the Zipfile virtual table.
Added the edit() SQL function.
Added the .excel command to simplify exporting database content to a spreadsheet.
Databases are opened using Append VFS when the --append flag is used on the command line or with the .open command.
Enhance the SQLITE_ENABLE_UPDATE_DELETE_LIMIT compile-time option so that it works for WITHOUT ROWID tables.
Provide the sqlite_offset(X) SQL function that returns the byte offset into the database file to the beginning of the record holding value X, when compiling with -DSQLITE_ENABLE_OFFSET_SQL_FUNC.
Bug fixes
2018-01-24 13:44:14 +00:00
adam
b5ec5a1e90 py-ldap3: updated to 2.4.1
2.4.1:
- tested against pyasn1 from version 0.1.8 up to version 0.4.2, Python 2.6.6, Python 2.7.14, Python 3.6.4
- auto_encode parameter is honored when binding
- fixed organizationalName definition in oid
- automatic byte to int conversion working again
- mock connection searchs correctly escape filters
- fixed bind with not unicode characters in Python 2
- extended filter attributes should work again with pyasn1 0.4.1
- fixed error when reading incomplete server info
- NOT keyword properly handled in dit_content_rules
- operational attributes are prorerly returned in Cursor whit get_operational_attributes = True
- start_tls() is properly executed with AD when raise_exceptions=True
- reopening a Connection honours auto_bind setting
- an attribute returned with no value from a flaky server doesn't raise exception anymore
- pwdLastSet in AD is valid only for -1
- fixed docs for ldifProducer
- fixed monkeypatching of pyasn1 for Boolean Value in BER encoding
- check_names was not honoured while validating attribute values
- locks refactored in Connection and in Async strategy
- socket properly closed when checking availability of an invalid server
2018-01-24 13:41:35 +00:00