Release 2.5.2:
* code-cleaning in setup.py
Modules/
* PyBytes_ instead of PyString_ and added PyInt_FromLong compat macro
* moved code from version.c to ldapmodule.c
* removed obsolete back-ward compability constants from common.h
* build checks whether LDAP_API_VERSION is OpenLDAP 2.4.x
* _ldap.__author__ and _ldap.__license__ also set from ldap.pkginfo
* assume C extension API for Python 2.7+
Lib/
* removed all dependencies on modules string and types
* removed use of .has_key()
* removed class ldap.ldapobject.NonblockingLDAPObject
* new global constant ldap.LIBLDAP_API_INFO
* right after importing _ldap there is a call into libldap to initialize it
* method .decodeControlValue() of SSSResponseControl and VLVResponseControl
does not set class attribute result_code anymore
* always use bytes() for UUID() constructor in ldap.syncrepl
* module ldif now uses functions b64encode() and b64decode()
* fixed pickling and restoring of ReconnectLDAPObject
* more modules with PEP-8 compliance
* ldap.ldapobject split into module-package
Tests/
* scripts do not directly call SlapdTestCase.setUpClass() anymore
* added LDIF test with folded, base64-encoded attribute
* added more tests for sub-module ldap.dn
* added tests for ldap.syncrepl
2.64, 2017-11-20 several small bugfixes and enhancements
BUG FIX
In dbroweval, the next row option previously did not correctly set up _last_fieldname. It now does.
ENHANCEMENT
The csv_to_db converter now has an optional -F x option to set the field separator.
ENHANCEMENT
Finally dbcolsplittocols has a --header option, and a new -N option to give the list of resulting output columns.
INCOMPATIBLE CHANGE
Now dbcolstats and dbmultistats produce no output (but a schema) when given no input but a schema. Previously they gave a null row of output. The --output-on-no-input and --no-output-on-no-input options can control this behavior.
- Remove option to bundle the Snappy compression library, it caused issues
for programs linking to libmongoc
- Fix pkg-config and CMake config file flags for programs that statically
link to libmongoc when libmongoc is statically linked to zLib
- The configure flag "--with-zlib=no" was ignored
- Fix crash in authentication when username is NULL
=== Breaking changes
Aggregations::
- Change parsing of numeric `to` and `from` parameters in `date_range`
aggregation
Aliases::
- Wrong behavior deleting alias
Allocation::
- Remove `cluster.routing.allocation.snapshot.relocation_enabled`
setting
Analysis::
- Do not allow custom analyzers to have the same names as built-in
analyzers
- Removing query-string parameters in `_analyze` API
CAT API::
- Write -1 on unbounded queue in cat thread pool
CRUD::
- Disallow `VersionType.FORCE` for GetRequest
- Disallow `VersionType.FORCE` versioning for 6.x indices
- If the index does not exist, delete document will not auto create it
Cluster::
- Disallow : in cluster and index/alias names
- No longer allow cluster name in data path
Core::
- Simplify file store
- Make boolean conversion strict
- Remove the `default` store type.
- Remove store throttling.
Geo::
- Remove deprecated geo search features
- Reduce GeoDistance Insanity
Highlighting::
- Remove the postings highlighter and make unified the default
highlighter choice
Index APIs::
- Remove (deprecated) support for '+' in index expressions
- Delete index API to work only against concrete indices
- Open/Close index api to allow_no_indices by default
- Remove support for controversial `ignore_unavailable` and
`allow_no_indices` from indices exists api
Index Templates::
- Allows multiple patterns to be specified for index templates
Indexed Scripts/Templates::
- Scripting: Remove search template actions
Ingest::
- update ingest-user-agent regexes.yml
- remove ingest.new_date_format
Inner Hits::
- Return the _source of inner hit nested as is without wrapping it
into its full path context
Java API::
- Enforce Content-Type requirement on the rest layer and remove
deprecated methods
Java REST Client::
- Remove deprecated created and found from index, delete and bulk
Mapping::
- Reject out of range numbers for float, double and half_float
- Enforce at most one type.
- Disallow `include_in_all` for 6.0+ indices
- Disable _all by default, disallow configuring _all on 6.0+ indices
- Throw an exception on unrecognized "match_mapping_type"
Network::
- Remove unused Netty-related settings
- Remove blocking TCP clients and servers
- Remove `modules/transport_netty_3` in favor of `netty_4`
- Remove LocalTransport in favor of MockTcpTransport
Packaging::
- Configure heap dump path out of the box
- Remove support for ES_INCLUDE
- Setup: Change default heap to 1G
- Use config directory to find jvm.options
- Remove implicit 32-bit support
- Remove default path settings
- Remove path.conf setting
- Honor masking of systemd-sysctl.service
- Rename CONF_DIR to ES_PATH_CONF
- Remove customization of ES_USER and ES_GROUP
Percolator::
- Remove deprecated percolate and mpercolate apis
Plugin Analysis ICU::
- Upgrade icu4j for the ICU analysis plugin to 59.1
- Upgrade icu4j to latest version
Plugin Delete By Query::
- Require explicit query in _delete_by_query API
Plugin Discovery Azure Classic::
- Remove `discovery.type` BWC layer from the EC2/Azure/GCE plugins
Plugin Discovery EC2::
- Ec2 Discovery: Cleanup deprecated settings
- Discovery EC2: Remove region setting
- AWS Plugins: Remove signer type setting
Plugin Lang JS::
- Remove lang-python and lang-javascript
Plugin Mapper Attachment::
- Remove mapper attachments plugin
Plugin Repository Azure::
- Remove global `repositories.azure` settings
- Remove auto creation of container for azure repository
Plugin Repository GCS::
- GCS Repository: Remove specifying credential file on disk
Plugin Repository S3::
- S3 Repository: Cleanup deprecated settings
- S3 Repository: Remove region setting
- S3 Repository: Remove bucket auto create
- S3 Repository: Remove env var and sysprop credentials support
- Remove deprecated S3 settings
Plugins::
- Make plugin loading stricter
Query DSL::
- Remove deprecated `type` and `slop` field in `match` query
- Remove several parse field deprecations in query builders
- Remove deprecated parameters from `ids_query`
- Refactor QueryStringQuery for 6.0
- Change `split_on_whitespace` default to false
- Remove deprecated template query
- Throw exception in scroll requests using `from`
- Remove deprecated `minimum_number_should_match` in BoolQueryBuilder
- Remove support for empty queries
- Remove deprecated query names: in, geo_bbox, mlt, fuzzy_match and
match_fuzzy
- The `terms` query should always map to a Lucene `TermsQuery`.
- Be strict when parsing values searching for booleans
- Remove collect payloads parameter
REST::
- IndexClosedException to return 400 rather than 403
- Remove comma-separated feature parsing for GetIndicesAction
- Improve REST error handling when endpoint does not support HTTP
verb, add OPTIONS support
- Remove ldjson support and document ndjson for bulk/msearch
- Enable strict duplicate checks for all XContent types
- Enable strict duplicate checks for JSON content
- Remove lenient stats parsing
- Remove allow unquoted JSON
- Remove FORCE version_type
Scripting::
- remove lang url parameter from stored script requests
- Disallow lang to be used with Stored Scripts
- Remove Deprecated Script Settings
- Scripting: Remove native scripts
- Scripting: Remove file scripts
- Make dates be ReadableDateTimes in scripts
- Remove groovy scripting language
- Remove script access to term statistics
Search::
- Make `index` in TermsLookup mandatory
- Removes FieldStats API
- Remove deprecated fielddata_fields from search request
- Removes deprecated fielddata_fields
- ProfileResult and CollectorResult should print machine readable
timing information
- Remove indices query
- Remove ignored type parameter in search_shards api
Sequence IDs::
- Change certain replica failures not to fail the replica shard
Settings::
- Settings: Remove shared setting property
- Settings: Remove support for yaml and json config files
Shadow Replicas::
- Remove shadow replicas
Similarities::
- Similarity should accept dynamic settings when possible
=== Breaking Java changes
Aggregations::
- Remove the unused SignificantTerms.compareTerm() method
- Make SignificantTerms.Bucket an interface rather than an abstract
class
- Fix NPE when `values` is omitted on percentile_ranks agg
- Make Terms.Bucket an interface rather than an abstract class
- Compound order for histogram aggregations
Internal::
- Collapses package structure for some bucket aggs
Java API::
- Remove deprecated IdsQueryBuilder ctor
- Removing unneeded getTookInMillis method
- Java api: ActionRequestBuilder#execute to return a PlainActionFuture
Java High Level REST Client::
- Unify the result interfaces from get and search in Java client
- Allow RestHighLevelClient to use plugins
Java REST Client::
- Rename client artifacts
Network::
- Simplify TransportAddress
Plugin Delete By Query::
- Move DeleteByQuery and Reindex requests into core
Plugins::
- Drop name from TokenizerFactory
Query DSL::
- Remove QueryParseContext
- Remove QueryParseContext from parsing QueryBuilders
REST::
- Return index name and empty map for `/{index}/_alias` with no
aliases
=== Deprecations
Index APIs::
- Deprecated use of + in index expressions
Index Templates::
- Restore deprecation warning for invalid match_mapping_type values
Indexed Scripts/Templates::
- Scripting: Deprecate stored search template apis
Internal::
- Deprecate XContentType auto detection methods in XContentFactory
Percolator::
- Deprecate percolate query's document_type parameter.
Plugins::
- Plugins: Add backcompat for sha1 checksums
Scripting::
- Scripting: Change keys for inline/stored scripts to source/id
- Scripting: Deprecate native scripts
- Scripting: Deprecate index lookup
- Deprecate Fine Grain Settings for Scripts
- Scripting: Deprecate file script settings
- Scripting: Deprecate file scripts
Settings::
- Settings: Update settings deprecation from yml to yaml
- Deprecate settings in .yml and .json
Tribe Node::
- Deprecate tribe service
=== New features
Aggregations::
- SignificantText aggregation - like significant_terms, but for text
Analysis::
- Expose simplepattern and simplepatternsplit tokenizers
- Parse synonyms with the same analysis chain
Core::
- Enable index-time sorting
Internal::
- Automatically adjust search threadpool queue_size
Mapping::
- Add new ip_range field type
Parent/Child::
- Move parent_id query to the parent-join module
- Introduce ParentJoinFieldMapper, a field mapper that creates
parent/child relation within documents of the same index
Plugin Analysis ICU::
- Add ICUCollationFieldMapper
Search::
- Automatically early terminate search query based on index sorting
Sequence IDs::
- Add a scheduled translog retention check
- Initialize sequence numbers on a shrunken index
- Initialize primary term for shrunk indices
- Introduce translog size and age based retention policies
Stats::
- Adds nodes usage API to monitor usages of actions
Task Manager::
- Task Management
Upgrade API::
- TemplateUpgraders should be called during rolling restart
=== Enhancements
Aggregations::
- Add strict parsing of aggregation ranges
- Adds rewrite phase to aggregations
- Tweak AggregatorBase.addRequestCircuitBreakerBytes
- Add superset size to Significant Term REST response
- Add document count to Matrix Stats aggregation response
- Adds an implementation of LogLogBeta for the cardinality aggregation
- Support distance units in GeoHashGrid aggregation precision
- Reject multiple methods in `percentiles` aggregation
- Use `global_ordinals_hash` execution mode when sorting by sub
aggregations.
- Add a specialized deferring collector for terms aggregator
- Agg builder accessibility fixes
- Remove support for the include/pattern syntax.
- Promote longs to doubles when a terms agg mixes decimal and
non-decimal numbers
Allocation::
- Adjust status on bad allocation explain requests
- Promote replica on the highest version node
Analysis::
- [Analysis] Support normalizer in request param
- Enforce validation for PathHierarchy tokenizer
- [analysis-icu] Allow setting unicodeSetFilter
- Match- and MultiMatchQueryBuilder should only allow setting analyzer
on string values
Bulk::
- Simplify bulk request execution
CAT API::
- expand `/_cat/nodes` to return information about hard drive
CRUD::
- Added validation for upsert request
Circuit Breakers::
- ScriptService: Replace max compilation per minute setting with max
compilation rate
Cluster::
- Validate a joining node's version with version of existing cluster
nodes
- Switch indices read-only if a node runs out of disk space
- Add a cluster block that allows to delete indices that are read-only
- Separate publishing from applying cluster states
- Adds cluster state size to /_cluster/state response
Core::
- Allow `InputStreamStreamInput` array size validation where
applicable
- Refactor bootstrap check results and error messages
- Add BootstrapContext to expose settings and recovered state to
bootstrap checks
- Unit testable index creation task on MetaDataCreateIndexService
- Ignore .DS_Store files on macOS
- Add max file size bootstrap check
- Add compatibility versions to main action response
- Index ids in binary form.
- Explicitly reject duplicate data paths
- Use SPI in High Level Rest Client to load XContent parsers
- Upgrade to lucene-7.0.0-snapshot-a0aef2f
- Speed up PK lookups at index time.
- Use Java 9 FilePermission model
- Add friendlier message on bad keystore permissions
- Epoch millis and second formats accept float implicitly
- Remove connect SocketPermissions from core
- Add repository-url module and move URLRepository
- Remove accept SocketPermissions from core
- Move IfConfig.logIfNecessary call into bootstrap
- Remove artificial default processors limit
- Simplify write failure handling
- Improve bootstrap checks error messages
Discovery::
- Allow plugins to validate cluster-state on join
Engine::
- Add refresh stats tracking for realtime get
- Introducing a translog deletion policy
- Fill missing sequence IDs up to max sequence ID when recovering from
store
- Use sequence numbers to identify out of order delivery in replicas &
recovery
- Add replica ops with version conflict to translog
- Clarify global checkpoint recovery
- Move the IndexDeletionPolicy to be engine internal
Exceptions::
- IllegalStateException: Only duplicated jar instead of classpath
Highlighting::
- Picks offset source for the unified highlighter directly from the es
mapping
Index APIs::
- Let primary own its replication group
- Create index request should return the index name
Index Templates::
- Fix error message for a put index template request without
index_patterns
Ingest::
- Add Ingest-Processor specific Rest Endpoints & Add Grok endpoint
- Port support for commercial GeoIP2 databases from Logstash.
- add `exclude_keys` option to KeyValueProcessor
- Allow removing multiple fields in ingest processor
- Add target_field parameter to ingest processors
Inner Hits::
- Reuse inner hit query weight
Internal::
- TemplateUpgradeService should only run on the master
- Cleanup IndexFieldData visibility
- Bump the min compat version to 5.6.0
- "shard started" should show index and shard ID
- Break out clear scroll logic from TransportClearScrollAction
- Add helper methods to TransportActionProxy to identify proxy actions
and requests
- Add remote cluster infrastructure to fetch discovery nodes.
- Add the ability to set eager_global_ordinals in the new parent-join
field
- Disallow multiple parent-join fields per mapping
- Remove the need for _UNRELEASED suffix in versions
- Optimize the order of bytes in uuids for better compression.
- Prevent cluster internal `ClusterState.Custom` impls to leak to a
client
- Use holder pattern for lazy deprecation loggers
- Allow `ClusterState.Custom` to be created on initial cluster states
- Try to convince the JVM not to lose stacktraces
- Make document write requests immutable
- Add assertions enabled helper
Java API::
- Always Accumulate Transport Exceptions
Java High Level REST Client::
- [DOCS] restructure java clients docs pages
- Use SPI in High Level Rest Client to load XContent parsers
- Add support for clear scroll to high level REST client
- Add search scroll method to high level REST client
- Add search method to high level REST client
- Make RestHighLevelClient Closeable and simplify its creation
- Add info method to High Level Rest client
- Add support for named xcontent parsers to high level REST client
- Add BulkRequest support to High Level Rest client
- Add UpdateRequest support to High Level Rest client
- Add delete API to the High Level Rest Client
- Add Index API to High Level Rest Client
- Add get/exists method to RestHighLevelClient
- Add fromxcontent methods to delete response
- Add REST high level client gradle submodule and first simple method
- Add doc_count to ParsedMatrixStats
- Add fromXContent method to ClearScrollResponse
- ClearScrollRequest to implement ToXContentObject
- SearchScrollRequest to implement ToXContentObject
- Add aggs parsers for high level REST Client
Java REST Client::
- Shade external dependencies in the rest client jar
- RestClient uses system properties and system default SSLContext
- Wrap rest httpclient with doPrivileged blocks
Logging::
- Prevent excessive disk consumption by log files
- Use LRU set to reduce repeat deprecation messages
Mapping::
- More efficient encoding of range fields.
- Don't detect source's XContentType in DocumentParser.parseDocument()
- Better validation of `copy_to`.
- Optimize `terms` queries on `ip` addresses to use a
`PointInSetQuery` whenever possible.
- Loosen the restrictions on disabling _all in 6.x
- Date detection should not rely on a hardcoded set of characters.
- Identify documents by their `_id`.
Network::
- Add additional low-level logging handler
- Unwrap causes when maybe dying
- Move TransportStats accounting into TcpTransport
- Simplify connection closing and cleanups in TcpTransport
- Disable the Netty recycler in the client
- Remove Netty logging hack
- Isolate SocketPermissions to Netty
- Wrap netty accept/connect ops with doPrivileged
- Replace Socket, ServerSocket, and HttpServer usages in tests with
mocksocket versions
Packaging::
- Remove memlock suggestion from systemd service
- Set address space limit in systemd service file
- Version option should display if snapshot
- Ignore JVM options before checking Java version
- Also skip JAVA_TOOL_OPTIONS on Windows
- Introduce elasticsearch-env for Windows
- Introduce elasticsearch-env
- Stop exporting HOSTNAME from scripts
- Set number of processes in systemd unit file
Parent/Child::
- Remove ParentJoinFieldSubFetchPhase
- Support parent id being specified as number in the _source
Percolator::
- Store the QueryBuilder's Writable representation instead of its
XContent representation
- Add support for selecting percolator query candidate matches
containing wildcard / prefix queries
Plugin Discovery EC2::
- Read ec2 discovery address from aws instance tags
Plugin Lang Painless::
- Allow Custom Whitelists in Painless
- Update Painless to Allow Augmentation from Any Class
- Add Needs Methods to Painless Script Context Factories
- Support Script Context Stateful Factory in Painless
- Generate Painless Factory for Creating Script Instances
- Update Painless to Use New Script Contexts
- Optimize instance creation in LambdaBootstrap
- Make Painless Compiler Use an Instance Per Context
- Make PainlessScript An Interface
Plugin Repository GCS::
- GCS Repository: Add secure storage of credentials
Plugin Repository HDFS::
- Add permission checks before reading from HDFS stream
- Add doPrivilege blocks for socket connect ops in repository-hdfs
- Add Kerberos support for Repo HDFS plugin
Plugin Repository S3::
- S3 Repository: Add back repository level credentials
Plugins::
- Adjust SHA-512 supported format on plugin install
- Move tribe to a module
- Plugins can register pre-configured char filters
- Add purge option to remove plugin CLI
- Allow plugins to register pre-configured tokenizers
- Move ReindexAction class to core
- Make PreConfiguredTokenFilter harder to misuse
- Plugins: Remove leniency for missing plugins dir
- Add doPrivilege blocks for socket connect operations in plugins
Query DSL::
- Make slop optional when parsing `span_near` query
- Require a field when a `seed` is provided to the `random_score`
function.
- Add support for auto_generate_synonyms_phrase_query in match_query,
multi_match_query, query_string and simple_query_string
REST::
- Cat shards bytes
- Refactor PathTrie and RestController to use a single trie for all
methods
- Make ObjectParser support string to boolean conversion
Recovery::
- Introduce a History UUID as a requirement for ops based recovery
- Goodbye, Translog Views
- Disallow multiple concurrent recovery attempts for same target shard
- Live primary-replica resync (no rollback)
- Peer Recovery: remove maxUnsafeAutoIdTimestamp hand off
- Introduce sequence-number-based recovery
Scripting::
- Scripting: Rename SearchScript.needsScores to needs_score
- Scripting: Add optional context parameter to put stored script
requests
- Add New Security Script Settings
- Add StatefulFactoryType as optional intermediate factory in script
contexts
- Make contexts available to ScriptEngine construction
- Make ScriptEngine.compile generic on the script context
- Add instance and compiled classes to script contexts
Search::
- Add soft limit on allowed number of script fields in request
- Add a soft limit for the number of requested doc-value fields
- Rewrite search requests on the coordinating nodes
- Ensure query resources are fetched asynchronously during rewrite
- Introduce a new Rewriteable interface to streamline rewriting
- Reduce the scope of `QueryRewriteContext`
- Reduce the overhead of timeouts and low-level search cancellation.
- Reduce profiling overhead.
- Prevent `can_match` requests from sending to incompatible nodes
- Add a shard filter search phase to pre-filter shards based on query
rewriting
- Ensure we rewrite common queries to `match_none` if possible
- Limit the number of concurrent shard requests per search request
- Add cluster name validation to RemoteClusterConnection
- Speed up sorted scroll when the index sort matches the search sort
- Leverage scorerSupplier when applicable.
- Add Cross Cluster Search support for scroll searches
- Track EWMA[1] of task execution time in search threadpool executor
- Query range fields by doc values when they are expected to be more
efficient than points
- Search: Fairer balancing when routing searches by session ID
- Add parsing from xContent to Suggest
- Add parsing from xContent to ShardSearchFailure
- Eliminate array access in tight loops when profiling is enabled.
- Support Multiple Inner Hits on a Field Collapse Request
- Expand cross cluster search indices for search requests to the
concrete index or to it's aliases
Search Templates::
- Add max concurrent searches to multi template search
Sequence IDs::
- Roll translog generation on primary promotion
- Restoring from snapshot should force generation of a new history
uuid
- Add global checkpoint tracking on the primary
- Introduce global checkpoint background sync
- Move `UNASSIGNED_SEQ_NO` and `NO_OPS_PERFORMED` to SequenceNumbers`
- Move primary term from ReplicationRequest to ConcreteShardRequest
- Add reason to global checkpoint updates on replica
- Introduce primary/replica mode for GlobalCheckPointTracker
- Throw back replica local checkpoint on new primary
- Update global checkpoint when increasing primary term on replica
- Enable a long translog retention policy by default
- Introduce primary context
- Block older operations on primary term transition
- Block global checkpoint advances when recovering
- Add primary term to doc write response
- Preserve multiple translog generations
- Introduce translog generation rolling
- Replicate write failures
- Introduce sequence-number-aware translog
- Introduce translog no-op
- Tighten sequence numbers recovery
- Add BWC layer to seq no infra and enable BWC tests
- Add internal _primary_term doc values field, fix _seq_no indexing
- Add global checkpoint to translog checkpoints
- Sequence numbers commit data for Lucene uses Iterable interface
- Simplify GlobalCheckpointService and properly hook it for cluster
state updates
- Fill gaps on primary promotion
- Introduce clean transition on primary promotion
- Guarantee that translog generations are seqNo conflict free
- Inline global checkpoints
Settings::
- Add disk threshold settings validation
- Enable cross-setting validation
- Validate `transport.profiles.*` settings
- Cleanup network / transport related settings
- Emit settings deprecation logging at most once
- IndexMetaData: Introduce internal format index setting
- Persist created keystore on startup unless keystore is present
- Settings: Add keystore.seed auto generated secure setting
- Settings: Add keystore creation to add commands
Snapshot/Restore::
- Fixed references to Multi Index Syntax
- Improves snapshot logging and snapshot deletion error handling
- Enhances get snapshots API to allow retrieving repository index only
Stats::
- Update `IndexShard#refreshMetric` via a
`ReferenceManager.RefreshListener`
- Expose disk usage estimates in nodes stats
Store::
- Remote support for lucene versions without checksums
Suggesters::
- Remove deprecated _suggest endpoint
Task Manager::
- Add descriptions to bulk tasks
Translog::
- Translog file recovery should not rely on lucene commits
=== Bug fixes
Aggregations::
- Do not delegate a null scorer to LeafBucketCollectors
- Create weights lazily in filter and filters aggregation
- Fix IndexOutOfBoundsException in histograms for NaN doubles (#26787)
- Scripted_metric _agg parameter disappears if params are provided
- Fixes array out of bounds for value count agg
- Aggregations bug: Significant_text fails on arrays of text.
- Check bucket metric ages point to a multi bucket agg
- Terms aggregation should remap global ordinal buckets when a
sub-aggregator is used to sort the terms
- Correctly set doc_count when MovAvg "predicts" values on existing
buckets
- DateHistogram: Fix `extended_bounds` with `offset`
- Fix ArrayIndexOutOfBoundsException when no ranges are specified in
the query
Aliases::
- mget with an alias shouldn't ignore alias routing
- GET aliases should 404 if aliases are missing
Allocation::
- Fix DiskThresholdMonitor flood warning
- Allow wildcards for shard IP filtering
Analysis::
- Pre-configured shingle filter should disable graph analysis
- PatternAnalyzer should lowercase wildcard queries when `lowercase`
is true.
CAT API::
- Fix NPE for /_cat/indices when no primary shard
CRUD::
- Serialize and expose timeout of acknowledged requests in REST layer
- Fix silent loss of last command to _bulk and _msearch due to missing
newline
Cache::
- Reduce the default number of cached queries.
- fix bug of weight computation
Circuit Breakers::
- Checks the circuit breaker before allocating bytes for a new big
array
Cluster::
- Register setting `cluster.indices.tombstones.size`
Core::
- Correctly encode warning headers
- Fix cache compute if absent for expired entries
- Timed runnable should delegate to abstract runnable
- Stop invoking non-existent syscall
- MetaData Builder doesn't properly prevent an alias with the same
name as an index
- Release operation permit on thread-pool rejection
- Node should start up despite of a lingering `.es_temp_file`
- Fix cache expire after access
Dates::
- Fix typo in date format
Discovery::
- MasterNodeChangePredicate should use the node instance to detect
master change
Engine::
- Die with dignity while merging
- Engine - do not index operations with seq# lower than the local
checkpoint into lucene
Geo::
- Fix typo in GeoUtils#isValidLongitude
Highlighting::
- Fix percolator highlight sub fetch phase to not highlight query
twice
- FastVectorHighlighter should not cache the field query globally
- Higlighters: Fix MultiPhrasePrefixQuery rewriting
- Fix nested query highlighting
Index APIs::
- Shrink API should ignore templates
- Rollover max docs should only count primaries
- Validates updated settings on closed indices
Ingest::
- date processor should not fail if timestamp is specified as json
number
- date_index_name processor should not fail if timestamp is specified
as json number
- Sort Processor does not have proper behavior with targetField
- fix grok's pattern parsing to validate pattern names in expression
- Remove support for Visio and potm files
- Fix floating-point error when DateProcessor parses UNIX
- add option for _ingest.timestamp to use new ZonedDateTime (5.x
backport)
Inner Hits::
- Do not allow inner hits that fetch _source and have a non nested
object field as parent
- When fetching nested inner hits only access stored fields when
needed
- If size / offset are out of bounds just do a plain count
- Fix Source filtering in new field collapsing feature
Internal::
- Bump version to 6.0.1
- `IndexShard.routingEntry` should only be updated once all internal
state is ready
- Catch exceptions and inform handler in
RemoteClusterConnection#collectNodes
- Internal: Add versionless alias for rest client codebase in policy
files
- Upgrade Lucene to version 7.0.1
- Fix BytesReferenceStreamInput#skip with offset
- Fix race condition in RemoteClusterConnection node supplier
- Initialise empty lists in BaseTaskResponse constructor
- Extract a common base class for scroll executions
- Obey lock order if working with store to get metadata snapshots
- Fix Version based BWC and set correct minCompatVersion
- Fix `_field_caps` serialization in order to support cross cluster
search
- Avoid race when shutting down controller processes
- Fix handling of document failure exception in InternalEngine
- Ensure remote cluster is connected before fetching `_field_caps`
Java API::
- BulkProcessor flush runnable preserves the thread context from
creation time
Java High Level REST Client::
- Make RestHighLevelClient's Request class public
- Forbid direct usage of ContentType.create() methods
- Make ShardSearchTarget optional when parsing ShardSearchFailure
Java REST Client::
- Better message text for ResponseException
- rest-client-sniffer: configurable threadfactory
Logging::
- Allow not configure logging without config
Mapping::
- Allow copying from a field to another field that belongs to the same
nested object.
- Fixed bug that mapper_parsing_exception is thrown for numeric field
with ignore_malformed=true when inserting "NaN"
- Coerce decimal strings for whole number types by truncating the
decimal part
- Fix parsing of ip range queries.
- Disable date field mapping changing
- Correctly enable _all for older 5.x indices
- token_count datatype should handle null value
- keep _parent field while updating child type mapping
- ICUCollationKeywordFieldMapper use SortedSetDocValuesField
- Fix serialization of the `_all` field.
More Like This::
- Pass over _routing value with more_like_this items to be retrieved
NOT CLASSIFIED::
- DocumentMissingException during Logstash scripted upsert
- An assertion trips when master opens an index from before 5.x
Nested Docs::
- In case of a single type the _id field should be added to the nested
document instead of _uid field
- Inner hits source filtering not working
Network::
- Fixed ByteBuf leaking in
org.elasticsearch.http.netty4.Netty4HttpRequestHandler
- Check for closed connection while opening
- Ensure pending transport handlers are invoked for all channel
failures
- Notify onConnectionClosed rather than onNodeDisconnect to prune
transport handlers
- Release pipelined http responses on close
- Fix error message if an incompatible node connects
Packaging::
- Fix handling of Windows paths containing parentheses
- Exit Windows scripts promptly on failure
- Pass config path as a system property
- ES_HOME needs to be made absolute before attempt at traversal
- Fix elasticsearch-keystore handling of path.conf
- Stop disabling explicit GC
- Avoid failing install if system-sysctl is masked
- Get short path name for native controllers
- When stopping via systemd only kill the JVM, not its control group
- remove remaining references to scripts directory
- Handle parentheses in batch file path
- Detect modified keystore on package removal
- Create keystore on RPM and Debian package install
- Add safer empty variable checking for Windows
- Export HOSTNAME environment variable
- Fix daemonization command status test
- Set RuntimeDirectory in systemd service
Parent/Child::
- The default _parent field should not try to load global ordinals
Percolator::
- Also support query extraction for queries wrapped inside a
ESToParentBlockJoinQuery
- Fix range queries with date range based on current time in
percolator queries.
Plugin Analysis Kuromoji::
- Fix kuromoji default stoptags
Plugin Analysis Phonetic::
- Fix beidermorse phonetic token filter for unspecified `languageset`
Plugin Discovery File::
- Fix discovery-file plugin to use custom config path
Plugin Ingest Attachment::
- Add missing mime4j library
Plugin Lang Painless::
- Painless: allow doubles to be casted to longs.
Plugin Repository Azure::
- Azure snapshots can not be restored anymore
- Snapshot : azure module - accelerate the listing of files (used in
delete snapshot)
- Use Azure upload method instead of our own implementation
- Make calls to CloudBlobContainer#exists privileged
Plugin Repository GCS::
- Ensure that gcs client creation is privileged
Plugin Repository HDFS::
- Add Log4j to SLF4J binding for repository-hdfs
- Upgrading HDFS Repository Plugin to use HDFS 2.8.1 Client
Plugin Repository S3::
- Avoid SecurityException in repository-S3 on
DefaultS3OutputStream.flush()
- Wrap getCredentials() in a doPrivileged() block
Plugins::
- X-Pack plugin download fails on Windows desktop
- Fix plugin installation permissions
Query DSL::
- Fixed incomplete JSON body on count request making
org.elasticsearch.rest.action.RestActions#parseTopLevelQueryBuilder
go into endless loop
- SpanNearQueryBuilder should return the inner clause when a single
clause is provided
- Refactor field expansion for match, multi_match and query_string
query
- WrapperQueryBuilder should also rewrite the parsed query
REST::
- Rest test fixes
- Fix inconsistencies in the rest api specs for cat.snapshots
- Fix inconsistencies in the rest api specs for *_script
- exists template needs a template name
- Fix handling of invalid error trace parameter
- Fix handling of exceptions thrown on HEAD requests
- Fixed NPEs caused by requests without content.
- Fix get mappings HEAD requests
Recovery::
- Close translog view after primary-replica resync
Reindex API::
- Fix update_by_query's default size parameter
- Reindex: don't duplicate _source parameter
- Add qa module that tests reindex-from-remote against pre-5.0
versions of Elasticsearch
Scroll::
- Fix single shard scroll within a cluster with nodes in version `>=
5.3` and `<= 5.3`
Search::
- Fail query when a sort is provided in conjunction with rescorers
- Let search phases override max concurrent requests
- Avoid stack overflow on search phases
- Fix search_after with geo distance sorting
- Fix serialization errors when cross cluster search goes to a single
shard
- Early termination with index sorting should not set terminated_early
in the response
- Format doc values fields.
- Fix term(s) query for range field
- Caching a MinDocQuery can lead to wrong results.
- Fix random score generation when no seed is provided.
- Merge FunctionScoreQuery and FiltersFunctionScoreQuery
- Respect cluster alias in `_index` aggs and queries
- First increment shard stats before notifying and potentially sending
response
- Remove assertion about deviation when casting to a float.
- Prevent skipping shards if a suggest builder is present
- Ensure remote cluster alias is preserved in inner hits aggs
- Do not search locally if remote index pattern resolves to no indices
- Adds check for negative search request size
- Make sure range queries are correctly profiled.
- Fix RangeFieldMapper rangeQuery to properly handle relations
- Fix ExpandSearchPhase when response contains no hits
- Refactor simple_query_string to handle text part like multi_match
and query_string
- Fix `_exists_` in query_string on empty indices.
- Fix script field sort returning Double.MAX_VALUE for all documents
- Compute the took time of the query after the expand phase of field
collapsing
Sequence IDs::
- Fire global checkpoint sync under system context
- Fix pre-6.0 response to unknown replication actions
- Track local checkpoint on primary immediately
- Initialize max unsafe auto ID timestamp on shrink
- Use correct primary term for replicating NOOPs
- Handle already closed while filling gaps
- TranslogWriter.assertNoSeqNumberConflict failure
- Avoid losing ops in file-based recovery
- Handle primary failure handling replica response
Settings::
- Emit settings deprecation logging on empty update
- Fix filtering for ListSetting
- Fix settings serialization to not serialize secure settings or not
take the total size into account
- Keystore CLI should use the AddFileKeyStoreCommand for files
- Allow resetting settings that use an IP validator
- Updating an unrecognized setting should error out with that reason
- Settings: Fix setting groups to include secure settings
Similarities::
- Add boolean similarity to built in similarity types
Snapshot/Restore::
- Snapshot/Restore: better handle incorrect chunk_size settings in FS
repo
- Snapshot/Restore: Ensure that shard failure reasons are correctly
stored in CS
- Output all empty snapshot info fields if in verbose mode
- Remove redundant and broken MD5 checksum from repository-s3
- Consolidates the logic for cleaning up snapshots on master election
- Removes completed snapshot from cluster state on master change
- Keep snapshot restore state and routing table in sync
- Master failover during snapshotting could leave the snapshot
incomplete
- Fix inefficient (worst case exponential) loading of snapshot
repository
Stats::
- Fix RestGetAction name typo
- Keep cumulative elapsed scroll time in microseconds
- _nodes/stats should not fail due to concurrent
AlreadyClosedException
- Avoid double decrement on current query counter
- Adjust available and free bytes to be non-negative on huge FSes
Suggesters::
- Fix division by zero in phrase suggester that causes assertion to
fail
- Context suggester should filter doc values field
- Fix context suggester to read values from keyword type field
Templates::
- Tests: Fix FullClusterRestartIT.testSnapshotRestore test failing in
6.x
Translog::
- Fix Translog.Delete serialization for sequence numbers
Upgrade API::
- Upgrade API: fix excessive logging and unnecessary template updates
=== Regressions
Bulk::
- Only re-parse operation if a mapping update was needed
Highlighting::
- Fix Fast Vector Highlighter NPE on match phrase prefix
Search::
- Always use DisjunctionMaxQuery to build cross fields disjunction
Sequence IDs::
- Indexing performance degradation in 6.0.0-beta1
=== Upgrades
Core::
- Upgrade to Lucene 7.0.0
Logging::
- Upgrade to Log4j 2.9.1
Network::
- Upgrade to Netty 4.1.13.Final
Plugin Ingest Attachment::
- Update to Tika 1.14
Upgrade API::
- Improve stability and logging of TemplateUpgradeServiceIT tests
Features
- Send keyspace in QUERY, PREPARE, and BATCH messages
- Add IPv4Address/IPv6Address support for inet types
- WriteType.CDC and VIEW missing
- Warn on Cluster init if contact points are specified but LBP isn't
- Include hash of result set metadata in prepared stmt id
- Add NO_COMPACT startup option
- Add new exception type for CDC
Bug Fixes
- Both _set_final_exception/result called for the same ResponseFuture
- Use of DCAwareRoundRobinPolicy raises NoHostAvailable exception
- Not create two sessions by default in CQLEngine
- Bug when subclassing AyncoreConnection
- Error at cleanup when closing the asyncore connections
- Fix sites where sessions can change during iteration
- cqlengine: allow min_length=0 for Ascii and Text column types
- Rare exception when "sys.exit(0)" after query timeouts
- Dont set the session keyspace when preparing statements
- Use of DCAwareRoundRobinPolicy raises NoHostAvailable exception
Other
- Remove DeprecationWarning when using WhiteListRoundRobinPolicy
- Bump Cython dependency version to 0.27
Changes since 2.4.45:
Mandatory prerequisites:
- Python 2.7.x
- pyasn1 0.3.7+ and pyasn1_modules 0.1.5+
Modules/
* removed unused code schema.c
Lib/
* ldap.__version__, ldap.__author__ and ldap.__license__ now
imported from new sub-module ldap.pkginfo also to setup.py
* Added safety assertion when importing _ldap:
ldap.pkginfo.__version__ must match _ldap.__version__
* removed stand-alone module dsml
* slapdtest.SlapdObject.restart() just restarts slapd
without cleaning any data
* Compability changes for pyasn1 0.3.x or newer
(thanks to Ilya Etingof and Christian Heimes)
* The methods SSSResponseControl.decodeControlValue() and
VLVResponseControl.decodeControlValue() now follow the coding
convention to use camel-cased ASN.1 name as class attribute name.
The old class names are still set for back-ward compability
but should not be used in new code because they might be removed
in a later release.
* removed SSSRequestControl from ldap.controls.KNOWN_RESPONSE_CONTROLS
Tests/
* added explicit reconnect tests for ReconnectLDAPObject
2.4:
security fix in the rebind() method of the Connection object (thanks Daniel)
fix for Sasl credentials in Python 3 (thanks Busuwe)
fixed bug when checking for equality in MockBase
added validator parameter to Server object for custom validators
attribute values are now validated in add/compare/modify operations in the Connection object
Python types can now be used in add/compare/modify operations
compatible with the pyasn1 library from version 0.1.8 up to latest (0.3.3 for now) version
fixed compatibility with Twisted on Windows on Python 2.7 (thanks Pmisik)
fixed paged_search behaviour in Reader object
fixed regression in MockBase (thanks Markus)
fixed invalid filter sequence in MockBase (thanks SignedBit)
added compatibility with Cython (thanks Pedro)
fixed auto_encode check in validate_attribute_value for unknown attrs (thanks CFelder)
don’t encode response_value as extended_response_to_dict expects a decoded value (thanks Matthias)
compatible with the pyasn1 library from version 0.1.8 up to latest (0.3.7 for now) version
added LDAPObjectDereferenceError exception
LDAPObjectDereferenceError is raised when an object tries to dereference itself in the Abstraction Layer (thanks Daniele)
async module renamed to asynchronous for compatibility with Python 3.7 (thank Barry)
long integer are properly checked in mocking strategies (thanks gregn610)
NUMERIC_TYPES includes long for Python 2
The PostgreSQL Global Development Group has released an update to all supported versions of our database system, including 10.1, 9.6.6, 9.5.10, 9.4.15, 9.3.20, and 9.2.24. This release fixes three security issues. This release also fixes issues found in BRIN indexing, logical replication and other bugs reported over the past three months.
All users using the affected versions of PostgreSQL should update as soon as possible. If you use BRIN indexes or contrib/start-scripts, please see the release notes for additional post-upgrade steps.
Security Issues
Three security vulnerabilities have been fixed by this release:
CVE-2017-12172: Start scripts permit database administrator to modify root-owned files
CVE-2017-15098: Memory disclosure in JSON functions
CVE-2017-15099: INSERT ... ON CONFLICT DO UPDATE fails to enforce SELECT privileges
Bug Fixes and Improvements
This update also fixes a number of bugs reported in the last few months. Some of these issues affect only version 10, but many affect all supported versions:
Fix a race condition in BRIN indexing that could cause some rows to not be included in the indexing.
Fix crash when logical decoding is invoked from a PL language function.
Several fixes for logical replication.
Restored behavior for CTEs attached to INSERT/UPDATE/DELETE statements to pre-version 10.
Prevent low-probability crash in processing of nested trigger firings.
Do not evaluate an aggregate function's argument expressions when the conditions in the FILTER clause evaluate to FALSE. This complies with SQL-standard behavior.
Fix incorrect query results when multiple GROUPING SETS columns contain the same simple variable.
Fix memory leak over the lifespan of a query when evaluating a set-returning function from the target list in a SELECT.
Several fixes for parallel query execution, including fixing a crash in the parallel execution of certain queries that contain a certain type of bitmap scan.
Fix json_build_array(), json_build_object(), jsonb_build_array(), and jsonb_build_object() to handle explicit VARIADIC arguments correctly.
Prevent infinite float values from being casted to the numeric type.
Fix autovacuum's “work item” logic to prevent possible crashes and silent loss of work items.
Several fixes for VIEWs around adding columns to the end of a view.
Fix for hashability detection of range data types that are created by a user.
Improvements on using extended statistics on columns for the purposes of query planning.
Prevent idle_in_transaction_session_timeout from being ignored when a statement_timeout occurred earlier.
Fix low-probability loss of NOTIFY messages due more than 2 billion transactions processing before any queries are executed in the session.
Several file system interaction fixes.
Correctly restore the umask setting when file creation fails in COPY or lo_export().
Fix pg_dump to ensure that it emits GRANT commands in a valid order.
Fix pg_basebackup's matching of tablespace paths to canonicalize both paths before comparing to help improve Windows compatibility.
Fix libpq to not require user's home directory to exist when trying to read the "~/.pgpass" file.
Several fixes for ecpg.
couchdb 2.1.1
- CouchDB now supports compilation and running under Erlang/OTP 20.x
- The couch_peruser functionality is now really fixed
- The cookie domain for AuthSession cookies, used in a proxy
authentication configuration, can now be customized via the ini file
- It is now possible to modify shard maps for system databases
- Due to an Erlang bug (ERL-343), invalid paths can be returned if
volumes are mounted containing whitespace in their name (fixed)
- The current node's local interface can now be accessed at
/_node/_local/{endpoint} as well as at
/_node/<nodename>@<hostname>/{endpoint}.- The Dockerfile in the source
repository has been retired
- Fauxton now uses a version of React with a BSD license.
- CouchDB now no longer decompresses documents just to determine their
uncompressed size
- The design document cache (ddoc_cache) has been rewritten to improve
performance
- Mango now supports partial indexes
- Mango queries can now be paginated
- Mango _find accepts an execution_stats parameter
- Mango now requires that all of the fields in a candidate index must
exist in a query's selector
- Other minor improvements.
couchdb 2.1.0
- The Mango _find endpoint supports a new combination operator,
$allMatch.
- New scheduling replicator.
- Other minor improvements.
See changelog for the 2.1.x branch for more:
http://docs.couchdb.org/en/latest/whatsnew/2.1.html
## 2.1.0
* Support RubyInstaller2 for Windows. Fixes#365.
* Support the FREETDS_DIR environment variable. Fixes#371.
* Rename binstubs to tsql-ttds and defncopy-ttds
* Support separate timeout values per connection Fixes#348.
* Allow client proc to capture INFO messages. Fixes#352.
* Use official HTTP mirrors instead of FTP. Fixes#384.
=== 5.2.0 (2017-10-27)
* Fix type conversion for smallint unsigned and integer unsigned types on
jdbc/mysql (jeremyevans) (#1443)
* Add pg_extended_date_support extension, for handling infinite and BC
dates/timestamps (jeremyevans)
* Do not ignore existing @dataset instance variable when subclassing
Sequel::Model (bjmllr) (#1435)
=== 5.1.0 (2017-10-01)
* Make jdbc/h2 and jdbc/hsqldb adapters respect :foreign_key_constraint_name
option when adding new foreign key column (jeremyevans)
* Do not issue unnecessary query for macaddr type oid when loading the pg_inet
extension (jeltz) (#1423)
* Make alter_table add_foreign_key with a column symbol reversible when using
the :foreign_key_constraint_name option (jeremyevans) (#1422)
* Do not raise an error if calling Model.freeze on a frozen model
(jeremyevans) (#1421)
* Make Database#copy_into in the jdbc/postgresql adapter handle multi-byte
strings (ckoenig) (#1416)
* Remove deprecated Model use_after_commit_rollback class and instance methods
(jeremyevans)
* Remove deprecated Model.allowed_columns method in the base model support
(jeremyevans)
* Remove deprecated Model.plugin_module_defined? private method (jeremyevans)
* Remove deprecated support for Model#_before_validation private method
(jeremyevans)
Release 3.21.0:
Take advantage of the atomic-write capabilities in the F2FS filesystem when available, for greatly reduced transaction overhead. This currently requires the SQLITE_ENABLE_BATCH_ATOMIC_WRITE compile-time option.
Allow ATTACH and DETACH commands to work inside of a transaction.
Allow WITHOUT ROWID virtual tables to be writable if the PRIMARY KEY contains exactly one column.
The "fsync()" that occurs after the header is written in a WAL reset now uses the sync settings for checkpoints. This means it will use a "fullfsync" on macs if PRAGMA checkpoint_fullfsync set on.
The sqlite3_sourceid() function tries to detect if the source code has been modified from what is checked into version control and if there are modifications, the last four characters of the version hash are shown as "alt1" or "alt2". The objective is to detect accidental and/or careless edits. A forger can subvert this feature.
Improved de-quoting of column names for CREATE TABLE AS statements with an aggregate query on the right-hand side.
Fewer "stat()" system calls issued by the unix VFS.
Enhanced the LIKE optimization so that it works with an ESCAPE clause.
Enhanced PRAGMA integrity_check and PRAGMA quick_check to detect obscure row corruption that they were formerly missing. Also update both pragmas so that they return error text rather than SQLITE_CORRUPT when encountering corruption in records.
The query planner now prefers to implement FROM-clause subqueries using co-routines rather using the query flattener optimization. Support for the use of co-routines for subqueries may no longer be disabled.
Pass information about !=, IS, IS NOT, NOT NULL, and IS NULL constraints into the xBestIndex method of virtual tables.
Enhanced the CSV virtual table so that it accepts the last row of input if the final new-line character is missing.
Remove the rarely-used "scratch" memory allocator. Replace it with the SQLITE_CONFIG_SMALL_MALLOC configuration setting that gives SQLite a hint that large memory allocations should be avoided when possible.
Added the swarm virtual table to the existing union virtual table extension.
Added the sqlite_dbpage virtual table for providing direct access to pages of the database file. The source code is built into the amalgamation and is activated using the -DSQLITE_ENABLE_DBPAGE_VTAB compile-time option.
Add a new type of fts5vocab virtual table - "instance" - that provides direct access to an FTS5 full-text index at the lowest possible level.
Remove a call to rand_s() in the Windows VFS since it was causing problems in Firefox on some older laptops.
The src/shell.c source code to the command-line shell is no longer under version control. That file is now generated as part of the build process.
Miscellaneous microoptimizations reduce CPU usage by about 2.1%.
Bug fixes
Major enhancements in PostgreSQL 10 include:
Logical replication using publish/subscribe
Declarative table partitioning
Improved query parallelism
Significant general performance improvements
Stronger password authentication based on SCRAM-SHA-256
Improved monitoring and control
The above items are explained in more detail in the sections below.
Changes in MySQL 5.7.20:
Audit Log Notes
Event-matching filter rules for the audit_log plugin now support an abort element, which can be used to prevent qualifying events from executing. For more information, see Audit Log Filtering. This capability can be used, for example, to augment the capabilities of MySQL Enterprise Firewall, which blocks SQL statements on a per-user basis, by writing audit filtering rules that match statements and block them based on characteristics of the statements themselves.
Deprecation and Removal Notes
Previously, the --transaction-isolation and --transaction-read-only server startup options corresponded to the tx_isolation and tx_read_only system variables. For better name correspondence between startup option and system variable names, transaction_isolation and transaction_read_only have been created as aliases for tx_isolation and tx_read_only. The tx_isolation and tx_read_only variables are now deprecated and will be removed in MySQL 8.0. Applications should be adjusted to use transaction_isolation and transaction_read_only instead.
The query cache is now deprecated and is removed in MySQL 8.0. Deprecation includes these items:
* The FLUSH QUERY CACHE and RESET QUERY CACHE statements.
* The SQL_CACHE and SQL_NO_CACHE SELECT modifiers.
* These system variables: have_query_cache, ndb_cache_check_time, query_cache_limit, query_cache_min_res_unit, query_cache_size, query_cache_type, query_cache_wlock_invalidate.
* These status variables: Qcache_free_blocks, Qcache_free_memory, Qcache_hits, Qcache_inserts, Qcache_lowmem_prunes, Qcache_not_cached, Qcache_queries_in_cache, Qcache_total_blocks.
The mysql client by default strips comments in statements sent to the server, and this behavior is controlled using --skip-comments (strip comments), and --comments (preserve comments).
Comment stripping is now deprecated. This feature and the options to control it will be removed in a future MySQL release.
These syntax constructs for table and column references are now deprecated and will be removed in a future version of MySQL. Instances of these constructs should be changed to remove the leading period.
* .col_name
* .tbl_name
* .tbl_name.col_name
Security Notes
Certificates automatically generated by mysqld and mysql_ssl_rsa_setup now use X509 v3 rather than v1.
The keyring_okv plugin now supports password-protecting the key file used for secure connections. See Using the keyring_okv KMIP Plugin.
Bugs Fixed
Changes in MySQL 5.6.38:
Packaging Notes
---------------
mysqlcheck was missing in the MySQL Server Docker image, which prevented mysql_upgrade from running.
Bugs Fixed
----------
InnoDB: Replication lag occurred on slave instances during large update operations on tables with many partitions.
InnoDB: A failure occurred during an end range comparison.
InnoDB: Enabling the innodb_buffer_pool_load_now setting failed in readonly mode. The event that signals the buffer pool load thread was not initialized.
InnoDB: A long wait for a dictionary operation lock held by a full-text search synchronization operation caused a server exit.
Partitioning: Queries involving NULL were not always handled correctly on tables that were partitioned by LIST.
Replication: When replicating a partitioned table with an index, on a replication slave where HASH_SCAN was specified as part of the slave_rows_search_algorithms setting, the slave I/O thread sometimes stopped with an error HA_ERR_KEY_NOT_FOUND.
Replication: Replication clients no longer enable LOCAL capability for LOAD DATA statements, because they do not use LOAD DATA LOCAL statements.
Replication: In case of a failure while creating multiple slave applier worker threads, some threads would be left orphaned and their resources would not be collected. Thanks to Laurynas Biveinis for his contribution to fixing this bug.
MSI packages for Windows failed to detect when Microsoft Visual C++ 2010 Redistributable Package was installed.
yaSSL could incorrectly perform TLS cipher negotiation.
The server failed to check the maximum path length for partition names.
Identifiers containing a mixture of backslashes and backticks could be parsed incorrectly.
Source packages for Debian platforms contained prebuilt debug binaries, causing build failures on any architectures other than the one on which those binaries were built.
Uninstalling the daemon_memcached plugin caused a serious error.
Selecting from a view could yield different results with materialization enabled versus materialization disabled.
The Performance Schema failed to check the maximum host length for client connections.
A server error occurred when a full text search result exceeded the innodb_ft_result_cache_limit setting. The patch for this bug also backports a related patch.
If a stored function was considered a constant by the optimizer, calling it from a subquery in a NOT IN condition in the WHERE clause could cause a server exit.
A mysqldump memory leak was fixed.
If a session rolled back to a savepoint and then was killed, the statements up to the point of the savepoint could be committed.
For clients that used Connector/Python and authenticated using the sha256_password plugin, the server could handle connections incorrectly.
NAME_CONST() can return null if incorrect arguments are given. In some cases, this was not handled and could cause a server exit.
Changes in MySQL 5.5.58:
Packaging Notes
---------------
mysqlcheck was missing in the MySQL Server Docker image, which prevented mysql_upgrade from running.
Bugs Fixed
----------
Replication: Replication clients no longer enable LOCAL capability for LOAD DATA statements, because they do not use LOAD DATA LOCAL statements.
yaSSL could incorrectly perform TLS cipher negotiation.
The server failed to check the maximum path length for partition names.
Identifiers containing a mixture of backslashes and backticks could be parsed incorrectly.
NAME_CONST() can return null if incorrect arguments are given. In some cases, this was not handled and could cause a server exit.
v0.13.0
Backwards Incompatible Changes
------------------------------
Drop support for PostgreSQL 9.1
Remove the deprecated "binary" parameter from Connection.set_type_codec()
New Features
------------
Add support for PostgreSQL 10
Bug Fixes
---------
Document that single fetches can return None
Fix type introspection being very slow on large databases
Fix copy tests on PostgreSQL < 9.4
Fix DeprecationWarning in tests
Fix intermittent authentication failures against PostgreSQL 10 servers
Do not attempt to connect to Unix sockets on Windows when host is not set
Guard against incorrect use of resources associated with a connection
Warn when there are active listeners on a connection that is released
Add a test for cursors on a standby replica.
Clarify the argument/parameter count mismatch exception
Fix TypeError on get_attributes when result has no columns
protocol: Use try-finally explicitly every time we create a waiter
Call correct parent constructor in InterfaceWarning.__init__
Allow grabbing the version information programmatically.
Use the general statement cache for type introspection
Fix issues with inet type I/O
Handle inactive connection closes while stored in the pool
0.9.6
feature
[feature] [commands] The alembic history command will now make use of the revision environment env.py unconditionally if the revision_environment configuration flag is set to True. Previously, the environment would only be invoked if the history specification were against a database-stored revision token.
bug
[bug] [commands] Fixed a few Python3.6 deprecation warnings by replacing StopIteration with return, as well as using getfullargspec() instead of getargspec() under Python 3.
[bug] [commands] An addition to 441 fixed in 0.9.5, we forgot to also filter for the + sign in migration names which also breaks due to the relative migrations feature.
[bug] [autogenerate] Fixed bug expanding upon the fix for 85 which adds the correct module import to the “inner” type for an ARRAY type, the fix now accommodates for the generic sqlalchemy.types.ARRAY type added in SQLAlchemy 1.1, rendering the inner type correctly regardless of whether or not the Postgresql dialect is present.
[bug] [mysql] Fixed bug where server default comparison of CURRENT_TIMESTAMP would fail on MariaDB 10.2 due to a change in how the function is represented by the database during reflection.
[bug] [autogenerate] Fixed bug where comparison of Numeric types would produce a difference if the Python-side Numeric inadvertently specified a non-None “scale” with a “precision” of None, even though this Numeric type will pass over the “scale” argument when rendering. Pull request courtesy Ivan Mmelnychuk.
[bug] [batch] The name of the temporary table in batch mode is now generated off of the original table name itself, to avoid conflicts for the unusual case of multiple batch operations running against the same database schema at the same time.
[bug] [autogenerate] A ForeignKeyConstraint can now render correctly if the link_to_name flag is set, as it will not attempt to resolve the name from a “key” in this case. Additionally, the constraint will render as-is even if the remote column name isn’t present on the referenced remote table.
[bug] [runtime] [py3k] Reworked “sourceless” system to be fully capable of handling any combination of: Python2/3x, pep3149 or not, PYTHONOPTIMIZE or not, for locating and loading both env.py files as well as versioning files. This includes: locating files inside of __pycache__ as well as listing out version files that might be only in versions/__pycache__, deduplicating version files that may be in versions/__pycache__ and versions/ at the same time, correctly looking for .pyc or .pyo files based on if pep488 is present or not. The latest Python3x deprecation warnings involving importlib are also corrected.
=== Enhancements
Network::
* Add additional low-level logging handler
* Unwrap exception causes when checking if dying
=== Bug fixes
Aggregations::
* Fix IndexOutOfBoundsException in histograms for NaN doubles
Core::
* MetaData Builder doesn't properly prevent an alias with the same
* name as an index
Packaging::
* Fix default paths for Windows service
Plugin Repository Azure::
* Use Azure upload method instead of our own implementation
Search::
* Fix serialization errors when cross cluster search goes to a single
* shard
Author: Frediano Ziglio <freddy77@gmail.com>
Date: Sat Sep 30 22:25:16 2017 +0100
ctlib: Add CS_BIGTIME/CS_BIGDATETIME type declarations
Author: Frediano Ziglio <freddy77@gmail.com>
Date: Fri Sep 22 12:28:30 2017 +0100
ctlib: Support Microsoft DATE/TIME types
Author: Frediano Ziglio <freddy77@gmail.com>
Date: Thu Sep 21 18:23:06 2017 +0100
ctlib: Support missing Sybase types in _ct_get_client_type
Author: Frediano Ziglio <freddy77@gmail.com>
Date: Thu Sep 21 20:57:11 2017 +0100
ctlib: Fix wrong type for TIME and DATE from _ct_get_server_type
This caused data to be converted in the wrong way.
Author: Frediano Ziglio <freddy77@gmail.com>
Date: Wed Sep 20 11:20:37 2017 +0100
tds: Fix possible reading buffer overflow converting from char to float
Row column data are not NUL terminated so make sure we use
terminated strings.
This patch also improve checking format errors converting
float numbers using strtod instead of atof.
Author: Frediano Ziglio <freddy77@gmail.com>
Date: Sun Sep 17 17:34:16 2017 +0100
tds: Add missing declaration for Sybase type
Declarations are used for bulk copy and datacopy utility.
- Remove a syntax error in the configure script that affects some shells.
- The configure script respects --with-zlib=system and --with-snappy=system.
- The internal mongoc_server_description_t struct is properly reinitialized
after a network error.
- Fix the encoding of this NEWS file.
