Path to this page:
Subject: CVS commit: pkgsrc/databases/elasticsearch
From: Filip Hajny
Date: 2018-02-07 17:26:16
Message id: 20180207162616.CA8C9FB40@cvs.NetBSD.org
Log Message:
databases/elasticsearch: Update to 6.2.0.
6.2.0
=== Breaking changes
Aggregations::
- Add a new cluster setting to limit the total number of buckets
returned by a request
Core::
- Forbid granting the all permission in production
Highlighting::
- Limit the analyzed text for highlighting
Search::
- Introduce limit to the number of terms in Terms Query
=== Breaking Java changes
Java API::
- Remove `operationThreaded` from Java API
Java High Level REST Client::
- REST high-level client: remove index suffix from indices client
method names
=== Deprecations
Analysis::
- Backport delimited payload filter renaming
Suggesters::
- deprecating `jarowinkler` in favor of `jaro_winkler`
- Deprecating `levenstein` in favor of `levensHtein`
=== New features
Plugin Ingest GeoIp::
- Enable ASN support for Ingest GeoIP plugin.
Plugin Lang Painless::
- Painless: Add spi jar that will be published for extending
whitelists
- Painless: Add a simple cache for whitelist methods and fields.
Plugins::
- Add the ability to bundle multiple plugins into a meta plugin
Rank Evaluation::
- Backport of ranking evaluation API (#27478)
Recovery::
- Backport for using lastSyncedGlobalCheckpoint in deletion policy
Reindex API::
- Add scroll parameter to _reindex API
=== Enhancements
Allocation::
- Fix cluster.routing.allocation.enable and
cluster.routing.rebalance.enable case
- Add node id to shard failure message
Analysis::
- Limit the analyzed text for highlighting (#27934)
- Allow TrimFilter to be used in custom normalizers
Circuit Breakers::
- Add accounting circuit breaker and track segment memory usage
Cluster::
- Adds wait_for_no_initializing_shards to cluster health API
Core::
- Introduce elasticsearch-core jar
- Rename core module to server
- Introduce elasticsearch-core jar
- Add Writeable.Reader support to TransportResponseHandler
- Simplify rejected execution exception
- Add node name to thread pool executor name
Discovery::
- Add information when master node left to DiscoveryNodes'
shortSummary()
Engine::
- Move uid lock into LiveVersionMap
- Optimize version map for append-only indexing
Geo::
- [GEO] Add WKT Support to GeoBoundingBoxQueryBuilder
- [Geo] Add Well Known Text (WKT) Parsing Support to ShapeBuilders
Highlighting::
- Include all sentences smaller than fragment_size in the unified
highlighter
Ingest::
- Enable convert processor to support Long and Double
Internal::
- Make KeyedLock reentrant
- Make AbstractQueryBuilder.declareStandardFields to be protected
- Tighten the CountedBitSet class
- Avoid doing redundant work when checking for self references.
Java API::
- Add missing delegate methods to NodeIndicesStats
- Java api clean-up : consistency for `shards_acknowledged` getters
Java High Level REST Client::
- add toString implementation for UpdateRequest.
- Add Close Index API to the high level REST client
- Add Open Index API to the high level REST client
- Added Create Index support to high-level REST client
- Add multi get api to the high level rest client
- Add msearch api to high level client
Mapping::
- Allow `_doc` as a type.
Network::
- Add NioGroup for use in different transports
- Add read timeouts to http module
- Implement byte array reusage in `NioTransport`
- Introduce resizable inbound byte buffer
- Decouple nio constructs from the tcp transport
Packaging::
- Extend JVM options to support multiple versions
- Add explicit coreutils dependency
- Detect mktemp from coreutils
- Enable GC logs by default
- Use private directory for temporary files
Percolator::
- also extract match_all queries when indexing percolator queries
Plugin Lang Painless::
- Painless: Add whitelist extensions
- Painless: Modify Loader to Load Classes Directly from Definition
- Clean Up Painless Cast Object
- Painless: Only allow Painless type names to be the same as the
equivalent Java class.
Plugins::
- Add client actions to action plugin
- Plugins: Add validation to plugin descriptor parsing
- Plugins: Add plugin extension capabilities
- Add support for filtering mappings fields
Rank Evaluation::
- Simplify RankEvalResponse output
Recovery::
- Truncate tlog cli should assign global checkpoint
- Replica starts peer recovery with safe commit
- Primary send safe commit in file-based recovery
- Fail resync-failed shards in subsequent writes
- Introduce promoting index shard state
- Non-peer recovery should set the global checkpoint
- Persist global checkpoint when finalizing a peer recovery
- Rollback a primary before recovering from translog
Rollover::
- Fail rollover if duplicated alias found in templates
Search::
- Use typeName() to check field type in GeoShapeQueryBuilder
- Optimize search_after when sorting in index sort order
Sequence IDs::
- Do not keep 5.x commits when having 6.x commits
- Use lastSyncedGlobalCheckpoint in deletion policy
- Use CountedBitSet in LocalCheckpointTracker
- Only fsync global checkpoint if needed
- Keep commits and translog up to the global checkpoint
- Adjust CombinedDeletionPolicy for multiple commits
- Keeps index commits up to the current global checkpoint
- Dedup translog operations by reading in reverse
Settings::
- Add validation of keystore setting names
Snapshot/Restore::
- Use AmazonS3.doesObjectExist() method in S3BlobContainer
- Remove XContentType auto detection in BlobStoreRepository
- Include include_global_state in Snapshot status API (#22423)
Task Manager::
- Add ability to associate an ID with tasks
Translog::
- Simplify MultiSnapshot#SeqNoset
- Enclose CombinedDeletionPolicy in SnapshotDeletionPolicy
=== Bug fixes
Aggregations::
- Adds metadata to rewritten aggregations
- Fix NPE on composite aggregation with sub-aggregations that need
scores
- StringTerms.Bucket.getKeyAsNumber detection type
- Fix incorrect results for aggregations nested under a nested
aggregation
- Fix global aggregation that requires breadth first and scores
- Fix composite aggregation when after term is missing in the shard
- Fix preserving FiltersAggregationBuilder#keyed field on rewrite
- Using DocValueFormat::parseBytesRef for parsing missing value
parameter
- Fix illegal cast of the "low cardinality" optimization of the
`terms` aggregation.
- Always include the _index and _id for nested search hits.
Allocation::
- Do not open indices with broken settings
Core::
- Fix lock accounting in releasable lock
- Fixes ByteSizeValue to serialise correctly
- Do not set data paths on no local storage required
- Ensure threadcontext is preserved when refresh listeners are invoked
- Ensure logging is configured for CLI commands
Engine::
- Replica recovery could go into an endless flushing loop
- Use `_refresh` to shrink the version map on inactivity
- Allow resize version map under lock even if there are pending
operations
- Reset LiveVersionMap on sync commit
Geo::
- Correct two equality checks on incomparable types
- Handle case where the hole vertex is south of the containing
polygon(s)
Highlighting::
- Fix highlighting on a keyword field that defines a normalizer
Inner Hits::
- Add version support for inner hits in field collapsing (#27822)
Internal::
- Never return null from Strings.tokenizeToStringArray
- Fallback to TransportMasterNodeAction for cluster health retries
- Retain originalIndex info when rewriting FieldCapabilities requests
Java REST Client::
- Do not use system properties when building the HttpAsyncClient
Mapping::
- Ignore null value for range field (#27845)
- Pass `java.locale.providers=COMPAT` to Java 9 onwards
- Allow update of `eager_global_ordinals` on `_parent`.
- Fix merging of _meta field
Network::
- Only bind loopback addresses when binding to local
- Remove potential nio selector leak
- Fix issue where the incorrect buffers are written
- Throw UOE from compressible bytes stream reset
- Bubble exceptions when closing compressible streams
Packaging::
- Allow custom service names when installing on windows
Percolator::
- Avoid TooManyClauses exception if number of terms / ranges is
exactly equal to 1024
Plugin Analysis ICU::
- Catch InvalidPathException in IcuCollationTokenFilterFactory
Plugin Analysis Phonetic::
- Fix daitch_mokotoff phonetic filter to use the dedicated Lucene
filter
Plugin Lang Painless::
- Painless: Fix variable scoping issue in lambdas
- Painless: Fix errors allowing void to be assigned to def.
Plugin Repository HDFS::
- Fix SecurityException when HDFS Repository used against HA Namenodes
Plugins::
- Make sure that we don't detect files as maven coordinate when
installing a plugin
- Fix upgrading indices which use a custom similarity plugin.
Recovery::
- Open engine should keep only starting commit
- Allow shrinking of indices from a previous major
- Set global checkpoint before open engine from store
- Check and repair index under the store metadata lock
- Flush old indices on primary promotion and relocation
Rollover::
- Make index rollover action atomic
Scripting::
- Ensure we protect Collections obtained from scripts from
self-referencing
Scroll::
- Reject scroll query if size is 0 (#22552)
- Fix scroll query with a sort that is a prefix of the index sort
Search::
- Fix simple_query_string on invalid input
- Use the underlying connection version for CCS connections
- Fix synonym phrase query expansion for cross_fields parsing
- Carry forward weights, etc on rescore rewrite
- Fix routing with leading or trailing whitespace
Sequence IDs::
- Recovery from snapshot may leave seq# gaps
- No longer unidle shard during recovery
- Obey translog durability in global checkpoint sync
Settings::
- Settings: Introduce settings updater for a list of settings
- Fix setting notification for complex setting (affixMap settings)
that could cause transient settings to be ignored
- Fix environment variable substitutions in list setting
- Allow index settings to be reset by wildcards
Snapshot/Restore::
- Consistent updates of IndexShardSnapshotStatus
- Avoid concurrent snapshot finalizations when deleting an INIT
snapshot
- Do not start snapshots that are deleted during initialization
- Do not swallow exception in ChecksumBlobStoreFormat.writeAtomic()
- Consistent update of stage and failure message in
IndexShardSnapshotStatus
- Fail restore when the shard allocations max retries count is reached
- Delete shard store files before restoring a snapshot
Stats::
- Fixes DocStats to properly deal with shards that report -1 index
size
- Include internal refreshes in refresh stats
Term Vectors::
- Fix term vectors generator with keyword and normalizer
=== Upgrades
Core::
- Dependencies: Update joda time to 2.9.9
- upgrade to lucene 7.2.1
- Upgrade jna from 4.4.0-1 to 4.5.1
Ingest::
- update ingest-attachment to use Tika 1.17 and newer deps
6.1.3
Engine::
- Replica recovery could go into an endless flushing loop
Internal::
- Never return null from Strings.tokenizeToStringArray
- Fallback to TransportMasterNodeAction for cluster health retries
Mapping::
- Allow update of `eager_global_ordinals` on `_parent`.
Scripting::
- Ensure we protect Collections obtained from scripts from
self-referencing
Settings::
- Fix setting notification for complex setting (affixMap settings)
that could cause transient settings to be ignored
- Fix environment variable substitutions in list setting
Snapshot/Restore::
- Avoid concurrent snapshot finalizations when deleting an INIT
snapshot
- Do not start snapshots that are deleted during initialization
Files: