./databases/elasticsearch, Distributed RESTful Search Engine

[ CVSweb ] [ Homepage ] [ RSS ] [ Required by ] [ Add to tracker ]


Branch: CURRENT, Version: 5.4.2, Package name: elasticsearch-5.4.2, Maintainer: imil

Elasticsearch is a distributed RESTful search engine built for the cloud.
Features include:

* Distributed and Highly Available Search Engine.
* Multi Tenant with Multi Types.
* Various set of APIs
* Document oriented
* Reliable, Asynchronous Write Behind for long term persistency.
* (Near) Real Time Search.
* Built on top of Lucene
* Per operation consistency
* Open Source under Apache 2 License.


Required to run:
[shells/bash] [lang/openjdk8]

Required to build:
[pkgtools/cwrappers]

Master sites:

SHA1: 87c884a637ac8d06a77acb881599ee81d136412c
RMD160: 3ca19ab31fd0765323b3f62ecb0c38ad4f4b7762
Filesize: 32541.104 KB

Version history: (Expand)


CVS history: (Expand)


   2017-06-21 15:35:52 by Filip Hajny | Files touched by this commit (2) | Package updated
Log message:
Update databases/elasticsearch to 5.4.2

=== Enhancements

Core::
* Explicitly reject duplicate data paths

Packaging::
* Set number of processes in systemd unit file

=== Bug fixes

Aggregations::
* Terms aggregation should remap global ordinal buckets when a
* sub-aggregator is used to sort the terms

Analysis::
* PatternAnalyzer should lowercase wildcard queries when `lowercase`
* is true.

Circuit Breakers::
* Checks the circuit breaker before allocating bytes for a new big
* array

Geo::
* Fix GeoPoint FieldStats ternary logic bug
* Fix GeoDistance Ordinal for BWC

Index APIs::
* Rollover max docs should only count primaries

Nested Docs::
* Fix the `max` score mode.

Network::
* Ensure pending transport handlers are invoked for all channel
* failures

Packaging::
* When stopping via systemd only kill the JVM, not its control group

Suggesters::
* Fix context suggester to read values from keyword type field
   2017-06-14 15:49:35 by Filip Hajny | Files touched by this commit (3) | Package updated
Log message:
Update databases/elasticsearch to 5.4.1.

=== Enhancements

Aggregations::
- Allow scripted metric agg to access `_score`

Core::
- Improve bootstrap checks error messages

Internal::
- Log JVM arguments on startup

Network::
- Disable the Netty recycler in the client
- Remove Netty logging hack
- Set available processors for Netty

Snapshot/Restore::
- Ensure every repository has an incompatible-snapshots blob

Stats::
- Show JVM arguments

=== Bug fixes

Aggregations::
- Fix ArrayIndexOutOfBoundsException when no ranges are specified in
  the query

Allocation::
- Discard stale node responses from async shard fetching

Core::
- Fix cache expire after access

Index APIs::
- Fix legacy GeoPointField decoding in FieldStats
- Validates updated settings on closed indices

Internal::
- Remove `_UNRELEASED` from Version constants for released versions
- Avoid race when shutting down controller processes
- Fix NPE if field caps request has a field that exists not in all
  indices

More Like This::
- Pass over _routing value with more_like_this items to be retrieved

Network::
- Notify onConnectionClosed rather than onNodeDisconnect to prune
  transport handlers
- SniffNodesSampler should close connection after handling responses

Packaging::
- Handle parentheses in batch file path

Percolator::
- Fix range queries with date range based on current time in
  percolator queries.

Plugin Repository HDFS::
- Fixing permission errors for `KERBEROS` security mode for HDFS
  Repository

Plugins::
- X-Pack plugin download fails on Windows desktop [ISSUE]
- Fix plugin installation permissions

Reindex API::
- Reindex: don't duplicate _source parameter
- Add qa module that tests reindex-from-remote against pre-5.0
  versions of Elasticsearch

Scroll::
- Fix single shard scroll within a cluster with nodes in version `>=
  5.3` and `<= 5.3`

Search::
- Fix ExpandSearchPhase when response contains no hits
- Include all aliases including non-filtering in  `_search_shards`
  response

Settings::
- Allow resetting settings that use an IP validator

Snapshot/Restore::
- Removes completed snapshot from cluster state on master change
- Fix inefficient (worst case exponential) loading of snapshot
  repository

=== Upgrades

Core::
- Upgrade to Lucene 6.5.1

Network::
- Upgrade to Netty 4.1.11.Final
- Upgrade Netty to 4.1.10.Final
   2017-05-11 10:36:30 by Filip Hajny | Files touched by this commit (3) | Package updated
Log message:
Update databases/elasticsearch to 5.4.0.

=== Breaking changes

Settings::
- Remove support for default settings

=== Breaking Java changes

Aggregations::
- Move getProperty method out of MultiBucketsAggregation.Bucket
  interface
- Remove getProperty method from Aggregations interface and impl
- Move getProperty method out of Aggregation interface

Java API::
- Fold InternalSearchHits and friends into their interfaces

=== Deprecations

Aggregations::
- Deprecate Stats#getCountAsString

Java API::
- Add BulkProcessor methods with XContentType parameter

Network::
- Deprecate Netty 3

Packaging::
- Add deprecation warnings for $ES_USER and $ES_GROUP

Plugin Delete By Query::
- Deprecate delete_by_query requests without an explicit query

Plugin Repository Azure::
- Deprecate global `repositories.azure` settings

Plugin Repository S3::
- Deprecate repositories.s3 settings

REST::
- Deprecate ldjson support and document ndjson for bulk/msearch

Stats::
- Deprecate `_field_stats` endpoint

=== New features

Analysis::
- Adds pattern keyword marker filter support
- Expose WordDelimiterGraphTokenFilter

Index APIs::
- Add FieldCapabilities (`_field_caps`) API

Search::
- Introduce incremental reduction of TopDocs

Similarities::
- Adds boolean similarity to Elasticsearch

=== Enhancements

Aggregations::
- Add BucketMetricValue interface
- Move aggs CommonFields and TYPED_KEYS_DELIMITER from
  InternalAggregation to Aggregation
- Use ParseField for aggs CommonFields rather than String
- Share XContent rendering code in terms aggs
- Add unit tests for ParentToChildAggregator
- First step towards incremental reduction of query responses

Allocation::
- Trigger replica recovery restarts by master when primary relocation
  completes
- Makes the same_shard host dynamically updatable

Analysis::
- Support Keyword type in Analyze API

Cluster::
- Prevent nodes from joining if newer indices exist in the cluster

Core::
- Detect remnants of path.data/default.path.data bug
- Await termination after shutting down executors
- Add early-access check
- Adapter action future should restore interrupts
- Disable bootstrap checks for single-node discovery
- Enable explicitly enforcing bootstrap checks
- Add equals/hashcode method to ReplicationResponse

Dates::
- Improve error handling for epoch format parser with time zone
  (#22621)

Discovery::
- Introduce single-node discovery
- UnicastZenPing shouldn't ping the address of the local node
- MasterFaultDetection can start after the initial cluster state has
  been processed

Highlighting::
- Add support for fragment_length in the unified highlighter
- Add BreakIteratorBoundaryScanner support

Index APIs::
- Wildcard cluster names for cross cluster search

Ingest::
- Lazy load the geoip databases

Internal::
- Add a dedicated TransportRemoteInfoAction for consistency
- Simplify sorted top docs merging in SearchPhaseController
- Synchronized CollapseTopFieldDocs with lucenes relatives
- Cleanup SearchPhaseController interface
- Do not create String instances in 'Strings' methods accepting
  StringBuilder

Java API::
- Added types options to DeleteByQueryRequest

Java High Level REST Client::
- Convert suggestion response parsing to use NamedXContentRegistry
- UpdateRequest implements ToXContent
- Add javadoc for DocWriteResponse.Builders
- Expose WriteRequest.RefreshPolicy string representation
- Use `typed_keys` parameter to prefix suggester names by type in
  search responses
- Add parsing methods to BulkItemResponse

Logging::
- Warn on not enough masters during election

Mapping::
- Improve error message for ipv6 on legacy ip fields

Nested Docs::
- Avoid adding unnecessary nested filters when ranges are used.

Network::
- Adjust default Netty receive predictor size to 64k
- Keep the pipeline handler queue small initially
- Set network receive predictor size to 32kb
- TransportService.connectToNode should validate remote node ID

Packaging::
- Introduce Java version check
- Cleanup some things after removal of joda-time hack

Percolator::
- Allowing range queries with now ranges inside percolator queries
- Add term extraction support for MultiPhraseQuery

Plugin Discovery EC2::
- Settings: Migrate ec2 discovery sensitive settings to elasticsearch
  keystore

Plugin Lang Painless::
- Allow painless to load stored fields
- Start on custom whitelists for Painless
- Fix Painless's implementation of interfaces returning primitives
- Allow painless to implement more interfaces

Plugin Repository Azure::
- Add Backoff policy to azure repository

Plugin Repository S3::
- Removes the retry mechanism from the S3 blob store
- S3 Repository: Eagerly load static settings

Plugins::
- Modify permissions dialog for plugins
- Plugins: Add plugin cli specific exit codes
- Plugins: Output better error message when existing plugin is
  incompatible

Query DSL::
- Make it possible to validate a query on all shards instead of a
  single random shard

REST::
- Validate top-level keys when parsing mget requests
- Cluster stats should not render empty http/transport types
- Add parameter to prefix aggs name with type in search responses

Search::
- Set shard count limit to unlimited
- Streamline shard index availability in all SearchPhaseResults
- Search took time should use a relative clock
- Prevent negative `from` parameter in SearchSourceBuilder
- Remove unnecessary result sorting in SearchPhaseController
- Expose `batched_reduce_size` via `_search`
- Adding fromXContent to Suggest and Suggestion class
- Adding fromXContent to Suggestion.Entry and subclasses
- Add CollapseSearchPhase as a successor for the FetchSearchPhase
- Integrate IndexOrDocValuesQuery.
- Detach SearchPhases from AbstractSearchAsyncAction
- Fix GraphQuery expectation after Lucene upgrade to 6.5
- Nested queries should avoid adding unnecessary filters when
  possible.
- Add xcontent parsing to completion suggestion option
- Add xcontent parsing to suggestion options
- Separate reduce (aggs, suggest and profile) from merging fetched
  hits

Settings::
- Add secure file setting to keystore
- Add a setting which specifies a list of setting
- Add a property to mark setting as final
- Remove obsolete index setting `index.version.minimum_compatible`.
- Provide a method to retrieve a closeable char[] from a SecureString
- Update indices settings api to support CBOR and SMILE format
- Improve setting deprecation message

Snapshot/Restore::
- Change snapshot status error to use generic SnapshotException

Stats::
- Add cross-cluster search remote cluster info API

Task Manager::
- Allow task to be unregistered by ClusterStateApplier
- Limit IndexRequest toString() length

=== Bug fixes

Aggregations::
- Align behavior HDR percentiles iterator with percentile() method
- The `filter` and `significant_terms` aggregations should parse the
  `filter` as a filter, not a query.
- Completion suggestion should also consider text if prefix/regex is
  missing
- Fixes the per term error in the terms aggregation
- Fixes terms error count for multiple reduce phases
- Restore support for the `include/pattern` syntax.

Bulk::
- Reject empty IDs

CRUD::
- Fix backport executing ops as single item bulk

Cluster::
- Don't set local node on cluster state used for node join validation
- Allow a cluster state applier to create an observer and wait for a
  better state
- Cluster allocation explain to never return empty response body

Core::
- Check for default.path.data included in path.data
- Improve performance of extracting warning value
- Reject duplicate settings on the command line
- Restrict build info loading to ES jar, not any jar

Discovery::
- ZenDiscovery - only validate min_master_nodes values if local node
  is master

Index APIs::
- Fixes restore of a shrunken index when initial recovery node is gone
- Honor update request timeout

Ingest::
- Improve missing ingest processor error
- update _ingest.timestamp to use new ZonedDateTime

Inner Hits::
- Replace NestedChildrenQuery with ParentChildrenBlockJoinQuery
- Changed DisMaxQueryBuilder to extract inner hits from leaf queries

Internal::
- Add infrastructure to mark contexts as system contexts
- Always restore the ThreadContext for operations delayed due to a
  block

Java High Level REST Client::
- Correctly parse BulkItemResponse.Failure's status

Java REST Client::
- Make buffer limit configurable in HeapBufferedConsumerFactory
- RestClient asynchronous execution should not throw exceptions

Mapping::
- Preserve response headers when creating an index
- Improves disabled fielddata error message
- Switch include_in_all in multifield to warning
- Fix MapperService StackOverflowError
- Fix NPE with scaled floats stats when field is not indexed

Network::
- Fix possible hang in local transport when nodes get concurrently
  disconnected
- Respect promises on pipelined responses
- Ensure that releasing listener is called

Packaging::
- Fall back to non-atomic move when removing plugins

Percolator::
- Fix memory leak when percolator uses bitset or field data cache

Plugin Ingest Attachment::
- Remove support for Visio and potm files

Plugin Lang Painless::
- Fix painless's regex lexer and error messages
- Replace Painless's Cast with casting strategies
- Fix Bad Casts In Painless

Plugin Repository Azure::
- Azure blob store's readBlob() method first checks if the blob exists

Plugin Repository S3::
- Handle BlobPath's trailing separator case. Add test cases to
  BlobPathTests.java

Plugins::
- Fix delete of plugin directory on remove plugin
- Use a marker file when removing a plugin

Query DSL::
- FuzzyQueryBuilder should error when parsing array of values

REST::
- [API] change wait_for_completion default according to docs
- Deprecate request_cache for clear-cache
- HTTP transport stashes the ThreadContext instead of the
  RestController
- Ensure we try to autodetect content type for handlers that support
  plain text
- Fix date format in warning headers
- Align REST specs for HEAD requests
- Correct warning header to be compliant
- Fix get HEAD requests
- Fix search scroll request with a plain text body
- Handle bad HTTP requests
- Fix get source HEAD requests
- Properly encode location header
- Fix template HEAD requests
- Fix index HEAD requests
- Fix alias HEAD requests

Recovery::
- Provide target allocation id as part of start recovery request

Reindex API::
- Fix throttled reindex_from_remote
- Fix reindex with a remote source on a version before 2.0.0
- Make reindex wait for cleanup before responding

Scripting::
- Remove unnecessary Groovy deprecation logging
- Convert script/template objects to json format internally
- Script: Fix value of `ctx._now` to be current epoch time in
  milliseconds

Search::
- Cross Cluster Search: propagate original indices per cluster
- Query string default field
- Speed up parsing of large `terms` queries.
- IndicesQueryCache should delegate the scorerSupplier method.
- Fork LRUQueryCache from Lucene to work around LUCENE-7749
- Disable graph analysis at query time for shingle and cjk filters
  producing tokens of different size
- Fix cross-cluster remote node gateway attributes
- Use a fixed seed for computing term hashCode in TermsSliceQuery
- Honor max concurrent searches in multi-search
- Avoid stack overflow in multi-search
- Fix query_string_query to transform "foo:*" in an exists query on
  the field name
- Factor out filling of TopDocs in SearchPhaseController
- Replace blocking calls in ExpandCollapseSearchResponseListener by
  asynchronous requests

Search Templates::
- No longer add illegal content type option to stored search templates

Settings::
- Do not set path.data in environment if not set
- Correct handling of default and array settings
- Fix merge scheduler config settings
- Settings: Fix keystore cli prompting for yes/no to handle console
  returning null

Similarities::
- Fix similarity upgrade when "default" similarity is overridden

Snapshot/Restore::
- Fixes maintaining the shards a snapshot is waiting on
- Fixes snapshot status on failed snapshots
- Fixes snapshot deletion handling on in-progress snapshot failure
- Prioritize listing index-N blobs over index.latest in reading
  snapshots

Stats::
- Avoid overflow when computing total FS stats
- Handle existence of cgroup version 2 hierarchy
- Handle long overflow when adding paths' totals
- Fix control group pattern
- Fix total disk bytes returning negative value

=== Regressions

Bulk::
- Fix _bulk response when it can't create an index

=== Upgrades

Aggregations::
- Upgrade HDRHistogram to 2.1.9

Core::
- Upgrade to Lucene 6.5.0
- Upgrade from JNA 4.2.2 to JNA 4.4.0
- Upgrade to lucene-6.5.0-snapshot-d00c5ca
- Upgrade to lucene-6.5.0-snapshot-f919485.

Logging::
- Upgrade to Log4j 2.8.2

Network::
- Upgrade to Netty 4.1.9
- Upgrade to Netty 4.1.8

Plugin Repository Azure::
- Update to Azure Storage 5.0.0
   2017-04-22 19:20:55 by Filip Hajny | Files touched by this commit (3) | Package updated
Log message:
Update databases/elasticsearch to 5.3.1

=== Breaking changes

Settings::
- Remove support for default settings

=== Enhancements

Core::
- Detect remnants of path.data/default.path.data bug

Network::
- Adjust default Netty receive predictor size to 64k

REST::
- Cluster stats should not render empty http/transport types

=== Bug fixes

Aggregations::
- The `filter` and `significant_terms` aggregations should parse the
  `filter` as a filter, not a query.
- Restore support for the `include/pattern` syntax.

Bulk::
- Reject empty IDs

Core::
- Improve performance of extracting warning value
- Restrict build info loading to ES jar, not any jar

Discovery::
- ZenDiscovery - only validate min_master_nodes values if local node
  is master

Index APIs::
- Honor update request timeout

Inner Hits::
- Replace `NestedChildrenQuery` with `ParentChildrenBlockJoinQuery`

Internal::
- Add infrastructure to mark contexts as system contexts

Java REST Client::
- Make buffer limit configurable in HeapBufferedConsumerFactory

Mapping::
- Preserve response headers when creating an index
- Fix NPE with scaled floats stats when field is not indexed

Network::
- Fix possible hang in local transport when nodes get concurrently
  disconnected

Plugin Repository Azure::
- Azure blob store's readBlob() method first checks if the blob exists

Reindex API::
- Fix reindex with a remote source on a version before 2.0.0

Search::
- Disable graph analysis at query time for shingle and cjk filters
  producing tokens of different size
- Fix cross-cluster remote node gateway attributes
- Use a fixed seed for computing term hashCode in TermsSliceQuery

Settings::
- Do not set path.data in environment if not set
- Correct handling of default and array settings

Stats::
- Handle existence of cgroup version 2 hierarchy

=== Upgrades

Internal::
- upgrade to Lucene 6.4.2
   2017-03-30 17:23:50 by Filip Hajny | Files touched by this commit (3) | Package updated
Log message:
Update databases/elasticsearch to 5.3.0

=== Breaking changes

Query DSL::
- Fix name of `enabled_position_increments`

Search::
- Remove DFS_QUERY_AND_FETCH as a search type

=== Breaking Java changes

CRUD::
- Make index and delete operation execute as single bulk item
  (backport of #21964)

Internal::
- Replace SearchExtRegistry with namedObject
- Replace Suggesters with namedObject

Network::
- Remove HttpServer and HttpServerAdapter in favor of a simple
  dispatch method

Plugins::
- Deguice rest handlers

Search::
- Remove QUERY_AND_FETCH search type

=== Deprecations

Core::
- Deprecate lenient booleans

Geo::
- Geo distance range deprecation

Java API::
- Add BulkProcessor methods with XContentType parameter

Mapping::
- Deprecate the include_in_all mapping parameter

Network::
- Deprecate Netty 3
- Deprecate Netty 3

Plugin Repository Azure::
- Deprecate auto creation of container for azure repository

Plugin Repository S3::
- S3 Repository: Deprecate specifying region
- S3 Repository: Deprecate auto creation of s3 bucket for repository
- Deprecate specifying credentials through env vars, sys props, and
  remove profile files

REST::
- Deprecate ldjson support and document ndjson for bulk/msearch
- Optionally require a valid content type for all rest requests with
  content

Scripting::
- Change Namespace for Stored Script to Only Use Id

=== New features

Aggregations::
- Initial version of an adjacency matrix using the Filters aggregation

CRUD::
- Allow an index to be partitioned with custom routing

Highlighting::
- Integrate UnifiedHighlighter

Search::
- Add federated cross cluster search capabilities
- Add field collapsing for search request

Settings::
- Add infrastructure for elasticsearch keystore

=== Enhancements

Allocation::
- Include stale replica shard info when explaining an unassigned
  primary

Analysis::
- Analyze API Position Length Support

CRUD::
- Make index and delete operation execute as a single bulk item

Circuit Breakers::
- Add used memory amount to CircuitBreakingException message (#22521)

Cluster::
- Connect to new nodes concurrently

Core::
- Simplify write failure handling (backport of #19105)
- Simplify ElasticsearchException rendering as a XContent
- Remove setLocalNode from ClusterService and TransportService

Engine::
- Replace EngineClosedException with AlreadyClosedExcpetion

Index APIs::
- Indexing: Add shard id to indexing operation listener
- Better error when can't auto create index

Ingest::
- Lazy load the geoip databases

Internal::
- Improve connection closing in `RemoteClusterConnection`
- Remove some more usages of ParseFieldMatcher
- Introduce ToXContentObject interface

Java API::
- prevent NPE when trying to uncompress a null BytesReference

Java High Level REST Client::
- Add parsing from xContent to MainResponse
- Parse elasticsearch exception's root causes
- Add parsing method to BytesRestResponse's error
- Add parsing method for
  ElasticsearchException.generateThrowableXContent()
- Add fromxcontent methods to delete response
- Add parsing methods for UpdateResponse
- Add parsing from xContent to InternalSearchHit and
  InternalSearchHits
- Add fromxcontent methods to index response

Java REST Client::
- move ignore parameter support from yaml test client to low level
  rest client
- Support Preemptive Authentication with RestClient

Logging::
- Expose logs base path

Mapping::
- Improve error message for ipv6 on legacy ip fields

Network::
- Keep the pipeline handler queue small initially

Packaging::
- Introduce Java version check

Plugin Discovery EC2::
- Read ec2 discovery address from aws instance tags

Plugin Lang Painless::
- Generate reference links for painless API
- Painless: Add augmentation to String for base 64

Plugin Repository S3::
- S3 repository: Add named configurations

Plugins::
- Add the ability to define search response listeners in search plugin

Query DSL::
- QueryString and SimpleQueryString Graph Support
- Additional Graph Support in Match Query
- RangeQuery WITHIN case now normalises query

Reindex API::
- Increase visibility of doExecute so it can be used directly
- Improve error message when reindex-from-remote gets bad json

Scripting::
- Expose multi-valued dates to scripts and document painless's date
  functions

Search::
- Add a setting to disable remote cluster connections on a node
- First step towards separating individual search phases
- Add parsing from xContent to SearchProfileShardResults and nested
  classes
- ProfileResult and CollectorResult should print machine readable
  timing information

Settings::
- Improve setting deprecation message
- Add secure settings validation on startup
- Allow comma delimited array settings to have a space after each
  entry
- Allow affix settings to be dynamic / updatable
- Allow affix settings to delegate to actual settings
- Make s3 repository sensitive settings use secure settings

Snapshot/Restore::
- Duplicate snapshot name throws InvalidSnapshotNameException
- Use general cluster state batching mechanism for snapshot state
  updates

Stats::
- Add geo_point to FieldStats

=== Bug fixes

CRUD::
- Fix backport executing ops as single item bulk

Cache::
- Invalidate cached query results if query timed out

Cluster::
- Don't set local node on cluster state used for node join validation
- Allow a cluster state applier to create an observer and wait for a
  better state
- Cluster allocation explain to never return empty response body

Exceptions::
- Stop returning "es." internal exception headers as http response
  headers

Ingest::
- Improve missing ingest processor error
- fix date-processor to a new default year for every new pipeline
  execution

Internal::
- Always restore the ThreadContext for operations delayed due to a
  block
- Fix handling of document failure exception in InternalEngine
  (backport #22718)

Java REST Client::
- RestClient asynchronous execution should not throw exceptions

Mapping::
- Switch include_in_all in multifield to warning
- Fix MapperService StackOverflowError
- Range types causing `GetFieldMappingsIndexRequest` to fail due to
  `NullPointerException` in `RangeFieldMapper.doXContentBody` when
`include_defaults=true` is on the query string
- Disallow introducing illegal object mappings (double '..')

Network::
- Respect promises on pipelined responses
- Ensure that releasing listener is called

Packaging::
- Fall back to non-atomic move when removing plugins

Parent/Child::
- Add null check in case of orphan child document

Plugin Ingest Attachment::
- Remove support for Visio and potm files
- Add missing mime4j library

Plugin Lang Painless::
- Fix Bad Casts In Painless
- Don't allow casting from void to def in painless
- Fix def invoked qualified method refs

Plugins::
- Add check for null pluginName in remove command

Query DSL::
- Fix parsing for `max_determinized_states`

REST::
- [API] change wait_for_completion default according to docs
- HTTP transport stashes the ThreadContext instead of the
  RestController
- Ensure we try to autodetect content type for handlers that support
  plain text
- Fix date format in warning headers
- Correct warning header to be compliant
- Fix search scroll request with a plain text body
- Handle bad HTTP requests
- Properly encode location header

Reindex API::
- Reindex: do not log when can't clear old scroll
- Fix reindex-from-remote from <2.0

Scripting::
- Remove unnecessary Groovy deprecation logging
- Script: Fix value of `ctx._now` to be current epoch time in
  milliseconds

Search::
- Honor max concurrent searches in multi-search
- Avoid stack overflow in multi-search
- Replace blocking calls in ExpandCollapseSearchResponseListener by
  asynchronous requests
- Ensure fixed serialization order of InnerHitBuilder

Settings::
- Fix merge scheduler config settings
- Settings: Fix keystore cli prompting for yes/no to handle console
  returning null
- Expose `search.highlight.term_vector_multi_value` as a node level
  setting
- NPE when no setting name passed to elasticsearch-keystore

Similarities::
- Fix similarity upgrade when "default" similarity is overridden

Stats::
- Avoid overflow when computing total FS stats
- Handle long overflow when adding paths' totals
- Fix control group pattern
- Fix total disk bytes returning negative value

Task Manager::
- Fix hanging cancelling task with no children
- Fix broken TaskInfo.toString()

=== Regressions

Core::
- Source filtering: only accept array items if the previous include
  pattern matches

=== Upgrades

Internal::
- Upgrade to Lucene 6.4.1.
   2017-03-01 15:19:27 by Filip Hajny | Files touched by this commit (3) | Package updated
Log message:
Update databases/elasticsearch to 5.2.2.

5.2.2

- The request circuit breaker, which track the size of in-flight
  requests, was not decrementing its counter when the connection was
  closed by the client before the response could be returned. This could
  result in no further requests being accepted until the node has been
  restarted. All users should upgrade to take advantage of this bug fix.
- The cgroup functionality (for reading OS stats for containers) had a
  bug in the regex for parsing /proc/self/cgroup which prevented nodes
  with multiple hierarchies from starting up.
- Requests which have been delayed by a shard lock might be executed
  later on a different thread which lacks the request context, resulting
  in the requests being incorrectly rejected as unauthorised.
- Removal of an undocumented syntax for include/exclude parameters in
  the terms aggregation broke certain aggregations in Kibana.

5.2.1

- When stored fields are configured with best_compression, we rely on
  JVM garbage collection to reclaim Deflater/Inflater instances. However
  these classes use little JVM memory but may use significant native
  memory, so if may happen that the OS runs out of native memory before
  the JVM collects these unreachable Deflater/Inflater instances.
- Certain queries can hold a reference to the IndexReader that was used
  to build them. When these queries are cached, this reference causes
  Lucene to hold onto segments long after they should have been deleted.
   2017-02-14 11:36:03 by Filip Hajny | Files touched by this commit (3) | Package updated
Log message:
Update databases/elasticsearch to 5.2.0.

=== Breaking changes

Core::
- Add system call filter bootstrap check

=== Breaking Java changes

Allocation::
- Cluster Explain API uses the allocation process to explain shard
  allocation decisions

Cluster::
- Remove PROTO-based custom cluster state components

Ingest::
- Change type of ingest doc meta-data field 'TIMESTAMP' to `Date`

Internal::
- Consolidate the last easy parser construction
- Introduce XContentParser#namedObject

Plugins::
- Plugins: Replace Rest filters with RestHandler wrapper

Query DSL::
- Resolve index names in indices_boost

Search::
- Cluster search shards improvements: expose ShardId, adjust visibility
  of some members

=== Deprecations

Java API::
- Deprecate and remove "minimumNumberShouldMatch" in BoolQueryBuilder

Shadow Replicas::
- Add a deprecation notice to shadow replicas

=== New features

Analysis::
- Synonym Graph Support (LUCENE-6664)

Ingest::
- introduce KV Processor in Ingest Node

Mapping::
- Add the ability to set a normalizer on keyword fields.
- Add RangeFieldMapper for numeric and date range types

=== Enhancements

Aggregations::
- `value_type` is useful regardless of scripting.
- Support for partitioning set of terms

Allocation::
- Adds setting level to allocation decider explanations
- Improves allocation decider decision explanation messages
- Prepares allocator decision objects for use with the allocation
  explain API

Analysis::
- Expose FlattenGraphTokenFilter

CRUD::
- Use correct block levels for TRA subclasses

Cluster::
- Keep NodeConnectionsService in sync with current nodes in the cluster
  state
- Add a generic way of checking version before serializing custom
  cluster object
- Add validation for supported index version on node join, restore,
  upgrade & open index
- Let ClusterStateObserver only hold onto state that's needed for change
  detection
- Remove mutable status field from cluster state

Core::
- Rename bootstrap.seccomp to bootstrap.system_call_filter
- Cleanup random stats serialization code
- Avoid corruption when deserializing booleans
- Reduce memory pressure when sending large terms queries.

Discovery::
- Simplify Unicast Zen Ping
- Prefer joining node with conflicting transport address when becoming
  master

Ingest::
- add `ignore_missing` flag to ingest plugins
- Added ability to remove pipelines via wildcards (#22149)
- Enables the ability to inject serialized json fields into root of
  document
- compile ScriptProcessor inline scripts when creating ingest pipelines

Internal::
- Remove some more usages of ParseFieldMatcher
- Remove some more usages of ParseFieldMatcher
- Remove some ParseFieldMatcher usages
- Add infrastructure to manage network connections outside of
  Transport/TransportService
- Replace strict parsing mode with response headers assertions
- Start using `ObjectParser` for aggs.
- Don't output null source node in RecoveryFailedException
- ClusterService should expose "applied" cluster states (i.e., remove
  ClusterStateStatus)

Java High Level REST Client::
- Add fromxcontent methods to index response
- Add fromXContent() methods for ReplicationResponse
- Add parsing method for ElasticsearchException
- Add fromXContent method to GetResponse

Java REST Client::
- Warn log deprecation warnings received from server

Logging::
- Log deleting indices at info level
- Log failure to connect to node at info instead of debug

Mapping::
- Atomic mapping updates across types
- Only update DocumentMapper if field type changes
- Better error message when `_parent` isn't an object

Network::
- Disable the Netty recycler
- Tell Netty not to be unsafe in transport client
- Introduce a low level protocol handshake
- Detach handshake from connect to node
- Reduce number of connections per node depending on the nodes role
- Add a connect timeout to the ConnectionProfile to allow per node
  connect timeouts
- Grant Netty permission to read system somaxconn
- Remove connectToNodeLight and replace it with a connection profile

Packaging::
- Improve the out-of-the-box experience

Plugin Discovery EC2::
- Add support for ca-central-1 region to EC2 and S3 plugins
- Support for eu-west-2 (London) cloud-aws plugin
- Add us-east-2 AWS region
- Add setting to set read timeout for EC2 discovery and S3 repository
  plugins

Plugin Ingest GeoIp::
- Cache results of geoip lookups

Plugin Lang Painless::
- Improve painless's ScriptException generation

Plugins::
- Pass ThreadContext to transport interceptors to allow header
  modification
- Provide helpful error message if a plugin exists
- Add shutdown hook for closing CLI commands
- Allow plugins to install bootstrap checks

Query DSL::
- Un-deprecate fuzzy query
- support numeric bounds with decimal parts for long/integer/short/byte
  datatypes

Reindex API::
- Reindex: Better error message for pipeline in wrong place
- Timeout improvements for rest client and reindex

Scripting::
- Wrap VerifyError in ScriptException
- Log ScriptException's xcontent if file script compilation fails

Search::
- Move SearchTransportService and SearchPhaseController creation outside
  of TransportSearchAction constructor
- Don't carry ShardRouting around when not needed in
  AbstractSearchAsyncAction
- ShardSearchRequest to take ShardId constructor argument rather than
  the whole ShardRouting
- Use index uuid as key in the alias filter map rather than the index
  name

Settings::
- Speed up filter and prefix settings operations

Snapshot/Restore::
- Fixes retrieval of the latest snapshot index blob
- Synchronize snapshot deletions on the cluster state

Stats::
- Include unindexed field in FieldStats response

Task Manager::
- Improve the error message if task and node isn't found
- Add descriptions to create snapshot and restore snapshot tasks.
- Add proper descriptions to reindex, update-by-query and
  delete-by-query tasks.

=== Bug fixes

Aggregations::
- Fix scaled_float numeric type in aggregations
- Allow terms aggregations on pure boolean scripts.
- Fix numeric terms aggregations with includes/excludes and
  minDocCount=0
- Fix `missing` on aggs on `boolean` fields.
- IP range masks exclude the maximum address of the range.
- Fix `other_bucket` on the `filters` agg to be enabled if a key is set.

Allocation::
- Cannot force allocate primary to a node where the shard already exists
- Promote shadow replica to primary when initializing primary fails
- Trim in-sync allocations set only when it grows

Analysis::
- AsciiFoldingFilter's multi-term component should never preserve the
  original token.
- Pre-built analysis factories do not implement MultiTermAware
  correctly.

CRUD::
- Reject external versioning and explicit version numbers on create

Cluster::
- IndicesService handles all exceptions during index deletion

Core::
- Streamline foreign stored context restore and allow to perserve
  response headers
- Support negative numbers in readVLong

Discovery::
- Close InputStream when receiving cluster state in
  PublishClusterStateAction
- Do not reply to pings from another cluster

Engine::
- Close and flush refresh listeners on shard close

Exceptions::
- Fixing shard recovery error message to report the number of docs
  correctly for each node

Highlighting::
- Fix FiltersFunctionScoreQuery highlighting

Index APIs::
- Ensure shrunk indices carry over version information from its source

Ingest::
- fix index out of bounds error in KV Processor
- Fixes GrokProcessor's ignorance of named-captures with same name.

Inner Hits::
- Inner hits and ignore unmapped

Internal::
- Index creation and setting update may not return deprecation logging

Java API::
- Don't output empty ext object in SearchSourceBuilder#toXContent

Java REST Client::
- Don't use null charset in RequestLogger

Mapping::
- The `_all` default mapper is not completely configured.
- Fix MapperService.allEnabled().
- Dynamic `date` fields should use the `format` that was used to detect
  it is a date.
- Sub-fields should not accept `include_in_all` parameter
- Mappings: Fix get mapping when no indexes exist to not fail in
  response generation

Nested Docs::
- Fix bug in query builder rewrite that ignores the ignore_unmapped
  option

Network::
- Pass `forceExecution` flag to transport interceptor
- Ensure new connections won't be opened if transport is closed or
  closing
- Prevent open channel leaks if handshake times out or is interrupted
- Execute low level handshake in #openConnection
- Properly configure Netty 3 ClientBootstrap when using custom
  connection profile
- Handle connection close / reset events gracefully during handshake
- Do not lose host information when pinging
- DiscoveryNode and TransportAddress should preserve host information

Packaging::
- Another fix for handling of paths on Windows
- Fix handling of spaces in Windows paths
- Add option to skip kernel parameters on install

Percolator::
- Fix NPE in percolator's 'now' range check for percolator queries with
  range queries

Plugin Analysis Stempel::
- Fix thread safety of Stempel's token filter factory

Plugin Lang Painless::
- Whitelist some ScriptDocValues in painless
- Update Painless Loop Counter to be Higher
- Fix some issues with painless's strings
- Test fix for def equals in Painless
- Fix a VerifyError bug in Painless

Plugin Mapper Attachment::
- NPE is raised when defining a non existing type within attachments
  type

Plugin Repository Azure::
- Fixes default chunk size for Azure repositories
- readonly on azure repository must be taken into account

Query DSL::
- Fix script score function that combines `_score` and weight

REST::
- Adds percent-encoding for Location headers

Recovery::
- Fix primary relocation for shadow replicas
- Don't close store under CancellableThreads
- Use a fresh recovery id when retrying recoveries
- Allow flush/force_merge/upgrade on shard marked as relocated

Reindex API::
- Fix reindex from remote clearing scroll
- Fix source filtering in reindex-from-remote
- Remove content type detection from reindex-from-remote
- Don't close rest client from its callback
- Keep context during reindex's retries

Scripting::
- Expose `ip` fields as strings in scripts.

Search::
- Improve concurrency of ShardCoreKeyMap.
- Make `-0` compare less than `+0` consistently.
- Fix boost_mode propagation when the function score query builder is
  rewritten
- FiltersAggregationBuilder: rewriting filter queries, the same way as
  in FilterAggregationBuilder
- Fix cross_fields type on multi_match query with synonyms

Search Templates::
- SearchTemplateRequest to implement CompositeIndicesRequest

Settings::
- Handle spaces in `action.auto_create_index` gracefully
- Fix settings diff generation for affix and group settings

Snapshot/Restore::
- Gracefully handles pre 2.x compressed snapshots
- URLRepository should throw NoSuchFileException to correctly adhere to
  readBlob contract
- Fixes shard level snapshot metadata loading when index-N file is
  missing

Stats::
- Implement stats for geo_point and geo_shape field
- Use reader for doc stats
- Avoid NPE in NodeService#stats if HTTP is disabled
- Add support for "include_segment_file_sizes" in indices stats REST
  handler

Term Vectors::
- Fix `_termvectors` with preference to not hit NPE
- Return correct term statistics when a field is not found in a shard

=== Regressions

Core::
- Source filtering: only accept array items if the previous include
  pattern matches

Logging::
- Restores the original default format of search slow log

Search::
- Handle specialized term queries in MappedFieldType.extractTerm(Query)

=== Upgrades

Core::
- Upgrade to Lucene 6.4.0
- Update Jackson to 2.8.6
- Upgrade to lucene-6.4.0-snapshot-084f7a0.
- Upgrade to lucene-6.4.0-snapshot-ec38570
   2017-01-17 18:34:16 by Filip Hajny | Files touched by this commit (2) | Package updated
Log message:
Update databases/elasticsearch to 5.1.2.

Aggregations::
- Allow terms aggregations on pure boolean scripts.
- IP range masks exclude the maximum address of the range.
- Fix `other_bucket` on the `filters` agg to be enabled if a key is set.

Allocation::
- Promote shadow replica to primary when initializing primary fails
- Trim in-sync allocations set only when it grows

Analysis::
- Pre-built analysis factories do not implement MultiTermAware
  correctly.

CRUD::
- Reject external versioning and explicit version numbers on create

Core::
- Support negative numbers in readVLong

Exceptions::
- Fixing shard recovery error message to report the number of docs
  correctly for each node

Index APIs::
- Ensure shrunk indices carry over version information from its source

Internal::
- Don't output null source node in RecoveryFailedException

Java REST Client::
- Don't use null charset in RequestLogger

Logging::
- Restores the original default format of search slow log

Mapping::
- Only update DocumentMapper if field type changes
- The `_all` default mapper is not completely configured.
- Fix MapperService.allEnabled().

Network::
- Disable the Netty recycler
- Tell Netty not to be unsafe in transport client

Nested Docs::
- Fix bug in query builder rewrite that ignores the ignore_unmapped
  option

Packaging::
- Another fix for handling of paths on Windows

Percolator::
- Fix NPE in percolator's 'now' range check for percolator queries with
  range queries

Plugins::
- Provide helpful error message if a plugin exists
- Add shutdown hook for closing CLI commands

Plugin Lang Painless::
- Update Painless Loop Counter to be Higher

Plugin Repository Azure::
- readonly on azure repository must be taken into account

Recovery::
- Fix primary relocation for shadow replicas
- Don't close store under CancellableThreads
- Use a fresh recovery id when retrying recoveries
- Allow flush/force_merge/upgrade on shard marked as relocated

Reindex API::
- Don't close rest client from its callback

Search::
- Improve concurrency of ShardCoreKeyMap.
- Make `-0` compare less than `+0` consistently.
- FiltersAggregationBuilder: rewriting filter queries, the same way as
  in FilterAggregationBuilder

Stats::
- Implement stats for geo_point and geo_shape field
- Use reader for doc stats
- Avoid NPE in NodeService#stats if HTTP is disabled
- Add support for "include_segment_file_sizes" in indices stats REST
  handler

Term Vectors::
- Fix _termvectors with preference to not hit NPE
- Return correct term statistics when a field is not found in a shard