./databases/elasticsearch, Distributed RESTful Search Engine

[ CVSweb ] [ Homepage ] [ RSS ] [ Required by ] [ Add to tracker ]


Branch: CURRENT, Version: 5.6.3, Package name: elasticsearch-5.6.3, Maintainer: imil

Elasticsearch is a distributed RESTful search engine built for the cloud.
Features include:

* Distributed and Highly Available Search Engine.
* Multi Tenant with Multi Types.
* Various set of APIs
* Document oriented
* Reliable, Asynchronous Write Behind for long term persistency.
* (Near) Real Time Search.
* Built on top of Lucene
* Per operation consistency
* Open Source under Apache 2 License.


Required to run:
[shells/bash] [lang/openjdk8]

Required to build:
[pkgtools/cwrappers]

Master sites:

SHA1: d5e4b61038f2cc3ec7ae5cbecf3406c7ecc7a1c4
RMD160: 7aa1ea3643ba036f216d9e2e2ade85ed7f9cf15a
Filesize: 32982.896 KB

Version history: (Expand)


CVS history: (Expand)


   2017-10-17 13:27:05 by Filip Hajny | Files touched by this commit (2) | Package updated
Log message:
Update databases/elasticsearch to 5.6.3.

=== Enhancements

Network::
* Add additional low-level logging handler
* Unwrap exception causes when checking if  dying

=== Bug fixes

Aggregations::
* Fix IndexOutOfBoundsException in histograms for NaN doubles

Core::
* MetaData Builder doesn't properly prevent an alias with the same
* name as an index

Packaging::
* Fix default paths for Windows service

Plugin Repository Azure::
* Use Azure upload method instead of our own implementation

Search::
* Fix serialization errors when cross cluster search goes to a single
* shard
   2017-09-27 14:33:36 by Filip Hajny | Files touched by this commit (3) | Package updated
Log message:
Update databases/elasticsearch to 5.6.2.

== 5.6.2 Release Notes

=== Bug fixes

Aggregations::
- Do not delegate a null scorer to LeafBucketCollectors

Inner Hits::
- Do not allow inner hits that fetch _source and have a non nested
  object field as parent

Internal::
- Catch exceptions and inform handler in
  RemoteClusterConnection#collectNodes

Java API::
- BulkProcessor flush runnable preserves the thread context from
  creation time

Java High Level REST Client::
- Make RestHighLevelClient's Request class public

Plugin Analysis Kuromoji::
- Fix kuromoji default stoptags

Plugin Repository HDFS::
- Fix permission errors when using Read Only HDFS Repository

Query DSL::
-  Fixed incomplete JSON body on count request making
   org.elasticsearch.rest.action.RestActions#parseTopLevelQueryBuilder
   go into endless loop

Scripting::
- Add missing script contexts and types allowed settings

Upgrade API::
- Upgrade API: fix excessive logging and unnecessary template updates

=== Upgrades

Logging::
- Upgrade to Log4j 2.9.1

== 5.6.1 Release Notes

=== Bug fixes

Highlighting::
- Fix percolator highlight sub fetch phase to not highlight query twice

Mapping::
- Fix unmapped_type creation for indices created in 2.x

Similarities::
- Add boolean similarity to built in similarity types

=== Upgrades

Core::
- Upgrade to Lucene-6.6.1.

== 5.6.0 Release Notes

=== Breaking Java changes

Java High Level REST Client::
- Allow RestHighLevelClient to use plugins

Java REST Client::
- Rename client artifacts

=== Deprecations

Highlighting::
- Postings highlighter deprecation

Indexed Scripts/Templates::
- Scripting: Deprecate stored search template apis

Mapping::
- Add deprecation logging when _all is enabled

Query DSL::
- Deprecate omitting terms lookup index name in 5.6

Scripting::
- Scripting: Deprecate scripts.max_compilation_per_minute setting
- Scripting: Change keys for inline/stored scripts to source/id

Tribe Node::
- Deprecate tribe service

=== New features

Java High Level REST Client::
- Backport high level REST client

Parent/Child::
- Typeless parent child backport
- Move parent_id query to the parent-join module
- Introduce ParentJoinFieldMapper, a field mapper that creates
  parent/child relation within documents of the same index

Upgrade API::
- TemplateUpgraders should be called during rolling restart

=== Enhancements

Allocation::
- Adjust status on bad allocation explain requests
- Promote replica on the highest version node

Analysis::
- [analysis-icu] Allow setting unicodeSetFilter

CAT API::
- expand `/_cat/nodes` to return information about hard drive

Cluster::
- Validate a joining node's version with version of existing cluster
  nodes

Core::
- Add max file size bootstrap check
- Explicitly reject duplicate data paths

Highlighting::
- Picks offset source for the unified highlighter directly from the es
  mapping

Index APIs::
- Create index request should return the index name

Ingest::
- Add Ingest-Processor specific Rest Endpoints & Add Grok endpoint
- Port support for commercial GeoIP2 databases from Logstash.
- Allow removing multiple fields in ingest processor
- Add target_field parameter to ingest processors

Internal::
- Use holder pattern for lazy deprecation loggers
- "shard started" should show index and shard ID
- Break out clear scroll logic from TransportClearScrollAction
- Add helper methods to TransportActionProxy to identify proxy actions
  and requests
- Add remote cluster infrastructure to fetch discovery nodes.
- Disallow multiple parent-join fields per mapping

Java High Level REST Client::
- [DOCS] restructure java clients docs pages
- Use SPI in High Level Rest Client to load XContent parsers

Java REST Client::
- Shade external dependencies in the rest client jar
- RestClient uses system properties and system default SSLContext

Logging::
- Use LRU set to reduce repeat deprecation messages

Mapping::
- Optimize `terms` queries on `ip` addresses to use a `PointInSetQuery`
  whenever possible.

Network::
- Simplify connection closing and cleanups in TcpTransport

Packaging::
- Remove memlock suggestion from systemd service
- Set address space limit in systemd service file

Parent/Child::
- Remove ParentJoinFieldSubFetchPhase
- Support parent id being specified as number in the _source

Query DSL::
- Make slop optional when parsing `span_near` query

Search::
- Reduce the overhead of timeouts and low-level search cancellation.
- Reduce profiling overhead.
- Backport `can_match` endpoint to 5.6 to allow 6.0 to use the
  optimization in mixed version
- Add a shard filter search phase to pre-filter shards based on query
  rewriting
- Ensure we rewrite common queries to `match_none` if possible
- Limit the number of concurrent shard requests per search request
- Add cluster name validation to RemoteClusterConnection
- Leverage scorerSupplier when applicable.
- Add Cross Cluster Search support for scroll searches

Sequence IDs::
- 5.x - Move primary term from ReplicationRequest to
  ConcreteShardRequest
- Forward compatibility for primary context handoff on 6.x

Settings::
- Emit settings deprecation logging at most once
- IndexMetaData: Introduce internal format index setting

Snapshot/Restore::
- Improves snapshot logging and snapshot deletion error handling

Stats::
- Update `IndexShard#refreshMetric` via a
  `ReferenceManager.RefreshListener`

=== Bug fixes

Aggregations::
- Fixes array out of bounds for value count agg

Aliases::
- mget with an alias shouldn't ignore alias routing

Allocation::
- Allow wildcards for shard IP filtering

Analysis::
- Pre-configured shingle filter should disable graph analysis

CRUD::
- Serialize and expose timeout of acknowledged requests in REST layer
  (ES 5.6)

Cluster::
- Register setting `cluster.indices.tombstones.size`

Core::
- Release operation permit on thread-pool rejection
- Node should start up despite of a lingering `.es_temp_file`

Discovery::
- MasterNodeChangePredicate should use the node instance to detect
  master change

Engine::
- Engine - Do not store operations that are not index into lucene in the
  translog (5.x only)

Geo::
- Fix GeoPoint FieldStats ternary logic bug

Highlighting::
- Fix nested query highlighting
- FastVectorHighlighter should not cache the field query globally

Index APIs::
- Shrink API should ignore templates
- Rollover max docs should only count primaries

Ingest::
- Sort Processor does not have proper behavior with targetField

Inner Hits::
- Fix inner hits to work with queries wrapped in an indices query
- When fetching nested inner hits only access stored fields when needed

Internal::
- Fix BytesReferenceStreamInput#skip with offset
- Fix race condition in RemoteClusterConnection node supplier
- Initialise empty lists in BaseTaskResponse constructor

Java High Level REST Client::
- Register ip_range aggregation with the high level client
- add top hits as a parsed aggregation to the rest high level client

Logging::
- Lazy initialize deprecation logger in parser
- Allow not configure logging without config
- Declare XContent deprecation logger as static

Mapping::
- ICUCollationKeywordFieldMapper use SortedSetDocValuesField
- Fixed bug that mapper_parsing_exception is thrown for numeric field
  with ignore_malformed=true when inserting "NaN"
- Coerce decimal strings for whole number types by truncating the
  decimal part
- Fix parsing of ip range queries.
- Remove `fielddata:false` from mappings of non-analyzed strings.
- Disable date field mapping changing
- token_count datatype should handle null value
- keep _parent field while updating child type mapping

Nested Docs::
- In case of a single type the _id field should be added to the nested
  document instead of _uid field

Network::
- Release pipelined http responses on close
- Ensure pending transport handlers are invoked for all channel failures

Packaging::
- setgid on /etc/elasticearch on package install
- Stop disabling explicit GC
- Avoid failing install if system-sysctl is masked
- Get short path name for native controllers
- When stopping via systemd only kill the JVM, not its control group

Parent/Child::
- The default _parent field should not try to load global ordinals

Plugin Lang Painless::
- Painless: allow doubles to be casted to longs.

Plugin Repository HDFS::
- Upgrading HDFS Repository Plugin to use HDFS 2.8.1 Client

Query DSL::
- Parse "*" in query_string_query as MatchAllDocsQuery
- SpanNearQueryBuilder should return the inner clause when a single
  clause is provided
- WrapperQueryBuilder should also rewrite the parsed query

REST::
- Fix handling of exceptions thrown on HEAD requests

Search::
- Fix term(s) query for range field
- Caching a MinDocQuery can lead to wrong results.
- First increment shard stats before notifying and potentially sending
  response
- Remove assertion about deviation when casting to a float.
- Prevent skipping shards if a suggest builder is present
- Ensure remote cluster alias is preserved in inner hits aggs
- Do not search locally if remote index pattern resolves to no indices

Settings::
- Fix settings serialization to not serialize secure settings or not
  take the total size into account
- Keystore CLI should use the AddFileKeyStoreCommand for files

Snapshot/Restore::
- Snapshot/Restore: fix NPE while handling null failure reasons
- Snapshot/Restore: Ensure that shard failure reasons are correctly
  stored in CS
- Output all empty snapshot info fields if in verbose mode

Stats::
- _nodes/stats should not fail due to concurrent AlreadyClosedException

Suggesters::
- Context suggester should filter doc values field

=== Upgrades

Network::
- Upgrade to Netty 4.1.13.Final

Upgrade API::
- Improve stability and logging of TemplateUpgradeServiceIT tests

== 5.5.3 Release Notes

=== Deprecations

Mapping::
- Add deprecation logging when _all is enabled

=== Bug fixes

Packaging::
- setgid on /etc/elasticearch on package install
   2017-08-18 11:03:08 by Filip Hajny | Files touched by this commit (3) | Package updated
Log message:
elasticsearch 5.5.2
======================================================================

=== Bug fixes

Aggregations::
- Fixes array out of bounds for value count agg

Core::
- Release operation permit on thread-pool rejection

Inner Hits::
- Fix inner hits to work with queries wrapped in an indices query
- When fetching nested inner hits only access stored fields when needed

Logging::
- Declare XContent deprecation logger as static

Query DSL::
- Parse "*" in query_string_query as MatchAllDocsQuery

elasticsearch 5.5.1
======================================================================

=== Bug fixes

Aliases::
- mget with an alias shouldn't ignore alias routing

Engine::
- Engine - Do not store operations that are not index into lucene in the
  translog (5.x only)

Internal::
- Fix BytesReferenceStreamInput#skip with offset

Packaging::
- Stop disabling explicit GC
- Avoid failing install if system-sysctl is masked
- Get short path name for native controllers

Query DSL::
- WrapperQueryBuilder should also rewrite the parsed query

elasticsearch 5.5.0
======================================================================

=== Breaking changes

Plugins::
- Remove hidden file leniency from spawner

Settings::
- Remove support for default settings

=== Breaking Java changes

Aggregations::
- Remove the unused SignificantTerms.compareTerm() method
- Make SignificantTerms.Bucket an interface rather than an abstract
  class
- Make Terms.Bucket an interface rather than an abstract class

Plugin Delete By Query::
- Move DeleteByQuery and Reindex requests into core

=== Deprecations

Index APIs::
- Deprecated use of + in index expressions

Packaging::
- Add deprecation warnings for $ES_USER and $ES_GROUP

Plugin Repository S3::
- S3 Repository: Deprecate remaining `repositories.s3.*` settings

REST::
- Add deprecation logging for comma-separated feature parsing

Scripting::
- Scripting: Deprecate native scripts
- Scripting: Deprecate index lookup
- Deprecate Fine Grain Settings for Scripts
- Scripting: Deprecate file script settings
- Scripting: Deprecate file scripts

Settings::
- Settings: Update settings deprecation from yml to yaml
- Deprecate settings in .yml and .json

Tribe Node::
- Deprecate tribe service

=== New features

Mapping::
- Add new ip_range field type

Plugin Analysis ICU::
- Add ICUCollationFieldMapper

=== Enhancements

Aggregations::
- Add superset size to Significant Term REST response
- Add document count to Matrix Stats aggregation response
-  Share XContent rendering code in significant terms aggregations
- Add `count` to rest output of `geo_centroid`
- Allow scripted metric agg to access `_score`

Aliases::
- Handle multiple aliases in _cat/aliases api

Circuit Breakers::
- Closing a ReleasableBytesStreamOutput closes the underlying BigArray

Cluster::
- Add a cluster block that allows to delete indices that are read-only
- Extract a common base class to allow services to listen to remote
  cluster config updates

Core::
- Explicitly reject duplicate data paths
- Use SPI in High Level Rest Client to load XContent parsers
- Improve bootstrap checks error messages
- Regex upgrades
- Detect remnants of path.data/default.path.data bug

Engine::
- Add refresh stats tracking for realtime get
- Engine: store maxUnsafeAutoIdTimestamp in commit

Exceptions::
- IllegalStateException: Only duplicated jar instead of classpath

Index APIs::
- Open and close index to honour allow_no_indices option

Ingest::
- add `exclude_keys` option to KeyValueProcessor

Inner Hits::
- Reuse inner hit query weight

Internal::
- "shard started" should show index and shard ID
- Add the ability to set eager_global_ordinals in the new parent-join
  field
- Add assertions enabled helper
- Add cross cluster support to `_field_caps`
- Log JVM arguments on startup
- Preserve cluster alias throughout search execution to lookup nodes by
  cluster and ID
- Move RemoteClusterService into TransportService
- Enum related performance additions.

Java API::
- Always Accumulate Transport Exceptions

Java High Level REST Client::
- Add doc_count to ParsedMatrixStats
- Add fromXContent method to ClearScrollResponse
- ClearScrollRequest to implement ToXContentObject
- SearchScrollRequest to implement ToXContentObject
- Backport aggs parsers for high level REST Client
- Add utility method to parse named XContent objects with typed prefix

Logging::
- Warn on not enough masters during election

Mapping::
- Do not index `_type` when there is at most one type.
- Only allow one type on 6.0 indices
- token_count type : add an option to count tokens (fix #23227)

Network::
- Disable the Netty recycler in the client
- Remove Netty logging hack
- Set available processors for Netty

Packaging::
- Set number of processes in systemd unit file

Plugin Lang Painless::
- Optimize instance creation in LambdaBootstrap
- Allow painless to load stored fields

Plugin Repository GCS::
- GCS Repository: Add secure storage of credentials

Plugins::
- Add purge option to remove plugin CLI
- Move ReindexAction class to core
- Plugins: Add support for platform specific plugins

REST::
- Make ObjectParser support string to boolean conversion
- Allow passing single scrollID in clear scroll API body

Scripting::
- Add Ability to Specify No Types/Contexts Allowed For Scripts
- Add New Security Script Settings

Search::
- Eliminate array access in tight loops when profiling is enabled.
- Support Multiple Inner Hits on a Field Collapse Request
- Expand cross cluster search indices for search requests to the
  concrete index or to it's aliases
- Remove leniency when merging fetched hits in a search response phase

Search Templates::
- Add max concurrent searches to multi template search

Settings::
- Emit settings deprecation logging at most once

Snapshot/Restore::
- Improves snapshot logging and snapshot deletion error handling
- Enhances get snapshots API to allow retrieving repository index only
- Ensure every repository has an incompatible-snapshots blob
- Change snapshot status error to use generic SnapshotException

Stats::
- Show JVM arguments

Suggesters::
- Provide informative error message in case of unknown suggestion
  context.
- Allow different data types for category in Context suggester

Upgrade API::
- Allow plugins to upgrade templates and index metadata on startup

=== Bug fixes

Aggregations::
- Terms aggregation should remap global ordinal buckets when a
  sub-aggregator is used to sort the terms
- Correctly set doc_count when MovAvg "predicts" values on existing
  buckets
- InternalPercentilesBucket should not rely on ordered percents array
- Align behavior HDR percentiles iterator with percentile() method
- DateHistogram: Fix `extended_bounds` with `offset`
- Fix ArrayIndexOutOfBoundsException when no ranges are specified in the
  query

Aliases::
- GET aliases should 404 if aliases are missing

Allocation::
- Discard stale node responses from async shard fetching

Analysis::
- PatternAnalyzer should lowercase wildcard queries when `lowercase` is
  true.

Bulk::
- Reject empty IDs

Cache::
- fix bug of weight computation

Circuit Breakers::
- Checks the circuit breaker before allocating bytes for a new big array

Core::
- Fix cache expire after access
- Check for default.path.data included in path.data

Geo::
- Fix GeoPoint FieldStats ternary logic bug
- Fix GeoDistance Ordinal for BWC

Highlighting::
- Higlighters: Fix MultiPhrasePrefixQuery rewriting

Index APIs::
- Rollover max docs should only count primaries
- Fix legacy GeoPointField decoding in FieldStats
- Validates updated settings on closed indices
- Fixes restore of a shrunken index when initial recovery node is gone

Ingest::
- fix grok's pattern parsing to validate pattern names in expression
- Fix floating-point error when DateProcessor parses UNIX
- add option for _ingest.timestamp to use new ZonedDateTime (5.x
  backport)

Inner Hits::
- Fix Source filtering in new field collapsing feature

Internal::
- Fix race condition in RemoteClusterConnection node supplier
- Initialise empty lists in BaseTaskResponse constructor
- Extract a common base class for scroll executions
- Ensure remote cluster is connected before fetching `_field_caps`
- Obey lock order if working with store to get metadata snapshots
- Remove `_UNRELEASED` from Version constants for released versions
- Fix `_field_caps` serialization in order to support cross cluster
  search
- Avoid race when shutting down controller processes
- Fix NPE if field caps request has a field that exists not in all
  indices

More Like This::
- Pass over _routing value with more_like_this items to be retrieved

Nested Docs::
- In case of a single type the _id field should be added to the nested
  document instead of _uid field

Network::
- Ensure pending transport handlers are invoked for all channel failures
- Notify onConnectionClosed rather than onNodeDisconnect to prune
  transport handlers
- SniffNodesSampler should close connection after handling responses

Packaging::
- When stopping via systemd only kill the JVM, not its control group
- Handle parentheses in batch file path

Percolator::
- Fix range queries with date range based on current time in percolator
  queries.
- For legacy indices rewrite percolator query upon percolation time
- Fix memory leak when percolator uses bitset or field data cache

Plugin Lang Painless::
- painless: Fix method references to ctor with the new LambdaBootstrap
  and cleanup code
- Fix Painless Lambdas for Java 9

Plugins::
- X-Pack plugin download fails on Windows desktop
- Fix plugin installation permissions
- Fix delete of plugin directory on remove plugin
- Use a marker file when removing a plugin
- Remove hidden file leniency from plugin service

Query DSL::
- Thread falls into infinite loop when processing Indices query

REST::
- Fix handling of exceptions thrown on HEAD requests
- Fixed NPEs caused by requests without content.
- Fix get mappings HEAD requests

Recovery::
- Provide target allocation id as part of start recovery request

Reindex API::
- Reindex: don't duplicate _source parameter
- Add qa module that tests reindex-from-remote against pre-5.0 versions
  of Elasticsearch

Scroll::
- Fix single shard scroll within a cluster with nodes in version `>=
  5.3` and `<= 5.3`

Search::
- Adds check for negative search request size
- Do not search locally if remote index pattern resolves to no indices
- Make sure range queries are correctly profiled.
- Compute the took time of the query after the expand phase of field
  collapsing
- Fix RangeFieldMapper rangeQuery to properly handle relations
- Fix ExpandSearchPhase when response contains no hits
- Include all aliases including non-filtering in  `_search_shards`
  response
- Cross Cluster Search: propagate original indices per cluster

Search Templates::
- No longer add illegal content type option to stored search templates

Settings::
- Keystore CLI should use the AddFileKeyStoreCommand for files
- Settings: Fix setting groups to include secure settings
- Allow resetting settings that use an IP validator
- Do not set path.data in environment if not set

Snapshot/Restore::
- Output all empty snapshot info fields if in verbose mode
- Remove redundant and broken MD5 checksum from repository-s3
- Consolidates the logic for cleaning up snapshots on master election
- Removes completed snapshot from cluster state on master change
- Fix inefficient (worst case exponential) loading of snapshot
  repository
- Fixes maintaining the shards a snapshot is waiting on

Stats::
- _nodes/stats should not fail due to concurrent AlreadyClosedException
- Avoid double decrement on current query counter

Suggesters::
- Fix context suggester to read values from keyword type field

Task Manager::
- Task Management: Make TaskInfo parsing forwards compatible

=== Regressions

Highlighting::
- Fix Fast Vector Highlighter NPE on match phrase prefix

=== Upgrades

Core::
- Upgrade to Lucene 6.5.1

Network::
- Upgrade to Netty 4.1.11.Final
- Upgrade Netty to 4.1.10.Final
   2017-07-04 16:19:48 by Filip Hajny | Files touched by this commit (2) | Package updated
Log message:
Update databases/elasticsearch to 5.4.3.

Snapshot/Restore::
* Improves snapshot logging and snapshot deletion error handling

Snapshot/Restore::
* Remove redundant and broken MD5 checksum from repository-s3
   2017-06-21 15:35:52 by Filip Hajny | Files touched by this commit (2) | Package updated
Log message:
Update databases/elasticsearch to 5.4.2

=== Enhancements

Core::
* Explicitly reject duplicate data paths

Packaging::
* Set number of processes in systemd unit file

=== Bug fixes

Aggregations::
* Terms aggregation should remap global ordinal buckets when a
* sub-aggregator is used to sort the terms

Analysis::
* PatternAnalyzer should lowercase wildcard queries when `lowercase`
* is true.

Circuit Breakers::
* Checks the circuit breaker before allocating bytes for a new big
* array

Geo::
* Fix GeoPoint FieldStats ternary logic bug
* Fix GeoDistance Ordinal for BWC

Index APIs::
* Rollover max docs should only count primaries

Nested Docs::
* Fix the `max` score mode.

Network::
* Ensure pending transport handlers are invoked for all channel
* failures

Packaging::
* When stopping via systemd only kill the JVM, not its control group

Suggesters::
* Fix context suggester to read values from keyword type field
   2017-06-14 15:49:35 by Filip Hajny | Files touched by this commit (3) | Package updated
Log message:
Update databases/elasticsearch to 5.4.1.

=== Enhancements

Aggregations::
- Allow scripted metric agg to access `_score`

Core::
- Improve bootstrap checks error messages

Internal::
- Log JVM arguments on startup

Network::
- Disable the Netty recycler in the client
- Remove Netty logging hack
- Set available processors for Netty

Snapshot/Restore::
- Ensure every repository has an incompatible-snapshots blob

Stats::
- Show JVM arguments

=== Bug fixes

Aggregations::
- Fix ArrayIndexOutOfBoundsException when no ranges are specified in
  the query

Allocation::
- Discard stale node responses from async shard fetching

Core::
- Fix cache expire after access

Index APIs::
- Fix legacy GeoPointField decoding in FieldStats
- Validates updated settings on closed indices

Internal::
- Remove `_UNRELEASED` from Version constants for released versions
- Avoid race when shutting down controller processes
- Fix NPE if field caps request has a field that exists not in all
  indices

More Like This::
- Pass over _routing value with more_like_this items to be retrieved

Network::
- Notify onConnectionClosed rather than onNodeDisconnect to prune
  transport handlers
- SniffNodesSampler should close connection after handling responses

Packaging::
- Handle parentheses in batch file path

Percolator::
- Fix range queries with date range based on current time in
  percolator queries.

Plugin Repository HDFS::
- Fixing permission errors for `KERBEROS` security mode for HDFS
  Repository

Plugins::
- X-Pack plugin download fails on Windows desktop [ISSUE]
- Fix plugin installation permissions

Reindex API::
- Reindex: don't duplicate _source parameter
- Add qa module that tests reindex-from-remote against pre-5.0
  versions of Elasticsearch

Scroll::
- Fix single shard scroll within a cluster with nodes in version `>=
  5.3` and `<= 5.3`

Search::
- Fix ExpandSearchPhase when response contains no hits
- Include all aliases including non-filtering in  `_search_shards`
  response

Settings::
- Allow resetting settings that use an IP validator

Snapshot/Restore::
- Removes completed snapshot from cluster state on master change
- Fix inefficient (worst case exponential) loading of snapshot
  repository

=== Upgrades

Core::
- Upgrade to Lucene 6.5.1

Network::
- Upgrade to Netty 4.1.11.Final
- Upgrade Netty to 4.1.10.Final
   2017-05-11 10:36:30 by Filip Hajny | Files touched by this commit (3) | Package updated
Log message:
Update databases/elasticsearch to 5.4.0.

=== Breaking changes

Settings::
- Remove support for default settings

=== Breaking Java changes

Aggregations::
- Move getProperty method out of MultiBucketsAggregation.Bucket
  interface
- Remove getProperty method from Aggregations interface and impl
- Move getProperty method out of Aggregation interface

Java API::
- Fold InternalSearchHits and friends into their interfaces

=== Deprecations

Aggregations::
- Deprecate Stats#getCountAsString

Java API::
- Add BulkProcessor methods with XContentType parameter

Network::
- Deprecate Netty 3

Packaging::
- Add deprecation warnings for $ES_USER and $ES_GROUP

Plugin Delete By Query::
- Deprecate delete_by_query requests without an explicit query

Plugin Repository Azure::
- Deprecate global `repositories.azure` settings

Plugin Repository S3::
- Deprecate repositories.s3 settings

REST::
- Deprecate ldjson support and document ndjson for bulk/msearch

Stats::
- Deprecate `_field_stats` endpoint

=== New features

Analysis::
- Adds pattern keyword marker filter support
- Expose WordDelimiterGraphTokenFilter

Index APIs::
- Add FieldCapabilities (`_field_caps`) API

Search::
- Introduce incremental reduction of TopDocs

Similarities::
- Adds boolean similarity to Elasticsearch

=== Enhancements

Aggregations::
- Add BucketMetricValue interface
- Move aggs CommonFields and TYPED_KEYS_DELIMITER from
  InternalAggregation to Aggregation
- Use ParseField for aggs CommonFields rather than String
- Share XContent rendering code in terms aggs
- Add unit tests for ParentToChildAggregator
- First step towards incremental reduction of query responses

Allocation::
- Trigger replica recovery restarts by master when primary relocation
  completes
- Makes the same_shard host dynamically updatable

Analysis::
- Support Keyword type in Analyze API

Cluster::
- Prevent nodes from joining if newer indices exist in the cluster

Core::
- Detect remnants of path.data/default.path.data bug
- Await termination after shutting down executors
- Add early-access check
- Adapter action future should restore interrupts
- Disable bootstrap checks for single-node discovery
- Enable explicitly enforcing bootstrap checks
- Add equals/hashcode method to ReplicationResponse

Dates::
- Improve error handling for epoch format parser with time zone
  (#22621)

Discovery::
- Introduce single-node discovery
- UnicastZenPing shouldn't ping the address of the local node
- MasterFaultDetection can start after the initial cluster state has
  been processed

Highlighting::
- Add support for fragment_length in the unified highlighter
- Add BreakIteratorBoundaryScanner support

Index APIs::
- Wildcard cluster names for cross cluster search

Ingest::
- Lazy load the geoip databases

Internal::
- Add a dedicated TransportRemoteInfoAction for consistency
- Simplify sorted top docs merging in SearchPhaseController
- Synchronized CollapseTopFieldDocs with lucenes relatives
- Cleanup SearchPhaseController interface
- Do not create String instances in 'Strings' methods accepting
  StringBuilder

Java API::
- Added types options to DeleteByQueryRequest

Java High Level REST Client::
- Convert suggestion response parsing to use NamedXContentRegistry
- UpdateRequest implements ToXContent
- Add javadoc for DocWriteResponse.Builders
- Expose WriteRequest.RefreshPolicy string representation
- Use `typed_keys` parameter to prefix suggester names by type in
  search responses
- Add parsing methods to BulkItemResponse

Logging::
- Warn on not enough masters during election

Mapping::
- Improve error message for ipv6 on legacy ip fields

Nested Docs::
- Avoid adding unnecessary nested filters when ranges are used.

Network::
- Adjust default Netty receive predictor size to 64k
- Keep the pipeline handler queue small initially
- Set network receive predictor size to 32kb
- TransportService.connectToNode should validate remote node ID

Packaging::
- Introduce Java version check
- Cleanup some things after removal of joda-time hack

Percolator::
- Allowing range queries with now ranges inside percolator queries
- Add term extraction support for MultiPhraseQuery

Plugin Discovery EC2::
- Settings: Migrate ec2 discovery sensitive settings to elasticsearch
  keystore

Plugin Lang Painless::
- Allow painless to load stored fields
- Start on custom whitelists for Painless
- Fix Painless's implementation of interfaces returning primitives
- Allow painless to implement more interfaces

Plugin Repository Azure::
- Add Backoff policy to azure repository

Plugin Repository S3::
- Removes the retry mechanism from the S3 blob store
- S3 Repository: Eagerly load static settings

Plugins::
- Modify permissions dialog for plugins
- Plugins: Add plugin cli specific exit codes
- Plugins: Output better error message when existing plugin is
  incompatible

Query DSL::
- Make it possible to validate a query on all shards instead of a
  single random shard

REST::
- Validate top-level keys when parsing mget requests
- Cluster stats should not render empty http/transport types
- Add parameter to prefix aggs name with type in search responses

Search::
- Set shard count limit to unlimited
- Streamline shard index availability in all SearchPhaseResults
- Search took time should use a relative clock
- Prevent negative `from` parameter in SearchSourceBuilder
- Remove unnecessary result sorting in SearchPhaseController
- Expose `batched_reduce_size` via `_search`
- Adding fromXContent to Suggest and Suggestion class
- Adding fromXContent to Suggestion.Entry and subclasses
- Add CollapseSearchPhase as a successor for the FetchSearchPhase
- Integrate IndexOrDocValuesQuery.
- Detach SearchPhases from AbstractSearchAsyncAction
- Fix GraphQuery expectation after Lucene upgrade to 6.5
- Nested queries should avoid adding unnecessary filters when
  possible.
- Add xcontent parsing to completion suggestion option
- Add xcontent parsing to suggestion options
- Separate reduce (aggs, suggest and profile) from merging fetched
  hits

Settings::
- Add secure file setting to keystore
- Add a setting which specifies a list of setting
- Add a property to mark setting as final
- Remove obsolete index setting `index.version.minimum_compatible`.
- Provide a method to retrieve a closeable char[] from a SecureString
- Update indices settings api to support CBOR and SMILE format
- Improve setting deprecation message

Snapshot/Restore::
- Change snapshot status error to use generic SnapshotException

Stats::
- Add cross-cluster search remote cluster info API

Task Manager::
- Allow task to be unregistered by ClusterStateApplier
- Limit IndexRequest toString() length

=== Bug fixes

Aggregations::
- Align behavior HDR percentiles iterator with percentile() method
- The `filter` and `significant_terms` aggregations should parse the
  `filter` as a filter, not a query.
- Completion suggestion should also consider text if prefix/regex is
  missing
- Fixes the per term error in the terms aggregation
- Fixes terms error count for multiple reduce phases
- Restore support for the `include/pattern` syntax.

Bulk::
- Reject empty IDs

CRUD::
- Fix backport executing ops as single item bulk

Cluster::
- Don't set local node on cluster state used for node join validation
- Allow a cluster state applier to create an observer and wait for a
  better state
- Cluster allocation explain to never return empty response body

Core::
- Check for default.path.data included in path.data
- Improve performance of extracting warning value
- Reject duplicate settings on the command line
- Restrict build info loading to ES jar, not any jar

Discovery::
- ZenDiscovery - only validate min_master_nodes values if local node
  is master

Index APIs::
- Fixes restore of a shrunken index when initial recovery node is gone
- Honor update request timeout

Ingest::
- Improve missing ingest processor error
- update _ingest.timestamp to use new ZonedDateTime

Inner Hits::
- Replace NestedChildrenQuery with ParentChildrenBlockJoinQuery
- Changed DisMaxQueryBuilder to extract inner hits from leaf queries

Internal::
- Add infrastructure to mark contexts as system contexts
- Always restore the ThreadContext for operations delayed due to a
  block

Java High Level REST Client::
- Correctly parse BulkItemResponse.Failure's status

Java REST Client::
- Make buffer limit configurable in HeapBufferedConsumerFactory
- RestClient asynchronous execution should not throw exceptions

Mapping::
- Preserve response headers when creating an index
- Improves disabled fielddata error message
- Switch include_in_all in multifield to warning
- Fix MapperService StackOverflowError
- Fix NPE with scaled floats stats when field is not indexed

Network::
- Fix possible hang in local transport when nodes get concurrently
  disconnected
- Respect promises on pipelined responses
- Ensure that releasing listener is called

Packaging::
- Fall back to non-atomic move when removing plugins

Percolator::
- Fix memory leak when percolator uses bitset or field data cache

Plugin Ingest Attachment::
- Remove support for Visio and potm files

Plugin Lang Painless::
- Fix painless's regex lexer and error messages
- Replace Painless's Cast with casting strategies
- Fix Bad Casts In Painless

Plugin Repository Azure::
- Azure blob store's readBlob() method first checks if the blob exists

Plugin Repository S3::
- Handle BlobPath's trailing separator case. Add test cases to
  BlobPathTests.java

Plugins::
- Fix delete of plugin directory on remove plugin
- Use a marker file when removing a plugin

Query DSL::
- FuzzyQueryBuilder should error when parsing array of values

REST::
- [API] change wait_for_completion default according to docs
- Deprecate request_cache for clear-cache
- HTTP transport stashes the ThreadContext instead of the
  RestController
- Ensure we try to autodetect content type for handlers that support
  plain text
- Fix date format in warning headers
- Align REST specs for HEAD requests
- Correct warning header to be compliant
- Fix get HEAD requests
- Fix search scroll request with a plain text body
- Handle bad HTTP requests
- Fix get source HEAD requests
- Properly encode location header
- Fix template HEAD requests
- Fix index HEAD requests
- Fix alias HEAD requests

Recovery::
- Provide target allocation id as part of start recovery request

Reindex API::
- Fix throttled reindex_from_remote
- Fix reindex with a remote source on a version before 2.0.0
- Make reindex wait for cleanup before responding

Scripting::
- Remove unnecessary Groovy deprecation logging
- Convert script/template objects to json format internally
- Script: Fix value of `ctx._now` to be current epoch time in
  milliseconds

Search::
- Cross Cluster Search: propagate original indices per cluster
- Query string default field
- Speed up parsing of large `terms` queries.
- IndicesQueryCache should delegate the scorerSupplier method.
- Fork LRUQueryCache from Lucene to work around LUCENE-7749
- Disable graph analysis at query time for shingle and cjk filters
  producing tokens of different size
- Fix cross-cluster remote node gateway attributes
- Use a fixed seed for computing term hashCode in TermsSliceQuery
- Honor max concurrent searches in multi-search
- Avoid stack overflow in multi-search
- Fix query_string_query to transform "foo:*" in an exists query on
  the field name
- Factor out filling of TopDocs in SearchPhaseController
- Replace blocking calls in ExpandCollapseSearchResponseListener by
  asynchronous requests

Search Templates::
- No longer add illegal content type option to stored search templates

Settings::
- Do not set path.data in environment if not set
- Correct handling of default and array settings
- Fix merge scheduler config settings
- Settings: Fix keystore cli prompting for yes/no to handle console
  returning null

Similarities::
- Fix similarity upgrade when "default" similarity is overridden

Snapshot/Restore::
- Fixes maintaining the shards a snapshot is waiting on
- Fixes snapshot status on failed snapshots
- Fixes snapshot deletion handling on in-progress snapshot failure
- Prioritize listing index-N blobs over index.latest in reading
  snapshots

Stats::
- Avoid overflow when computing total FS stats
- Handle existence of cgroup version 2 hierarchy
- Handle long overflow when adding paths' totals
- Fix control group pattern
- Fix total disk bytes returning negative value

=== Regressions

Bulk::
- Fix _bulk response when it can't create an index

=== Upgrades

Aggregations::
- Upgrade HDRHistogram to 2.1.9

Core::
- Upgrade to Lucene 6.5.0
- Upgrade from JNA 4.2.2 to JNA 4.4.0
- Upgrade to lucene-6.5.0-snapshot-d00c5ca
- Upgrade to lucene-6.5.0-snapshot-f919485.

Logging::
- Upgrade to Log4j 2.8.2

Network::
- Upgrade to Netty 4.1.9
- Upgrade to Netty 4.1.8

Plugin Repository Azure::
- Update to Azure Storage 5.0.0
   2017-04-22 19:20:55 by Filip Hajny | Files touched by this commit (3) | Package updated
Log message:
Update databases/elasticsearch to 5.3.1

=== Breaking changes

Settings::
- Remove support for default settings

=== Enhancements

Core::
- Detect remnants of path.data/default.path.data bug

Network::
- Adjust default Netty receive predictor size to 64k

REST::
- Cluster stats should not render empty http/transport types

=== Bug fixes

Aggregations::
- The `filter` and `significant_terms` aggregations should parse the
  `filter` as a filter, not a query.
- Restore support for the `include/pattern` syntax.

Bulk::
- Reject empty IDs

Core::
- Improve performance of extracting warning value
- Restrict build info loading to ES jar, not any jar

Discovery::
- ZenDiscovery - only validate min_master_nodes values if local node
  is master

Index APIs::
- Honor update request timeout

Inner Hits::
- Replace `NestedChildrenQuery` with `ParentChildrenBlockJoinQuery`

Internal::
- Add infrastructure to mark contexts as system contexts

Java REST Client::
- Make buffer limit configurable in HeapBufferedConsumerFactory

Mapping::
- Preserve response headers when creating an index
- Fix NPE with scaled floats stats when field is not indexed

Network::
- Fix possible hang in local transport when nodes get concurrently
  disconnected

Plugin Repository Azure::
- Azure blob store's readBlob() method first checks if the blob exists

Reindex API::
- Fix reindex with a remote source on a version before 2.0.0

Search::
- Disable graph analysis at query time for shingle and cjk filters
  producing tokens of different size
- Fix cross-cluster remote node gateway attributes
- Use a fixed seed for computing term hashCode in TermsSliceQuery

Settings::
- Do not set path.data in environment if not set
- Correct handling of default and array settings

Stats::
- Handle existence of cgroup version 2 hierarchy

=== Upgrades

Internal::
- upgrade to Lucene 6.4.2