Solr-5.3.1

Lucene Change Log For more information on past and future Lucene versions, please see: http://s.apache.org/luceneversions ======================= Lucene 5.3.1 ======================= Bug Fixes * LUCENE-6774: Remove classloader hack in MorfologikFilter. (Robert Muir, Uwe Schindler) * LUCENE-6781: Fixed BoostingQuery to rewrite wrapped queries. (Adrien Grand) * LUCENE-6748: UsageTrackingQueryCachingPolicy no longer caches trivial queries like MatchAllDocsQuery. (Adrien Grand) Tests * LUCENE-6760, SOLR-7958: Move TestUtil#randomWhitespace to the only Solr test that is using it. The method is not useful for Lucene tests (and easily breaks, e.g., in Java 9 caused by Unicode version updates). (Uwe Schindler) ======================= Lucene 5.3.0 ======================= New Features * LUCENE-6485: Add CustomSeparatorBreakIterator to postings highlighter which splits on any character. For example, it can be used with getMultiValueSeparator render whole field values. (Luca Cavanna via Robert Muir) * LUCENE-6459: Add common suggest API that mirrors Lucene's Query/IndexSearcher APIs for Document based suggester. Adds PrefixCompletionQuery, RegexCompletionQuery, FuzzyCompletionQuery and ContextQuery. (Areek Zillur via Mike McCandless) * LUCENE-6487: Spatial Geo3D API now has a WGS84 ellipsoid world model option. (Karl Wright via David Smiley) * LUCENE-6477: Add experimental BKD geospatial tree doc values format and queries, for fast "bbox/polygon contains lat/lon points" (Mike McCandless) * LUCENE-6526: Asserting(Query|Weight|Scorer) now ensure scores are not computed if they are not needed. (Adrien Grand) * LUCENE-6481: Add GeoPointField, GeoPointInBBoxQuery, GeoPointInPolygonQuery for simple "indexed lat/lon point in bbox/shape" searching. (Nick Knize via Mike McCandless) * LUCENE-5954: The segments_N commit point now stores the Lucene version that wrote the commit as well as the lucene version that wrote the oldest segment in the index, for faster checking of "too old" indices (Ryan Ernst, Robert Muir, Mike McCandless) * LUCENE-6519: BKDPointInPolygonQuery is much faster by avoiding the per-hit polygon check when a leaf cell is fully contained by the polygon. (Nick Knize, Mike McCandless) * LUCENE-6549: Add preload option to MMapDirectory. (Robert Muir) * LUCENE-6504: Add Lucene53Codec, with norms implemented directly via the Directory's RandomAccessInput api. (Robert Muir) * LUCENE-6539: Add new DocValuesNumbersQuery, to match any document containing one of the specified long values. This change also moves the existing DocValuesTermsQuery and DocValuesRangeQuery to Lucene's sandbox module, since in general these queries are quite slow and are only fast in specific cases. (Adrien Grand, Robert Muir, Mike McCandless) * LUCENE-6577: Give earlier and better error message for invalid CRC. (Robert Muir) * LUCENE-6544: Geo3D: (1) Regularize path & polygon construction, (2) add PlanetModel.surfaceDistance() (ellipsoidal calculation), (3) cache lat & lon in GeoPoint, (4) add thread-safety where missing -- Geo3dShape. (Karl Wright, David Smiley) * LUCENE-6606: SegmentInfo.toString now confesses how the documents were sorted, when SortingMergePolicy was used (Christine Poerschke via Mike McCandless) * LUCENE-6524: IndexWriter can now be initialized from an already open near-real-time or non-NRT reader. (Boaz Leskes, Robert Muir, Mike McCandless) * LUCENE-6578: Geo3D can now compute the distance from a point to a shape, both inner distance and to an outside edge. Multiple distance algorithms are available. (Karl Wright, David Smiley) * LUCENE-6632: Geo3D: Compute circle planes more accurately. (Karl Wright via David Smiley) * LUCENE-6653: Added general purpose BytesTermAttribute to basic token attributes package that can be used for TokenStreams that solely produce binary terms. (Uwe Schindler) * LUCENE-6365: Add Operations.topoSort, to run topological sort of the states in an Automaton (Markus Heiden via Mike McCandless) * LUCENE-6365: Replace Operations.getFiniteStrings with a more scalable iterator API (FiniteStringsIterator) (Markus Heiden via Mike McCandless) * LUCENE-6589: Add a new org.apache.lucene.search.join.CheckJoinIndex class that can be used to validate that an index has an appropriate structure to run join queries. (Adrien Grand) * LUCENE-6659: Remove IndexWriter's unnecessary hard limit on max concurrency (Robert Muir, Mike McCandless) * LUCENE-6547: Add GeoPointDistanceQuery, matching all points within the specified distance from the center point. Fix GeoPointInBBoxQuery to handle dateline crossing. * LUCENE-6694: Add LithuanianAnalyzer and LithuanianStemmer. (Dainius Jocas via Robert Muir) * LUCENE-6695: Added a new BlendedTermQuery to blend statistics across several terms. (Simon Willnauer, Adrien Grand) * LUCENE-6706: Added a new PayloadScoreQuery that generalises the behaviour of PayloadTermQuery and PayloadNearQuery to all Span queries. (Alan Woodward) * LUCENE-6697: Add experimental range tree doc values format and queries, based on a 1D version of the spatial BKD tree, for a faster and smaller alternative to postings-based numeric and binary term filtering. Range trees can also handle values larger than 64 bits. (Adrien Grand, Mike McCandless) * LUCENE-6647: Add GeoHash string utility APIs (Nick Knize via Mike McCandless). * LUCENE-6710: GeoPointField now uses full 64 bits (up from 62) to encode lat/lon (Nick Knize via Mike McCandless). * LUCENE-6580: SpanNearQuery now allows defined-width gaps in its subqueries (Alan Woodward, Adrien Grand). * LUCENE-6712: Use doc values to post-filter GeoPointField hits that fall in boundary cells, resulting in smaller index, faster searches and less heap used for each query (Nick Knize via Mike McCandless). API Changes * LUCENE-6508: Simplify Lock api, there is now just Directory.obtainLock() which returns a Lock that can be released (or fails with exception). Add lock verification to IndexWriter. Improve exception messages when locking fails. (Uwe Schindler, Mike McCandless, Robert Muir) * LUCENE-6529: Removed an optimization in UninvertingReader that was causing incorrect results for Numeric fields using precisionStep (hossman, Robert Muir) * LUCENE-6551: Add missing ConcurrentMergeScheduler.getAutoIOThrottle getter (Simon Willnauer, Mike McCandless) * LUCENE-6552: Add MergePolicy.OneMerge.getMergeInfo and rename setInfo to setMergeInfo (Simon Willnauer, Mike McCandless) * LUCENE-6525: Deprecate IndexWriterConfig's writeLockTimeout. (Robert Muir) * LUCENE-6466: Moved SpanQuery.getSpans() and .extractTerms() to SpanWeight (Alan Woodward, Robert Muir) * LUCENE-6371, LUCENE-6490: Payload collection from Spans is moved to a more generic SpanCollector framework. Spans no longer implements .hasPayload() and .getPayload() methods, and instead exposes a collect() method that allows the collection of arbitrary postings information. SpanPayloadCheckQuery and SpanPayloadNearCheckQuery have moved from the .spans package to the .payloads package. (Alan Woodward, David Smiley, Paul Elschot, Robert Muir) * LUCENE-6583: FilteredQuery is deprecated and will be removed in 6.0. It should be replaced with a BooleanQuery which handle the query as a MUST clause and the filter as a FILTER clause. (Adrien Grand) * LUCENE-6553: The postings, spans and scorer APIs no longer take an acceptDocs parameter. Live docs are now always checked on top of these APIs. (Adrien Grand) * LUCENE-6634: PKIndexSplitter now takes a Query instead of a Filter to decide how to split an index. (Adrien Grand) * LUCENE-6643: GroupingSearch from lucene/grouping was changed to take a Query object to define groups instead of a Filter. (Adrien Grand) * LUCENE-6554: ToParentBlockJoinFieldComparator was removed because of a bug w