- SOLR-4245: When a core is registering with ZooKeeper, the timeout to find the
leader in the cluster state is 30 seconds rather than leaderVoteWait + extra
time.
(Mark Miller)
- SOLR-4238: Fix jetty example requestLog config
(jm via hossman)
- SOLR-4251: Fix SynonymFilterFactory when an optional tokenizerFactory is supplied.
(Chris Bleakley via rmuir)
- SOLR-4253: Misleading resource loading warning from Carrot2 clustering
component fixed
(Stanisław Osiński)
- SOLR-4257: PeerSync updates and Log Replay updates should not wait for
a ZooKeeper connection in order to proceed.
(yonik)
- SOLR-4045: SOLR admin page returns HTTP 404 on core names containing
a '.' (dot)
(steffkes)
- SOLR-4176: analysis ui: javascript not properly handling URL decoding
of input
(steffkes)
- SOLR-4079: Long core names break web gui appearance and functionality
(steffkes)
- SOLR-4263: Incorrect Link from Schema-Browser to Query From for Top-Terms
(steffkes)
- SOLR-3829: Admin UI Logging events broken if schema.xml defines a catch-all
dynamicField with type ignored
(steffkes)
- SOLR-4275: Fix TrieTokenizer to no longer throw StringIndexOutOfBoundsException
in admin UI / AnalysisRequestHandler when you enter no number to tokenize.
(Uwe Schindler)
- SOLR-4279: Wrong exception message if _version_ field is multivalued
(shalin)
- SOLR-4170: The 'backup' ReplicationHandler command can sometimes use a stale
index directory rather than the current one.
(Mark Miller, Marcin Rzewucki)
- SOLR-3876: Solr Admin UI is completely dysfunctional on IE 9
(steffkes)
- SOLR-4112: Fixed DataImportHandler ZKAwarePropertiesWriter implementation so
import works fine with SolrCloud clusters
(Deniz Durmus, James Dyer,
Erick Erickson, shalin)
- SOLR-4291: Harden the Overseer work queue thread loop.
(Mark Miller)
- SOLR-3820: Solr Admin Query form is missing some edismax request parameters
(steffkes)
- SOLR-4217: post.jar no longer ignores -Dparams when -Durl is used.
(Alexandre Rafalovitch, ehatcher)
- SOLR-4303: On replication, if the generation of the master is lower than the
slave we need to force a full copy of the index.
(Mark Miller, Gregg Donovan)
- SOLR-4266: HttpSolrServer does not release connection properly on exception
when no response parser is used.
(Steve Molloy via Mark Miller)
- SOLR-2298: Updated JavaDoc for SolrDocument.addField and SolrInputDocument.addField
to have more information on name and value parameters.
(Siva Natarajan)
- Other Changes (29)
- SOLR-4106: Javac/ ivy path warnings with morfologik fixed by
upgrading to Morfologik 1.5.5
(Robert Muir, Dawid Weiss)
- SOLR-3899: SolrCore should not log at warning level when the index directory
changes - it's an info event.
(Tobias Bergman, Mark Miller)
- SOLR-3861: Refactor SolrCoreState so that it's managed by SolrCore.
(Mark Miller, hossman)
- SOLR-3966: Eliminate superfluous warning from LanguageIdentifierUpdateProcessor
(Markus Jelsma via hossman)
- SOLR-3932: SolrCmdDistributorTest either takes 3 seconds or 3 minutes.
(yonik, Mark Miller)
- SOLR-3856: New tests for SqlEntityProcessor/CachedSqlEntityProcessor
(James Dyer)
- SOLR-4067: ZkStateReader#getLeaderProps should not return props for a leader
that it does not think is live.
(Mark Miller)
- SOLR-4086: DIH refactor of VariableResolver and Evaluator. VariableResolver
and each built-in Evaluator are separate concrete classes. DateFormatEvaluator
now defaults with the ROOT Locale. However, users may specify a different
Locale using an optional new third parameter.
(James Dyer)
- SOLR-3602: Update ZooKeeper to 3.4.5
(Mark Miller)
- SOLR-4095: DIH NumberFormatTransformer & DateFormatTransformer default to the
ROOT Locale if none is specified. These previously used the machine's default.
(James Dyer)
- SOLR-4096: DIH FileDataSource & FieldReaderDataSource default to UTF-8 encoding
if none is specified. These previously used the machine's default.
(James Dyer)
- SOLR-1916: DIH to not use Lucene-forbidden Java APIs
(default encoding, locale, etc.)
(James Dyer, Robert Muir)
- SOLR-4111: SpellCheckCollatorTest#testContextSensitiveCollate to test against
both DirectSolrSpellChecker & IndexBasedSpellChecker
(Tomás Fernández Löbbe via James Dyer)
- SOLR-2141: Better test coverage for Evaluators
(James Dyer)
- SOLR-4119: Update Guava to 13.0.1
(Mark Miller)
- SOLR-4074: Raise default ramBufferSizeMB to 100 from 32.
(yonik, Mark Miller)
- SOLR-4062: The update log location in solrconfig.xml should default to
${solr.ulog.dir} rather than ${solr.data.dir:}
(Mark Miller)
- SOLR-4155: Upgrade Jetty to 8.1.8.
(Robert Muir)
- SOLR-2986: Add MoreLikeThis to warning about features that require uniqueKey.
Also, change the warning to warn log level.
(Shawn Heisey via Mark Miller)
- SOLR-4163: README improvements
(Shawn Heisey via hossman)
- SOLR-4248: "ant eclipse" should declare .svn directories as derived.
(Shawn Heisey via Mark Miller)
- SOLR-3279: Upgrade Carrot2 to 3.6.2
(Stanisław Osiński)
- SOLR-4254: Harden the 'leader requests replica to recover' code path.
(Mark Miller, yonik)
- SOLR-4226: Extract fl parsing code out of ReturnFields constructor.
(Ryan Ernst via Robert Muir)
- SOLR-4208: ExtendedDismaxQParserPlugin has been refactored to make
subclassing easier.
(Tomás Fernández Löbbe, hossman)
- SOLR-3735: Relocate the example mime-to-extension mapping, and
upgrade Velocity Engine to 1.7
(ehatcher)
- SOLR-4287: Removed "apache-" prefix from Solr distribution and artifact
filenames.
(Ryan Ernst, Robert Muir, Steve Rowe)
- SOLR-4016: Deduplication does not work with atomic/partial updates so
disallow atomic update requests which change signature generating fields.
(Joel Nothman, yonik, shalin)
- SOLR-4308: Remove the problematic and now unnecessary log4j-over-slf4j.
(Mark Miller)
- Versions of Major Components (5)
- Apache Tika 1.2
- Carrot2 3.5.0
- Velocity 1.6.4 and Velocity Tools 2.0
- Apache UIMA 2.3.1
- Apache ZooKeeper 3.3.6
- Upgrading from Solr 4.0.0-BETA (2)
- In order to better support distributed search mode, the TermVectorComponent's
response format has been changed so that if the schema defines a
uniqueKeyField, then that field value is used as the "key" for each document in
its response section, instead of the internal lucene doc id. Users w/o a
uniqueKeyField will continue to see the same response format. See SOLR-3229
for more details.
- If you are using SolrCloud's distributed update request capabilities and a non
string type id field, you must re-index.
- Upgrading from Solr 4.0.0-ALPHA (2)
- Solr is now much more strict about requiring that the uniqueKeyField feature
(if used) must refer to a field which is not multiValued. If you upgrade from
an earlier version of Solr and see an error that your uniqueKeyField "can not
be configured to be multivalued" please add 'multiValued="false"' to the
<field /> declaration for your uniqueKeyField. See SOLR-3682 for more details.
- In addition, please review the notes above about upgrading from 4.0.0-BETA
- Upgrading from Solr 3.6 (10)
- The Lucene index format has changed and as a result, once you upgrade,
previous versions of Solr will no longer be able to read your indices.
In a master/slave configuration, all searchers/slaves should be upgraded
before the master. If the master were to be updated first, the older
searchers would not be able to read the new index format.
- Setting abortOnConfigurationError=false is no longer supported
(since it has never worked properly). Solr will now warn you if
you attempt to set this configuration option at all. (see SOLR-1846)
- The default logic for the 'mm' param of the 'dismax' QParser has
been changed. If no 'mm' param is specified (either in the query,
or as a default in solrconfig.xml) then the effective value of the
'q.op' param (either in the query or as a default in solrconfig.xml
or from the 'defaultOperator' option in schema.xml) is used to
influence the behavior. If q.op is effectively "AND" then mm=100%.
If q.op is effectively "OR" then mm=0%. Users who wish to force the
legacy behavior should set a default value for the 'mm' param in
their solrconfig.xml file.
- The VelocityResponseWriter is no longer built into the core. Its JAR and
dependencies now need to be added (via <lib> or solr/home lib inclusion),
and it needs to be registered in solrconfig.xml like this:
<queryResponseWriter name="velocity" class="solr.VelocityResponseWriter"/>
- The update request parameter to choose Update Request Processor Chain is
renamed from "update.processor" to "update.chain". The old parameter was
deprecated but still working since Solr3.2, but is now removed
entirely.
- The <indexDefaults> and <mainIndex> sections of solrconfig.xml are discontinued
and replaced with the <indexConfig> section. There are also better defaults.
When migrating, if you don't know what your old settings mean, simply delete
both <indexDefaults> and <mainIndex> sections. If you have customizations,
put them in <indexConfig> section - with same syntax as before.
- Two of the SolrServer subclasses in SolrJ were renamed/replaced.
CommonsHttpSolrServer is now HttpSolrServer, and
StreamingUpdateSolrServer is now ConcurrentUpdateSolrServer.
- The PingRequestHandler no longer looks for a <healthcheck/> option in the
(legacy) <admin> section of solrconfig.xml. Users who wish to take
advantage of this feature should configure a "healthcheckFile" init param
directly on the PingRequestHandler. As part of this change, relative file
paths have been fixed to be resolved against the data dir. See the example
solrconfig.xml and SOLR-1258 for more details.
- Due to low level changes to support SolrCloud, the uniqueKey field can no
longer be populated via <copyField/> or <field default=...> in the
schema.xml. Users wishing to have Solr automatically generate a uniqueKey
value when adding documents should instead use an instance of
solr.UUIDUpdateProcessorFactory in their update processor chain. See
SOLR-2796 for more details.
- In addition, please review the notes above about upgrading from 4.0.0-BETA, and 4.0.0-ALPHA
Detailed Change List
- New Features (8)
- SOLR-3670: New CountFieldValuesUpdateProcessorFactory makes it easy to index
the number of values in another field for later use at query time.
(hossman)
- SOLR-2768: new "mod(x,y)" function for computing the modulus of two value
sources.
(hossman)
- SOLR-3238: Numerous small improvements to the Admin UI
(steffkes)
- SOLR-3597: seems like a lot of wasted whitespace at the top of the admin screens
(steffkes)
- SOLR-3304: Added Solr adapters for Lucene 4's new spatial module. With
SpatialRecursivePrefixTreeFieldType ("location_rpt" in example schema), it is
possible to index a variable number of points per document (and sort on them),
index not just points but any Spatial4j supported shape such as polygons, and
to query on these shapes too. Polygons requires adding JTS to the classpath.
(David Smiley)
- SOLR-3825: Added optional capability to log what ids are in a response
(Scott Stults via gsingers)
- SOLR-3821: Added 'df' to the UI Query form
(steffkes)
- SOLR-3822: Added hover titles to the edismax params on the UI Query form
(steffkes)
- Optimizations (4)
- SOLR-3715: improve concurrency of the transaction log by removing
synchronization around log record serialization.
(yonik)
- SOLR-3807: Currently during recovery we pause for a number of seconds after
waiting for the leader to see a recovering state so that any previous updates
will have finished before our commit on the leader - we don't need this wait
for peersync.
(Mark Miller)
- SOLR-3837: When a leader is elected and asks replicas to sync back to him and
that fails, we should ask those nodes to recovery asynchronously rather than
synchronously.
(Mark Miller)
- SOLR-3709: Cache the url list created from the ClusterState in CloudSolrServer
on each request.
(Mark Miller)
- Bug Fixes (58)
- SOLR-3685: Solr Cloud sometimes skipped peersync attempt and replicated instead due
to tlog flags not being cleared when no updates were buffered during a previous
replication.
(Markus Jelsma, Mark Miller, yonik)
- SOLR-3229: Fixed TermVectorComponent to work with distributed search
(Hang Xie, hossman)
- SOLR-3725: Fixed package-local-src-tgz target to not bring in unnecessary jars
and binary contents.
(Michael Dodsworth via rmuir)
- SOLR-3649: Fixed bug in JavabinLoader that caused deleteById(List<String> ids)
to not work in SolrJ
(siren)
- SOLR-3730: Rollback is not implemented quite right and can cause corner case fails in
SolrCloud tests.
(rmuir, Mark Miller)
- SOLR-2981: Fixed StatsComponent to no longer return duplicated information
when requesting multiple stats.facet fields.
(Roman Kliewer via hossman)
- SOLR-3743: Fixed issues with atomic updates and optimistic concurrency in
conjunction with stored copyField targets by making real-time get never
return copyField targets.
(yonik)
- SOLR-3746: Proper error reporting if updateLog is configured w/o necessary
"_version_" field in schema.xml
(hossman)
- SOLR-3745: Proper error reporting if SolrCloud mode is used w/o
necessary "_version_" field in schema.xml
(hossman)
- SOLR-3770: Overseer may lose updates to cluster state
(siren)
- SOLR-3721: Fix bug that could theoretically allow multiple recoveries to run
briefly at the same time if the recovery thread join call was interrupted.
(Per Steffensen, Mark Miller)
- SOLR-3782: A leader going down while updates are coming in can cause shard
inconsistency.
(Mark Miller)
- SOLR-3611: We do not show ZooKeeper data in the UI for a node that has children.
(Mark Miller)
- SOLR-3789: Fix bug in SnapPuller that caused "internal" compression to fail.
(siren)
- SOLR-3790: ConcurrentModificationException could be thrown when using hl.fl=*.
Fixed in r1231606.
(yonik, koji)
- SOLR-3668: DataImport : Specifying Custom Parameters
(steffkes)
- SOLR-3793: UnInvertedField faceting cached big terms in the filter
cache that ignored deletions, leading to duplicate documents in search
later when a filter of the same term was specified.
(Günter Hipler, hossman, yonik)
- SOLR-3679: Core Admin UI gives no feedback if "Add Core" fails
(steffkes, hossman)
- SOLR-3795: Fixed LukeRequestHandler response to correctly return field name
strings in copyDests and copySources arrays
(hossman)
- SOLR-3699: Fixed some Directory leaks when there were errors during SolrCore
or SolrIndexWriter initialization.
(hossman)
- SOLR-3518: Include final 'hits' in log information when aggregating a
distributed request
(Markus Jelsma via hossman)
- SOLR-3628: SolrInputField and SolrInputDocument are now consistently backed
by Collections passed in to setValue/setField, and defensively copy values
from Collections passed to addValue/addField
(Tom Switzer via hossman)
- SOLR-3595: CurrencyField now generates an appropriate error on schema init
if it is configured as multiValued - this has never been properly supported,
but previously failed silently in odd ways.
(hossman)
- SOLR-3823: Fix 'bq' parsing in edismax. Please note that this required
reverting the negative boost support added by SOLR-3278
(hossman)
- SOLR-3827: Fix shareSchema=true in solr.xml
(Tomás Fernández Löbbe via hossman)
- SOLR-3809: Fixed config file replication when subdirectories are used
(Emmanuel Espina via hossman)
- SOLR-3828: Fixed QueryElevationComponent so that using 'markExcludes' does
not modify the result set or ranking of 'excluded' documents relative to
not using elevation at all.
(Alexey Serba via hossman)
- SOLR-3569: Fixed debug output on distributed requests when there are no
results found.
(David Bowen via hossman)
- SOLR-3811: Query Form using wrong values for dismax, edismax
(steffkes)
- SOLR-3779: DataImportHandler's LineEntityProcessor when used in conjunction
with FileListEntityProcessor would only process the first file.
(Ahmet Arslan via James Dyer)
- SOLR-3791: CachedSqlEntityProcessor would throw a NullPointerException when
a query returns a row with a NULL key.
(Steffen Moelter via James Dyer)
- SOLR-3833: When a election is started because a leader went down, the new
leader candidate should decline if the last state they published was not
active.
(yonik, Mark Miller)
- SOLR-3836: When doing peer sync, we should only count sync attempts that
cannot reach the given host as success when the candidate leader is
syncing with the replicas - not when replicas are syncing to the leader.
(Mark Miller)
- SOLR-3835: In our leader election algorithm, if on connection loss we found
we did not create our election node, we should retry, not throw an exception.
(Mark Miller)
- SOLR-3834: A new leader on cluster startup should also run the leader sync
process in case there was a bad cluster shutdown.
(Mark Miller)
- SOLR-3772: On cluster startup, we should wait until we see all registered
replicas before running the leader process - or if they all do not come up,
N amount of time.
(Mark Miller)
- SOLR-3756: If we are elected the leader of a shard, but we fail to publish
this for any reason, we should clean up and re trigger a leader election.
(Mark Miller)
- SOLR-3812: ConnectionLoss during recovery can cause lost updates, leading to
shard inconsistency.
(Mark Miller)
- SOLR-3813: When a new leader syncs, we need to ask all shards to sync back,
not just those that are active.
(Mark Miller)
- SOLR-3641: CoreContainer is not persisting roles core attribute.
(hossman, Mark Miller)
- SOLR-3527: SolrCmdDistributor drops some of the important commit attributes
(maxOptimizeSegments, softCommit, expungeDeletes) when sending a commit to
replicas.
(Andy Laird, Tomás Fernández Löbbe, Mark Miller)
- SOLR-3844: SolrCore reload can fail because it tries to remove the index
write lock while already holding it.
(Mark Miller)
- SOLR-3831: Atomic updates do not distribute correctly to other nodes.
(Jim Musil, Mark Miller)
- SOLR-3465: Replication causes two searcher warmups.
(Michael Garski, Mark Miller)
- SOLR-3645: /terms should default to distrib=false.
(Nick Cotton, Mark Miller)
- SOLR-3759: Various fixes to the example-DIH configs
(Ahmet Arslan, hossman)
- SOLR-3777: Dataimport-UI does not send unchecked checkboxes
(Glenn MacStravic
via steffkes)
- SOLR-3850: DataImportHandler "cacheKey" parameter was incorrectly renamed "cachePk"
(James Dyer)
- SOLR-3087: Fixed DOMUtil so that code doing attribute validation will
automatically ignore nodes in the reserved "xml" prefix - in particular this
fixes some bugs related to xinclude and fieldTypes.
(Amit Nithian, hossman)
- SOLR-3783: Fixed Pivot Faceting to work with facet.missing=true
(hossman)
- SOLR-3869: A PeerSync attempt to its replicas by a candidate leader should
not fail on o.a.http.conn.ConnectTimeoutException.
(Mark Miller)
- SOLR-3875: Fixed index boosts on multi-valued fields when docBoost is used
(hossman)
- SOLR-3878: Exception when using open-ended range query with CurrencyField
(janhoy)
- SOLR-3891: CacheValue in CachingDirectoryFactory cannot be used outside of
solr.core package.
(phunt via Mark Miller)
- SOLR-3892: Inconsistent locking when accessing cache in CachingDirectoryFactory
from RAMDirectoryFactory and MockDirectoryFactory.
(phunt via Mark Miller)
- SOLR-3883: Distributed indexing forwards non-applicable request params.
(Dan Sutton, Per Steffensen, yonik, Mark Miller)
- SOLR-3903: Fixed MissingFormatArgumentException in ConcurrentUpdateSolrServer
(hossman)
- SOLR-3916: Fixed whitespace bug in parsing the fl param
(hossman)
- Other Changes (18)
- SOLR-3690: Fixed binary release packages to include dependencies needed for
the solr-test-framework
(hossman)
- SOLR-2857: The /update/json and /update/csv URLs were restored to aid
in the migration of existing clients.
(yonik)
- SOLR-3691: SimplePostTool: Mode for crawling/posting web pages
See http://wiki.apache.org/solr/ExtractingRequestHandler for examples
(janhoy)
- SOLR-3707: Upgrade Solr to Tika 1.2
(janhoy)
- SOLR-2747: Updated changes2html.pl to handle Solr's CHANGES.txt; added
target 'changes-to-html' to solr/build.xml.
(Steve Rowe, Robert Muir)
- SOLR-3752: When a leader goes down, have the Overseer clear the leader state
in cluster.json
(Mark Miller)
- SOLR-3751: Add defensive checks for SolrCloud updates and requests that ensure
the local state matches what we can tell the request expected.
(Mark Miller)
- SOLR-3773: Hash based on the external String id rather than the indexed
representation for distributed updates.
(Michael Garski, yonik, Mark Miller)
- SOLR-3780: Maven build: Make solrj tests run separately from solr-core.
(Steve Rowe)
- SOLR-3772: Optionally, on cluster startup, we can wait until we see all registered
replicas before running the leader process - or if they all do not come up,
N amount of time.
(Jan Høydahl, Per Steffensen, Mark Miller)
- SOLR-3750: Optionally, on session expiration, we can explicitly wait some time before
running the leader sync process so that we are sure every node participates.
(Per Steffensen, Mark Miller)
- SOLR-3824: Velocity: Error messages from search not displayed
(janhoy)
- SOLR-3826: Test framework improvements for specifying coreName on initCore
(Amit Nithian, hossman)
- SOLR-3749: Allow default UpdateLog syncLevel to be configured by
solrconfig.xml
(Raintung Li, Mark Miller)
- SOLR-3845: Rename numReplicas to replicationFactor in Collections API.
(yonik, Mark Miller)
- SOLR-3815: SolrCloud - Add properties such as "range" to shards, which changes
the clusterstate.json and puts the shard replicas under "replicas".
(yonik)
- SOLR-3871: SyncStrategy should use an executor for the threads it creates to
request recoveries.
(Mark Miller)
- SOLR-3870: SyncStrategy should have a close so it can abort earlier on
shutdown.
(Mark Miller)
- Versions of Major Components (5)
- Apache Tika 1.1
- Carrot2 3.5.0
- Velocity 1.6.4 and Velocity Tools 2.0
- Apache UIMA 2.3.1
- Apache ZooKeeper 3.3.6
- Upgrading from Solr 4.0.0-ALPHA (1)
- Solr is now much more strict about requiring that the uniqueKeyField feature
(if used) must refer to a field which is not multiValued. If you upgrade from
an earlier version of Solr and see an error that your uniqueKeyField "can not
be configured to be multivalued" please add 'multiValued="false"' to the
<field /> declaration for your uniqueKeyField. See SOLR-3682 for more details.
Detailed Change List
- New Features (15)
- LUCENE-4201: Added JapaneseIterationMarkCharFilterFactory to normalize Japanese
iteration marks.
(Robert Muir, Christian Moen)
- SOLR-1856: In Solr Cell, literals should override Tika-parsed values.
Patch adds a param "literalsOverride" which defaults to true, but can be set
to "false" to let Tika-parsed values be appended to literal values
(Chris Harris, janhoy)
- SOLR-3488: Added a Collection management API for SolrCloud.
(Tommaso Teofili, Sami Siren, yonik, Mark Miller)
- SOLR-3559: Full deleteByQuery support with SolrCloud distributed indexing.
All replicas of a shard will be consistent, even if updates arrive in a
different order on different replicas.
(yonik)
- SOLR-1929: Index encrypted documents with ExtractingUpdateRequestHandler.
By supplying resource.password=<mypw> or specifying an external file with regular
expressions matching file names, Solr will decrypt and index PDFs and DOCX formats.
(janhoy, Yiannis Pericleous)
- SOLR-3562: Add options to remove instance dir or data dir on core unload.
(Mark Miller, Per Steffensen)
- SOLR-2702: The default directory factory was changed to NRTCachingDirectoryFactory
which wraps the StandardDirectoryFactory and caches small files for improved
Near Real-time (NRT) performance.
(Mark Miller, yonik)
- SOLR-2616: Include a sample java util logging configuration file.
(David Smiley, Mark Miller)
- SOLR-3460: Add cloud-scripts directory and a zkcli.sh|bat tool for easy scripting
and interaction with ZooKeeper.
(Mark Miller)
- SOLR-1725: StatelessScriptUpdateProcessorFactory allows users to implement
the full ScriptUpdateProcessor API using any scripting language with a
javax.script.ScriptEngineFactory
(Uri Boness, ehatcher, Simon Rosenthal, hossman)
- SOLR-139: Change to updateable documents to create the document if it doesn't
already exist. To assert that the document must exist, use the optimistic
concurrency feature by specifying a _version_ of 1.
(yonik)
- LUCENE-2510, LUCENE-4044: Migrated Solr's Tokenizer-, TokenFilter-, and
CharFilterFactories to the lucene-analysis module. To add new analysis
modules to Solr (like ICU, SmartChinese, Morfologik,...), just drop in
the JAR files from Lucene's binary distribution into your Solr instance's
lib folder. The factories are automatically made available with SPI.
(Chris Male, Robert Muir, Uwe Schindler)
- SOLR-3634, SOLR-3635: CoreContainer and CoreAdminHandler will now remember
and report back information about failures to initialize SolrCores. These
failures will be accessible from the web UI and CoreAdminHandler STATUS
command until they are "reset" by creating/renaming a SolrCore with the
same name.
(hossman, steffkes)
- SOLR-1280: Added commented-out example of the new script update processor
to the example configuration. See http://wiki.apache.org/solr/ScriptUpdateProcessor
(ehatcher)
- SOLR-3672: SimplePostTool: Improvements for posting files
Support for auto mode, recursive and wildcards
(janhoy)
- Optimizations (3)
- SOLR-3708: Add hashCode to ClusterState so that structures built based on the
ClusterState can be easily cached.
(Mark Miller)
- SOLR-3709: Cache the url list created from the ClusterState in CloudSolrServer on each
request.
(Mark Miller, yonik)
- SOLR-3710: Change CloudSolrServer so that update requests are only sent to leaders by
default.
(Mark Miller)
- Bug Fixes (22)
- SOLR-3582: Our ZooKeeper watchers respond to session events as if they are change events,
creating undesirable side effects.
(Trym R. Møller, Mark Miller)
- SOLR-3467: ExtendedDismax escaping is missing several reserved characters
(Michael Dodsworth via janhoy)
- SOLR-3587: After reloading a SolrCore, the original Analyzer is still used rather than a new
one.
(Alexey Serba, yonik, rmuir, Mark Miller)
- LUCENE-4185: Fix a bug where CharFilters were wrongly being applied twice.
(Michael Froh, rmuir)
- SOLR-3610: After reloading a core, indexing would fail on any newly added fields to the schema.
(Brent Mills, rmuir)
- SOLR-3377: edismax fails to correctly parse a fielded query wrapped by parens.
This regression was introduced in 3.6.
(Bernd Fehling, Jan Høydahl, yonik)
- SOLR-3621: Fix rare concurrency issue when opening a new IndexWriter for replication or rollback.
(Mark Miller)
- SOLR-1781: Replication index directories not always cleaned up.
(Markus Jelsma, Terje Sten Bjerkseth, Mark Miller)
- SOLR-3639: Update ZooKeeper to 3.3.6 for a variety of bug fixes.
(Mark Miller)
- SOLR-3629: Typo in solr.xml persistence when overriding the solrconfig.xml
file name using the "config" attribute prevented the override file from being
used.
(Ryan Zezeski, hossman)
- SOLR-3642: Correct broken check for multivalued fields in stats.facet
(Yandong Yao, hossman)
- SOLR-3660: Velocity: Link to admin page broken
(janhoy)
- SOLR-3658: Adding thousands of docs with one UpdateProcessorChain instance can briefly create
spikes of threads in the thousands.
(yonik, Mark Miller)
- SOLR-3656: A core reload now always uses the same dataDir.
(Mark Miller, yonik)
- SOLR-3662: Core reload bugs: a reload always obtained a non-NRT searcher, which
could go back in time with respect to the previous core's NRT searcher. Versioning
did not work correctly across a core reload, and update handler synchronization
was changed to synchronize on core state since more than on update handler
can coexist for a single index during a reload.
(yonik)
- SOLR-3663: There are a couple of bugs in the sync process when a leader goes down and a
new leader is elected.
(Mark Miller)
- SOLR-3623: Fixed inconsistent treatment of third-party dependencies for
solr contribs analysis-extras & uima
(hossman)
- SOLR-3652: Fixed range faceting to error instead of looping infinitely
when 'gap' is zero -- or effectively zero due to floating point arithmetic
underflow.
(hossman)
- SOLR-3648: Fixed VelocityResponseWriter template loading in SolrCloud mode.
For the example configuration, this means /browse now works with SolrCloud.
(janhoy, ehatcher)
- SOLR-3677: Fixed misleading error message in web ui to distinguish between
no SolrCores loaded vs. no /admin/ handler available.
(hossman, steffkes)
- SOLR-3428: SolrCmdDistributor flushAdds/flushDeletes can cause repeated
adds/deletes to be sent
(Mark Miller, Per Steffensen)
- SOLR-3647: DistributedQueue should use our Solr zk client rather than the std zk
client. ZooKeeper expiration can be permanent otherwise.
(Mark Miller)
- Other Changes (14)
- SOLR-3524: Make discarding punctuation configurable in JapaneseTokenizerFactory.
The default is to discard punctuation, but this is overridable as an expert option.
(Kazuaki Hiraga, Jun Ohtani via Christian Moen)
- SOLR-1770: Move the default core instance directory into a collection1 folder.
(Mark Miller)
- SOLR-3355: Add shard and collection to SolrCore statistics.
(Michael Garski, Mark Miller)
- SOLR-3575: solr.xml should default to persist=true
(Mark Miller)
- SOLR-3563: Unloading all cores in a SolrCloud collection will now cause the removal of
that collection's meta data from ZooKeeper.
(Mark Miller, Per Steffensen)
- SOLR-3599: Add zkClientTimeout to solr.xml so that it's obvious how to change it and so
that you can change it with a system property.
(Mark Miller)
- SOLR-3609: Change Solr's expanded webapp directory to be at a consistent path called
solr-webapp rather than a temporary directory.
(Mark Miller)
- SOLR-3600: Raise the default zkClientTimeout from 10 seconds to 15 seconds.
(Mark Miller)
- SOLR-3215: Clone SolrInputDocument when distrib indexing so that update processors after
the distrib update process do not process the document twice.
(Mark Miller)
- SOLR-3683: Improved error handling if an <analyzer> contains both an
explicit class attribute, as well as nested factories.
(hossman)
- SOLR-3682: Fail to parse schema.xml if uniqueKeyField is multivalued
(hossman)
- SOLR-2115: DIH no longer requires the "config" parameter to be specified in solrconfig.xml.
Instead, the configuration is loaded and parsed with every import. This allows the use of
a different configuration with each import, and makes correcting configuration errors simpler.
Also, the configuration itself can be passed using the "dataConfig" parameter rather than
using a file (this previously worked in debug mode only). When configuration errors are
encountered, the error message is returned in XML format.
(James Dyer)
- SOLR-3439: Make SolrCell easier to use out of the box. Also improves "/browse" to display
rich-text documents correctly, along with facets for author and content_type.
With the new "content" field, highlighting of body is supported. See also SOLR-3672 for
easier posting of a whole directory structure.
(Jack Krupansky, janhoy)
- SOLR-3579: SolrCloud view should default to the graph view rather than tree view.
(steffkes, Mark Miller)
- More information about this release, including any errata related to the
release notes, upgrade instructions, or other changes may be found online at:
https://wiki.apache.org/solr/Solr4.0
- Versions of Major Components (5)
- Apache Tika 1.1
- Carrot2 3.5.0
- Velocity 1.6.4 and Velocity Tools 2.0
- Apache UIMA 2.3.1
- Apache ZooKeeper 3.3.4
- Upgrading from Solr 3.6-dev (9)
- The Lucene index format has changed and as a result, once you upgrade,
previous versions of Solr will no longer be able to read your indices.
In a master/slave configuration, all searchers/slaves should be upgraded
before the master. If the master were to be updated first, the older
searchers would not be able to read the new index format.
- Setting abortOnConfigurationError=false is no longer supported
(since it has never worked properly). Solr will now warn you if
you attempt to set this configuration option at all. (see SOLR-1846)
- The default logic for the 'mm' param of the 'dismax' QParser has
been changed. If no 'mm' param is specified (either in the query,
or as a default in solrconfig.xml) then the effective value of the
'q.op' param (either in the query or as a default in solrconfig.xml
or from the 'defaultOperator' option in schema.xml) is used to
influence the behavior. If q.op is effectively "AND" then mm=100%.
If q.op is effectively "OR" then mm=0%. Users who wish to force the
legacy behavior should set a default value for the 'mm' param in
their solrconfig.xml file.
- The VelocityResponseWriter is no longer built into the core. Its JAR and
dependencies now need to be added (via <lib> or solr/home lib inclusion),
and it needs to be registered in solrconfig.xml like this:
<queryResponseWriter name="velocity" class="solr.VelocityResponseWriter"/>
- The update request parameter to choose Update Request Processor Chain is
renamed from "update.processor" to "update.chain". The old parameter was
deprecated but still working since Solr3.2, but is now removed
entirely.
- The <indexDefaults> and <mainIndex> sections of solrconfig.xml are discontinued
and replaced with the <indexConfig> section. There are also better defaults.
When migrating, if you don't know what your old settings mean, simply delete
both <indexDefaults> and <mainIndex> sections. If you have customizations,
put them in <indexConfig> section - with same syntax as before.
- Two of the SolrServer subclasses in SolrJ were renamed/replaced.
CommonsHttpSolrServer is now HttpSolrServer, and
StreamingUpdateSolrServer is now ConcurrentUpdateSolrServer.
- The PingRequestHandler no longer looks for a <healthcheck/> option in the
(legacy) <admin> section of solrconfig.xml. Users who wish to take
advantage of this feature should configure a "healthcheckFile" init param
directly on the PingRequestHandler. As part of this change, relative file
paths have been fixed to be resolved against the data dir. See the example
solrconfig.xml and SOLR-1258 for more details.
- Due to low level changes to support SolrCloud, the uniqueKey field can no
longer be populated via <copyField/> or <field default=...> in the
schema.xml. Users wishing to have Solr automatically generate a uniqueKey
value when adding documents should instead use an instance of
solr.UUIDUpdateProcessorFactory in their update processor chain. See
SOLR-2796 for more details.
Detailed Change List
- New Features (60)
- SOLR-3272: Solr filter factory for MorfologikFilter (Polish lemmatisation).
(Rafał Kuć via Dawid Weiss, Steven Rowe, Uwe Schindler).
- SOLR-571: The autowarmCount for LRUCaches (LRUCache and FastLRUCache) now
supports "percentages" which get evaluated relative the current size of
the cache when warming happens.
(Tomás Fernández Löbbe and hossman)
- SOLR-1932: New relevancy function queries: termfreq, tf, docfreq, idf
norm, maxdoc, numdocs.
(yonik)
- SOLR-1665: Add debug component options for timings, results and query info only
(gsingers, hossman, yonik)
- SOLR-2112: Solrj API now supports streaming results.
(ryan)
- SOLR-792: Adding PivotFacetComponent for Hierarchical faceting
(ehatcher, Jeremy Hinegardner, Thibaut Lassalle, ryan)
- LUCENE-2507, SOLR-2571, SOLR-2576: Added DirectSolrSpellChecker, which uses Lucene's
DirectSpellChecker to retrieve correction candidates directly from the term dictionary using
levenshtein automata.
(James Dyer, rmuir)
- SOLR-1873, SOLR-2358: SolrCloud - added shared/central config and core/shard management via zookeeper,
built-in load balancing, and distributed indexing.
(Jamie Johnson, Sami Siren, Ted Dunning, yonik, Mark Miller)
Additional Work:
-
SOLR-2324: SolrCloud solr.xml parameters are not persisted by CoreContainer.
(Massimo Schiavon, Mark Miller)
-
SOLR-2287: Allow users to query by multiple, compatible collections with SolrCloud.
(Soheb Mahmood, Alex Cowell, Mark Miller)
-
SOLR-2622: ShowFileRequestHandler does not work in SolrCloud mode.
(Stefan Matheis, Mark Miller)
-
SOLR-3108: Error in SolrCloud's replica lookup code when replica's are hosted in same Solr instance.
(Bruno Dumon, Sami Siren, Mark Miller)
-
SOLR-3080: Remove shard info from zookeeper when SolrCore is explicitly unloaded.
(yonik, Mark Miller, siren)
-
SOLR-3437: Recovery issues a spurious commit to the cluster.
(Trym R. Møller via Mark Miller)
-
SOLR-2822: Skip update processors already run on other nodes
(hossman)
- SOLR-1566: Transforming documents in the ResponseWriters. This will allow
for more complex results in responses and open the door for function queries
as results.
(ryan with patches from grant, noble, cmale, yonik, Jan Høydahl,
Arul Kalaipandian, Luca Cavanna, hossman)
-
SOLR-2037: Thanks to SOLR-1566, documents boosted by the QueryElevationComponent
can be marked as boosted.
(gsingers, ryan, yonik)
- SOLR-2396: Add CollationField, which is much more efficient than
the Solr 3.x CollationKeyFilterFactory, and also supports
Locale-sensitive range queries.
(rmuir)
- SOLR-2338: Add support for using <similarity/> in a schema's fieldType,
for customizing scoring on a per-field basis.
(hossman, yonik, rmuir)
- SOLR-2335: New 'field("...")' function syntax for referring to complex
field names (containing whitespace or special characters) in functions.
- SOLR-2383: /browse improvements: generalize range and date facet display
(Jan Høydahl via yonik)
- SOLR-2272: Pseudo-join queries / filters. Examples:
-
To restrict to the set of parents with at least one blue-eyed child:
fq={!join from=parent to=name}eyes:blue
-
To restrict to the set of children with at least one blue-eyed parent:
fq={!join from=name to=parent}eyes:blue
(yonik)
- SOLR-1942: Added the ability to select postings format per fieldType in schema.xml
as well as support custom Codecs in solrconfig.xml.
(simonw via rmuir)
- SOLR-2136: Boolean type added to function queries, along with
new functions exists(), if(), and(), or(), xor(), not(), def(),
and true and false constants.
(yonik)
- SOLR-2491: Add support for using spellcheck collation in conjunction
with grouping. Note that the number of hits returned for collations
is the number of ungrouped hits.
(James Dyer via rmuir)
- SOLR-1298: Return FunctionQuery as pseudo field. The solr 'fl' param
now supports functions. For example: fl=id,sum(x,y) -- NOTE: only
functions with fast random access are recommended.
(yonik, ryan)
- SOLR-705: Optionally return shard info with each document in distributed
search. Use fl=id,[shard] to return the shard url.
(ryan)
- SOLR-2417: Add explain info directly to return documents using
?fl=id,[explain]
(ryan)
- SOLR-2533: Converted ValueSource.ValueSourceSortField over to new rewriteable Lucene
SortFields. ValueSourceSortField instances must be rewritten before they can be used.
This is done by SolrIndexSearcher when necessary.
(Chris Male).
- SOLR-2193, SOLR-2565: You may now specify a 'soft' commit when committing. This will
use Lucene's NRT feature to avoid guaranteeing documents are on stable storage in exchange
for faster reopen times. There is also a new 'soft' autocommit tracker that can be
configured.
(Mark Miller, Robert Muir)
- SOLR-2399: Updated Solr Admin interface. New look and feel with per core administration
and many new options.
(Stefan Matheis via ryan)
- SOLR-1032: CSV handler now supports "literal.field_name=value" parameters.
(Simon Rosenthal, ehatcher)
- SOLR-2656: realtime-get, efficiently retrieves the latest stored fields for specified
documents, even if they are not yet searchable (i.e. without reopening a searcher)
(yonik)
- SOLR-2703: Added support for Lucene's "surround" query parser.
(Simon Rosenthal, ehatcher)
- SOLR-2754: Added factories for several ranking algorithms:
-
BM25SimilarityFactory: Okapi BM25
-
DFRSimilarityFactory: Divergence from Randomness models
-
IBSimilarityFactory: Information-based models
-
LMDirichletSimilarity: LM with Dirichlet smoothing
-
LMJelinekMercerSimilarity: LM with Jelinek-Mercer smoothing
(David Mark Nemeskey, Robert Muir)
- SOLR-2134 Trie* fields should support sortMissingLast=true, and deprecate Sortable* Field Types
(Ryan McKinley, Mike McCandless, Uwe Schindler, Erick Erickson)
- SOLR-2438 added MultiTermAwareComponent to the various classes to allow automatic lowercasing
for multiterm queries (wildcards, regex, prefix, range, etc). You can now optionally specify a
"multiterm" analyzer in our schema.xml, but Solr should "do the right thing" if you don't
specify <analyzer type="multiterm">
(Pete Sturge Erick Erickson, Mentoring from Seeley and Muir)
- SOLR-2481: Add support for commitWithin in DataImportHandler
(Sami Siren via yonik)
- SOLR-2992: Add support for IndexWriter.prepareCommit() via prepareCommit=true
on update URLs.
(yonik)
- SOLR-2906: Added LFU cache options to Solr.
(Shawn Heisey via Erick Erickson)
- SOLR-3069: Ability to add openSearcher=false to not open a searcher when doing
a hard commit. commitWithin now only invokes a softCommit.
(yonik)
- SOLR-2802: New FieldMutatingUpdateProcessor and Factory to simplify the
development of UpdateProcessors that modify field values of documents as
they are indexed. Also includes several useful new implementations:
-
RemoveBlankFieldUpdateProcessorFactory
-
TrimFieldUpdateProcessorFactory
-
HTMLStripFieldUpdateProcessorFactory
-
RegexReplaceProcessorFactory
-
FieldLengthUpdateProcessorFactory
-
ConcatFieldUpdateProcessorFactory
-
FirstFieldValueUpdateProcessorFactory
-
LastFieldValueUpdateProcessorFactory
-
MinFieldValueUpdateProcessorFactory
-
MaxFieldValueUpdateProcessorFactory
-
TruncateFieldUpdateProcessorFactory
-
IgnoreFieldUpdateProcessorFactory
(hossman, janhoy)
- SOLR-3120: Optional post filtering for spatial queries bbox and geofilt
for LatLonType.
(yonik)
- SOLR-2459: Expose LogLevel selection with a RequestHandler rather then servlet
(Stefan Matheis, Upayavira, ryan)
- SOLR-3134: Include shard info in distributed response when shards.info=true
(Russell Black, ryan)
- SOLR-2898: Support grouped faceting.
(Martijn van Groningen)
Additional Work:
-
SOLR-3406: Extended grouped faceting support to facet.query and facet.range parameters.
(David Boychuck, Martijn van Groningen)
- SOLR-2949: QueryElevationComponent is now supported with distributed search.
(Mark Miller, yonik)
- SOLR-3221: Added the ability to directly configure aspects of the concurrency
and thread-pooling used within distributed search in solr. This allows for finer
grained controlled and can be tuned by end users to target their own specific
requirements. This builds on the work of the HttpCommComponent and uses the same configuration
block to configure the thread pool. The default configuration has
the same behaviour as solr 3.5, favouring throughput over latency. More
information can be found on the wiki (http://wiki.apache.org/solr/SolrConfigXml)
(Greg Bowyer)
- SOLR-3278: Negative boost support to the Extended Dismax Query Parser Boost Query (bq).
(James Dyer)
- SOLR-3255: OpenExchangeRates.Org Exchange Rate Provider for CurrencyField
(janhoy)
- SOLR-3358: Logging events are captured and available from the /admin/logging
request handler.
(ryan)
- SOLR-1535: PreAnalyzedField type provides a functionality to index (and optionally store)
field content that was already processed and split into tokens using some external processing
chain. Serialization format is pluggable, and defaults to JSON.
(ab)
- SOLR-3363: Consolidated Exceptions in Analysis Factories so they only throw
InitializationExceptions
(Chris Male)
- SOLR-2690: New support for a "TZ" request param which overrides the TimeZone
used when rounding Dates in DateMath expressions for the entire request
(all date range queries and date faceting is affected). The default TZ
is still UTC.
(David Schlotfeldt, hossman)
- SOLR-3402: Analysis Factories are now configured with their Lucene Version
throw setLuceneMatchVersion, rather than through the Map passed to init.
Parsing and simple error checking for the Version is now done inside
the code that creates the Analysis Factories.
(Chris Male)
- SOLR-3178: Optimistic locking. If a _version_ is provided with an update
that does not match the version in the index, an HTTP 409 error (Conflict)
will result.
(Per Steffensen, yonik)
- SOLR-139: Updateable documents. JSON Example:
{"id":"mydoc", "f1":{"set":10}, "f2":{"add":20}} will result in field "f1"
being set to 10, "f2" having an additional value of 20 added, and all
other existing fields unchanged. All source fields must be stored for
this feature to work correctly.
(Ryan McKinley, Erik Hatcher, yonik)
- SOLR-2857: Support XML,CSV,JSON, and javabin in a single RequestHandler and
choose the correct ContentStreamLoader based on Content-Type header. This
also deprecates the existing [Xml,JSON,CSV,Binary,Xslt]UpdateRequestHandler.
(ryan)
- SOLR-2585: Context-Sensitive Spelling Suggestions & Collations. This adds support
for the "spellcheck.alternativeTermCount" & "spellcheck.maxResultsForSuggest"
parameters, letting users receive suggestions even when all the queried terms
exist in the dictionary. This differs from "spellcheck.onlyMorePopular" in
that the suggestions need not consist entirely of terms with a greater document
frequency than the queried terms.
(James Dyer)
- SOLR-2058: Edismax query parser to allow "phrase slop" to be specified per-field
on the pf/pf2/pf3 parameters using optional "FieldName~slop^boost" syntax. The
prior "FieldName^boost" syntax is still accepted. In such cases the value on the
"ps" parameter serves as the default slop.
(Ron Mayer via James Dyer)
- SOLR-3495: New UpdateProcessors have been added to create default values for
configured fields. These works similarly to the <field default="..."/>
option in schema.xml, but are applied in the UpdateProcessorChain, so they
may be used prior to other UpdateProcessors, or to generate a uniqueKey field
value when using the DistributedUpdateProcessor (ie: SolrCloud)
TimestampUpdateProcessorFactory
UUIDUpdateProcessorFactory
DefaultValueUpdateProcessorFactory
(hossman)
- SOLR-2993: Add WordBreakSolrSpellChecker to offer suggestions by combining adjacent
query terms and/or breaking terms into multiple words. This spellchecker can be
configured with a traditional checker (ie: DirectSolrSpellChecker). The results
are combined and collations can contain a mix of corrections from both spellcheckers.
(James Dyer)
- SOLR-3508: Simplify JSON update format for deletes as well as allow
version specification for optimistic locking. Examples:
-
{"delete":"myid"}
-
{"delete":["id1","id2","id3"]}
-
{"delete":{"id":"myid", "_version_":123456789}}
(yonik)
- SOLR-3211: Allow parameter overrides in conjunction with "spellcheck.maxCollationTries".
To do so, use parameters starting with "spellcheck.collateParam." For instance, to
override the "mm" parameter, specify "spellcheck.collateParam.mm". This is helpful
in cases where testing spellcheck collations for result counts should use different
parameters from the main query
(James Dyer)
- SOLR-2599: CloneFieldUpdateProcessorFactory provides similar functionality
to schema.xml's <copyField/> declaration but as an update processor that can
be combined with other processors in any order.
(Jan Høydahl & hossman)
- SOLR-3351: eDismax: ps2 and ps3 params
(janhoy)
- SOLR-3542: Add WeightedFragListBuilder for FVH and set it to default fragListBuilder
in example solrconfig.xml.
(Sebastian Lutze, koji)
- SOLR-2396: Add ICUCollationField to contrib/analysis-extras, which is much
more efficient than the Solr 3.x ICUCollationKeyFilterFactory, and also
supports Locale-sensitive range queries.
(rmuir)
- Optimizations (5)
- SOLR-1875: Per-segment field faceting for single valued string fields.
Enable with facet.method=fcs, control the number of threads used with
the "threads" local param on the facet.field param. This algorithm will
only be faster in the presence of rapid index changes.
(yonik)
- SOLR-1904: When facet.enum.cache.minDf > 0 and the base doc set is a
SortedIntSet, convert to HashDocSet for better performance.
(yonik)
- SOLR-2092: Speed up single-valued and multi-valued "fc" faceting. Typical
improvement is 5%, but can be much greater (up to 10x faster) when facet.offset
is very large (deep paging).
(yonik)
- SOLR-2193, SOLR-2565: The default Solr update handler has been improved so
that it uses fewer locks, keeps the IndexWriter open rather than closing it
on each commit (ie commits no longer wait for background merges to complete),
works with SolrCore to provide faster 'soft' commits, and has an improved API
that requires less instanceof special casing.
(Mark Miller, Robert Muir)
Additional Work:
-
SOLR-2697: commit and autocommit operations don't reset
DirectUpdateHandler2.numDocsPending stats attribute.
(Alexey Serba, Mark Miller)
- SOLR-2950: The QueryElevationComponent now avoids using the FieldCache and looking up
every document id
(gsingers, yonik)
- Bug Fixes (41)
- SOLR-3139: Make ConcurrentUpdateSolrServer send UpdateRequest.getParams()
as HTTP request params
(siren)
- SOLR-3165: Cannot use DIH in Solrcloud + Zookeeper
(Alexey Serba,
Mark Miller, siren)
- SOLR-3068: Occasional NPE in ThreadDumpHandler
(siren)
- SOLR-2762: FSTLookup could return duplicate results or one results less
than requested.
(David Smiley, Dawid Weiss)
- SOLR-2741: Bugs in facet range display in trunk
(janhoy)
- SOLR-1908: Fixed SignatureUpdateProcessor to fail to initialize on
invalid config. Specifically: a signatureField that does not exist,
or overwriteDupes=true with a signatureField that is not indexed.
(hossman)
- SOLR-1824: IndexSchema will now fail to initialize if there is a
problem initializing one of the fields or field types.
(hossman)
- SOLR-1928: TermsComponent didn't correctly break ties for non-text
fields sorted by count.
(yonik)
- SOLR-2107: MoreLikeThisHandler doesn't work with alternate qparsers.
(yonik)
- SOLR-2108: Fixed false positives when using wildcard queries on fields with reversed
wildcard support. For example, a query of *zemog* would match documents that contain
'gomez'.
(Landon Kuhn via Robert Muir)
- SOLR-1962: SolrCore#initIndex should not use a mix of indexPath and newIndexPath
(Mark Miller)
- SOLR-2275: fix DisMax 'mm' parsing to be tolerant of whitespace
(Erick Erickson via hossman)
- SOLR-2193, SOLR-2565, SOLR-2651: SolrCores now properly share IndexWriters across SolrCore reloads.
(Mark Miller, Robert Muir)
Additional Work:
-
SOLR-2705: On reload, IndexWriterProvider holds onto the initial SolrCore it was created with.
(Yury Kats, Mark Miller)
- SOLR-2682: Remove addException() in SimpleFacet. FacetComponent no longer catches and embeds
exceptions occurred during facet processing, it throws HTTP 400 or 500 exceptions instead.
(koji)
- SOLR-2654: Directorys used by a SolrCore are now closed when they are no longer used.
(Mark Miller)
- SOLR-2854: Now load URL content stream data (via stream.url) when called for during request handling,
rather than loading URL content streams automatically regardless of use.
(David Smiley and Ryan McKinley via ehatcher)
- SOLR-2829: Fix problem with false-positives due to incorrect
equals methods.
(Yonik Seeley, Hossman, Erick Erickson.
Marc Tinnemeyer caught the bug)
- SOLR-2848: Removed 'instanceof AbstractLuceneSpellChecker' hacks from distributed spellchecking code,
and added a merge() method to SolrSpellChecker instead. Previously if you extended SolrSpellChecker
your spellchecker would not work in distributed fashion.
(James Dyer via rmuir)
- SOLR-2509: StringIndexOutOfBoundsException in the spellchecker collate when the term contains
a hyphen.
(Thomas Gambier caught the bug, Steffen Godskesen did the patch, via Erick Erickson)
- SOLR-1730: Made it clearer when a core failed to load as well as better logging when the
QueryElevationComponent fails to properly initialize
(gsingers)
- SOLR-1520: QueryElevationComponent now supports non-string ids
(gsingers)
- SOLR-3037: When using binary format in solrj the codec screws up parameters
(Sami Siren, Jörg Maier via yonik)
- SOLR-3062: A join in the main query was not respecting any filters pushed
down to it via acceptDocs since LUCENE-1536.
(Mike Hugo, yonik)
- SOLR-3214: If you use multiple fl entries rather than a comma separated list, all but the first
entry can be ignored if you are using distributed search.
(Tomás Fernández Löbbe via Mark Miller)
- SOLR-3352: eDismax: pf2 should kick in for a query with 2 terms
(janhoy)
- SOLR-3361: ReplicationHandler "maxNumberOfBackups" doesn't work if backups are triggered on commit
(James Dyer, Tomás Fernández Löbbe)
- SOLR-2605: fixed tracking of the 'defaultCoreName' in CoreContainer so that
CoreAdminHandler could return consistent information regardless of whether
there is a a default core name or not.
(steffkes, hossman)
- SOLR-3370: fixed CSVResponseWriter to respect globs in the 'fl' param
(Keith Fligg via hossman)
- SOLR-3436: Group count incorrect when not all shards are queried in the second
pass.
(Francois Perron, Martijn van Groningen)
- SOLR-3454: Exception when using result grouping with main=true and using
wt=javabin.
(Ludovic Boutros, Martijn van Groningen)
- SOLR-3446: Better errors when PatternTokenizerFactory is configured with
an invalid pattern, and include the 'name' whenever possible in plugin init
error messages.
(hossman)
- LUCENE-4075: Cleaner path usage in TestXPathEntityProcessor
(Greg Bowyer via hossman)
- SOLR-2923: IllegalArgumentException when using useFilterForSortedQuery on an
empty index.
(Adrien Grand via Mark Miller)
- SOLR-2352: Fixed TermVectorComponent so that it will not fail if the fl
param contains globs or psuedo-fields
(hossman)
- SOLR-3541: add missing solrj dependencies to binary packages.
(Thijs Vonk via siren)
- SOLR-3522: fixed parsing of the 'literal()' function
(hossman)
- SOLR-3548: Fixed a bug in the cachability of queries using the {!join}
parser or the strdist() function, as well as some minor improvements to
the hashCode implementation of {!bbox} and {!geofilt} queries.
(hossman)
- SOLR-3470: contrib/clustering: custom Carrot2 tokenizer and stemmer factories
are respected now
(Stanislaw Osinski, Dawid Weiss)
- SOLR-3430: Added a new DIH test against a real SQL database. Fixed problems
revealed by this new test related to the expanded cache support added to
3.6/SOLR-2382
(James Dyer)
- SOLR-1958: When using the MailEntityProcessor, import would fail if
fetchMailsSince was not specified.
(Max Lynch via James Dyer)
- SOLR-4289: Admin UI - JVM memory bar - dark grey "used" width is too small
(steffkes, elyograg)
- Other Changes (48)
- SOLR-1846: Eliminate support for the abortOnConfigurationError
option. It has never worked very well, and in recent versions of
Solr hasn't worked at all.
(hossman)
- SOLR-1889: The default logic for the 'mm' param of DismaxQParser and
ExtendedDismaxQParser has been changed to be determined based on the
effective value of the 'q.op' param
(hossman)
- SOLR-1946: Misc improvements to the SystemInfoHandler: /admin/system
(hossman)
- SOLR-2289: Tweak spatial coords for example docs so they are a bit
more spread out
(Erick Erickson via hossman)
- SOLR-2288: Small tweaks to eliminate compiler warnings. primarily
using Generics where applicable in method/object declarations, and
adding @SuppressWarnings("unchecked") when appropriate
(hossman)
- SOLR-2375: Suggester Lookup implementations now store trie data
and load it back on init. This means that large tries don't have to be
rebuilt on every commit or core reload.
(ab)
- SOLR-2413: Support for returning multi-valued fields w/o <arr> tag
in the XMLResponseWriter was removed. XMLResponseWriter only
no longer work with values less then 2.2
(ryan)
- SOLR-2423: FieldType argument changed from String to Object
Conversion from SolrInputDocument > Object > Fieldable is now managed
by FieldType rather then DocumentBuilder.
(ryan)
- SOLR-2461: QuerySenderListener and AbstractSolrEventListener are
now public
(hossman)
- LUCENE-2995: Moved some spellchecker and suggest APIs to modules/suggest:
HighFrequencyDictionary, SortedIterator, TermFreqIterator, and the
suggester APIs and implementations.
(rmuir)
- SOLR-2576: Remove deprecated SpellingResult.add(Token, int).
(James Dyer via rmuir)
- LUCENE-3232: Moved MutableValue classes to new 'common' module.
(Chris Male)
- LUCENE-2883: FunctionQuery, DocValues (and its impls), ValueSource (and its
impls) and BoostedQuery have been consolidated into the queries module. They
can now be found at o.a.l.queries.function.
- SOLR-2027: FacetField.getValues() now returns an empty list if there are no
values, instead of null
(Chris Male)
- SOLR-1825: SolrQuery.addFacetQuery now enables facets automatically, like
addFacetField
(Chris Male)
- SOLR-2663: FieldTypePluginLoader has been refactored out of IndexSchema
and made public.
(hossman)
- SOLR-2331,SOLR-2691: Refactor CoreContainer's SolrXML serialization code and improve testing
(Yury Kats, hossman, Mark Miller)
- SOLR-2698: Enhance CoreAdmin STATUS command to return index size.
(Yury Kats, hossman, Mark Miller)
- SOLR-2654: The same Directory instance is now always used across a SolrCore so that
it's easier to add other DirectoryFactory's without static caching hacks.
(Mark Miller)
- LUCENE-3286: 'luke' ant target has been disabled due to incompatibilities with XML
queryparser location
(Chris Male)
- SOLR-1897: The data dir from the core descriptor should override the data dir from
the solrconfig.xml rather than the other way round.
(Mark Miller)
- SOLR-2756: Maven configuration: Excluded transitive stax:stax-api dependency
from org.codehaus.woodstox:wstx-asl dependency.
(David Smiley via Steve Rowe)
- SOLR-2588: Moved VelocityResponseWriter back to contrib module in order to
remove it as a mandatory core dependency.
(ehatcher)
- SOLR-2862: More explicit lexical resources location logged if Carrot2 clustering
extension is used. Fixed solr. impl. of IResource and IResourceLookup.
(Dawid Weiss)
- SOLR-1123: Changed JSONResponseWriter to now use application/json as its Content-Type
by default. However the Content-Type can be overwritten and is set to text/plain in
the example configuration.
(Uri Boness, Chris Male)
- SOLR-2607: Removed deprecated client/ruby directory, which included solr-ruby and flare.
(ehatcher)
- SOLR-3032: logOnce from SolrException logOnce and all the supporting
structure is gone. abortOnConfigurationError is also gone as it is no longer referenced.
Errors should be caught and logged at the top-most level or logged and NOT propagated up the
chain.
(Erick Erickson)
- SOLR-2105: Remove support for deprecated "update.processor" (since 3.2), in favor of
"update.chain"
(janhoy)
- SOLR-3005: Default QueryResponseWriters are now initialized via init() with an empty
NamedList.
(Gasol Wu, Chris Male)
- SOLR-2607: Removed obsolete client/ folder
(ehatcher, Eric Pugh, janhoy)
- SOLR-3202, SOLR-3244: Dropping Support for JSP. New Admin UI is all client side
(ryan, Aliaksandr Zhuhrou, Uwe Schindler)
- SOLR-3159: Upgrade example and tests to run with Jetty 8
(ryan)
- SOLR-3254: Upgrade Solr to Tika 1.1
(janhoy)
- SOLR-3329: Dropped getSourceID() from SolrInfoMBean and using
getClass().getPackage().getSpecificationVersion() for Version.
(ryan)
- SOLR-3302: Upgraded SLF4j to version 1.6.4
(hossman)
- SOLR-3322: Add more context to IndexReaderFactory.newReader
(ab)
- SOLR-3343: Moved FastWriter, FileUtils, RegexFileFilter, RTimer and SystemIdResolver
from org.apache.solr.common to org.apache.solr.util
(Chris Male)
- SOLR-3357: ResourceLoader.newInstance now accepts a Class representation of the expected
instance type
(Chris Male)
- SOLR-3388: HTTP caching is now disabled by default for RequestUpdateHandlers.
(ryan)
- SOLR-3309: web.xml now specifies metadata-complete=true (which requires
Servlet 2.5) to prevent servlet containers from scanning class annotations
on startup. This allows for faster startup times on some servlet containers.
(Bill Bell, hossman)
- SOLR-1893: Refactored some common code from LRUCache and FastLRUCache into
SolrCacheBase
(Tomás Fernández Löbbe via hossman)
- SOLR-3403: Deprecated Analysis Factories now log their own deprecation messages.
No logging support is provided by Factory parent classes.
(Chris Male)
- SOLR-1258: PingRequestHandler is now directly configured with a
"healthcheckFile" instead of looking for the legacy
<admin><healthcheck/></admin> syntax. Filenames specified as relative
paths have been fixed so that they are resolved against the data dir
instead of the CWD of the java process.
(hossman)
- SOLR-3083: JMX beans now report Numbers as numeric values rather then String
(Tagged Siteops, Greg Bowyer via ryan)
- SOLR-2796: Due to low level changes to support SolrCloud, the uniqueKey
field can no longer be populated via <copyField/> or <field default=...>
in the schema.xml.
- SOLR-3534: The Dismax and eDismax query parsers will fall back on the 'df' parameter
when 'qf' is absent. And if neither is present nor the schema default search field
then an exception will be thrown now.
(dsmiley)
- SOLR-3262: The "threads" feature of DIH is removed (deprecated in Solr 3.6)
(James Dyer)
- SOLR-3422: Refactored DIH internal data classes. All entities in
data-config.xml must have a name
(James Dyer)
- Documentation (1)
- SOLR-2232: Improved README info on solr.solr.home in examples
(Eric Pugh and hossman)
- Bug Fixes (2)
- SOLR-3790: ConcurrentModificationException could be thrown when using hl.fl=*.
(yonik, koji)
- SOLR-3589: Edismax parser does not honor mm parameter if analyzer splits a token.
(Tom Burton-West, Robert Muir)
- More information about this release, including any errata related to the
release notes, upgrade instructions, or other changes may be found online at:
https://wiki.apache.org/solr/Solr3.6.1
- Bug Fixes (11)
- LUCENE-3969: Throw IAE on bad arguments that could cause confusing errors in
PatternTokenizer. CommonGrams populates PositionLengthAttribute correctly.
(Uwe Schindler, Mike McCandless, Robert Muir)
- SOLR-3361: ReplicationHandler "maxNumberOfBackups" doesn't work if backups are triggered on commit
(James Dyer, Tomás Fernández Löbbe)
- SOLR-3375: Fix charset problems with HttpSolrServer
(Roger Håkansson, yonik, siren)
- SOLR-3436: Group count incorrect when not all shards are queried in the second
pass.
(Francois Perron, Martijn van Groningen)
- SOLR-3454: Exception when using result grouping with main=true and using
wt=javabin.
(Ludovic Boutros, Martijn van Groningen)
- SOLR-3489: Config file replication less error prone
(Jochen Just via janhoy)
- SOLR-3477: SOLR does not start up when no cores are defined
(Tomás Fernández Löbbe via tommaso)
- SOLR-3470: contrib/clustering: custom Carrot2 tokenizer and stemmer factories
are respected now
(Stanislaw Osinski, Dawid Weiss)
- SOLR-3360: More DIH bug fixes for the deprecated "threads" parameter.
(Mikhail Khludnev, Claudio R, via James Dyer)
- SOLR-3430: Added a new DIH test against a real SQL database. Fixed problems
revealed by this new test related to the expanded cache support added to
3.6/SOLR-2382
(James Dyer)
- SOLR-3336: SolrEntityProcessor substitutes most variables at query time.
(Michael Kroh, Lance Norskog, via Martijn van Groningen)
- More information about this release, including any errata related to the
release notes, upgrade instructions, or other changes may be found online at:
https://wiki.apache.org/solr/Solr3.6
- Upgrading from Solr 3.5 (9)
- SOLR-2983: As a consequence of moving the code which sets a MergePolicy from SolrIndexWriter to SolrIndexConfig,
(custom) MergePolicies should now have an empty constructor; thus an IndexWriter should not be passed as constructor
parameter but instead set using the setIndexWriter() method.
- As doGet() methods in SimplePostTool was changed to static, the client applications of this
class need to be recompiled.
- In Solr version 3.5 and earlier, HTMLStripCharFilter had known bugs in the
character offsets it provided, triggering e.g. exceptions in highlighting.
HTMLStripCharFilter has been re-implemented, addressing this and other
issues. See the entry for LUCENE-3690 in the Bug Fixes section below for a
detailed list of changes. For people who depend on the behavior of
HTMLStripCharFilter in Solr version 3.5 and earlier: the old implementation
(bugs and all) is preserved as LegacyHTMLStripCharFilter.
- As of Solr 3.6, the <indexDefaults> and <mainIndex> sections of solrconfig.xml are deprecated
and replaced with a new <indexConfig> section. Read more in SOLR-1052 below.
- SOLR-3040: The DIH's admin UI (dataimport.jsp) now requires DIH request handlers to start with
a '/'.
(dsmiley)
- SOLR-3161: <requestDispatcher handleSelect="false"> is now the default. An existing config will
probably work as-is because handleSelect was explicitly enabled in default configs. HandleSelect
makes /select work as well as enables the 'qt' parameter. Instead, consider explicitly
configuring /select as is done in the example solrconfig.xml, and register your other search
handlers with a leading '/' which is a recommended practice.
(David Smiley, Erik Hatcher)
- SOLR-3161: Don't use the 'qt' parameter with a leading '/'. It probably won't work in 4.0
and it's now limited in 3.6 to SearchHandler subclasses that aren't lazy-loaded.
- SOLR-2724: Specifying <defaultSearchField> and <solrQueryParser defaultOperator="..."/> in
schema.xml is now considered deprecated. Instead you are encouraged to specify these via the "df"
and "q.op" parameters in your request handler definition.
(David Smiley)
- Bugs found and fixed in the SignatureUpdateProcessor that previously caused
some documents to produce the same signature even when the configured fields
contained distinct (non-String) values. Users of SignatureUpdateProcessor
are strongly advised that they should re-index as document signatures may
have now changed. (see SOLR-3200 & SOLR-3226 for details)
- New Features (31)
- SOLR-2020: Add Java client that uses Apache Http Components http client (4.x).
(Chantal Ackermann, Ryan McKinley, Yonik Seeley, siren)
- SOLR-2854: Now load URL content stream data (via stream.url) when called for during request handling,
rather than loading URL content streams automatically regardless of use.
(David Smiley and Ryan McKinley via ehatcher)
- SOLR-2904: BinaryUpdateRequestHandler should be able to accept multiple update requests from
a stream
(shalin)
- SOLR-1565: StreamingUpdateSolrServer supports RequestWriter API and therefore, javabin update
format
(shalin)
- SOLR-2438 added MultiTermAwareComponent to the various classes to allow automatic lowercasing
for multiterm queries (wildcards, regex, prefix, range, etc). You can now optionally specify a
"multiterm" analyzer in our schema.xml, but Solr should "do the right thing" if you don't
specify <fieldType="multiterm">
(Pete Sturge Erick Erickson, Mentoring from Seeley and Muir)
- SOLR-2919: Added support for localized range queries when the analysis chain uses
CollationKeyFilter or ICUCollationKeyFilter.
(Michael Sokolov, rmuir)
- SOLR-2982: Added BeiderMorseFilterFactory for Beider-Morse (BMPM) phonetic encoder. Upgrades
commons-codec to version 1.6
(Brooke Schreier Ganz, rmuir)
- SOLR-1843: A new "rootName" attribute is now available when
configuring <jmx/> in solrconfig.xml. If this attribute is set,
Solr will use it as the root name for all MBeans Solr exposes via
JMX. The default root name is "solr" followed by the core name.
(Constantijn Visinescu, hossman)
- SOLR-2906: Added LFU cache options to Solr.
(Shawn Heisey via Erick Erickson)
- SOLR-3036: Ability to specify overwrite=false on the URL for XML updates.
(Sami Siren via yonik)
- SOLR-2603: Add the encoding function for alternate fields in highlighting.
(Massimo Schiavon, koji)
- SOLR-1729: Evaluation of NOW for date math is done only once per request for
consistency, and is also propagated to shards in distributed search.
Adding a parameter NOW=<time_in_ms> to the request will override the
current time.
(Peter Sturge, yonik, Simon Willnauer)
- SOLR-1709: Distributed support for Date and Numeric Range Faceting
(Peter Sturge, David Smiley, hossman, Simon Willnauer)
- SOLR-3054, LUCENE-3671: Add TypeTokenFilterFactory that creates TypeTokenFilter
that filters tokens based on their TypeAttribute.
(Tommaso Teofili via
Uwe Schindler)
- LUCENE-3305, SOLR-3056: Added Kuromoji morphological analyzer for Japanese.
See the 'text_ja' fieldtype in the example to get started.
(Christian Moen, Masaru Hasegawa via Robert Muir)
- SOLR-1860: StopFilterFactory, CommonGramsFilterFactory, and
CommonGramsQueryFilterFactory can optionally read stopwords in Snowball
format (specify format="snowball").
(Robert Muir)
- SOLR-3105: ElisionFilterFactory optionally allows the parameter
ignoreCase (default=false).
(Robert Muir)
- LUCENE-3714: Add WFSTLookupFactory, a suggester that uses a weighted FST
for more fine-grained suggestions.
(Mike McCandless, Dawid Weiss, Robert Muir)
- SOLR-3143: Add SuggestQueryConverter, a QueryConverter intended for
auto-suggesters.
(Robert Muir)
- SOLR-3033: ReplicationHandler's backup command now supports a 'maxNumberOfBackups'
init param that can be used to delete all but the most recent N backups.
(Torsten Krah, James Dyer)
- SOLR-2202: Currency FieldType, whith support for currencies and exchange rates
(Greg Fodor & Andrew Morrison via janhoy, rmuir, Uwe Schindler)
- SOLR-3026: eDismax: Locking down which fields can be explicitly queried (user fields aka uf)
(janhoy, hossmann, Tomás Fernández Löbbe)
- SOLR-2826: URLClassify Update Processor
(janhoy)
- SOLR-2764: Create a NorwegianLightStemmer and NorwegianMinimalStemmer
(janhoy)
- SOLR-3221: Added the ability to directly configure aspects of the concurrency
and thread-pooling used within distributed search in solr. This allows for finer
grained controlled and can be tuned by end users to target their own specific
requirements. This builds on the work of the HttpCommComponent and uses the same configuration
block to configure the thread pool. The default configuration has
the same behaviour as solr 3.5, favouring throughput over latency. More
information can be found on the wiki (http://wiki.apache.org/solr/SolrConfigXml)
(Greg Bowyer)
- SOLR-2001: The query component will substitute an empty query that matches
no documents if the query parser returns null. This also prevents an
exception from being thrown by the default parser if "q" is missing.
(yonik)
-
SOLR-435: if q is "" then it's also acceptable.
(dsmiley, hoss)
- SOLR-2919: Added parametric tailoring options to ICUCollationKeyFilterFactory.
These can be used to customize range query/sort behavior, for example to
support numeric collation, ignore punctuation/whitespace, ignore accents but
not case, control whether upper/lowercase values are sorted first, etc.
(rmuir)
- SOLR-2346: Add a chance to set content encoding explicitly via content type
of stream for extracting request handler. This is convenient when Tika's
auto detector cannot detect encoding, especially the text file is too short
to detect encoding.
(koji)
- SOLR-1499: Added SolrEntityProcessor that imports data from another Solr core
or instance based on a specified query.
(Lance Norskog, Erik Hatcher, Pulkit Singhal, Ahmet Arslan, Luca Cavanna,
Martijn van Groningen)
- SOLR-3190: Minor improvements to SolrEntityProcessor. Add more consistency
between solr parameters and parameters used in SolrEntityProcessor and
ability to specify a custom HttpClient instance.
(Luca Cavanna via Martijn van Groningen)
- SOLR-2382: Added pluggable cache support to DIH so that any Entity can be
made cache-able by adding the "cacheImpl" parameter. Include
"SortedMapBackedCache" to provide in-memory caching (as previously this was
the only option when using CachedSqlEntityProcessor). Users can provide
their own implementations of DIHCache for other caching strategies.
Deprecate CachedSqlEntityProcessor in favor of specifing "cacheImpl" with
SqlEntityProcessor. Make SolrWriter implement DIHWriter and allow the
possibility of pluggable Writers (DIH writing to something other than Solr).
(James Dyer, Noble Paul)
- Optimizations (3)
- SOLR-1931: Speedup for LukeRequestHandler and admin/schema browser. New parameter
reportDocCount defaults to 'false'. Old behavior still possible by specifying this as 'true'
(Erick Erickson)
- SOLR-3012: Move System.getProperty("type") in postData() to main() and add type argument so that
the client applications of SimplePostTool can set content type via method argument.
(koji)
- SOLR-2888: FSTSuggester refactoring: internal storage is now UTF-8,
external sorting (on disk) prevents OOMs even with large data sets
(the bottleneck is now FST construction), code cleanups and API cleanups.
(Dawid Weiss, Robert Muir)
- Bug Fixes (43)
- SOLR-3187 SystemInfoHandler leaks filehandles
(siren)
- LUCENE-3820: Fixed invalid position indexes by reimplementing PatternReplaceCharFilter.
This change also drops real support for boundary characters -- all input is prebuffered
for pattern matching.
(Dawid Weiss)
- SOLR-3068: Fixed NPE in ThreadDumpHandler
(siren)
- SOLR-2912: Fixed File descriptor leak in ShowFileRequestHandler
(Michael Ryan, shalin)
- SOLR-2819: Improved speed of parsing hex entities in HTMLStripCharFilter
(Bernhard Berger, hossman)
- SOLR-2509: StringIndexOutOfBoundsException in the spellchecker collate when the term contains
a hyphen.
(Thomas Gambier caught the bug, Steffen Godskesen did the patch, via Erick Erickson)
- SOLR-2955: Fixed IllegalStateException when querying with group.sort=score desc in sharded
environment.
(Steffen Elberg Godskesen, Martijn van Groningen)
- SOLR-2956: Fixed inconsistencies in the flags (and flag key) reported by
the LukeRequestHandler
(hossman)
- SOLR-1730: Made it clearer when a core failed to load as well as better logging when the
QueryElevationComponent fails to properly initialize
(gsingers)
- SOLR-1520: QueryElevationComponent now supports non-string ids
(gsingers)
- SOLR-3024: Fixed JSONTestUtil.matchObj, in previous releases it was not
respecting the 'delta' arg
(David Smiley via hossman)
- SOLR-2542: Fixed DIH Context variables which were broken for all scopes other
then SCOPE_ENTITY
(Linbin Chen & Frank Wesemann via hossman)
- SOLR-3042: Fixed Maven Jetty plugin configuration.
(David Smiley via Steve Rowe)
- SOLR-2970: CSV ResponseWriter returns fields defined as stored=false in schema
(janhoy)
- LUCENE-3690, LUCENE-2208, SOLR-882, SOLR-42: Re-implemented
HTMLStripCharFilter as a JFlex-generated scanner and moved it to
lucene/contrib/analyzers/common/. See below for a list of bug fixes and
other changes. To get the same behavior as HTMLStripCharFilter in Solr
version 3.5 and earlier (including the bugs), use LegacyHTMLStripCharFilter,
which is the previous implementation.
Behavior changes from the previous version:
-
Known offset bugs are fixed.
-
The "Mark invalid" exceptions reported in SOLR-1283 are no longer
triggered (the bug is still present in LegacyHTMLStripCharFilter).
-
The character entity "'" is now always properly decoded.
-
More cases of <script> tags are now properly stripped.
-
CDATA sections are now handled properly.
-
Valid tag name characters now include the supplementary Unicode characters
from Unicode character classes [:ID_Start:] and [:ID_Continue:].
-
Uppercase character entities """, "©", ">", "<", "®",
and "&" are now recognized and handled as if they were in lowercase.
-
The REPLACEMENT CHARACTER U+FFFD is now used to replace numeric character
entities for unpaired UTF-16 low and high surrogates (in the range
[U+D800-U+DFFF]).
-
Properly paired numeric character entities for UTF-16 surrogates are now
converted to the corresponding code units.
-
Opening tags with unbalanced quotation marks are now properly stripped.
-
Literal "<" and ">" characters in opening tags, regardless of whether they
appear inside quotation marks, now inhibit recognition (and stripping) of
the tags. The only exception to this is for values of event-handler
attributes, e.g. "onClick", "onLoad", "onSelect".
-
A newline '\n' is substituted instead of a space for stripped HTML markup.
-
Nothing is substituted for opening and closing inline tags - they are
simply removed. The list of inline tags is (case insensitively): <a>,
<abbr>, <acronym>, <b>, <basefont>, <bdo>, <big>, <cite>, <code>, <dfn>,
<em>, <font>, <i>, <img>, <input>, <kbd>, <label>, <q>, <s>, <samp>,
<select>, <small>, <span>, <strike>, <strong>, <sub>, <sup>, <textarea>,
<tt>, <u>, and <var>.
-
HTMLStripCharFilterFactory now handles HTMLStripCharFilter's "escapedTags"
feature: opening and closing tags with the given names, including any
attributes and their values, are left intact in the output.
(Steve Rowe)
- LUCENE-3717: Fixed offset bugs in TrimFilter, WordDelimiterFilter, and
HyphenatedWordsFilter where they would create invalid offsets in
some situations, leading to problems in highlighting.
(Robert Muir)
- SOLR-2280: commitWithin ignored for a delete query
(Juan Grande via janhoy)
- SOLR-3073: Fixed 'Invalid UUID string' error when having an UUID field as
the unique key and executing a distributed grouping request.
(Devon Krisman, Martijn van Groningen)
- SOLR-3084: Fixed initialization error when using
<queryResponseWriter default="true" ... />
(Bernd Fehling and hossman)
- SOLR-3109: Fixed numerous redundant shard requests when using distributed grouping.
(rblack via Martijn van Groningen)
- SOLR-3052: Fixed typo in distributed grouping parameters.
(Martijn van Groningen, Grant Ingersoll)
- SOLR-2909: Add support for ResourceLoaderAware tokenizerFactories in synonym
filter factories.
(Tom Klonikowski, Jun Ohtani via Koji Sekiguchi)
- SOLR-3168: ReplicationHandler "numberToKeep" & "maxNumberOfBackups" parameters
would keep only 1 backup, even if more than 1 was specified
(Neil Hooey, James Dyer)
- SOLR-3009: hitGrouped.vm isn't shipped with 3.x
(ehatcher, janhoy)
- SOLR-3195: timeAllowed is ignored for grouping queries
(Russell Black via Martijn van Groningen)
- SOLR-2124: Do not log stack traces for "Service Disabled" / 503 Exceptions (PingRequestHandler, etc)
(James Dyer, others)
- SOLR-3260: DataImportHandler: ScriptTransformer gives better error messages when
problems arise on initialization (no Script Engine, invalid script, etc).
(James Dyer)
- SOLR-2959: edismax now respects the magic fields '_val_' and '_query_'
(Michael Watts, hossman)
- SOLR-3074: fix SolrPluginUtils.docListToSolrDocumentList to respect the
list of fields specified. This fix also deprecates
DocumentBuilder.loadStoredFields which is not used anywhere in Solr,
and was fundamentally broken/bizarre.
(hossman, Ahmet Arslan)
- SOLR-2291: fix JSONWriter to respect field list when writing SolrDocuments
(Ahmet Arslan via hossman)
- SOLR-3264: Fix CoreContainer and SolrResourceLoader logging to be more
clear about when SolrCores are being created, and stop misleading people
about SolrCore instanceDir's being the "Solr Home Dir"
(hossman)
- SOLR-3046: Fix whitespace typo in DIH response "Time taken"
(hossman)
- SOLR-3261: Fix edismax to respect query operators when literal colons
are used in query string.
(Juan Grande via hossman)
- SOLR-3226: Fix SignatureUpdateProcessor to no longer ignore non-String
field values
(Spyros Kapnissis, hossman)
- SOLR-3200: Fix SignatureUpdateProcessor "all fields" mode to use all
fields of each document instead of the fields specified by the first
document indexed
(Spyros Kapnissis via hossman)
- SOLR-3316: Distributed grouping failed when rows parameter was set to 0 and
sometimes returned a wrong hit count as matches.
(Cody Young, Martijn van Groningen)
- SOLR-3107: contrib/langid: When using the LangDetect implementation of
langid, set the random seed to 0, so that the same document is detected as
the same language with the same probability every time.
(Christian Moen via rmuir)
- SOLR-2937: Configuring the number of contextual snippets used for
search results clustering. The hl.snippets parameter is now respected
by the clustering plugin, can be overridden by carrot.summarySnippets
if needed
(Stanislaw Osinski).
- SOLR-2938: Clustering on multiple fields. The carrot.title and
carrot.snippet can now take comma- or space-separated lists of
field names to cluster
(Stanislaw Osinski).
- SOLR-2939: Clustering of multilingual search results. The document's
language field be passed in the carrot.lang parameter, the carrot.lcmap
parameter enables mapping of language codes to ISO 639
(Stanislaw Osinski).
- SOLR-2940: Passing values for custom Carrot2 fields to Clustering component.
The custom field mapping are defined using the carrot.custom parameter
(Stanislaw Osinski).
- SOLR-2941: NullPointerException on clustering component initialization
when schema does not have a unique key field
(Stanislaw Osinski).
- SOLR-2942: ClassCastException when passing non-textual fields to
clustering component
(Stanislaw Osinski).
- Other Changes (16)
- SOLR-2922: Upgrade commons-io and commons-lang to 2.1 and 2.6, respectively.
(koji)
- SOLR-2920: Refactor frequent conditional use of DefaultSolrParams and
AppendedSolrParams into factory methods.
(David Smiley via hossman)
- SOLR-3032: Deprecate logOnce from SolrException logOnce and all the supporting
structure will disappear in 4.0. Errors should be caught and logged at the
top-most level or logged and NOT propagated up the chain.
(Erick Erickson)
- SOLR-2718: Add ability to lazy load response writers, defined with startup="lazy".
(ehatcher)
- SOLR-2901: Upgrade Solr to Tika 1.0
(janhoy)
- SOLR-3059: Example XSL stylesheet for indexing query result XML
(janhoy)
- SOLR-3097, SOLR-3105: Add analysis configurations for different languages to
the example.
(Christian Moen, Robert Muir)
- SOLR-3005: Default QueryResponseWriters are now initialized via init() with an empty
NamedList.
(Gasol Wu, Chris Male)
- SOLR-3140: Upgrade schema version to 1.5, where omitNorms defaults to "true" for all
primitive (non-analyzed) field types such as int, float, date, bool, string..
(janhoy)
- SOLR-3077: Better error messages when attempting to use "blank" field names
(Antony Stubbs via hossman)
- SOLR-2712: expecting fl=score to return all fields is now deprecated.
In solr 4.0, this will only return the score.
(ryan)
- SOLR-3156: Check for Lucene directory locks at startup. In previous versions
this check was only performed during modifying (e.g. adding and deleting
documents) the index.
(Luca Cavanna via Martijn van Groningen)
- SOLR-1052: Deprecated <indexDefaults> and <mainIndex> in solrconfig.xml
From now, all settings go in the new <indexConfig> tag, and some defaults are
changed: useCompoundFile=false, ramBufferSizeMB=32, lockType=native, so that
the effect of NOT specifying <indexConfig> at all gives same result as the
example config used to give in 3.5
(janhoy, gsingers)
- SOLR-3294: In contrib/clustering/lib/, replaced the manually retrowoven
Java 1.5-compatible carrot2-core-3.5.0.jar (which is not publicly available,
except from the Solr Subversion repository), with newly released Java
1.5-compatible carrot2-core-<IP_ADDRESS>.jar (hosted on the Maven Central
repository). Also updated dependencies jackson-core-asl and
jackson-mapper-asl (both v1.5.2 -> v1.7.4).
(Dawid Weiss, Steve Rowe)
- SOLR-3295: netcdf jar is excluded from the binary release (and disabled in
ivy.xml) because it requires java 6. If you want to parse this content with
extracting request handler and are willing to use java 6, just add the jar.
(rmuir)
- SOLR-3142: DIH Imports no longer default optimize to true, instead false.
If you want to force all segments to be merged into one, you can specify
this parameter yourself. NOTE: this can be very expensive operation and
usually does not make sense for delta-imports.
(Robert Muir)
- Build (5)
- SOLR-2487: Add build target to package war without slf4j jars
(janhoy)
- SOLR-3112: Fix tests not to write to src/test-files
(Luca Cavanna via Robert Muir)
- LUCENE-3753: Restructure the Solr build system.
(Steve Rowe)
- SOLR-3204: The packaged pre-release artifact of Commons CSV used the original
package name (org.apache.commons.csv). This created a compatibility issue as
the Apache Commons team works toward an official release of Commons CSV.
The source of Commons CSV was added under a separate package name to the
Solr source code.
(Uwe Schindler, Chris Male, Emmanuel Bourg)
- LUCENE-3930: Changed build system to use Apache Ivy for retrival of 3rd
party JAR files. Please review README.txt for instructions.
(Robert Muir, Chris Male, Uwe Schindler, Steven Rowe, Hossman)
- New Features (11)
- SOLR-2749: Add boundary scanners for FastVectorHighlighter. <boundaryScanner/>
can be specified with a name in solrconfig.xml, and use hl.boundaryScanner=name
parameter to specify the named <boundaryScanner/>.
(koji)
- SOLR-2066,SOLR-2776: Added support for distributed grouping.
(Martijn van Groningen, Jasper van Veghel, Matt Beaumont)
- SOLR-2769: Added factory for the new Hunspell stemmer capable of doing stemming
for 99 languages
(janhoy, cmale)
- SOLR-1979: New contrib "langid". Adds language identification capabilities as an
Update Processor, using Tika's LanguageIdentifier or Cybozu language-detection
library
(janhoy, Tommaso Teofili, gsingers)
- SOLR-2818: Added before/after count response parsing support for range facets in
SolrJ.
(Bernhard Frauendienst via Martijn van Groningen)
- SOLR-2276: Add support for cologne phonetic to PhoneticFilterFactory.
(Marc Pompl via rmuir)
- SOLR-1926: Add hl.q parameter.
(koji)
- SOLR-2881: Numeric types now support sortMissingFirst/Last. This includes Trie and date types
(Ryan McKinley, Mike McCandless, Uwe Schindler, Erick Erickson)
- SOLR-1023: StatsComponent now supports date fields and string fields.
(Chris Male, Mark Holland, Gunnlaugur Thor Briem, Ryan McKinley)
- SOLR-2578: ReplicationHandler's backup command now supports a 'numberToKeep'
request param that can be used to delete all but the most recent N backups.
(James Dyer via hossman)
- SOLR-2839: Add alternative implementation to contrib/langid supporting 53
languages, based on http://code.google.com/p/language-detection/
(rmuir)
- Optimizations (1)
- SOLR-2742: SolrJ: Provide commitWithinMs as optional parameter for all add() methods,
making the feature more conveniently accessible for developers
(janhoy)
- Bug Fixes (11)
- SOLR-2748: The CommitTracker used for commitWith or autoCommit by maxTime
could commit too frequently and could block adds until a new searcher was
registered.
(yonik)
- SOLR-2726: Fixed NullPointerException when using spellcheck.q with Suggester.
(Bernd Fehling, valentin via rmuir)
- SOLR-2772: Fixed Date parsing/formatting of years 0001-1000
(hossman)
- SOLR-2763: Extracting update request handler throws exception and returns 400
when zero-length file posted using multipart form post
(janhoy)
- SOLR-2780: Fixed issue where multi select facets didn't respect group.truncate parameter.
(Martijn van Groningen, Ramzi Alqrainy)
- SOLR-2793: In rare cases (most likely during shutdown), a SolrIndexSearcher can be left
open if the executor rejects a task.
(Mark Miller)
- SOLR-2791: Replication: abortfetch command is broken if replication was started
by fetchindex command instead of a regular poll
(Yury Kats via shalin)
- SOLR-2861: Fix extremely rare race condition on commit that can result
in a NPE
(yonik)
- SOLR-2813: Fix HTTP error codes returned when requests contain strings that
can not be parsed as numbers for Trie fields.
(Jeff Crump and hossman)
- SOLR-2902: List of collations are wrong parsed in SpellCheckResponse causing
a wrong number of collation results in the response.
(Bastiaan Verhoef, James Dyer via Simon Willnauer)
- SOLR-2875: Fix the incorrect url in DIH example tika-data-config.xml
(Shinichiro Abe via koji)
- Other Changes (13)
- SOLR-2750: Make both "update.chain" and the deprecated "update.param" work
consistently everywhere; see also SOLR-2105.
(Mark Miller, janhoy)
- LUCENE-3410: Deprecated the WordDelimiterFilter constructors accepting multiple
ints masquerading as booleans. Preferred constructor now accepts a single int
bitfield
(Chris Male)
- SOLR-2758: Moved ConcurrentLRUCache from o.a.s.common.util package in the solrj
module to the o.a.s.util package in the Solr core module.
(David Smiley via Steve Rowe)
- SOLR-2766: Package individual javadoc sites for solrj and test-framework.
(Steve Rowe, Mike McCandless)
- SOLR-2771: Solr modules' tests should not depend on solr-core test classes;
move BufferingRequestProcessor from solr-core tests to test-framework so that
the Solr Cell module can use it.
(janhoy, Steve Rowe)
- LUCENE-3457: Upgrade commons-compress to 1.2
(Doron Cohen)
- SOLR-2757: min() and max() functions now support an arbitrary number of
ValueSources
(Bill Bell via hossman)
- SOLR-2372: Upgrade Solr to Tika 0.10
(janhoy)
- SOLR-2792: Allow case insensitive Hunspell stemming
(janhoy, rmuir)
- SOLR-2862: More explicit lexical resources location logged if Carrot2 clustering
extension is used. Fixed solr. impl. of IResource and IResourceLookup.
(Dawid Weiss)
- SOLR-2849: Fix dependencies in Maven POMs.
(David Smiley via Steve Rowe)
- SOLR-2591: Remove commitLockTimeout option from solrconfig.xml
(Luca Cavanna via Martijn van Groningen)
- SOLR-2746: Upgraded UIMA dependencies from *-2.3.1-SNAPSHOT.jar to *-2.3.1.jar.
- Upgrading from Solr 3.3 (3)
- The Lucene index format has changed and as a result, once you upgrade,
previous versions of Solr will no longer be able to read your indices.
In a master/slave configuration, all searchers/slaves should be upgraded
before the master. If the master were to be updated first, the older
searchers would not be able to read the new index format.
- Previous versions of Solr silently allow and ignore some contradictory
properties specified in schema.xml. For example:
-
indexed="false" omitNorms="false"
-
indexed="false" omitTermFreqAndPositions="false"
Field property validation has now been fixed, to ensure that
contradictions like these now generate error messages. If users
have existing schemas that generate one of these new "conflicting
'false' field options for non-indexed field" error messages the
conflicting "omit*" properties can safely be removed, or changed to
"true" for consistent behavior with previous Solr versions. This
situation has now been fixed to cause an error on startup when these
contradictory options. See SOLR-2669.
- FacetComponent no longer catches and embeds exceptions occurred during facet
processing, it throws HTTP 400 or 500 exceptions instead.
- New Features (14)
- SOLR-2540: CommitWithin as an Update Request parameter
You can now specify &commitWithin=N (ms) on the update request
(janhoy)
- SOLR-2458: post.jar enhanced to handle JSON, CSV and <optimize>
(janhoy)
- LUCENE-3234: add a new parameter hl.phraseLimit for FastVectorHighlighter speed up.
(Mike Sokolov via koji)
- SOLR-2429: Ability to add cache=false to queries and query filters to avoid
using the filterCache or queryCache. A cost may also be specified and is used
to order the evaluation of non-cached filters from least to greatest cost .
For very expensive query filters (cost >= 100) if the query implements
the PostFilter interface, it will be used to obtain a Collector that is
checked only for documents that match the main query and all other filters.
The "frange" query now implements the PostFilter interface.
(yonik)
- SOLR-2630: Added new XsltUpdateRequestHandler that works like
XmlUpdateRequestHandler but allows to transform the POSTed XML document
using XSLT. This allows to POST arbitrary XML documents to the update
handler, as long as you also provide a XSL to transform them to a valid
Solr input document.
(Upayavira, Uwe Schindler)
- SOLR-2615: Log individual updates (adds and deletes) at the FINE level
before adding to the index. Fix a null pointer exception in logging
when there was no unique key.
(David Smiley via yonik)
- LUCENE-2048: Added omitPositions to the schema, so you can omit position
information while still indexing term frequencies.
(rmuir)
- SOLR-2584: add UniqFieldsUpdateProcessor that removes duplicate values in the
specified fields.
(Elmer Garduno, koji)
- SOLR-2670: Added NIOFSDirectoryFactory
(yonik)
- SOLR-2523: Added support in SolrJ to easily interact with range facets.
The range facet response can be parsed and is retrievable from the
QueryResponse class. The SolrQuery class has convenient methods for using
range facets.
(Martijn van Groningen)
- SOLR-2637: Added support for group result parsing in SolrJ.
(Tao Cheng, Martijn van Groningen)
- SOLR-2665: Added post group faceting. Facet counts are based on the most
relevant document of each group matching the query. This feature has the
same impact on the StatsComponent.
(Martijn van Groningen)
- SOLR-2675: CoreAdminHandler now allows arbitrary properties to be
specified when CREATEing a new SolrCore using property.* request
params.
(Yury Kats, hossman)
- SOLR-2714: JSON update format - "null" field values are now dropped
instead of causing an exception.
(Trygve Laugstøl, yonik)
- Optimizations (1)
- LUCENE-3233: Improved memory usage, build time, and performance of
SynonymFilterFactory.
(Mike McCandless, Robert Muir)
- Bug Fixes (24)
- SOLR-2625: TermVectorComponent throws NPE if TF-IDF option is used without DF
option.
(Daniel Erenrich, Simon Willnauer)
- SOLR-2631: PingRequestHandler should not allow to ping itself using "qt"
param to prevent infinite loop.
(Edoardo Tosca, Uwe Schindler)
- SOLR-2636: Fix explain functionality for negative queries.
(Tom Hill via yonik)
- SOLR-2538: Range Faceting on long/double fields could overflow if values
bigger then the max int/float were used.
(Erbi Hanka, hossman)
- SOLR-2230: CommonsHttpSolrServer.addFile could not be used to send
multiple files in a single request.
(Stephan Günther, hossman)
- SOLR-2541: PluginInfos was not correctly parsing <long/> tags when
initializing plugins
(Frank Wesemann, hossman)
- SOLR-2623: Solr JMX MBeans do not survive core reloads
(Alexey Serba, shalin)
- Fixed grouping bug when start is bigger than rows and format is simple that zero documents are returned even
if there are documents to display.
(Martijn van Groningen, Nikhil Chhaochharia)
- SOLR-2564: Fixed ArrayIndexOutOfBoundsException when using simple format and
start > 0
(Martijn van Groningen, Matteo Melli)
- SOLR-2642: Fixed sorting by function when using grouping.
(Thomas Heigl, Martijn van Groningen)
- SOLR-2535: REGRESSION: in Solr 3.x and trunk the admin/file handler
fails to show directory listings
(David Smiley, Peter Wolanin via Erick Erickson)
- SOLR-2545: ExternalFileField file parsing would fail if any key
contained an "=" character. It now only looks for the last "=" delimiter
prior to the float value.
(Markus Jelsma, hossman)
- SOLR-2662: When Solr is configured to have no queryResultCache, the
"start" parameter was not honored and the documents returned were
0 through start+offset.
(Markus Jelsma, yonik)
- SOLR-2669: Fix backwards validation of field properties in
SchemaField.calcProps
(hossman)
- SOLR-2676: Add "welcome-file-list" to solr.war so admin UI works correctly
in servlet containers such as WebSphere that do not use a default list
(Jay R. Jaeger, hossman)
- SOLR-2606: Fixed sort parsing of fields containing punctuation that
failed due to sort by function changes introduced in SOLR-1297
(Mitsu Hadeishi, hossman)
- SOLR-2706: contrib/clustering: The carrot.lexicalResourcesDir parameter
now works with absolute directories
(Stanislaw Osinski)
- SOLR-2692: contrib/clustering: Typo in param name fixed: "carrot.fragzise"
changed to "carrot.fragSize"
(Stanislaw Osinski).
- SOLR-2644: When using DIH with threads=2 the default logging is set too high
(Bill Bell via shalin)
- SOLR-2492: DIH does not commit if only deletes are processed
(James Dyer via shalin)
- SOLR-2186: DataImportHandler's multi-threaded option throws NPE
(Lance Norskog, Frank Wesemann, shalin)
- SOLR-2655: DIH multi threaded mode does not resolve attributes correctly
(Frank Wesemann, shalin)
- SOLR-2695: DIH: Documents are collected in unsynchronized list in
multi-threaded debug mode
(Michael McCandless, shalin)
- SOLR-2668: DIH multithreaded mode does not rollback on errors from
EntityProcessor
(Frank Wesemann, shalin)
- Other Changes (2)
- SOLR-2629: Eliminate deprecation warnings in some JSPs.
(Bernd Fehling, hossman)
- SOLR-2743: Remove commons logging from contrib/extraction.
(koji)
- Build (2)
- SOLR-2452,SOLR-2653,LUCENE-3323,SOLR-2659,LUCENE-3329,SOLR-2666:
Rewrote the Solr build system:
-
Integrated more fully with the Lucene build system: generalized the
Lucene build system and eliminated duplication.
-
Converted all Solr contribs to the Lucene/Solr conventional src/ layout:
java/, resources/, test/, and test-files/<contrib-name>.
-
Created a new Solr-internal module named "core" by moving the java/,
test/, and test-files/ directories from solr/src/ to solr/core/src/.
-
Merged solr/src/webapp/src/ into solr/core/src/java/.
-
Eliminated solr/src/ by moving all its directories up one level;
renamed solr/src/site/ to solr/site-src/ because solr/site/ already
exists.
-
Merged solr/src/common/ into solr/solrj/src/java/.
-
Moved o.a.s.client.solrj.* and o.a.s.common.* tests from
solr/src/test/ to solr/solrj/src/test/.
-
Made the solrj tests not depend on the solr core tests by moving
some classes from solr/src/test/ to solr/test-framework/src/java/.
-
Each internal module (core/, solrj/, test-framework/, and webapp/)
now has its own build.xml, from which it is possible to run
module-specific targets. solr/build.xml delegates all build
tasks (via <ant dir="internal-module-dir"> calls) to these
modules' build.xml files.
(Steve Rowe, Robert Muir)
- LUCENE-3406: Add ant target 'package-local-src-tgz' to Lucene and Solr
to package sources from the local working copy.
(Seung-Yeoul Yang via Steve Rowe)
- Documentation (none)
- Upgrading from Solr 3.2.0 (1)
- SolrCore's CloseHook API has been changed in a backward-incompatible way. It
has been changed from an interface to an abstract class. Any custom
components which use the SolrCore.addCloseHook method will need to
be modified accordingly. To migrate, put your old CloseHook#close impl into
CloseHook#preClose.
- New Features (7)
- SOLR-2378: A new, automaton-based, implementation of suggest (autocomplete)
component, offering an order of magnitude smaller memory consumption
compared to ternary trees and jaspell and very fast lookups at runtime.
(Dawid Weiss)
- SOLR-2400: Field- and DocumentAnalysisRequestHandler now provide a position
history for each token, so you can follow the token through all analysis stages.
The output contains a separate int[] attribute containing all positions from
previous Tokenizers/TokenFilters (called "positionHistory").
(Uwe Schindler)
- SOLR-2524: (SOLR-236, SOLR-237, SOLR-1773, SOLR-1311) Grouping / Field collapsing
using the Lucene grouping contrib. The search result can be grouped by field and query.
(Martijn van Groningen, Emmanuel Keller, Shalin Shekhar Mangar, Koji Sekiguchi,
Iván de Prado, Ryan McKinley, Marc Sturlese, Peter Karich, Bojan Smid,
Charles Hornberger, Dieter Grad, Dmitry Lihachev, Doug Steigerwald,
Karsten Sperling, Michael Gundlach, Oleg Gnatovskiy, Thomas Traeger,
Harish Agarwal, yonik, Michael McCandless, Bill Bell)
- SOLR-1331 -- Added a srcCore parameter to CoreAdminHandler's mergeindexes action
to merge one or more cores' indexes to a target core
(shalin)
- SOLR-2610 -- Add an option to delete index through CoreAdmin UNLOAD action
(shalin)
- SOLR-2480: Add ignoreTikaException flag to the extraction request handler so
that users can ignore TikaException but index meta data.
(Shinichiro Abe, koji)
- SOLR-2582: Use uniqueKey for error log in UIMAUpdateRequestProcessor.
(Tommaso Teofili via koji)
- Optimizations (1)
- SOLR-2567: Solr now defaults to TieredMergePolicy. See http://s.apache.org/merging
for more information.
(rmuir)
- Bug Fixes (5)
- SOLR-2519: Improve text_* fieldTypes in example schema.xml: improve
cross-language defaults for text_general; break out separate
English-specific fieldTypes
(Jan Høydahl, hossman, Robert Muir,
yonik, Mike McCandless)
- SOLR-2462: Fix extremely high memory usage problems with spellcheck.collate.
Separately, an additional spellcheck.maxCollationEvaluations (default=10000)
parameter is added to avoid excessive CPU time in extreme cases (e.g. long
queries with many misspelled words).
(James Dyer via rmuir)
- SOLR-2579: UIMAUpdateRequestProcessor ignore error fails if text.length() < 100.
(Elmer Garduno via koji)
- SOLR-2581: UIMAToSolrMapper wrongly instantiates Type with reflection.
(Tommaso Teofili via koji)
- SOLR-2551: Check dataimport.properties for write access (if delta-import is
supported in DIH configuration) before starting an import
(C S, shalin)
- Other Changes (5)
- SOLR-2571: Add a commented out example of the spellchecker's thresholdTokenFrequency
parameter to the example solrconfig.xml, and also add a unit test for this feature.
(James Dyer via rmuir)
- SOLR-2576: Deprecate SpellingResult.add(Token token, int docFreq), please use
SpellingResult.addFrequency(Token token, int docFreq) instead.
(James Dyer via rmuir)
- SOLR-2574: Upgrade slf4j to v1.6.1
(shalin)
- LUCENE-3204: The maven-ant-tasks jar is now included in the source tree;
users of the generate-maven-artifacts target no longer have to manually
place this jar in the Ant classpath. NOTE: when Ant looks for the
maven-ant-tasks jar, it looks first in its pre-existing classpath, so
any copies it finds will be used instead of the copy included in the
Lucene/Solr source tree. For this reason, it is recommeded to remove
any copies of the maven-ant-tasks jar in the Ant classpath, e.g. under
~/.ant/lib/ or under the Ant installation's lib/ directory.
(Steve Rowe)
- SOLR-2611: Fix typos in the example configuration
(Eric Pugh via rmuir)
- Versions of Major Components (3)
- Apache Lucene trunk
- Apache Tika 0.8
- Carrot2 3.4.2
- Upgrading from Solr 3.1 (2)
- The updateRequestProcessorChain for a RequestHandler is now defined
with update.chain rather than update.processor. The latter still works,
but has been deprecated.
- <uimaConfig/> just beneath <config> ... </config> is no longer supported.
It should move to UIMAUpdateRequestProcessorFactory setting.
See contrib/uima/README.txt for more details. (SOLR-2436)
Detailed Change List
- New Features (6)
- SOLR-2496: Add ability to specify overwrite and commitWithin as request
parameters (e.g. specified in the URL) when using the JSON update format,
and added a simplified format for specifying multiple documents.
Example: [{"id":"doc1"},{"id":"doc2"}]
(yonik)
- SOLR-2113: Add TermQParserPlugin, registered as "term". This is useful
when generating filter queries from terms returned from field faceting or
the terms component. Example: fq={!term f=weight}1.5
(hossman, yonik)
- SOLR-1915: DebugComponent now supports using a NamedList to model
Explanation objects in its responses instead of
Explanation.toString
(hossman)
- SOLR-2448: Search results clustering updates: bisecting k-means
clustering algorithm added, loading of Carrot2 stop words from
<solr.home>/conf/carrot2 (SOLR-2449), using Solr's stopwords.txt
for clustering (SOLR-2450), output of cluster scores (SOLR-2505)
(Stanislaw Osinski, Dawid Weiss).
- SOLR-2503: extend UIMAUpdateRequestProcessorFactory mapping function to
map feature value to dynamicField.
(koji)
- SOLR-2512: add ignoreErrors flag to UIMAUpdateRequestProcessorFactory so
that users can ignore exceptions in AE.
(Tommaso Teofili, koji)
- Optimizations (none)
- Bug Fixes (17)
- SOLR-2445: Change the default qt to blank in form.jsp, because there is no "standard"
request handler unless you have it in your solrconfig.xml explicitly.
(koji)
- SOLR-2455: Prevent double submit of forms in admin interface.
(Jeffrey Chang via uschindler)
- SOLR-2464: Fix potential slowness in QueryValueSource (the query() function) when
the query is very sparse and may not match any documents in a segment.
(yonik)
- SOLR-2469: When using java replication with replicateAfter=startup, the first
commit point on server startup is never removed.
(yonik)
- SOLR-2466: SolrJ's CommonsHttpSolrServer would retry requests on failure, regardless
of the configured maxRetries, due to HttpClient having its own retry mechanism
by default. The retryCount of HttpClient is now set to 0, and SolrJ does
the retry.
(yonik)
- SOLR-2409: edismax parser - treat the text of a fielded query as a literal if the
fieldname does not exist. For example Mission: Impossible should not search on
the "Mission" field unless it's a valid field in the schema.
(Ryan McKinley, yonik)
- SOLR-2403: facet.sort=index reported incorrect results for distributed search
in a number of scenarios when facet.mincount>0. This patch also adds some
performance/algorithmic improvements when (facet.sort=count && facet.mincount=1
&& facet.limit=-1) and when (facet.sort=index && facet.mincount>0)
(yonik)
- SOLR-2333: The "rename" core admin action does not persist the new name to solr.xml
(Rasmus Hahn, Paul R. Brown via Mark Miller)
- SOLR-2390: Performance of usePhraseHighlighter is terrible on very large Documents,
regardless of hl.maxDocCharsToAnalyze.
(Mark Miller)
- SOLR-2474: The helper TokenStreams in analysis.jsp and AnalysisRequestHandlerBase
did not clear all attributes so they displayed incorrect attribute values for tokens
in later filter stages.
(uschindler, rmuir, yonik)
- SOLR-2467: Fix <analyzer class="..." /> initialization so any errors
are logged properly.
(hossman)
- SOLR-2493: SolrQueryParser was fixed to not parse the SolrConfig DOM tree on each
instantiation which is a huge slowdown.
(Stephane Bailliez via uschindler)
- SOLR-2495: The JSON parser could hang on corrupted input and could fail
to detect numbers that were too large to fit in a long.
(yonik)
- SOLR-2520: Make JSON response format escape \u2029 as well as \u2028
in strings since those characters are not valid in javascript strings
(although they are valid in JSON strings).
(yonik)
- SOLR-2536: Add ReloadCacheRequestHandler to fix ExternalFileField bug (if reopenReaders
set to true and no index segments have been changed, commit cannot trigger reload
external file).
(koji)
- SOLR-2539: VectorValueSource.floatVal incorrectly used byteVal on sub-sources.
(Tom Liu via yonik)
- SOLR-2554: RandomSortField didn't work when used in a function query.
(yonik)
- Other Changes (7)
- SOLR-2061: Pull base tests out into a new Solr Test Framework module,
and publish binary, javadoc, and source test-framework jars.
(Drew Farris, Robert Muir, Steve Rowe)
- SOLR-2105: Rename RequestHandler param 'update.processor' to 'update.chain'.
(Jan Høydahl via Mark Miller)
- SOLR-2485: Deprecate BaseResponseWriter, GenericBinaryResponseWriter, and
GenericTextResponseWriter. These classes will be removed in 4.0.
(ryan)
- SOLR-2451: Enhance assertJQ to allow individual tests to specify the
tolerance delta used in numeric equalities. This allows for slight
variance in asserting score comparisons in unit tests.
(David Smiley, Chris Hostetter)
- SOLR-2528: Remove default="true" from HtmlEncoder in example solrconfig.xml,
because html encoding confuses non-ascii users.
(koji)
- SOLR-2387: add mock annotators for improved testing in contrib/uima,
(Tommaso Teofili via rmuir)
- SOLR-2436: move uimaConfig to under the uima's update processor in
solrconfig.xml.
(Tommaso Teofili, koji)
- Build (1)
- LUCENE-3006: Building javadocs will fail on warnings by default. Override with -Dfailonjavadocwarning=false
(sarowe, gsingers)
- Documentation (none)
- Versions of Major Components (5)
- Apache Lucene 3.1.0
- Apache Tika 0.8
- Carrot2 3.4.2
- Velocity 1.6.1 and Velocity Tools 2.0-beta3
- Apache UIMA 2.3.1-SNAPSHOT
- Upgrading from Solr 1.4 (13)
- The Lucene index format has changed and as a result, once you upgrade,
previous versions of Solr will no longer be able to read your indices.
In a master/slave configuration, all searchers/slaves should be upgraded
before the master. If the master were to be updated first, the older
searchers would not be able to read the new index format.
- The Solr JavaBin format has changed as of Solr 3.1. If you are using the
JavaBin format, you will need to upgrade your SolrJ client. (SOLR-2034)
- The experimental ALIAS command has been removed (SOLR-1637)
- Using solr.xml is recommended for single cores also (SOLR-1621)
- Old syntax of <highlighting> configuration in solrconfig.xml
is deprecated (SOLR-1696)
- The deprecated HTMLStripReader, HTMLStripWhitespaceTokenizerFactory and
HTMLStripStandardTokenizerFactory were removed. To strip HTML tags,
HTMLStripCharFilter should be used instead, and it works with any
Tokenizer of your choice. (SOLR-1657)
- Field compression is no longer supported. Fields that were formerly
compressed will be uncompressed as index segments are merged. For
shorter fields, this may actually be an improvement, as the compression
used was not very good for short text. Some indexes may get larger though.
- SOLR-1845: The TermsComponent response format was changed so that the
"terms" container is a map instead of a named list. This affects
response formats like JSON, but not XML.
(yonik)
- SOLR-1876: All Analyzers and TokenStreams are now final to enforce
the decorator pattern.
(rmuir, uschindler)
- LUCENE-2608: Added the ability to specify the accuracy on a per request basis.
It is recommended that implementations of SolrSpellChecker should change over to the new SolrSpellChecker
methods using the new SpellingOptions class, but are not required to. While this change is
backward compatible, the trunk version of Solr has already dropped support for all but the SpellingOptions method.
(gsingers)
- readercycle script was removed. (SOLR-2046)
- In previous releases, sorting or evaluating function queries on
fields that were "multiValued" (either by explicit declaration in
schema.xml or by implict behavior because the "version" attribute on
the schema was less then 1.2) did not generally work, but it would
sometimes silently act as if it succeeded and order the docs
arbitrarily. Solr will now fail on any attempt to sort, or apply a
function to, multi-valued fields
- The DataImportHandler jars are no longer included in the solr
WAR and should be added in Solr's lib directory, or referenced
via the <lib> directive in solrconfig.xml.
Detailed Change List
- New Features (71)
- SOLR-1302: Added several new distance based functions, including
Great Circle (haversine), Manhattan, Euclidean and String (using the
StringDistance methods in the Lucene spellchecker).
Also added geohash(), deg() and rad() convenience functions.
See http://wiki.apache.org/solr/FunctionQuery.
(gsingers)
- SOLR-1553: New dismax parser implementation (accessible as "edismax")
that supports full lucene syntax, improved reserved char escaping,
fielded queries, improved proximity boosting, and improved stopword
handling. Note: status is experimental for now.
(yonik)
- SOLR-1574: Add many new functions from java Math (e.g. sin, cos)
(yonik)
- SOLR-1569: Allow functions to take in literal strings by modifying the
FunctionQParser and adding LiteralValueSource
(gsingers)
- SOLR-1571: Added unicode collation support though Lucene's CollationKeyFilter
(Robert Muir via shalin)
- SOLR-785: Distributed Search support for SpellCheckComponent
(Matthew Woytowitz, shalin)
- SOLR-1625: Add regexp support for TermsComponent
(Uri Boness via noble)
- SOLR-1297: Add sort by Function capability
(gsingers, yonik)
- SOLR-1139: Add TermsComponent Query and Response Support in SolrJ
(Matt Weber via shalin)
- SOLR-1177: Distributed Search support for TermsComponent
(Matt Weber via shalin)
- SOLR-1621, SOLR-1722: Allow current single core deployments to be specified by solr.xml
(Mark Miller , noble)
- SOLR-1532: Allow StreamingUpdateSolrServer to use a provided HttpClient
(Gabriele Renzi via shalin)
- SOLR-1653: Add PatternReplaceCharFilter
(koji)
- SOLR-1131: FieldTypes can now output multiple Fields per Type and still be searched. This can be handy for hiding the details of a particular
implementation such as in the spatial case.
(Chris Mattmann, shalin, noble, gsingers, yonik)
- SOLR-1586: Add support for Geohash and Spatial Tile FieldType
(Chris Mattmann, gsingers)
- SOLR-1697: PluginInfo should load plugins w/o class attribute also
(noble)
- SOLR-1268: Incorporate FastVectorHighlighter
(koji)
- SOLR-1750: SolrInfoMBeanHandler added for simpler programmatic access
to info currently available from registry.jsp and stats.jsp
(ehatcher, hossman)
- SOLR-1815: SolrJ now preserves the order of facet queries.
(yonik)
- SOLR-1677: Add support for choosing the Lucene Version for Lucene components within
Solr.
(Uwe Schindler, Mark Miller)
- SOLR-1379: Add RAMDirectoryFactory for non-persistent in memory index storage.
(Alex Baranov via yonik)
- SOLR-1857: Synced Solr analysis with Lucene 3.1. Added KeywordMarkerFilterFactory
and StemmerOverrideFilterFactory, which can be used to tune stemming algorithms.
Added factories for Bulgarian, Czech, Hindi, Turkish, and Wikipedia analysis. Improved the
performance of SnowballPorterFilterFactory.
(rmuir)
- SOLR-1657: Converted remaining TokenStreams to the Attributes-based API. All Solr
TokenFilters now support custom Attributes, and some have improved performance:
especially WordDelimiterFilter and CommonGramsFilter.
(rmuir, cmale, uschindler)
- SOLR-1740: ShingleFilterFactory supports the "minShingleSize" and "tokenSeparator"
parameters for controlling the minimum shingle size produced by the filter, and
the separator string that it uses, respectively.
(Steven Rowe via rmuir)
- SOLR-744: ShingleFilterFactory supports the "outputUnigramsIfNoShingles"
parameter, to output unigrams if the number of input tokens is fewer than
minShingleSize, and no shingles can be generated.
(Chris Harris via Steven Rowe)
- SOLR-1923: PhoneticFilterFactory now has support for the
Caverphone algorithm.
(rmuir)
- SOLR-1957: The VelocityResponseWriter contrib moved to core.
Example search UI now available at http://localhost:8983/solr/browse
(ehatcher)
- SOLR-1974: Add LimitTokenCountFilterFactory.
(koji)
- SOLR-1966: QueryElevationComponent can now return just the included results in the elevation file
(gsingers, yonik)
- SOLR-1556: TermVectorComponent now supports per field overrides. Also, it now throws an error
if passed in fields do not exist and warnings
if fields that do not have term vector options (termVectors, offsets, positions)
that align with the schema declaration. It also
will now return warnings about
(gsingers)
- SOLR-1985: FastVectorHighlighter: add wrapper class for Lucene's SingleFragListBuilder
(koji)
- SOLR-1984: Add HyphenationCompoundWordTokenFilterFactory.
(PB via rmuir)
- SOLR-397: Date Faceting now supports a "facet.date.include" param
for specifying when the upper & lower end points of computed date
ranges should be included in the range. Legal values are: "all",
"lower", "upper", "edge", and "outer". For backwards compatibility
the default value is the set: [lower,upper,edge], so that all ranges
between start and end are inclusive of their endpoints, but the
"before" and "after" ranges are not.
- SOLR-945: JSON update handler that accepts add, delete, commit
commands in JSON format.
(Ryan McKinley, yonik)
- SOLR-2015: Add a boolean attribute autoGeneratePhraseQueries to TextField.
autoGeneratePhraseQueries="true" (the default) causes the query parser to
generate phrase queries if multiple tokens are generated from a single
non-quoted analysis string. For example WordDelimiterFilter splitting text:pdp-11
will cause the parser to generate text:"pdp 11" rather than (text:PDP OR text:11).
Note that autoGeneratePhraseQueries="true" tends to not work well for non whitespace
delimited languages.
(yonik)
- SOLR-1925: Add CSVResponseWriter (use wt=csv) that returns the list of documents
in CSV format.
(Chris Mattmann, yonik)
- SOLR-1240: "Range Faceting" has been added. This is a generalization
of the existing "Date Faceting" logic so that it now supports any
all stock numeric field types that support range queries in addition
to dates. facet.date is now deprecated in favor of this generalized mechanism.
(Gijs Kunze, hossman)
- SOLR-2021: Add SolrEncoder plugin to Highlighter.
(koji)
- SOLR-2030: Make FastVectorHighlighter use of SolrEncoder.
(koji)
- SOLR-2053: Add support for custom comparators in Solr spellchecker, per LUCENE-2479
(gsingers)
- SOLR-2049: Add hl.multiValuedSeparatorChar for FastVectorHighlighter, per LUCENE-2603.
(koji)
- SOLR-2059: Add "types" attribute to WordDelimiterFilterFactory, which
allows you to customize how WordDelimiterFilter tokenizes text with
a configuration file.
(Peter Karich, rmuir)
- SOLR-2099: Add ability to throttle rsync based replication using rsync option --bwlimit.
(Brandon Evans via koji)
- SOLR-1316: Create autosuggest component.
(Ankul Garg, Jason Rutherglen, Shalin Shekhar Mangar, Grant Ingersoll, Robert Muir, ab)
- SOLR-1568: Added "native" filtering support for PointType, GeohashField. Added LatLonType with filtering support too. See
http://wiki.apache.org/solr/SpatialSearch and the example. Refactored some items in Lucene spatial.
Removed SpatialTileField as the underlying CartesianTier is broken beyond repair and is going to be moved.
(gsingers)
- SOLR-2128: Full parameter substitution for function queries.
Example: q=add($v1,$v2)&v1=mul(popularity,5)&v2=20.0
(yonik)
- SOLR-2133: Function query parser can now parse multiple comma separated
value sources. It also now fails if there is extra unexpected text
after parsing the functions, instead of silently ignoring it.
This allows expressions like q=dist(2,vector(1,2),$pt)&pt=3,4
(yonik)
- SOLR-2157: Suggester should return alpha-sorted results when onlyMorePopular=false
(ab)
- SOLR-2010: Added ability to verify that spell checking collations have
actual results in the index.
(James Dyer via gsingers)
- SOLR-2188: Added "maxTokenLength" argument to the factories for ClassicTokenizer,
StandardTokenizer, and UAX29URLEmailTokenizer.
(Steven Rowe)
- SOLR-2129: Added a Solr module for dynamic metadata extraction/indexing with Apache UIMA.
See contrib/uima/README.txt for more information.
(Tommaso Teofili via rmuir)
- SOLR-2325: Allow tagging and exclusion of main query for faceting.
(yonik)
- SOLR-2263: Add ability for RawResponseWriter to stream binary files as well as
text files.
(Eric Pugh via yonik)
- SOLR-860: Add debug output for MoreLikeThis.
(koji)
- SOLR-1057: Add PathHierarchyTokenizerFactory.
(ryan, koji)
- SOLR-1804: Re-enabled clustering component on trunk, updated to latest
version of Carrot2. No more LGPL run-time dependencies. This release of
C2 also does not have a specific Lucene dependency.
(Stanislaw Osinski, gsingers)
- SOLR-2282: Add distributed search support for search result clustering.
(Brad Giaccio, Dawid Weiss, Stanislaw Osinski, rmuir, koji)
- SOLR-2210: Add icu-based tokenizer and filters to contrib/analysis-extras
(rmuir)
- SOLR-1336: Add SmartChinese (word segmentation for Simplified Chinese)
tokenizer and filters to contrib/analysis-extras
(rmuir)
- SOLR-2211,LUCENE-2763: Added UAX29URLEmailTokenizerFactory, which implements
UAX#29, a unicode algorithm with good results for most languages, as well as
URL and E-mail tokenization according to the relevant RFCs.
(Tom Burton-West via rmuir)
- SOLR-2237: Added StempelPolishStemFilterFactory to contrib/analysis-extras
(rmuir)
- SOLR-1525: allow DIH to refer to core properties
(noble)
- SOLR-1547: DIH TemplateTransformer copy objects more intelligently when the
template is a single variable
(noble)
- SOLR-1627: DIH VariableResolver should be fetched just in time
(noble)
- SOLR-1583: DIH Create DataSources that return InputStream
(noble)
- SOLR-1358: Integration of Tika and DataImportHandler
(Akshay Ukey, noble)
- SOLR-1654: TikaEntityProcessor example added DIHExample
(Akshay Ukey via noble)
- SOLR-1678: Move onError handling to DIH framework
(noble)
- SOLR-1352: Multi-threaded implementation of DIH
(noble)
- SOLR-1721: Add explicit option to run DataImportHandler in synchronous mode
(Alexey Serba via noble)
- SOLR-1737: Added FieldStreamDataSource
(noble)
- Optimizations (7)
- SOLR-1679: Don't build up string messages in SolrCore.execute unless they
are necessary for the current log level.
(Fuad Efendi and hossman)
- SOLR-1874: Optimize PatternReplaceFilter for better performance.
(rmuir, uschindler)
- SOLR-1968: speed up initial filter cache population for facet.method=enum and
also big terms for multi-valued facet.method=fc. The resulting speedup
for the first facet request is anywhere from 30% to 32x, depending on how many
terms are in the field and how many documents match per term.
(yonik)
- SOLR-2089: Speed up UnInvertedField faceting (facet.method=fc for
multi-valued fields) when facet.limit is both high, and a high enough
percentage of the number of unique terms in the field. Extreme cases
yield speedups over 3x.
(yonik)
- SOLR-2046: add common functions to scripts-util.
(koji)
- SOLR-1684: Switch clustering component to use the
SolrIndexSearcher.doc(int, Set<String>) method b/c it can use the document
cache
(gsingers)
- SOLR-2200: Improve the performance of DataImportHandler for large
delta-import updates.
(Mark Waddle via rmuir)
- Bug Fixes (93)
- SOLR-1769: Solr 1.4 Replication - Repeater throwing NullPointerException
(Jörgen Rydenius via noble)
- SOLR-1432: Make the new ValueSource.getValues(context,reader) delegate
to the original ValueSource.getValues(reader) so custom sources
will work.
(yonik)
- SOLR-1572: FastLRUCache correctly implemented the LRU policy only
for the first 2B accesses.
(yonik)
- SOLR-1582: copyField was ignored for BinaryField types
(gsingers)
- SOLR-1563: Binary fields, including trie-based numeric fields, caused null
pointer exceptions in the luke request handler.
(yonik)
- SOLR-1577: The example solrconfig.xml defaulted to a solr data dir
relative to the current working directory, even if a different solr home
was being used. The new behavior changes the default to a zero length
string, which is treated the same as if no dataDir had been specified,
hence the "data" directory under the solr home will be used.
(yonik)
- SOLR-1584: SolrJ - SolrQuery.setIncludeScore() incorrectly added
fl=score to the parameter list instead of appending score to the
existing field list.
(yonik)
- SOLR-1580: Solr Configuration ignores 'mergeFactor' parameter, always
uses Lucene default.
(Lance Norskog via Mark Miller)
- SOLR-1593: ReverseWildcardFilter didn't work for surrogate pairs
(i.e. code points outside of the BMP), resulting in incorrect
matching. This change requires reindexing for any content with
such characters.
(Robert Muir, yonik)
- SOLR-1596: A rollback operation followed by the shutdown of Solr
or the close of a core resulted in a warning:
"SEVERE: SolrIndexWriter was not closed prior to finalize()" although
there were no other consequences.
(yonik)
- SOLR-1595: StreamingUpdateSolrServer used the platform default character
set when streaming updates, rather than using UTF-8 as the HTTP headers
indicated, leading to an encoding mismatch.
(hossman, yonik)
- SOLR-1587: A distributed search request with fl=score, didn't match
the behavior of a non-distributed request since it only returned
the id,score fields instead of all fields in addition to score.
(yonik)
- SOLR-1601: Schema browser does not indicate presence of charFilter.
(koji)
- SOLR-1615: Backslash escaping did not work in quoted strings
for local param arguments.
(Wojtek Piaseczny, yonik)
- SOLR-1628: log contains incorrect number of adds and deletes.
(Thijs Vonk via yonik)
- SOLR-343: Date faceting now respects facet.mincount limiting
(Uri Boness, Raiko Eckstein via hossman)
- SOLR-1624: Highlighter only highlights values from the first field value
in a multivalued field when term positions (term vectors) are stored.
(Chris Harris via yonik)
- SOLR-1635: Fixed error message when numeric values can't be parsed by
DOMUtils - notably for plugin init params in solrconfig.xml.
(hossman)
- SOLR-1651: Fixed Incorrect dataimport handler package name in SolrResourceLoader
(Akshay Ukey via shalin)
- SOLR-1660: CapitalizationFilter crashes if you use the maxWordCountOption
(Robert Muir via shalin)
- SOLR-1667: PatternTokenizer does not reset attributes such as positionIncrementGap
(Robert Muir via shalin)
- SOLR-1711: SolrJ - StreamingUpdateSolrServer had a race condition that
could halt the streaming of documents. The original patch to fix this
(never officially released) introduced another hanging bug due to
connections not being released.
(Attila Babo, Erik Hetzner, Johannes Tuchscherer via yonik)
- SOLR-1748, SOLR-1747, SOLR-1746, SOLR-1745, SOLR-1744: Streams and Readers
retrieved from ContentStreams are not closed in various places, resulting
in file descriptor leaks.
(Christoff Brill, Mark Miller)
- SOLR-1753: StatsComponent throws NPE when getting statistics for facets in distributed search
(Janne Majaranta via koji)
- SOLR-1736:In the slave , If 'mov'ing file does not succeed , copy the file
(noble)
- SOLR-1579: Fixes to XML escaping in stats.jsp
(David Bowen and hossman)
- SOLR-1777: fieldTypes with sortMissingLast=true or sortMissingFirst=true can
result in incorrectly sorted results.
(yonik)
- SOLR-1798: Small memory leak (~100 bytes) in fastLRUCache for every
commit.
(yonik)
- SOLR-1823: Fixed XMLResponseWriter (via XMLWriter) so it no longer throws
a ClassCastException when a Map containing a non-String key is used.
(Frank Wesemann, hossman)
- SOLR-1797: fix ConcurrentModificationException and potential memory
leaks in ResourceLoader.
(yonik)
- SOLR-1850: change KeepWordFilter so a new word set is not created for
each instance
(John Wang via yonik)
- SOLR-1706: fixed WordDelimiterFilter for certain combinations of options
where it would output incorrect tokens.
(Robert Muir, Chris Male)
- SOLR-1936: The JSON response format needed to escape unicode code point
U+2028 - 'LINE SEPARATOR'
(Robert Hofstra, yonik)
- SOLR-1914: Change the JSON response format to output float/double
values of NaN,Infinity,-Infinity as strings.
(yonik)
- SOLR-1948: PatternTokenizerFactory should use parent's args
(koji)
- SOLR-1870: Indexing documents using the 'javabin' format no longer
fails with a ClassCastException whenSolrInputDocuments contain field
values which are Collections or other classes that implement
Iterable.
(noble, hossman)
- SOLR-1981: Solr will now fail correctly if solr.xml attempts to
specify multiple cores that have the same name
(hossman)
- SOLR-1791: Fix messed up core names on admin gui
(yonik via koji)
- SOLR-1995: Change date format from "hour in am/pm" to "hour in day"
in CoreContainer and SnapShooter.
(Hayato Ito, koji)
- SOLR-2008: avoid possible RejectedExecutionException w/autoCommit
by making SolreCore close the UpdateHandler before closing the
SearchExecutor.
(NarasimhaRaju, hossman)
- SOLR-2036: Avoid expensive fieldCache ram estimation for the
admin stats page.
(yonik)
- SOLR-2047: ReplicationHandler should accept bool type for enable flag.
(koji)
- SOLR-1630: Fix spell checking collation issue related to token positions
(rmuir, gsingers)
- SOLR-2100: The replication handler backup command didn't save the commit
point and hence could fail when a newer commit caused the older commit point
to be removed before it was finished being copied. This did not affect
normal master/slave replication.
(Peter Sturge via yonik)
- SOLR-2114: Fixed parsing error in hsin function. The function signature has changed slightly.
(gsingers)
- SOLR-2083: SpellCheckComponent misreports suggestions when distributed
(James Dyer via gsingers)
- SOLR-2111: Change exception handling in distributed faceting to work more
like non-distributed faceting, change facet_counts/exception from a String