lucene2.2.0资源-CSDN文库

共1899个文件

html：1760个

png：24个

pdf：19个

lucene

5星 · 超过95%的资源需积分: 9 190 浏览量 2007-11-09 08:33:11 上传评论 2 收藏 6.25MB ZIP 举报

资源推荐

资源详情

资源评论

收起资源包目录

lucene2.2.0 （1899个子文件）

screen.css 12KB

profile.css 4KB

basic.css 2KB

stylesheet.css 1KB

print.css 1KB

pdfdoc.gif 1008B

xmldoc.gif 992B

printer.gif 603B

page.gif 79B

external-link.gif 71B

inherit.gif 57B

current.gif 54B

label.gif 54B

chapter_open.gif 49B

chapter.gif 49B

spacer.gif 43B

header_white_line.gif 37B

index-all.html 1.99MB

overview-tree.html 201KB

constant-values.html 174KB

serialized-form.html 171KB

Query.html 167KB

Analyzer.html 123KB

IndexWriter.html 119KB

IndexReader.html 114KB

allclasses-frame.html 108KB

TokenStream.html 104KB

IndexReader.html 100KB

allclasses-noframe.html 94KB

QueryParser.html 84KB

fileformats.html 79KB

PrecedenceQueryParser.html 76KB

GOMEntryImpl.html 76KB

GOMSourceImpl.html 74KB

IndexModifier.html 72KB

ServerBaseFeed.html 68KB

Term.html 67KB

ParallelReader.html 65KB

FilterIndexReader.html 63KB

QueryParser.html 63KB

ServerBaseEntry.html 62KB

CorruptIndexException.html 61KB

MoreLikeThis.html 60KB

Searcher.html 58KB

MultiReader.html 57KB

MultiFieldQueryParser.html 56KB

StorageImplementation.html 55KB

StorageException.html 54KB

package-use.html 54KB

DB4oStorage.html 54KB

Directory.html 54KB

QueryTemplateManager.html 54KB

GOMStaxWriter.html 52KB

Filter.html 52KB

FSDirectory.html 51KB

package-use.html 50KB

MultiSearcher.html 48KB

GOMLinkImpl.html 47KB

Weight.html 47KB

GOMEntry.html 47KB

IndexSearcher.html 47KB

RemoteSearchable.html 46KB

AbstractGOMElement.html 46KB

package-summary.html 45KB

Similarity.html 45KB

GOMPersonImpl.html 45KB

GDataIndexer.html 45KB

IndexSchema.html 45KB

GOMContentImpl.html 44KB

GDataAccount.html 44KB

overview-summary.html 43KB

Token.html 43KB

Highlighter.html 42KB

GOMCategoryImpl.html 42KB

BooleanQuery.html 42KB

Document.html 41KB

FieldCache.html 41KB

DbDirectory.html 41KB

StorageCoreController.html 41KB

AbstractField.html 41KB

GDataService.html 40KB

Field.html 40KB

GOMGeneratorImpl.html 39KB

JEDirectory.html 39KB

StorageQuery.html 39KB

HTMLParser.html 39KB

GOMTextContructImpl.html 39KB

GDataAdminService.html 39KB

GDataRequest.html 39KB

ServiceException.html 38KB

ServerBaseEntry.html 38KB

SimpleCharStream.html 37KB

AnalyzingQueryParser.html 37KB

Storage.html 37KB

IndexSchemaField.html 37KB

GOMSource.html 36KB

Directory.html 36KB

AtomParser.html 35KB

SnowballProgram.html 35KB

BasicDocMaker.html 35KB

共 1899 条

Apache Lucene - Index File Formats

by Doug Cutting

Table of contents

1 Index File Formats............................................................................................................. 3

2 Definitions..........................................................................................................................3

2.1 Inverted Indexing...........................................................................................................3

2.2 Types of Fields.............................................................................................................. 4

2.3 Segments........................................................................................................................4

2.4 Document Numbers.......................................................................................................4

3 Overview............................................................................................................................5

4 File Naming....................................................................................................................... 5

5 Primitive Types..................................................................................................................6

5.1 Byte................................................................................................................................6

5.2 UInt32............................................................................................................................6

5.3 Uint64............................................................................................................................6

5.4 VInt................................................................................................................................6

5.5 Chars..............................................................................................................................7

5.6 String............................................................................................................................. 7

6 Per-Index Files...................................................................................................................7

6.1 Segments File................................................................................................................ 8

6.2 Lock File........................................................................................................................9

6.3 Deletable File.................................................................................................................9

6.4 Compound Files.............................................................................................................9

7 Per-Segment Files............................................................................................................ 10

7.1 Fields........................................................................................................................... 10

7.2 Term Dictionary.......................................................................................................... 11

7.3 Frequencies..................................................................................................................13

7.4 Positions...................................................................................................................... 15

7.5 Normalization Factors................................................................................................. 16

7.6 Term Vectors...............................................................................................................16

7.7 Deleted Documents..................................................................................................... 18

8 Limitations....................................................................................................................... 19

Apache Lucene - Index File Formats

Page 2

1. Index File Formats

This document defines the index file formats used in Lucene version 2.1. If you are using a

different version of Lucene, please consult the copy of docs/fileformats.html that

was distributed with the version you are using.

Apache Lucene is written in Java, but several efforts are underway to write versions of

Lucene in other programming languages. If these versions are to remain compatible with

Apache Lucene, then a language-independent definition of the Lucene index format is

required. This document thus attempts to provide a complete and independent definition of

the Apache Lucene 2.1 file formats.

As Lucene evolves, this document should evolve. Versions of Lucene in different

programming languages should endeavor to agree on file formats, and generate new versions

of this document.

Compatibility notes are provided in this document, describing how file formats have changed

from prior versions.

In version 2.1, the file format was changed to allow lock-less commits (ie, no more commit

lock). The change is fully backwards compatible: you can open a pre-2.1 index for searching

or adding/deleting of docs. When the new segments file is saved (committed), it will be

written in the new file format (meaning no specific "upgrade" process is needed). But note

that once a commit has occurred, pre-2.1 Lucene will not be able to read the index.

2. Definitions

The fundamental concepts in Lucene are index, document, field and term.

An index contains a sequence of documents.

•

A document is a sequence of fields.

•

A field is a named sequence of terms.

•

A term is a string.

The same string in two different fields is considered a different term. Thus terms are

represented as a pair of strings, the first naming the field, and the second naming text within

the field.

2.1. Inverted Indexing

The index stores statistics about terms in order to make term-based search more efficient.

Apache Lucene - Index File Formats

Page 3

Lucene's index falls into the family of indexes known as an inverted index. This is because it

can list, for a term, the documents that contain it. This is the inverse of the natural

relationship, in which documents list terms.

2.2. Types of Fields

In Lucene, fields may be stored, in which case their text is stored in the index literally, in a

non-inverted manner. Fields that are inverted are called indexed. A field may be both stored

and indexed.

The text of a field may be tokenized into terms to be indexed, or the text of a field may be

used literally as a term to be indexed. Most fields are tokenized, but sometimes it is useful for

certain identifier fields to be indexed literally.

See the Field java docs for more information on Fields.

2.3. Segments

Lucene indexes may be composed of multiple sub-indexes, or segments. Each segment is a

fully independent index, which could be searched separately. Indexes evolve by:

Creating new segments for newly added documents.

Merging existing segments.

Searches may involve multiple segments and/or multiple indexes, each index potentially

composed of a set of segments.

2.4. Document Numbers

Internally, Lucene refers to documents by an integer document number. The first document

added to an index is numbered zero, and each subsequent document added gets a number one

greater than the previous.

Note that a document's number may change, so caution should be taken when storing these

numbers outside of Lucene. In particular, numbers may change in the following situations:

•

The numbers stored in each segment are unique only within the segment, and must be

converted before they can be used in a larger context. The standard technique is to

allocate each segment a range of values, based on the range of numbers used in that

segment. To convert a document number from a segment to an external value, the

segment's base document number is added. To convert an external value back to a

segment-specific value, the segment is identified by the range that the external value is in,

Apache Lucene - Index File Formats

Page 4

and the segment's base value is subtracted. For example two five document segments

might be combined, so that the first segment has a base value of zero, and the second of

five. Document three from the second segment would have an external value of eight.

•

When documents are deleted, gaps are created in the numbering. These are eventually

removed as the index evolves through merging. Deleted documents are dropped when

segments are merged. A freshly-merged segment thus has no gaps in its numbering.

3. Overview

Each segment index maintains the following:

•

Field names. This contains the set of field names used in the index.

•

Stored Field values. This contains, for each document, a list of attribute-value pairs,

where the attributes are field names. These are used to store auxiliary information about

the document, such as its title, url, or an identifier to access a database. The set of stored

fields are what is returned for each hit when searching. This is keyed by document

number.

•

Term dictionary. A dictionary containing all of the terms used in all of the indexed fields

of all of the documents. The dictionary also contains the number of documents which

contain the term, and pointers to the term's frequency and proximity data.

•

Term Frequency data. For each term in the dictionary, the numbers of all the documents

that contain that term, and the frequency of the term in that document.

•

Term Proximity data. For each term in the dictionary, the positions that the term occurs in

each document.

•

Normalization factors. For each field in each document, a value is stored that is

multiplied into the score for hits on that field.

•

Term Vectors. For each field in each document, the term vector (sometimes called

document vector) may be stored. A term vector consists of term text and term frequency.

To add Term Vectors to your index see the Field constructors

•

Deleted documents. An optional file indicating which documents are deleted.

Details on each of these are provided in subsequent sections.

4. File Naming

All files belonging to a segment have the same name with varying extensions. The extensions

correspond to the different file formats described below. When using the Compound File

format (default in 1.4 and greater) these files are collapsed into a single .cfs file (see below

Apache Lucene - Index File Formats

Page 5

评论收藏

内容反馈

zhangnan_120120

2013-01-29

非常好，内容很全面。
mark_yueye

2013-11-30

相当不错,很喜欢
ystz900403

2012-12-24

用起来感觉不错
yjyj0730

2013-09-09

导入失败了，还要再研究一下，谢谢了
wyjabc12ok

2014-01-22

很详细下了包可以用

前往

页

ckangtai

粉丝: 41
资源: 458

lucene2.2.0

lucene-2.2.0zip

lucene-analyzers-2.2.0.jar

NetRobot网络机器人

lucene简单实例

Lucene下调试通过的简单程序

基于JAVA的搜索引擎 lucene-2.2.0

lucene-2.2.0-src

ShuzhenAnalyzer-1.1.3

lucene-highlighter-2.2.0.jar

lucene-highlighter-2.2.0-src.zip

lucene-core-2.3.2.jar

lucene-core-2.1.0.jar

cocoon-lucene-block-2.2.0-dev.jar

compass-2.2.0.zip

elasticsearch-2.2.0.tar

mmseg4j-solr总共4个文件

elasticsearch-2.2.0.rpm

paoding的maven工程及jar包

elasticsearch-analysis-ik2.x增加连续数字字母英语智能分词、动态词库刷新支持elasticsearch2.x以上

微信小程序源码-合集6.rar

微信小程序源码-合集5.rar

微信小程序源码-合集4.rar

微信小程序源码-合集3.rar

微信小程序源码-合集2.rar

浏览器插件 Auto Refresh Plus 7.4.4 ctx

品优购项目 素材及代码

学生宿舍管理系统源码文件

全能电子地图下载器1.9.5完善版.zip

大学生网页设计大作业-5个网页设计制作作品自己任选

最新资源

品优购项目素材及代码