【weblucene官方CVS源码】----<下载不扣分，回帖加1分，欢迎下载，童叟无欺>

$Id: README.txt,v 1.5 2004/10/30 11:36:18 lhelper Exp $ 中文文档请参考: http://www.chedong.com/tech/weblucene.html WebLucene ========= Lucene Web interface, use XML as a lightweight protocol. developer can convert data source (text, DB, MS Word, PDF... etc) into xml format, indexing with lucene engine, and get full text search result via HTTP, with XML format output, user can easily intergrated with JSP ASP PHP front end or use XSLT at server side transform output. Indexing Process ================ MySQL \ / JSP Oracle - DB - ==> XML ==> (Lucene Index) ==> XML - ASP MSSQL / - PHP MS Word / \ / XHTML PDF / =XSLT=> - TEXT \ XML \_______WebLucene_______/ i18n issue: for Java is Unicode based, user can indexing data source(XML) in different charset into one lucene index(in unicode) and output result according to client browser support languages. GBK \ / BIG5 BIG5 - UNICODE ====> Unicode - GB2312 SJIS - (XML) (XML) - SJIS ISO-8859-1 / \ ISO-8859-1 Searching Process ================= Input/Output: "HTTP GET"/XML Client Browser Input==(HTTP GET)==> WebLuceneServlet ==> XML Result Set==(XSLT)==> XHTML output ==> Output to Client Browser XML format search result ======================== Lucene_result.dtd Chinese_gbk.xml Simplified Chinese indexing source sample Chinese_big5.xml Triditional Chinese indexing source sample Japanese_sjis.xml Japanese indexing source sample English_en.xml English indexing source sample every sample contents 5 articles indexing source: XML format Lucene_index.dtd WebLuceneSource Document: Field: title author content pub_date lang meta_info(not stored) Index: all_idx: title + content + meta_info, for full text searching author_idx: index only without token, for author match date_idx: index only without token, for date range search lang_idx: index only without token, for language filter search searching result: XML format WebLuceneResult: Simple search result ResultSet: Record: contents with stored Field name Query QueryString OffSet PageSize OutputFormat Filter field type(match/prefix/before/after) SortType (score/doc/doc_desc) result xslt transform: source map: 1 lucene extension: CJKTokenizer: a simple tokenizer support European languages and East Asia languages org/apache/lucene/analysis/cjk/ IndexOrderSearcher: docID based result sorting org/apache/lucene/search/ 2 web application: FileBasedPropertiesSupplier.java: properties supplier, supplier properties for SimplePropertiesFactory PropertyFileFilenameFilter.java: properties file filter, filte file by filename SimplePropertiesConsumer.java: properties consumer, which acquire data from SimplePropertiesFactory SimplePropertiesFactory.java: properties container com/chedong/properties ParamUtil.java: used to validate the validation of the parameter RequestParser.java: a utility that can used to parser the http request com/chedong/util/ WebLuceneAdminServlet.java: Globle configurations viewer and re-loader WebLucenePropertiesConsumer.java: WebLucenePropertiesPreprocessor.java: WebLuceneServlet.java: Search Entrance <==construct WebLuceneQuery and choose correct xslt trans XML output com/chedong/weblucene/ SAXIndexer: SAX based lucene xml source indexer com/chedong/weblucene/index/ DOMSearcher.java: invoke lucene indexSearcher,highlight result hits and convert search result to XML WebLuceneHighlighter.java: search result hits highligher and abstractor. WebLuceneQuery.java: Search Query Bean WebLuceneResultSet.java: WebLuceneSearcherBase.java: com/chedong/weblucene/search/ XsltCache: xslt transformer caching com/chedong/xslt/ 3 application file list: BUILD.txt install document in chinese README.txt read me document INSTALL.txt install documnet CHANGES.txt change log LICENSE.txt we use "The Apache Software License" build.xml ant build file webapp/ index.html test entrnace ==> WebLucene?dir=demo&q=keyword&encoding=utf-8&offset=10&size=10 weblucene_results.dtd search results XML definition weblucene_index.dtd indexing source XML definition WEB-INF/ web.xml webapp configuration src/ java source directory test/ unit test directory classes/ java classes directory bin/ shell commands: java LuceneXMLIndexer input.xml output directory conf/ weblucene.conf global config file log4j.conf config file for log4j blog.conf config file for demo, which can override the declaration in weblucene.conf var/ lucene indics blog/ demo directory index/ lucene index library html.xsl xslt template for html rss.xsl xslt template for rss lib/ include jar files java-getopt.jar java command line get options lucene.jar Lucene: core full text index engine xerces.jar XML parser xalan.jar XSLT log4j.jar logger README.txt the jar file download path