chrislusf wrote:
Maybe you should look at
DBSight, a database search based on lucene.
It uses direct SQL to crawl database rather than relying on some specific framework. Indexing, Re-Indexing, Incremental Indexing are all easy to do and efficient.
It'll get you started in several minutes. Free version can create size unlimited index now.
Chris
thanks for the info, I looked through the site.
Sounds interesting, but not for my case.
I'll describe briefly what my module + Lucene must be able to do (and does now) within a Grails app:
1. Create new *domain* classes and modify them in run-time, and prepare the index structures for them, all within 2 minutes time-frame
2. Simulateneously in several threads (I had 7 once) index the raw data within 6-8 sec per 10 MB data file. Each index's minimal size is 2.5 GB ~ 150000 document, but it can be up to 13 GB ~ 8+ Mio docs.
3. Simulateneously search in up to 20 indexes in various combinations with search times up to 800 ms
No need for internet crawling and different presentation formats.
Can DBSight serve as a good and performant replacement for that?