« Return to Thread: Alternative to Compass/Searchable plugin
Re: Alternative to Compass/Searchable plugin
by chrislusf
::
Rate this Message:
1. No. DBSight can not handle that, and I suppose no existing tools can handle your case.
2. My experience is that in multi-threaded indexing mode, 20G data can take 4 hours to index. Your 6~8sec/10MB looks in the range.
3. This should be possible.
Maybe you would need a producer~consumer model to separate the indexing and searching process to separate machines, because either one will slow down the machine a lot.
--
Chris Lu
-------------------------
Instant Scalable Full-Text Search On Any Database/Application
site: http://www.dbsight.net
demo: http://search.dbsight.com
Lucene Database Search in 3 minutes: http://wiki.dbsight.com/index.php?title=Create_Lucene_Database_Search_in_3_minutes
DBSight customer, a shopping comparison site, (anonymous per request) got 2.6 Million Euro funding!
2. My experience is that in multi-threaded indexing mode, 20G data can take 4 hours to index. Your 6~8sec/10MB looks in the range.
3. This should be possible.
Maybe you would need a producer~consumer model to separate the indexing and searching process to separate machines, because either one will slow down the machine a lot.
--
Chris Lu
-------------------------
Instant Scalable Full-Text Search On Any Database/Application
site: http://www.dbsight.net
demo: http://search.dbsight.com
Lucene Database Search in 3 minutes: http://wiki.dbsight.com/index.php?title=Create_Lucene_Database_Search_in_3_minutes
DBSight customer, a shopping comparison site, (anonymous per request) got 2.6 Million Euro funding!
On Tue, Jun 10, 2008 at 3:37 PM, Konstantyn Smirnov <injecteer@...> wrote:
chrislusf wrote:
>
> Maybe you should look at http://www.dbsight.net DBSight , a database
> search based on lucene.thanks for the info, I looked through the site.
>
> It uses direct SQL to crawl database rather than relying on some specific
> framework. Indexing, Re-Indexing, Incremental Indexing are all easy to do
> and efficient.
>
> It'll get you started in several minutes. Free version can create size
> unlimited index now.
>
> Chris
>
Sounds interesting, but not for my case.
I'll describe briefly what my module + Lucene must be able to do (and does
now) within a Grails app:
1. Create new *domain* classes and modify them in run-time, and prepare the
index structures for them, all within 2 minutes time-frame
2. Simulateneously in several threads (I had 7 once) index the raw data
within 6-8 sec per 10 MB data file. Each index's minimal size is 2.5 GB ~
150000 document, but it can be up to 13 GB ~ 8+ Mio docs.
3. Simulateneously search in up to 20 indexes in various combinations with
search times up to 800 ms
No need for internet crawling and different presentation formats.
Can DBSight serve as a good and performant replacement for that?
--
View this message in context: http://www.nabble.com/Alternative-to-Compass-Searchable-plugin-tp17248352p17766301.html
Sent from the grails - user mailing list archive at Nabble.com.---------------------------------------------------------------------
To unsubscribe from this list, please visit:
http://xircles.codehaus.org/manage_email
« Return to Thread: Alternative to Compass/Searchable plugin
| Free Forum Powered by Nabble | Forum Help |