Re: Re: [ANN] Searchable Plugin 0.4.1 released

by Maurice Nicholson-2 :: Rate this Message:

Hey Barz,

term frequences (SomeClass.termFreqs) gives you a list of term+frequency pairs, in other words, a list of terms and their respective frequencies.

Personally I think the documentation is pretty clear:

http://grails.org/Searchable+Plugin+-+Searching#SearchablePlugin-Searching-termFreqs

and the here's the first example from that section:

// print all Book term frequencies
def termFreqs = Book.termFreqs()
termFreqs.each { 
    println "${it.term} occurs ${it.freq} times in the index for Book instances" 

}

Anyway, I think the feature you describe makes sense, but it can be achieved now, if not especially optimised, by simply hunting for the term in the term-freqs, eg:

Book.termFreqs.find { it.term == 'marmalade' }.freqs

The information exists in the index, so it could be exposed in a simpler fashion, but is it required? Term-freqs are an advanced topic (IMHO) and I wonder how many people will use this feature?

The other point is that the term frequency currently provided is the frequency of a term over the whole index, not just a single Book instance! Again the information is in the index on a per Lucene document (Book instance) basis, it's just a question of exposing it.

As you said these are features that make sense in Compass itself so I think they are questions for the Compass forum.

Cheers,
Maurice

On 21/04/2008, Barzilai Spinak <barcho@...> wrote:

Hi Maurice.
I'm glad to tell you that the two main bugs I had with previous
versions, now seem to be fixed! (the NPE when cascade-saving, and some
other errors with component references).

The other thing was about termFreq, which I thought it had a bug. Maybe
it's not a bug after all, but some misunderstanding on my part, or it's
not clearly explained in the docs, or it's a bug :-)

Let me explain.

When calling SomeClass.termFreqs('someTerm'), I thought the resulting
number would be "the number of occurrences of someTerm within instances
SomeClass".

For example, if I had:
(new Album(title:'yeah yeah yeah')).save()
(new Album(title:'Just say yeah')).save()

and then I query: Album.termFreqs('yeah'), I would get a count of 4
However, what I seem to be getting is "the number of Album instances
that have the term 'yeah' in any of their indexable properties".

So... maybe this is the intended behaviour... maybe not... in any case,
I think that 1) it should be more explicitly explained, 2) a *real* term
frequencies, with respect to terms should be added.
Like for example (completely made up example), if I had a Book class,
which hasMany Paragraph, and 'm storing the text in the Paragraph. And
I'm doing some text analysis, wanting to know how many times a certain
term appears in the Book. I don't want the count of paragraphs that
contain that word, I want the actual number of occurrences of that word.

Thinking a little more, maybe this behaviour is a "feature" of Compass?

BarZ

---------------------------------------------------------------------
To unsubscribe from this list, please visit:

http://xircles.codehaus.org/manage_email

« Return to Thread: [ANN] Searchable Plugin 0.4.1 released