Repository navigation
Expose Scores for Full Text Search #1244
Description
Activity
Hi, wondering if anyone would be working on this? It would really make my current usage of redisgraph super useful. Currently we are pulling the node properties offline and searching on it.
Hi @lppier,
This would definitely be a valuable addition! We've scheduled some time next week to discuss how to implement it with the RediSearch team. I'll update here when we've started development.
Reacted by Pier, Lj V. Miranda and AlrasheedAThanks so much!
Hi, is this feature still under consideration?
I hope this will make it to 2.6,
@MeirShpilraien can we allocate time to look into it next week?Reacted by PierThanks @swilly22 , we've actually implemented our solution on redisgraph already, having the scores will allow us to use it as a feedback to our downstream results ranking module. Would really appreciate having it.
For clarity, the request is for something like this :
https://neo4j.com/docs/cypher-manual/current/administration/indexes-for-full-text-search/@swilly22 We store people, companies and have relationships between them in the redisgraph. The graph is one of the backend services for our search engine. One of the use case is when someone searches for a company, say "Dropbox" , and the people affliated are also retrieved. This query is sent in parallel to the various backend services, of which redisgraph is one of them.
Our search engine then has a ranking model which takes in a score from the various backend search services, plus the query. This ranking model decides which results to put at the top.
Just to add, we are using the redissearch enabled wildcards like * and % in our search as well.
Reacted by Roi Lipmanit is already in the
edgedocker image, not sure when it will be officially released.Ok thanks, am asking as I'm using it in a production system , will wait for it to be released thanks.
Hi! Would like to clarify how the Tf-Idf computation works if you're using a fuzzy query.
That is, query looks like this:
CALL db.idx.fulltext.queryNodes(‘Node’, ‘%zeller%’) YIELD node, score RETURN node, scoreResults are something like (just showing a shortened format):
Result 1:
displayName: Tim Keller score: 10Result 2:
displayName: Bob Zeller score: 10I would have expected Bob Zeller to have a higher score, since there's an exact term match. Sorry, I know there's a lot of components to the score so tracing the exact cause/computation with our data is on us, but asking in case you'd have an insight into what might have caused this?
Also, what is the range of the scores? Is it from 0-100?
Thanks!
@alronlam Thank you for the issue.
Currently, RediSearch gives all fuzzy matching terms the same score. There is no penalty on a higher distance.
Are you familiar with an algorithm that will decide on the score based on the distance?Please open an issue about the subject on the RediSearch repo.
Thank you for RedisGraph.
I understand that the fulltext search in RedisGraph is powered by RediSearch.
How can I get the scores (tfidf or otherwise) of the search results?
Eg.
CALL db.idx.fulltext.queryNodes('movie', 'Book') YIELD node RETURN node.titleWould it be possible to get the following?
These scores would be useful for me against a threshold where I decide whether to use the node or not for further processing in my app.