-
Notifications
You must be signed in to change notification settings - Fork 462
Open
Description
In https://github.com/castorini/pyserini/blob/master/pyserini/encode/_auto.py
though AutoDocumentEncoder allows batch encoding, but AutoQueryEncoder encodes one query at a time.
This forces FaissSearcher # batch_search function to encode one query at a time
pyserini/pyserini/search/faiss/_searcher.py
Line 194 in 9815d56
| q_embs = [_enc(q) for q in queries] |
def _enc(q):
if isinstance(q, dict):
return self.query_encoder.encode(**q)
assert isinstance(q, str)
return self.query_encoder.encode(q)
q_embs = [_enc(q) for q in queries]
Allowing batch encoding for queries would improve performance of batch_search
Metadata
Metadata
Assignees
Labels
No labels