Is it a problem to store your vector database in memory?

Asked Jul 05 '23 at 12:51

Active Jul 05 '23 at 12:51

Viewed 90 times

I'm learning ChatGPT/LLM Development and am regularly coming across all different kinds of vector database implementations.

Some of them, e.g. Chroma, currently only support in-memory implementations for Python.

My initial reaction when I read that is "how can that be enough memory?". For what use cases are in-memory vector databases suitable?

asked Jul 05 '23 at 12:51

codeananda

Ikr, it is the same case with even `milvus`. I realised the trick is with indexing on how ANN based indices can be used. – Kiritee Gak Jul 05 '23 at 19:43
Can you explain a bit more what you mean about this indexing trick? – codeananda Jul 07 '23 at 14:14

0 Answers0