Ideas for speed improvements

Changes

1 changed files (+1/-0)

• README.md
  • @@ -34,3 +34,4 @@ - AMD support using https://rocm.docs.amd.com/projects/radeon/en/latest/docs/install/native_linux/install-onnx.html (ideally we should just do `pip3 install onnxruntime-rocm -f https://repo.radeon.com/rocm/manylinux/rocm-rel-6.3.1/` (use the latest ROCm version) but uv doesn't recognize that URL as a registry and fastembed specifically depends on onnxruntime not onnxruntime-rocm so the whole thing is a huge mess. I hate Python packaging)
    - Unload the image embedding model to save RAM unless doing a file to file search - Write a systemd `.service` and `.socket` for running the server with socket activation - Fix the packaging so this works with both uv and `pip install -e .` I really hate Python packaging + - Parallelize indexing? Not sure if this will help. I might need to batch embedding queries instead, but that sounds like a huge pain to implement.