Binary quantisation

15-08-2025

• binary quantization - https://x.com/_avichawla/status/1952256615215976745
• create binary vector index
• generate text embeddings (float32)
• convert to binary vectors (32x reduction in memory)
• use hamming distance as the search metric for retrieval