Publication · 2024

HashAttention: Semantic sparsity for faster inference

Aditya Desai, Shuo Yang, Alejandro Cuadron, Matei Zaharia, Joseph E. Gonzalez, Ion Stoica · arXiv preprint