Nvidia’s new technique cuts LLM reasoning costs by 8x without losing accuracy
Researchers at Nvidia have developed a technique that can reduce the memory costs of large language model reasoning by up to eight times. Their technique, called dynamic memory sparsification (DMS), c...