Hardware·
One model per chip: AMD bought Taalas, whose test part hit 17,000 tokens a second
Taalas casts a model's weights into transistors. Its 6nm test chip served Llama 3.1 8B at roughly 17,000 tokens per second, and AMD just bought the company.
Taalas casts a model's weights into transistors. Its 6nm test chip served Llama 3.1 8B at roughly 17,000 tokens per second, and AMD just bought the company.

Qualcomm is in talks to buy Tenstorrent for up to $10 billion, per Reuters and The Information. The bet: a RISC-V challenger to Nvidia, not just phones.