Tesla has filed a patent "High Precision Complex Number Based Rotary Positional Encoding Calculation On 8-Bit Compute Hardware" (US20260017019)
There are several ideas in the patent but it appears that this work will be available in the latest AI5 chip. A good introduction is https://www.youtube.com/watch?v=GG9yOsPEGek
One of the key ideas is to use logarithms and addition rather than multiplication. Faster and less power needed.
NVIDIA is going to hurt from this.
My mother has used such manually operating machine in the late 60s. It was called the slide ruler or something.
So, they invented the slide rule?
https://patentscope.wipo.int/search/en/detail.jsf?docId=US47... doesn’t mention “8-bit” at all, so why did they put “on 8-bit Compute hardware” in the title?
Seems it could at least slightly open up the world for doing it on 9-bit Compute hardware or (partially) in software, for example.