Akida GenAI & Akida 3 have been adapted to handle 16-bit integer and 32-bit FP. This, in addition to the malleable architecture, enables these two chips to be flexibly configured to handle all types of models and to be adapted for future applications.Thanks FK,
The roadmap is chock full of groundbreaking advances. I felt that question time could have been better utilized by addressing the new opportunities these advances provide.
The provision of a LUT in place of an activation function seems like a patentable idea if original. We are also told by JT that a patent application is in the pipeline for a new technique for retrieving data from memory. This is the most energy intensive action so the invention will further increase the power efficiency and probably latency.
Akida 2 is 8 times more efficient than Akida 1, and presumably that also applies to GenAI & Akida 3 for equivalent Akida 1 tasks. However, 16-bit integer and 32-bit FP seem to provide excessive capabilities for an edge device. Does Nvidia need to look over its shoulder "like one that on a lonesome road doth walk in fear and dread, and having once turned round, walks on, and turns no more his head, because he knows that close behind a frightful fiend doth tread"?
Last edited: