This is not a “new approach”, it’s the same one but hardware-based. It also is wildly impractical. Models are only useful if they stay somewhat up to date. This way only produces a whole load of garbage everytime you want to update it. Probably useful in the industry or robotics, but not for an everyday LLM.
Today I learned every chip ever made and put into any device in any application is wildly impractical and produces a whole load of garbage any time you want to update it.
Software based solutions will always have the advantage of being applicable to older hardware (maybe with a compatibility layer, but nontheless still viable). Something that should be up-to-date pretty much every day if we apply it to things like internet search simply cannot be solved in hardware alone.
As i said, there are applications where a hardware-based approach is completely valid (like on a production line where nothing essential changes during the time where it is doing stuff), but for other approaches we would be fucked from here to Uranus if we solved everything in hardware.
This is not a “new approach”, it’s the same one but hardware-based. It also is wildly impractical. Models are only useful if they stay somewhat up to date. This way only produces a whole load of garbage everytime you want to update it. Probably useful in the industry or robotics, but not for an everyday LLM.
Today I learned every chip ever made and put into any device in any application is wildly impractical and produces a whole load of garbage any time you want to update it.
You’re not wrong.
Software based solutions will always have the advantage of being applicable to older hardware (maybe with a compatibility layer, but nontheless still viable). Something that should be up-to-date pretty much every day if we apply it to things like internet search simply cannot be solved in hardware alone.
As i said, there are applications where a hardware-based approach is completely valid (like on a production line where nothing essential changes during the time where it is doing stuff), but for other approaches we would be fucked from here to Uranus if we solved everything in hardware.