One thing I wanted to say before I go to bed and get my bubble rest is I want to give a BIG BIG kudos to OpenAI not just for making a good chip but for showing the world that it’s a lot easier to beat Nvidia than it looks.
There micro architecture isn’t designed for inference
