This video walks you through the book that describes the core GPU math algorithms in GPT-3. If you understand this, then you understand the core of what AI really is.
Download the book #438c_gpt3_decoded_.docx from
I am looking for a job. Any help appreciated.
PS: In the video I talk about how Nvidia GPUs were designed for graphics… I know thats probably not true for later versions of Nvidia GPUs, but still, all their GPU CUDA SW (from what I understand) is backward compatible (something like that; I watched a video interview with one of the original CUDA devs). That would be a lot of backward compatible baggage. All I know is that working with Nvidia drivers for the AI drones (Jetson Nano) was … a challenge. Musk and others are creating their own custom chips… should be interesting to see how things work out.
[ad_2]
source
