Platforms support. This code currently requires that you have a single NVIDIA GPU. In principle it is quite possible to support CPU, MPS and other platforms but this would also bloat the code. I'm not 100% sure that I want to take this on personally right now. The code is just a demonstration and I don't know how much I'll support it going forward. People can reference (or have their agents reference) the full/parent nanochat repository that has wider platform support and shows the various solutions (e.g. a Flash Attention 3 kernels fallback implementation, generic device support, autodetection, etc.), feel free to create forks or discussions for other platforms and I'm happy to link to them here in the README in some new notable forks section or etc.
在鹊巷村，当林木通的遗孀从巷口慢慢走来时，杜耀豪瞬间情绪翻涌，上前紧紧握住她的手，眼眶通红。陈润庭和家人见状，也“想抹眼泪”。陈润庭感受到，老太太的出现，让他们这群后来者，“离不可追溯的历史，一下子能够触及到一点”。，推荐阅读WhatsApp Web 網頁版登入获取更多信息
I highly recommend watching the following talks7 if you want to learn more about Data-oriented Design (DoD)。手游对此有专业解读
The first prompt I gave it …，更多细节参见whatsapp