Autoregressive Language Model on the 6502 Processor

Community post

A language model on a 1975 MOS 6502 processor, using a tiny Mamba-based language model and custom 8-bit ternary inference engine, used to generate text on a BBC Micro from the 1980s.

WebNovare Imports W
Autoregressive Language Model on the 6502 Processor

A language model on a 1975 MOS 6502 processor, using a tiny Mamba-based language model and custom 8-bit ternary inference engine, used to generate text on a BBC Micro from the 1980s.

Source: mattbeton.com (23 points, 5 comments) Hacker News discussion

Reader Support

Support WebNovare

Send a crypto tip if this article helped you.

Comments

No comments yet.

Log in or register to join the conversation.