Mattbeton COM

1 post in this topic

RSS All Topics Community
Autoregressive Language Model on the 6502 Processor

Community post

Autoregressive Language Model on the 6502 Processor

A language model on a 1975 MOS 6502 processor, using a tiny Mamba-based language model and custom 8-bit ternary inference engine, used to generate text on a BBC Micro from the 1980s.

1 min read W WebNovare Imports

A language model on a 1975 MOS 6502 processor, using a tiny Mamba-based language model and custom 8-bit ternary inference engine, used to generate text on a BBC Micro from the 1980s. Source: mattbeton.com (23 points, 5 comments) Hacker News discussion