Program-as-Weights: A Programming Paradigm for Fuzzy Functions
Turning vague instructions into tiny, reusable AI programs that run locally
Researchers built a system that compiles natural-language descriptions into small neural programs that can run on ordinary computers without calling cloud APIs. A tiny 600-million-parameter interpreter running these programs matches the output quality of a 32-billion-parameter model, while using 50 times less memory and running 30 times faster on a MacBook.
Tasks like filtering log files or ranking search results currently require paid API calls to large language models every single time. This approach lets you define the function once and then run it repeatedly on your own machine—cheaper, faster, and without sending data to the cloud. It's especially valuable for teams who need reproducible results or can't rely on internet access.