You might find our ProgramAsWeights work interesting! We train a neural compiler on (English function description, input, output) examples to produce small neural programs that run locally on CPU.
The paper explains how we generated the training data. We've also released the code, model weights, and dataset:
Paper:
Dataset:
You can try it here: