Transformers
Trained first, then deployed frozen.
Most of today's AI runs on transformers. A transformer is completely feed-forward, and in a typical deployed model its attention matrices and all other weights are fixed once training ends. New knowledge means fine-tuning or retraining, a separate run in a data centre.