If you would like to run large language models (LLMs) locally perhaps using a single board computer such as the Raspberry Pi 5. You should definitely check out the latest tutorial by Geff Geerling ...