#llm-inference

2 projects

Swift Aug 15, 2026

How to run a 26 billion parameter model in two gigabytes of memory on a regular Mac

Engineer Andrey Mikhailov built TurboFieldfare, a custom Swift/Metal runtime that runs Google's Gemma 4 26B-A4B model in just 2 GB of RAM on a basic MacBook Air M2.

Python Jul 26, 2026

Exploring LitGPT - How to Fine-Tune and Run Open Neural Networks Without Heavy Frameworks

LitGPT from Lightning AI rewrites 20+ popular LLM architectures in pure PyTorch, offering fine-tuning, deployment, and benchmarking without heavy framework overhead.