TIL: MLX is only a little faster than llama.cpp on my M1
This is part one, on an M1 with 16 GB of memory. In part two I'll run the exact same test on my 10-core M5 with 24 GB.
Writing
The Bajoran Engineer
Python, software, web development, Django, JavaScript, Open Source, Ethics.
Posts tagged LLM Clear
-
-
Building an Agentic Python App for Mobile
The answer to whether I can get an agentic Python App running on mobile spans the full environment stack and proposes a really exciting problem. The goal is to keep …
