TIL: MLX is only a little faster than llama.cpp on my M1
This is part one, on an M1 with 16 GB of memory. In part two I'll run the exact same test on my 10-core M5 with 24 GB.
Writing
Posts tagged apple-silicon Clear
This is part one, on an M1 with 16 GB of memory. In part two I'll run the exact same test on my 10-core M5 with 24 GB.