Peak Pocket AI

Phone AI Index

Speed board

Each row is one device, one model file and one GPU setting. Speed comes from the Speed check: a fixed prompt, a fixed seed, a warm-up, then five timed replies. The value is the median of those five. The interval is a distribution-free 95% interval for the median of the submissions. Rows with fewer than three submissions are marked provisional. What a result contains.

iPhone

iPhone 12 Pro (iPhone13,3)
ModelQuantSizeDecode tok/s [95% CI]Prefill tok/sTTFTnGPUConditions
bartowski/Llama-3.2-3B-Instruct-GGUF
Llama-3.2-3B-Instruct-Q4_K_M.gguf
Q4_K_M2.02 GB7.3 [no interval]55.43163 ms1 provisionalGPU100% on battery, llama.cpp b11118