Skip to content
localmodel.run

Device profile · Android

Best local LLMs for Generic Android Phone (12GB RAM)

Generic Android Phone (12GB RAM) has ~8.5 GB usable for model weights and runs 35 of 67 popular models. Best tool: PocketPal AI.

Usable memory
~8.5 GB
Models run
35
Too large
32
Top pick
4B
Top pick Q4_K_M
Gemma 3 4B Yes

Runs at Q4_K_M using ~3.8 GB of ~8.5 GB usable. You have room for Q8_0 for higher quality.

Runs on Generic Android Phone (12GB RAM)

Compatible models 35 total

Too large for this device

DeepSeek R1DeepSeek V3Qwen3 235B A22Bgpt-oss 120BLlama 4 ScoutSarvam-105BQwen2.5 72BLlama 3.3 70BMixtral 8x7BCommand R 35BYi 1.5 34BQwen2.5 32BQwen3 32BDeepSeek-R1-Distill-Qwen 32BQwen2.5 Coder 32BGranite 4.0 H SmallQwen3 30B-A3BSarvam-30BGemma 2 27BGemma 3 27BMistral Small 3 24BSarvam-M 24Bgpt-oss 20BDeepSeek-V2-LitePhi-4 14BQwen2.5 14BQwen3 14BDeepSeek-R1-Distill-Qwen 14BQwen2.5 Coder 14BMistral Nemo 12BGemma 3 12BLlama 3.2 Vision 11B

Best way to run models on Android

Runtime guide Android

Beginner: PocketPal AI, Polished app, download GGUF and run offline.

Power user: MLC LLM / LiteRT-LM, GPU/NPU acceleration paths for supported chips.

NPU acceleration is limited and chip-specific; most apps run on CPU. Expect 1B-4B class.

Full Android tool guide →

FAQ

What is the best local LLM for Generic Android Phone (12GB RAM)?

Gemma 3 4B is the strongest model that runs comfortably, using ~3.8 GB at Q4_K_M of the ~8.5 GB usable on Generic Android Phone (12GB RAM).

How much of Generic Android Phone (12GB RAM)'s memory can I use for a model?

About 8.5 GB. On a CPU-only machine, leave headroom for the OS and apps.

Which tool should I use on Android?

PocketPal AI (Polished app, download GGUF and run offline.) or MLC LLM / LiteRT-LM for speed. NPU acceleration is limited and chip-specific; most apps run on CPU. Expect 1B-4B class.

Sources

Memory figures are estimates. See methodology.