Models / Llama / Llama 3.2 1B

Llama 3.2 1B

Run it on your iPhone or iPad. Meta's smallest Llama. Quick and light. It runs privately inside QUIET Ai: no internet connection needed, nothing leaves your device.

1.2B0.8 GB128K contextEveryday chatMultilingualOffline & travel
Exact name in the app
Llama 3.2 1B

Type this in the Models search.

Open in QUIET Ai works on an iPhone or iPad with the app installed. It also copies the name.

Which devices can run it

DeviceQ4_K_M
iPhone · 6 GB
iPhone 13 Pro, 14, 14 Pro, 15, 15 Plus
Runs great
iPhone · 8 GB
iPhone 15 Pro, 16 series, 17, 16e
Runs great
iPhone · 12 GB
iPhone 17 Pro, 17 Pro Max, iPhone Air
Runs great
iPad · 8 GB
iPad Air M1–M3, iPad mini (A17 Pro), iPad Pro M4 256/512 GB
Runs great
iPad · 16 GB
iPad Pro M4 / M5 with 1 TB or 2 TB
Runs great

Estimated for about 4,000 tokens of conversation. QUIET Ai measures your exact device before you download.

How to get it in QUIET Ai

  1. Get QUIET Ai from the App Store.
  2. Open Models and search for Llama 3.2 1B.
  3. Tap Download. QUIET checks it fits your device first.
  4. Chat. It works in Airplane Mode.

Details

FamilyLlama
Size1.2B parameters
Context131,072 tokens
LicenseLlama 3.2 License
On Hugging Facebartowski/Llama-3.2-1B-Instruct-GGUF

Questions

Can I run Llama 3.2 1B on my iPhone?

Yes, on iPhones with enough memory: it runs great on 8 GB iPhones such as the iPhone 16 and runs great on 12 GB iPhones such as the iPhone 17 Pro. QUIET Ai checks your device before downloading.

Does Llama 3.2 1B need the internet?

Only to download it once. After that it runs entirely on your device in QUIET Ai, including in Airplane Mode, and nothing you type is sent anywhere.

How big is Llama 3.2 1B?

The Q4_K_M file is about 0.8 GB.