Models / Hermes / Hermes 3 Llama 3.2 3B

Hermes 3 Llama 3.2 3B

Run it on your iPhone or iPad. The compact Hermes 3 for stories and characters on a phone with less memory. It runs privately inside QUIET Ai: no internet connection needed, nothing leaves your device.

3.2B2.0 GB128K contextEveryday chatOffline & travelStories & charactersUncensored
Exact name in the app
bartowski/Hermes-3-Llama-3.2-3B-GGUF

Paste this in Models › More › Add from Hugging Face.

Open in QUIET Ai works on an iPhone or iPad with the app installed. It also copies the name.

Use it responsibly
This model is tuned to refuse less. It can produce content that is inaccurate or unsuitable for some people. QUIET Ai is rated 18+. You're responsible for how you use what it writes, and for following the law where you live.

Which devices can run it

DeviceQ4_K_M
iPhone · 6 GB
iPhone 13 Pro, 14, 14 Pro, 15, 15 Plus
Runs great
iPhone · 8 GB
iPhone 15 Pro, 16 series, 17, 16e
Runs great
iPhone · 12 GB
iPhone 17 Pro, 17 Pro Max, iPhone Air
Runs great
iPad · 8 GB
iPad Air M1–M3, iPad mini (A17 Pro), iPad Pro M4 256/512 GB
Runs great
iPad · 16 GB
iPad Pro M4 / M5 with 1 TB or 2 TB
Runs great

Estimated for about 4,000 tokens of conversation. QUIET Ai measures your exact device before you download.

How to get it in QUIET Ai

  1. Get QUIET Ai from the App Store.
  2. Open Models › More › Add from Hugging Face.
  3. Paste bartowski/Hermes-3-Llama-3.2-3B-GGUF and pick the Q4_K_M file.
  4. QUIET reads the file's header and shows whether it fits before anything downloads.

Details

FamilyHermes
Size3.2B parameters
Context131,072 tokens
LicenseLlama 3.2 License
On Hugging Facebartowski/Hermes-3-Llama-3.2-3B-GGUF

Questions

Can I run Hermes 3 Llama 3.2 3B on my iPhone?

Yes, on iPhones with enough memory: it runs great on 8 GB iPhones such as the iPhone 16 and runs great on 12 GB iPhones such as the iPhone 17 Pro. QUIET Ai checks your device before downloading.

Does Hermes 3 Llama 3.2 3B need the internet?

Only to download it once. After that it runs entirely on your device in QUIET Ai, including in Airplane Mode, and nothing you type is sent anywhere.

How big is Hermes 3 Llama 3.2 3B?

The Q4_K_M file is about 2.0 GB.