Models / Mistral / Mistral 7B

Mistral 7B

Run it on your iPhone or iPad. A classic 7B model with a direct style. It runs privately inside QUIET Ai: no internet connection needed, nothing leaves your device.

7.2B4.4 GB32K contextEveryday chat
Exact name in the app
Mistral 7B

Type this in the Models search.

Open in QUIET Ai works on an iPhone or iPad with the app installed. It also copies the name.

Which devices can run it

DeviceQ4_K_M
iPhone · 6 GB
iPhone 13 Pro, 14, 14 Pro, 15, 15 Plus
Too big
iPhone · 8 GB
iPhone 15 Pro, 16 series, 17, 16e
Tight: close other apps
iPhone · 12 GB
iPhone 17 Pro, 17 Pro Max, iPhone Air
Runs great
iPad · 8 GB
iPad Air M1–M3, iPad mini (A17 Pro), iPad Pro M4 256/512 GB
Tight: close other apps
iPad · 16 GB
iPad Pro M4 / M5 with 1 TB or 2 TB
Runs great

Estimated for about 4,000 tokens of conversation. QUIET Ai measures your exact device before you download.

How to get it in QUIET Ai

  1. Get QUIET Ai from the App Store.
  2. Open Models and search for Mistral 7B.
  3. Tap Download. QUIET checks it fits your device first.
  4. Chat. It works in Airplane Mode.

Details

FamilyMistral
Size7.2B parameters
Context32,768 tokens
LicenseApache 2.0
On Hugging Facebartowski/Mistral-7B-Instruct-v0.3-GGUF

Questions

Can I run Mistral 7B on my iPhone?

Yes, on iPhones with enough memory: it tight: close other apps on 8 GB iPhones such as the iPhone 16 and runs great on 12 GB iPhones such as the iPhone 17 Pro. QUIET Ai checks your device before downloading.

Does Mistral 7B need the internet?

Only to download it once. After that it runs entirely on your device in QUIET Ai, including in Airplane Mode, and nothing you type is sent anywhere.

How big is Mistral 7B?

The Q4_K_M file is about 4.4 GB.