Models / Dolphin / Dolphin 2.9.3 Mistral 7B
Dolphin 2.9.3 Mistral 7B
Run it on your iPhone or iPad. The classic Dolphin on Mistral 7B: follows the system prompt, with a 32K context for long chats. It runs privately inside QUIET Ai: no internet connection needed, nothing leaves your device.
bartowski/dolphin-2.9.3-mistral-7B-32k-GGUFPaste this in Models › More › Add from Hugging Face.
Open in QUIET Ai works on an iPhone or iPad with the app installed. It also copies the name.
Which devices can run it
| Device | Q4_K_M |
|---|---|
| iPhone · 6 GB iPhone 13 Pro, 14, 14 Pro, 15, 15 Plus | Too big |
| iPhone · 8 GB iPhone 15 Pro, 16 series, 17, 16e | Tight: close other apps |
| iPhone · 12 GB iPhone 17 Pro, 17 Pro Max, iPhone Air | Runs great |
| iPad · 8 GB iPad Air M1–M3, iPad mini (A17 Pro), iPad Pro M4 256/512 GB | Tight: close other apps |
| iPad · 16 GB iPad Pro M4 / M5 with 1 TB or 2 TB | Runs great |
Estimated for about 4,000 tokens of conversation. QUIET Ai measures your exact device before you download.
How to get it in QUIET Ai
- Get QUIET Ai from the App Store.
- Open Models › More › Add from Hugging Face.
- Paste
bartowski/dolphin-2.9.3-mistral-7B-32k-GGUFand pick the Q4_K_M file. - QUIET reads the file's header and shows whether it fits before anything downloads.
Details
| Family | Dolphin |
| Size | 7.2B parameters |
| Context | 32,768 tokens |
| License | Apache 2.0 |
| On Hugging Face | bartowski/dolphin-2.9.3-mistral-7B-32k-GGUF |
Questions
Can I run Dolphin 2.9.3 Mistral 7B on my iPhone?
Yes, on iPhones with enough memory: it tight: close other apps on 8 GB iPhones such as the iPhone 16 and runs great on 12 GB iPhones such as the iPhone 17 Pro. QUIET Ai checks your device before downloading.
Does Dolphin 2.9.3 Mistral 7B need the internet?
Only to download it once. After that it runs entirely on your device in QUIET Ai, including in Airplane Mode, and nothing you type is sent anywhere.
How big is Dolphin 2.9.3 Mistral 7B?
The Q4_K_M file is about 4.4 GB.