Models / Dolphin models

Dolphin models

Dolphin models that run offline on iPhone and iPad with QUIET Ai.

Dolphin 3.0 Llama 3.1 8BTight: close other apps
8B · 4.9 GB · 128K

A general assistant tuned to follow your system prompt instead of a built-in rulebook. Few refusals, strong at writing and code.

dphn/Dolphin3.0-Llama3.1-8B-GGUF
CodingEveryday chatUncensored
View details
Dolphin 3.0 Llama 3.2 3BRuns great
3.2B · 2.0 GB · 128K

The small Dolphin. Same few-refusals tuning, light enough for most recent iPhones.

bartowski/Dolphin3.0-Llama3.2-3B-GGUF
Everyday chatOffline & travelUncensored
View details
Dolphin 3.0 Llama 3.1 8B AbliteratedTight: close other apps
8B · 4.9 GB · 128K

Dolphin 3.0 with its remaining refusal behaviour removed by abliteration, a technique that edits the model's weights rather than its prompt.

mradermacher/Dolphin3.0-Llama3.1-8B-abliterated-GGUF
AbliteratedEveryday chatUncensored
View details
Dolphin 3.0 Qwen2.5 3BRuns great
3.1B · 1.9 GB · 32K

Dolphin's few-refusals tuning on Qwen2.5 3B. Quick on any recent iPhone and good in many languages.

bartowski/Dolphin3.0-Qwen2.5-3b-GGUF
Everyday chatMultilingualOffline & travelUncensored
View details
Dolphin 3.0 Qwen2.5 1.5BRuns great
1.5B · 1.0 GB · 32K

The smallest Dolphin: under 1 GB, so it runs on nearly every iPhone that QUIET Ai supports.

bartowski/Dolphin3.0-Qwen2.5-1.5B-GGUF
Everyday chatOffline & travelUncensored
View details
Dolphin 2.9.3 Mistral 7BTight: close other apps
7.2B · 4.4 GB · 32K

The classic Dolphin on Mistral 7B: follows the system prompt, with a 32K context for long chats.

bartowski/dolphin-2.9.3-mistral-7B-32k-GGUF
Everyday chatStories & charactersUncensored
View details

Download on the App Store