Models / Dolphin models
Dolphin models
Dolphin models that run offline on iPhone and iPad with QUIET Ai.
Dolphin 3.0 Llama 3.1 8BTight: close other apps
A general assistant tuned to follow your system prompt instead of a built-in rulebook. Few refusals, strong at writing and code.
dphn/Dolphin3.0-Llama3.1-8B-GGUF
View details
Dolphin 3.0 Llama 3.2 3BRuns great
The small Dolphin. Same few-refusals tuning, light enough for most recent iPhones.
bartowski/Dolphin3.0-Llama3.2-3B-GGUF
View details
Dolphin 3.0 Llama 3.1 8B AbliteratedTight: close other apps
Dolphin 3.0 with its remaining refusal behaviour removed by abliteration, a technique that edits the model's weights rather than its prompt.
mradermacher/Dolphin3.0-Llama3.1-8B-abliterated-GGUF
View details
Dolphin 3.0 Qwen2.5 3BRuns great
Dolphin's few-refusals tuning on Qwen2.5 3B. Quick on any recent iPhone and good in many languages.
bartowski/Dolphin3.0-Qwen2.5-3b-GGUF
View details
Dolphin 3.0 Qwen2.5 1.5BRuns great
The smallest Dolphin: under 1 GB, so it runs on nearly every iPhone that QUIET Ai supports.
bartowski/Dolphin3.0-Qwen2.5-1.5B-GGUF
View details
Dolphin 2.9.3 Mistral 7BTight: close other apps
The classic Dolphin on Mistral 7B: follows the system prompt, with a 32K context for long chats.
bartowski/dolphin-2.9.3-mistral-7B-32k-GGUF
View details