Models / Qwen / Qwen2.5 3B Instruct Abliterated
Qwen2.5 3B Instruct Abliterated
Run it on your iPhone or iPad. Qwen2.5 3B with refusals removed. Small, fast and multilingual. It runs privately inside QUIET Ai: no internet connection needed, nothing leaves your device.
mradermacher/Qwen2.5-3B-Instruct-abliterated-GGUFPaste this in Models › More › Add from Hugging Face.
Open in QUIET Ai works on an iPhone or iPad with the app installed. It also copies the name.
Which devices can run it
| Device | Q4_K_M |
|---|---|
| iPhone · 6 GB iPhone 13 Pro, 14, 14 Pro, 15, 15 Plus | Runs great |
| iPhone · 8 GB iPhone 15 Pro, 16 series, 17, 16e | Runs great |
| iPhone · 12 GB iPhone 17 Pro, 17 Pro Max, iPhone Air | Runs great |
| iPad · 8 GB iPad Air M1–M3, iPad mini (A17 Pro), iPad Pro M4 256/512 GB | Runs great |
| iPad · 16 GB iPad Pro M4 / M5 with 1 TB or 2 TB | Runs great |
Estimated for about 4,000 tokens of conversation. QUIET Ai measures your exact device before you download.
How to get it in QUIET Ai
- Get QUIET Ai from the App Store.
- Open Models › More › Add from Hugging Face.
- Paste
mradermacher/Qwen2.5-3B-Instruct-abliterated-GGUFand pick the Q4_K_M file. - QUIET reads the file's header and shows whether it fits before anything downloads.
Details
| Family | Qwen |
| Size | 3.1B parameters |
| Context | 32,768 tokens |
| License | Qwen Research License |
| On Hugging Face | mradermacher/Qwen2.5-3B-Instruct-abliterated-GGUF |
Questions
Can I run Qwen2.5 3B Instruct Abliterated on my iPhone?
Yes, on iPhones with enough memory: it runs great on 8 GB iPhones such as the iPhone 16 and runs great on 12 GB iPhones such as the iPhone 17 Pro. QUIET Ai checks your device before downloading.
Does Qwen2.5 3B Instruct Abliterated need the internet?
Only to download it once. After that it runs entirely on your device in QUIET Ai, including in Airplane Mode, and nothing you type is sent anywhere.
How big is Qwen2.5 3B Instruct Abliterated?
The Q4_K_M file is about 1.9 GB.