Dolphin 3.0 Review: Uncensored Local LLM for NSFW, Roleplay and Coding

Dolphin 3.0 is one of the classic names in the uncensored local LLM world. It is not just another benchmark model: people look for Dolphin…

schedule
article 8 min read
Dolphin 3.0 review cover for uncensored local LLM and NSFW support

Dolphin 3.0 is one of the classic names in the uncensored local LLM world. It is not just another benchmark model: people look for Dolphin because they want a model that is more willing to follow the system prompt, more flexible for writing and roleplay, and less filtered than mainstream hosted assistants.

The practical summary is this: Dolphin 3.0 R1 Mistral 24B is the stronger flagship choice if you have enough GPU memory, while Dolphin 3.0 Llama 3.1 8B is the easier desktop model for Ollama, LM Studio and quick local experiments. It is a good fit for creative writing, roleplay, coding, math and agent-style local workflows, but public deployment still needs your own safety rules.

What Is Dolphin 3.0?

Dolphin 3.0 is a family of instruction-tuned local models curated by Eric Hartford, Ben Gitter, BlouseJury and Cognitive Computations. The model card for Dolphin3.0-R1-Mistral-24B describes it as a general-purpose local model for coding, math, agentic work, function calling and broad chat use. It also makes the Dolphin philosophy clear: the system owner, not the model publisher, should decide the system prompt and alignment policy.

Dolphin 3.0 R1 Mistral 24B on Hugging Face
Dolphin 3.0 R1 Mistral 24B is the flagship 24B-class Dolphin 3.0 release for reasoning, coding and general local use.

That philosophy is why Dolphin has stayed popular in the local community. It is often chosen by users who find mainstream safety-aligned assistants too restrictive for fiction, private roleplay, local experimentation, or prompt-behavior research. At the same time, Dolphin is still just a model: it can hallucinate, follow bad prompts, and produce content that is unsuitable for public products without moderation.

Dolphin Hugging Face organization page
The Dolphin organization page links the project, models and official community entry points.

Official Downloads

Model Best for Download
Dolphin 3.0 R1 Mistral 24B Best overall quality in the classic Dolphin 3.0 line; coding, math, roleplay and agentic tasks Hugging Face 24B
Dolphin 3.0 Llama 3.1 8B Consumer GPU testing, desktop local chat, fast roleplay and writing Hugging Face 8B
Dolphin 3.0 Llama 3.1 8B GGUF llama.cpp, LM Studio, KoboldCPP, Ollama-style local use Official GGUF 8B
Dolphin 3.0 R1 Mistral 24B GGUF Quantized 24B desktop/server testing Bartowski GGUF 24B
Ollama dolphin3 Fast one-command local setup for 8B Ollama dolphin3
Dolphin 3.0 Llama 3.1 8B on Hugging Face
Dolphin 3.0 Llama 3.1 8B is the easier entry point for consumer GPUs and desktop tools.

If you are new to Dolphin, start with the 8B version or Ollama. Move to the 24B model when you know your prompts, context length and hardware limits. The 24B model is the more interesting review target, but the 8B model is the one most people can actually run without changing their workstation.

User Impressions and Strengths

Community interest in Dolphin usually centers on three strengths: prompt obedience, writing/roleplay stability, and fewer refusals. The model is not trying to be the safest general assistant. It is trying to be a controllable local model that lets the user define behavior through the system prompt.

Compared with many official chat models, Dolphin often feels more direct and less paternalistic. That makes it useful for fiction writing, character dialogue, private brainstorming, local agents and coding assistants where the owner wants strong instruction following. The tradeoff is that it needs more user discipline: if the prompt is bad, the output can be bad in a very literal way.

Comparison With Local LLMs

Model How it compares with Dolphin 3.0 Who should choose it
Dolphin 3.0 Classic uncensored fine-tune route, strong system-prompt control, popular for writing and roleplay. Users who want local flexibility and fewer refusals.
Qwen 3.8 Stronger broad multilingual/coding ecosystem and newer large-model family; more safety-aligned in official routes. Users who need Japanese/Chinese/English work, coding and RAG.
Gemma 4 Google-backed model family with cleaner official documentation and multimodal focus; less uncensored by default. Users who prefer mainstream open weights and safety documentation.
Llama 3.1 / Llama 4 fine-tunes Huge ecosystem and many uncensored derivatives; Dolphin is a recognizable curated line. Users who want maximum community model choice.
Mistral Small 24B The base style behind the 24B route is capable, but Dolphin changes the instruction-following and refusal profile. Users who want a more conventional instruct model may prefer Mistral.
Nous / Hermes models Also strong in roleplay and instruction following; usually less explicitly marketed as uncensored. Users comparing creative writing and agent behavior.

Local Setup

The easiest route is Ollama for the 8B model. It hides most setup details and is good enough for quick chat tests, prompt experiments and local writing workflows.

Dolphin 3 on Ollama
Ollama is one of the simplest ways to run the 8B Dolphin 3 model locally.
ollama pull dolphin3 ollama run dolphin3

For GGUF files, use LM Studio or llama.cpp. For the full 24B Safetensors model, use Transformers or a serving stack such as vLLM if your hardware is ready.

pip install -U transformers accelerate torch safetensors python - <<'PY' from transformers import AutoModelForCausalLM, AutoTokenizer model_id = "dphn/Dolphin3.0-R1-Mistral-24B" tok = AutoTokenizer.from_pretrained(model_id) model = AutoModelForCausalLM.from_pretrained( model_id, torch_dtype="auto", device_map="auto", ) PY

GPU Requirements

Model BF16 estimate Practical route Notes
Dolphin 3.0 Mistral 24B Around 48GB+ for weights, more with long context and KV cache 24GB GPU can be realistic with 4-bit GGUF/quantized builds and shorter context Best quality, but not the easiest local model.
Dolphin 3.0 Llama 3.1 8B 16GB+ is comfortable for BF16-style use 6GB-12GB can work with GGUF quantization Best first model for home GPUs.
CPU-only GGUF No VRAM required, but slower Use Q4/Q5 GGUF with llama.cpp or LM Studio Fine for writing tests, not ideal for long agents.
Online API/chat No local GPU Use Dolphin web, OpenRouter or another provider Good for evaluation before downloading.

The real memory requirement depends on quantization, context length, batch size, KV cache, GPU offload and your runner. For roleplay or writing with long context, memory grows quickly. If a model loads but becomes slow or crashes, reduce context length before assuming the model is unusable.

Online Use When Your Hardware Is Not Enough

Dolphin’s own web entry point is dphn.ai/chat, and the Dolphin Hugging Face organization also points users toward official project channels. This is the cleanest place to start if you want to understand the project before downloading a local model.

Dolphin official chat site
Dolphin's own site provides a direct web entry point before you download a local model.

For API-style testing, OpenRouter's Cognitive Computations page can be useful. It lists Cognitive Computations models and lets developers compare pricing, context windows and capabilities. Venice is another online AI chat service that privacy-focused and less-restrictive-chat users often consider, though it should be treated as a separate service rather than the official Dolphin site.

Cognitive Computations models on OpenRouter
OpenRouter can be useful when your hardware is not enough or you want API-style testing.

NSFW and Uncensored Behavior

Dolphin 3.0 is one of the better-known uncensored local model families. For private local use, it is generally more willing to follow adult, roleplay or sensitive creative prompts than mainstream hosted assistants. That is the main reason people search for Dolphin with terms like NSFW, uncensored, roleplay and jailbreak-free local LLM.

Still, uncensored does not mean harmless or unlimited. Dolphin can generate adult content, unsafe suggestions, biased content or legally sensitive output if prompted. The model will not automatically replace policy design. If you deploy it for other people, you need your own rules, filters, logging choices and abuse handling. For personal use, keep it local and understand the laws and platform rules where you live.

The healthiest way to think about Dolphin is not as a magic model without consequences, but as a controllable local fine-tune. It is excellent when you want the system prompt to matter and you accept responsibility for what you ask it to do.

FAQ

Is Dolphin 3.0 really uncensored?

It is much less refusal-heavy than mainstream hosted assistants and is widely recognized as part of the uncensored fine-tune tradition. But behavior still depends on the model variant, prompt, runner and any moderation layer you add.

Which Dolphin 3.0 model should I start with?

Start with Dolphin 3.0 Llama 3.1 8B through Ollama or GGUF if you have a normal desktop. Try Dolphin 3.0 R1 Mistral 24B when you want better quality and have enough VRAM or a quantized build.

Can RTX 4090 24GB run the 24B model?

The full BF16 24B model is too large for comfortable 24GB use, but 4-bit GGUF or other quantized builds can be realistic with shorter context and careful settings.

Is Dolphin good for Japanese?

It can respond in Japanese, but it is not primarily known as a Japanese model. Qwen or other multilingual models may be stronger for polished Japanese writing. Dolphin is more attractive for prompt obedience and uncensored roleplay behavior.

Is it safe to use Dolphin online?

Online providers have their own privacy rules, logs, moderation and terms. For sensitive prompts, local use is safer. For quick evaluation, online sites are convenient as long as you do not upload confidential material.

Can I use Dolphin commercially?

Check the license of the exact model and any base model or GGUF conversion you download. The license and acceptable-use terms can differ between base weights, fine-tunes and quantized uploads.

Verdict

Dolphin 3.0 remains one of the cleanest examples of the classic uncensored local fine-tune route. It is easy to recommend when the reader wants creative writing, roleplay, agent-style prompts, coding help and fewer refusals than mainstream chat assistants.

The best first step is the 8B model through Ollama or GGUF. The 24B Mistral model is the more serious quality target if you have stronger hardware. For NSFW and uncensored use, the model is powerful precisely because it gives more control back to the user, which also means the user has to take more responsibility.

References

Sign In

OR

Create Account

Password must be 8-20 characters and contain letters and numbers

OR

Forgot Password

Password must be 8-20 characters and contain letters and numbers