dicksondickson/DSV4-Flash-Vision-Exp-ablit-DS4-GGUF

This GGUF is an Antirez DS4 / DwarfStar compatible quantization of:
drowzeys/keys-DeepSeekV4Flash-Vision-EXP-ablit

Using imatrix collected using Antirez's GGUF:
antirez/deepseek-v4-gguf
DeepSeek-V4-Flash-Vision-Exp-IQ2XXS-w2Q2K-AProjQ8-SExpQ8-OutQ8.gguf

GGUF quantized using Antirez's GGUF as template:
antirez/deepseek-v4-gguf
DeepSeek-V4-Flash-Vision-Exp-IQ2XXS-w2Q2K-AProjQ8-SExpQ8-OutQ8.gguf

Run this using DS4 / DwarfStar:
https://github.com/antirez/ds4

Vision tower and Dspark is untouched and is a mirror of Antirez's repo.

Credits

Keys (drowzeys) — abliteration + safetensor anchors
Antirez - DS4 engine + gguf file / template
DeepSeek-AI — DeepSeek-V4-Flash-0731

Usage Warnings

  • Risk of Sensitive or Controversial Outputs: This model’s safety filtering has been significantly reduced, potentially generating sensitive, controversial, or inappropriate content. Users should exercise caution and rigorously review generated outputs.

  • Not Suitable for All Audiences: Due to limited content filtering, the model’s outputs may be inappropriate for public settings, underage users, or applications requiring high security.

  • Legal and Ethical Responsibilities: Users must ensure their usage complies with local laws and ethical standards. Generated content may carry legal or ethical risks, and users are solely responsible for any consequences.

  • Research and Experimental Use: It is recommended to use this model for research, testing, or controlled environments, avoiding direct use in production or public-facing commercial applications.

  • Monitoring and Review Recommendations: Users are strongly advised to monitor model outputs in real-time and conduct manual reviews when necessary to prevent the dissemination of inappropriate content.

  • No Default Safety Guarantees: Unlike standard models, this model has not undergone rigorous safety optimization. I/we bears no responsibility for any consequences arising from its use.

Downloads last month
494
GGUF
Model size
0.5B params
Architecture
deepseek4-vision
Hardware compatibility
Log In to add your hardware

We're not able to determine the quantization variants.

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for dicksondickson/DSV4-Flash-Vision-Exp-ablit-DS4-GGUF

Collection including dicksondickson/DSV4-Flash-Vision-Exp-ablit-DS4-GGUF