A new repository on Hugging Face offers quantized versions of the Qwen3.8-Flash-Next model, specifically focusing on the GSQ-RCO quantizations developed by the Deep Algorithms and Systems Lab at ISTA. This release includes a control vector named 'Strata' that modifies the model's behavior at runtime by subtracting a specific direction from its residual streams, aiming to reduce refusals. The repository provides instructions for running these models with the Strata engine on consumer GPUs, detailing hardware requirements and setup commands. AI
IMPACT Enables fine-tuning of model behavior on consumer hardware by modifying refusal tendencies.
RANK_REASON Release of a quantized model with a specific control vector for runtime modification.
Read on Hugging Face Trending Models →
- alesha-pro/Qwen3.8-Flash-Next-abliterated-GSQ-RCO-Strata-GGUF
- AMD
- Hugging Face
- Huihui
- ISTA-DASLab
- Nvidia
- Qwen3.8-Flash-Next
- RTX 3090
- Strata
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →