From 8bab852cacc2f59876a685ec9ec0ed474f5d1ca5 Mon Sep 17 00:00:00 2001 From: mudler <2420543+mudler@users.noreply.github.com> Date: Wed, 5 Nov 2025 15:39:31 +0000 Subject: [PATCH] chore(model gallery): :robot: add new models via gallery agent Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> --- gallery/index.yaml | 60 ++++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 60 insertions(+) diff --git a/gallery/index.yaml b/gallery/index.yaml index 209e4c6c83fb..c971d2ca59d2 100644 --- a/gallery/index.yaml +++ b/gallery/index.yaml @@ -23049,3 +23049,63 @@ - filename: YanoljaNEXT-Rosetta-27B-2511.i1-Q4_K_M.gguf sha256: 0a599099e93ad521045e17d82365a73c1738fff0603d6cb2c9557e96fbc907cb uri: huggingface://mradermacher/YanoljaNEXT-Rosetta-27B-2511-i1-GGUF/YanoljaNEXT-Rosetta-27B-2511.i1-Q4_K_M.gguf +- !!merge <<: *qwen3vl + name: "qwen3-vl-12b-instruct-brainstorm20x-i1" + urls: + - https://huggingface.co/mradermacher/Qwen3-VL-12B-Instruct-Brainstorm20x-i1-GGUF + description: | + **Model Name:** Qwen3-VL-12B-Instruct-Brainstorm20x + **Base Model:** Qwen/Qwen3-VL-8B-Instruct + **Repository:** [mradermacher/Qwen3-VL-12B-Instruct-Brainstorm20x-i1-GGUF](https://huggingface.co/mradermacher/Qwen3-VL-12B-Instruct-Brainstorm20x-i1-GGUF) + **Type:** Multimodal Instruction-Finetuned Language Model (Vision-Language) + **Architecture:** Qwen3-VL with Brainstorm 20x adapter (expanded from 8B to 12B, 55 layers, 608 tensors) + + --- + + ### ๐Ÿ” **Overview** + A powerful, instruction-tuned multimodal model that combines **Qwen3-VL-8B-Instruct** with the advanced **Brainstorm 20x adapter**, enhancing reasoning, creativity, and narrative depth. This model excels at image-to-text generation, visual coding, long-context understanding (up to 256K tokens), and complex multimodal tasks. + + --- + + ### ๐ŸŒŸ **Key Features** + - **Enhanced Creative Reasoning:** Brainstorm 20x improves prose quality, coherence, emotional engagement, and detail densityโ€”ideal for storytelling, brainstorming, and creative writing. + - **Stronger Visual Understanding:** Superior object recognition, spatial reasoning, video comprehension, and OCR (supports 32 languages). + - **Code & Image Generation:** Generates HTML/CSS/JS, Draw.io diagrams, and structured code from images. + - **Long-Context & Multimodal Flexibility:** Handles books, videos, and detailed prompts with full recall and temporal indexing. + - **Highly Customizable:** Works with GGUF, GPTQ, EXL2, AWQ, and HQQ quantizations; requires a separate `mmproj` quant (Q8/F16/BF16/F32) for full functionality. + + --- + + ### ๐Ÿ› ๏ธ **Use Cases** + - Creative writing & world-building + - Visual brainstorming & ideation + - AI-powered design & coding from images + - Long-form content generation + - Multimodal agents and GUI interaction + + --- + + ### โš™๏ธ **Recommended Settings** + - **Temperature:** 0.3โ€“0.7 (up to 1.5 for creative tasks) + - **Top-p:** 0.8, **Top-k:** 20 + - **Repetition Penalty:** 1.05โ€“1.1 + - **Smoothing Factor:** 1.5 (in KoboldCpp, oobabooga, SillyTavern) + - **Context Length:** At least 8K for complex tasks + + --- + + ### ๐Ÿ“Œ **Note on Quantization** + This repository contains **quantized GGUF versions** of the model. The original full-precision base model is **Qwen/Qwen3-VL-8B-Instruct**. To access the true base model description and weights, refer to the original repo: [Qwen/Qwen3-VL-8B-Instruct](https://huggingface.co/Qwen/Qwen3-VL-8B-Instruct). + + --- + + **Ideal for:** Developers, creators, researchers, and AI enthusiasts seeking a rich, expressive, and deeply reasoning multimodal model with exceptional narrative and visual intelligence. + + > โœ… **Use the original base model for full precision; use this GGUF version for efficient, high-quality inference.** + overrides: + parameters: + model: Qwen3-VL-12B-Instruct-Brainstorm20x.i1-Q4_K_M.gguf + files: + - filename: Qwen3-VL-12B-Instruct-Brainstorm20x.i1-Q4_K_M.gguf + sha256: 1d960b389b00e064864a2e835daaafb02026961c85ce45473d12b42f18f5a263 + uri: huggingface://mradermacher/Qwen3-VL-12B-Instruct-Brainstorm20x-i1-GGUF/Qwen3-VL-12B-Instruct-Brainstorm20x.i1-Q4_K_M.gguf