Duplicate from VIDraft/Gemma-3-R1984-1B

.gitattributes

@@ -0,0 +1,36 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,181 @@
+---
+license: gemma
+library_name: transformers
+base_model: google/gemma-3-1b-it
+language:
+- en
+- ko
+- ja
+- zh
+- es
+- ru
+- ar
+- hi
+- id
+- ml
+- fr
+- de
+pipeline_tag: image-text-to-text
+---
+
+# Gemma3-R1984-1B
+
+# Model Overview
+Gemma3-R1984-1B is a robust Agentic AI platform built on Googls’s Gemma-3-4B model. It integrates state-of-the-art deep research via web search with multimodal file processing—including images, videos, and documents—and handles long contexts up to 8,000 tokens. Designed for local deployment on independent servers using NVIDIA L40s, L4, A-100(ZeroGPU) GPUs, it provides high security, prevents data leakage, and delivers uncensored responses.
+
+# Key Features
+Multimodal Processing:
+Supports multiple file types such as images (PNG, JPG, JPEG, GIF, WEBP), videos (MP4), and documents (PDF, CSV, TXT).
+
+Deep Research (Web Search):
+Automatically extracts keywords from user queries and utilizes the SERPHouse API to retrieve up to 20 real-time search results. The model incorporates multiple sources by explicitly citing them in the response.
+
+Long Context Handling:
+Capable of processing inputs up to 8,000 tokens, ensuring comprehensive analysis of lengthy documents or conversations.
+
+Robust Reasoning:
+Employs extended chain-of-thought reasoning for systematic and accurate answer generation.
+
+Secure Local Deployment:
+Operates on independent local servers using NVIDIA L40s GPUs to maximize security and prevent information leakage.
+
+**Experience the Power of Gemma3-R1984-1B**
+
+- ✅ **Agentic AI Platform:** An autonomous system designed to make intelligent decisions and act independently.
+- ✅ **Reasoning & Uncensored:** Delivers clear, accurate, and unfiltered responses by harnessing advanced reasoning capabilities.
+- ✅ **Multimodal & VLM:** Seamlessly processes and interprets multiple input types—text, images, videos—empowering versatile applications.
+- ✅ **Deep-Research & RAG:** Integrates state-of-the-art deep research and retrieval-augmented generation to provide comprehensive, real-time insights.
+
+**Cutting-Edge Hardware for Maximum Security**
+
+Gemma3-R1984-1B is engineered to operate on a dedicated **NVIDIA L40s GPU** within an independent local server environment. This robust setup not only guarantees optimal performance and rapid processing but also enhances security by isolating the model from external networks, effectively preventing information leakage. Whether handling sensitive data or complex queries, our platform ensures that your information remains secure and your AI interactions remain uncompromised.
+
+
+
+# Use Cases
+Fast-response conversational agents
+
+Deep research and retrieval-augmented generation (RAG)
+
+Document comparison and detailed analysis
+
+Visual question answering from images and videos
+
+Complex reasoning and research-based inquiries
+
+# Supported File Formats
+Images: PNG, JPG, JPEG, GIF, WEBP
+
+Videos: MP4
+
+Documents: PDF, CSV, TXT
+
+# Model Details
+Parameter Count: Approximately 1B parameters (estimated)
+
+Context Window: Up to 8,000 tokens
+
+Hugging Face Model Path: VIDraft/Gemma-3-R1984-1B
+
+License: mit(Agentic AI) / gemma(gemma-3-1B)
+
+# Installation and Setup
+## Requirements
+Ensure you have Python 3.8 or higher installed. The model relies on several libraries:
+
+PyTorch (with bfloat16 support)
+
+Transformers
+
+Gradio
+
+OpenCV (opencv-python)
+
+Pillow (PIL)
+
+PyPDF2
+
+Pandas
+
+Loguru
+
+Requests
+
+
+# Install dependencies using pip:
+
+pip install torch transformers gradio opencv-python pillow PyPDF2 pandas loguru requests
+
+# Environment Variables
+Set the following environment variables before running the model:
+
+## SERPHOUSE_API_KEY
+Your SERPHouse API key for web search functionality.
+
+Example:
+export SERPHOUSE_API_KEY="your_api_key_here"
+
+MODEL_ID
+(Optional) The model identifier; default is VIDraft/Gemma-3-R1984-1B.
+
+MAX_NUM_IMAGES
+(Optional) Maximum number of images allowed per query (default is 5).
+
+# Running the Model
+Gemma3-R1984-1B comes with a Gradio-based multimodal chat interface. To run the model locally:
+
+1. Clone the Repository:
+Ensure you have the repository containing the model code.
+
+2. Launch the Application:
+Execute the main Python file:
+
+
+python your_filename.py
+
+This will start a local Gradio interface. Open the provided URL in your browser to interact with the model.
+
+# Example Code: Server and Client Request
+## Server Example
+You can deploy the model server locally using the provided Gradio code. Make sure your server is accessible at your designated URL.
+
+## Client Request Example
+Below is an example of how to interact with the model using an HTTP API call:
+
+```py
+
+import requests
+import json
+
+# Replace with your server URL and token
+url = "http://<your-server-url>:8000/v1/chat/completions"
+headers = {
+    "Content-Type": "application/json",
+    "Authorization": "Bearer your_token_here"
+}
+
+# Construct the message payload
+messages = [
+    {"role": "system", "content": "You are a powerful AI assistant."},
+    {"role": "user", "content": "Compare the contents of two PDF files."}
+]
+
+data = {
+    "model": "VIDraft/Gemma-3-R1984-1B",
+    "messages": messages,
+    "temperature": 0.15
+}
+
+# Send the POST request to the server
+response = requests.post(url, headers=headers, data=json.dumps(data))
+
+# Print the response from the model
+print(response.json())
+```
+
+**Important Deployment Notice:**
+
+For optimal performance, it is highly recommended to clone the repository using the following command. This model is designed to run on a server equipped with at least an NVIDIA L40s, L4, A100(ZeroGPU) GPU. The minimum VRAM requirement is 24GB, and VRAM usage may temporarily peak at approximately 82GB during processing.
+
+```bash
+git clone https://huggingface.co/spaces/VIDraft/Gemma-3-R1984-1B

added_tokens.json

@@ -0,0 +1,3 @@
+{
+  "<image_soft_token>": 262144
+}

config.json

@@ -0,0 +1,37 @@
+{
+  "architectures": [
+    "Gemma3ForCausalLM"
+  ],
+  "attention_bias": false,
+  "attention_dropout": 0.0,
+  "attn_logit_softcapping": null,
+  "bos_token_id": 2,
+  "cache_implementation": "hybrid",
+  "eos_token_id": [
+    1,
+    106
+  ],
+  "final_logit_softcapping": null,
+  "head_dim": 256,
+  "hidden_activation": "gelu_pytorch_tanh",
+  "hidden_size": 1152,
+  "initializer_range": 0.02,
+  "intermediate_size": 6912,
+  "max_position_embeddings": 32768,
+  "model_type": "gemma3_text",
+  "num_attention_heads": 4,
+  "num_hidden_layers": 26,
+  "num_key_value_heads": 1,
+  "pad_token_id": 0,
+  "query_pre_attn_scalar": 256,
+  "rms_norm_eps": 1e-06,
+  "rope_local_base_freq": 10000,
+  "rope_scaling": null,
+  "rope_theta": 1000000,
+  "sliding_window": 512,
+  "sliding_window_pattern": 6,
+  "torch_dtype": "float32",
+  "transformers_version": "4.51.3",
+  "use_cache": true,
+  "vocab_size": 262144
+}

generation_config.json

@@ -0,0 +1,13 @@
+{
+  "bos_token_id": 2,
+  "cache_implementation": "hybrid",
+  "do_sample": true,
+  "eos_token_id": [
+    1,
+    106
+  ],
+  "pad_token_id": 0,
+  "top_k": 64,
+  "top_p": 0.95,
+  "transformers_version": "4.51.3"
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:454b9a6c5b06d2157518f2bbe1c96f9ab0b030980be1604731c199697bcc65a4
+size 3999582960

preprocessor_config.json

@@ -0,0 +1,13 @@
+{
+  "bos_token_id": 2,
+  "cache_implementation": "hybrid",
+  "do_sample": true,
+  "eos_token_id": [
+    1,
+    106
+  ],
+  "pad_token_id": 0,
+  "top_k": 64,
+  "top_p": 0.95,
+  "transformers_version": "4.50.0.dev0"
+}

special_tokens_map.json

@@ -0,0 +1,33 @@
+{
+  "boi_token": "<start_of_image>",
+  "bos_token": {
+    "content": "<bos>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eoi_token": "<end_of_image>",
+  "eos_token": {
+    "content": "<eos>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "image_token": "<image_soft_token>",
+  "pad_token": {
+    "content": "<pad>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4667f2089529e8e7657cfb6d1c19910ae71ff5f28aa7ab2ff2763330affad795
+size 33384568

tokenizer.model

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1299c11d7cf632ef3b4e11937501358ada021bbdf7c47638d13c0ee982f2e79c
+size 4689074