Mungert commited on
Commit
caf0999
Β·
verified Β·
1 Parent(s): 4222ba2

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +85 -0
README.md CHANGED
@@ -18,6 +18,31 @@ This model was generated using [llama.cpp](https://github.com/ggerganov/llama.cp
18
 
19
 
20
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
21
  ---
22
 
23
  <a href="https://readyforquantum.com/huggingface_gguf_selection_guide.html" style="color: #7FFF7F;">
@@ -204,6 +229,66 @@ Help me test my **AI-Powered Quantum Network Monitor Assistant** with **quantum-
204
  πŸ‘‰ [Quantum Network Monitor](https://readyforquantum.com/?assistant=open&utm_source=huggingface&utm_medium=referral&utm_campaign=huggingface_repo_readme)
205
 
206
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
207
  The full Open Source Code for the Quantum Network Monitor Service available at my github repos ( repos with NetworkMonitor in the name) : [Source Code Quantum Network Monitor](https://github.com/Mungert69). You will also find the code I use to quantize the models if you want to do it yourself [GGUFModelBuilder](https://github.com/Mungert69/GGUFModelBuilder)
208
 
209
  πŸ’¬ **How to test**:
 
18
 
19
 
20
 
21
+ ---
22
+
23
+ <a href="https://readyforquantum.com/huggingface_gguf_selection_guide.html" style="color: #7FFF7F;">
24
+ Click here to get info on choosing the right GGUF model format
25
+ </a>
26
+
27
+ ---
28
+
29
+
30
+
31
+ <!--Begin Original Model Card-->
32
+
33
+
34
+ # <span style="color: #7FFF7F;">gpt-oss-20b GGUF Models</span>
35
+
36
+
37
+ ## <span style="color: #7F7FFF;">Model Generation Details</span>
38
+
39
+ This model was generated using [llama.cpp](https://github.com/ggerganov/llama.cpp) at commit [`cd6983d5`](https://github.com/ggerganov/llama.cpp/commit/cd6983d56d2cce94ecb86bb114ae8379a609073c).
40
+
41
+
42
+
43
+
44
+
45
+
46
  ---
47
 
48
  <a href="https://readyforquantum.com/huggingface_gguf_selection_guide.html" style="color: #7FFF7F;">
 
229
  πŸ‘‰ [Quantum Network Monitor](https://readyforquantum.com/?assistant=open&utm_source=huggingface&utm_medium=referral&utm_campaign=huggingface_repo_readme)
230
 
231
 
232
+ The full Open Source Code for the Quantum Network Monitor Service available at my github repos ( repos with NetworkMonitor in the name) : [Source Code Quantum Network Monitor](https://github.com/Mungert69). You will also find the code I use to quantize the models if you want to do it yourself [GGUFModelBuilder](https://github.com/Mungert69/GGUFModelBuilder)
233
+
234
+ πŸ’¬ **How to test**:
235
+ Choose an **AI assistant type**:
236
+ - `TurboLLM` (GPT-4.1-mini)
237
+ - `HugLLM` (Hugginface Open-source models)
238
+ - `TestLLM` (Experimental CPU-only)
239
+
240
+ ### **What I’m Testing**
241
+ I’m pushing the limits of **small open-source models for AI network monitoring**, specifically:
242
+ - **Function calling** against live network services
243
+ - **How small can a model go** while still handling:
244
+ - Automated **Nmap security scans**
245
+ - **Quantum-readiness checks**
246
+ - **Network Monitoring tasks**
247
+
248
+ 🟑 **TestLLM** – Current experimental model (llama.cpp on 2 CPU threads on huggingface docker space):
249
+ - βœ… **Zero-configuration setup**
250
+ - ⏳ 30s load time (slow inference but **no API costs**) . No token limited as the cost is low.
251
+ - πŸ”§ **Help wanted!** If you’re into **edge-device AI**, let’s collaborate!
252
+
253
+ ### **Other Assistants**
254
+ 🟒 **TurboLLM** – Uses **gpt-4.1-mini** :
255
+ - **It performs very well but unfortunatly OpenAI charges per token. For this reason tokens usage is limited.
256
+ - **Create custom cmd processors to run .net code on Quantum Network Monitor Agents**
257
+ - **Real-time network diagnostics and monitoring**
258
+ - **Security Audits**
259
+ - **Penetration testing** (Nmap/Metasploit)
260
+
261
+ πŸ”΅ **HugLLM** – Latest Open-source models:
262
+ - 🌐 Runs on Hugging Face Inference API. Performs pretty well using the lastest models hosted on Novita.
263
+
264
+ ### πŸ’‘ **Example commands you could test**:
265
+ 1. `"Give me info on my websites SSL certificate"`
266
+ 2. `"Check if my server is using quantum safe encyption for communication"`
267
+ 3. `"Run a comprehensive security audit on my server"`
268
+ 4. '"Create a cmd processor to .. (what ever you want)" Note you need to install a [Quantum Network Monitor Agent](https://readyforquantum.com/Download/?utm_source=huggingface&utm_medium=referral&utm_campaign=huggingface_repo_readme) to run the .net code on. This is a very flexible and powerful feature. Use with caution!
269
+
270
+ ### Final Word
271
+
272
+ I fund the servers used to create these model files, run the Quantum Network Monitor service, and pay for inference from Novita and OpenAIβ€”all out of my own pocket. All the code behind the model creation and the Quantum Network Monitor project is [open source](https://github.com/Mungert69). Feel free to use whatever you find helpful.
273
+
274
+ If you appreciate the work, please consider [buying me a coffee](https://www.buymeacoffee.com/mahadeva) β˜•. Your support helps cover service costs and allows me to raise token limits for everyone.
275
+
276
+ I'm also open to job opportunities or sponsorship.
277
+
278
+ Thank you! 😊
279
+
280
+
281
+ <!--End Original Model Card-->
282
+
283
+ ---
284
+
285
+ # <span id="testllm" style="color: #7F7FFF;">πŸš€ If you find these models useful</span>
286
+
287
+ Help me test my **AI-Powered Quantum Network Monitor Assistant** with **quantum-ready security checks**:
288
+
289
+ πŸ‘‰ [Quantum Network Monitor](https://readyforquantum.com/?assistant=open&utm_source=huggingface&utm_medium=referral&utm_campaign=huggingface_repo_readme)
290
+
291
+
292
  The full Open Source Code for the Quantum Network Monitor Service available at my github repos ( repos with NetworkMonitor in the name) : [Source Code Quantum Network Monitor](https://github.com/Mungert69). You will also find the code I use to quantize the models if you want to do it yourself [GGUFModelBuilder](https://github.com/Mungert69/GGUFModelBuilder)
293
 
294
  πŸ’¬ **How to test**: