cognitivecomputations/Dolphin-Llama3.1-8B-Instruct-exl2-6bpw
Updated
•
3
Cognitive Computations
community
AI & ML interests
Supervised Fine Tuning, DPO, and unalignment
Recent Activity
View all activity
cognitivecomputations's activity
LLuke777
published
a
model
1 day ago
LLuke777
updated
a
model
1 day ago
Stuck when run on 8xH100
1
#8 opened 3 days ago
by
Thai
Post
9953
Access requests enabled for latest GLM models
While a fix is being implemented (https://github.com/ggml-org/llama.cpp/pull/12957) I want to leave the models up for visibility and continued discussion, but want to prevent accidental downloads of known broken models (even though there are settings that could fix it at runtime for now)
With this goal, I've enabled access requests. I don't really want your data, so I'm sorry that I don't think there's a way around that? But that's what I'm gonna do for now, and I'll remove the gate when a fix is up and verified and I have a chance to re-convert and quantize!
Hope you don't mind in the mean time :D
While a fix is being implemented (https://github.com/ggml-org/llama.cpp/pull/12957) I want to leave the models up for visibility and continued discussion, but want to prevent accidental downloads of known broken models (even though there are settings that could fix it at runtime for now)
With this goal, I've enabled access requests. I don't really want your data, so I'm sorry that I don't think there's a way around that? But that's what I'm gonna do for now, and I'll remove the gate when a fix is up and verified and I have a chance to re-convert and quantize!
Hope you don't mind in the mean time :D
ImranzamanML
posted
an
update
9 days ago
Post
3588
Mental Health Chatbot by Fine-Tuning Llama 4
https://huggingface.co/blog/ImranzamanML/llama-4-fine-tuning-with-mental-health-counseling
https://huggingface.co/blog/ImranzamanML/llama-4-fine-tuning-with-mental-health-counseling
-
- 4 replies
Tool usage
5
#2 opened 4 months ago
by
jago93
Great Model Base for ERP!
2
1
#1 opened 4 months ago
by
Joseph717171
Adding Evaluation Results
#3 opened 4 months ago
by
T145
LLuke777
updated
a
model
10 days ago
why tokenizer_config.json changed for AWQ model.
2
#7 opened 11 days ago
by
rockcat-miao
Does FlashMLA support kv cache fp8 dtype and how to enable FlashMLA ?
9
#6 opened 20 days ago
by
CharlesLincoln
ImranzamanML
posted
an
update
18 days ago
Post
1564
Llama 4 is here and it's making serious waves!
After diving into the latest benchmark results, it’s clear that Meta’s new Llama 4 lineup (Maverick, Scout, and Behemoth) is no joke.
Here are a few standout highlights🔍:
Llama 4 Maverick hits the sweet spot between cost and performance
- Outperforms GPT-4o in image tasks like ChartQA (90.0 vs 85.7) and DocVQA (94.4 vs 92.8)
- Beats others in MathVista and MMLU Pro too and at a fraction of the cost ($0.19–$0.49 vs $4.38 🤯)
Llama 4 Scout is lean, cost-efficient, and surprisingly capable
- Strong performance across image and language tasks (e.g. ChartQA: 88.8, DocVQA: 94.4)
- More affordable than most competitors and still beats out larger models like Gemini 2.0 Flash-Lite
Llama 4 Behemoth is the heavy hitter.
- Tops the charts in LiveCodeBench (49.4), MATH-500 (95.0), and MMLU Pro (82.2)
- Even edges out Claude 3 Sonnet and Gemini 2 Pro in multiple areas
Meta didn’t just show up, they delivered across multimodal, coding, reasoning, and multilingual benchmarks.
And honestly? Seeing this level of performance, especially at lower inference costs, is a big deal for anyone building on LLMs.
Curious to see how these models do in real-world apps next.
#AI #Meta #Llama4 #LLMs #Benchmarking #MachineLearning #OpenSourceAI #GenerativeAI
- 1 reply
How to Resolve "GLIBC_2.32 Not Found" Error When Deploying vLLM Environment?
8
#32 opened 28 days ago
by
lastsummerLi
v2ray
updated
3
models
26 days ago
Can the 4090 device run this model?
3
#3 opened 28 days ago
by
jinzhongwei
vllm crach with a slightly longer prompt
1
#4 opened 28 days ago
by
rockcat-miao