jlli/Hungarian_CCPDF_SynQA
Viewer
•
Updated
•
19.3k
•
52
Jonathan Li
jlli
AI & ML interests
None yet
Recent Activity
updated
a dataset
20 days ago
jlli/Hungarian_CCPDF_SynQA
Organizations
jlli's activity
updated
a
dataset
20 days ago
updated
a
dataset
3 months ago
Vocab size vs. LM head size mismatch
2
#46 opened 3 months ago
by
harshil-shah
Text model weights are different from 3.1 8B Instruct
#32 opened 3 months ago
by
jlli
upvoted
a
collection
3 months ago
updated
4
datasets
3 months ago
reacted to
zolicsaki's
post with 🚀
7 months ago
Post
2795
We posted new SOTA SambaLingo 70B parameter models for Arabic, Thai and Hungarian!
Check out the models here sambanovasystems/sambalingo-65e25770f2037c85ad35ca77
and our paper
https://arxiv.org/abs/2404.05829
Check out the models here sambanovasystems/sambalingo-65e25770f2037c85ad35ca77
and our paper
https://arxiv.org/abs/2404.05829
reacted to
zolicsaki's
post with 🚀
7 months ago
Post
890
SambaNova just released a revolutionary paper about how the SN40L AI chip can host many LLMs on a single node and run inference so efficiently that it enables running a "composition of experts." These experts can be interconnected via a router, resulting in remarkable accuracy. This method allows you to take open source expert models from HuggingFace and continuously build and integrate them into a composition of experts.
I am also super excited about the possibilities that SN40Ls unlock for LLM agent workflows and pipelined calls. With the release of GPT4o, it seems that monolithic LLMs are starting to reach a plateau, and I believe that the next wave of AI will be driven by pipelined LLM calls and agent workflows. Most pipelined LLM workflows are bottlenecked by prohibitively expensive compute and high latency, but the SN40L provides a one stop shop solution for this. We need to get the word out to the community that this hardware exists, because it will open up a realm of possibilities that developers working with Nvidia hardware did not know exist.
SambaNova SN40L: Scaling the AI Memory Wall with Dataflow and Composition of Experts (2405.07518)
I am also super excited about the possibilities that SN40Ls unlock for LLM agent workflows and pipelined calls. With the release of GPT4o, it seems that monolithic LLMs are starting to reach a plateau, and I believe that the next wave of AI will be driven by pipelined LLM calls and agent workflows. Most pipelined LLM workflows are bottlenecked by prohibitively expensive compute and high latency, but the SN40L provides a one stop shop solution for this. We need to get the word out to the community that this hardware exists, because it will open up a realm of possibilities that developers working with Nvidia hardware did not know exist.
SambaNova SN40L: Scaling the AI Memory Wall with Dataflow and Composition of Experts (2405.07518)
upvoted
2
papers
7 months ago
liked
a
Space
10 months ago
updated
a
collection
10 months ago