Hugging Face's logo

Nt3awnou

community
Activity Feed Request to join this org

AI & ML interests

None defined yet.

Recent Activity

imomayiz  authored a paper 3 months ago
Atlas-Chat: Adapting Large Language Models for Low-Resource Moroccan Arabic Dialect
loubnabnl  authored a paper 6 months ago
The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale
lekssays  authored a paper 6 months ago
Semantic Ranking for Automated Adversarial Technique Annotation in Security Text
View all activity

nt3awnou's activity

alielfilali01 
posted an update 13 days ago
view post
Post
3301
Unpopular opinion: Open Source takes courage to do !

Not everyone is brave enough to release what they have done (the way they've done it) to the wild to be judged !
It really requires a high level of "knowing wth are you doing" ! It's kind of a super power !

Cheers to the heroes here who see this!
·
alielfilali01 
posted an update 17 days ago
view post
Post
1477
Apparently i forgot to put this here !

Well, this is a bit late but consider given our recent blog a read if you are interested in Evaluation.

You don't have to be into Arabic NLP in order to read it, the main contribution we are introducing is a new evaluation measure for NLG. We made the fisrt application of this measure on Arabic for now and we will be working with colleagues from the community to expand it to other languages.

Blog:
Rethinking LLM Evaluation with 3C3H: AraGen Benchmark and Leaderboard
https://huggingface.co/blog/leaderboard-3c3h-aragen

Space:
inceptionai/AraGen-Leaderboard

Give it a read and let me know your thoughts 🤗
loubnabnl 
posted an update about 1 month ago
view post
Post
1639
Making SmolLM2 reproducible: open-sourcing our training & evaluation toolkit 🛠️ https://github.com/huggingface/smollm/

- Pre-training code with nanotron
- Evaluation suite with lighteval
- Synthetic data generation using distilabel (powers our new SFT dataset HuggingFaceTB/smoltalk)
- Post-training scripts with TRL & the alignment handbook
- On-device tools with llama.cpp for summarization, rewriting & agents

Apache 2.0 licensed. V2 pre-training data mix coming soon!

Which other tools should we add next?
alielfilali01 
posted an update about 1 month ago
view post
Post
2175
Unpopular opinion : o1-preview is more stupid than 4o and Qwen2.5-72B-Instruct in extremely underrated !
  • 2 replies
·
alielfilali01 
posted an update 2 months ago
view post
Post
1699
I feel like this incredible resource hasn't gotten the attention it deserves in the community!

@clefourrier and generally the HuggingFace evaluation team put together a fantastic guidebook covering a lot about 𝗘𝗩𝗔𝗟𝗨𝗔𝗧𝗜𝗢𝗡 from basics to advanced tips.

link : https://github.com/huggingface/evaluation-guidebook

I haven’t finished it yet, but i'am enjoying every piece of it so far. Huge thanks @clefourrier and the team for this invaluable resource !
  • 3 replies
·
alielfilali01 
posted an update 3 months ago
view post
Post
1825
Why nobdoy is talking about the new training corpus released by MBZUAI today.

TxT360 is +15 Trillion tokens corpus outperforming FineWeb on several metrics. Ablation studies were done up to 1T tokens.

Read blog here : LLM360/TxT360
Dataset : LLM360/TxT360
  • 2 replies
·
alielfilali01 
posted an update 3 months ago
view post
Post
2569
Don't you think we should add a tag "Evaluation" for datasets that are meant to be benchmarks and not for training ?

At least, when someone is collecting a group of datasets from an organization or let's say the whole hub can filter based on that tag and avoid somehow contaminating their "training" data.
imomayiz 
authored a paper 3 months ago
alielfilali01 
posted an update 3 months ago
view post
Post
868
We need a fork feature for models and datasets similar to "Duplicate this space" in spaces ! Don't you think ?

Sometimes you just want to save something in your profile privately and work on it later without the hassle of "load_.../push_to_hub" in a code file.

I know this is super lazy 😅 But it is what it is ...

tag : @victor
·
alielfilali01 
posted an update 3 months ago
view post
Post
1201
@mariagrandury (SomosNLP) and team releases the Spanish leaderboard !!!
It is impressive how they choosed to design this leaderboard and how it support 4 languages (all part of Spain ofc).

Check it out from this link :
la-leaderboard/la-leaderboard
  • 1 reply
·
alielfilali01 
posted an update 3 months ago
alielfilali01 
posted an update 3 months ago
view post
Post
572
Are the servers down or what ? Am i the only one experiencing this error :
HfHubHTTPError: 500 Server Error: Internal Server Error for url: https://huggingface.co/api/datasets/...../)

Internal Error - We're working hard to fix this as soon as possible!
  • 2 replies
·
alielfilali01 
posted an update 4 months ago
view post
Post
1088
Datapluck: Portability Tool for Huggingface Datasets

"I found myself recently whipping up notebooks just to pull huggingface datasets locally, annotate or operate changes and update them again. This happened often enough that I made a cli tool out of it, which I've been using successfully for the last few months.

While huggingface uses open formats, I found the official toolchain relatively low-level and not adapted to quick operations such as what I am doing."
~ @omarkamali

Link : https://omarkama.li/blog/datapluck
  • 1 reply
·
alielfilali01 
posted an update 5 months ago
view post
Post
720
Any idea if this "scheduled"/"dynamic" batch size is available in HF Trainers ? I've never seen it personally
loubnabnl 
authored a paper 6 months ago
lekssays 
authored a paper 6 months ago
loubnabnl 
posted an update 7 months ago
view post
Post
5334
🍷 FineWeb technical report is out and so is 📚 FineWeb-Edu, a 1.3 trillion tokens dataset that outperforms all other open web datasets, with remarkable improvements on educational benchmarks such as MMLU, ARC, and OpenBookQA.

Technical report: HuggingFaceFW/blogpost-fineweb-v1
Dataset: HuggingFaceFW/fineweb-edu

We used Llama 3 generations to train an educational quality classifier, filtering the 15 trillion tokens of FineWeb to select only those with high educational value (an approach also used in Llama 3 and Phi-3 training datasets). We're releasing both FineWeb-Edu and the classifier, along with a larger, less heavily filtered version containing 5.4 trillion tokens.

You can find more details about the dataset and the experiments we ran in the FineWeb technical report, It's a 45-minute read but it contains all the secret sauce for building high quality web datasets.

Enjoy!
loubnabnl 
authored a paper 7 months ago
alielfilali01 
posted an update 7 months ago
view post
Post
1983
I'm officially considered #gpu_poor 💀
But I'm #data_rich 😎
alielfilali01 
posted an update 7 months ago
view post
Post
674
Did you know you can't push a model to hub with an id over 96 chars 🫠
·