Byerose's picture

3 17

Byerose

Byerose

·

byerose

AI & ML interests

None yet

Recent Activity

reacted to Kseniase's post with ❤️ about 1 month ago

10 Free Comprehensive Datasets for Supervised Fine-Tuning High-quality datasets, their size and relevance directly impact the effectiveness of fine-tuning and the models' real-world applications. Among the numerous datasets for different tasks, it can be challenging to choose the most comprehensive dataset that best suits your purposes. So today, we invite you to explore top 10 free datasets on natural language processing and maths: 1. https://huggingface.co/datasets/fka/awesome-chatgpt-prompts proposes a huge variety of prompts that can be used with ChatGPT. Over 700 models were trained on this dataset. 2. https://huggingface.co/datasets/HuggingFaceFW/fineweb from Hugging Face includes 15T tokens of cleaned and deduplicated English web data. It’s suitable for LLM training, benchmarking, model validation. 3. https://huggingface.co/datasets/HuggingFaceFW/fineweb-2 is an another version of FineWeb with high-quality pretraining data to over 1000 languages. 4. https://huggingface.co/datasets/O1-OPEN/OpenO1-SFT with Chinese and English data can be used for Chain-of-Thought activation. 5. https://huggingface.co/datasets/yahma/alpaca-cleaned is a curated version of the original Alpaca Dataset released by Stanford. 6. https://huggingface.co/datasets/lmsys/lmsys-chat-1m with 1 million real-world conversations with 25 state-of-the-art LLMs offers diverse use cases, like content moderation, safety benchmarks, and training instruction-following models. 7. https://huggingface.co/datasets/allenai/dolma from Allen AI includes 3T tokens from a diverse mix of web content, academic publications, code, books, and encyclopedic materials. Math datasets: 1. https://huggingface.co/datasets/HuggingFaceTB/finemath consists of educational math content and has two versions: 34B tokens and 54B tokens. 2. https://huggingface.co/datasets/amphora/QwQ-LongCoT-130K for training O1-like LLMs. 3. https://huggingface.co/datasets/openai/gsm8k for training multi-step reasoning.

reacted to Kseniase's post with 👍 about 1 month ago

10 Free Comprehensive Datasets for Supervised Fine-Tuning High-quality datasets, their size and relevance directly impact the effectiveness of fine-tuning and the models' real-world applications. Among the numerous datasets for different tasks, it can be challenging to choose the most comprehensive dataset that best suits your purposes. So today, we invite you to explore top 10 free datasets on natural language processing and maths: 1. https://huggingface.co/datasets/fka/awesome-chatgpt-prompts proposes a huge variety of prompts that can be used with ChatGPT. Over 700 models were trained on this dataset. 2. https://huggingface.co/datasets/HuggingFaceFW/fineweb from Hugging Face includes 15T tokens of cleaned and deduplicated English web data. It’s suitable for LLM training, benchmarking, model validation. 3. https://huggingface.co/datasets/HuggingFaceFW/fineweb-2 is an another version of FineWeb with high-quality pretraining data to over 1000 languages. 4. https://huggingface.co/datasets/O1-OPEN/OpenO1-SFT with Chinese and English data can be used for Chain-of-Thought activation. 5. https://huggingface.co/datasets/yahma/alpaca-cleaned is a curated version of the original Alpaca Dataset released by Stanford. 6. https://huggingface.co/datasets/lmsys/lmsys-chat-1m with 1 million real-world conversations with 25 state-of-the-art LLMs offers diverse use cases, like content moderation, safety benchmarks, and training instruction-following models. 7. https://huggingface.co/datasets/allenai/dolma from Allen AI includes 3T tokens from a diverse mix of web content, academic publications, code, books, and encyclopedic materials. Math datasets: 1. https://huggingface.co/datasets/HuggingFaceTB/finemath consists of educational math content and has two versions: 34B tokens and 54B tokens. 2. https://huggingface.co/datasets/amphora/QwQ-LongCoT-130K for training O1-like LLMs. 3. https://huggingface.co/datasets/openai/gsm8k for training multi-step reasoning.

liked a model 3 months ago

allenai/wildguard

View all activity

Organizations

None yet

Byerose's activity

New activity in Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2 3 months ago

There are still refusal behaviors

#9 opened 3 months ago by

New activity in Qwen/Qwen2-7B-Instruct 3 months ago

load from local filepath error

#2 opened 8 months ago by

New activity in mistralai/Ministral-8B-Instruct-2410 3 months ago

Error when setting max_model_len to 65536 for Ministral-8B-Instruct-2410 on A100 | VLLM

#10 opened 3 months ago by

Error when setting max_model_len to 65536 for Ministral-8B-Instruct-2410 on A100 | VLLM

#10 opened 3 months ago by