Artidoro Pagnoni's picture

6 2 10

Artidoro Pagnoni

artidoro

·

https://artidoro.github.io/

AI & ML interests

NLP, generation, factuality, disinformation.

Recent Activity

liked a dataset about 2 months ago

allenai/DataDecide-ppl-results

liked a model 4 months ago

facebook/blt

reacted to Jaward's post with ❤️ 4 months ago

nanoBLT: Simplified lightweight implementation of a character-level Byte Latent Transformer model (under 500 lines of code). The model is 2x4x2 (n_layers_encoder, n_layers_latent, n_layers_decoder) layer deep trained on ~1M bytes of tiny Shakespeare with a patch size of 4. Code: https://github.com/Jaykef/ai-algorithms/blob/main/byte_latent_transformer.ipynb

View all activity

Organizations

authored 2 papers 8 months ago

Socratic Pretraining: Question-Driven Pretraining for Controllable Summarization

Paper • 2212.10449 • Published Dec 20, 2022

Byte Latent Transformer: Patches Scale Better Than Tokens

Paper • 2412.09871 • Published Dec 13, 2024 • 109

authored a paper about 2 years ago

QLoRA: Efficient Finetuning of Quantized LLMs

Paper • 2305.14314 • Published May 23, 2023 • 55