James PRO

jtatman

AI & ML interests

improving domain specific models and re-sampling data, refining datasets for use in different modalities, small scale micro-llm clusters using quantized and smoothed models, and all emerging llm stack connecting technologies. Small models rock.

Recent Activity

liked a Space about 22 hours ago

onnx-community/convert-to-onnx

liked a model 2 days ago

nari-labs/Dia-1.6B

liked a model 2 days ago

lllyasviel/FramePackI2V_HY

View all activity

Organizations

jtatman's activity

upvoted a paper 5 months ago

Hymba: A Hybrid-head Architecture for Small Language Models

Paper • 2411.13676 • Published Nov 20, 2024 • 45

upvoted a paper 8 months ago

Paper Copilot: A Self-Evolving and Efficient LLM System for Personalized Academic Assistance

Paper • 2409.04593 • Published Sep 6, 2024 • 27

upvoted a collection 9 months ago

Llama 3.1

Collection

This collection hosts the transformers and original repos of the Llama 3.1, Llama Guard 3 and Prompt Guard models • 11 items • Updated Dec 6, 2024 • 663

upvoted an article 9 months ago

Article

Llama 3.1 - 405B, 70B & 8B with multilinguality and long context

Jul 23, 2024

• 232

upvoted a paper 9 months ago

Retrieval-Enhanced Machine Learning: Synthesis and Opportunities

Paper • 2407.12982 • Published Jul 17, 2024 • 6

upvoted a paper 10 months ago

Model Merging and Safety Alignment: One Bad Model Spoils the Bunch

Paper • 2406.14563 • Published Jun 20, 2024 • 31

upvoted an article 10 months ago

Article

Welcome Gemma - Google's new open LLM

Feb 21, 2024

• 23

upvoted a collection 11 months ago

abliterated-v3

Collection

Latest gen of the abliterated models I've produced • 17 items • Updated Jun 3, 2024 • 117

upvoted 2 papers about 1 year ago

ShortGPT: Layers in Large Language Models are More Redundant Than You Expect

Paper • 2403.03853 • Published Mar 6, 2024 • 65

Meta-Prompting: Enhancing Language Models with Task-Agnostic Scaffolding

Paper • 2401.12954 • Published Jan 23, 2024 • 32

upvoted 3 papers over 1 year ago

Transformers are Multi-State RNNs

Paper • 2401.06104 • Published Jan 11, 2024 • 38

LLM in a flash: Efficient Large Language Model Inference with Limited Memory

Paper • 2312.11514 • Published Dec 12, 2023 • 258

Rethinking Attention: Exploring Shallow Feed-Forward Neural Networks as an Alternative to Attention Layers in Transformers

Paper • 2311.10642 • Published Nov 17, 2023 • 26