7 3 18

Henry Kroll III

hellork

http://anch.org

themanyone

AI & ML interests

Small, open-source LLMs for mobile with <= 4Gb graphics, text generation, image manipulation recognition, 3D model generation, language preservation and translation, and business use cases.

Recent Activity

updated a collection about 1 month ago

Under 10b iq4_nl gguf

updated a collection about 1 month ago

Under 10b iq4_nl gguf

reacted to andito's post with 🔥 about 2 months ago

🧠👁️ Can AI visualize solutions? Humans often solve visual problems by sketching ideas in our minds. What if Vision-Language Models (VLMs) could do something similar, not by generating full images, but by using internal “mental sketches”? That’s the idea behind Mirage, a new framework that empowers VLMs to reason using latent visual tokens. Instead of just thinking in words, Mirage mixes in abstract visual representations that help the model solve complex tasks. These aren't photorealistic images. They're compact, internal representations optimized purely to support reasoning. 🔧 Mirage is trained in two phases: 1) Grounding: It learns to produce latent tokens anchored in real images. 2) Refinement: The model drops the images and learns to generate visual tokens on its own. 📈 And yes, it works! On challenging benchmarks like Visual Spatial Planning, Jigsaw puzzles, and Spatial Attention Tasks, Mirage clearly outperforms GPT-4o and other strong baselines. Smart sketches > empty words. By mimicking the way humans visualize solutions, Mirage gives AI a new kind of imagination, one that’s faster, more efficient, and more human-like. Kudos to the teams at UMass Amherst and MIT behind this exciting work. Check the paper: https://huggingface.co/papers/2506.17218

View all activity

Organizations

upvoted an article 3 months ago

Article

Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA

and 4 others •

May 24, 2023

• 162

upvoted a collection 11 months ago

Under 10b iq4_nl gguf

Collection

Under 10B GGUFs Non-linear Quantized to try on 4GiB VRAM. Leaderboard https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard • 46 items • Updated Jul 10 • 3

upvoted a collection 12 months ago

FalconMamba 7B

Collection

This collection features the FalconMamba 7B base model, the instruction-tuned version, their 4-bit and GGUF variants, and the demo. • 15 items • Updated 30 days ago • 34

Henry Kroll III

AI & ML interests

Recent Activity

Organizations

hellork's activity

Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA