Waseem AlShikh
wassemgtk
AI & ML interests
Multi-modal, Palmyra LLMs, Knowledge Graph
Recent Activity
updated
a model
15 days ago
wassemgtk/mergekit-ties-isswcgh
published
a model
15 days ago
wassemgtk/mergekit-ties-isswcgh
replied to
their
post
18 days ago
I’ve been diving into the iRoPE architecture from Llama 4—a game-changer for long-context models! It interleaves local attention (with RoPE) for short contexts and global attention (with inference-time temp scaling) for long-range reasoning, aiming for infinite context. I’m going to try writing iRoPE—who wants to help?
Code: https://github.com/wassemgtk/iRoPE-try/blob/main/iRoPE.ipynb
Organizations
wassemgtk's activity
Added explanation of how combined score is calculated
#2 opened 2 months ago
by
ecw429
Update app.py
1
#1 opened 2 months ago
by
karsitu
Add link to paper and update citation.
#2 opened 2 months ago
by
nielsr

Any details on this and the base model?
1
#1 opened 6 months ago
by
jukofyork

Base model?
5
#4 opened 8 months ago
by
KevalRx
Access the model via Ollama
1
#3 opened 9 months ago
by
gileneo
Quantization allowed?
3
1
#1 opened 9 months ago
by
bartowski

Adding `safetensors` variant of this model
#1 opened about 1 year ago
by
SFconvertbot

70B submissions are just disappearing after a while
3
#10 opened 12 months ago
by
abhinand
It's broken
12
#9 opened 12 months ago
by
tosaddler

Create handler.py
#4 opened over 1 year ago
by
wassemgtk

add example for text-generation-inference
#1 opened over 1 year ago
by
nbroad

add text-generation-inference example
#1 opened over 1 year ago
by
nbroad

add example for text-generation-inference
#3 opened over 1 year ago
by
nbroad

changed palmyra-med -> InstructPalmyra-20b
#2 opened over 1 year ago
by
nbroad

Model max length?
2
#3 opened about 2 years ago
by
cheesyFishes

Update README.md
#2 opened about 2 years ago
by
heathexer
Create requirements.txt
#1 opened about 2 years ago
by
nbroad

Create handler.py
#2 opened about 2 years ago
by
philschmid

Model card typos
#1 opened about 2 years ago
by
jeffboudier
