chandar-lab/NeoBERT
Fill-Mask
โข
Updated
โข
17
โข
25
Dokyoon
leeloolee
AI & ML interests
ai
Recent Activity
liked
a model
about 13 hours ago
chandar-lab/NeoBERT
liked
a model
about 13 hours ago
moonshotai/Moonlight-16B-A3B-Instruct
Organizations
leeloolee's activity
liked
2
models
about 13 hours ago
upvoted
a
paper
9 days ago
liked
a
model
11 days ago
upvoted
a
paper
12 days ago
liked
a
model
17 days ago
upvoted
a
paper
20 days ago
liked
a
dataset
about 1 month ago
upvoted
a
paper
about 1 month ago
published
a
model
about 1 month ago
reacted to
mitkox's
post with ๐
about 1 month ago
Post
1418
Training a model to reason in the continuous latent space based on Meta's Coconut.
If it all works will apply it on the MiniCPM-o SVD-LR.
Endgame is a multimodal, adaptive, and efficient foundational on device AI model.
If it all works will apply it on the MiniCPM-o SVD-LR.
Endgame is a multimodal, adaptive, and efficient foundational on device AI model.
- 2 replies
liked
2
models
about 2 months ago
upvoted
an
article
about 2 months ago
Article
Context Parallelism
By
โข
โข
13
liked
2
models
about 2 months ago
upvoted
a
collection
about 2 months ago
upvoted
a
paper
about 2 months ago
reacted to
singhsidhukuldeep's
post with ๐
about 2 months ago
Post
3427
Exciting breakthrough in e-commerce recommendation systems!
Walmart Global Tech researchers have developed a novel Triple Modality Fusion (TMF) framework that revolutionizes how we make product recommendations.
>> Key Innovation
The framework ingeniously combines three distinct data types:
- Visual data to capture product aesthetics and context
- Textual information for detailed product features
- Graph data to understand complex user-item relationships
>> Technical Architecture
The system leverages a Large Language Model (Llama2-7B) as its backbone and introduces several sophisticated components:
Modality Fusion Module
- All-Modality Self-Attention (AMSA) for unified representation
- Cross-Modality Attention (CMA) mechanism for deep feature integration
- Custom FFN adapters to align different modality embeddings
Advanced Training Strategy
- Curriculum learning approach with three complexity levels
- Parameter-Efficient Fine-Tuning using LoRA
- Special token system for behavior and item representation
>> Real-World Impact
The results are remarkable:
- 38.25% improvement in Electronics recommendations
- 43.09% boost in Sports category accuracy
- Significantly higher human evaluation scores compared to traditional methods
Currently deployed in Walmart's production environment, this research demonstrates how combining multiple data modalities with advanced LLM architectures can dramatically improve recommendation accuracy and user satisfaction.
Walmart Global Tech researchers have developed a novel Triple Modality Fusion (TMF) framework that revolutionizes how we make product recommendations.
>> Key Innovation
The framework ingeniously combines three distinct data types:
- Visual data to capture product aesthetics and context
- Textual information for detailed product features
- Graph data to understand complex user-item relationships
>> Technical Architecture
The system leverages a Large Language Model (Llama2-7B) as its backbone and introduces several sophisticated components:
Modality Fusion Module
- All-Modality Self-Attention (AMSA) for unified representation
- Cross-Modality Attention (CMA) mechanism for deep feature integration
- Custom FFN adapters to align different modality embeddings
Advanced Training Strategy
- Curriculum learning approach with three complexity levels
- Parameter-Efficient Fine-Tuning using LoRA
- Special token system for behavior and item representation
>> Real-World Impact
The results are remarkable:
- 38.25% improvement in Electronics recommendations
- 43.09% boost in Sports category accuracy
- Significantly higher human evaluation scores compared to traditional methods
Currently deployed in Walmart's production environment, this research demonstrates how combining multiple data modalities with advanced LLM architectures can dramatically improve recommendation accuracy and user satisfaction.
- 2 replies
upvoted
a
paper
2 months ago