REAL-MM-RAG-Bench is a benchmark designed to evaluate multi-modal retrieval models under realistic and challenging conditions.
AI & ML interests
Enterprise AI and ML, Foundation Models, Responsible AI
Recent Activity
View all activity
Organization Card
IBM ❤️ Open Source AI
IBM is building enterprise-focused foundation models to drive the future of business.
We strongly believe in the power of collaboration and community-driven development to propel AI forward. As such, we will be hosting our latest open innovations from IBM Research in this Hugging Face organization. We hope that the AI community will find our efforts useful and that our models help fuel their research.
If you have any questions, please visit our discussions page.
This category highlights the collective efforts of the AI Automation team in advancing Industry 4.0 applications and exploring innovations beyond it.
-
AssetOpsBench: Benchmarking AI Agents for Task Automation in Industrial Asset Operations and Maintenance
Paper • 2506.03828 • Published • 15 -
FailureSensorIQ: A Multi-Choice QA Dataset for Understanding Sensor Relationships and Failure Modes
Paper • 2506.03278 • Published • 6 -
ibm-research/AssetOpsBench
Viewer • Updated • 141 • 2.14k • 5 -
1
AssetOpsBench
📉Evaluating Autonomous AI Agents for Industry 4.0 Tasks
REAL-MM-RAG-Bench is a benchmark designed to evaluate multi-modal retrieval models under realistic and challenging conditions.
This category highlights the collective efforts of the AI Automation team in advancing Industry 4.0 applications and exploring innovations beyond it.
-
AssetOpsBench: Benchmarking AI Agents for Task Automation in Industrial Asset Operations and Maintenance
Paper • 2506.03828 • Published • 15 -
FailureSensorIQ: A Multi-Choice QA Dataset for Understanding Sensor Relationships and Failure Modes
Paper • 2506.03278 • Published • 6 -
ibm-research/AssetOpsBench
Viewer • Updated • 141 • 2.14k • 5 -
1
AssetOpsBench
📉Evaluating Autonomous AI Agents for Industry 4.0 Tasks
spaces
9
pinned
Running
3
BlueBench Leaderboard
🥇
An open-source benchmark for enterprise use cases.
Running
3DGrid-VQGAN Demo
🐻
SMILES to 3D grid and reconstruction comparison demo
Running
1
AssetOpsBench
📉
Evaluating Autonomous AI Agents for Industry 4.0 Tasks
Running
1
SMI-TED-demo1
🦦
Generate embeddings from SMILES strings or CSV files
Sleeping
1
Fm4m Eval Demo
👁
Running
4
FM4M-demo2
🐢
Generate and analyze molecular structures
models
322
ibm-research/materials.3dgrid_vqgan
Updated
•
35
ibm-research/materials.geodite
Graph Machine Learning
•
Updated
ibm-research/materials.selfies-ted
Feature Extraction
•
0.4B
•
Updated
•
61.7k
•
•
9
ibm-research/materials.mhg-ged
Feature Extraction
•
Updated
•
413
•
4
ibm-research/flowstate
9.07M
•
Updated
•
19.6k
•
4
ibm-research/biomed.dna.snp.modernbert.113m.v1
Updated
•
2
ibm-research/biomed.dna.ref.modernbert.113m.v1
Updated
•
1
ibm-research/biomed.rna.bert.110m.mlm.rda.v1
Updated
•
3
ibm-research/biomed.rna.bert.110m.mlm.multitask.v1
Updated
•
3
ibm-research/biomed.rna.bert.110m.wced.v1
Updated
•
3
datasets
71
ibm-research/FailureSensorIQ
Viewer
•
Updated
•
8.3k
•
232
•
3
ibm-research/knowledge_consistency_of_LLMs
Preview
•
Updated
•
88
•
2
ibm-research/ToolRM-train-data
Viewer
•
Updated
•
459k
•
364
•
6
ibm-research/BFCL-FC-robustness
Updated
•
45
ibm-research/AssetOpsBench
Viewer
•
Updated
•
141
•
2.14k
•
5
ibm-research/SQL-API-Bench
Viewer
•
Updated
•
3.41k
•
66
•
4
ibm-research/MermaidSeqBench
Viewer
•
Updated
•
132
•
32
•
2
ibm-research/data-product-benchmark
Viewer
•
Updated
•
20.8k
•
111
•
2
ibm-research/fc-reward-bench
Viewer
•
Updated
•
1.5k
•
267
•
4
ibm-research/REAL-MM-RAG_TechReport_BEIR
Viewer
•
Updated
•
5.57k
•
872