Just dropped a new blog post 🤗

"Comparing Open-source and Proprietary LLMs in Medical AI"

We put the biggest AI brains 🧠 to the test on medical tasks 🏥 using popular benchmarks such as MedQA.

Closed-source vs. open-source, costs decoded, and performance revealed! We need even more comprehensive benchmarks and evaluations of LLMs in medical tasks 🔬

Read more at: https://huggingface.co/blog/mpimentel/comparing-llms-medical-ai

authored a paper 7 months ago

Beyond Fine-tuning: Unleashing the Potential of Continuous Pretraining for Clinical LLMs

Paper • 2409.14988 • Published Sep 23, 2024 • 24

upvoted a paper 7 months ago

Beyond Fine-tuning: Unleashing the Potential of Continuous Pretraining for Clinical LLMs

Paper • 2409.14988 • Published Sep 23, 2024 • 24

commented a paper 8 months ago

MEDIC: Towards a Comprehensive Framework for Evaluating LLMs in Clinical Applications

Paper • 2409.07314 • Published Sep 11, 2024 • 57 •

authored 2 papers 8 months ago

Beyond Metrics: A Critical Analysis of the Variability in Large Language Model Evaluation Frameworks

Paper • 2407.21072 • Published Jul 29, 2024 • 2

MEDIC: Towards a Comprehensive Framework for Evaluating LLMs in Clinical Applications

Paper • 2409.07314 • Published Sep 11, 2024 • 57

upvoted a paper 8 months ago

Beyond Metrics: A Critical Analysis of the Variability in Large Language Model Evaluation Frameworks

Paper • 2407.21072 • Published Jul 29, 2024 • 2