Mergenetic: a Simple Evolutionary Model Merging Library
Model merging allows combining the capabilities of existing models into a new
one - post hoc, without additional training. This has made it increasingly
popular thanks to its low cost and the availability of libraries that support
merging on consumer GPUs. Recent work shows that pairing merging with
evolutionary algorithms can boost performance, but no framework currently
supports flexible experimentation with such strategies in language models. We
introduce Mergenetic, an open-source library for evolutionary model merging.
Mergenetic enables easy composition of merging methods and evolutionary
algorithms while incorporating lightweight fitness estimators to reduce
evaluation costs. We describe its design and demonstrate that Mergenetic
produces competitive results across tasks and languages using modest hardware.
682ad9809506a7e45a93be00
Adrian Robert Minut
admin_assigned
2025-05-19T07:25:22.059Z
6318e7a2acffc70bd4e057ec
https://cdn-avatars.huggingface.co/v1/production/uploads/6318e7a2acffc70bd4e057ec/2m3XSbNLwv7Kmo8qfWq3L.jpeg
Adrian Robert Minut
user
adrianrob
682ad9809506a7e45a93be01
Tommaso Mencattini
claimed_verified
2025-05-19T07:22:21.898Z
63ab16a6d7ee953f604ecd52
https://cdn-avatars.huggingface.co/v1/production/uploads/63ab16a6d7ee953f604ecd52/ujylOpczHKxU6Kfr-jGVr.png
Tommaso Mencattini
user
tmencatt
682ad9809506a7e45a93be02
Andrea Santilli
claimed_verified
2025-05-19T07:22:26.518Z
5e8ef1f14957053f606489e6
https://cdn-avatars.huggingface.co/v1/production/uploads/1635502086699-5e8ef1f14957053f606489e6.jpeg
Andrea Santilli
user
teelinsan
682ad9809506a7e45a93be03
Donato Crisostomi
admin_assigned
2025-05-19T07:25:28.737Z
64256584daa3502ee3570b86
https://cdn-avatars.huggingface.co/v1/production/uploads/64256584daa3502ee3570b86/kui0eb59S5aTUeZIjawUj.jpeg
Donato Crisostomi
user
crisostomi
682ad9809506a7e45a93be04
Emanuele Rodolà
admin_assigned
2025-05-19T07:25:35.566Z
652681664e066bf73f8e2bd1
/avatars/084dec4765d9996d74901b8df95ec35f.svg
Emanuele Rodola'
user
erodola
Mergenetic: a Simple Evolutionary Model Merging Library
Model merging allows combining the capabilities of existing models into a new
one - post hoc, without additional training. This has made it increasingly
popular thanks to its low cost and the availability of libraries that support
merging on consumer GPUs. Recent work shows that pairing merging with
evolutionary algorithms can boost performance, but no framework currently
supports flexible experimentation with such strategies in language models. We
introduce Mergenetic, an open-source library for evolutionary model merging.
Mergenetic enables easy composition of merging methods and evolutionary
algorithms while incorporating lightweight fitness estimators to reduce
evaluation costs. We describe its design and demonstrate that Mergenetic
produces competitive results across tasks and languages using modest hardware.
Mergenetic is an open-source library that combines model merging with evolutionary algorithms for flexible experimentation in language models, achieving competitive results with limited computational resources.
model merging evolutionary algorithms fitness estimators