GenAgent: Build Collaborative AI Systems with Automated Workflow
  Generation -- Case Studies on ComfyUI
Much previous AI research has focused on developing monolithic models to
maximize their intelligence and capability, with the primary goal of enhancing
performance on specific tasks. In contrast, this paper explores an alternative
approach: collaborative AI systems that use workflows to integrate models, data
sources, and pipelines to solve complex and diverse tasks. We introduce
GenAgent, an LLM-based framework that automatically generates complex
workflows, offering greater flexibility and scalability compared to monolithic
models. The core innovation of GenAgent lies in representing workflows with
code, alongside constructing workflows with collaborative agents in a
step-by-step manner. We implement GenAgent on the ComfyUI platform and propose
a new benchmark, OpenComfy. The results demonstrate that GenAgent outperforms
baseline approaches in both run-level and task-level evaluations, showing its
capability to generate complex workflows with superior effectiveness and
stability.
66d83ad80d88366001ccf370
Xiangyuan Xue
66d83ad80d88366001ccf371
Zeyu Lu
claimed_verified
2024-09-04T12:00:46.104Z
635626a8ec32331b227f407b
https://cdn-avatars.huggingface.co/v1/production/uploads/635626a8ec32331b227f407b/KRkAEN3eXN_mYzzJQ_8dO.jpeg
LuZeyu
user
whlzy
66d83ad80d88366001ccf372
Di Huang
66d83ad80d88366001ccf373
Wanli Ouyang
66d83ad80d88366001ccf374
Lei Bai
GenAgent: Build Collaborative AI Systems with Automated Workflow
  Generation -- Case Studies on ComfyUI
Much previous AI research has focused on developing monolithic models to
maximize their intelligence and capability, with the primary goal of enhancing
performance on specific tasks. In contrast, this paper explores an alternative
approach: collaborative AI systems that use workflows to integrate models, data
sources, and pipelines to solve complex and diverse tasks. We introduce
GenAgent, an LLM-based framework that automatically generates complex
workflows, offering greater flexibility and scalability compared to monolithic
models. The core innovation of GenAgent lies in representing workflows with
code, alongside constructing workflows with collaborative agents in a
step-by-step manner. We implement GenAgent on the ComfyUI platform and propose
a new benchmark, OpenComfy. The results demonstrate that GenAgent outperforms
baseline approaches in both run-level and task-level evaluations, showing its
capability to generate complex workflows with superior effectiveness and
stability.
GenAgent, an LLM-based framework, generates complex workflows automatically, offering flexibility and scalability, and outperforms baselines in various task evaluations.
LLM-based framework collaborative AI systems workflows ComfyUI platform OpenComfy benchmark