Automatic Method Illustration Generation for AI Scientific Papers via Drawing Middleware Creation, Evolution, and Orchestration

Method illustrations (MIs) play a crucial role in conveyingthe core ideas of scientific papers, yet their generation remains a labor-intensive process. Here, we take inspiration from human authors’ drawingpractices and correspondingly propose FigAgent, a novel multi-agentframework for high-quality automatic MI generation. Our FigAgent dis-tills drawing experiences from similar components across MIs and encap-sulates them into reusable drawing middlewares that can be orchestratedfor MI generation, while evolving these middlewares to adapt to dynami-cally evolving drawing requirements. Besides, a novel Explore-and-Selectdrawing strategy is introduced to mimic the human-like trial-and-errormanner for gradually constructing MIs with complex structures. Exten-sive experiments show the efficacy of our method. Project page is here.