CAD-Assistant: Tool-Augmented VLLMs as Generic CAD Task Solvers?
Guardat en:
| Publicat a: | arXiv.org (Dec 18, 2024), p. n/a |
|---|---|
| Autor principal: | |
| Altres autors: | , , , , , , |
| Publicat: |
Cornell University Library, arXiv.org
|
| Matèries: | |
| Accés en línia: | Citation/Abstract Full text outside of ProQuest |
| Etiquetes: |
Sense etiquetes, Sigues el primer a etiquetar aquest registre!
|
MARC
| LEADER | 00000nab a2200000uu 4500 | ||
|---|---|---|---|
| 001 | 3147264510 | ||
| 003 | UK-CbPIL | ||
| 022 | |a 2331-8422 | ||
| 035 | |a 3147264510 | ||
| 045 | 0 | |b d20241218 | |
| 100 | 1 | |a Mallis, Dimitrios | |
| 245 | 1 | |a CAD-Assistant: Tool-Augmented VLLMs as Generic CAD Task Solvers? | |
| 260 | |b Cornell University Library, arXiv.org |c Dec 18, 2024 | ||
| 513 | |a Working Paper | ||
| 520 | 3 | |a We propose CAD-Assistant, a general-purpose CAD agent for AI-assisted design. Our approach is based on a powerful Vision and Large Language Model (VLLM) as a planner and a tool-augmentation paradigm using CAD-specific modules. CAD-Assistant addresses multimodal user queries by generating actions that are iteratively executed on a Python interpreter equipped with the FreeCAD software, accessed via its Python API. Our framework is able to assess the impact of generated CAD commands on geometry and adapts subsequent actions based on the evolving state of the CAD design. We consider a wide range of CAD-specific tools including Python libraries, modules of the FreeCAD Python API, helpful routines, rendering functions and other specialized modules. We evaluate our method on multiple CAD benchmarks and qualitatively demonstrate the potential of tool-augmented VLLMs as generic CAD task solvers across diverse CAD workflows. | |
| 653 | |a Solvers | ||
| 653 | |a Python | ||
| 653 | |a Modules | ||
| 653 | |a Computer aided design--CAD | ||
| 653 | |a Large language models | ||
| 700 | 1 | |a Karadeniz, Ahmet Serdar | |
| 700 | 1 | |a Cavada, Sebastian | |
| 700 | 1 | |a Rukhovich, Danila | |
| 700 | 1 | |a Foteinopoulou, Niki | |
| 700 | 1 | |a Cherenkova, Kseniya | |
| 700 | 1 | |a Anis Kacem | |
| 700 | 1 | |a Aouada, Djamila | |
| 773 | 0 | |t arXiv.org |g (Dec 18, 2024), p. n/a | |
| 786 | 0 | |d ProQuest |t Engineering Database | |
| 856 | 4 | 1 | |3 Citation/Abstract |u https://www.proquest.com/docview/3147264510/abstract/embedded/6A8EOT78XXH2IG52?source=fedsrch |
| 856 | 4 | 0 | |3 Full text outside of ProQuest |u http://arxiv.org/abs/2412.13810 |