Using drawings and deep neural networks to characterize the building blocks of human visual similarity
Guardado en:
| 發表在: | Memory & Cognition vol. 53, no. 1 (Jan 2025), p. 219 |
|---|---|
| 主要作者: | |
| 其他作者: | |
| 出版: |
Springer Nature B.V.
|
| 主題: | |
| 在線閱讀: | Citation/Abstract Full Text Full Text - PDF |
| 標簽: |
沒有標簽, 成為第一個標記此記錄!
|
| Resumen: | Early in life and without special training, human beings discern resemblance between abstract visual stimuli, such as drawings, and the real-world objects they represent. We used this capacity for visual abstraction as a tool for evaluating deep neural networks (DNNs) as models of human visual perception. Contrasting five contemporary DNNs, we evaluated how well each explains human similarity judgments among line drawings of recognizable and novel objects. For object sketches, human judgments were dominated by semantic category information; DNN representations contributed little additional information. In contrast, such features explained significant unique variance perceived similarity of abstract drawings. In both cases, a vision transformer trained to blend representations of images and their natural language descriptions showed the greatest ability to explain human perceptual similarity-an observation consistent with contemporary views of semantic representation and processing in the human mind and brain. Together, the results suggest that the building blocks of visual similarity may arise within systems that learn to use visual information, not for specific classification, but in service of generating semantic representations of objects. |
|---|---|
| ISSN: | 0090-502X 1532-5946 |
| DOI: | 10.3758/s13421-024-01580-1 |
| Fuente: | ABI/INFORM Global |