IDEEAS Lab

Can vision language models read students’ concept maps of social-ecological systems as reliably as trained researchers, so systems thinking can be studied at scale?

Using Vision Language Models to Analyze Concept Maps

Seed Project (Unfunded), 2025–present.

Use vision language models (VLMs) to analyze concept maps and other visualizations of complex systems. One application is to study how students represent and reason about social-ecological systems in engineering design.

Objectives

  • Develop a dataset of concept maps and other visualizations of complex systems
  • Prototype VLM-based analysis pipelines for identifying elements and relationships
  • Evaluate against expert judgments and iterate on prompts and pipelines
  • Release a reproducible workflow and documentation

All research