Research

Publications

Peer-reviewed papers, preprints, and conference proceedings from the IDEEAS Lab.

Selected Work

Current research signals

A short entry point into the lab's recent work on AI-assisted qualitative methods, engineering education, and decision-making.

Thematic analysis with open-source generative AI and machine learning: A new method for inductive qualitative codebook development

Andrew Katz, Gabriella Coloyan Fleming, Joyce B. Main

This paper introduces a novel method for developing qualitative codebooks using open-source generative AI and machine learning techniques, enabling more systematic and reproducible inductive thematic analysis.

Using generative AI for large-scale qualitative analysis of social media posts to understand why people leave computer science

Amanda Ross, Andrew Katz

This study uses generative AI for large-scale qualitative analysis of over 10,000 Reddit posts to understand diverse reasons why people leave computer science, including job dissatisfaction and influential factors at different stages of departure.

Advancing Qualitative Analysis in Professional Disaster and Risk Communication: A Comparative Study of an OpenAI ChatGPT 3.5 Model-Enabled Method for Processing Complex Public Posts

Margaret Webb, Harman Singh, Rachel Inman, Sweta Baniya et al.

This paper explores the application of ChatGPT 3.5 to advance qualitative analysis in professional disaster and risk communication research, demonstrating a comparative method for processing complex public posts.

Expanding possibilities for generative AI in qualitative analysis: Fostering student feedback literacy through the application of a feedback quality rubric

Katherine Drinkwater Gregg, Olivia Ryan, Andrew Katz, Mark Huerta et al.

This study investigates the reliability and utility of generative AI to apply a feedback quality rubric to peer feedback comments from first-year engineering students, exploring how LLMs can assist in qualitative analysis.

Index

Browse the full publication record

Showing 73 of 73 publications

Journal

2026

Featured

Thematic analysis with open-source generative AI and machine learning: A new method for inductive qualitative codebook development

Andrew Katz, Gabriella Coloyan Fleming, Joyce B. Main

Humanities and Social Sciences Communications

This paper introduces a novel method for developing qualitative codebooks using open-source generative AI and machine learning techniques, enabling more systematic and reproducible inductive thematic analysis.

Journal

2025

Featured

Using generative AI for large-scale qualitative analysis of social media posts to understand why people leave computer science

Amanda Ross, Andrew Katz

Journal of Engineering Education

This study uses generative AI for large-scale qualitative analysis of over 10,000 Reddit posts to understand diverse reasons why people leave computer science, including job dissatisfaction and influential factors at different stages of departure.

Journal

2025

Featured

Advancing Qualitative Analysis in Professional Disaster and Risk Communication: A Comparative Study of an OpenAI ChatGPT 3.5 Model-Enabled Method for Processing Complex Public Posts

Margaret Webb, Harman Singh, Rachel Inman, Sweta Baniya, Andrew Katz

International Journal of Disaster Risk Reduction

This paper explores the application of ChatGPT 3.5 to advance qualitative analysis in professional disaster and risk communication research, demonstrating a comparative method for processing complex public posts.

Journal

2025

Featured

Expanding possibilities for generative AI in qualitative analysis: Fostering student feedback literacy through the application of a feedback quality rubric

Katherine Drinkwater Gregg, Olivia Ryan, Andrew Katz, Mark Huerta, Susan Sajadi

Journal of Engineering Education

This study investigates the reliability and utility of generative AI to apply a feedback quality rubric to peer feedback comments from first-year engineering students, exploring how LLMs can assist in qualitative analysis.

Conference

2025

Automated Analysis of Knowledge Types in Computer Science Textbooks: A Natural Language Processing Approach to Understanding Epistemic Climate

Mitchell Gerhardt, Andrew Katz

Proceedings of the 2025 ASEE Annual Conference & Exposition

This paper uses a natural language processing approach to automatically analyze knowledge types in computer science textbooks, providing insights into the epistemic climate of educational materials.

Journal

2025

Featured

Leveraging Generative Text Models and Natural Language Processing to Perform Traditional Thematic Data Analysis

Isil Anakok, Andrew Katz, Kai Jun Chew, Holly Matusovich

International Journal of Qualitative Methods

This paper explores how generative text models and natural language processing can be leveraged to perform traditional thematic data analysis in educational research contexts.

Journal

2025

Featured

Understanding instructor decision-making in engineering education for sustainable development: a comparison of institutions in Denmark and the United States

Maya Menon, Marie C. Paretti, Jennifer M. Case, Andrew S. Katz

European Journal of Engineering Education

This comparative study examines instructor decision-making in engineering education for sustainable development across institutions in Denmark and the United States.

Journal

2025

Curriculum comparison: chemical and mechanical engineering education in the United States and Turkey

Hatice Cilsalar-Sagnak, Isil Anakok, Andrew Katz

Australasian Journal of Engineering Education

This comparative study examines chemical and mechanical engineering education programs in the United States and Turkey, identifying similarities and differences in curriculum design.

Journal

2025

Featured

Engineering students' interests in nonprofit and public policy careers: Applying a data-driven approach to identifying contributing factors

Dayoung Kim, Andrew Katz

Journal of Engineering Education

Publication on Engineering students' interests in nonprofit and public policy careers: Applying a data-driven approach to identifying contributing factors

Journal

2024

Featured

A Reinforcement Learning Framework for N-Ary Document-Level Relation Extraction

C. Yuan, R. Rossi, A. Katz, H. Eldardiry

IEEE Transactions on Big Data

Publication on A Reinforcement Learning Framework for N-Ary Document-Level Relation Extraction

Conference

2024

From Manual Coding to Machine Understanding: Students' Feedback Analysis

A. Alsharif, A. Katz

Proceedings of the 131st Annual Conference of the American Society for Engineering Education

Publication on From Manual Coding to Machine Understanding: Students' Feedback Analysis

Journal

2024

Featured

How do ethics and diversity, equity, and inclusion relate in engineering? A systematic review

J. L. Hess, A. Lin, A. Whitehead, A. Katz

Journal of Engineering Education

Publication on How do ethics and diversity, equity, and inclusion relate in engineering? A systematic review

Journal

2024

Featured

Inspiring Sustainability in Undergraduate Engineering Programs

T. Griesinger, K. Reid, D. Knight, A. Katz, J. Somers

Sustainability

Publication on Inspiring Sustainability in Undergraduate Engineering Programs

Conference

2024

Novel Approach Designing Interview Protocols with Generative Large Language Models to Study Mental Models and Engineering Design

F. Bilow, M. Paretti, T. Shealy, A. Katz

Proceedings of the 131st Annual Conference of the American Society for Engineering Education

Publication on Novel Approach Designing Interview Protocols with Generative Large Language Models to Study Mental Models and Engineering Design

Conference

2024

Paradigm Shift? Preliminary Findings of Engineering Faculty Members’ Mental Models of Assessment in the Era of Generative AI

I. Anakok, K. Chew, H. Matusovich, A. Katz

Proceedings of the 131st Annual Conference of the American Society for Engineering Education

Publication on Paradigm Shift? Preliminary Findings of Engineering Faculty Members’ Mental Models of Assessment in the Era of Generative AI

Conference

2024

Skill Development of Engineering and Physical Science Doctoral Students: Understanding the Role of Advisor, Faculty, and Peer Interactions

A. Alsharif, M. Denton, D. Knight, M. Borrego, A. Katz

Proceedings of the 131st Annual Conference of the American Society for Engineering Education

Publication on Skill Development of Engineering and Physical Science Doctoral Students: Understanding the Role of Advisor, Faculty, and Peer Interactions

Conference

2024

Stumbling Our Way Through Finding a Better Prompt: Using GPT-4 to Analyze Engineering Faculty’s Mental Models of Assessment

A. Ross, A. Katz, K. Chew, H. Matusovich

Proceedings of the 131st Annual Conference of the American Society for Engineering Education

Publication on Stumbling Our Way Through Finding a Better Prompt: Using GPT-4 to Analyze Engineering Faculty’s Mental Models of Assessment

Journal

2024

Featured

Thematic Analysis with Open-Source Generative AI and Machine Learning: A New Method for Inductive Qualitative Codebook Development

Andrew Katz, Gabriella Coloyan Fleming, Joyce Main

arXiv preprint

Publication on Thematic Analysis with Open-Source Generative AI and Machine Learning: A New Method for Inductive Qualitative Codebook Development

Journal

2024

Featured

Using Generative Text Models to Create Qualitative Codebooks for Student Evaluations of Teaching

Andrew Katz, Mitch Gerhardt, Michelle Soledad

International Journal of Qualitative Methods

Publication on Using Generative Text Models to Create Qualitative Codebooks for Student Evaluations of Teaching

Journal

2024

Featured

Using Generative Text Models to Create Qualitative Codebooks for Student Evaluations of Teaching

A. Katz, M. Gerhardt, M. Soledad

arXiv preprint

Publication on Using Generative Text Models to Create Qualitative Codebooks for Student Evaluations of Teaching

Journal

2024

Featured

What engineering employers want: An analysis of technical and professional skills in engineering job advertisements

G. C. Fleming, M. Klopfer, A. Katz, D. Knight

Journal of Engineering Education

Publication on What engineering employers want: An analysis of technical and professional skills in engineering job advertisements

Journal

2023

Advanced Considerations in Quantitative Methods for New Directions in Engineering Education Research

A. Katz, A. Godwin, C. Brozina

International Handbook of Engineering Education Research

Publication on Advanced Considerations in Quantitative Methods for New Directions in Engineering Education Research

Journal

2023

Advancing qualitative analysis: An exploration of the potential of generative AI and NLP in thematic coding

Yasir Gamieldien, Jennifer M Case, Andrew Katz

Available at SSRN 4487768

Publication on Advancing qualitative analysis: An exploration of the potential of generative AI and NLP in thematic coding

Conference

2023

Exploring Faculty Members' Conceptualizations of Diversity, Equity, and Inclusion in Engineering Education

I. Anakok, J. Hess, S. Panuganti, A. Katz

IEEE Frontiers in Education Conference (FIE)

Publication on Exploring Faculty Members' Conceptualizations of Diversity, Equity, and Inclusion in Engineering Education

Conference

2023

Exploring NLP-based Methods for Generating Engineering Ethics Assessment Qualitative Codebooks

A. Hingle, A. Katz, A. Johri

IEEE Frontiers in Education Conference (FIE)

Publication on Exploring NLP-based Methods for Generating Engineering Ethics Assessment Qualitative Codebooks

Journal

2023

Exploring the Efficacy of ChatGPT in Analyzing Student Teamwork Feedback with an Existing Taxonomy

A. Katz, S. Wei, G. Nanda, C. Brinton, M. Ohland

arXiv preprint

Publication on Exploring the Efficacy of ChatGPT in Analyzing Student Teamwork Feedback with an Existing Taxonomy

Conference

2023

Exploring the Impact of Engineering Projects in Community Service on Engineering Students’ Perspectives about Engineering as a Major

I. Anakok, M. Huerta, A. Katz

IEEE Frontiers in Education Conference (FIE)

Publication on Exploring the Impact of Engineering Projects in Community Service on Engineering Students’ Perspectives about Engineering as a Major

Conference

2023

How Participating in Extracurricular Activities Supports Dimensions of Student Wellness

B. Johnson, J. Main, A. Katz

IEEE Frontiers in Education Conference (FIE)

Publication on How Participating in Extracurricular Activities Supports Dimensions of Student Wellness

Conference

2023

Promoting Research Quality to Study Mental Models of Ethics and Diversity, Equity, and Inclusion (DEI) in Engineering

J. Hess, A. Katz, I. Anakok, B. Jesiek, A. Whitehead, S. Panuganti

Proceedings of the 130th Annual Conference of the American Society for Engineering Education

Publication on Promoting Research Quality to Study Mental Models of Ethics and Diversity, Equity, and Inclusion (DEI) in Engineering

Conference

2023

Pushing Ethics Assessment Forward in Engineering: NLP-Assisted Qualitative Coding of Student Responses

U. Shakir, J. Hess, M. James, A. Katz

Proceedings of the 130th Annual Conference of the American Society for Engineering Education

Publication on Pushing Ethics Assessment Forward in Engineering: NLP-Assisted Qualitative Coding of Student Responses

Journal

2023

The Utility of Large Language Models and Generative AI for Education Research

A. Katz, U. Shakir, B. Chambers

arXiv preprint

Publication on The Utility of Large Language Models and Generative AI for Education Research

Journal

2023

Utilizing Natural Language Processing to Examine Self-Reflections in Self-Regulated Learning

Yasir Gamieldien, Rachel McCord, Andrew Katz

Available at SSRN 4487795

Publication on Utilizing Natural Language Processing to Examine Self-Reflections in Self-Regulated Learning

Conference

2023

WIP: Faculty Use of Metaphors When Discussing Assessment

A. Ross, A. Katz, H. Matusovich, K. Chew

Proceedings of the 130th Annual Conference of the American Society for Engineering Education

Publication on WIP: Faculty Use of Metaphors When Discussing Assessment

Conference

2022

A Thematic and Trend Analysis of Engineering Education for Sustainable Development

M. Menon, A. Katz, M. Paretti

2022 ASEE Annual Conference \& Exposition

Publication on A Thematic and Trend Analysis of Engineering Education for Sustainable Development

Conference

2022

An Empirical Study of Programming Languages Specified in Engineering Job Postings

L. Schibelius, A. Ross, A. Katz

2022 ASEE Annual Conference \& Exposition

Publication on An Empirical Study of Programming Languages Specified in Engineering Job Postings

Conference

2022

Analysis of Advances in Engineering Education Publications (2007-2020) to Examine Impact and Coverage of Topics

A. Katz, C. Brozina, A. Johri, L. Shuman

2022 IEEE Frontiers in Education Conference (FIE)

Publication on Analysis of Advances in Engineering Education Publications (2007-2020) to Examine Impact and Coverage of Topics

Journal

2022

Applying concepts from political science and economics to advance the study of engineering education

A. Katz, J. Main

Studies in Engineering Education

Publication on Applying concepts from political science and economics to advance the study of engineering education

Conference

2022

Augmented Reality for Sustainable Collaborative Design

S. Yan, E. Kang, A. Katz, A. Hira

2022 ASEE Annual Conference \& Exposition

Publication on Augmented Reality for Sustainable Collaborative Design

Conference

2022

Clustering-based unsupervised generative relation extraction

Chenhan Yuan, Ryan A Rossi, Andrew Katz, Hoda Eldardiry

2022 IEEE International Conference on Big Data (Big Data)

Publication on Clustering-based unsupervised generative relation extraction

Conference

2022

Collateral Damage: Investigating the Impacts of COVID on STEM Professionals with Caregiving Responsibilities

A. Maltese, K. Paul, J. Kim, A. Godwin, A. Katz, A. Diekman

2022 ASEE Annual Conference \& Exposition

Publication on Collateral Damage: Investigating the Impacts of COVID on STEM Professionals with Caregiving Responsibilities

Conference

2022

Defining Assessment: Foundation Knowledge Toward Exploring Engineering Faculty’s Assessment Mental Models

K. Chew, A. Ross, A. Katz, H. M. Matusovich

2022 IEEE Frontiers in Education Conference (FIE)

Publication on Defining Assessment: Foundation Knowledge Toward Exploring Engineering Faculty’s Assessment Mental Models

Journal

2022

Development of hybrid laboratory sessions during the COVID-19 Pandemic

M. Szoke, A. Katz, A. Borgoltz, W. J. Devenport

Advances in Engineering Education

Publication on Development of hybrid laboratory sessions during the COVID-19 Pandemic

Conference

2022

Students’ Feedback About Their Experiences in EPICS Using Natural Language Processing

I. Anakok, J. Woods, M. Huerta, J. Schoepf, H. Murzi, A. Katz

2022 IEEE Frontiers in Education Conference (FIE)

Publication on Students’ Feedback About Their Experiences in EPICS Using Natural Language Processing

Conference

2022

Understanding First-year Engineering Students’ Perceptions of Working with Real Stakeholders on a Design Project: A PBL Approach

H. Murzi, L. Fielding, M. Huerta, J. O. Alvarez, M. James, A. Katz, J. Grohs

2022 IEEE Frontiers in Education Conference (FIE)

Publication on Understanding First-year Engineering Students’ Perceptions of Working with Real Stakeholders on a Design Project: A PBL Approach

Conference

2022

Using Natural Language Processing to Explore Undergraduate Students’ Perspectives of Social Class, Gender, and Race

U. Shakir, S. Ovink, A. Katz

2022 ASEE Annual Conference \& Exposition

Publication on Using Natural Language Processing to Explore Undergraduate Students’ Perspectives of Social Class, Gender, and Race

Conference

2022

Using Sentiment Analysis to Evaluate First-year Engineering Students Teamwork Textual Feedback

A. Alsharif, A. Katz, D. Knight, S. Alatwah

2022 ASEE Annual Conference \& Exposition

Publication on Using Sentiment Analysis to Evaluate First-year Engineering Students Teamwork Textual Feedback

Conference

2022

Work-in-Progress: Using Latent Dirichlet Allocation to uncover themes in student comments from peer evaluations of teamwork

G. Nanda, S. Wei, M. Ohland, A. Katz, C. Brinton

2022 ASEE Annual Conference \& Exposition

Publication on Work-in-Progress: Using Latent Dirichlet Allocation to uncover themes in student comments from peer evaluations of teamwork

Journal

2021

Civil Engineering Students’ Beliefs about Global Warming and Misconceptions about Climate Science

T. Shealy, A. Katz, A. Godwin, M. Bell

Journal of Civil Engineering Education

Publication on Civil Engineering Students’ Beliefs about Global Warming and Misconceptions about Climate Science

Conference

2021

Engineering ethics in engineering design courses: A preliminary investigation

A. Katz, U. Shakir, I. Anakok, H. Murzi

American Society for Engineering Education Annual Conference

Publication on Engineering ethics in engineering design courses: A preliminary investigation

Conference

2021

Factors associated with collaboration networks in ASEE conference papers

S. Abdelhamid, A. Katz

American Society for Engineering Education Annual Conference

Publication on Factors associated with collaboration networks in ASEE conference papers

Conference

2021

Figurative language in computer education: Evidence from YouTube instructional videos

S. Abdelhamid, A. Katz

American Society for Engineering Education Annual Conference

Publication on Figurative language in computer education: Evidence from YouTube instructional videos

Journal

2021

Higher perceived design thinking traits and active learning in design courses motivate engineering students to tackle energy sustainability in their careers

J. Milovanovic, T. Shealy, A. Katz

Sustainability

Publication on Higher perceived design thinking traits and active learning in design courses motivate engineering students to tackle energy sustainability in their careers

Journal

2021

Predicting engineering students’ desire to address climate change in their careers: An exploratory study using responses from a U.S. National survey

T. Shealy, A. Katz, A. Godwin

Environmental Education Research

Publication on Predicting engineering students’ desire to address climate change in their careers: An exploratory study using responses from a U.S. National survey

Journal

2021

Taking stock: An Analysis of IJEE publications from 1996--2020 to examine impact and coverage of topics

C. Brozina, A. Katz, A. Johri

International Journal of Engineering Education

Publication on Taking stock: An Analysis of IJEE publications from 1996--2020 to examine impact and coverage of topics

Journal

2021

The correlation between undergraduate student diversity and the representation of women of color faculty in engineering

J. Main, L. Tan, M. Cox, E. McGee, A. Katz

Journal of Engineering Education

Publication on The correlation between undergraduate student diversity and the representation of women of color faculty in engineering

Conference

2021

Using natural language processing to facilitate student feedback analysis

A. Katz, M. Norris, A. Alsharif, M. Klopfer, D. Knight, J. Grohs

American Society for Engineering Education Annual Conference

Publication on Using natural language processing to facilitate student feedback analysis

Conference

2021

Your views can be my views: Understanding differences in paradigms held by traditionally marginalized students in engineering

Q. Ketchum, M. C. Paretti, H. Murzi, A. Katz

American Society for Engineering Education Annual Conference

Publication on Your views can be my views: Understanding differences in paradigms held by traditionally marginalized students in engineering

Conference

2020

An Investigation of When and Where Ethics Appears in Undergraduate Engineering Curricula

A. Katz, U. Shakir

2020 ASEE Virtual Annual Conference

Publication on An Investigation of When and Where Ethics Appears in Undergraduate Engineering Curricula

Conference

2020

Civil Engineering Students’ Beliefs about the Technical and Social Implications of Global Warming and When Global Warming Will Impact Them Personally and Others

A. Katz, T. Shealy, A. Godwin

2020 ASEE Virtual Annual Conference

Publication on Civil Engineering Students’ Beliefs about the Technical and Social Implications of Global Warming and When Global Warming Will Impact Them Personally and Others

Journal

2020

Clustering-based Unsupervised Generative Relation Extraction

C. Yuan, R. Rossi, A. Katz, H. Eldardiry

arXiv preprint

Publication on Clustering-based Unsupervised Generative Relation Extraction

Conference

2020

Harvesting tweets for a better understanding of engineering students' first-year experiences

S. Abdelhamid, A. Katz

2020 First-Year Engineering Experience Conference

Publication on Harvesting tweets for a better understanding of engineering students' first-year experiences

Journal

2020

Overcoming Challenges to Enhance a First Year Engineering Ethics Curriculum

A. Katz, K. Reid, D. Riley, N. Van Tyne

Advances in Engineering Education

Publication on Overcoming Challenges to Enhance a First Year Engineering Ethics Curriculum

Journal

2020

Reinforcement Learning-based N-ary Cross-Sentence Relation Extraction

C. Yuan, R. Rossi, A. Katz, H. Eldardiry

arXiv preprint

Publication on Reinforcement Learning-based N-ary Cross-Sentence Relation Extraction

Conference

2020

Using Chatbots as Smart Teaching Assistants for First-Year Engineering Students

S. Abdelhamid, A. Katz

2020 First-Year Engineering Experience Conference

Publication on Using Chatbots as Smart Teaching Assistants for First-Year Engineering Students

Conference

2019

Monetizing Life May Be the Ethical Thing to Do

A. Salado, A. Katz

2019 American Society for Engineering Education Annual Conference

Publication on Monetizing Life May Be the Ethical Thing to Do

Conference

2018

Investigating influences on first-year engineering students’ views of ethics and social responsibility

S. Nittala, T. Zephirin, S. M. J. Howland, D. Kim, A. Katz, B. K. Jesiek

American Society for Engineering Education Annual Conference

Publication on Investigating influences on first-year engineering students’ views of ethics and social responsibility

Conference

2018

Learning from failures: Engineering education in an age of academic capitalism

A. Katz, D. Riley

American Society for Engineering Education Annual Conference

Publication on Learning from failures: Engineering education in an age of academic capitalism

Conference

2017

Factors related to faculty views of undergraduate engineering ethics education

A. Katz, D. Knight

American Society for Engineering Education Annual Conference

Publication on Factors related to faculty views of undergraduate engineering ethics education

Conference

2017

Telling it like it was: Histories of change in engineering ethics education

M. Davis, J. Herkert, M. Loui, I. Nair, S. Pfatteicher, M. Pritchard, A. Katz

Panel Session at the Association for Practical and Professional Ethics Annual Conference

Publication on Telling it like it was: Histories of change in engineering ethics education

Conference

2016

Addressing the state of higher education in State of the Union Addresses

A. Katz

Association for the Study of Higher Education Annual Conference

Publication on Addressing the state of higher education in State of the Union Addresses

Conference

2016

Shadow codes of engineering ethics: An experiment in ethics imaginaries

A. Katz, Y. Lambrinidou, D. M. Riley

Association for Practical and Professional Ethics Annual Conference

Publication on Shadow codes of engineering ethics: An experiment in ethics imaginaries

Conference

2016

The revealing effects of disaster: A case study from Tulane University

A. Katz

American Society for Engineering Education Annual Conference

Publication on The revealing effects of disaster: A case study from Tulane University

Conference

2015

Educating for a revolution: Discerning together the Highlander idea and its lessons for ESJP’s work

D. Riley, A. Katz

Engineering, Social Justice, and Peace Annual Conference

Publication on Educating for a revolution: Discerning together the Highlander idea and its lessons for ESJP’s work