Research
Publications
Peer-reviewed papers, preprints, and conference proceedings from the IDEEAS Lab.
Thematic analysis with open-source generative AI and machine learning: A new method for inductive qualitative codebook development
Andrew Katz, Gabriella Coloyan Fleming, Joyce B. Main
Humanities and Social Sciences Communications, 2026
This paper introduces a novel method for developing qualitative codebooks using open-source generative AI and machine learning techniques, enabling more systematic and reproducible inductive thematic analysis.
Using generative AI for large-scale qualitative analysis of social media posts to understand why people leave computer science
Amanda Ross, Andrew Katz
Journal of Engineering Education, 2025
This study uses generative AI for large-scale qualitative analysis of over 10,000 Reddit posts to understand diverse reasons why people leave computer science, including job dissatisfaction and influential factors at different stages of departure.
Advancing Qualitative Analysis in Professional Disaster and Risk Communication: A Comparative Study of an OpenAI ChatGPT 3.5 Model-Enabled Method for Processing Complex Public Posts
Margaret Webb, Harman Singh, Rachel Inman, Sweta Baniya, Andrew Katz
International Journal of Disaster Risk Reduction, 2025
This paper explores the application of ChatGPT 3.5 to advance qualitative analysis in professional disaster and risk communication research, demonstrating a comparative method for processing complex public posts.
Expanding possibilities for generative AI in qualitative analysis: Fostering student feedback literacy through the application of a feedback quality rubric
Katherine Drinkwater Gregg, Olivia Ryan, Andrew Katz, Mark Huerta, Susan Sajadi
Journal of Engineering Education, 2025
This study investigates the reliability and utility of generative AI to apply a feedback quality rubric to peer feedback comments from first-year engineering students, exploring how LLMs can assist in qualitative analysis.
Automated Analysis of Knowledge Types in Computer Science Textbooks: A Natural Language Processing Approach to Understanding Epistemic Climate
Mitchell Gerhardt, Andrew Katz
Proceedings of the 2025 ASEE Annual Conference & Exposition, 2025
This paper uses a natural language processing approach to automatically analyze knowledge types in computer science textbooks, providing insights into the epistemic climate of educational materials.
Leveraging Generative Text Models and Natural Language Processing to Perform Traditional Thematic Data Analysis
Isil Anakok, Andrew Katz, Kai Jun Chew, Holly Matusovich
International Journal of Qualitative Methods, 2025
This paper explores how generative text models and natural language processing can be leveraged to perform traditional thematic data analysis in educational research contexts.
Understanding instructor decision-making in engineering education for sustainable development: a comparison of institutions in Denmark and the United States
Maya Menon, Marie C. Paretti, Jennifer M. Case, Andrew S. Katz
European Journal of Engineering Education, 2025
This comparative study examines instructor decision-making in engineering education for sustainable development across institutions in Denmark and the United States.
Curriculum comparison: chemical and mechanical engineering education in the United States and Turkey
Hatice Cilsalar-Sagnak, Isil Anakok, Andrew Katz
Australasian Journal of Engineering Education, 2025
This comparative study examines chemical and mechanical engineering education programs in the United States and Turkey, identifying similarities and differences in curriculum design.
Engineering students' interests in nonprofit and public policy careers: Applying a data-driven approach to identifying contributing factors
Dayoung Kim, Andrew Katz
Journal of Engineering Education, 2025
Publication on Engineering students' interests in nonprofit and public policy careers: Applying a data-driven approach to identifying contributing factors
A Reinforcement Learning Framework for N-Ary Document-Level Relation Extraction
C. Yuan, R. Rossi, A. Katz, H. Eldardiry
IEEE Transactions on Big Data, 2024
Publication on A Reinforcement Learning Framework for N-Ary Document-Level Relation Extraction
From Manual Coding to Machine Understanding: Students' Feedback Analysis
A. Alsharif, A. Katz
Proceedings of the 131st Annual Conference of the American Society for Engineering Education, 2024
Publication on From Manual Coding to Machine Understanding: Students' Feedback Analysis
How do ethics and diversity, equity, and inclusion relate in engineering? A systematic review
J. L. Hess, A. Lin, A. Whitehead, A. Katz
Journal of Engineering Education, 2024
Publication on How do ethics and diversity, equity, and inclusion relate in engineering? A systematic review
Inspiring Sustainability in Undergraduate Engineering Programs
T. Griesinger, K. Reid, D. Knight, A. Katz, J. Somers
Sustainability, 2024
Publication on Inspiring Sustainability in Undergraduate Engineering Programs
Novel Approach Designing Interview Protocols with Generative Large Language Models to Study Mental Models and Engineering Design
F. Bilow, M. Paretti, T. Shealy, A. Katz
Proceedings of the 131st Annual Conference of the American Society for Engineering Education, 2024
Publication on Novel Approach Designing Interview Protocols with Generative Large Language Models to Study Mental Models and Engineering Design
Paradigm Shift? Preliminary Findings of Engineering Faculty Members’ Mental Models of Assessment in the Era of Generative AI
I. Anakok, K. Chew, H. Matusovich, A. Katz
Proceedings of the 131st Annual Conference of the American Society for Engineering Education, 2024
Publication on Paradigm Shift? Preliminary Findings of Engineering Faculty Members’ Mental Models of Assessment in the Era of Generative AI
Skill Development of Engineering and Physical Science Doctoral Students: Understanding the Role of Advisor, Faculty, and Peer Interactions
A. Alsharif, M. Denton, D. Knight, M. Borrego, A. Katz
Proceedings of the 131st Annual Conference of the American Society for Engineering Education, 2024
Publication on Skill Development of Engineering and Physical Science Doctoral Students: Understanding the Role of Advisor, Faculty, and Peer Interactions
Stumbling Our Way Through Finding a Better Prompt: Using GPT-4 to Analyze Engineering Faculty’s Mental Models of Assessment
A. Ross, A. Katz, K. Chew, H. Matusovich
Proceedings of the 131st Annual Conference of the American Society for Engineering Education, 2024
Publication on Stumbling Our Way Through Finding a Better Prompt: Using GPT-4 to Analyze Engineering Faculty’s Mental Models of Assessment
Thematic Analysis with Open-Source Generative AI and Machine Learning: A New Method for Inductive Qualitative Codebook Development
Andrew Katz, Gabriella Coloyan Fleming, Joyce Main
arXiv preprint, 2024
Publication on Thematic Analysis with Open-Source Generative AI and Machine Learning: A New Method for Inductive Qualitative Codebook Development
Using Generative Text Models to Create Qualitative Codebooks for Student Evaluations of Teaching
Andrew Katz, Mitch Gerhardt, Michelle Soledad
International Journal of Qualitative Methods, 2024
Publication on Using Generative Text Models to Create Qualitative Codebooks for Student Evaluations of Teaching
Using Generative Text Models to Create Qualitative Codebooks for Student Evaluations of Teaching
A. Katz, M. Gerhardt, M. Soledad
arXiv preprint, 2024
Publication on Using Generative Text Models to Create Qualitative Codebooks for Student Evaluations of Teaching
What engineering employers want: An analysis of technical and professional skills in engineering job advertisements
G. C. Fleming, M. Klopfer, A. Katz, D. Knight
Journal of Engineering Education, 2024
Publication on What engineering employers want: An analysis of technical and professional skills in engineering job advertisements
Advanced Considerations in Quantitative Methods for New Directions in Engineering Education Research
A. Katz, A. Godwin, C. Brozina
International Handbook of Engineering Education Research, 2023
Publication on Advanced Considerations in Quantitative Methods for New Directions in Engineering Education Research
Advancing qualitative analysis: An exploration of the potential of generative AI and NLP in thematic coding
Yasir Gamieldien, Jennifer M Case, Andrew Katz
Available at SSRN 4487768, 2023
Publication on Advancing qualitative analysis: An exploration of the potential of generative AI and NLP in thematic coding
Exploring Faculty Members' Conceptualizations of Diversity, Equity, and Inclusion in Engineering Education
I. Anakok, J. Hess, S. Panuganti, A. Katz
IEEE Frontiers in Education Conference (FIE), 2023
Publication on Exploring Faculty Members' Conceptualizations of Diversity, Equity, and Inclusion in Engineering Education
Exploring NLP-based Methods for Generating Engineering Ethics Assessment Qualitative Codebooks
A. Hingle, A. Katz, A. Johri
IEEE Frontiers in Education Conference (FIE), 2023
Publication on Exploring NLP-based Methods for Generating Engineering Ethics Assessment Qualitative Codebooks
Exploring the Efficacy of ChatGPT in Analyzing Student Teamwork Feedback with an Existing Taxonomy
A. Katz, S. Wei, G. Nanda, C. Brinton, M. Ohland
arXiv preprint, 2023
Publication on Exploring the Efficacy of ChatGPT in Analyzing Student Teamwork Feedback with an Existing Taxonomy
Exploring the Impact of Engineering Projects in Community Service on Engineering Students’ Perspectives about Engineering as a Major
I. Anakok, M. Huerta, A. Katz
IEEE Frontiers in Education Conference (FIE), 2023
Publication on Exploring the Impact of Engineering Projects in Community Service on Engineering Students’ Perspectives about Engineering as a Major
How Participating in Extracurricular Activities Supports Dimensions of Student Wellness
B. Johnson, J. Main, A. Katz
IEEE Frontiers in Education Conference (FIE), 2023
Publication on How Participating in Extracurricular Activities Supports Dimensions of Student Wellness
Promoting Research Quality to Study Mental Models of Ethics and Diversity, Equity, and Inclusion (DEI) in Engineering
J. Hess, A. Katz, I. Anakok, B. Jesiek, A. Whitehead, S. Panuganti
Proceedings of the 130th Annual Conference of the American Society for Engineering Education, 2023
Publication on Promoting Research Quality to Study Mental Models of Ethics and Diversity, Equity, and Inclusion (DEI) in Engineering
Pushing Ethics Assessment Forward in Engineering: NLP-Assisted Qualitative Coding of Student Responses
U. Shakir, J. Hess, M. James, A. Katz
Proceedings of the 130th Annual Conference of the American Society for Engineering Education, 2023
Publication on Pushing Ethics Assessment Forward in Engineering: NLP-Assisted Qualitative Coding of Student Responses
The Utility of Large Language Models and Generative AI for Education Research
A. Katz, U. Shakir, B. Chambers
arXiv preprint, 2023
Publication on The Utility of Large Language Models and Generative AI for Education Research
Utilizing Natural Language Processing to Examine Self-Reflections in Self-Regulated Learning
Yasir Gamieldien, Rachel McCord, Andrew Katz
Available at SSRN 4487795, 2023
Publication on Utilizing Natural Language Processing to Examine Self-Reflections in Self-Regulated Learning
WIP: Faculty Use of Metaphors When Discussing Assessment
A. Ross, A. Katz, H. Matusovich, K. Chew
Proceedings of the 130th Annual Conference of the American Society for Engineering Education, 2023
Publication on WIP: Faculty Use of Metaphors When Discussing Assessment
A Thematic and Trend Analysis of Engineering Education for Sustainable Development
M. Menon, A. Katz, M. Paretti
2022 ASEE Annual Conference \& Exposition, 2022
Publication on A Thematic and Trend Analysis of Engineering Education for Sustainable Development
An Empirical Study of Programming Languages Specified in Engineering Job Postings
L. Schibelius, A. Ross, A. Katz
2022 ASEE Annual Conference \& Exposition, 2022
Publication on An Empirical Study of Programming Languages Specified in Engineering Job Postings
Analysis of Advances in Engineering Education Publications (2007-2020) to Examine Impact and Coverage of Topics
A. Katz, C. Brozina, A. Johri, L. Shuman
2022 IEEE Frontiers in Education Conference (FIE), 2022
Publication on Analysis of Advances in Engineering Education Publications (2007-2020) to Examine Impact and Coverage of Topics
Applying concepts from political science and economics to advance the study of engineering education
A. Katz, J. Main
Studies in Engineering Education, 2022
Publication on Applying concepts from political science and economics to advance the study of engineering education
Augmented Reality for Sustainable Collaborative Design
S. Yan, E. Kang, A. Katz, A. Hira
2022 ASEE Annual Conference \& Exposition, 2022
Publication on Augmented Reality for Sustainable Collaborative Design
Clustering-based unsupervised generative relation extraction
Chenhan Yuan, Ryan A Rossi, Andrew Katz, Hoda Eldardiry
2022 IEEE International Conference on Big Data (Big Data), 2022
Publication on Clustering-based unsupervised generative relation extraction
Collateral Damage: Investigating the Impacts of COVID on STEM Professionals with Caregiving Responsibilities
A. Maltese, K. Paul, J. Kim, A. Godwin, A. Katz, A. Diekman
2022 ASEE Annual Conference \& Exposition, 2022
Publication on Collateral Damage: Investigating the Impacts of COVID on STEM Professionals with Caregiving Responsibilities
Defining Assessment: Foundation Knowledge Toward Exploring Engineering Faculty’s Assessment Mental Models
K. Chew, A. Ross, A. Katz, H. M. Matusovich
2022 IEEE Frontiers in Education Conference (FIE), 2022
Publication on Defining Assessment: Foundation Knowledge Toward Exploring Engineering Faculty’s Assessment Mental Models
Development of hybrid laboratory sessions during the COVID-19 Pandemic
M. Szoke, A. Katz, A. Borgoltz, W. J. Devenport
Advances in Engineering Education, 2022
Publication on Development of hybrid laboratory sessions during the COVID-19 Pandemic
Students’ Feedback About Their Experiences in EPICS Using Natural Language Processing
I. Anakok, J. Woods, M. Huerta, J. Schoepf, H. Murzi, A. Katz
2022 IEEE Frontiers in Education Conference (FIE), 2022
Publication on Students’ Feedback About Their Experiences in EPICS Using Natural Language Processing
Understanding First-year Engineering Students’ Perceptions of Working with Real Stakeholders on a Design Project: A PBL Approach
H. Murzi, L. Fielding, M. Huerta, J. O. Alvarez, M. James, A. Katz, J. Grohs
2022 IEEE Frontiers in Education Conference (FIE), 2022
Publication on Understanding First-year Engineering Students’ Perceptions of Working with Real Stakeholders on a Design Project: A PBL Approach
Using Natural Language Processing to Explore Undergraduate Students’ Perspectives of Social Class, Gender, and Race
U. Shakir, S. Ovink, A. Katz
2022 ASEE Annual Conference \& Exposition, 2022
Publication on Using Natural Language Processing to Explore Undergraduate Students’ Perspectives of Social Class, Gender, and Race
Using Sentiment Analysis to Evaluate First-year Engineering Students Teamwork Textual Feedback
A. Alsharif, A. Katz, D. Knight, S. Alatwah
2022 ASEE Annual Conference \& Exposition, 2022
Publication on Using Sentiment Analysis to Evaluate First-year Engineering Students Teamwork Textual Feedback
Work-in-Progress: Using Latent Dirichlet Allocation to uncover themes in student comments from peer evaluations of teamwork
G. Nanda, S. Wei, M. Ohland, A. Katz, C. Brinton
2022 ASEE Annual Conference \& Exposition, 2022
Publication on Work-in-Progress: Using Latent Dirichlet Allocation to uncover themes in student comments from peer evaluations of teamwork
Civil Engineering Students’ Beliefs about Global Warming and Misconceptions about Climate Science
T. Shealy, A. Katz, A. Godwin, M. Bell
Journal of Civil Engineering Education, 2021
Publication on Civil Engineering Students’ Beliefs about Global Warming and Misconceptions about Climate Science
Engineering ethics in engineering design courses: A preliminary investigation
A. Katz, U. Shakir, I. Anakok, H. Murzi
American Society for Engineering Education Annual Conference, 2021
Publication on Engineering ethics in engineering design courses: A preliminary investigation
Factors associated with collaboration networks in ASEE conference papers
S. Abdelhamid, A. Katz
American Society for Engineering Education Annual Conference, 2021
Publication on Factors associated with collaboration networks in ASEE conference papers
Figurative language in computer education: Evidence from YouTube instructional videos
S. Abdelhamid, A. Katz
American Society for Engineering Education Annual Conference, 2021
Publication on Figurative language in computer education: Evidence from YouTube instructional videos
Higher perceived design thinking traits and active learning in design courses motivate engineering students to tackle energy sustainability in their careers
J. Milovanovic, T. Shealy, A. Katz
Sustainability, 2021
Publication on Higher perceived design thinking traits and active learning in design courses motivate engineering students to tackle energy sustainability in their careers
Predicting engineering students’ desire to address climate change in their careers: An exploratory study using responses from a U.S. National survey
T. Shealy, A. Katz, A. Godwin
Environmental Education Research, 2021
Publication on Predicting engineering students’ desire to address climate change in their careers: An exploratory study using responses from a U.S. National survey
Taking stock: An Analysis of IJEE publications from 1996--2020 to examine impact and coverage of topics
C. Brozina, A. Katz, A. Johri
International Journal of Engineering Education, 2021
Publication on Taking stock: An Analysis of IJEE publications from 1996--2020 to examine impact and coverage of topics
The correlation between undergraduate student diversity and the representation of women of color faculty in engineering
J. Main, L. Tan, M. Cox, E. McGee, A. Katz
Journal of Engineering Education, 2021
Publication on The correlation between undergraduate student diversity and the representation of women of color faculty in engineering
Using natural language processing to facilitate student feedback analysis
A. Katz, M. Norris, A. Alsharif, M. Klopfer, D. Knight, J. Grohs
American Society for Engineering Education Annual Conference, 2021
Publication on Using natural language processing to facilitate student feedback analysis
Your views can be my views: Understanding differences in paradigms held by traditionally marginalized students in engineering
Q. Ketchum, M. C. Paretti, H. Murzi, A. Katz
American Society for Engineering Education Annual Conference, 2021
Publication on Your views can be my views: Understanding differences in paradigms held by traditionally marginalized students in engineering
An Investigation of When and Where Ethics Appears in Undergraduate Engineering Curricula
A. Katz, U. Shakir
2020 ASEE Virtual Annual Conference, 2020
Publication on An Investigation of When and Where Ethics Appears in Undergraduate Engineering Curricula
Civil Engineering Students’ Beliefs about the Technical and Social Implications of Global Warming and When Global Warming Will Impact Them Personally and Others
A. Katz, T. Shealy, A. Godwin
2020 ASEE Virtual Annual Conference, 2020
Publication on Civil Engineering Students’ Beliefs about the Technical and Social Implications of Global Warming and When Global Warming Will Impact Them Personally and Others
Clustering-based Unsupervised Generative Relation Extraction
C. Yuan, R. Rossi, A. Katz, H. Eldardiry
arXiv preprint, 2020
Publication on Clustering-based Unsupervised Generative Relation Extraction
Harvesting tweets for a better understanding of engineering students' first-year experiences
S. Abdelhamid, A. Katz
2020 First-Year Engineering Experience Conference, 2020
Publication on Harvesting tweets for a better understanding of engineering students' first-year experiences
Overcoming Challenges to Enhance a First Year Engineering Ethics Curriculum
A. Katz, K. Reid, D. Riley, N. Van Tyne
Advances in Engineering Education, 2020
Publication on Overcoming Challenges to Enhance a First Year Engineering Ethics Curriculum
Reinforcement Learning-based N-ary Cross-Sentence Relation Extraction
C. Yuan, R. Rossi, A. Katz, H. Eldardiry
arXiv preprint, 2020
Publication on Reinforcement Learning-based N-ary Cross-Sentence Relation Extraction
Using Chatbots as Smart Teaching Assistants for First-Year Engineering Students
S. Abdelhamid, A. Katz
2020 First-Year Engineering Experience Conference, 2020
Publication on Using Chatbots as Smart Teaching Assistants for First-Year Engineering Students
Monetizing Life May Be the Ethical Thing to Do
A. Salado, A. Katz
2019 American Society for Engineering Education Annual Conference, 2019
Publication on Monetizing Life May Be the Ethical Thing to Do
Investigating influences on first-year engineering students’ views of ethics and social responsibility
S. Nittala, T. Zephirin, S. M. J. Howland, D. Kim, A. Katz, B. K. Jesiek
American Society for Engineering Education Annual Conference, 2018
Publication on Investigating influences on first-year engineering students’ views of ethics and social responsibility
Learning from failures: Engineering education in an age of academic capitalism
A. Katz, D. Riley
American Society for Engineering Education Annual Conference, 2018
Publication on Learning from failures: Engineering education in an age of academic capitalism
Factors related to faculty views of undergraduate engineering ethics education
A. Katz, D. Knight
American Society for Engineering Education Annual Conference, 2017
Publication on Factors related to faculty views of undergraduate engineering ethics education
Telling it like it was: Histories of change in engineering ethics education
M. Davis, J. Herkert, M. Loui, I. Nair, S. Pfatteicher, M. Pritchard, A. Katz
Panel Session at the Association for Practical and Professional Ethics Annual Conference, 2017
Publication on Telling it like it was: Histories of change in engineering ethics education
Addressing the state of higher education in State of the Union Addresses
A. Katz
Association for the Study of Higher Education Annual Conference, 2016
Publication on Addressing the state of higher education in State of the Union Addresses
Shadow codes of engineering ethics: An experiment in ethics imaginaries
A. Katz, Y. Lambrinidou, D. M. Riley
Association for Practical and Professional Ethics Annual Conference, 2016
Publication on Shadow codes of engineering ethics: An experiment in ethics imaginaries
The revealing effects of disaster: A case study from Tulane University
A. Katz
American Society for Engineering Education Annual Conference, 2016
Publication on The revealing effects of disaster: A case study from Tulane University
Educating for a revolution: Discerning together the Highlander idea and its lessons for ESJP’s work
D. Riley, A. Katz
Engineering, Social Justice, and Peace Annual Conference, 2015
Publication on Educating for a revolution: Discerning together the Highlander idea and its lessons for ESJP’s work