Category: Human Factors

CLS Students Tour Production Plant for Boss Plow

In October, a group of MTU Human Factors students toured the BOSS SnowPlow headquarters and plant in Iron Mountain, MI. BOSS is a leader in the snow and ice management business with a growing product line and increased development of human-centered processes and equipment.

Katrina Carlson, a graduate student in the Applied Cognitive Science and Human Factors program, organized the trip for the department after completing a summer internship at BOSS. Students toured the BOSS plant, Product Development Lab, and Virtual Reality facilities to learn about the role of human factors in consumer product design as well as production technique and quality assurance.

HFES MTU Chapter Meeting

Come join us for our first HFES (Human Factors and Ergonomics Society) MTU Chapter meeting on November 9 at 6:00 p.m.. We will be meeting via Zoom and discussing opportunities with the club for Spring semester. We will have links to both our InvolvementLink and Discord to keep you up to date on all the club activities!

Reach out to Brandon Woolman (BrWoolma@mtu.edu) for a link or questions.

A close-up of a logo

Description automatically generated

ACSHF Forum: Cosmas John Kathumba

The Department of Cognitive and Learning Sciences will host Cosmas John Kathumba from Rhodes University at the next Applied Cognitive Science and Human Factors forum.

The presentation will be from 2:00 to 3:00 p.m. (EST) Monday October 30 via Zoom from Grahamstown, South Africa.

Title: Promoting and investigatin the pre-service teachers’ computational thinking practical development in the physical sciences methods course. 

Abstract:
Computational thinking (CT)’s recognition as a fundamental skill alongside writing, reading and arithmetic (Wing, 2006) has influenced researchers and educators to infuse it in other disciplines such as science, technology, engineering, and mathematics (STEM) apart from computer science to promote instruction and problem-solving competencies. CT is a skill set required for all humans to navigate and survive in the 21st century. However, a framework is scarce to help science teachers at the secondary school level in South Africa to practically develop CT skills. Thus, it is necessary to inititate intervention to work with teachers to develop CT practically. It is against this backdrop that this intervention study seeks to explore how pre-service physical sciences teachers develop CT in the physical sciences methods course. The main research question of this proposed study is “How do the physical sciences methods course infused with computational thinking concepts influence or not pre-service teachers’ practical development of computational thinking?” This proposed study is underpinned by the Lev Vygotsky’s social-cultural theory (SCT). Further, this study will use a transformative mixed methods design and will be guided by a “Code, Connect, Create” (3C) professional development model. The study will be carried out within the Education Faculty at Rhodes University with the postgraduate certificate in education (PGCE) students during the physical sciences methods course. This proposed study will be carried out in two stages. In the first stage, pre-service teachers will be assessed on their prior understanding of CT skills before they start learning the actual content of the physical sciences methods course; in the second stage, they will be introduced to different strategies for teaching physical sciences that infuse CT skills. Data will be generated through pre-questionnaire and post-questionnaire, post-intervention interviews, peer and self-assessment, and journal reflections. A mixed method of data analysis will be employed. 

ACSHF Forum: Chikondi Sepula & Blessings Hwaca

The Department of Cognitive and Learning Sciences will host Chikondi Sepula & Blessings Hwaca from Rhodes University at the next Applied Cognitive Science and Human Factors forum.

There will be two presentations from 2:00 to 3:00 p.m. Monday October 16 via Zoom from Grahamstown, South Africa.

Title: Exploring the Development of Computational Thinking Skills among Pre-Service Teachers through Visual Programming: An Interventionist Case Study
Abstract:
Due to its profound cognitive effect on learners, computational thinking (CT) has gained significant attention and has been increasingly integrated into primary and secondary education worldwide. The integration of CT into educational curricula offers several benefits, including improved learning outcomes, enhanced problem-solving abilities, and the development of skills necessary for the digital landscape of the 21st century. Reflecting this global trend, South Africa introduced CT in primary schools through a dedicated subject called “coding and robotics” in 2023. However, as cited in other contexts, teacher upskilling is a primary challenge faced in successfully integrating CT in South Africa. Many teachers lack the necessary skills to effectively teach this new subject. Recognizing this gap, I was motivated to explore the development of CT skills with pre-service teachers using visual programming. This study will be underpinned by the social-cultural theory (SCT) of Lev Vygotsky. Informed by this theory, the intervention will be guided by a professional development (PD) model called “Code, Connect, Create” and a pedagogical model known as “Use, Modify, Create”. The study will be carried out within the Education Department at Rhodes University. All first-year pre-service teachers who are willing to participate from within the department will be included in the intervention. Data will be collected through the CT Reflective tools, semi-structured interviews, focus-group discussions, and reflective journals. The CT framework proposed by Brennan & Resnick (2012) will be used as a lens to facilitate and assess CT development among the pre-service teachers as a result of the intervention. An evaluative interpretivist case study methodology will be employed in this study, as it allows the detailing of contextual effects of the visual programming approach, as well as enabling and constraining factors that should be considered when developing CT with visual programming.

Title: Working with Secondary School Educators’ on the development of Computational Thinking through lesson planning

Abstract:
Computational Thinking (CT) is a cognitive skill that helps learners to think logically and creatively, becoming more popular as well as necessary at all levels of education globally. By introducing CT into curriculum design and lesson activities, educators together with their learners can benefit in many ways such as effective problem-solving, better learning outcomes, and more holistic preparation for the digital challenges of the 21st century. Two of the obstacles cited in South African STEM Education are the lack of skilled teachers and low interest of learners in the former, which warrants the need for more support and focus from different actors. Since CT is not only for STEM subjects but also for any discipline or challenge, thus educators who understand computational thinking can help students use their skills in different situations and contexts and encourage them to think logically and systematically. As a scholar, I am inspired to investigate how we can promote the development of CT during lesson planning by selected secondary school educators. The intervention study will be carried out with ten educators in Makhanda, Eastern Cape province. The Pattern Recognition, Abstraction, Decomposition, and Algorithms (PRADA) and Vygotsky Social Cultural theory will be used as theoretical frameworks. The data will be collected through Workshops, Journal reflection, Interviews, and Focus Group discussions.

ACSHF Forum: Leanne Jensen

The Department of Cognitive and Learning Sciences will host Leanne Jensen, PhD at the next Applied Cognitive Science and Human Factors forum Monday October 2 in Meese 109, from 2:00 p.m. to 3:00 p.m.

Leanne R. Jensen, PhD holds a prominent role in the aerospace industry as a member of The Boeing Company’s Technical Fellowship, focusing on Human Performance Technology and human factors engineering.  Her work has led to several invention awards related to human reliability and productivity, including a patent-pending for a model-based systems engineering approach to advanced product quality planning, solidifying her reputation as an innovative thought leader.  Her expertise in developing and implementing human-centric solutions has enabled organizations to achieve higher levels of safety, productivity, quality, and operational excellence.    

Leanne’s educational journey reflects her dedication to acquiring a diverse skill set that spans technical, instructional, and performance improvement disciplines. She holds an Associate degree in Machine Design (MTU), a Bachelor of Science degree in Mechanical Engineering Technology (MTU), a Master of Science degree in Instructional Design Technology (Walden University), and a PhD in Education, specializing in Training and Performance Improvement (Capella University). This diverse educational foundation has enabled Leanne to approach her work with a holistic perspective, integrating technical and instructional principles to drive performance excellence.

Abstract: 

In an era marked by unprecedented technological advancements, the concept of Human Digital Twins has emerged as a revolutionary paradigm with profound implications for healthcare, industry, and society at large.  Rooted in the field of digital modeling and simulation, Human Digital Twins rely on data acquisition, machine learning, sensor technology, and mathematics to digitally represent an individual’s characteristics and behaviors in a digital form.   From optimizing ergonomics and user experience to fine-tuning manufacturing processes through predictive analytics, these digital counterparts will revolutionize design, prototyping, and testing across industry.  The world of Human Digital Twins promises to expand horizons and inspire innovative thinking for the next generation of engineers, setting the stage for a future where personalized, data-driven solutions redefine our approach to design.  Explore more about the concept of Human Digital Twins are and how they can drive innovation and excellence in product development.

ACSHF Grad student graduations – Summer 23

We would like to congratulate some newly graduated PhD and MS students from the ACSHF program as of this summer:

Isaac Flint, PhD
Nishat Alam, MS
Anne Linja, PhD

Well done all!

Titles and abstracts for each can be found below:

Isaac Flint
Title:The Impact of Cognitive Ability and Age on Movement Corrections: An Exploration of the Neurocognitive and Physiological Contributors to Optimal Feedback Control

Abstract: Making successful movement corrections is an important part of navigating dynamic environments where unexpected obstructions can occur. Failure to engage in successful movement corrections can result in injury and, in some cases, death. One theory used to explain people’s ability to make movement corrections is the optimal feedback control theory, which follows the minimal intervention principle. Experiment 1 shows older adults are as likely as young adults to choose hand paths that require the least effort following a visual perturbation; however, they also commit more collisions and have slower movement speeds. Regression analyses show that success rates and movement times on the obstacle avoidance task are related to individuals’ measures of executive control and processing speed. P3b components, often associated with executive control, were elicited following medium and large cursor jumps. These ERP responses were different between the two conditions for young adults; however, they were not different for older adults. Experiment 2 shows young adults’ performance on obstacle avoidance tasks aligned with what would be predicted according to the minimal intervention principle, regardless of if responding to haptic/proprioceptive or visual feedback. The modality of the perturbation did have an impact on performance when the optimal path was ambiguous. The P3bs observed in Experiment 2 were also affected by the difference in the modality of feedback. When these findings are evaluated with the experiment’s other findings showing 1) greater P3b related activity for collision trials than non-collision trials, 2) very little differences between P3bs from trials with inward and outward movement corrections, and 3) EMG indicators of movement correction onset occur before the P3b peak, it suggests that the neural activity observed in this study has more to do with monitoring the movement corrections than path selection. The regression models from Experiment 2 also show the top-down processing of visual feedback is associated with a greater number of cognitive variables; yet some level of executive control is still associated with participants; tendency to make optimal reaching movements following physical perturbations.

Nishat Alam
Title: Types of Questions Teachers Ask to Engage Students in Making Sense of a Student Contribution

Abstract: In the student-centered classroom, a teacher’s interpretation and response to student mathematical contributions plays an important role to shape and direct students’ opportunities for sense-making. This research used a scenario-based survey questionnaire to examine what types
of questions middle and high school mathematics teachers indicate they would ask to engage
students in making sense of a high-leverage student mathematical contribution and their
reasoning about why particular questions are or are not productive. From the results, it could be
concluded that teachers asked more productive questions after seeing a set of possible questions.
Their beliefs about the productivity of the questions related to a variety of factors, including the
specificity of the question, student participation, student ability and whether incorrect solutions
should be discussed. The results could inform future work with teachers to productively use
student thinking in their teaching.

Anne Linja
Title:
EXPLICIT RULE LEARNING : A COGNITIVE TUTORIAL METHOD TO TRAIN
USERS OF ARTIFICIAL INTELLIGENCE/MACHINE LEARNING SYSTEMS

Abstract:
Today’s intelligent software systems, such as Artificial Intelligence/Machine Learning systems, are sophisticated, complicated, sometimes complex systems. In order to effectively interact with these systems, novice users need to have a certain level of understanding. An awareness of a system’s underlying principles, rationale, logic, and goals can enhance the synergistic human-machine interaction. It also benefits the user to know when they can trust the systems’ output, and to discern boundary conditions that might change the output. The purpose of this research is to empirically test the viability of a Cognitive Tutorial approach, called Explicit Rule Learning. Several approaches have been used to train humans in intelligent software systems; one of them is exemplar-based training. Although there has been some success, depending on the structure of the system, there are limitations to exemplars, which oftentimes are post hoc and case-based. Explicit Rule Learning is a global and rule-based training method that incorporates exemplars, but goes beyond specific cases. It provides learners with rich, robust mental models and the ability to transfer the learned skills to novel, previously unencountered situations. Learners are given verbalizable, probabilistic if…then statements, supplemented with exemplars. This is followed up with a series of practice problems, to which learners respond and receive immediate feedback on their correctness. The expectation is that this method will result in a refined representation of the system’s underlying principles, and a richer and more robust mental model that will enable the learner to simulate future states. Preliminary research helped to evaluate and refine Explicit Rule Learning. The final study in this research applied Explicit Rule Learning to a more real-world system, autonomous driving. The mixed-method within-subject study used a more naturalistic environment. Participants were given training material using the Explicit Rule Learning method and were subsequently tested on their ability to predict the autonomous vehicle’s actions. The results indicate that the participants trained with the Explicit Rule Learning method were more proficient at predicting the autonomous vehicle’s actions. These results, together with the results of preceding studies indicate that Explicit Rule Learning is an effective method to accelerate the proficiency of learners of intelligent software systems. Explicit Rule Learning is a low-cost training intervention that can be adapted to many intelligent software systems, including the many types of AI/ML systems in today’s world.

ACSHF Forum: Grad Student Presentations

The Department of Cognitive and Learning Sciences will host two speakers at the next Applied Cognitive Science and Human Factors forum: Tauseef Ibne Mamun and Erin Matas, both ACSHF graduate students. Their presentations will be from 2:00 to 3:00 p.m. Monday (April 17) in Meese 109 and via Zoom.

Mamun will present  “The Use of Social Forums to Train Users about Shortcomings of Tesla Full Self-driving (FSD)

Abstract: In the past decade, consumer adoption of commercial semi-autonomous vehicles has increased, and along with it user concerns about shortcomings of these systems, especially regarding safety. Users often turn to social media forums to discuss these shortcomings, find workarounds, and confirm their experience is common. We suggest that these forums may provide some of the best training for users to understand the limitations of AI, as they are not controlled by the vendor who has a vested interest in hiding the limitations of their systems. In two laboratory experiments, we examined how information from Tesla FSD forums impact participants’ ability to detect and predict hazardous driving situations in simulated scenarios. Drivers who received the training were better at anticipating and recognizing dangerous driving conditions, suggesting that exposure to user-generated explanations of the shortcomings of the system may in fact improve safety and acceptance of the systems.

Matas will present “Practicum Project: Leadership Program Evaluation Using Cognitive Task Analysis (CTA)

Abstract: The Association of Research Libraries (ARL) Leadership Fellows Program is designed to prepare emerging library leaders for senior-level positions in research libraries and other types of organizations. Erin Matas is a 2021-2022 cohort Fellow. For her ACSHF practicum project, Erin used Cognitive Task Analysis (CTA) methods to identify areas where improvement is needed for the leadership program’s training and development. The Leadership Fellows program has a year-long curriculum that targets different learning topics each month. Using human factors methods, Erin analyzed challenges in the Fellows’ current jobs and compared them with the topics covered in the program to determine if there are any training gaps. Erin interviewed 7 Fellows using CTA to identify cognitively complex aspects of their work and systematically analyzed the data. She developed task diagrams from each interview, identified themes, and presents results in a concept map. To round out the project, Erin will deliver the concept map and an executive summary report of her findings and recommendations regarding training to the Director of the ARL Leadership Fellows Program. The Program Director will include the recommendations in the final assessment of the program for the year to the ARL executive leadership team. Did CTA techniques identify overlooked training topics, pinpoint where more support is needed, and/or reinforce the strength of the current curriculum? Find out on April 17th at the ACSHF Forum!

ACSHF Forum: Grad Student Presentations

The Department of Cognitive and Learning Sciences will host two speakers at the next Applied Cognitive Science and Human Factors forum: Katrina Carlson and Brittany Nelson, both ACSHF graduate students. Their presentations will be from 2:00 to 3:00 p.m. Monday (April 3) in Meese 109 and via Zoom.

Carlson will present ” Engineering Self-efficacy and Spatial Skills: A two-part study”

Abstract:

The research team behind previous work on the increased academic and retention outcomes of students who have taken a Spatial Visualization Intervention course at MTU postulates that affective changes within the students as a result of the course may be responsible for downstream academic success. One possible explanation may be related to the students’ confidence in their ability (self-efficacy) to gain the skills needed to become an engineer.  Extensive research has been conducted on self-efficacy, and academic self-efficacy has been shown to be significantly correlated with academic performance.

The first part of this study examines the general and engineering self-efficacy of students at the beginning and end of the Spatial Skills Intervention course, Spring 2023 (N= 9), and compares these to students at the beginning and end of a first year engineering class. One hundred sixty-eight students completed general and engineering self-efficacy surveys. The General Self-Efficacy Scale was used; this tool was developed from longer scales and was found to be a reliable and valid measure of overall self-efficacy and not a specific skill area.  The Assessment of Engineering Self-Efficacy V3.0 for undergraduate engineering students  was also used. Items on this measure are related to predictions of future academic ability and their sense of belonging in engineering and STEM classes.

The second part of this study will examine students’ visual and spatial perception, memory, and skills through a battery of tasks using the PEBL Platform.  Previous research has examined the development of spatial skills and the resulting increase in problem-solving skills across domains that require spatial reasoning.  Research has also been conducted to examine whether spatial visualization, the ability to mentally maneuver 2D and 3D objects, is a single ability or is composed of more than one skill or ability. Participants (N=80) will include both Intro to Psychology students, who will also take the Purdue Spatial Visualization Test with Rotations (PSVT:R) as a part of this battery, and first year engineering students.This part of the study will examine the relationships between students’ visual and spatial skills, drawing skills (engineering students only), and their PSVT:R scores and seeks to examine a possible taxonomy of spatial skills.  This battery may serve as a reliable and valid assessment in the future of student skills at the high school and/or college level to indicate a need for additional instruction and practice of skills. There may be applications of these findings in other fields and for other purposes, such as geography, computing education, and military use.

Nelson will present “Title: Preliminary Evaluation for an Educational Intervention: Insights from a Usability Survey”

Abstract: 

Increasing whole grain intake can reduce the risk of chronic health conditions such as cancer and heart disease. However, people continue to make poor dietary health decisions, and the life expectancy for Americans is declining. Therefore, a novel intervention is needed to boost informed dietary decision-making. This study aimed to (1) provide preliminary evidence on the effectiveness, enjoyment, and efficiency of a novel intervention and (2) identify practices for making scientific information more usable. The study used a self-report online survey. Qualitative and quantitative data were collected to test the effectiveness, enjoyment, and efficiency of the educational intervention and how to improve it. Results suggest that the intervention is effective at increasing informed preventative decision-making. One hundred percent of participants showed adequate gist understanding across the four knowledge domains: habit gist understanding, whole-grain gist understanding, gist understanding of benefits, and gist understanding of susceptibility and severity. The results also revealed several strategies for increasing the usability of other educational interventions for a student sample demographic: increase/incorporate graphs, data, and references to increase the trustworthiness of an intervention. These results suggest that an educational video intervention effectively increases informed decision-making for preventative behaviors. These findings are also valuable for future intervention development and testing, making this proposal the next step for preventative care.

ACSHF Forum: Grad Student Presentations

The Department of Cognitive and Learning Sciences will host two speakers at the next Applied Cognitive Science and Human Factors forum: Nishat Alam and Anne Inger Mørtvedt, both ACSHF graduate students. Their presentations will be from 2:00 to 3:00 p.m. Monday (March 27) in Meese 109 and via Zoom.

Alam will present “Types of Questions Teachers Ask to Engage Students in Making Sense of a Student Contribution.”

Abstract:

In the student center classroom, where teachers constantly make decisions based on what is happening surrounding them, what they are noticing, and how they are interpreting student contributions, a teacher’s interpretation and response to student mathematical contributions plays an important role to shape and direct students’ thinking. In particular, failing to ask productive questions that help students to engage in a sense-making discussion could deteriorate cognitive opportunities. This research is planning to study what types of questions teachers indicate they would ask to engage students in making sense of a high-leverage student mathematical contribution, what Leatham et al. (2015) refer to as a MOST (Mathematically Significant Pedagogical Opportunities to Build on Student Thinking) and their reasoning about why particular questions are or are not productive. In this study, a scenario-based survey questionnaire will be sent via email to 100 middle and high school teachers. In the given scenario, a MOST has surfaced, and teachers will be asked three questions about how they would respond in the scenario. This research could lead us to determine if teachers are selecting the questions which are likely to be productive in supporting students’ mathematical thinking and why they select the questions that they do. Knowing this will inform future work with teachers to productively use student thinking in their teaching.

Mørtvedt will present “Relationship between Program Usability Characteristics and Intention to Use: Preliminary Data Implementing a Sport Injury Prevention Program.”

Abstract:

Adherence to exercise programs is low across multiple populations. For example, within the target population for ACL injuries, only ~4-20 % of sports teams have implemented evidence based injury prevention programs. This study explored the relationship between usability characteristics and implementation likelihood for a newly developed ACL injury prevention program. Twenty-two female handball players, aged 16 to 18, participated in the intervention study. Data on usability characteristics was collected through a modified usability scale similar to the System Usability Scale. Subcomponents of the usability scale included
learnability, perceived effectiveness, ease of use, enjoyability and efficiency. Paired sample’s t-test revealed a significant difference between all constructs from pre to post intervention, except for the perceived effectiveness score. Enjoyability and efficiency were the constructs that changed the most, both scores going down post intervention. Perceived effectiveness, enjoyability and efficiency were significantly correlated with intention to use the program (rho 0.50, p = 0.02, rho 0.50, p= 0.02, rho 0.65, p < 0.001, respectively), indicating that program adherence is affected by whether they believe the program will work (e.g. reduce injuries),
whether they enjoy performing the program and whether they find it reasonable with regard to time use. We did not find any significant relationships between the two other subcomponents (e.g. learnability, ease of use) and intention to use. This preliminary data suggests that program designers may want to make sure participants understand why it is important to perform the program, in addition to developing an exercise program that they seem to enjoy performing and find worth their time. Future studies should capture more data on the usability scale/subscales to ensure the factor structure is consistent and items display appropriate psychometric properties.

Bettin paper in SIGCSE 2023 Proceedings

Briana Bettin’s (CLS/CS) paper, “Challenges, Choice, & Change: Experiences and Reflections from the First Semester of a Technology and Human Futures Course,” was recently published in the SIGCSE 2023 Proceedings of the 54th ACM Technical Symposium, March 2023.  

The paper explores survey responses from graduate students who completed Bettin’s newly designed course, “Reimagining Technofuturism” during spring 2022. The course explored facets of human identity and societal systems in order to understand technology’s role, how technology impacts our human futures and how we might design differently in order to arrive at future technologies that better center human identities and futures.

In the paper Bettin discusses the general design of the course as well as literature background that suggests courses like this are novel but growing in presence nationwide. In addition to the overall value of the course—exploring how design choices, emphasizing computing technology design, impact society and the ways identity can alter those impacts for individuals and groups.

The paper contains student quotes that Bettin pulled together with a narrative thread. Bettin closed the paper with her own quote as she reflected on the outcomes of the course:

“I expected some level of general interest and engagement, but marvel at how much the students consistently exceeded my expectations. From diverse discussion examples to a breadth of project directions—the students not only grappled with the complex and vast space, but seemed to enjoy “tackling” such depth in some meaningful way.”

The ACM Technical Symposium is SIGCSE’s flagship conference. It has been held annually in the United States since 1970. This year, for the first time, the conference is being held in Toronto, Canada, March 15-18, 2023.

Briana Bettin is an assistant professor in the departments of computer science and cognitive and learning sciences (psychology and human factors). She received her master’s in human-computer interaction from Iowa State University and her bachelor’s and PhD in computer science from Michigan Tech. Her research work broadly centers computing education with focus on human interests, impacts, and learning within our increasingly technological society. Her goal is to help us all learn to better live with, work with, (re)imagine with, and be represented equitably within the increasingly digital landscape of our world.

Related story: Q&A with Teaching Award Winner Briana Bettin