Institute of Computing and Cybersystems (ICC) Blog

Category: HCC

Appropriating Everyday Surfaces for Tap Interaction

Published
By
Zachary Garavet and Siva Kakula

Researchers

Scott Kuhl (Associate Professor, CS)

Keith Vertanen (Assistant Professor, CS)

Sponsor: ECE Alumnus Paul Williams ’61

Amount of Support: $44,000

Duration of Support: 1 year

What if an everyday surface, like a table, could be transformed into a rich, interactive surface that can remotely operate things like computers, entertainment systems, and home appliances?

That’s what Michigan Tech Institute of Computing and Cybersystems (ICC) researchers Keith Vertanen and Scott Kuhl set out to do with a $44K seed grant from Electrical and Computer Engineering alumnus Paul Williams ’61.

Vertanen, assistant professor of computer science, and Kuhl, associate professor of computer science, are members of the ICC’s Center for Human-Centered Computing, which integrates art, people, design, technology, and human experience in the research of multiple areas of human-centered computing. They were assisted in this research by PhD candidate Siva Krishna Kakula, Computer Science, and undergraduate Zachary Garavet, Computer Engineering.

The team’s research goals were threefold: to create machine learning models that can precisely locate a user’s taps on a surface using only an array of inexpensive surface microphones; demonstrate the feasibility and precision of the models by developing a virtual keyboard interface on an ordinary wooden table; and conduct user studies to validate the system’s usability and performance.

The researchers are working on a related technical conference paper to present to their peers. Their outcomes included a prototype virtual keyboard that supports typing at rates comparable to a touchscreen device; possibly the first-ever acoustic sensing algorithm that infers a continuous two-dimensional tap location; and novel statistical models that quickly adapt to individual users and varied input surfaces.

Further, their results, hardware, and data sets can be applied to future collaborative work, and were used in the researchers’ $500K National Science Foundation proposal, “Text Interaction in Virtual and Augmented Environments,” which is under review.

Future applications of the research include enriched interactions in Virtual Reality (VR) and Augmented Reality (AR), compared to existing vision-only based sensing; and on-body interaction, like using your palm as an input surface.

Vertanen and Kuhl plan to continue this research, working to improve the accuracy of tap location inference, build richer interactions like swiping or tapping with multiple fingers, develop wireless sensor pods that can be quickly and easily deployed on any flat surface, and explore the display of virtual visual content on surfaces via Augmented Reality smartglasses.

View a video about this research at https://youtu.be/sF7aeXMfsIQ.

Seed grant donor Paul Williams is also the benefactor of the Paul and Susan Williams Center for Computer Systems Research, located on the fifth floor of the Electrical Energy Resources Center. The 10,000-square-foot, high-performance computing center—the home of the ICC—was established to foster close collaboration among researchers across multiple disciplines at Michigan Tech

The ICC, founded in 2015, promotes collaborative, cross-disciplinary research and learning experiences in the areas of cyber-physical systems, cybersecurity, data sciences, human-centered computing, and scalable architectures and systems. It provides faculty and students the opportunity to work across organizational boundaries to create an environment that mirrors contemporary technological innovation.

Five research centers comprise the ICC. The ICC’s 50 members, who represent 15 academic units at Michigan Tech, are collaborating to conduct impactful research, make valuable contributions in the field of computing, and solve problems of critical national importance.

Visit the ICC website at mtu.edu/icc. Contact the ICC at icc-contact@mtu.edu or 906-487-2518.

Download a summary of this research.

Continue Reading →

Kelly Steelman Selected HFES Science Policy Fellow

Published
By

Kelly Steelman (CLS) has been selected from a competitive pool of applicants to participate in the Human Factors and Ergonomics Society (HFES) Science Policy Fellowship program.

The HFES Science Policy Fellows (SPF) program provides a valuable opportunity for HFES members to learn how to successfully advocate for human factors and ergonomics on the national stage. SPF Participants will receive extensive training in public affairs, advocacy and outreach to be provided by Lewis-Burke Associates and the HFES Government Relations Committee during the HFES Annual Meeting. They will also participate in an annual spring Capitol Hill Day in Washington, D.C., including a Hill visit training session and a policy-related speaker prior to the visit day. They will be invited to attend monthly conference calls with Lewis-Burke and the HFES Government Relations Committee covering ongoing events and opportunities for HFES to engage in policy decisions.

Following an initial one-year term in the SPF program, each program graduate will commit to two years of service in an outreach capacity. They will create a customized plan that may include continued participation in the Capitol Hill day and interactions with policymakers in Washington, DC, working at the local/state level, serving on the GRC or a subcommittee, and other forms of outreach developed by each participant. HFES SPF participants and graduates will form the basis of a future brain trust with expertise in outreach creating a pipeline of politically engaged and knowledgeable members within HFES.

Continue Reading →

Williams Seed Grant Funds Virtual Keyboard Research

Published
By

Siva Krishna Kakula and Zachary GaravetBy Karen Johnson, ICC Communications Director

What if an everyday surface, like a table, could be transformed into a rich, interactive surface that can remotely operate things like computers, entertainment systems, and home appliances?

That’s what Michigan Tech Institute of Computing and Cybersystems (ICC) researchers Keith Vertanen and Scott Kuhl set out to do with a $44K seed grant from Electrical and Computer Engineering alumnus Paul Williams ’61.

Vertanen, assistant professor of computer science, and Kuhl, associate professor of computer science, are members of the ICC’s Center for Human-Centered Computing, which integrates art, people, design, technology, and human experience in the research of multiple areas of human-centered computing. They were assisted in this research by PhD candidate Siva Krishna Kakula, Computer Science, and undergraduate Zachary Garavet, Computer Engineering.

The team’s research goals were threefold: to create machine learning models that can precisely locate a user’s taps on a surface using only an array of inexpensive surface microphones; demonstrate the feasibility and precision of the models by developing a virtual keyboard interface on an ordinary wooden table; and conduct user studies to validate the system’s usability and performance.

The researchers are working on a related technical conference paper to present to their peers. Their outcomes included a prototype virtual keyboard that supports typing at rates comparable to a touchscreen device; possibly the first-ever acoustic sensing algorithm that infers a continuous two-dimensional tap location; and novel statistical models that quickly adapt to individual users and varied input surfaces.

Further, their results, hardware, and data sets can be applied to future collaborative work, and were used in the researchers’ $500K National Science Foundation proposal, “Text Interaction in Virtual and Augmented Environments,” which is under review.

Future applications of the research include enriched interactions in Virtual Reality (VR) and Augmented Reality (AR), compared to existing vision-only based sensing; and on-body interaction, like using your palm as an input surface.

Vertanen and Kuhl plan to continue this research, working to improve the accuracy of tap location inference, build richer interactions like swiping or tapping with multiple fingers, develop wireless sensor pods that can be quickly and easily deployed on any flat surface, and explore the display of virtual visual content on surfaces via Augmented Reality smartglasses.

View a video about this research at https://youtu.be/sF7aeXMfsIQ. Download a summary of the research from the ICC website at icc.mtu.edu/downloads.

Seed grant donor Paul Williams is also the benefactor of the Paul and Susan Williams Center for Computer Systems Research, located on the fifth floor of the Electrical Energy Resources Center. The 10,000-square-foot, high-performance computing center—the home of the ICC—was established to foster close collaboration among researchers across multiple disciplines at Michigan Tech

Continue Reading →

ICC Members Receive Achievement Awards at Annual Banquet

Published
By

Soner Onder, Bo Chen, Kevin TrewarthaAt the annual awards banquet of the Michigan Tech Institute of Computing and Cybersysytems (ICC), on Friday, April 12, three ICC members received the ICC Achievement Award in recognition of their exceptional contributions to research and learning in the fields of computing.

Soner Önder, director of the ICC Center for Scalable Architectures and Systems and professor of computer science, was recognized for his research in next-generation architectures. Önder is principal investigator of three National Science Foundation (NSF) grants, and he has three NSF grant proposals under review.

“Soner is one of our very top researchers in terms of research expenditures and new awards,” said Tim Havens, ICC director and the William and Gloria Jackson Associate Professor of Computer Systems. “He is also active in developing and implementing the ICC vision and activities.”

Kevin Trewartha, a member of the ICC’s Center for Human-Centered Computing, was recognized for his interdisciplinary and collaborative research at the intersection of technology and human motor movement. Trewartha is an assistant professor with a dual appointment in the departments of Cognitive and Learning Sciences and Kinesiology and Integrative Physiology.

“Kevin encompasses the best of the ICC vision,” said Beth Veinott, director of the ICC Center for Human-Centered Computing and associate professor of cognitive and learning sciences.

Trewartha is co-principal investigator, with ICC member Shane Mueller, of a new, three-year, interdisciplinary and collaborative project funded by the National Institutes of Health. For this research, Trewartha and Mueller are working with UP Health Systems Portage and five graduate and three undergraduate students to investigate how technology supports earlier diagnosis of the neurodegenerative diseases.

Bo Chen, a member of the ICC’s Center for Cyber-Physical Systems and assistant professor of computer science, was recognized for his teaching and research in cybersecurity of mobile devices.

Chen is the co-PI of two external grants on cybersecurity from the National Science Administration, and he has submitted numerous cybersecurity proposals to NSF, NSA, Microsoft, and Google.

“Dr. Bo Chen has demonstrated achievements and contributions to the mission of the ICC since coming to Michigan Tech as a tenure-track CS faculty in fall ’17,” said ICC members Guy Hembroff and Yu Cai in their nomination, adding that during that short time, “Dr. Chen has published one book, five journal papers, and 10 conference papers, and in 2017 he was awarded a Distinguished Paper Award from the prestigious cybersecurity venue, the Annual Computer Security Application Conference (ACSAC ’17).”

Chen is the faculty coach for the MTU NCL (National Cyber League) cyber competition team, and during the fall 2018 regular season under Chen’s leadership, a Michigan Tech CS undergraduate student placed 36th out of 3,350 players in NCL cyber competition. Dr. Chen was also recently recognized for receiving an exceptional “average of seven dimensions” student evaluation score for his teaching, among additional accolades.

The ICC, founded in 2015, promotes collaborative, cross-disciplinary research and learning experiences in the areas of cyber-physical systems, cybersecurity, data sciences, human-centered computing, and scalable architectures and systems. It provides faculty and students the opportunity to work across organizational boundaries to create an environment that mirrors contemporary technological innovation.

Five research centers comprise the ICC. The ICC’s 50 members, who represent 15 academic units at Michigan Tech, are collaborating to conduct impactful research, make valuable contributions in the field of computing, and solve problems of critical national importance.

Visit the ICC website at icc.mtu.edu. Contact the ICC at icc-contact@mtu.edu or 906-487-2518.

Continue Reading →

2017 ICC Achievement Awards Presented at ICC Annual Retreat

Published
By

ICC Annual Retreat was held on April 21. Co-Director Dan Fuhrmann presented ICC Achievement Awards to two researchers for their outstanding research and honorable contributions to the ICC in 2017. Zhuo Feng from the Center for Scalable Architectures and Systems (SAS) and Shane Mueller from the Center for Human-Centered Computing (HCC) were this year’s recipients.

Shane Mueller is Associate Professor in the Department of Cognitive and Learning Sciences with an expertise in Cognitive and Computational Modeling. He has recently been awardedDARPA’s Explainable AI (XAI) Grant to develop naturalistic theories of explanation with AI systems and to develop a computational cognitive model of explanatory reasoning.  In addition to this effort, he has served as Co-PI of  several proposals in collaboration with other HCC members from the KIP, CS, and Math departments. He has continuously published his works in top journals and conferences, such as IEEE and Cognitive Modeling Communities and organized several conferences. Another significant achievement is developing PEBL: The Free Psychology Experiment Building Language for HCI and Psychology Researchers, which is widely used across the world. Zhuo Feng is Associate Professor in the Department of Electrical and Computer Engineering. Zhuo has received funding as the sole PI on three National Science Foundation (NSF) grants since 2014 with a total of $1.1 million. He received a Faculty Early Career Development (CAREER) Award from NSF in 2014, a Best Paper Award from ACM/IEEE Design Automation Conference (DAC) in 2013, and two Best Paper AwardNominations from IEEE/ACM International Conference on Computer-Aided Design (ICCAD) in 2006 and 2008. His publications include 16 journal papers (14 IEEE/ACM Transactions) and 34 ACM/IEEE conference papers.

Continue Reading →

HCC Center Director’s Lab Featured in the ACM Magazine, Interactions

Published
By

The ACM magazine, Interactions, is featuring HCC Center Director, Philart Jeon’s, Mind Music Machine (tri-M) Lab this month. The Tri-M Lab is a transdisciplinary research group based in the departments of Cognitive Science and Computer Science at Michigan Tech. The research goal of the lab is understanding the mechanisms of the human mind and designing better interactions between people and technologies. Researchers utilize various instruments, including computer vision technologies, display wall, digital audio workstation, driving simulators, neurophysiological equipment, and robots. To learn more visit ACM’s Interactions.

Continue Reading →