- Sponsorship -

Students invited to demo their social skills app at Samsung conference


A smartphone app developed by Kent Career Tech Center students to help autistic teens navigate social situations will be showcased on a national stage in November.

Two students and their 3D Animation & Game Design  Instructor Marc Petz, are headed to the Samsung Developer Conference in San Francisco to show off a smartphone app they created to help autistic teens develop their social skills.

They were invited to attend the conference after an earlier edition of the app finished in the Top 10 at the national “Solve For Tomorrow” competition sponsored by Samsung earlier this year.  His students have now upgraded their Virtual Reality (VR) application into an Augmented Reality (AR) application that can be loaded into a smartphone.

Avatars simulate hallway encounters, coaching autistic teenagers through social encounters they might otherwise find awkward or uncomfortable

“This is 100 percent student developed and expert guided,” says Petz, who was invited to the conference with two of his 3D graduates. The group plans to demonstrate their app from Samsung’s booth at the conference, which attracts thousands of software developers.

Their AR app uses avatars to coach autistic teenagers as they role-play their interaction with other teenagers. The social scenarios, such as a having conversation in a school hallway, were scripted with help from Mary Musto, a teacher consultant at Kent Transition Center with a background in Autism and Behavioral Therapy.

Petz and his students also worked with YETi CGI, a Wyoming-based company that develops electronic games and artificial intelligence products for Fortune 500 companies. Petz also teaches digital animation and game design as an adjunct professor at Ferris State University.

The animated avatars – or characters –  coach their users to make eye contact and respond to questions or comments  from the avatars, who appear in the settings in which the users find themselves.

“We’re bringing the technology to your reality,” said Petz. The app uses recorded voices instead of machine-generated speech to make the interactions seem more natural.

The smartphone app developed by students at Kent Career Tech Center offers several scenarios that can be used as coaching tools by autistic teenagers

“We know this has the potential of reaching a lot of people,” said Keith Takens, a Ferris State University sophomore who helped develop the program while he attended the Tech Center.

Takens, one of the students going to the Samsung conference, noted that up to 2 percent of the world’s population has autism to some degree.

Meanwhile, Petz’ students are continuing to develop new role-playing scenarios to the app. For example, methods of starting, maintaining and ending conversations are being added to the app.

The app is based on a web site that connects to the app, forgoing the need to download the app to a smartphone.  “It’s as accessible as Wikipedia,” said Takens, noting the app does not require the bandwidth needed for other streaming services such as Netflix.

Connect

YouTube demonstration of the students’ app

SNN article: Tech Center’s 3D Autism Project a national finalist in Samsung ‘Solve for Tomorrow’ contest

 

- Sponsorship -
James Harger
James Harger
James Harger left School News Network in January of 2020. James previously reported on West Michigan's economy, courts and politics for The Grand Rapids Press and Mlive.com for more than 37 years. He also is employed as Servanthood Leader at Immanuel Lutheran Church in downtown Grand Rapids. A graduate of Central Michigan University, he also has worked for publications in Holland, Mount Pleasant and Lansing. He is married to Lisa and has one daughter, who lives in Ann Arbor.

LATEST ARTICLES

Longtime volunteer does whatever’s needed for school: ‘I love being here’

A 24-year parent and grandparent volunteer tends to student and family needs at Martin Luther King Jr. Leadership Academy...

Lessons from a pandemic: ‘agile learners’ need ‘agile adults’

Reflecting on the end of fall semester and 2020, Superintendent Dedrick Martin sat down with School News Network to discuss how Caledonia adapted to school closures, virtual learning and social distancing during the COVID-19 pandemic...

It’s all about getting students back to classrooms, Supt. Shibler says of the vaccine

Superintendent Michael Shibler hopes the more people get vaccinated, the closer we are to the end of the pandemic...

Young constitutional scholars view current events, politics through historical lens

East Grand Rapids and East Kentwood high school We the People team members have qualified for the national competition, becoming well versed in civics and critical thinking along the way...

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Related Articles

‘Hope on the horizon’ as local teachers start getting COVID-19 vaccine

Lincoln School special education teacher, Ann Post believes there is 'hope on the horizon' for Kent ISD teachers and educators across Kent County after receiving her first round of the COVID-19 vaccine...

Partnership continues focus on student emotional, mental health

A group is working to identify trauma and provide support early in order to increase student success...

A familiar face returns to lead Kent ISD

Retired Kent ISD Assistant Superintendent Ron Koehler officially took the helm as interim superintendent on Jan. 1...
- Sponsorship -

HOW'S SCHOOL TODAY?

Engagement: The Most Important Measure of Student Success

Polls find that students’ engagement in their school work declines as they ascend the grades. Tests that don’t relate to their real-life experiences exacerbate the problem...

RADEMACHER & FRIENDS

Food ‘angels’ support hungry kids through pandemic

They work all across Kent County, guardian angels with peanut butter on their hands and crumbs on their shirtsleeves...
- Sponsorship -

MEDIA PARTNERS

Maranda Where You LiveWGVU

SUSTAINING SPONSORS