Google Colab: AI Co-pilot Socio-emotional Training System for Autistic Children

LOCATION ADDRESS (Hybrid in person and zoom)
In-person at Maker Nexus
1330 Orleans Dr, Sunnyvale, CA 94089
Seats are limited

To be announced:
Online on Zoom
https://acm-org.zoom.us/j/93606604841?pwd=htaOk50UxEMFUp32yky2ZyTabJwmDu.1
On YouTube:
https://youtube.com/live/sIDoZZxpnH0?feature=share

AGENDA
3:00 Door opens, registration at the front desk. No food or drinks provided. Bring your own water bottle, cups or mugs.
3:15 SFBayACM upcoming events, speaker introduction
3:30 Presentation starts
4:30 – 5:00 Maker Nexus lab tours, timing depends on Q&A

TALK DESCRIPTION
Key Topics: Google MediaPipe, FaceLandmark, Neurodivergent, Face BlendShape.

Abstract:
Through demonstration of the latest computer vision technologies in Google Colab, Claire will introduce her AI co-pilot socio-emotional training system for autistic children and demonstrate the system with a random volunteer attendee. See this 2 minutes video: https://www.youtube.com/watch?v=jkybghoqCD4

One in 36 children are diagnosed with autism spectrum disorder. Some key symptoms and supporting neuroscience are: lack of emotion interpretation (amygdala theory), not showing sign of acknowledgement (impaired mirror neuron system), and eyes not focusing on the priority area (relevance detector theory). Claire designed the HarmonyVisage system, a neuroscience-based AI co-pilot training system that tailors to autistic children’s individual preferences (subgroups) and unique facial features. The blendshape analyzer offers real time feedback on socio-emotional cues and reciprocal eye engagement, and explains emotions using 13 measurable facial features. 4 phases of experiments were conducted with a total of 46 participants. Each participant went through 8-week training. 3 out of the 4 subgroups demonstrated statistically significant improvement with p-values 0.027, 0.001, and 0.001 respectively. HarmonyVisage may be used at home for daily training and in therapy clinics to assist therapist accurate assessment. In a world transformed by AI, HarmonyVisage is bridging the gap between perspectives and contributing to an inclusive and harmonic society.

This lecture is suitable for neuron scientists, therapists, AI developers, ASD parents and community. The impactful innovation has social benefit than just technical coding. You can post your questions online and/or leave your email address to Humphrey@SFBayACM.org, title your comment as “Maker Nexus 9/28/2023 event: (Comment, next action plan, cosponsor, partner)” Please select one word above in your email header for easy reading.

SPEAKER BIO:
Claire Xu, Student, The Harker School, is a strong advocate for transforming research innovations into tangible solutions for real-world challenges. Claire exemplifies a commitment to driving positive change through her endeavors. One of Claire’s notable projects involves pioneering a groundbreaking system aimed at training socio-emotional skills in autistic children using computer vision. Her research yielded compelling results with participants from 15 cities of 4 countries. Three out of four participant subtypes demonstrated statistically significant improvement – a testament to her innovative approach and dedication to addressing pressing societal needs. In another remarkable venture, Claire and her partner innovated sustainable fashion by developing vegan leather from 100% biodegradable materials. Her efforts earned her recognition, including the National 2nd Place of Engineering at the 2023 Thermo Fisher Scientific Junior Innovators Challenge, as well as being named the National Top 30 Finalists. Additionally, Claire was honored with the Most Promising Young Scientist Award. Driven by her passion for knowledge-sharing and collaboration, Claire is eager to engage with like-minded researchers and enthusiasts to amplify the impact of research innovations.
http://svyoungscholars.org/