Live Sketch
AI and User-generated AR storytelling
Category
UI Motion Design
UX Design
Date
2020
Role
UX Design (student)
Overview
Live Sketch was a project created for a Snapchat-sponsored studio course at ArtCenter College of Design. This app explores how the camera and machine vision models can interpret a simple human input and context to author unexpected AR content.
Users draw simple 2D sketches on the real-time camera footage and Live Sketch will generate a unique 3D object based on 1. the sketch inference 2. the objects, spaces, and people recognized in the scene. The context-aware 3D object will dynamically update based on the camera view. Users can discover unique stories as they move the camera around.
Users can go live with their story or share their sketch with friends for them to edit and add onto.
Approach
I was apart of a three-person group exploring future applications combining AI, AR, and visual storytelling. My role was both UX prototyping and final motion user flow of the concept.
Special Thanks
A special thank you to our group mentors RAJAN VAISH, ANDRES MONROY-HERNANDEZ, SNAP INC RESEARCH, BBC RESEARCH, and MICROSOFT RESEARCH
Ian Sterling, 2023