featured projects:   CovidID  Seeing Eye Drone    blindBike    SCD    iSight   iVest   ULearn

ULearn

ULearn watches students as they learn via web-based material and with Computer Vision and Machine Learning techniques detect when the user is Frustrated and subsequently provide semantically related alternative content. The user can browser using the ULearn app on any website. The forward facing camera on the mobile device monitors the user, performing face detection and then emotion detection using a Convolutional Neural Network trained on a set of emotions. If any of a set of emotions related to frustration is detected the currently viewed website is analyzed using Google's NLP analaysis cloud service and the informaiton is used to perform a search for simlar content. These similar webpages are presented as "tips" to the user that they can choose to explore.