LeapCode

Built at a hackathon, LeapCode enables users with limited mobility to control a game entirely through facial expressions. FaceMesh tracks facial landmarks in real-time, mapping them to game inputs with normalization for varying lighting and distances.

• ▸Accomplished hands-free game control via facial expressions by building a FaceMesh-to-input mapping algorithm with distance/lighting normalization enabling accessible gameplay for users with limited mobility.
• ▸Architected a low-latency state management system that bridged the Next.js virtual DOM with direct jQuery interactions, minimizing re-renders for smooth gameplay.