One model for dense correspondence across all 25 ordered pairs of RGB, event, thermal, depth and LiDAR.
Research
My research aims to close the loop between multimodal perception and action. I want to build robots that perceive the world through multiple modalities (e.g., vision, touch, and inertial sensing), that estimate their own epistemic uncertainty, and that act to reduce this uncertainty while carrying out their tasks.
Publications
A Soft Actor-Critic policy steers a constant-thrust spacecraft across a multi-revolution orbit transfer while minimizing flight time.
Projects
I led the monocular 3D mapping and target localization system that reports each casualty's GPS position to first responders, live, from EO and IR drone imagery.
A drone inspection product I worked on end to end. I built the stitching pipeline that localizes every blade defect in 3D on one stitched blade, letting human inspectors review the data offsite 7× faster; the matching work behind it placed 7th of 642 teams at the CVPR 2022 Image Matching Challenge and won a gold medal in 2023.
Experience
- Graduate Research Assistant, AirLab, Carnegie Mellon University
- Machine Learning Researcher, The Boeing Company
- Machine Learning Engineer, Nearthlab
- Aerospace Engineer, Nearthlab
- Research Assistant, ASCL, KAIST
Education
- M.S. Robotics, Carnegie Mellon University
- B.S. / M.S. Aerospace Engineering, KAIST