I lead an applied research organization developing 3D Computer Vision algorithms for Vision Pro. I'm intersted in AR/VR, object detection and tracking, 6DoF pose estimation, hand tracking, generative models, computer graphics, depth estimation, and synthetic data.
Previously, I worked on Computer Vision and Machine Learning projects across Silicon Valley startups. I created two open source projects that reached tens of thousands of users. Prior to that, I founded a venture-backed social media startup, participating in 500Startups and Facebook's fbFund programs. I also served on the board of Hacker Dojo, a non-profit technology community center in Mountain View.
While my current work at Apple (2018-present) is confidential, below are some selected projects from my prior experience:
An implementation of Mask RCNN on Keras and TensorFlow. I built this during my work at Matterport and they graciously agreed to open source it. Since its release in November 2017, it has become one of the top instance segmentation models on TensorFlow and was used by thousands of developers in applications ranging from Kaggle competitions to Ph.D theses.
Like TensorBoard, but simpler and runs directly in Jupyter notebook. It was adopted by Microsoft as one of the building blocks of their TensorWatch tool. Supports PyTorch, TensorFlow, and Keras.
To clean up my own development environment, I built a Docker container that includes recent versions of the top deep learning tools. Getting everything to work smoothly took a bit of work, so I shared it publicly on Docker Hub for others to use. It's currently the #1 container and most starred on DockerHub when you search for deep learning containers.
I occasionally talk about deep learning at local events. This is a talk I did for ACM (Association for Computing Machinery) about using TensorFlow to recognize traffic signs.
A question I kept getting about my Mask RCNN implementation was: how do I use it with my own dataset? So I built a toy example and documented the whole process, including manually annotating a small dataset from scratch. The restul was an article and code to automatically apply a color splash effect on images of balloons (i.e. convert the image to grayscale except for balloons, which stay colored).