YiChang Shih
施易昌
Senior Staff Software Engineer, TLM
yichangshih at gmail dot com
Curriculum Vitae | Google Scholar | LinkedIn
I lead a team to build on-device Gen-AI and Machine Learning solutions for the Google Pixel Camera series. We deliver end-to-end solutions across engineering and research boundary. See more info in the C.V..
I enjoy working with interns. Please contact me if you are interested in internship. I have been lucky to work with the following interns so far:
-
Kai-En Lin: from UCSD, on Object NeRF (2021)
-
Chen Gao: from Virginia Tech, on Portrait NeRF (2020)
-
Zixun Yu: from Purdue, on portrait image enhancement (2019)
-
Wei-Shang Lai: from UC Merced, on wide-angle portrait distortion correction (2018)
Public Talks:
3/1/2023: Stanford SCIEN seminar: Mobile Computational Photography with Ultrawide and Telephoto Lens.
Short Bio
Before Google, I was a Research Scientist at LightCo, where we launched the very first (and super cool) L16 camera (Verge).
I received my Ph.D. from MIT CSAIL in 2015, advised by Frédo Durand and Bill Freeman on Computer Vision, and Computer Graphics, and Computational Photography. My PhD research was about data-driven graphics. By leveraging repetitive visual-information and high quality examplars, my thesis explores advanced image editing algorithms. I've worked on hardware devices for imaging and enhancement during my master in MIT.
During internship, I had great intern opportunities to work with Jon Barron and Marc Levoy (Google[x], 2014), Sylvain Paris and Connelly Barnes (Adobe Research , 2013), Vivek Kwatra and Troy Chinen (Google Research , 2012) Neel Joshi and Brian Guenter. (Microsoft Research, 2011).
Publications
High-Resolution Frame Interpolation with Patch-based Cascaded Diffusion
Junhwa Hur, Charles Herrmann, Saurabh Saxena, Janne Kontkanen, Wei-Sheng Lai,
Yichang Shih, Michael Rubinstein, David J. Fleet, Deqing Sun
arXiv:2410.11838, 2024
Efficient Hybrid Zoom using Camera Fusion on Mobile Phone
Xiaotong Wu, Wei-Sheng Lai, YiChang Shih, Charles Herrmann, Michael Krainin, Deqing Sun, and Chia-Kai Liang
ACM Transactions on Graphics (SIGGRAPH ASIA) 2023
Vision Transformer for NeRF-Based View Synthesis from a Single Input Image
Kai-En Lin, Yen-Chen Lin, Wei-Sheng Lai, Tsung-Yi Lin, YiChang Shih, and Ravi Ramamoorthi
WACV 2023
Face Deblurring using Dual Camera Fusion on Mobile Phones
Wei-Sheng Lai, YiChang Shih, Lun-Cheng Chu, Xiaotong Wu, Sung-Fang Tsai, Michael Krainin, Deqing Sun, and Chia-Kai Liang
ACM Transactions on Graphics (SIGGRAPH) 2022
Correcting Face Distortion in Wide-Angle Videos
Wei-Sheng Lai, YiChang Shih, Chia-Kai Liang, and Ming-Hsuan Yang
IEEE TIP 2021
Portrait Neural Radiance Fields from a Single Image
Chen Gao, YiChang Shih, Wei-Sheng Lai, Chia-Kai Liang, and Jia-Bin Huang
arXiv:2012.05903, 2020
Distortion-Free Wide-Angle Portraits on Camera Phones
[project_web] [pdf]
YiChang Shih, Wei-Sheng Lai, Chia-Kai Liang
ACM Transactions on Graphics (SIGGRAPH) 2019
Transform Recipes for Efficient Cloud Photo Enhancement
[project_web] [pdf]
Michaël Gharbi, YiChang Shih, Gaurav Chaurasia, Jonathan Ragan-Kelley, Sylvain Paris, and Frédo Durand
ACM Transactions on Graphics (SIGGRAPH Asia) 2015
PhD Thesis: Data-Driven Photographic Style Using Local Transfer
[thesis pdf][defense presentation (pdf)][pptx (171MB)]
YiChang Shih
March 2015, MIT CSAIL, Cambridge, MA
Fast Bilateral-Space Stereo for Synthetic Defocus
Jon Barron, Andrew Adams, YiChang Shih, and Carlos Hernandez
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2015 (Oral)
Reflection Removal using Ghosting Cues
[pdf][supp][simulator][poster][code]
YiChang Shih, Dilip Krishnan, Frédo Durand, William T. Freeman
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2015
Style Transfer for Headshot Portraits
[project_web][pdf]
YiChang Shih, Sylvain Paris, Connelly Barnes, William T. Freeman, Frédo Durand
ACM Transactions on Graphics (SIGGRAPH) 2014
Seeing the Arrow of Time
[project web] [pdf]
L. Pickup, Z. Pan, D. Wei, Y. Shih, W. Freeman, A. Zisserman and B. Schölkopf
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2014
Joint Noise Level Estimation from Personal Photo Collections
[project web][pdf]
YiChang Shih, Vivek Kwatra, Troy Chinen, Hui Fang, Sergey Ioffe
IEEE International Conference on Computer Vision (ICCV) 2013
Data-driven Hallucination of Different Times of Day from a Single Outdoor Photo
[project web][pdf]
YiChang Shih, Sylvain Paris, Frédo Durand, William T. Freeman
ACM Transactions on Graphics (SIGGRAPH Asia) 2013
Image Enhancement using Calibrated Lens Simulations
[project web] [pdf]
YiChang Shih, Brian Guenter, Neel Joshi
European Conference on Computer Vision (ECCV) 2012
Laser Speckle Photography for Surface Tampering Detection
[project web] [pdf]
YiChang Shih, Abe Davis, Samuel W. Hasinoff, Frédo Durand, William T. Freeman
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2012
YiChang Shih, Master thesis, 2012 [pdf]
Light Field Analysis for Modeling Image Formation
[pdf]
Chia-Kai Liang, YiChang Shih, Homer H. Chen
IEEE Trans. Image Processing. Vol. 20, No.2 pp. 446-460, 2011.
Course Projects
Bars Removal by Multiview Images
Course: 6.865 Computational Photography (2011)
with HsinJung Yang
Handwritten Sanskrit Recognition using a Multi-class SVM with K-NN Guidance
[pdf]
Course: 6.867 Machine Learning (2011)
with Donglai Wei