Ting-Chun Wang

Senior Research Scientist

NVIDIA

Santa Clara, CA

Email:

tingchunw at nvidia dot com

 

GitHub | Google Scholar

 

I'm a senior research scientist at NVIDIA, working on computer vision, machine learning and computer graphics.
I received my PhD from University of California, Berkeley in 2017, advised by Professor Ravi Ramamoorthi and Alexei A. Efros.
My recent research focus is on using generative adversarial models to synthesize realistic images and videos, with applications to rendering, visual manipulations and beyond.


News

Publications

avid2vid_nips

Few-shot Video-to-Video Synthesis

 

Ting-Chun Wang, Ming-Yu Liu, Andrew Tao, Guilin Liu, Jan Kautz, Bryan Catanzaro

 

Conference on Neural Information Processing Systems (NeurIPS), 2019

 

project | paper | github | YouTube | bibtex

@inproceedings{wang2019fewshotvid2vid,
  title={Few-shot Video-to-Video Synthesis},
  author={Ting-Chun Wang and Ming-Yu Liu and Andrew Tao and Guilin Liu and Jan Kautz and Bryan Catanzaro},
  booktitle={Conference on Neural Information Processing Systems (NeurIPS)},
  year={2019}
}
      
d2m_nips

Dance to Music

 

Hsin-Ying Lee, Xiaodong Yang, Ming-Yu Liu, Ting-Chun Wang, Yu-Ding Lu, Ming-Hsuan Yang, Jan Kautz

 

Conference on Neural Information Processing Systems (NeurIPS), 2019

 

spade_cvpr

Semantic Image Synthesis with Spatially-Adaptive Normalization

 

Taesung Park, Ming-Yu Liu, Ting-Chun Wang, Jun-Yan Zhu

 

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019 (best paper finalist)

 

project | paper | github | YouTube | bibtex

@inproceedings{park2019SPADE,
  title={Semantic Image Synthesis with Spatially-Adaptive Normalization},
  author={Park, Taesung and Liu, Ming-Yu and Wang, Ting-Chun and Zhu, Jun-Yan},
  booktitle={Proceedings of the IEEE Conference on 
             Computer Vision and Pattern Recognition (CVPR)},
  year={2019}
}
      
vid2vid_nips

Video-to-Video Synthesis

 

Ting-Chun Wang, Ming-Yu Liu, Jun-Yan Zhu, Guilin Liu, Andrew Tao, Jan Kautz, Bryan Catanzaro

 

Conference on Neural Information Processing Systems (NeurIPS), 2018

 

project | paper | arXiv | github | YouTube | bibtex

@inproceedings{wang2018vid2vid,
   author    = {Ting-Chun Wang and Ming-Yu Liu and Jun-Yan Zhu and Guilin Liu
                and Andrew Tao and Jan Kautz and Bryan Catanzaro},
   title     = {Video-to-Video Synthesis},
   booktitle = {Conference on Neural Information Processing Systems (NeurIPS)},   
   year      = {2018},
}
      
ds_arxiv

Domain Stylization: A Strong, Simple Baseline for Synthetic to Real Image Domain Adaptation

 

Aysegul Dundar, Ming-Yu Liu, Ting-Chun Wang, John Zedlewski, Jan Kautz

 

arXiv preprint arXiv:1807.09384

 

arXiv | bibtex

@article{dundar2018domain,
  title={Domain Stylization: A Strong, Simple Baseline for Synthetic to Real Image Domain Adaptation},
  author={Dundar, Aysegul and Liu, Ming-Yu and Wang, Ting-Chun and Zedlewski, John and Kautz, Jan},
  journal={arXiv preprint arXiv:1807.09384},
  year={2018}
}
      
parconv_eccv

Image Inpainting for Irregular Holes Using Partial Convolutions

 

Guilin Liu, Fitsum A. Reda, Kevin J. Shih, Ting-Chun Wang, Andrew Tao, Bryan Catanzaro

 

European Conference on Computer Vision (ECCV), 2018

 

project | arXiv | YouTube | bibtex

          
@inproceedings{liu2018image,
   author    = {Liu, Guilin and Reda, Fitsum A and Shih, Kevin J 
                and Wang, Ting-Chun and Tao, Andrew and Catanzaro, Bryan},
   title     = {Image inpainting for irregular holes using partial convolutions},
   booktitle = {Proceedings of the European Conference on Computer Vision (ECCV)},   
   year      = {2018},
}
      
pix2pixHD_cvpr

High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs

 

Ting-Chun Wang, Ming-Yu Liu, Jun-Yan Zhu, Andrew Tao, Jan Kautz, Bryan Catanzaro

 

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018 (oral presentation)

 

project | paper | arXiv | github | YouTube | slides | bibtex

@inproceedings{wang2018pix2pixHD,
   author    = {Ting-Chun Wang and Ming-Yu Liu and Jun-Yan Zhu 
                and Andrew Tao and Jan Kautz and Bryan Catanzaro},
   title     = {High-Resolution Image Synthesis and Semantic Manipulation 
                with Conditional GANs},
   booktitle = {Proceedings of the IEEE Conference on 
                Computer Vision and Pattern Recognition (CVPR)},   
   year      = {2018},
}
      
thesis

Beyond Photo-Consistency: Shape, Reflectance, and Material Estimation Using
Light-Field Cameras

 

Ting-Chun Wang

 

PhD Thesis, 2017

 

lfv_sig

Light Field Video Capture Using a Learning-Based Hybrid Imaging System

 

Ting-Chun Wang, Jun-Yan Zhu, Nima Khademi Kalantari, Alexei Efros, Ravi Ramamoorthi

 

ACM Transactions on Graphics (SIGGRAPH), 2017

 

paper | lo-res pdf | YouTube | bibtex | project page

@article{wang2017light,
   author  = {Ting-Chun Wang and Jun-Yan Zhu and Nima Khademi Kalantari 
              and Alexei A. Efros and Ravi Ramamoorthi},
   title   = {Light Field Video Capture Using a Learning-Based Hybrid 
              Imaging System},
   journal = {ACM Transactions on Graphics (Proceedings of SIGGRAPH)},
   volume  = {36},
   number  = {4},
   year    = {2017},
}
      
brdf_pami

SVBRDF-Invariant Shape and Reflectance Estimation from Light-Field Cameras

 

Ting-Chun Wang, Manmohan Chandraker, Alexei Efros, Ravi Ramamoorthi

 

Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2017

 

paper | bibtex

@article{wang2017svbrdf,
   title={{SVBRDF}-Invariant Shape and Reflectance 
   Estimation from Light-Field Cameras},
   author={Wang, Ting-Chun and Chandraker, Manmohan
   and Efros, Alexei and Ramamoorthi, Ravi},
   journal={IEEE Transactions on Pattern 
   Analysis and Machine Intelligence (TPAMI)},
   year={2017},
}
      
lfvs_sig

Learning-Based View Synthesis for Light Field Cameras

 

Nima Khademi Kalantari, Ting-Chun Wang, Ravi Ramamoorthi

 

ACM Transactions on Graphics (SIGGRAPH Asia), 2016

 

project page | paper | bibtex

@article{Kalantari16ViewSynthesis,
   author={Nima Khademi Kalantari and Ting-Chun Wang 
   and Ravi Ramamoorthi},
   title={Learning-Based View Synthesis for Light 
   Field Cameras},
   journal={ACM Transactions on Graphics (Proceedings 
   of SIGGRAPH Asia 2016)},
   year={2016},
}
      
lfmr_eccv

A 4D Light-Field Dataset and CNN Architectures for Material Recognition

 

Ting-Chun Wang, Jun-Yan Zhu, Ebi Hiroaki, Manmohan Chandraker, Alexei Efros, Ravi Ramamoorthi

 

European Conference on Computer Vision (ECCV), 2016

 

paper | HTML comparison | bibtex | dataset (2D thumbnail) | full dataset (15.9G)

@inproceedings{wang2016dataset,
   title={A {4D} light-field dataset and {CNN} 
   architectures for material recognition},
   author={Wang, Ting-Chun and Zhu, Jun-Yan 
   and Hiroaki, Ebi and Chandraker, Manmohan 
   and Efros, Alexei and Ramamoorthi, Ravi},
   booktitle={Proceedings of European Conference on 
   Computer Vision (ECCV)},
   year={2016}
}
      
brdf_cvpr

SVBRDF-Invariant Shape and Reflectance Estimation from Light-Field Cameras

 

Ting-Chun Wang, Manmohan Chandraker, Alexei Efros, Ravi Ramamoorthi

 

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016 (oral presentation)

 

paper | supplementary | HTML comparison | bibtex

@inproceedings{wang2016svbrdf,
   title={SVBRDF-invariant shape and reflectance 
   estimation from light-field cameras},
   author={Wang, Ting-Chun and Chandraker, Manmohan 
   and Efros, Alexei and Ramamoorthi, Ravi},
   booktitle={Proceedings of the IEEE Conference on 
   Computer Vision and Pattern Recognition (CVPR)},
   year={2016}
}
      
stereo_cvpr

Depth from Semi-Calibrated Stereo and Defocus

 

Ting-Chun Wang, Manohar Srikanth, Ravi Ramamoorthi

 

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016

 

paper | HTML comparison | bibtex

@inproceedings{wang2016semi,
   title={Depth from semi-calibrated stereo and defocus},
   author={Wang, Ting-Chun and Srikanth, Manohar
   and Ramamoorthi, Ravi},
   booktitle={Proceedings of the IEEE Conference on 
   Computer Vision and Pattern Recognition (CVPR)},
   year={2016}
}
      
occlusion_pami

Depth Estimation with Occlusion Modeling Using Light-field Cameras

 

Ting-Chun Wang, Alexei Efros, Ravi Ramamoorthi

 

Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2016

 

paper | bibtex

@article{wang2016depth,
   title={Depth estimation with occlusion modeling 
   using light-field cameras},
   author={Wang, Ting-Chun and Efros, Alexei and 
   Ramamoorthi, Ravi},
   journal={IEEE Transactions on Pattern 
   Analysis and Machine Intelligence (TPAMI)},
   volume={38},
   number={11},
   pages={2170--2181},
   year={2016},
}
      
occlusion

Occlusion-aware depth estimation using light-field cameras

 

Ting-Chun Wang, Alexei Efros, Ravi Ramamoorthi

 

International Conference on Computer Vision (ICCV), 2015

 

paper | supplementary | bibtex | code | dataset (3.3GB)

@inproceedings{wang2015occlusion,
  title={Occlusion-aware depth estimation 
  using light-field cameras.},
  author={Wang, Ting-Chun and 
  Efros, Alexei and Ramamoorthi, Ravi},
  booktitle={Proceedings of the IEEE International 
  Conference on Computer Vision (ICCV)},
  year={2015}
}
      
glossy_pami

Depth estimation and specular removal for glossy surfaces using
point and line consistency with light-field cameras

 

Michael Tao, Jong-Chyi Su, Ting-Chun Wang, Jitendra Malik, Ravi Ramamoorthi

 

Transactions on Pattern Analysis and Machine Intelligence (TPAMI)

 

paper | bibtex

@article{tao2015depth,
title={Depth Estimation and Specular Removal 
for Glossy Surfaces Using Point and 
Line Consistency with Light-Field Cameras},
author={Tao, Michael and Su, Jong-Chyi 
and Wang, Ting-Chun and Malik, Jitendra 
and Ramamoorthi, },
journal={IEEE Transactions on Pattern 
Analysis \& Machine Intelligence},
number={1},
pages={1--1},
year={2015},
publisher={IEEE}
}
      
glossy

Depth estimation for glossy surfaces with light-field cameras

 

Michael Tao, Ting-Chun Wang, Jitendra Malik, Ravi Ramamoorthi

 

ECCV workshop on Light Fields for Computer Vision (L4CV), 2014

 

paper | bibtex

@inproceedings{tao2014depth,
title={Depth estimation for glossy 
surfaces with light-field cameras},
author={Tao, Michael W and Wang, Ting-Chun 
and Malik, Jitendra and Ramamoorthi, Ravi},
booktitle={Computer Vision-ECCV 2014 Workshops},
pages={533--547},
year={2014},
organization={Springer}
}
      

Software

SPADE: Semantic image synthesis on diverse datasets including Flickr and coco.

vid2vid: High-resolution video-to-video translation.

pix2pixHD: High-resolution image-to-image translation.

Light Field Video: Light field video applications (e.g. video refocusing, changing aperture and view).


Talks

High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs (pix2pixHD)

CVPR (2018)

 

Beyond Photo-Consistency: Shape, Reflectance, and Material Estimation Using Light-Field Cameras

Dissertation talk (2017)

 

Light Field Video Capture Using a Learning-Based Hybrid Imaging System

Siggraph (2017)

 

SVBRDF-Invariant Shape and Reflectance Estimation from Light-Field Cameras

CVPR (2016)


web page statistics from GoStats