Aaron Hertzmann: Research

Art, Science, and Perception

	Toward a Theory of Perspective Perception in Pictures A. Hertzmann. Journal of Vision. To appear.
	Art and the science of generative AI Z. G. Epstein, A. Hertzmann, et al. Science. 2023. Vol. 360, No. 6650. Extended whitepaper (includes complete author list)
	A computational approach to studying aesthetic judgments of ambiguous artworks X. Wang, Z. Bylinskii, A. Hertzmann, R. Pepperell. Psychology of Aesthetics, Creativity, and the Arts. To appear. [Preprint]
	The Choices Hidden in Photography A. Hertzmann. Journal of Vision. October 2022, Vol. 22, 10.
	Toward Quantifying Ambiguities in Artistic Images X. Wang, Z. Bylinskii, A. Hertzmann, R. Pepperell. ACM Trans. Applied Perception (TAP). 2020. (SAP Special Issue)
	Toward Modeling Creative Processes for Algorithmic Painting A. Hertzmann. Proc. International Conference on Computational Creativity (ICCC). 2022.
	The Role of Edges in Line Drawing Perception A. Hertzmann. Perception. Vol. 50, Issue 3, 2021. Preprint
	Computers Do Not Make Art, People Do A. Hertzmann. Communications of the ACM (CACM). May 2020 (Vol. 63, No. 5).
	Why Do Line Drawings Work? A Realism Hypothesis A. Hertzmann. Perception. Vol. 49, Issue 4, 2020. Preprint
	Visual Indeterminacy in GAN Art A. Hertzmann. Leonardo (Special Issue: SIGGRAPH Art Papers). Vol. 53, No. 4, pp. 424-428. 2020.
	Can Computers Create Art? A. Hertzmann. Arts. 2018. 7(2). A note about the publisher
	Non-Photorealistic Rendering and the Science of Art A. Hertzmann. Proc. ACM Non-Photorealistic Animation and Rendering (NPAR). 2010.

Essays and Tutorials in Computer Science

	New Insights in Smooth Occluding Contours for Nonphotorealistic Rendering A. Hertzmann. IEEE Computer Graphics & Applications (CG&A). Jan.-Feb. 2024, pp. 76-85, vol. 44.
	The Curse of Performative User Studies A. Hertzmann. IEEE Computer Graphics & Applications (CG&A). Nov.-Dec. 2023, pp. 112-116, vol. 43.
	Towards Better User Studies in Computer Graphics and Vision Z. Bylinskii, L. Herman, A. Hertzmann, S. Hutka, Y. Zhang. Foundations and Trends in Computer Graphics and Vision. 2023. Vol. 15: No. 3, pp 201-252.
	Line Drawings from 3D Models: A Tutorial P. Bénard, A. Hertzmann. Foundations and Trends in Computer Graphics and Vision. Volume 11, Issue 1-2. 2019.
	Machine Learning lecture notes A. Hertzmann. CSC 411 course notes.
	Computer Graphics lecture notes D. J. Fleet, A. Hertzmann. CSC 418 course notes.
	Introduction to Bayesian Learning A. Hertzmann. SIGGRAPH Course Notes. 2004.
	Machine Learning for Computer Graphics: A Manifesto and Tutorial A. Hertzmann. Proc. Pacific Graphics (PG). 2003. pp. 22-36. Invited paper..
	A Survey of Stroke-Based Rendering A. Hertzmann. IEEE Computer Graphics & Applications (CG&A). July/August 2003. Vol. 23, No. 4. pp. 70-81.
	Introduction to 3D Non-Photorealistic Rendering: Silhouettes and Outlines A. Hertzmann. In S. Green, editor, Non-Photorealistic Rendering. SIGGRAPH 99 Course Notes. 1999.

Selected Technical Publications in Computer Science

	Region-Aware Simplification and Stylization of 3D Line Drawings V. Nguyen, M. Fisher, A. Hertzmann, S. Rusinkiewicz. Computer Graphics Forum. 2024.
	Algebraic Smooth Occluding Contours R. Capouellez, J. Dai, A. Hertzmann, D. Zorin. ACM SIGGRAPH Conference Proceedings. 2023.
	ConTesse: Accurate Occluding Contours for Subdivision Surfaces C. Liu, P. Bénard, A. Hertzmann, S. Hoshyari. ACM Trans. on Graphics (TOG). 2023.
	ZoomShop: Depth-Aware Editing of Photographic Composition S. Liu, M. Agrawala, S. DiVerdi, A. Hertzmann. Computer Graphics Forum (Proc. Eurographics). 2022.
	HuMoR: 3D Human Motion Model for Robust Pose Estimation D. Rempe, T. Birdal, A. Hertzmann, J. Yang, S. Sridhar, L. Guibas. Proc. Int. Conf. on Computer Vision (ICCV). 2021.
	Neural Strokes: Stylized Line Drawing of 3D Shapes D. Liu, M. Fisher, A. Hertzmann, E. Kalogerakis. Proc. Int. Conf. on Computer Vision (ICCV). 2021.
	Contact-Aware Retargeting of Skinned Motion R. Villegas, D. Ceylan, A. Hertzmann, J. Yang, J. Saito. Proc. Int. Conf. on Computer Vision (ICCV). 2021.
	GANSpace: Discovering Interpretable GAN Controls E. Härkönen, A. Hertzmann, J. Lehtinen, S. Paris. Proc. Neural Information Processing Systems (NeurIPS). 2020.
	Predicting Visual Importance Across Graphic Design Types C. Fosco, V. Casser, A. K. Bedi, P. O'Donovan, A. Hertzmann, Z. Bylinskii. Proc. ACM User Interface Software and Technology (UIST). 2020.
	Contact and Human Dynamics from Monocular Video D. Rempe, L. Guibas, A. Hertzmann, B. C. Russell, R. Villegas, J. Yang. Proc. European Conf. on Computer Vision (ECCV). 2020.
	Transforming and Projecting Images into Class-conditional Generative Networks M. Huh, R. Zhang, J. Zhu, S. Paris, A. Hertzmann. Proc. European Conf. on Computer Vision (ECCV). 2020.
	Neural Contours: Learning to Draw Lines from 3D Shapes D. Liu, M. Nabail, A. Hertzmann, E. Kalogerakis. Proc. IEEE Computer Vision and Pattern Recognition (CVPR). 2020.
	LayoutGAN: Synthesizing Graphic Layouts with Vector-Wireframe Adversarial Networks J. Li, J. Yang, A. Hertzmann, J. Zhang, T. Xu. IEEE Trans. Pattern Analysis and Machine Intelligence (PAMI). 2020. Journal version of ICLR 2019 paper
	View-Dependent Video Textures for 360^o Video S. Liu, M. Agrawala, S. DiVerdi, A. Hertzmann. Proc. ACM User Interface Software and Technology (UIST). 2019.
	Visual Font Pairing S. Jiang, Z. Wang, A. Hertzmann, H. Jin, Y. Fu. IEEE Trans. Multimedia. Aug 2020. Vol. 22, No. 8.
	Video Motion Stylization by 2D Rigidification J. Delanoy, A. Bousseau, A. Hertzmann. Proc. Expressive. 2019.
	Adversarial training for fast arbitrary style transfer Z. Xu, M. J. Wilber, C. Fang, A. Hertzmann, H. Jin. Computers & Graphics. April 2020. Journal version of Expressive 2019 paper
	Im2Pencil: Controllable Pencil Illustration from Photographs Y. Li, C. Fang, A. Hertzmann, E. Shechtman, M. Yang. Proc. IEEE Computer Vision and Pattern Recognition (CVPR). 2019.
	Motion parallax for 360^o RGBD video A. Serrano, I. Kim, Z. Chen, S. DiVerdi, D. Gutierrez, A. Hertzmann, B. Masia. IEEE Trans. Visualization and Computer Graphics (TVCG). 2019. (Proc. IEEE VR 2019). Selected for presentation at SIGGRAPH.
	Context-Aware Asset Search for Graphic Design B. Kovacs, P. O'Donovan, K. Bala, A. Hertzmann. IEEE Trans. Visualization and Computer Graphics (TVCG). 2019. Vol. 52, No. 7.
	Learning A Stroke-Based Representation for Fonts E. Balashova, A. H. Bermano, V. G. Kim, S. DiVerdi, A. Hertzmann, T. Funkhouser. Computer Graphics Forum. 2019. Vol. 38, No. 1..
	Depth Conflict Reduction for Stereo VR Video Interfaces C. Nguyen, S. DiVerdi, A. Hertzmann, F. Liu. Proc. ACM Conference on Human Factors in Computing Systems (CHI). 2018.
	BAM! The Behance Artistic Media Dataset for Recognition Beyond Photography M. J. Wilber, C. Fang, H. Jin, A. Hertzmann, J. Collomosse, S. Belongie. Proc. Int. Conf. on Computer Vision (ICCV). 2017.
	Learning Visual Importance for Graphic Designs and Data Visualizations Z. Bylinskii, N. W. Kim, P. O'Donovan, S. Alsheikh, S. Madan, H. Pfister, F. Durand, B. C. Russell, A. Hertzmann. Proc. ACM User Interface Software and Technology (UIST). 2017. Honorable Mention Award
	CollaVR: Collaborative In-Headset Review for VR Video C. Nguyen, S. DiVerdi, A. Hertzmann, F. Liu. Proc. ACM User Interface Software and Technology (UIST). 2017.
	Learning Hierarchical Shape Segmentation and Labeling from Online Repositories L. Yi, L. Guibas, A. Hertzmann, V. G. Kim, H. Su, E. Yumer. ACM Trans. on Graphics (Proc. SIGGRAPH). 2017.
	Vremiere: In-headset Virtual Reality Video Editing C. Nguyen, S. DiVerdi, A. Hertzmann, F. Liu. Proc. ACM Conference on Human Factors in Computing Systems (CHI). 2017. Honorable Mention Award
	Controlling Perceptual Factors in Neural Style Transfer L. Gatys, A. S. Ecker, M. Bethge, A. Hertzmann, E. Shechtman. Proc. IEEE Computer Vision and Pattern Recognition (CVPR). 2017.
	A Joint Model for Who-to-Follow and What-to-View Recommendations on Behance M. Rudolph, M. D. Hoffman, A. Hertzmann. Proc. MSM. 2016.
	Automatic Portrait Segmentation for Image Stylization X. Shen, A. Hertzmann, J. Jia, S. Paris, B. Price, E. Shechtman, I. Sachs. Computer Graphics Forum. 2016.
	Style-Based Exploration of Illustration Datasets E. Garces, A. Agarwala, A. Hertzmann, D. Gutierrez. Multimedia Tools and Applications. 2016.
	Deep Classifiers from Image Tags in the Wild H. Izadinia, B. C. Russell, A. Farhadi, M. D. Hoffman, A. Hertzmann. Proc. Multimedia COMMONS. 2015.
	Style Compatibility For 3D Furniture Models T. Liu, A. Hertzmann, W. Li, T. Funkhouser. ACM Trans. on Graphics (Proc. SIGGRAPH). 2015.
	DesignScape: Design with Interactive Layout Suggestions P. O'Donovan, A. Agarwala, A. Hertzmann. Proc. ACM Conference on Human Factors in Computing Systems (CHI). 2015.
	MatrixWave: Visual Comparison of Event Sequence Data J. Zhao, Z. Liu, M. Dontcheva, A. Hertzmann, A. Wilson. Proc. ACM Conference on Human Factors in Computing Systems (CHI). 2015. Honorable Mention Award
	Predicting Range of Acceptable Photographic Tonal Adjustments R. Jaroensri, S. Paris, A. Hertzmann, V. Bychkovsky, F. Durand. Proc. Int. Conf. Computational Photography (ICCP). 2015.
	Learning Style Similarity for Searching Infographics B. Saleh, A. Hertzmann, M. Dontcheva, Z. Liu. Proc. Graphics Interface (GI). 2015.
	Efficient Optimization for Sparse Gaussian Process Regression Y. Cao, M. Brubaker, D. J. Fleet, A. Hertzmann. IEEE Trans. Pattern Analysis and Machine Intelligence (PAMI). Dec. 2015. Vol. 37(12).
	Metric Regression Forests for Correspondence Estimation G. Pons-Moll, J. Taylor, J. Shotton, A. Hertzmann, A. Fitzgibbon. Int. J. Computer Vision (IJCV). July 2015. Vol. 113(3). pp 163-175. Journal version of BMVC 2013 paper Best Science Paper Award
	Recognizing Image Style S. Karayev, M. Trentacoste, H. Han, A. Agarwala, T. Darrell, A. Hertzmann, H. Winnemöller. Proc. British Machine Vision Conference (BMVC). 2014.
	PortraitSketch: Face Sketching Assistance for Novices J. Xie, A. Hertzmann, W. Li, H. Winnemöller. Proc. ACM User Interface Software and Technology (UIST). 2014. Selected for presentation at SIGGRAPH 2015
	Computing Smooth Surface Contours with Accurate Topology P. Bénard, A. Hertzmann, M. Kass. ACM Trans. on Graphics (TOG). 2014. Volume 33, Issue 2.
	Exploratory Font Selection Using Crowdsourced Attributes P. O'Donovan, J. Lībeks, A. Agarwala, A. Hertzmann. ACM Trans. on Graphics (Proc. SIGGRAPH). 2014.
	A Similarity Measure for Illustration Style E. Garces, A. Agarwala, D. Gutierrez, A. Hertzmann. ACM Trans. on Graphics (Proc. SIGGRAPH). 2014.
	Collaborative Filtering of Color Aesthetics P. O'Donovan, A. Agarwala, A. Hertzmann. Proc. Computational Aesthetics (CAe). 2014.
	User-Specific Hand Modeling from Monocular Depth Sequences J. Taylor, R. Stebbing, V. Ramakrishna, C. Keskin, J. Shotton, S. Izadi, A. Hertzmann, A. Fitzgibbon. Proc. IEEE Computer Vision and Pattern Recognition (CVPR). 2014.
	Learning Layouts for Single-Page Graphic Designs P. O'Donovan, A. Agarwala, A. Hertzmann. IEEE Trans. Visualization and Computer Graphics (TVCG). August 2014, Vol. 20(8).
	Feedback Control for Rotational Movements in Feature Space M. Al Borno, E. Fiume, A. Hertzmann, M. de Lasa. Computer Graphics Forum. 2014.
	Learning Latent Factor Models of Human Travel M. Guerzhoy, A. Hertzmann. Proc. Canadian Conference on Artificial Intelligence (AI). 2014. Best Paper Award
	Trajectory Optimization for Full-Body Movements with Complex Contacts M. Al Borno, M. de Lasa, A. Hertzmann. IEEE Trans. Visualization and Computer Graphics (TVCG). Vol. 19, No. 8. Aug 2013.
	Image-Based Remodeling A. Colburn, A. Agarwala, A. Hertzmann, B. Curless, M. F. Cohen. IEEE Trans. Visualization and Computer Graphics (TVCG). Jan. 2013 (vol. 19 no. 1). pp. 56-66. [video]
	AniPaint: Interactive Painterly Animation from Video P. O'Donovan, A. Hertzmann. IEEE Trans. Visualization and Computer Graphics (TVCG). March 2012. Vol. 18, No. 3.
	Learning Hatching for Pen-and-Ink Illustration of Surfaces E. Kalogerakis, D. Nowrouzezahrai, S. Breslav, A. Hertzmann. ACM Trans. on Graphics (TOG). Jan. 2012. Vol. 31, No. 1.
	Color Compatibility From Large Datasets P. O'Donovan, A. Agarwala, A. Hertzmann. ACM Trans. on Graphics (Proc. SIGGRAPH). Aug. 2011.
	Feature-Based Locomotion Controllers M. de Lasa, I. Mordatch, A. Hertzmann. ACM Trans. on Graphics (Proc. SIGGRAPH). July 2010.
	Robust Physics-Based Locomotion Using Low-Dimensional Planning I. Mordatch, M. de Lasa, A. Hertzmann. ACM Trans. on Graphics (Proc. SIGGRAPH). July 2010.
	Optimizing Walking Controllers for Uncertain Inputs and Environments J. M. Wang, D. J. Fleet, A. Hertzmann. ACM Trans. on Graphics (Proc. SIGGRAPH). July 2010.
	Learning 3D Mesh Segmentation and Labeling E. Kalogerakis, A. Hertzmann, K. Singh. ACM Trans. on Graphics (Proc. SIGGRAPH). July 2010.
	Shape and Spatially-Varying BRDFs from Photometric Stereo D. B. Goldman, B. Curless, A. Hertzmann, S. M. Seitz. IEEE Trans. Pattern Analysis and Machine Intelligence (PAMI). June 2010. Journal version of ICCV 2005 paper
	Physics-Based Person Tracking Using the Anthropomorphic Walker M. Brubaker, D. J. Fleet, A. Hertzmann. Int. J. Computer Vision (IJCV). March 2010. Vol. 87, Nos. 1-2. Journal version of CVPR 2007 paper
	Optimizing Walking Controllers J. M. Wang, D. J. Fleet, A. Hertzmann. ACM Trans. on Graphics (Proc. SIGGRAPH Asia). Dec. 2009. Vol. 28, No. 5.
	Prioritized Optimization for Task-Space Control M. de Lasa, A. Hertzmann. Proc. IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS). 2009.
	Image Sequence Geolocation with Human Travel Priors E. Kalogerakis, O. Vesselova, J. Hays, A. A. Efros, A. Hertzmann. Proc. Int. Conf. on Computer Vision (ICCV). 2009.
	Data-driven curvature for real-time line drawing of dynamic scenes E. Kalogerakis, D. Nowrouzezahrai, P. Simari, J. McCrae, A. Hertzmann, K. Singh. ACM Trans. on Graphics (TOG). Jan. 2009. Vol. 28, No. 1.
	Non-Rigid Structure-From-Motion: Estimating Shape and Motion with Hierarchical Priors L. Torresani, A. Hertzmann, C. Bregler. IEEE Trans. Pattern Analysis and Machine Intelligence (PAMI). May 2008. Vol. 30, No. 5. pp. 878-892. Journal version of CVPR 2000, CVPR 2001, NIPS 2003 papers
	Gaussian Process Dynamical Models for Human Motion J. M. Wang, D. J. Fleet, A. Hertzmann. IEEE Trans. Pattern Analysis and Machine Intelligence (PAMI). Feb 2008. Vol. 30, No. 2. pp. 283-298. Journal version of NIPS 2006 paper
	Shape from Video: Dense Shape, Texture, Motion and Lighting from Monocular Image Streams A. Lakdawalla, A. Hertzmann. Proc. Workshop on Photometric Analysis on Computer Vision (WACV). 2007.
	Specifying Label Layout Styles by Example I. Vollick, D. Vogel, M. Agrawala, A. Hertzmann. Proc. ACM User Interface Software and Technology (UIST). 2007. pp. 221-230.
	Active Learning for Real-Time Motion Controllers S. Cooper, A. Hertzmann, Z. Popović. ACM Trans. on Graphics (Proc. SIGGRAPH). 2007.
	Isophote Distance: A Shading Approach to Artistic Stroke Thickness T. Goodwin, I. Vollick, A. Hertzmann. Proc. ACM Non-Photorealistic Animation and Rendering (NPAR). 2007. pp. 53-62.
	Multifactor Gaussian Process Models for Style-Content Separation J. M. Wang, D. J. Fleet, A. Hertzmann. Proc. International Conference on Machine Learning (ICML). 2007. pp. 975-982.
	Composition of Complex Optimal Multi-Character Motions C. K. Liu, A. Hertzmann, Z. Popović. Proc. ACM Symposium on Computer Animation (SCA). 2006. pp. 215-222.
	Learning a correlated model of identity and pose-dependent body shape variation for real-time synthesis B. Allen, B. Curless, Z. Popović. Proc. ACM Symposium on Computer Animation (SCA). 2006. pp. 147-156.
	Removing Camera Shake From A Single Photograph R. Fergus, B. Singh, A. Hertzmann, S. T. Roweis, W. T. Freeman. ACM Trans. on Graphics (Proc. SIGGRAPH). 2006. 25(3):787-794.
	Segmentation-Based 3D Artistic Rendering A. Kolliopoulos, J. M. Wang, A. Hertzmann. Proc. Eurographics Symposium on Rendering (EGSR). 2006. pp. 381-370.
	Learning Shared Latent Structure for Image Synthesis and Robotic Imitation A. P. Shon, K. Grochow, A. Hertzmann, R. P. N. Rao. Proc. Neural Information Processing Systems (NIPS). 2006. pp 1233-1240.
	Priors for People Tracking from Small Training Sets R. Urtasun, D. J. Fleet, A. Hertzmann, P. Fua. Proc. Int. Conf. on Computer Vision (ICCV). 2005. pp. 403-410.
	Learning Physics-Based Motion Style with Nonlinear Inverse Optimization C. K. Liu, A. Hertzmann, Z. Popović. ACM Trans. on Graphics (Proc. SIGGRAPH). 2005. pp. 1071-1081.
	Example-Based Photometric Stereo: Shape Reconstruction with General, Varying BRDFs A. Hertzmann, S. M. Seitz. IEEE Trans. Pattern Analysis and Machine Intelligence (PAMI). 2005. Vol. 27, No. 8. pp. 1254-1264. Journal version of CVPR 2003 paper
	A Segment-Based Probabilistic Generative Model of Speech K. Achan, S. T. Roweis, A. Hertzmann, B. Frey. Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP). 2005. Vol. 5, pages 221-224.
	Style-Based Inverse Kinematics K. Grochow, S. L. Martin, A. Hertzmann, Z. Popović. ACM Trans. on Graphics (Proc. SIGGRAPH). 2004. pp. 552-531.
	Keyframe-Based Tracking for Rotoscoping and Animation A. Agarwala, A. Hertzmann, D. H. Salesin, S. M. Seitz. ACM Trans. on Graphics (Proc. SIGGRAPH). 2004. pp. 584-591.
	Automatic Non-Rigid 3D Modeling from Video L. Torresani, A. Hertzmann. Proc. European Conf. on Computer Vision (ECCV). 2004. Vol. 2, pp. 299-312.
	Example-Based Stereo with General BRDFs A. Treuille, A. Hertzmann, S. M. Seitz. Proc. European Conf. on Computer Vision (ECCV). 2004. Vol. 2, pp. 457-469.
	Learning Non-Rigid 3D Shape from 2D Motion L. Torresani, A. Hertzmann, C. Bregler. Proc. Neural Information Processing Systems (NIPS). 2003. pp. 1555-1562.
	Shape and Motion under Varying Illumination: Unifying Structure from Motion, Photometric Stereo, and Multi-view Stereo L. Zhang, B. Curless, A. Hertzmann, S. M. Seitz. Proc. Int. Conf. on Computer Vision (ICCV). 2003. pp. 618-625.
	Curve Analogies A. Hertzmann, N. Oliver, S. M. Seitz, B. Curless. Proc. Eurographics Workshop on Rendering (EGWR). 2002. pp. 233-245.
	Fast Paint Texture A. Hertzmann. Proc. ACM Non-Photorealistic Animation and Rendering (NPAR). 2002. pp. 91-96, 161.
	Algorithms for Rendering in Artistic Styles A. Hertzmann. PhD thesis. New York University. May 2001. Janet Fabri Award for Outstanding Dissertation in Computer Science, New York University, 2002
	Image Analogies A. Hertzmann, C. E. Jacobs, N. Oliver, B. Curless, D. H. Salesin. ACM SIGGRAPH Conference Proceedings. 2001. pp. 327-340.
	Texture and Shape Synthesis on Surfaces L. Ying, A. Hertzmann, H. Biermann, D. Zorin. Proc. Eurographics Workshop on Rendering (EGWR). 2001. pp. 301-312..
	Paint By Relaxation A. Hertzmann. Proc. Computer Grahics International (CGI). 2001. pp. 47-54.
	Illustrating smooth surfaces A. Hertzmann, D. Zorin. ACM SIGGRAPH Conference Proceedings. 2000. pp. 517-526.
	Style machines M. Brand, A. Hertzmann. ACM SIGGRAPH Conference Proceedings. 2000. pp. 183-192.
	Painterly Rendering for Video and Interaction A. Hertzmann, K. Perlin. Proc. ACM Non-Photorealistic Animation and Rendering (NPAR). 2000. pp. 7-12, 121. [Videos]
	Recovering Non-Rigid 3D Shape from Image Streams C. Bregler, A. Hertzmann, H. Biermann. Proc. IEEE Computer Vision and Pattern Recognition (CVPR). 2000. pp. 690-696.
	Painterly Rendering with Curved Brush Strokes of Multiple Sizes A. Hertzmann. ACM SIGGRAPH Conference Proceedings. 1998. pp. 453-460. [Code]