eos: A lightweight header-only 3D Morphable Model fitting library in modern C++11/14.
eos is a lightweight 3D Morphable Face Model fitting library that provides basic functionality to use face models, as well as camera and shape fitting functionality. It's written in modern C++11/14.
At the moment, it mainly provides the following functionality:
- MorphableModel and PcaModel classes to represent 3DMMs, with basic operations like
draw_sample() - Our low-resolution, shape-only 3D Morphable Face Model (share/sfm_shape_3448.bin)
- Fast, linear pose, shape and expression fitting, edge and contour fitting:
- Linear scaled orthographic projection camera pose estimation
- Linear shape-to-landmarks fitting, implementation of O. Aldrian & W. Smith, Inverse Rendering of Faces with a 3D Morphable Model, PAMI 2013
- Expression fitting, and 6 linear expression blendshapes: anger, disgust, fear, happiness, sadness, surprise.
- Edge-fitting, heavily inspired by: A. Bas et al., Fitting a 3D Morphable Model to Edges: A Comparison Between Hard and Soft Correspondences, ACCVW 2016
- Isomap texture extraction to obtain a pose-invariant representation of the face texture
- (New): Python bindings for parts of the library, and Matlab bindings for the fitting
- (Experimental): Non-linear fitting cost functions using Ceres for shape, camera, blendshapes and the colour model (needs Ceres to be installed separately)
More information, features and sample code on Github
Documentation (doxygen)
License & contributions:
This code is licensed under the Apache License, Version 2.0
Contributions are very welcome! (best in the form of pull requests.) Please use Github issues for any bug reports, ideas, and discussions.
If you use this code in your own work, please cite the following paper: A Multiresolution 3D Morphable Face Model and Fitting Framework, P. Huber, G. Hu, R. Tena, P. Mortazavian, W. Koppen, W. Christmas, M. Rätsch, J. Kittler, International Conference on Computer Vision Theory and Applications (VISAPP) 2016, Rome, Italy [PDF].