## SMPL-X: A new joint 3D model of the human body, face and hands together
[[Paper Page](https://smpl-x.is.tue.mpg.de)] [[Paper](https://ps.is.tuebingen.mpg.de/uploads_file/attachment/attachment/497/SMPL-X.pdf)]
[[Supp. Mat.](https://ps.is.tuebingen.mpg.de/uploads_file/attachment/attachment/498/SMPL-X-supp.pdf)]
![SMPL-X Examples](./images/teaser_fig.png)
## Table of Contents
* [License](#license)
* [Description](#description)
* [News](#news)
* [Installation](#installation)
* [Downloading the model](#downloading-the-model)
* [Loading SMPL-X, SMPL+H and SMPL](#loading-smpl-x-smplh-and-smpl)
* [SMPL and SMPL+H setup](#smpl-and-smplh-setup)
* [Model loading](https://github.com/vchoutas/smplx#model-loading)
* [MANO and FLAME correspondences](#mano-and-flame-correspondences)
* [Example](#example)
* [Modifying the global pose of the model](#modifying-the-global-pose-of-the-model)
* [Citation](#citation)
* [Acknowledgments](#acknowledgments)
* [Contact](#contact)
## License
Software Copyright License for **non-commercial scientific research purposes**.
Please read carefully the [terms and conditions](https://github.com/vchoutas/smplx/blob/master/LICENSE) and any accompanying documentation before you download and/or use the SMPL-X/SMPLify-X model, data and software, (the "Model & Software"), including 3D meshes, blend weights, blend shapes, textures, software, scripts, and animations. By downloading and/or using the Model & Software (including downloading, cloning, installing, and any other use of this github repository), you acknowledge that you have read these terms and conditions, understand them, and agree to be bound by them. If you do not agree with these terms and conditions, you must not download and/or use the Model & Software. Any infringement of the terms of this agreement will automatically terminate your rights under this [License](./LICENSE).
## Disclaimer
The original images used for the figures 1 and 2 of the paper can be found in this link.
The images in the paper are used under license from gettyimages.com.
We have acquired the right to use them in the publication, but redistribution is not allowed.
Please follow the instructions on the given link to acquire right of usage.
Our results are obtained on the 483 × 724 pixels resolution of the original images.
## Description
*SMPL-X* (SMPL eXpressive) is a unified body model with shape parameters trained jointly for the
face, hands and body. *SMPL-X* uses standard vertex based linear blend skinning with learned corrective blend
shapes, has N = 10, 475 vertices and K = 54 joints,
which include joints for the neck, jaw, eyeballs and fingers.
SMPL-X is defined by a function M(θ, β, ψ), where θ is the pose parameters, β the shape parameters and
ψ the facial expression parameters.
## News
- 3 November 2020: We release the code to transfer between the models in the
SMPL family. For more details on the code, go to this [readme
file](./transfer_model/README.md). A detailed explanation on how the mappings
were extracted can be found [here](./transfer_model/docs/transfer.md).
- 23 September 2020: A UV map is now available for SMPL-X, please check the
Downloads section of the website.
- 20 August 2020: The full shape and expression space of SMPL-X are now available.
## Installation
To install the model please follow the next steps in the specified order:
1. To install from PyPi simply run:
```Shell
pip install smplx[all]
```
2. Clone this repository and install it using the *setup.py* script:
```Shell
git clone https://github.com/vchoutas/smplx
python setup.py install
```
## Downloading the model
To download the *SMPL-X* model go to [this project website](https://smpl-x.is.tue.mpg.de) and register to get access to the downloads section.
To download the *SMPL+H* model go to [this project website](http://mano.is.tue.mpg.de) and register to get access to the downloads section.
To download the *SMPL* model go to [this](http://smpl.is.tue.mpg.de) (male and female models) and [this](http://smplify.is.tue.mpg.de) (gender neutral model) project website and register to get access to the downloads section.
## Loading SMPL-X, SMPL+H and SMPL
### SMPL and SMPL+H setup
The loader gives the option to use any of the SMPL-X, SMPL+H, SMPL, and MANO models. Depending on the model you want to use, please follow the respective download instructions. To switch between MANO, SMPL, SMPL+H and SMPL-X just change the *model_path* or *model_type* parameters. For more details please check the docs of the model classes.
Before using SMPL and SMPL+H you should follow the instructions in [tools/README.md](./tools/README.md) to remove the
Chumpy objects from both model pkls, as well as merge the MANO parameters with SMPL+H.
### Model loading
You can either use the [create](https://github.com/vchoutas/smplx/blob/c63c02b478c5c6f696491ed9167e3af6b08d89b1/smplx/body_models.py#L54)
function from [body_models](./smplx/body_models.py) or directly call the constructor for the
[SMPL](https://github.com/vchoutas/smplx/blob/c63c02b478c5c6f696491ed9167e3af6b08d89b1/smplx/body_models.py#L106),
[SMPL+H](https://github.com/vchoutas/smplx/blob/c63c02b478c5c6f696491ed9167e3af6b08d89b1/smplx/body_models.py#L395) and
[SMPL-X](https://github.com/vchoutas/smplx/blob/c63c02b478c5c6f696491ed9167e3af6b08d89b1/smplx/body_models.py#L628) model. The path to the model can either be the path to the file with the parameters or a directory with the following structure:
```bash
models
├── smpl
│ ├── SMPL_FEMALE.pkl
│ └── SMPL_MALE.pkl
│ └── SMPL_NEUTRAL.pkl
├── smplh
│ ├── SMPLH_FEMALE.pkl
│ └── SMPLH_MALE.pkl
├── mano
| ├── MANO_RIGHT.pkl
| └── MANO_LEFT.pkl
└── smplx
├── SMPLX_FEMALE.npz
├── SMPLX_FEMALE.pkl
├── SMPLX_MALE.npz
├── SMPLX_MALE.pkl
├── SMPLX_NEUTRAL.npz
└── SMPLX_NEUTRAL.pkl
```
## MANO and FLAME correspondences
The vertex correspondences between SMPL-X and MANO, FLAME can be downloaded
from [the project website](https://smpl-x.is.tue.mpg.de). If you have extracted
the correspondence data in the folder *correspondences*, then use the following
scripts to visualize them:
1. To view MANO correspondences run the following command:
```
python examples/vis_mano_vertices.py --model-folder $SMPLX_FOLDER --corr-fname correspondences/MANO_SMPLX_vertex_ids.pkl
```
2. To view FLAME correspondences run the following command:
```
python examples/vis_flame_vertices.py --model-folder $SMPLX_FOLDER --corr-fname correspondences/SMPL-X__FLAME_vertex_ids.npy
```
## Example
After installing the *smplx* package and downloading the model parameters you should be able to run the *demo.py*
script to visualize the results. For this step you have to install the [pyrender](https://pyrender.readthedocs.io/en/latest/index.html) and [trimesh](https://trimsh.org/) packages.
`python examples/demo.py --model-folder $SMPLX_FOLDER --plot-joints=True --gender="neutral"`
![SMPL-X Examples](./images/example.png)
## Modifying the global pose of the model
If you want to modify the global pose of the model, i.e. the root rotation and
translation, to a new coordinate system for example, you need to take into
account that the model rotation uses the pelvis as the center of rotation. A
more detailed description can be found in the following
[link](https://www.dropbox.com/scl/fi/zkatuv5shs8d4tlwr8ecc/Change-parameters-to-new-coordinate-system.paper?dl=0&rlkey=lotq1sh6wzkmyttisc05h0in0).
If something is not clear, please let me know so that I can update the
description.
## Citation
Depending on which model is loaded for your project, i.e. SMPL-X or SMPL+H or SMPL, please cite the most relevant work below, listed in the same order:
```
@inproceedings{SMPL-X:2019,
title = {Expressive Body Capture: 3D Hands, Face, and Body from a Sing
没有合适的资源?快使用搜索试试~ 我知道了~
smplx:SMPL-X
共64个文件
py:46个
yaml:6个
md:4个
需积分: 47 18 下载量 198 浏览量
2021-08-04
20:30:53
上传
评论
收藏 949KB ZIP 举报
温馨提示
SMPL-X:一种全新的人体、面部和手部联合 3D 模型 [] [ ] [ ] 目录 例子 修改模型的全局位姿 引文 致谢 接触 执照 非商业科研用途的软件著作权许可。 在下载和/或使用 SMPL-X/SMPLify-X 模型、数据和软件(“模型和软件”)之前,请仔细阅读条款和条件以及任何随附的文档,包括 3D 网格、混合权重、混合形状、纹理、软件、脚本和动画。 通过下载和/或使用模型和软件(包括下载、克隆、安装和任何其他使用此 github 存储库),您承认您已阅读这些条款和条件,理解它们,并同意受它们的约束。 如果您不同意这些条款和条件,则不得下载和/或使用模型和软件。 任何违反本协议条款的行为将自动终止您在本许可下的权利。 免责声明 可在此链接中找到用于本文图 1 和图 2 的原始图像。 论文中的图像在 gettyimages.com 的许可下使用。 我们已获得在出版物中使用
资源推荐
资源详情
资源评论
收起资源包目录
smplx-master.zip (64个子文件)
smplx-master
images
teaser_fig.png 667KB
example.png 18KB
config_files
smplx2smpl.yaml 480B
smpl2smplh.yaml 551B
smplh2smplx.yaml 544B
smplx2smplh.yaml 579B
smpl2smplx.yaml 542B
smplh2smpl.yaml 481B
tools
clean_ch.py 2KB
merge_smplh_mano.py 3KB
__init__.py 784B
README.md 870B
LICENSE 6KB
smplx
vertex_joint_selector.py 3KB
utils.py 3KB
__init__.py 875B
vertex_ids.py 2KB
joint_names.py 5KB
body_models.py 98KB
lbs.py 14KB
transfer_model
config
cmd_parser.py 2KB
utils_cfg.py 909B
loss_defaults.py 1KB
__init__.py 745B
body_model_defaults.py 2KB
optim_defaults.py 2KB
defaults.py 2KB
dataset_defaults.py 1021B
docs
images
smpl_smplx_correspondence.png 188KB
transfer.md 6KB
optimizers
minimize.py 3KB
__init__.py 784B
optim_factory.py 3KB
data
build.py 2KB
__init__.py 746B
datasets
__init__.py 739B
mesh.py 2KB
losses
utils.py 1018B
losses.py 5KB
__init__.py 732B
__main__.py 3KB
__init__.py 710B
transfer_model.py 14KB
requirements.txt 121B
README.md 9KB
utils
typing.py 903B
o3d_utils.py 1KB
metrics.py 915B
mesh_utils.py 2KB
timer.py 2KB
np_utils.py 1KB
torch_utils.py 872B
__init__.py 1KB
def_transfer.py 2KB
pose_utils.py 5KB
requirements.txt 50B
examples
demo.py 7KB
vis_mano_vertices.py 3KB
demo_layers.py 7KB
vis_flame_vertices.py 3KB
setup.py 2KB
.gitignore 1KB
optional-requirements.txt 41B
README.md 10KB
共 64 条
- 1
资源评论
DaleDai
- 粉丝: 16
- 资源: 4724
上传资源 快速赚钱
- 我的内容管理 展开
- 我的资源 快来上传第一个资源
- 我的收益 登录查看自己的收益
- 我的积分 登录查看自己的积分
- 我的C币 登录后查看C币余额
- 我的收藏
- 我的下载
- 下载帮助
最新资源
- Screenshot_20240427_031602.jpg
- 网页PDF_2024年04月26日 23-46-14_QQ浏览器网页保存_QQ浏览器转格式(6).docx
- 直接插入排序,冒泡排序,直接选择排序.zip
- 在排序2的基础上,再次对快排进行优化,其次增加快排非递归,归并排序,归并排序非递归版.zip
- 实现了7种排序算法.三种复杂度排序.三种nlogn复杂度排序(堆排序,归并排序,快速排序)一种线性复杂度的排序.zip
- 冒泡排序 直接选择排序 直接插入排序 随机快速排序 归并排序 堆排序.zip
- 课设-内部排序算法比较 包括冒泡排序、直接插入排序、简单选择排序、快速排序、希尔排序、归并排序和堆排序.zip
- Python排序算法.zip
- C语言实现直接插入排序、希尔排序、选择排序、冒泡排序、堆排序、快速排序、归并排序、计数排序,并带图详解.zip
- 常用工具集参考用于图像等数据处理
资源上传下载、课程学习等过程中有任何疑问或建议,欢迎提出宝贵意见哦~我们会及时处理!
点击此处反馈
安全验证
文档复制为VIP权益,开通VIP直接复制
信息提交成功