没有合适的资源?快使用搜索试试~ 我知道了~
lipreading-in-the-wild-experiments:我在LRW数据集中使用深度学习进行唇读实验
共1613个文件
png:850个
py:307个
txt:296个
5 下载量 13 浏览量
2021-05-05
19:52:47
上传
评论
收藏 133.4MB ZIP 举报
温馨提示
在疯狂的实验中唇读 该存储库包含我在Keras中使用深度学习进行唇读的实验。 我训练并测试。 进程-lrw / 将LRW数据集中的视频转换为以下代码的代码:-与单词有关的帧-这些帧的嘴巴区域-音频 目录中的README文件中提供了说明。 形状预测器/ 放置process-lrw和head-pose所需的“ shape_predictor_68_face_landmarks.dat”文件的目录 图像检索/ 代码和文件---将lipreader视为图像检索系统 头姿势/ 代码和文件---计算LRW数据集中所有帧的头部姿势(使用process-lrw提取) 头部姿势是使用 (我的叉子)确定的。 目录中的README文件中提供了说明。
资源推荐
资源详情
资源评论
收起资源包目录
lipreading-in-the-wild-experiments:我在LRW数据集中使用深度学习进行唇读实验 (1613个子文件)
lrw_word_durations_alphabetic.csv 2.52MB
n_of_frames_per_sample.csv 1.44MB
start_frames_per_sample.csv 1.29MB
AP_at_K_vs_word_gray_test.gif 461KB
AP_at_K_vs_word_gray_val.gif 458KB
ND_01_RF_full_testSplit0.1_estimators100_lipreader_avg_precision_test.gif 296KB
.gitignore 1KB
26_assessor_equalClasses_syncnetUntrainable_headPose_lstm256_nOfFrames_LRdense_LRsoftmax_resnet152.json 254KB
8_assessor_resnet18_mouth512_lstm32_1fc128_bn_dp0.5_2fc64_bn_dp0.5_adam.json 41KB
28_assessor_equalClasses_syncnetUntrainable_headPose_lstm8_nOfFrames_LRdense_fc8_LRsoftmax_fc8_LRsoftmaxRatios_1fc8_bn_dp0.2_2fc16_bn_dp0.2_adam_lr0.001_lrDecay0.001.json 18KB
27_assessor_equalClasses_syncnetUntrainable_headPose_lstm8_nOfFrames_LRdense_fc8_LRsoftmax_fc8_1fc8_bn_dp0.2_2fc8_bn_dp0.2_adam_decay0.001.json 18KB
22_assessor_equalClasses_grayscaleImages_my_resnet_mouth32_lstm2_1fc16_bn_dp0.2_2fc16_bn_dp0.2_adam.json 17KB
25_assessor_equalClasses_syncnetUntrainable_lstm128_nOfFrames_LRdense_1fc8_bn_dp0.2_2fc8_bn_dp0.2_adam.json 17KB
26_assessor_equalClasses_syncnetUntrainable_lstm128_nOfFrames_LRdense_resnet18_adam.json 17KB
24_assessor_equalClasses_syncnetUntrainable_lstm128_nOfFrames_LRdense_1fc16_bn_dp0.2_2fc16_bn_dp0.2_adam.json 17KB
23_assessor_equalClasses_syncnet_lstm32_nOfFrames_LRdense_1fc16_bn_dp0.2_2fc16_bn_dp0.2_adam.json 17KB
21_assessor_equalClasses_grayscaleImages_resCNN_lstm4_1fc16_bn_dp0.2_2fc16_bn_dp0.2_adam.json 15KB
34_assessor_equalClasses_syncnetPreds_headPose_lstm8_nOfFrames_LRdense_fc8_LRsoftmax_fc8_LRsoftmaxRatios_1fc8_bn_dp0.5_2fc4_bn_dp0.5_adam_lr0.001_lrDecay0.001.json 13KB
20_assessor_equalClasses_grayscaleImages_cnn_1conv4_2conv8_3conv16_mouth128_lstm4_1fc16_bn_dp0.5_2fc16_bn_dp0.5_rmsprop.json 12KB
35_assessor_equalClasses_syncnetPreds_headPose_lstm8_nOfFrames_LRdense_fc8_LRsoftmax_fc8_LRsoftmaxRatios_1fc8_bn_dp0.5_2fc4_bn_dp0.5_adam_lr0.001_lrDecay0.001.json 11KB
43_assessor_equalClasses_syncnetPreds_headPose_lstm8_nOfFrames_LRdense_fc8_LRsoftmax_fc8_LRsoftmaxRatios_1fc8_bn_dp0.5_2fc4_bn_dp0.5_adam_lr0.001_lrDecay0.json 11KB
4_assessor_cnn_1conv32_2conv64_3conv128_mouth512_lstm32_1fc128_2fc64_adam.json 11KB
5_assessor_cnn_1conv16_2conv32_3conv64_mouth512_lstm32_1fc128_2fc64_adam.json 11KB
6_assessor_cnn_1conv16_2conv32_3conv64_mouth512_lstm32_1fc64_2fc16_adam.json 11KB
7_assessor_cnn_1conv16_2conv8_3conv4_mouth512_lstm8_1fc32_2fc8_adam.json 11KB
44_assessor_equalClasses_syncnetPreds_lstm8_nOfFrames_LRdense_fc8_LRsoftmax_fc8_LRsoftmaxRatios_1fc8_bn_dp0.5_2fc4_bn_dp0.5_residual_adam_lr0.001_lrDecay0.json 11KB
45_assessor_syncnetPreds_lstm8_nOfFrames_LRdense_fc8_LRsoftmax_fc8_LRsoftmaxRatios_1fc8_bn_dp0.5_2fc4_bn_dp0.5_residual_adam_lr0.001_lrDecay0.json 11KB
3_assessor_cnn_1conv32_2conv64_3conv128_mouth512_lstm32_1fc512_2fc128_denseNOTreg_adam.json 11KB
2_assessor_classweighted_cnn_1conv32_2conv64_3conv128_mouth512_lstm32_1fc512_2fc128_adam.json 11KB
1_assessor_classNOTweighted_cnn_mouth512_lstm32_1fc128_2fc64_denseNOTreg_adam.json 11KB
59_assessor_equalClasses_syncnetPreds_headPose_lstm256_nOfFrames_LRdense_fc128_LRsoftmax_fc64_LRsoftmaxRatios_1fc256_bn_dp0.2_2fc128_bn_dp0.2_tanh_neg_relu_adam_lr0.001_lrDecay1e-07.json 10KB
57_assessor_equalClasses_syncnetPreds_headPose_lstm128_nOfFrames_LRdense_fc128_LRsoftmax_fc64_LRsoftmaxRatios_1fc128_bn_dp0.5_2fc32_bn_dp0.5_tanh_neg_relu_adam_lr0.0001_lrDecay5e-07.json 10KB
58_assessor_equalClasses_syncnetPreds_headPose_lstm128_nOfFrames_LRdense_fc128_LRsoftmax_fc64_LRsoftmaxRatios_1fc128_bn_dp0.2_2fc32_bn_dp0.2_tanh_neg_relu_adam_lr0.001_lrDecay1e-07.json 10KB
60_assessor_equalClasses_syncnetPreds_lstm128_nOfFrames_LRdense_fc128_LRsoftmax_fc64_1fc128_bn_dp0.2_2fc32_bn_dp0.2_tanh_neg_relu_adam_lr0.001_lrDecay1e-07.json 9KB
61_assessor_equalClasses_syncnetPreds_lstm128_nOfFrames_LRdense_fc128_LRsoftmax_fc64_1fc128_bn_dp0.2_2fc32_bn_dp0.2_tanh_neg_relu_adam_lr0.001_lrDecay1e-07_trainedOn467LRWtrainWords_testingOn467Words.json 9KB
55_assessor_equalClasses_syncnetPreds_headPose_lstm128_nOfFrames_LRdense_fc128_LRsoftmax_fc64_LRsoftmaxRatios_1fc128_bn_dp0.5_2fc32_bn_dp0.5_adam_lr5e-06_lrDecay1e-06.json 9KB
56_assessor_equalClasses_syncnetPreds_headPose_lstm128_nOfFrames_LRdense_fc128_LRsoftmax_fc64_LRsoftmaxRatios_1fc128_bn_dp0.5_2fc32_bn_dp0.5_adam_lr5e-05_lrDecay5e-07.json 9KB
54_assessor_equalClasses_syncnetPreds_headPose_lstm128_nOfFrames_LRdense_fc128_LRsoftmax_fc64_LRsoftmaxRatios_1fc128_bn_dp0.2_2fc64_bn_dp0.2_adam_lr5e-05_lrDecay1e-06.json 9KB
31_assessor_equalClasses_syncnetPreds_headPose_lstm8_nOfFrames_LRdense_fc8_LRsoftmax_fc8_LRsoftmaxRatios_1fc16_bn_dp0.5_2fc16_bn_dp0.5_adam_lr0.001_lrDecay0.001.json 9KB
39_assessor_equalClasses_syncnetPreds_headPose_lstm4_nOfFrames_LRdense_fc4_LRsoftmax_fc4_LRsoftmaxRatios_1fc8_bn_dp0.5_2fc4_bn_dp0.5_adam_lr0.001_lrDecay0.json 9KB
37_assessor_equalClasses_syncnetPreds_headPose_lstm4_nOfFrames_LRdense_fc4_LRsoftmax_fc4_LRsoftmaxRatios_1fc8_bn_dp0.5_2fc4_bn_dp0.5_rmsprop.json 9KB
33_assessor_equalClasses_syncnetPreds_headPose_lstm8_nOfFrames_LRdense_fc8_LRsoftmax_fc8_LRsoftmaxRatios_1fc8_bn_dp0.5_2fc8_bn_dp0.5_adam_lr0.0005_lrDecay0.001.json 9KB
38_assessor_equalClasses_syncnetPreds_headPose_lstm4_nOfFrames_LRdense_fc4_LRsoftmax_fc4_LRsoftmaxRatios_1fc8_bn_dp0.5_2fc4_bn_dp0.5_adam_lr0.001_lrDecay0.005.json 9KB
41_assessor_equalClasses_syncnetPreds_headPose_lstm2_nOfFrames_LRdense_fc2_LRsoftmax_fc2_LRsoftmaxRatios_1fc4_bn_dp0.5_2fc2_bn_dp0.5_adam_lr0.001_lrDecay0.json 9KB
32_assessor_equalClasses_syncnetPreds_headPose_lstm8_nOfFrames_LRdense_fc8_LRsoftmax_fc8_LRsoftmaxRatios_1fc8_bn_dp0.5_2fc8_bn_dp0.5_adam_lr0.0005_lrDecay0.01.json 9KB
42_assessor_equalClasses_syncnetPreds_headPose_lstm8_nOfFrames_LRdense_fc8_LRsoftmax_fc8_LRsoftmaxRatios_1fc8_bn_dp0.5_2fc4_bn_dp0.5_adam_lr0.001_lrDecay0.json 9KB
36_assessor_equalClasses_syncnetPreds_headPose_lstm4_nOfFrames_LRdense_fc4_LRsoftmax_fc4_LRsoftmaxRatios_1fc8_bn_dp0.5_2fc4_bn_dp0.5_adam_lr0.001_lrDecay0.001.json 9KB
40_assessor_equalClasses_syncnetPreds_headPose_lstm4_nOfFrames_LRdense_fc4_LRsoftmax_fc4_LRsoftmaxRatios_1fc8_bn_dp0.5_2fc4_bn_dp0.5_adam_lr0.001_lrDecay0.json 9KB
29_assessor_equalClasses_syncnetPreds_headPose_lstm8_nOfFrames_LRdense_fc8_LRsoftmax_fc8_LRsoftmaxRatios_1fc16_bn_dp0.2_2fc16_bn_dp0.2_adam_lr0.001_lrDecay0.001.json 9KB
30_assessor_equalClasses_syncnetPreds_headPose_lstm8_nOfFrames_LRdense_fc8_LRsoftmax_fc8_LRsoftmaxRatios_1fc16_bn_dp0.5_2fc16_bn_dp0.5_adam_lr0.001_lrDecay0.001.json 9KB
53_assessor_equalClasses_syncnetPreds_lstm64_nOfFrames_LRdense_fc128_LRsoftmax_fc64_LRsoftmaxRatios_1fc64_bn_dp0.2_2fc32_bn_dp0.2_adam_lr5e-05_lrDecay1e-06.json 9KB
48_assessor_syncnetPreds_lstm64_nOfFrames_LRdense_LRdense_fc128_LRsoftmax_fc64_LRsoftmaxRatios_1fc64_bn_dp0.2_2fc32_bn_dp0.2_adam_lr0.0001_lrDecay0.json 9KB
49_assessor_syncnetPreds_lstm64_nOfFrames_LRdense_LRdense_fc128_LRsoftmax_fc64_LRsoftmaxRatios_1fc16_bn_dp0.2_2fc8_bn_dp0.2_adam_lr0.0001_lrDecay0.json 9KB
51_assessor_equalClasses_syncnetPreds_lstm64_nOfFrames_LRdense_LRdense_fc128_LRsoftmax_fc64_LRsoftmaxRatios_1fc16_bn_dp0.2_2fc8_bn_dp0.2_adam_lr5e-05_lrDecay1e-06.json 9KB
52_assessor_equalClasses_syncnetPreds_lstm64_nOfFrames_LRdense_fc128_LRsoftmax_fc64_LRsoftmaxRatios_1fc16_bn_dp0.2_2fc8_bn_dp0.2_adam_lr5e-05_lrDecay1e-06.json 9KB
50_assessor_equalClasses_syncnetPreds_lstm64_nOfFrames_LRdense_LRdense_fc128_LRsoftmax_fc64_LRsoftmaxRatios_1fc16_bn_dp0.2_2fc8_bn_dp0.2_adam_lr0.0001_lrDecay1e-07.json 9KB
46_assessor_syncnetPreds_lstm64_nOfFrames_LRdense_LRdense_fc128_LRsoftmax_fc64_LRsoftmaxRatios_1fc128_bn_dp0.2_1fc64_distance_contrastiveLoss_adam_lr0.001_lrDecay0.json 8KB
47_assessor_syncnetPreds_lstm64_nOfFrames_LRdense_LRdense_fc128_LRsoftmax_fc64_LRsoftmaxRatios_1fc128_bn_dp0.2_1fc64_distance_contrastiveLoss_adam_lr1e-05_lrDecay1e-07.json 8KB
9_assessor_flatten_lstm8_1fc128_bn_dp0.2_2fc64_bn_dp0.2_adam.json 6KB
10_assessor_flatten_lstm4_1fc64_bn_dp0.2_2fc32_bn_dp0.2_adam.json 6KB
13_assessor_equalClasses_1fc32_bn_dp0.5_2fc16_bn_dp0.5_adam.json 4KB
14_assessor_equalClasses_1fc16_bn_dp0.5_2fc16_bn_dp0.5_adam.json 4KB
19_assessor_equalClasses_1fc16_bn_dp0.5_2fc16_bn_dp0.5_sgd.json 4KB
17_assessor_equalClasses_1fc16_bn_dp0.5_2fc16_bn_dp0.5_sgd.json 4KB
11_assessor_equalClasses_1fc64_bn_dp0.2_2fc32_bn_dp0.2_adam.json 4KB
18_assessor_equalClasses_1fc16_bn_dp0.5_2fc16_bn_dp0.5_sgd.json 4KB
12_assessor_equalClasses_1fc32_bn_dp0.5_2fc16_bn_dp0.5_adam.json 4KB
15_assessor_equalClasses_1fc16_bn_dp0.5_2fc8_bn_dp0.5_adam.json 4KB
16_assessor_equalClasses_1fc16_bn_dp0.5_2fc8_bn_dp0.5_sgd.json 4KB
README.md 4KB
log.md 2KB
README.md 980B
README.md 847B
readme_shape_predictor.md 488B
LRW_train_lipreader_softmax_ratios.npy 1.53MB
LRW_test_lipreader_softmax_ratios.npy 391KB
LRW_val_lipreader_softmax_ratios.npy 391KB
1_assessor_classNOTweighted_cnn_mouth512_lstm32_1fc128_2fc64_denseNOTreg_adam_lrw_test_preds.npy 195KB
3_assessor_cnn_1conv32_2conv64_3conv128_mouth512_lstm32_1fc512_2fc128_denseNOTreg_adam_lrw_test_preds.npy 195KB
3_assessor_cnn_1conv32_2conv64_3conv128_mouth512_lstm32_1fc512_2fc128_denseNOTreg_adam_lrw_val_preds.npy 195KB
2_assessor_classweighted_cnn_1conv32_2conv64_3conv128_mouth512_lstm32_1fc512_2fc128_denseNOTreg_adam_lrw_test_preds.npy 195KB
1_assessor_classNOTweighted_cnn_mouth512_lstm32_1fc128_2fc64_denseNOTreg_adam_lrw_val_preds.npy 195KB
2_assessor_classweighted_cnn_1conv32_2conv64_3conv128_mouth512_lstm32_1fc512_2fc128_denseNOTreg_adam_lrw_val_preds.npy 195KB
lrw_test_assessor_preds.npy 195KB
5_assessor_cnn_1conv16_2conv32_3conv64_mouth512_lstm32_1fc128_2fc64_adam_lrw_val_preds.npy 195KB
11_assessor_equalClasses_1fc64_bn_dp0.2_2fc32_bn_dp0.2_adam_lrw_val_preds_latest.npy 195KB
11_assessor_equalClasses_1fc64_bn_dp0.2_2fc32_bn_dp0.2_adam_lrw_test_preds.npy 195KB
4_assessor_cnn_1conv32_2conv64_3conv128_mouth512_lstm32_1fc128_2fc64_adam_lrw_val_preds.npy 195KB
4_assessor_cnn_1conv32_2conv64_3conv128_mouth512_lstm32_1fc128_2fc64_adam_lrw_test_preds.npy 195KB
11_assessor_equalClasses_1fc64_bn_dp0.2_2fc32_bn_dp0.2_adam_lrw_test_preds_latest.npy 195KB
11_assessor_equalClasses_1fc64_bn_dp0.2_2fc32_bn_dp0.2_adam_lrw_val_preds.npy 195KB
5_assessor_cnn_1conv16_2conv32_3conv64_mouth512_lstm32_1fc128_2fc64_adam_lrw_test_preds.npy 78KB
n_of_syllables.npy 4KB
bilabial_or_not.npy 4KB
RF_woDense_woSM_wSyncnetPreds_defaultData_estimators10.pkl 809KB
RF_withSyncnetPreds_mix2525_estimators10.pkl 728KB
RF_withSyncnetPreds_defaultTrainTest_estimators10.pkl 628KB
XGBOOST_full_testSplit0.1.pkl 17KB
logReg_unopt_attributes_balanced.pkl 8KB
logReg_unopt_attributes.pkl 8KB
共 1613 条
- 1
- 2
- 3
- 4
- 5
- 6
- 17
资源评论
绘画窝
- 粉丝: 21
- 资源: 4715
上传资源 快速赚钱
- 我的内容管理 展开
- 我的资源 快来上传第一个资源
- 我的收益 登录查看自己的收益
- 我的积分 登录查看自己的积分
- 我的C币 登录后查看C币余额
- 我的收藏
- 我的下载
- 下载帮助
安全验证
文档复制为VIP权益,开通VIP直接复制
信息提交成功