模型并行[GPT2]和类似[GPT3]的模型的实现-Python开发
需积分: 37 195 浏览量
2021-05-25
11:39:08
上传
评论
收藏 83KB ZIP 举报
gpt-neo-master.zip （43个子文件） 
gpt-neo-master 
encoders.py 885B .gitignore 1KB Dockerfile 455B
requirements.txt 235B tasks.py 4KB data encoders.py 875B train_tokenizer.py 2KB create_tfrecords.py 12KB sample.py 9KB GPTNeo_example_notebook.ipynb 116KB CODEOWNERS 23B optimizers.py 6KB test_models.py 6KB models activations.py 4KB gpt2 gpt2.py 10KB layers.py 15KB utils.py 4KB LICENSE 1KB docker-compose.yml 2KB .github ISSUE_TEMPLATE bug_report.md 713B feature_request.md 608B workflows pytest.yml 885B utils.py 10KB model_fns.py 14KB README.md 21KB configs gpt3_XL_256_Pile.json 974B gpt3_6-7B_256.json 907B gpt3_medium_256.json 916B gpt3_13B_256_Pile.json 977B gpt3_large_256.json 1007B gpt3_13B_256.json 1KB gpt3_small_256.json 936B gpt2_small.json 900B gpt3_PAR_small_256.json 970B dataset_configs pile.json 229B openwebtext2_new_inputs.json 271B example.json 195B gpt3_2-7B_256.json 959B run_experiment.py 10KB main.py 11KB inputs.py 15KB export.py 501B configs.py 2KB资源评论
