馃摎 This guide explains how to use **Weights & Biases** (W&B) with YOLOv5 馃殌. UPDATED 29 September 2021.
- [About Weights & Biases](#about-weights-&-biases)
- [First-Time Setup](#first-time-setup)
- [Viewing runs](#viewing-runs)
- [Disabling wandb](#disabling-wandb)
- [Advanced Usage: Dataset Versioning and Evaluation](#advanced-usage)
- [Reports: Share your work with the world!](#reports)
## About Weights & Biases
Think of [W&B](https://wandb.ai/site?utm_campaign=repo_yolo_wandbtutorial) like GitHub for machine learning models. With a few lines of code, save everything you need to debug, compare and reproduce your models 鈥� architecture, hyperparameters, git commits, model weights, GPU usage, and even datasets and predictions.
Used by top researchers including teams at OpenAI, Lyft, Github, and MILA, W&B is part of the new standard of best practices for machine learning. How W&B can help you optimize your machine learning workflows:
- [Debug](https://wandb.ai/wandb/getting-started/reports/Visualize-Debug-Machine-Learning-Models--VmlldzoyNzY5MDk#Free-2) model performance in real time
- [GPU usage](https://wandb.ai/wandb/getting-started/reports/Visualize-Debug-Machine-Learning-Models--VmlldzoyNzY5MDk#System-4) visualized automatically
- [Custom charts](https://wandb.ai/wandb/customizable-charts/reports/Powerful-Custom-Charts-To-Debug-Model-Peformance--VmlldzoyNzY4ODI) for powerful, extensible visualization
- [Share insights](https://wandb.ai/wandb/getting-started/reports/Visualize-Debug-Machine-Learning-Models--VmlldzoyNzY5MDk#Share-8) interactively with collaborators
- [Optimize hyperparameters](https://docs.wandb.com/sweeps) efficiently
- [Track](https://docs.wandb.com/artifacts) datasets, pipelines, and production models
## First-Time Setup
<details open>
<summary> Toggle Details </summary>
When you first train, W&B will prompt you to create a new account and will generate an **API key** for you. If you are an existing user you can retrieve your key from https://wandb.ai/authorize. This key is used to tell W&B where to log your data. You only need to supply your key once, and then it is remembered on the same device.
W&B will create a cloud **project** (default is 'YOLOv5') for your training runs, and each new training run will be provided a unique run **name** within that project as project/name. You can also manually set your project and run name as:
```shell
$ python train.py --project ... --name ...
```
YOLOv5 notebook example: <a href="https://colab.research.google.com/github/ultralytics/yolov5/blob/master/tutorial.ipynb"><img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab"></a> <a href="https://www.kaggle.com/ultralytics/yolov5"><img src="https://kaggle.com/static/images/open-in-kaggle.svg" alt="Open In Kaggle"></a>
<img width="960" alt="Screen Shot 2021-09-29 at 10 23 13 PM" src="https://user-images.githubusercontent.com/26833433/135392431-1ab7920a-c49d-450a-b0b0-0c86ec86100e.png">
</details>
## Viewing Runs
<details open>
<summary> Toggle Details </summary>
Run information streams from your environment to the W&B cloud console as you train. This allows you to monitor and even cancel runs in <b>realtime</b> . All important information is logged:
- Training & Validation losses
- Metrics: Precision, Recall, mAP@0.5, mAP@0.5:0.95
- Learning Rate over time
- A bounding box debugging panel, showing the training progress over time
- GPU: Type, **GPU Utilization**, power, temperature, **CUDA memory usage**
- System: Disk I/0, CPU utilization, RAM memory usage
- Your trained model as W&B Artifact
- Environment: OS and Python types, Git repository and state, **training command**
<p align="center"><img width="900" alt="Weights & Biases dashboard" src="https://user-images.githubusercontent.com/26833433/135390767-c28b050f-8455-4004-adb0-3b730386e2b2.png"></p>
</details>
## Disabling wandb
- training after running `wandb disabled` inside that directory creates no wandb run
![Screenshot (84)](https://user-images.githubusercontent.com/15766192/143441777-c780bdd7-7cb4-4404-9559-b4316030a985.png)
- To enable wandb again, run `wandb online`
![Screenshot (85)](https://user-images.githubusercontent.com/15766192/143441866-7191b2cb-22f0-4e0f-ae64-2dc47dc13078.png)
## Advanced Usage
You can leverage W&B artifacts and Tables integration to easily visualize and manage your datasets, models and training evaluations. Here are some quick examples to get you started.
<details open>
<h3> 1: Train and Log Evaluation simultaneousy </h3>
This is an extension of the previous section, but it'll also training after uploading the dataset. <b> This also evaluation Table</b>
Evaluation table compares your predictions and ground truths across the validation set for each epoch. It uses the references to the already uploaded datasets,
so no images will be uploaded from your system more than once.
<details open>
<summary> <b>Usage</b> </summary>
<b>Code</b> <code> $ python train.py --upload_data val</code>
![Screenshot from 2021-11-21 17-40-06](https://user-images.githubusercontent.com/15766192/142761183-c1696d8c-3f38-45ab-991a-bb0dfd98ae7d.png)
</details>
<h3>2. Visualize and Version Datasets</h3>
Log, visualize, dynamically query, and understand your data with <a href='https://docs.wandb.ai/guides/data-vis/tables'>W&B Tables</a>. You can use the following command to log your dataset as a W&B Table. This will generate a <code>{dataset}_wandb.yaml</code> file which can be used to train from dataset artifact.
<details>
<summary> <b>Usage</b> </summary>
<b>Code</b> <code> $ python utils/logger/wandb/log_dataset.py --project ... --name ... --data .. </code>
![Screenshot (64)](https://user-images.githubusercontent.com/15766192/128486078-d8433890-98a3-4d12-8986-b6c0e3fc64b9.png)
</details>
<h3> 3: Train using dataset artifact </h3>
When you upload a dataset as described in the first section, you get a new config file with an added `_wandb` to its name. This file contains the information that
can be used to train a model directly from the dataset artifact. <b> This also logs evaluation </b>
<details>
<summary> <b>Usage</b> </summary>
<b>Code</b> <code> $ python train.py --data {data}_wandb.yaml </code>
![Screenshot (72)](https://user-images.githubusercontent.com/15766192/128979739-4cf63aeb-a76f-483f-8861-1c0100b938a5.png)
</details>
<h3> 4: Save model checkpoints as artifacts </h3>
To enable saving and versioning checkpoints of your experiment, pass `--save_period n` with the base cammand, where `n` represents checkpoint interval.
You can also log both the dataset and model checkpoints simultaneously. If not passed, only the final model will be logged
<details>
<summary> <b>Usage</b> </summary>
<b>Code</b> <code> $ python train.py --save_period 1 </code>
![Screenshot (68)](https://user-images.githubusercontent.com/15766192/128726138-ec6c1f60-639d-437d-b4ee-3acd9de47ef3.png)
</details>
</details>
<h3> 5: Resume runs from checkpoint artifacts. </h3>
Any run can be resumed using artifacts if the <code>--resume</code> argument starts with聽<code>wandb-artifact://</code>聽prefix followed by the run path, i.e,聽<code>wandb-artifact://username/project/runid </code>. This doesn't require the model checkpoint to be present on the local system.
<details>
<summary> <b>Usage</b> </summary>
<b>Code</b> <code> $ python train.py --resume wandb-artifact://{run_path} </code>
![Screenshot (70)](https://user-images.githubusercontent.com/15766192/128728988-4e84b355-6c87-41ae-a591-14aecf45343e.png)
</details>
<h3> 6: Resume runs from dataset artifact & checkpoint artifacts. </h3>
<b> Local dataset or model checkpoints are not required. This can be used to resume runs directly on a different device </b>
The syntax is same as the previous section, but you'll need to lof both the dataset and model checkpoints as artifacts, i.e, set bot <code>--upload_dataset</code> or
train fro
没有合适的资源?快使用搜索试试~ 我知道了~
温馨提示
基于yolov5的安全帽头盔检测系统源码+数据模型(高分毕业设计).zip 该项目是个人毕业设计项目源码,评审分达到95分以上,都经过严格调试,确保可以运行!放心下载使用。 基于yolov5的安全帽头盔检测系统源码+数据模型(高分毕业设计).zip 该项目是个人毕业设计项目源码,评审分达到95分以上,都经过严格调试,确保可以运行!放心下载使用。 基于yolov5的安全帽头盔检测系统源码+数据模型(高分毕业设计).zip 该项目是个人毕业设计项目源码,评审分达到95分以上,都经过严格调试,确保可以运行!放心下载使用。 基于yolov5的安全帽头盔检测系统源码+数据模型(高分毕业设计).zip 该项目是个人毕业设计项目源码,评审分达到95分以上,都经过严格调试,确保可以运行!放心下载使用。 基于yolov5的安全帽头盔检测系统源码+数据模型(高分毕业设计).zip 该项目是个人毕业设计项目源码,评审分达到95分以上,都经过严格调试,确保可以运行!放心下载使用。 基于yolov5的安全帽头盔检测系统源码+数据模型(高分毕业设计).zip 该项目是个人毕业设计项目源码,评审分达到95分以
资源推荐
资源详情
资源评论
收起资源包目录
基于yolov5的安全帽头盔检测系统源码+数据模型(高分毕业设计).zip (149个子文件)
Dockerfile 2KB
Dockerfile 821B
Dockerfile-cpu 1KB
.dockerignore 4KB
visualize_tool_gif_v2_1.gif 8.84MB
visualize_tool_gif_v2_0.gif 6.24MB
visualize_tool_gif_v1_0.gif 5.87MB
.gitignore 2KB
icon.ico 9KB
test_batch0_gt.jpg 475KB
test_batch0_pred.jpg 474KB
test_batch0_gt.jpg 462KB
output_2.jpg 301KB
area_output_1.jpg 278KB
background.jpg 181KB
output_4.jpg 161KB
output_1.jpg 144KB
area_output_2.jpg 136KB
1.jpg 109KB
output_3.jpg 78KB
BuyMeACoffee.jpg 67KB
WeChat.jpg 65KB
2.jpg 57KB
1.json 704B
2.json 491B
setting.json 60B
fold.json 59B
ip.json 52B
LICENSE 34KB
README.md 11KB
README.md 10KB
Visualize_Tool_Tutorial.md 2KB
README.md 2KB
test1.mp4 12.87MB
背景.png 2.39MB
图片1.png 101KB
运行.png 9KB
play.png 8KB
赞停.png 6KB
File_tree.png 5KB
conan.png 4KB
表情.png 4KB
数据探索.png 4KB
pause.png 4KB
停止.png 3KB
摄像头关.png 3KB
doctor.png 3KB
evil.png 3KB
摄像头开.png 3KB
实时视频流解析.png 2KB
button-on.png 2KB
暂停.png 2KB
打开.png 2KB
终止.png 1KB
button-off.png 1KB
圆.png 1KB
笑脸.png 786B
正方形.png 718B
箭头_列表展开.png 668B
箭头_列表收起.png 645B
关闭.png 605B
还原.png 601B
下拉_白色.png 573B
最大化.png 406B
最小化.png 249B
utils.py 50KB
general.py 39KB
visual_interface.py 38KB
datasets.py 37KB
main_window.py 29KB
wandb_utils.py 27KB
train.py 26KB
plots.py 22KB
tf.py 21KB
metrics.py 14KB
common.py 13KB
test.py 13KB
augmentations.py 12KB
yolo.py 11KB
detect_visual.py 11KB
loss.py 10KB
torch_utils.py 9KB
__init__.py 8KB
area_detect.py 8KB
autoanchor.py 7KB
detect.py 7KB
downloads.py 6KB
gen_head_helmet.py 6KB
benchmarks.py 6KB
experimental.py 5KB
google_utils.py 4KB
custom_util.py 4KB
denglu.py 4KB
rtsp_dialog.py 3KB
export.py 3KB
callbacks.py 2KB
warn.py 2KB
autobatch.py 2KB
activations.py 2KB
restapi.py 1KB
共 149 条
- 1
- 2
资源评论
- Destiny1722024-01-01资源很实用,对我启发很大,有很好的参考价值,内容详细。
盈梓的博客
- 粉丝: 6950
- 资源: 1402
上传资源 快速赚钱
- 我的内容管理 展开
- 我的资源 快来上传第一个资源
- 我的收益 登录查看自己的收益
- 我的积分 登录查看自己的积分
- 我的C币 登录后查看C币余额
- 我的收藏
- 我的下载
- 下载帮助
安全验证
文档复制为VIP权益,开通VIP直接复制
信息提交成功