馃摎 This guide explains how to use **Weights & Biases** (W&B) with YOLOv5 馃殌. UPDATED 29 September 2021.
* [About Weights & Biases](#about-weights-&-biases)
* [First-Time Setup](#first-time-setup)
* [Viewing runs](#viewing-runs)
* [Disabling wandb](#disabling-wandb)
* [Advanced Usage: Dataset Versioning and Evaluation](#advanced-usage)
* [Reports: Share your work with the world!](#reports)
## About Weights & Biases
Think of [W&B](https://wandb.ai/site?utm_campaign=repo_yolo_wandbtutorial) like GitHub for machine learning models. With a few lines of code, save everything you need to debug, compare and reproduce your models 鈥� architecture, hyperparameters, git commits, model weights, GPU usage, and even datasets and predictions.
Used by top researchers including teams at OpenAI, Lyft, Github, and MILA, W&B is part of the new standard of best practices for machine learning. How W&B can help you optimize your machine learning workflows:
* [Debug](https://wandb.ai/wandb/getting-started/reports/Visualize-Debug-Machine-Learning-Models--VmlldzoyNzY5MDk#Free-2) model performance in real time
* [GPU usage](https://wandb.ai/wandb/getting-started/reports/Visualize-Debug-Machine-Learning-Models--VmlldzoyNzY5MDk#System-4) visualized automatically
* [Custom charts](https://wandb.ai/wandb/customizable-charts/reports/Powerful-Custom-Charts-To-Debug-Model-Peformance--VmlldzoyNzY4ODI) for powerful, extensible visualization
* [Share insights](https://wandb.ai/wandb/getting-started/reports/Visualize-Debug-Machine-Learning-Models--VmlldzoyNzY5MDk#Share-8) interactively with collaborators
* [Optimize hyperparameters](https://docs.wandb.com/sweeps) efficiently
* [Track](https://docs.wandb.com/artifacts) datasets, pipelines, and production models
## First-Time Setup
<details open>
<summary> Toggle Details </summary>
When you first train, W&B will prompt you to create a new account and will generate an **API key** for you. If you are an existing user you can retrieve your key from https://wandb.ai/authorize. This key is used to tell W&B where to log your data. You only need to supply your key once, and then it is remembered on the same device.
W&B will create a cloud **project** (default is 'YOLOv5') for your training runs, and each new training run will be provided a unique run **name** within that project as project/name. You can also manually set your project and run name as:
```shell
$ python train.py --project ... --name ...
```
YOLOv5 notebook example: <a href="https://colab.research.google.com/github/ultralytics/yolov5/blob/master/tutorial.ipynb"><img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab"></a> <a href="https://www.kaggle.com/ultralytics/yolov5"><img src="https://kaggle.com/static/images/open-in-kaggle.svg" alt="Open In Kaggle"></a>
<img width="960" alt="Screen Shot 2021-09-29 at 10 23 13 PM" src="https://user-images.githubusercontent.com/26833433/135392431-1ab7920a-c49d-450a-b0b0-0c86ec86100e.png">
</details>
## Viewing Runs
<details open>
<summary> Toggle Details </summary>
Run information streams from your environment to the W&B cloud console as you train. This allows you to monitor and even cancel runs in <b>realtime</b> . All important information is logged:
* Training & Validation losses
* Metrics: Precision, Recall, [email protected], [email protected]:0.95
* Learning Rate over time
* A bounding box debugging panel, showing the training progress over time
* GPU: Type, **GPU Utilization**, power, temperature, **CUDA memory usage**
* System: Disk I/0, CPU utilization, RAM memory usage
* Your trained model as W&B Artifact
* Environment: OS and Python types, Git repository and state, **training command**
<p align="center"><img width="900" alt="Weights & Biases dashboard" src="https://user-images.githubusercontent.com/26833433/135390767-c28b050f-8455-4004-adb0-3b730386e2b2.png"></p>
</details>
## Disabling wandb
* training after running `wandb disabled` inside that directory creates no wandb run
![Screenshot (84)](https://user-images.githubusercontent.com/15766192/143441777-c780bdd7-7cb4-4404-9559-b4316030a985.png)
* To enable wandb again, run `wandb online`
![Screenshot (85)](https://user-images.githubusercontent.com/15766192/143441866-7191b2cb-22f0-4e0f-ae64-2dc47dc13078.png)
## Advanced Usage
You can leverage W&B artifacts and Tables integration to easily visualize and manage your datasets, models and training evaluations. Here are some quick examples to get you started.
<details open>
<h3> 1: Train and Log Evaluation simultaneousy </h3>
This is an extension of the previous section, but it'll also training after uploading the dataset. <b> This also evaluation Table</b>
Evaluation table compares your predictions and ground truths across the validation set for each epoch. It uses the references to the already uploaded datasets,
so no images will be uploaded from your system more than once.
<details open>
<summary> <b>Usage</b> </summary>
<b>Code</b> <code> $ python train.py --upload_data val</code>
![Screenshot from 2021-11-21 17-40-06](https://user-images.githubusercontent.com/15766192/142761183-c1696d8c-3f38-45ab-991a-bb0dfd98ae7d.png)
</details>
<h3>2. Visualize and Version Datasets</h3>
Log, visualize, dynamically query, and understand your data with <a href='https://docs.wandb.ai/guides/data-vis/tables'>W&B Tables</a>. You can use the following command to log your dataset as a W&B Table. This will generate a <code>{dataset}_wandb.yaml</code> file which can be used to train from dataset artifact.
<details>
<summary> <b>Usage</b> </summary>
<b>Code</b> <code> $ python utils/logger/wandb/log_dataset.py --project ... --name ... --data .. </code>
![Screenshot (64)](https://user-images.githubusercontent.com/15766192/128486078-d8433890-98a3-4d12-8986-b6c0e3fc64b9.png)
</details>
<h3> 3: Train using dataset artifact </h3>
When you upload a dataset as described in the first section, you get a new config file with an added `_wandb` to its name. This file contains the information that
can be used to train a model directly from the dataset artifact. <b> This also logs evaluation </b>
<details>
<summary> <b>Usage</b> </summary>
<b>Code</b> <code> $ python train.py --data {data}_wandb.yaml </code>
![Screenshot (72)](https://user-images.githubusercontent.com/15766192/128979739-4cf63aeb-a76f-483f-8861-1c0100b938a5.png)
</details>
<h3> 4: Save model checkpoints as artifacts </h3>
To enable saving and versioning checkpoints of your experiment, pass `--save_period n` with the base cammand, where `n` represents checkpoint interval.
You can also log both the dataset and model checkpoints simultaneously. If not passed, only the final model will be logged
<details>
<summary> <b>Usage</b> </summary>
<b>Code</b> <code> $ python train.py --save_period 1 </code>
![Screenshot (68)](https://user-images.githubusercontent.com/15766192/128726138-ec6c1f60-639d-437d-b4ee-3acd9de47ef3.png)
</details>
</details>
<h3> 5: Resume runs from checkpoint artifacts. </h3>
Any run can be resumed using artifacts if the <code>--resume</code> argument starts with聽<code>wandb-artifact://</code>聽prefix followed by the run path, i.e,聽<code>wandb-artifact://username/project/runid </code>. This doesn't require the model checkpoint to be present on the local system.
<details>
<summary> <b>Usage</b> </summary>
<b>Code</b> <code> $ python train.py --resume wandb-artifact://{run_path} </code>
![Screenshot (70)](https://user-images.githubusercontent.com/15766192/128728988-4e84b355-6c87-41ae-a591-14aecf45343e.png)
</details>
<h3> 6: Resume runs from dataset artifact & checkpoint artifacts. </h3>
<b> Local dataset or model checkpoints are not required. This can be used to resume runs directly on a different device </b>
The syntax is same as the previous section, but you'll need to lof both the dataset and model checkpoints as artifacts, i.e, set bot <code>--upload_dataset<
没有合适的资源?快使用搜索试试~ 我知道了~
资源推荐
资源详情
资源评论
收起资源包目录
优秀毕设项目:基于YOLOv5的道路标志识别系统,使用了MySQL数据库,PyQt5进行界面设计.zip (276个子文件)
events.out.tfevents.1677232745.AItrainee.2552.0 1.95MB
results.csv 6KB
Dockerfile 821B
best1.engine 17.09MB
best.engine 17.05MB
infinity-2147002.jpg 1.7MB
infinity-14816879.jpg 1.7MB
val_batch1_pred.jpg 618KB
val_batch1_labels.jpg 611KB
val_batch0_pred.jpg 598KB
val_batch0_labels.jpg 591KB
val_batch2_pred.jpg 578KB
val_batch2_labels.jpg 573KB
bus.jpg 476KB
train_batch1.jpg 458KB
train_batch2.jpg 441KB
train_batch0.jpg 426KB
labels_correlogram.jpg 206KB
zidane.jpg 165KB
labels.jpg 131KB
result3.jpg 53KB
result.jpg 29KB
result2.jpg 29KB
OIP.jpg 15KB
Snipaste_2023-02-08_14-38-46.jpg 14KB
annotations_all.json 3.32MB
TT100K_VOC_classes.json 632B
setting.json 84B
ip.json 53B
fold.json 32B
README.md 11KB
README.md 2KB
README_cn.md 2KB
README.md 2KB
README.md 1B
best.onnx 14.09MB
best1.onnx 14.09MB
zidane.png 1.92MB
yjtp-modified.png 816KB
img.png 702KB
标志识别.png 621KB
F1_curve.png 503KB
P_curve.png 448KB
R_curve.png 333KB
results.png 291KB
confusion_matrix.png 199KB
img_3.png 166KB
数据库.png 157KB
图像处理完成.png 134KB
图像处理与数据增强.png 134KB
PR_curve.png 132KB
img_1.png 130KB
img_4.png 101KB
img_2.png 89KB
初始化参数.png 88KB
数据分析.png 78KB
登陆.png 46KB
img_5.png 31KB
模.png 9KB
6-医疗-神经网络.png 9KB
摄像头_camera-one.png 8KB
摄像头_camera-five.png 8KB
img.png 7KB
监控摄像头_surveillance-cameras-two.png 7KB
赞停.png 6KB
圆形选中.png 6KB
摄像头.png 6KB
摄像头 (1).png 6KB
3.1关注-选中.png 6KB
3.1关注-选中 (1).png 6KB
6-医疗-神经网络 (2).png 5KB
人工智能机器人*.png 5KB
播放 (1).png 5KB
6-医疗-神经网络 (1).png 5KB
彩友多_跟单-未选中.png 5KB
链接.png 5KB
开始.png 5KB
29道路.png 5KB
打开.png 5KB
摄像头 (4).png 4KB
摄像头开.png 4KB
模型中心.png 4KB
创建_newlybuild.png 4KB
数据探索.png 4KB
数据探索.png 4KB
分享_share.png 4KB
摄像头 (3).png 4KB
摄像头 (2).png 4KB
关闭 (4).png 4KB
关闭 (2).png 4KB
保存硬盘_save-one.png 4KB
关闭 (1).png 4KB
圆点.png 3KB
停止.png 3KB
停止.png 3KB
摄像头关.png 3KB
摄像头关.png 3KB
文件夹-打开-没文件.png 3KB
wnt_预警报警.png 3KB
evil.png 3KB
共 276 条
- 1
- 2
- 3
资源评论
- 我走路带风~2024-05-04资源值得借鉴的内容很多,那就浅学一下吧,值得下载!
- jinghongguang2023-12-16资源很受用,资源主总结的很全面,内容与描述一致,解决了我当下的问题。
学术菜鸟小晨
- 粉丝: 1w+
- 资源: 4940
下载权益
C知道特权
VIP文章
课程特权
开通VIP
上传资源 快速赚钱
- 我的内容管理 展开
- 我的资源 快来上传第一个资源
- 我的收益 登录查看自己的收益
- 我的积分 登录查看自己的积分
- 我的C币 登录后查看C币余额
- 我的收藏
- 我的下载
- 下载帮助
安全验证
文档复制为VIP权益,开通VIP直接复制
信息提交成功