An_all-in-one_toolkit_for_computer_vision_EasyCV.zip

<div align="center"> [](https://pypi.org/project/pai-easycv/) [](https://easy-cv.readthedocs.io/en/latest/) [](https://github.com/open-mmlab/mmdetection/blob/master/LICENSE) [](https://github.com/alibaba/EasyCV/issues) [](https://GitHub.com/alibaba/EasyCV/pull/) [](https://GitHub.com/alibaba/EasyCV/commit/) <!-- [](https://GitHub.com/alibaba/EasyCV/graphs/contributors/) --> <!-- [](http://makeapullrequest.com) --> </div> # EasyCV English | [简体中文](README_zh-CN.md) ## Introduction EasyCV is an all-in-one computer vision toolbox based on PyTorch, mainly focuses on self-supervised learning, transformer based models, and major CV tasks including image classification, metric-learning, object detection, pose estimation and so on. ### Major features - **SOTA SSL Algorithms** EasyCV provides state-of-the-art algorithms in self-supervised learning based on contrastive learning such as SimCLR, MoCO V2, Swav, DINO and also MAE based on masked image modeling. We also provide standard benchmarking tools for ssl model evaluation. - **Vision Transformers** EasyCV aims to provide an easy way to use the off-the-shelf SOTA transformer models trained either using supervised learning or self-supervised learning, such as ViT, Swin Transformer and DETR Series. More models will be added in the future. In addition, we support all the pretrained models from [timm](https://github.com/rwightman/pytorch-image-models). - **Functionality & Extensibility** In addition to SSL, EasyCV also supports image classification, object detection, metric learning, and more areas will be supported in the future. Although covering different areas, EasyCV decomposes the framework into different components such as dataset, model and running hook, making it easy to add new components and combining it with existing modules. EasyCV provides simple and comprehensive interface for inference. Additionally, all models are supported on [PAI-EAS](https://help.aliyun.com/document_detail/113696.html), which can be easily deployed as online service and support automatic scaling and service monitoring. - **Efficiency** EasyCV supports multi-gpu and multi worker training. EasyCV uses [DALI](https://github.com/NVIDIA/DALI) to accelerate data io and preprocessing process, and uses [TorchAccelerator](https://github.com/alibaba/EasyCV/tree/master/docs/source/tutorials/torchacc.md) and fp16 to accelerate training process. For inference optimization, EasyCV exports model using jit script, which can be optimized by [PAI-Blade](https://help.aliyun.com/document_detail/205134.html) ## What's New [🔥 Latest News] We have released our YOLOX-PAI that achieves SOTA results within 40~50 mAP (less than 1ms). And we also provide a convenient and fast export/predictor api for end2end object detection. To get a quick start of YOLOX-PAI, click [here](docs/source/tutorials/yolox.md)! * 31/08/2022 EasyCV v0.6.0 was released. - Release YOLOX-PAI which achieves SOTA results within 40~50 mAP (less than 1ms) - Add detection algo DINO which achieves 58.5 mAP on COCO - Add mask2former algo - Releases imagenet1k, imagenet22k, coco, lvis, voc2012 data with BaiduDisk to accelerate downloading Please refer to [change_log.md](docs/source/change_log.md) for more details and history. ## Technical Articles We have a series of technical articles on the functionalities of EasyCV. * [EasyCV开源｜开箱即用的视觉自监督+Transformer算法库](https://zhuanlan.zhihu.com/p/505219993) * [MAE自监督算法介绍和基于EasyCV的复现](https://zhuanlan.zhihu.com/p/515859470) * [基于EasyCV复现ViTDet：单层特征超越FPN](https://zhuanlan.zhihu.com/p/528733299) * [基于EasyCV复现DETR和DAB-DETR，Object Query的正确打开方式](https://zhuanlan.zhihu.com/p/543129581) ## Installation Please refer to the installation section in [quick_start.md](docs/source/quick_start.md) for installation. ## Get Started Please refer to [quick_start.md](docs/source/quick_start.md) for quick start. We also provides tutorials for more usages. * [self-supervised learning](docs/source/tutorials/ssl.md) * [image classification](docs/source/tutorials/cls.md) * [object detection with yolox-pai](docs/source/tutorials/yolox.md) * [model compression with yolox](docs/source/tutorials/compression.md) * [metric learning](docs/source/tutorials/metric_learning.md) * [torchacc](docs/source/tutorials/torchacc.md) notebook * [self-supervised learning](docs/source/tutorials/EasyCV图像自监督训练-MAE.ipynb) * [image classification](docs/source/tutorials/EasyCV图像分类resnet50.ipynb) * [object detection with yolox-pai](docs/source/tutorials/EasyCV图像检测YoloX.ipynb) * [metric learning](docs/source/tutorials/EasyCV度量学习resnet50.ipynb) ## Model Zoo <div align="center"> <b>Architectures</b> </div> <table align="center"> <tbody> <tr align="center"> <td> <b>Self-Supervised Learning</b> </td> <td> <b>Image Classification</b> </td> <td> <b>Object Detection</b> </td> <td> <b>Segmentation</b> </td> </tr> <tr valign="top"> <td> <ul> <li><a href="configs/selfsup/byol">BYOL (NeurIPS'2020)</a></li> <li><a href="configs/selfsup/dino">DINO (ICCV'2021)</a></li> <li><a href="configs/selfsup/mixco">MiXCo (NeurIPS'2020)</a></li> <li><a href="configs/selfsup/moby">MoBY (ArXiv'2021)</a></li> <li><a href="configs/selfsup/mocov2">MoCov2 (ArXiv'2020)</a></li> <li><a href="configs/selfsup/simclr">SimCLR (ICML'2020)</a></li> <li><a href="configs/selfsup/swav">SwAV (NeurIPS'2020)</a></li> <li><a href="configs/selfsup/mae">MAE (CVPR'2022)</a></li> <li><a href="configs/selfsup/fast_convmae">FastConvMAE (ArXiv'2022)</a></li> </ul> </td> <td> <ul> <li><a href="configs/classification/imagenet/resnet">ResNet (CVPR'2016)</a></li> <li><a href="configs/classification/imagenet/resnext">ResNeXt (CVPR'2017)</a></li> <li><a href="configs/classification/imagenet/hrnet">HRNet (CVPR'2019)</a></li> <li><a href="configs/classification/imagenet/vit">ViT (ICLR'2021)</a></li> <li><a href="configs/classification/imagenet/swint">SwinT (ICCV'2021)</a></li> <li><a href="configs/classification/imagenet/efficientformer">EfficientFormer (ArXiv'2022)</a></li> <li><a href="configs/classification/imagenet/timm/deit">DeiT (ICML'2021)</a></li> <li><a href="configs/classification/imagenet/timm/xcit">XCiT (ArXiv'2021)</a></li> <li><a href="configs/classification/imagenet/timm/tnt">TNT (NeurIPS'2021)</a></li> <li><a href="configs/classification/imagenet/timm/convit">ConViT (ArXiv'2021)</a></li> <li><a href="configs/classification/imagenet/timm/cait">CaiT (ICCV'2021)</a></li> <li><a href="configs/classification/imagenet/timm/levit">LeViT (ICCV'2021)</a></li> <li><a href="configs/classification/imagenet/timm/convnext">ConvNeXt (CVPR'2022)</a></li> <li><a href="configs/classification/imagenet/timm/resmlp">ResMLP (ArXiv'2021)</a></li> <li><a href="configs/classification/imagenet/timm/coat">CoaT (ICCV'2021)</a></li> <li><a href="configs/classificati