加入CODE CHINA

· 不限速    · 不限空间    · 不限人数    · 私仓免费

免费加入
README.md

onnxruntime projects

Introduction

This repository include codes for some onnxruntime projects,such as classification, segmentation, detection, style transfer and super resolution.

Onnxruntime

ONNX Runtime is a performance-focused complete scoring engine for Open Neural Network Exchange (ONNX) models, with an open extensible architecture to continually address the latest developments in AI and Deep Learning. In my repository,onnxruntime.dll have been compiled. You can download it and see specific information about onnxruntime in https://github.com/microsoft/onnxruntime.

Projects

The programming language is C++ and The platform is Visual Studio. I have finished some projects based on onnxruntime official samples. The link have been mentioned afore. Also, you can download some onnx models in https://github.com/onnx/models. If necessary,you can see the structure onnx models in https://lutzroeder.github.io/netron/.

Windows
Network Classes Input resolution Batch size Iterations CPU Running time GPU Running time TRT Running time*
MobileNet 1000 224x224 1 1000 19.56s 4.15s 1.05s
ERFNet 4 640x480 1 1000 >100s 12.93s 5.6s
Tiny_YOLOv2 20 416x416 1 1000 40.64s 2.97s 1.92s
Super Resolution with sub-pixel CNN - 224x224 1 1000 34.14s 1.79s 1.14s
Fast Neural Style Transfer - 224x224 1 1000 87.99s 4.64s -
Ubuntu
Network Classes Input resolution Batch size Iterations CPU Running time GPU Running time TRT Running time*
MobileNet 1000 224x224 1 1000 20.09s 4.24s 0.79s
ERFNet 4 640x480 1 1000 >100s 13.56s 4.90s

*The TensorRT engine is compiled with FP16 settings. Just add "trt_builder->setFp16Mode(true);" to 339 line of tensorrt_execution_provider.cc, if you build libonnxruntime yourself.

**This experiment is implemented on NVIDIA 2080Ti.

Classification


The onnx model is moblienet. You can download it in the link mentioned afore.

Segmentation


The onnx model is our trained erfnet. We use specific datasets to train erfnet.

Detection


The onnx model is Tiny YOLOv2.You can download it in the link mentioned afore.

Style transfer


The onnx model is Fast Neural Style Transfer. You can download it in the link mentioned afore.

Super resolution


The onnx model is Super Resolution with sub-pixel CNN. You can download it in the link mentioned afore.

项目简介

🚀 Github 镜像仓库 🚀

源项目地址

https://github.com/tenglike1997/onnxruntime-projects

发行版本

当前项目没有发行版本

贡献者 2

tenglike @qq_38072352
T tenglike1997 @tenglike1997

开发语言

  • C++ 69.3 %
  • Objective-C 19.9 %
  • Makefile 5.5 %
  • C 4.6 %
  • QMake 0.7 %