Micaela Verucchi
142 lines
5.5 KiB
Markdown
142 lines
5.5 KiB
Markdown
# tkDNN
|
|
tkDNN is a Deep Neural Network library built with cuDNN primitives specifically thought to work on NVIDIA TK1(and all successive) board.<br>
|
|
The main scope is to do high performance inference on already trained models.
|
|
|
|
this branch actually work on every NVIDIA GPU that support the dependencies:
|
|
* CUDA 10.0
|
|
* CUDNN 7.603
|
|
* TENSORRT 6.01
|
|
* OPENCV 4.1
|
|
* yaml-cpp 0.5.2 (sudo apt install libyaml-cpp-dev)
|
|
|
|
## Workflow
|
|
The recommended workflow follow these step:
|
|
* Build and train a model in Keras (on any PC)
|
|
* Export weights and bias
|
|
* Define the model on tkDNN
|
|
* Do inference (on TK1)
|
|
|
|
## Compile the library
|
|
Build with cmake
|
|
```
|
|
mkdir build
|
|
cd build
|
|
cmake ..
|
|
# use -DTEST_DATA=False to skip dataset download
|
|
make
|
|
```
|
|
during the cmake configuration it will be dowloaded the weights needed for running
|
|
the tests
|
|
|
|
## DLA34 and ResNet101 weights
|
|
To get weights and outputs needed for running the tests you can use the Python
|
|
script and the Anaconda environment included in the repository.
|
|
|
|
Create Anaconda environment and activate it:
|
|
```
|
|
conda env create -f file_name.yml
|
|
source activate env_name
|
|
```
|
|
Run the Python script inside the environment.
|
|
|
|
## CenterNet weights
|
|
To get the weights needed for running the tests:
|
|
|
|
* clone the forked repository by the original CenterNet:
|
|
```
|
|
git clone https://github.com/sapienzadavide/CenterNet.git
|
|
```
|
|
* follow the instruction in the README.md and INSTALL.md
|
|
* copy the weigths and outputs from /path/to/CenterNet/src/ in ./test/centernet-path/ . For example:
|
|
```
|
|
cp /path/to/CenterNet/src/layers_dla/* ./test/dla34_cnet/layers/
|
|
cp /path/to/CenterNet/src/debug_dla/* ./test/dla34_cnet/debug/
|
|
```
|
|
or
|
|
```
|
|
cp /path/to/CenterNet/src/layers_resdcn/* ./test/resnet101_cnet/layers/
|
|
cp /path/to/CenterNet/src/debug_resdcn/* ./test/resnet101_cnet/debug/
|
|
```
|
|
|
|
## Test
|
|
Assumiung you have correctly builded the library these are the test ready to exec:
|
|
* test_simple: a simple convolutional and dense network (CUDNN only)
|
|
* test_mnist: the famous mnist netwok (CUDNN and TENSORRT)
|
|
* test_mnistRT: the mnist network hardcoded in using tensorRT apis (TENSORRT only)
|
|
* test_yolo: YOLO detection network (CUDNN and TENSORRT)
|
|
* test_yolo_tiny: smaller version of YOLO (CUDNN and TENSRRT)
|
|
* test_yolo3_berkeley: our yolo3 version trained with BDD100K dateset
|
|
* test_resnet101: ResNet101 network (CUDNN and TENSORRT)
|
|
* test_resnet101_cnet: CenterNet detection based on ResNet101 (CUDNN and TENSORRT)
|
|
* test_dla34: DLA34 network (CUDNN and TENSORRT)
|
|
* test_dla34_cnet: CenterNet detection based on DLA34 (CUDNN and TENSORRT)
|
|
|
|
|
|
## yolo3 berkeley demo detection
|
|
For the live detection you need to precompile the tensorRT file by luncing the desidered network test, this is the recommended process:
|
|
```
|
|
export TKDNN_MODE=FP16 # set the half floating point optimization
|
|
rm yolo3_berkeley.rt # be sure to delete(or move) old tensorRT files
|
|
./test_yolo3_berkeley # run the yolo test (is slow)
|
|
# with f16 inference the result will be a bit incorrect
|
|
```
|
|
this will genereate a yolo3_berkeley.rt file that can be used for live detection:
|
|
```
|
|
./yolo3_demo # launch detection on a demo video
|
|
./yolo3_demo yolo3_berkeley.rt /dev/video0 # launch detection on device 0
|
|
```
|
|
|
|
|
|
|
|
## CenterNet (DLA34, ResNet101) demo detection
|
|
For the live detection you need to precompile the tensorRT file by luncing the desidered network test, this is the recommended process:
|
|
```
|
|
export TKDNN_MODE=FP16 # set the half floating point optimization
|
|
```
|
|
|
|
For CenterNet based on ResNet101:
|
|
```
|
|
rm resnet101_cnet.rt # be sure to delete(or move) old tensorRT files
|
|
./test_resnet101_cnet # run the yolo test (is slow)
|
|
# with f16 inference the result will be a bit incorrect
|
|
```
|
|
|
|
For CenterNet based on DLA34:
|
|
```
|
|
rm dla34_cnet.rt # be sure to delete(or move) old tensorRT files
|
|
./test_dla34_cnet # run the yolo test (is slow)
|
|
# with f16 inference the result will be a bit incorrect
|
|
```
|
|
|
|
this will genereate resnet101_cnet.rt and dla34_cnet.rt file that can be used for live detection:
|
|
```
|
|
./centernet_demo # launch detection on a demo video
|
|
./centernet_demo resnet101_cnet.rt /dev/video0 # launch detection on device 0
|
|
./centernet_demo dla34_cnet.rt /dev/video0 # launch detection on device 0
|
|
```
|
|
|
|
## mAP demo
|
|
To compute mAP, precision, recall and f1score, run the map_demo.
|
|
|
|
A validation set is needed. To download COCO_val2017 run (form the root folder):
|
|
```
|
|
bash download_validation.sh
|
|
```
|
|
|
|
To compute the map, the following parameters are needed:
|
|
```
|
|
./map_demo <network rt> <network type [y|c]> <labels file path> <config file path>
|
|
```
|
|
where
|
|
* ```<network rt>```: rt file of a choosen network on wich compute the mAP.
|
|
* ```<network type [y|c]>```: type of network. Right now only y(yolo) and c(centernet) are allowed
|
|
* ```<labels file path>```: path to a text file containing all the paths of the groundtruth labels. It is important that all the labels of the groundtruth are in a folder called 'labels'. In the folder containing the folder 'labels' there should be also a folder 'images', containing all the groundtruth images having the same same as the labels. To better understand, if there is a label path/to/labels/000001.txt there should be a corresponding image path/to/images/000001.jpg.
|
|
* ```<config file path>```: path to a yaml file with the parameters needed for the mAP computation, similar to demo/config.yaml
|
|
|
|
Example:
|
|
|
|
```
|
|
cd build
|
|
./map_demo dla34_cnet.rt c ../demo/COCO_val2017/all_labels.txt ../demo/config.yaml
|
|
```
|