C++ desializing plugin error for Python + yolov4-tiny #82

New Issue

2020-07-15T18:05:59+02:00

marvision-ai commented

2020-07-15 18:05:59 +02:00

(Migrated from github.com)

This was talked about in another issue (https://github.com/ceccocats/tkDNN/issues/30) but I would like to make this a seperate topic.
PR: https://github.com/ceccocats/tkDNN/pull/44

Works great with yolo4v but does not work with yolov4-tiny.
For reference: I am using the standard yolov4-tiny that is packaged with the repo.

nvidia@nvidia:~/tkDNN$ python3 darknetTR.py build/yolo4tiny_fp16.rt --video=demo/yolo_test.mp4
build/yolo4tiny_fp16.rt
New NetworkRT (TensorRT v6.01)
Float16 support: 1
Int8 support: 1
DLAs: 2
Cant deserialize Plugin
/home/nvidia/tkDNN/src/NetworkRT.cpp:821
Aborting...

As far as I am concerned, the c++ api and python api call the same code:
detNN->init(net, n_classes, n_batch);

Is there anything I should test or change? I really can't locate why this would happen since building and running the FP16 on C++ works perfect.

This was talked about in another issue (https://github.com/ceccocats/tkDNN/issues/30) but I would like to make this a seperate topic. PR: https://github.com/ceccocats/tkDNN/pull/44 Works great with yolo4v but does not work with yolov4-tiny. For reference: I am using the standard yolov4-tiny that is packaged with the repo. ```bash nvidia@nvidia:~/tkDNN$ python3 darknetTR.py build/yolo4tiny_fp16.rt --video=demo/yolo_test.mp4 build/yolo4tiny_fp16.rt New NetworkRT (TensorRT v6.01) Float16 support: 1 Int8 support: 1 DLAs: 2 Cant deserialize Plugin /home/nvidia/tkDNN/src/NetworkRT.cpp:821 Aborting... ``` As far as I am concerned, the c++ api and python api call the same code: `detNN->init(net, n_classes, n_batch); ` Is there anything I should test or change? I really can't locate why this would happen since building and running the FP16 on C++ works perfect.

defi0x1 commented

2020-12-18 04:50:53 +01:00

(Migrated from github.com)

(y)

**(y)**

mive93 commented

2021-11-25 11:39:13 +01:00

(Migrated from github.com)

Closing for inactivity. Feel free to reopen.

This repo is archived. You cannot comment on issues.

1 Participants

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: mmr/tkDNN#82