mmr/tkDNN
Archived
1
0
Fork 0
Code Issues 46 Pull Requests 12 Releases 4 Activity

Any updates if it works with new versions of cuda 11.8? #304

New Issue
Open
opened 2023-08-21 07:48:23 +02:00 by yemuzi · 3 comments
yemuzi commented 2023-08-21 07:48:23 +02:00 (Migrated from github.com)
Copy Link
Copy Source

on 2070 gpu card,
image

Cuda failure: out of memory
/root/trt8/src/Conv2d.cpp:177
Aborting...

on 2070 gpu card, ![image](https://github.com/ceccocats/tkDNN/assets/3439941/9a52b487-412a-454d-a79d-77922fc6d755) Cuda failure: out of memory /root/trt8/src/Conv2d.cpp:177 Aborting...
ckurtz22 commented 2023-11-05 17:39:11 +01:00 (Migrated from github.com)
Copy Link
Copy Source

I've tested it up to Cuda 12.3, works fine. The memory error is because the tests are written around running it on a Jetson Xavier with unified memory. For normal GPUs you need to comment out this line so when it can just serialize the network without running it: https://github.com/ceccocats/tkDNN/blob/master/src/Conv2d.cpp#L176
And then you can load the network.rt file and run it later on.

I've tested it up to Cuda 12.3, works fine. The memory error is because the tests are written around running it on a Jetson Xavier with unified memory. For normal GPUs you need to comment out this line so when it can just serialize the network without running it: https://github.com/ceccocats/tkDNN/blob/master/src/Conv2d.cpp#L176 And then you can load the network.rt file and run it later on.
vtyw commented 2023-11-22 23:25:50 +01:00 (Migrated from github.com)
Copy Link
Copy Source

@ckurtz22 What version of OpenCV did you have to use with CUDA 12?

@ckurtz22 What version of OpenCV did you have to use with CUDA 12?
ckurtz22 commented 2023-11-23 01:11:53 +01:00 (Migrated from github.com)
Copy Link
Copy Source

@ckurtz22 What version of OpenCV did you have to use with CUDA 12?

I used the default opencv installation for Ubuntu 20.04, I believe it was 4.1. I also was able to build 4.8 from source and get it working without issue. I have not been using OpenCV with CUDA enabled,

> @ckurtz22 What version of OpenCV did you have to use with CUDA 12? I used the default opencv installation for Ubuntu 20.04, I believe it was 4.1. I also was able to build 4.8 from source and get it working without issue. I have not been using OpenCV with CUDA enabled,
This repo is archived. You cannot comment on issues.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
duplicate
enhancement
explanation
help wanted
invalid
question
wontfix
No Label
Milestone
No items
No Milestone
Assignees
Clear assignees
eeeck (Erick)
No Assignees
1 Participants
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: mmr/tkDNN#304
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?