Cuda failure: out of memory #303

Open
opened 2023-06-01 08:19:34 +02:00 by ckurtz22 · 2 comments
ckurtz22 commented 2023-06-01 08:19:34 +02:00 (Migrated from github.com)

Getting an error when running test_yolo4 on my laptop which has an RTX 3060 GPU:

Cuda failure: out of memory
/home/connor/tkDNN/src/Conv2d.cpp:176

Running on commit d4f7b4ad8b

Getting an error when running test_yolo4 on my laptop which has an RTX 3060 GPU: ``` Cuda failure: out of memory /home/connor/tkDNN/src/Conv2d.cpp:176 ``` Running on commit d4f7b4ad8b21f1af78e1bada3e0368c0c1304ad9
ckurtz22 commented 2023-06-02 16:42:20 +02:00 (Migrated from github.com)

Could be related: when using FP16 mode it uses the wrong size for allocating WgsLayers:
https://github.com/ceccocats/tkDNN/blob/master/src/LayerWgs.cpp#L76
(should be using b_size, but uses w_size instead)

Could be related: when using FP16 mode it uses the wrong size for allocating WgsLayers: https://github.com/ceccocats/tkDNN/blob/master/src/LayerWgs.cpp#L76 (should be using b_size, but uses w_size instead)
yemuzi commented 2023-08-21 09:14:50 +02:00 (Migrated from github.com)

on RTX 2070,cuda11.8,FP32 mode, have same problem,
image

on RTX 2070,cuda11.8,FP32 mode, have same problem, ![image](https://github.com/ceccocats/tkDNN/assets/3439941/2072e414-ab3d-425c-a2c9-27122d6ccebe)
This repo is archived. You cannot comment on issues.
1 Participants
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: mmr/tkDNN#303