mmr/tkDNN
Archived
1
0
Fork 0
Code Issues 46 Pull Requests 12 Releases 4 Activity

different BN epsilon from the forked darknet #167

New Issue
Closed
opened 2020-12-11 15:36:59 +01:00 by thnkinbtfly · 3 comments
thnkinbtfly commented 2020-12-11 15:36:59 +01:00 (Migrated from github.com)
Copy Link
Copy Source

Hi, thanks for this great project!!

Some outputs from the forked darknet and the tkDNN was different, and I tried to find out the reason.

I think the default epsilon used in tkDNN (1e-5) is different from darknet (1e-6).

The forked darknet uses 1e-6, as below.
https://git.hipert.unimore.it/fgatti/darknet/blob/master/src/blas.c#L292

But tkDNN is using 1e-5.
https://github.com/ceccocats/tkDNN/blob/b8855b9599e52a51b371e99255063cd6f00fecd7/include/tkDNN/Layer.h#L35

After updating this, the difference I confronted was resolved!
Could you check this?

Hi, thanks for this great project!! Some outputs from the forked darknet and the tkDNN was different, and I tried to find out the reason. I think the default epsilon used in tkDNN (1e-5) is different from darknet (1e-6). The forked darknet uses 1e-6, as below. https://git.hipert.unimore.it/fgatti/darknet/blob/master/src/blas.c#L292 But tkDNN is using 1e-5. https://github.com/ceccocats/tkDNN/blob/b8855b9599e52a51b371e99255063cd6f00fecd7/include/tkDNN/Layer.h#L35 After updating this, the difference I confronted was resolved! Could you check this?
thnkinbtfly commented 2020-12-11 15:44:46 +01:00 (Migrated from github.com)
Copy Link
Copy Source

I just checked the original darknet changed the epsilon to 1e-5.
https://github.com/AlexeyAB/darknet/commit/a34682e67c9ff279019e17070a5d34d596cd8422

Could you consider using the same epsilon when exporting the outputs and running the network?

I just checked the original darknet changed the epsilon to 1e-5. https://github.com/AlexeyAB/darknet/commit/a34682e67c9ff279019e17070a5d34d596cd8422 Could you consider using the same epsilon when exporting the outputs and running the network?
mive93 commented 2021-01-04 15:53:42 +01:00 (Migrated from github.com)
Copy Link
Copy Source

Hi @thnkinbtfly
I don't get the point.
So you're aying that he's using 1e-6 or 1e-5?
And where do you experienced the error?

Hi @thnkinbtfly I don't get the point. So you're aying that he's using 1e-6 or 1e-5? And where do you experienced the error?
mive93 commented 2021-11-25 11:37:36 +01:00 (Migrated from github.com)
Copy Link
Copy Source

Closing for inactivity. Feel free to reopen.

Closing for inactivity. Feel free to reopen.
This repo is archived. You cannot comment on issues.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
duplicate
enhancement
explanation
help wanted
invalid
question
wontfix
No Label
Milestone
No items
No Milestone
Assignees
Clear assignees
eeeck (Erick)
No Assignees
1 Participants
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: mmr/tkDNN#167
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?