commit | 6c25aad49787676c8dcaab74efd536690184ed04 | [log] [tgz] |
---|---|---|
author | Michele Di Giorgio <michele.digiorgio@arm.com> | Thu Jan 14 16:17:48 2021 +0000 |
committer | Georgios Pinitas <georgios.pinitas@arm.com> | Fri Jan 15 19:32:14 2021 +0000 |
tree | 3034bb24554d1c52077fcf20e38bd655e230bbe2 | |
parent | ddd79f5a1e92bfea85ad2104f15c991952f65ef8 [diff] |
Introduce threshold for NEON floating-point SOFT_RELU activation Large inputs produce incorrect results of Soft ReLu activations where the output saturates at around 88.72283. This is due to the approximation algorithm used for the logarithm. For this reason, we introduce a threshold such that with x > threshold, Soft ReLu activation will return the value x itself. SVE does not seem to suffer from the same issue, hence NEON kernels only are modified. Resolves COMPMID-4091 Change-Id: I357883deed4e4aba571a1d3163267772096c0412 Signed-off-by: Michele Di Giorgio <michele.digiorgio@arm.com> Reviewed-on: https://review.mlplatform.org/c/ml/ComputeLibrary/+/4865 Comments-Addressed: Arm Jenkins <bsgcomp@arm.com> Reviewed-by: Giorgio Arena <giorgio.arena@arm.com> Tested-by: Arm Jenkins <bsgcomp@arm.com>
Release repository: https://github.com/arm-software/ComputeLibrary
Development repository: https://review.mlplatform.org/#/admin/projects/ml/ComputeLibrary
Please report issues here: https://github.com/ARM-software/ComputeLibrary/issues
Make sure you are using the latest version of the library before opening an issue. Thanks
News:
Related projects:
Tutorials:
Documentation (API, changelogs, build guide, contribution guide, errata, etc.) available at https://github.com/ARM-software/ComputeLibrary/wiki/Documentation.
Binaries available at https://github.com/ARM-software/ComputeLibrary/releases.
License & Contributions: The software is provided under MIT license. Contributions to this project are accepted under the same license.
For technical discussion, the ComputeLibrary project has a public mailing list: acl-dev@lists.linaro.org The list is open to anyone inside or outside of Arm to self subscribe. In order to subscribe, please visit the following website: https://lists.linaro.org/mailman/listinfo/acl-dev
Before the ComputeLibrary project accepts your contribution, you need to certify its origin and give us your permission. To manage this process we use the Developer Certificate of Origin (DCO) V1.1 (https://developercertificate.org/)
To indicate that you agree to the the terms of the DCO, you "sign off" your contribution by adding a line with your name and e-mail address to every git commit message:
Signed-off-by: John Doe <john.doe@example.org>
You must use your real name, no pseudonyms or anonymous contributions are accepted.