tree 85a292b8a31c3bec2c3f4d32a5cec6ac48741a36
parent 6fe9eafe0707387e65f9b3c188f4145f64415ce3
author Gunes Bayir <gunes.bayir@arm.com> 1709564124 +0000
committer Gunes Bayir <gunes.bayir@arm.com> 1709570234 +0000

Fix performance regression in fixed-format kernels

Fix the performance regression in CpuGemmConv2d caused by importing memory at every run for fixed-format kernels. This has been done by adding an bypass_import parameter to the aux. tensor handler class (CpuAuxTensorHandler) and using it in CpuGemmConv2d so that the memory import happens if and only when the associated tensor is used in the gemm pack.

Also, improve the documentation of CpuAuxTensorHandler.

Resolves: ARMCL-1126

Co-authored by: SiCong Li <sicong.li@arm.com>
Change-Id: Idb26bdb2d19419074a6e7f2497a1741ae200603f
Signed-off-by: Gunes Bayir <gunes.bayir@arm.com>
Reviewed-on: https://review.mlplatform.org/c/ml/ComputeLibrary/+/11240
Tested-by: Arm Jenkins <bsgcomp@arm.com>
Reviewed-by: Pablo Marquez Tello <pablo.tello@arm.com>
Comments-Addressed: Arm Jenkins <bsgcomp@arm.com>
Benchmark: Arm Jenkins <bsgcomp@arm.com>