Gitiles
Code Review Sign In
review.mlplatform.org / ml / armnn / 788e2c644e16fa7043b9a647806df46fd18bc040 / . / docs / 01_03_delegate.dox
blob: 73d869041e7060d9386139541ad81f4e9e002828 [file] [log] [blame]
Jan Eilers31a7c892021-01-29 14:18:13 +0000[diff] [blame]1/// Copyright (c) 2021 ARM Limited and Contributors. All rights reserved.
2///
3/// SPDX-License-Identifier: MIT
4///
5
6namespace armnn
7{
8/**
9@page delegate TfLite Delegate
10@tableofcontents
11
12
13@section delegateintro About the delegate
14'armnnDelegate' is a library for accelerating certain TensorFlow Lite (TfLite) operators on Arm hardware. It can be
15integrated in TfLite using its delegation mechanism. TfLite will then delegate the execution of operators supported by
16Arm NN to Arm NN.
17
18The main difference to our @ref S6_tf_lite_parser is the amount of operators you can run with it. If none of the active
19backends support an operation in your model you won't be able to execute it with our parser. In contrast to that, TfLite
20only delegates operations to the armnnDelegate if it does support them and otherwise executes them itself. In other
21words, every TfLite model can be executed and every operation in your model that we can accelerate will be accelerated.
22That is the reason why the armnnDelegate is our recommended way to accelerate TfLite models.
23
24If you need help building the armnnDelegate, please take a look at our [build guide](delegate/BuildGuideNative.md).
25An example how to setup TfLite to integrate the armnnDelegate can be found in this
26guide: [Integrate the delegate into python](delegate/IntegrateDelegateIntoPython.md)
27
28
29@section delegatesupport Supported Operators
30This reference guide provides a list of TensorFlow Lite operators the Arm NN SDK currently supports.
31
32@subsection delegatefullysupported Fully supported
33
34The Arm NN SDK TensorFlow Lite delegate currently supports the following operators:
35
36- ABS
37
38- ADD
39
40- ARGMAX
41
42- ARGMIN
43
44- AVERAGE_POOL_2D, Supported Fused Activation: RELU , RELU6 , TANH, NONE
45
46- CONCATENATION, Supported Fused Activation: RELU , RELU6 , TANH, NONE
47
48- CONV_2D, Supported Fused Activation: RELU , RELU6 , TANH, NONE
49
50- DEPTH_TO_SPACE
51
52- DEPTHWISE_CONV_2D, Supported Fused Activation: RELU , RELU6 , TANH, NONE
53
54- DEQUANTIZE
55
56- DIV
57
58- EQUAL
59
60- ELU
61
62- EXP
63
64- FULLY_CONNECTED, Supported Fused Activation: RELU , RELU6 , TANH, NONE
65
Sadik Armagan788e2c62021-02-10 16:26:44 +0000[diff] [blame^]66- FLOOR
67
Jan Eilers31a7c892021-01-29 14:18:13 +0000[diff] [blame]68- GATHER
69
70- GREATER
71
72- GREATER_OR_EQUAL
73
74- HARD_SWISH
75
76- LESS
77
78- LESS_OR_EQUAL
79
80- LOCAL_RESPONSE_NORMALIZATION
81
82- LOGICAL_AND
83-
84- LOGICAL_NOT
85-
86- LOGICAL_OR
87
88- LOGISTIC
89
90- LOG_SOFTMAX
91
92- L2_NORMALIZATION
93
94- L2_POOL_2D
95
96- MAXIMUM
97
98- MAX_POOL_2D, Supported Fused Activation: RELU , RELU6 , TANH, NONE
99
100- MEAN
101
102- MINIMUM
103
104- MUL
105
106- NEG
107
108- NOT_EQUAL
109
110- PAD
111
112- QUANTIZE
113
114- RESHAPE
115
116- RESIZE_BILINEAR
117
118- RESIZE_NEAREST_NEIGHBOR
119
120- RELU
121
122- RELU6
123
124- RSQRT
125
126- SOFTMAX
127
128- SPACE_TO_DEPTH
129
130- SPLIT
131
132- SPLIT_V
133
134- SQRT
135
136- SUB
137
138- TANH
139
140- TRANSPOSE
141
142- TRANSPOSE_CONV
143
144More machine learning operators will be supported in future releases.
145**/
146}