# NeuralNetworks

## Summary

| ### Enumerations ||
|---|---|
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga900dca9b26de42491763226e12dcd47b{ https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga900dca9b26de42491763226e12dcd47baae0a47d1fa3a3f0b0861efc77f6865cf = 128 }` | enumFor [ANeuralNetworksModel_setOperandValue](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga92fd1d7bdf40364620d72fdaaca991f3), values with a length smaller or equal to this will be immediately copied into the model. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga1be3860693af99a6c1da72580097294c{ https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga1be3860693af99a6c1da72580097294ca4d7f5dd59e298470e16b1675bfe0c371 = 32 }` | enumFor [ANeuralNetworksCompilation_setCaching](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga825b1b36f8e22aed5e97c8e6d46a844e), specify the size of the cache token required from the application. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga61f16b495d2e04593c819c12e42ac9f2{ https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga61f16b495d2e04593c819c12e42ac9f2a844131738ae41e1b767a42117a270eba = 0, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga61f16b495d2e04593c819c12e42ac9f2a21dc0bcb8fb80fe636c461cbefacde25 = 1, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga61f16b495d2e04593c819c12e42ac9f2aa2a0ac5d1a2be5f9cc5a33a9f2fae882 = 2, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga61f16b495d2e04593c819c12e42ac9f2ab2d390de98c6284a719df28f4cfe2540 = 3, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga61f16b495d2e04593c819c12e42ac9f2af24e116a1a635c3b5f724709ea4a903d = 4 }` | enumDevice types. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4adbdd519e2d3f770784fc55d197159f{ https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga4adbdd519e2d3f770784fc55d197159fa59dfb9d11405ba87b3122644bea70209 = 0, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga4adbdd519e2d3f770784fc55d197159fa8cb1689bd4f21a3602589f10e550a39a = 1, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga4adbdd519e2d3f770784fc55d197159fac37c83d29f0cd5d5e1fc6155b9b68ddd = 2, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga4adbdd519e2d3f770784fc55d197159faa4143b3e2c2667682b2dde2d33c8bd40 = 3 }` | enumDifferent duration measurements. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5ea86afb2f613025b6af63c1f21ac028{ https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga5ea86afb2f613025b6af63c1f21ac028abe36c624e6db762dd711138e9a28f264 = 27, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga5ea86afb2f613025b6af63c1f21ac028a38c45ac5eeed83b5234bf2f9271ecad2 = 28, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga5ea86afb2f613025b6af63c1f21ac028aada4e57bb24f38676fa38663b6984639 = 29, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga5ea86afb2f613025b6af63c1f21ac028acbd6a309bf12692b48dabcdfaefde4e4 = 30, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga5ea86afb2f613025b6af63c1f21ac028adef8cfb423332610fc8330e3cdf70e60 = 31, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga5ea86afb2f613025b6af63c1f21ac028a6824b6631e203b939305f8137c4a1bbe = 1000006, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga5ea86afb2f613025b6af63c1f21ac028ac347d310b5aab3b7d64e521ba8d7ee51 = 1000007, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga5ea86afb2f613025b6af63c1f21ac028ac66b8e1b9611124219f270a516324e1e = 1000008 }` | enumNNAPI feature levels. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ec620045a39909a6bf00b3ee0c4d414{ https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga4ec620045a39909a6bf00b3ee0c4d414a0f7344826e8abfa2ba90c82e856dc4f9 = 0, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga4ec620045a39909a6bf00b3ee0c4d414abfcb75d9fb70f78934766b830d98d7d6 = 1, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga4ec620045a39909a6bf00b3ee0c4d414a9c969b9474ae51f8ecc544e11fbb8303 = 2, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga4ec620045a39909a6bf00b3ee0c4d414a29b9372bc4e003e080ef85342fd6c429 = 3 }` | enumFused activation function types. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298{ https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578 = 0, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc = 1, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ad392906165c1e93c2a9719998d65223c = 2, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447 = 3, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896 = 4, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3 = 5, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278 = 6, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a750fa6aa30c71eb8d093ee1c44d25a12 = 7, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c = 8, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ab275c740307fbffcfec94adcc7b374b9 = 9, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a823c78695644dea4e94aa04ff2d00cd7 = 10, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a63c89cf7133314db885eae2abe0acc70 = 11, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aac04cfb70bef0e2f4081b6b69a80ddf7 = 12, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7a907ab82a0229f28bd188dd37a1ef52 = 13, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9 = 14, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a66055118088cbd1d1d17dcbcd2c47ed5 = 15 }` | enumOperand types. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaabbe492c60331b13038e39d4207940e0{ https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0ad681988001e5f8ab73230a311f4ab034 = 0, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a12e6b53aadbd3736c38f1a159adea788 = 1, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a44cbea825c4b224dd3ea757e9b1f65ed = 2, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a34a73b5eaf458b67db5eda71557d1d01 = 3, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a2b49a44b7ebba243fad01556c1f0392e = 4, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a34253f8b844b4c143f0fa36be3ba3f7a = 5, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0ad4c9300b061d9d14669bd5acdc7538e2 = 6, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a8d2ada77adb74357fc0770405bca0e3c = 7, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0acdb4a57160153118dc6f87af0e4eccc5 = 8, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0aaada7a3dbaf4676aba560c933ff610c5 = 9, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0aca92716c8c73c1f0fa7f0757916fee26 = 10, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0abf295dee59560ff29d435226ec4c24bd = 11, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a2fb636e30d8853f9fa1a395e30660e92 = 12, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a876ccb0f3e6555637c5e278a7715fc05 = 13, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a82a340eb540933f638db420369650483 = 14, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a800cdcec5d7ba776789cb2d1ef669965 = 15, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0ad0377e8c305e596fb7f64ff896671fc5 = 16, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a0f227a4d98ad5af31f7fd4d255d246ce = 17, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0ab34ca99890c827b536ce66256a803d7a = 18, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0abb2f979866b131c5089ba0caaecee656 = 19, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a73b9a2ded1dda2925d2e73aec44d2e2e = 20, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a04a24c2d6f0aac4c3f5324c1d7764714 = 21, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a535e7e99383ee49456c8671843b93a59 = 22, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a42bd92518e273b6716ecd56b571fcd3e = 23, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0acd2684ac9c73bb29767b534e78a332e8 = 24, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a2bfbb83a537701e2843a3d5004250c2c = 25, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a90099ec472f6571a932b111d979dcccd = 26, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a7096de21038c1ce49d354a00cba7b552 = 27, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a4b63c9caab823f112d82d853a77381e5 = 28, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a2bdfefbdc6409b4bbcacc16c72002703 = 29, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a139794099b4137599bbc73af18b0d42a = 30, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a047fe95a35b27f45c05432b6ca18eb6c = 31, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0aaced01fc41e401b81cefcf53780558d1 = 32, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a91f17c92abe95e211de39c3715acd535 = 33, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a1207019989837ee9d10c5b6663504933 = 34, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a89695302f8b1e7ae7ce8f4d8c0b8a752 = 35, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a06a4248fe5ec71820ab95b87613780be = 36, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a92d7bc95eb68525334b6cfe80cd271ee = 37, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a8ecc424dd6710f89683edaf12ce38e39 = 38, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0af78048ff71a1e79bbc6034d30cad7cbc = 39, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a89be86ff36e83254e9b3d0954e7e0729 = 40, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0afd7603dd54060e6a52f5861674448528 = 41, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a492a71cb7aa50b9a1a834a3cb269d778 = 42, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a487fc5ae247de828f13e62b99f259f3c = 43, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a2d81e878c19e15700dad111ba6c0be89 = 44, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a0a1bde5b34668d90eec4cfa4944e241d = 45, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a5b993c1211c4b1bc52fb595a3025251d = 46, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0abd6365933837275bb1f5cde1fd9b8234 = 47, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a4af31ebf58c6845d36fe26cf1a794d2c = 48, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a32bd40860ff7c3d91f5e62980bb52bc2 = 49, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a2ac3c3daa1904f202589bef8c1c1860a = 50, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a4bcb358f8c49e45e386a0a75405d5763 = 51, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a72484020f2c41c814de0a7bf93dbbfd4 = 52, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0afe61c7102e8fa16d19c2d7d8f4f15360 = 53, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a3327f787f234f2a21f1fe14876ba85aa = 54, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a847acf8d9f3d2343328c3dbe6d447c50 = 55, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a5ffccf92d127766a741225ff7ad6f743 = 56, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a1e47d64cc1ac622e6fc515d602e1cd55 = 57, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a858bf52c76d31c41a8df611017a96db0 = 58, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0acf4d4d24685a6267d28f4873e7a43ae1 = 59, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0ad22137e675fafa6d72da7b52952cfb78 = 60, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a3e5d914633b5520c00b1668d2244b911 = 61, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0acb90aff5615d001708e9e4c6545b2b3c = 62, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a132ac3197242be5700d62b0037701718 = 63, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a9e6c534786db67a647aeefcdafc3af0e = 64, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0aad00698dac694a7c1233dede8e8de91e = 65, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a8738794be11b7a43e5c83010f582e0a6 = 66, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a3418665f9871dca43e3cb2efcac3990b = 67, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a7b79220811dd60b3c9afaabdc6ea6842 = 68, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0afe2c4f9e541dcc278509921fd2c8a502 = 69, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0af04a05fbde5ec0d2e4e088750a8451ad = 70, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a82e7e7c709ad117a0178203217be30cf = 71, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a60e0015c8f08ed26d59afe92f728068d = 72, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a42edb5ab6f1c74f4a756eb1ed0183a16 = 73, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a6cb5032c09d3c4b542d18495c247b5b4 = 74, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0af34811ac80385eaf39f79a97d99fb49e = 75, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a216dc116d754af120bc0cfbea4c17d7d = 76, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a257a84d4cfa9f6eef0997ddd591e9584 = 77, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0ab5934984ee3e89ffb703b0cac7d6a2f8 = 78, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0aea51a05dfc337082df51b4a263eb0c5c = 79, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0aa2b7674dd559dd3233523688ad71cb3e = 80, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a2848b39dd4bfba78f2438fda0d9397a4 = 81, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a6736198af337b2efbdb0b6b64dee7fe4 = 82, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0ac48dc0e528086e4d241d42d2923467da = 83, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a49b2dc37ea9219789a6d82f281499dbb = 84, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0af16ba8e2a692bce91fb53c0cd64eed11 = 85, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a13adfb1d5d7bce0e342a7a16e1a1be3e = 86, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0afb787314a8631fe847f1fd93cfd576a7 = 87, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0acf8329b28ec9fd0aa9d0e6a41aaba628 = 88, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0aae56dc75c058291cee272a537978ecd3 = 89, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0afb989792e22adaaa6fb540ae8415f562 = 90, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a5ac65e772b035ddb27c18236752aa1fd = 91, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0aaf30e491ad0b1fc7602cbde695b2c859 = 92, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0ae11aa1d461d2abaa117f6ee2cb503dd8 = 93, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a633997ea5224dc4063d35b9f2b2ab84b = 94, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a0de0bb95d2027cfa16f049a94b5b7211 = 95, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0ad9eb50679d1077710a6a4b3eb5207218 = 96, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0afdc0927832c42f93845fd9a2361b35f9 = 97, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a043a2da1768dd3441810b2033ededf29 = 98, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0ac88e58ac12cdd6ef3e20d7204ec6f33e = 99, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0ae59aaf309486084cf578f849f2d4135b = 100, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0af4f01ca710fc8ccb8afdcba762ac9fe3 = 101, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a57c91c2aa8b053ee31d7c6c7c62dcb01 = 102, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0ad56a6806e7e53b4357e8f44d82f71145 = 103, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0aea93f6a2df982a719a7705763205a9f2 = 104, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a552322f3765d68db977f89e6836ae9f0 = 105 }` | enumOperation types. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gab72e9e6263fd5b015bb7f41ec18ce220{ https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggab72e9e6263fd5b015bb7f41ec18ce220af941cf111bcdf02b706e6290310ded19 = 1, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggab72e9e6263fd5b015bb7f41ec18ce220a0744f0fca811cc952ae983d689dbc4d8 = 2 }` | enumImplicit padding algorithms. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga034380829226e2d980b2a7e63c992f18{ https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga034380829226e2d980b2a7e63c992f18a370c42db64448662ad79116556bcec01 = 0, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga034380829226e2d980b2a7e63c992f18af7fff807061a3e9358364a502691d887 = 1, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga034380829226e2d980b2a7e63c992f18af727c25f1e2d8dcc693c477aef4ea5f5 = 2 }` | enumExecution preferences. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5d965ed03664597bb50d3d3ba70d7169{ https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga5d965ed03664597bb50d3d3ba70d7169a92f3254b74ad32ac4a3e93bf1f761e28 = 90, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga5d965ed03664597bb50d3d3ba70d7169a7a4b7caab308274d2bdf9b4d12e8432e = 100, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga5d965ed03664597bb50d3d3ba70d7169aa94bdb89bb2aef9e8207ed820a624d47 = 110, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga5d965ed03664597bb50d3d3ba70d7169ab5cef404d6256c6fa8ec2225d641e8d4 = ANEURALNETWORKS_PRIORITY_MEDIUM }` | enumRelative execution priority. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gad8097859ab1bdd06be52a8421df152d4{ https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggad8097859ab1bdd06be52a8421df152d4a3d43394f34347d3a8de3c98dbd8a0365 = 0, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggad8097859ab1bdd06be52a8421df152d4a4012e33e698fe25493872e7e35a8aa71 = 1, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggad8097859ab1bdd06be52a8421df152d4af3b0cd9aad499d81233d1cc2b4b2cc40 = 2, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggad8097859ab1bdd06be52a8421df152d4a16c507550e6c79ed74a18277f243b6e8 = 3, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggad8097859ab1bdd06be52a8421df152d4a27e8dff6d655275b20c35d80d26d202a = 4, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggad8097859ab1bdd06be52a8421df152d4a0e0a89d262e5c2b645737c4754451d82 = 5, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggad8097859ab1bdd06be52a8421df152d4a8c8e618c0184e486c226c99a6946d835 = 6, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggad8097859ab1bdd06be52a8421df152d4a652eaffbcbf2348978dd4530592dcde0 = 7, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggad8097859ab1bdd06be52a8421df152d4ac0335932fa53628138aa0c42d731acc1 = 8, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggad8097859ab1bdd06be52a8421df152d4ac6c086a9f626e21d551ca5c178209360 = 9, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggad8097859ab1bdd06be52a8421df152d4a9fcd76a64b25ff722991b63d47142cb9 = 10, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggad8097859ab1bdd06be52a8421df152d4acf39c1619934d9a0905b12cd49f9d789 = 11, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggad8097859ab1bdd06be52a8421df152d4a0a278319a1eca9dd7a9ac20e38af4d97 = 12, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggad8097859ab1bdd06be52a8421df152d4acd26439e3bf37b6905bc1984ce1aeb9e = 13, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggad8097859ab1bdd06be52a8421df152d4a1feb6443bf2f3cc97ff33fa4b3dec4a9 = 14 }` | enumResult codes. |

| ### Typedefs ||
|---|---|
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5548a531e2a408cbe9c36fad1530118f` | typedef `struct https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5548a531e2a408cbe9c36fad1530118f` ANeuralNetworksBurst is an opaque type that can be used to reduce the latency of a rapid sequence of executions. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6` | typedef `struct https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6` ANeuralNetworksCompilation is an opaque type that can be used to compile a machine learning model. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga34d622f70bbda9ded8b28ff5d0419678` | typedef `struct https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga34d622f70bbda9ded8b28ff5d0419678` ANeuralNetworksDevice is an opaque type that represents a device. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga8b595e8510f91fa0f7d9eaa09fe6c269` | typedef `struct https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga8b595e8510f91fa0f7d9eaa09fe6c269` ANeuralNetworksEvent is an opaque type that represents an event that will be signaled once an execution completes. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b` | typedef `struct https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b` ANeuralNetworksExecution is an opaque type that can be used to apply a machine learning model to a set of inputs. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9a6b7719f0613ba9e2c93cffd97ebfc0` | typedef `struct https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9a6b7719f0613ba9e2c93cffd97ebfc0` ANeuralNetworksMemory is an opaque type that represents memory. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga92661bd0904009e8d0c9e8e1bf40bd84` | typedef `struct https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga92661bd0904009e8d0c9e8e1bf40bd84` ANeuralNetworksMemoryDesc is an opaque type that represents a memory descriptor. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ce6f20a94d3a2de47fa5a810feeb9a4` | typedef `struct https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ce6f20a94d3a2de47fa5a810feeb9a4` ANeuralNetworksModel is an opaque type that contains a description of the mathematical operations that constitute the model. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf2dc08c1084c170b255608f41d26297f` | typedef `struct https://developer.android.com/ndk/reference/struct/a-neural-networks-operand-type#struct_a_neural_networks_operand_type` [ANeuralNetworksOperandType](https://developer.android.com/ndk/reference/struct/a-neural-networks-operand-type#struct_a_neural_networks_operand_type) describes the type of an operand. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga1aa0c2cbc257093f98d6f0a2eb1932a5` | typedef `int32_t` Aliasing to [OperationCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaabbe492c60331b13038e39d4207940e0), used in function [ANeuralNetworksModel_addOperation](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga21fea9a299a4c1437cf1d280436b5381). |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaa8a83b434f62dd78f2c682cda0dc78d4` | typedef `struct https://developer.android.com/ndk/reference/struct/a-neural-networks-symm-per-channel-quant-params#struct_a_neural_networks_symm_per_channel_quant_params` Parameters for ANEURALNETWORKS_TENSOR_QUANT8_SYMM_PER_CHANNEL operand. |

| ### Functions ||
|---|---|
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga8837b557b05c7b6e03349fe2c6dbe72f(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6 *compilation, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5548a531e2a408cbe9c36fad1530118f **burst)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Create a [ANeuralNetworksBurst](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5548a531e2a408cbe9c36fad1530118f) to apply the given compilation. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaff2fa353d8137ba6ee332f5a86b7f7ce(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5548a531e2a408cbe9c36fad1530118f *burst)` | `void` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Destroys the burst object. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaa859b1859f1418a7dc739ba7bb5291e8(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ce6f20a94d3a2de47fa5a810feeb9a4 *model, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6 **compilation)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Create a [ANeuralNetworksCompilation](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6) to compile the given model. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga3ef5683b170614a689b6e2e7df78aefd(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ce6f20a94d3a2de47fa5a810feeb9a4 *model, const https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga34d622f70bbda9ded8b28ff5d0419678 *const *devices, uint32_t numDevices, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6 **compilation)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Create a [ANeuralNetworksCompilation](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6) to compile the given model for a specified set of devices. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9ce8960a4c74b9b98878b1798250abde(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6 *compilation)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Indicate that we have finished modifying a compilation. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga8cfcb96d9dd55cd19022b8c98546cda7(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6 *compilation)` | `void` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Destroy a compilation. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gab39854ccc29b486075fabc26e8fcfdf7(const https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6 *compilation, uint32_t index, uint32_t *alignment)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Get the preferred buffer and memory alignment of an input to an execution created from a particular compilation. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gac2845526b544a627b199cdaa3c189b11(const https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6 *compilation, uint32_t index, uint32_t *alignment)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Get the preferred buffer and memory alignment of an output to an execution created from a particular compilation. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gac00a1a4200d766d3793327ec616f40f7(const https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6 *compilation, uint32_t index, uint32_t *padding)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Get the preferred buffer and memory end padding of an input to an execution created from a particular compilation. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga77f3f4057228ca355f249bec368588d0(const https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6 *compilation, uint32_t index, uint32_t *padding)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Get the preferred memory end padding of an output to an execution created from a particular compilation. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga825b1b36f8e22aed5e97c8e6d46a844e(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6 *compilation, const char *cacheDir, const uint8_t *token)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Sets the compilation caching signature and the cache directory. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gae8e5b5b5441eea6113e8a08da5cf5d87(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6 *compilation, int32_t preference)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Sets the execution preference. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga3e8ae1dc23025a7e8d779fc9a061f7a4(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6 *compilation, int priority)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Set the execution priority. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga05fb09e58595a6f1f2ef2fa8b6e9f557(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6 *compilation, uint64_t duration)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Set the maximum expected duration for compiling the model. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5cc923384065f37721fbbd75f80ecfd4(const https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga34d622f70bbda9ded8b28ff5d0419678 *device, int64_t *featureLevel)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Get the NNAPI feature level of the specified NNAPI device. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga20a3289cdb5b45756d9561d9dba1081d(const https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga34d622f70bbda9ded8b28ff5d0419678 *device, const char **name)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Get the name of the specified device. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gad9ca7affd5eaa2d9d594099eb3de5f49(const https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga34d622f70bbda9ded8b28ff5d0419678 *device, int32_t *type)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Get the type of a given device. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga8437d171b0d7c0298de2c461e69bebee(const https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga34d622f70bbda9ded8b28ff5d0419678 *device, const char **version)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Get the version of the driver implementation of the specified device. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga1023be3573114ac0b4e46302c8358540(const https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga34d622f70bbda9ded8b28ff5d0419678 *device)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Wait until the device is in a live state. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga8d5e18cffd8389542af8334513e0ef09(int sync_fence_fd, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga8b595e8510f91fa0f7d9eaa09fe6c269 **event)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Create a [ANeuralNetworksEvent](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga8b595e8510f91fa0f7d9eaa09fe6c269) from a sync_fence file descriptor. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga22c89b22bb589a408fb2ec4a17af05ad(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga8b595e8510f91fa0f7d9eaa09fe6c269 *event)` | `void` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Destroys the event. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga2a31d4421e31a8493fd8f5a653d682fa(const https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga8b595e8510f91fa0f7d9eaa09fe6c269 *event, int *sync_fence_fd)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Get sync_fence file descriptor from the event. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9505d7f3b59a0e089d4ce67f293addfa(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga8b595e8510f91fa0f7d9eaa09fe6c269 *event)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Waits until the execution completes. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gae4f4b99ab910a2397bf1b857c11f7206(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b *execution, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5548a531e2a408cbe9c36fad1530118f *burst)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Schedule synchronous evaluation of the execution on a burst object. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga52bfde74591c81eae1ff010199f4a2e2(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b *execution)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Schedule synchronous evaluation of the execution. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga436633d3e8c4ebf6e3c44778799ca6b4(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6 *compilation, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b **execution)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Create a [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) to apply the given compilation. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga0399f20dfdf762c40d03c306749813a3(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b *execution, bool enable)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Specifies whether the [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) is able to accept padded input and output buffers and memory objects. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga6e72eaa3a6fb96be9f5ac7f5df4ed7ea(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b *execution)` | `void` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Destroy an execution. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf805e7328ab2ca185764028daab4c87f(const https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b *execution, int32_t durationCode, uint64_t *duration)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Get the time spent in the latest computation evaluated on the specified [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b), in nanoseconds. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gabefac7caff75fa62ae25964d13d01d61(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b *execution, int32_t index, uint32_t *dimensions)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Get the dimensional information of the specified output operand of the model of the latest computation evaluated on [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b). |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga8fb98db582ff0599aade3963694f43f1(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b *execution, int32_t index, uint32_t *rank)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Get the dimensional information of the specified output operand of the model of the latest computation evaluated on [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b). |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gac67f2c8f1ea2136d57bc871da2e6982f(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b *execution, int32_t index, const https://developer.android.com/ndk/reference/struct/a-neural-networks-operand-type#struct_a_neural_networks_operand_type *type, const void *buffer, size_t length)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Associate a user buffer with an input of the model of the [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b). |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga33a63f2ee1b1b17304f76ef8376af224(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b *execution, int32_t index, const https://developer.android.com/ndk/reference/struct/a-neural-networks-operand-type#struct_a_neural_networks_operand_type *type, const https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9a6b7719f0613ba9e2c93cffd97ebfc0 *memory, size_t offset, size_t length)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Associate a region of a memory object with an input of the model of the [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b). |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga91a8096a35988e1e5a15d4aa0e9e6a8d(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b *execution, uint64_t duration)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Set the maximum duration of WHILE loops in the specified execution. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga09e518f7facf0da023bfa13405439301(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b *execution, bool measure)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Specifies whether duration of the [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) is to be measured. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga7c25ad87c553d207efb257d09e62801e(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b *execution, int32_t index, const https://developer.android.com/ndk/reference/struct/a-neural-networks-operand-type#struct_a_neural_networks_operand_type *type, void *buffer, size_t length)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Associate a user buffer with an output of the model of the [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b). |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gafcd74c997781e196e081f19108e2c441(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b *execution, int32_t index, const https://developer.android.com/ndk/reference/struct/a-neural-networks-operand-type#struct_a_neural_networks_operand_type *type, const https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9a6b7719f0613ba9e2c93cffd97ebfc0 *memory, size_t offset, size_t length)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Associate a region of a memory object with an output of the model of the [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b). |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaa4d2abe06303d6728e4864d8f07c1a3a(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b *execution, bool reusable)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Specifies whether the [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) can be reused for multiple computations. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gab5896a441a236c08b99fcb7a4d02fe83(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b *execution, uint64_t duration)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Set the maximum expected duration of the specified execution. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5d5dc6f589d19221892c3ccb7b622e33(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b *execution, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga8b595e8510f91fa0f7d9eaa09fe6c269 **event)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Schedule asynchronous evaluation of the execution. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga371f25c6c44c05f8d267bb6f27ceeb3a(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b *execution, const https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga8b595e8510f91fa0f7d9eaa09fe6c269 *const *dependencies, uint32_t num_dependencies, uint64_t duration, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga8b595e8510f91fa0f7d9eaa09fe6c269 **event)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Schedule asynchronous evaluation of the execution with dependencies. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga3275184f420acc65e5080df7a308f9b7(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga92661bd0904009e8d0c9e8e1bf40bd84 *desc, const https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6 *compilation, uint32_t index, float frequency)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Specify that a memory object will be playing the role of an input to an execution created from a particular compilation. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga26c6391eb75bb83d14702d80fc4f6c41(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga92661bd0904009e8d0c9e8e1bf40bd84 *desc, const https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6 *compilation, uint32_t index, float frequency)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Specify that a memory object will be playing the role of an output to an execution created from a particular compilation. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gab0bffa683c1d1adbc5fa094e68304ee2(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga92661bd0904009e8d0c9e8e1bf40bd84 **desc)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Create a [ANeuralNetworksMemoryDesc](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga92661bd0904009e8d0c9e8e1bf40bd84) with no properties. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5e0c5b7ee674a6e3a011be7957986ec8(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga92661bd0904009e8d0c9e8e1bf40bd84 *desc)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Indicate that we have finished modifying a memory descriptor. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga010bf0653a9c55f549806c1065636827(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga92661bd0904009e8d0c9e8e1bf40bd84 *desc)` | `void` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Destroy a memory descriptor. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gac259bcb123a0ea9f868f6aef6b2269c4(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga92661bd0904009e8d0c9e8e1bf40bd84 *desc, uint32_t rank, const uint32_t *dimensions)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Set the dimensional information of the memory descriptor. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga58faff2cf57ac7691efc809b83a254da(const https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9a6b7719f0613ba9e2c93cffd97ebfc0 *src, const https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9a6b7719f0613ba9e2c93cffd97ebfc0 *dst)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Copies data from one memory object to another. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga75725b8ddd87e837937a576183fe6cd4(const https://developer.android.com/ndk/reference/group/a-hardware-buffer#group___a_hardware_buffer_1ga837cf80de697c99501d88bfe2326cfd4 *ahwb, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9a6b7719f0613ba9e2c93cffd97ebfc0 **memory)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Creates a shared memory object from an AHardwareBuffer handle. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga75511166bfbf29fb97a63548de8135bc(const https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga92661bd0904009e8d0c9e8e1bf40bd84 *desc, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9a6b7719f0613ba9e2c93cffd97ebfc0 **memory)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Creates a memory object from a memory descriptor. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga3a37c44f90bb727dc9eda5f65bb9aa68(size_t size, int protect, int fd, size_t offset, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9a6b7719f0613ba9e2c93cffd97ebfc0 **memory)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Creates a shared memory object from a file descriptor. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga8db9e0fed5e913a58320fc964288ba70(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9a6b7719f0613ba9e2c93cffd97ebfc0 *memory)` | `void` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Delete a memory object. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gabe3ab450ff498af8b3b4b88d5e256a36(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ce6f20a94d3a2de47fa5a810feeb9a4 *model, const https://developer.android.com/ndk/reference/struct/a-neural-networks-operand-type#struct_a_neural_networks_operand_type *type)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Add an operand to a model. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga21fea9a299a4c1437cf1d280436b5381(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ce6f20a94d3a2de47fa5a810feeb9a4 *model, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga1aa0c2cbc257093f98d6f0a2eb1932a5 type, uint32_t inputCount, const uint32_t *inputs, uint32_t outputCount, const uint32_t *outputs)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Add an operation to a model. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gadefc0c036914549f104237dd88676488(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ce6f20a94d3a2de47fa5a810feeb9a4 **model)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Create an empty [ANeuralNetworksModel](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ce6f20a94d3a2de47fa5a810feeb9a4). |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga74e521efc13d3eba79b8b779b306b53e(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ce6f20a94d3a2de47fa5a810feeb9a4 *model)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Indicate that we have finished modifying a model. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gae124cb448669f2713497107dfa4a563c(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ce6f20a94d3a2de47fa5a810feeb9a4 *model)` | `void` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Destroy a model. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf6b66f5fc0cd447269ad6035f49dbf4d(const https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ce6f20a94d3a2de47fa5a810feeb9a4 *model, const https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga34d622f70bbda9ded8b28ff5d0419678 *const *devices, uint32_t numDevices, bool *supportedOps)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Get the supported operations for a specified set of devices. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gacef56268ac6e5e80fa0b4714f57772ce(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ce6f20a94d3a2de47fa5a810feeb9a4 *model, uint32_t inputCount, const uint32_t *inputs, uint32_t outputCount, const uint32_t *outputs)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Specifies which operands will be the model's inputs and outputs. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga21cc8614f46a1553063b8b86d09ce75d(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ce6f20a94d3a2de47fa5a810feeb9a4 *model, bool allow)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Specifies whether [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) is allowed to be calculated with range and/or precision as low as that of the IEEE 754 16-bit floating-point format. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaa7ff0068c14c2dfcd805966699456e63(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ce6f20a94d3a2de47fa5a810feeb9a4 *model, int32_t index, const https://developer.android.com/ndk/reference/struct/a-neural-networks-symm-per-channel-quant-params#struct_a_neural_networks_symm_per_channel_quant_params *channelQuant)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Sets an operand's per channel quantization parameters. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga92fd1d7bdf40364620d72fdaaca991f3(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ce6f20a94d3a2de47fa5a810feeb9a4 *model, int32_t index, const void *buffer, size_t length)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Sets an operand to a constant value. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga0a1bcce272ba5ddfaa3c06a53ac7a6ec(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ce6f20a94d3a2de47fa5a810feeb9a4 *model, int32_t index, const https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9a6b7719f0613ba9e2c93cffd97ebfc0 *memory, size_t offset, size_t length)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Sets an operand to a value stored in a memory object. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga0cf32351868cc803cf25bf46f19d73b4(https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ce6f20a94d3a2de47fa5a810feeb9a4 *model, int32_t index, const https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ce6f20a94d3a2de47fa5a810feeb9a4 *value)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Sets an operand to a value that is a reference to another NNAPI model. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf60921202ae6128fedcd7a391b198915()` | `uint64_t` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Get the default timeout value for WHILE loops. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga2248fe3852454ad43a7fb74ba15a092c(uint32_t devIndex, https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga34d622f70bbda9ded8b28ff5d0419678 **device)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Get the representation of the specified device. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaad8be50acb25e9c885691a4e9184c7c4(uint32_t *numDevices)` | `int` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Get the number of available devices. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gac382b8e61eb908bc8d076bce43e561d4()` | `uint64_t` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Get the maximum timeout value for WHILE loops. |
| `https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga70048cdcbc0ec44b141f20eda9d086a5()` | `int64_t` **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details. Get the NNAPI runtime feature level. |

| ### Structs ||
|---|---|
| [ANeuralNetworksOperandType](https://developer.android.com/ndk/reference/struct/a-neural-networks-operand-type) | [ANeuralNetworksOperandType](https://developer.android.com/ndk/reference/struct/a-neural-networks-operand-type#struct_a_neural_networks_operand_type) describes the type of an operand. |
| [ANeuralNetworksSymmPerChannelQuantParams](https://developer.android.com/ndk/reference/struct/a-neural-networks-symm-per-channel-quant-params) | Parameters for ANEURALNETWORKS_TENSOR_QUANT8_SYMM_PER_CHANNEL operand. |

## Enumerations

### Anonymous Enum 54

Declared in `android/NeuralNetworksTypes.h`

```
 Anonymous Enum 54
```
For [ANeuralNetworksModel_setOperandValue](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga92fd1d7bdf40364620d72fdaaca991f3), values with a length smaller or equal to this will be immediately copied into the model.

The size is in bytes.

Available since NNAPI feature level 1.

| Properties ||
|---|---|
| `ANEURALNETWORKS_MAX_SIZE_OF_IMMEDIATELY_COPIED_VALUES` |   |

### Anonymous Enum 55

Declared in `android/NeuralNetworksTypes.h`

```
 Anonymous Enum 55
```
For [ANeuralNetworksCompilation_setCaching](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga825b1b36f8e22aed5e97c8e6d46a844e), specify the size of the cache token required from the application.

The size is in bytes.

Available since NNAPI feature level 3.

| Properties ||
|---|---|
| `ANEURALNETWORKS_BYTE_SIZE_OF_CACHE_TOKEN` |   |

### DeviceTypeCode

Declared in `android/NeuralNetworksTypes.h`

```
 DeviceTypeCode
```
Device types.

The type of NNAPI device.

| Properties ||
|---|---|
| `ANEURALNETWORKS_DEVICE_ACCELERATOR` | Dedicated accelerator for Machine Learning workloads. |
| `ANEURALNETWORKS_DEVICE_CPU` | The device runs NNAPI models on single or multi-core CPU. |
| `ANEURALNETWORKS_DEVICE_GPU` | The device can run NNAPI models and also accelerate graphics APIs such as OpenGL ES and Vulkan. |
| `ANEURALNETWORKS_DEVICE_OTHER` | The device does not fall into any category below. |
| `ANEURALNETWORKS_DEVICE_UNKNOWN` | The device type cannot be provided. |

### DurationCode

Declared in `android/NeuralNetworksTypes.h`

```
 DurationCode
```
Different duration measurements.

Durations are measured in nanoseconds.

Available since NNAPI feature level 3.

| Properties ||
|---|---|
| `ANEURALNETWORKS_DURATION_IN_DRIVER` |   |
| `ANEURALNETWORKS_DURATION_ON_HARDWARE` |   |
| `ANEURALNETWORKS_FENCED_DURATION_IN_DRIVER` |   |
| `ANEURALNETWORKS_FENCED_DURATION_ON_HARDWARE` |   |

### FeatureLevelCode

Declared in `android/NeuralNetworksTypes.h`

```
 FeatureLevelCode
```
NNAPI feature levels.

Each update of the NNAPI specification yields a new NNAPI feature level enum value. NNAPI feature level corrseponds to an NNAPI specification version that a driver and/or the NNAPI runtime can implement.

A feature level up to and including "FEATURE_LEVEL_5" maps directly to the Android API level that introduced the corresponding update of the NNAPI specification. Feature levels after Android API level 31 have no association with API level because the NNAPI specification can be updated between Android API releases. Outputs of [ANeuralNetworksDevice_getFeatureLevel](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5cc923384065f37721fbbd75f80ecfd4) and [ANeuralNetworks_getRuntimeFeatureLevel](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga70048cdcbc0ec44b141f20eda9d086a5) must be compared against these enum values instead of the Android API level.

| Properties ||
|---|---|
| `ANEURALNETWORKS_FEATURE_LEVEL_1` | NNAPI specification available in Android O-MR1, Android NNAPI feature level 1. |
| `ANEURALNETWORKS_FEATURE_LEVEL_2` | NNAPI specification available in Android P, Android NNAPI feature level 2. |
| `ANEURALNETWORKS_FEATURE_LEVEL_3` | NNAPI specification available in Android Q, Android NNAPI feature level 3. |
| `ANEURALNETWORKS_FEATURE_LEVEL_4` | NNAPI specification available in Android R, Android NNAPI feature level 4. |
| `ANEURALNETWORKS_FEATURE_LEVEL_5` | NNAPI specification available in Android S, Android NNAPI feature level 5. After Android S, the NNAPI specification can be updated between Android API releases. |
| `ANEURALNETWORKS_FEATURE_LEVEL_6` | Android NNAPI feature level 6. |
| `ANEURALNETWORKS_FEATURE_LEVEL_7` | Android NNAPI feature level 7. |
| `ANEURALNETWORKS_FEATURE_LEVEL_8` | Android NNAPI feature level 8. |

### FuseCode

Declared in `android/NeuralNetworksTypes.h`

```
 FuseCode
```
Fused activation function types.

Available since NNAPI feature level 1.

| Properties ||
|---|---|
| `ANEURALNETWORKS_FUSED_NONE` | NO fused activation function. |
| `ANEURALNETWORKS_FUSED_RELU` | Fused ReLU activation function. |
| `ANEURALNETWORKS_FUSED_RELU1` | Fused ReLU1 activation function. |
| `ANEURALNETWORKS_FUSED_RELU6` | Fused ReLU6 activation function. |

### OperandCode

Declared in `android/NeuralNetworksTypes.h`

```
 OperandCode
```
Operand types.

The type of an operand in a model.

Types prefaced with ANEURALNETWORKS_TENSOR_\* must be used for tensor data (i.e., tensors with at least one dimension). Types not prefaced by ANEURALNETWORKS_TENSOR_\* represent scalar values and must have no dimensions.

Although we define many types, most operators accept just a few types. Most used are [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447), [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3), and [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc).

Available since NNAPI feature level 1.

| Properties ||
|---|---|
| `ANEURALNETWORKS_BOOL` | An 8 bit boolean scalar value. Values of this operand type are either true or false. A zero value represents false; any other value represents true. Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_FLOAT16` | An IEEE 754 16 bit floating point scalar value. Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_FLOAT32` | A 32 bit floating point scalar value. |
| `ANEURALNETWORKS_INT32` | A signed 32 bit integer scalar value. |
| `ANEURALNETWORKS_MODEL` | A reference to a model. [ANeuralNetworksModel_setOperandValueFromModel](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga0cf32351868cc803cf25bf46f19d73b4) must be used to set the value for an Operand of this type. Available since NNAPI feature level 4. |
| `ANEURALNETWORKS_TENSOR_BOOL8` | A tensor of 8 bit boolean values. Values of this operand type are either true or false. A zero value represents false; any other value represents true. Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_TENSOR_FLOAT16` | A tensor of IEEE 754 16 bit floating point values. Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_TENSOR_FLOAT32` | A tensor of 32 bit floating point values. |
| `ANEURALNETWORKS_TENSOR_INT32` | A tensor of 32 bit integer values. |
| `ANEURALNETWORKS_TENSOR_QUANT16_ASYMM` | A tensor of 16 bit unsigned integers that represent real numbers. Attached to this tensor are two numbers that can be used to convert the 16 bit integer to the real value and vice versa. These two numbers are: - scale: a 32 bit floating point value greater than zero. - zeroPoint: a 32 bit integer, in range \[0, 65535\]. <br /> The formula is: real_value = (integer_value - zeroPoint) \* scale. Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_TENSOR_QUANT16_SYMM` | A tensor of 16 bit signed integers that represent real numbers. Attached to this tensor is a number representing real value scale that is used to convert the 16 bit number to a real value in the following way: realValue = integerValue \* scale. scale is a 32 bit floating point with value greater than zero. Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_TENSOR_QUANT8_ASYMM` | A tensor of 8 bit unsigned integers that represent real numbers. Attached to this tensor are two numbers that can be used to convert the 8 bit integer to the real value and vice versa. These two numbers are: - scale: a 32 bit floating point value greater than zero. - zeroPoint: a 32 bit integer, in range \[0, 255\]. <br /> The formula is: real_value = (integer_value - zeroPoint) \* scale. |
| `ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED` | A tensor of 8 bit signed integers that represent real numbers. Attached to this tensor are two numbers that can be used to convert the 8 bit integer to the real value and vice versa. These two numbers are: - scale: a 32 bit floating point value greater than zero. - zeroPoint: a 32 bit integer, in range \[-128, 127\]. <br /> The formula is: real_value = (integer_value - zeroPoint) \* scale. Available since NNAPI feature level 4. |
| `ANEURALNETWORKS_TENSOR_QUANT8_SYMM` | A tensor of 8 bit signed integers that represent real numbers. Attached to this tensor is a number representing real value scale that is used to convert the 8 bit number to a real value in the following way: realValue = integerValue \* scale. scale is a 32 bit floating point with value greater than zero. Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_TENSOR_QUANT8_SYMM_PER_CHANNEL` | A tensor of 8 bit signed integers that represent real numbers. This tensor is associated with additional fields that can be used to convert the 8 bit signed integer to the real value and vice versa. These fields are: - channelDim: a 32 bit unsigned integer indicating channel dimension. - scales: an array of positive 32 bit floating point values. The size of the scales array must be equal to dimensions\[channelDim\]. <br /> [ANeuralNetworksModel_setOperandSymmPerChannelQuantParams](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaa7ff0068c14c2dfcd805966699456e63) must be used to set the parameters for an Operand of this type. The channel dimension of this tensor must not be unknown (dimensions\[channelDim\] != 0). The formula is: realValue\[..., C, ...\] = integerValue\[..., C, ...\] \* scales\[C\] where C is an index in the Channel dimension. Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_UINT32` | An unsigned 32 bit integer scalar value. |

### OperationCode

Declared in `android/NeuralNetworksTypes.h`

```
 OperationCode
```
Operation types.

The type of an operation in a model.

Available since NNAPI feature level 1.

| Properties ||
|---|---|
| `ANEURALNETWORKS_ABS` | Computes the absolute value of a tensor, element-wise. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) (since NNAPI feature level 4) <br /> Supported tensor rank: from 1. Inputs: - 0: A tensor. <br /> Outputs: - 0: The output tensor of same shape as input0. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_ADD` | Adds two tensors, element-wise. Takes two input tensors of identical [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) and compatible dimensions. The output is the sum of both input tensors, optionally modified by an activation function. Two dimensions are compatible when: 1. they are equal, or 2. one of them is 1 <br /> The size of the output is the maximum size along each dimension of the input operands. It starts with the trailing dimensions, and works its way forward. Example: ``` input1.dimension = {4, 1, 2} input2.dimension = {5, 4, 3, 1} output.dimension = {5, 4, 3, 2} ``` <br /> Since NNAPI feature level 3, generic zero-sized input tensor is supported. Zero dimension is only compatible with 0 or 1. The size of the output dimension is zero if either of corresponding input dimension is zero. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) - [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) (since NNAPI feature level 4) <br /> Supported tensor rank: up to 4 Inputs: - 0: A tensor. - 1: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298), and compatible dimensions as input0. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scales and zeroPoint can be different from input0 scale and zeroPoint. - 2: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, and has to be one of the [FuseCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ec620045a39909a6bf00b3ee0c4d414) values. Specifies the activation to invoke on the result. For a [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) tensor, the [FuseCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ec620045a39909a6bf00b3ee0c4d414) must be "NONE". <br /> Outputs: - 0: The sum, a tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) as input0. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scale and zeroPoint can be different from inputs' scale and zeroPoint. <br /> Available since NNAPI feature level 1. |
| `ANEURALNETWORKS_ARGMAX` | Returns the index of the largest element along an axis. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: from 1 Inputs: - 0: An n-D tensor specifying the input. Must be non-empty. - 1: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar specifying the axis to reduce across. Negative index is used to specify axis from the end (e.g. -1 for the last axis). Must be in the range \[-n, n). <br /> Outputs: - 0: An (n - 1)-D [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) tensor. If input is 1-dimensional, the output shape is \[1\]. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_ARGMIN` | Returns the index of the smallest element along an axis. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: from 1 Inputs: - 0: An n-D tensor specifying the input. Must be non-empty. - 1: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar specifying the axis to reduce across. Negative index is used to specify axis from the end (e.g. -1 for the last axis). Must be in the range \[-n, n). <br /> Outputs: - 0: An (n - 1)-D [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) tensor. If input is 1-dimensional, the output shape is \[1\]. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_AVERAGE_POOL_2D` | Performs a 2-D average pooling operation. The output dimensions are functions of the filter dimensions, stride, and padding. The values in the output tensor are computed as: ``` output[b, i, j, channel] = sum_{di, dj}( input[b, strides[1] * i + di, strides[2] * j + dj, channel] ) / sum(1) ``` <br /> Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: 4, with "NHWC" or "NCHW" data layout. With the default data layout NHWC, the data is stored in the order of: \[batch, height, width, channels\]. Alternatively, the data layout could be NCHW, the data storage order of: \[batch, channels, height, width\]. NCHW is supported since NNAPI feature level 3. Both explicit padding and implicit padding are supported. Inputs (explicit padding): - 0: A 4-D tensor, of shape \[batches, height, width, depth\], specifying the input. Since NNAPI feature level 3, zero batches is supported for this tensor. - 1: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the padding on the left, in the 'width' dimension. - 2: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the padding on the right, in the 'width' dimension. - 3: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the padding on the top, in the 'height' dimension. - 4: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the padding on the bottom, in the 'height' dimension. - 5: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the stride when walking through input in the 'width' dimension. - 6: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the stride when walking through input in the 'height' dimension. - 7: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the filter width. - 8: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the filter height. - 9: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, and has to be one of the [FuseCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ec620045a39909a6bf00b3ee0c4d414) values. Specifies the activation to invoke on the result. - 10: An optional [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, default to false. Set to true to specify NCHW data layout for input0 and output0. Available since NNAPI feature level 3. <br /> Inputs (implicit padding): - 0: A 4-D tensor, of shape \[batches, height, width, depth\], specifying the input. Since NNAPI feature level 3, zero batches is supported for this tensor. - 1: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the implicit padding scheme, has to be one of the [PaddingCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gab72e9e6263fd5b015bb7f41ec18ce220) values. - 2: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the stride when walking through input in the 'width' dimension. - 3: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the stride when walking through input in the 'height' dimension. - 4: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the filter width. - 5: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the filter height. - 6: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, and has to be one of the [FuseCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ec620045a39909a6bf00b3ee0c4d414) values. Specifies the activation to invoke on the result. - 7: An optional [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, default to false. Set to true to specify NCHW data layout for input0 and output0. Available since NNAPI feature level 3. <br /> Outputs: - 0: The output 4-D tensor, of shape \[batches, out_height, out_width, depth\]. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scale and zeroPoint must be the same as input0. <br /> Available since NNAPI feature level 1. |
| `ANEURALNETWORKS_AXIS_ALIGNED_BBOX_TRANSFORM` | Transform axis-aligned bounding box proposals using bounding box deltas. Given the positions of bounding box proposals and the corresponding bounding box deltas for each class, return the refined bounding box regions. The resulting bounding boxes are cliped against the edges of the image. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT16_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aac04cfb70bef0e2f4081b6b69a80ddf7) <br /> Inputs: - 0: A 2-D Tensor of shape \[num_rois, 4\], specifying the locations of the bounding box proposals, each line with format \[x1, y1, x2, y2\]. For tensor of type [ANEURALNETWORKS_TENSOR_QUANT16_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aac04cfb70bef0e2f4081b6b69a80ddf7), the zeroPoint must be 0 and the scale must be 0.125. Zero num_rois is supported for this tensor. - 1: A 2-D Tensor of shape \[num_rois, num_classes \* 4\], specifying the bounding box delta for each region of interest and each class. The bounding box deltas are organized in the following order \[dx, dy, dw, dh\], where dx and dy is the relative correction factor for the center position of the bounding box with respect to the width and height, dw and dh is the log-scale relative correction factor for the width and height. For input0 of type [ANEURALNETWORKS_TENSOR_QUANT16_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aac04cfb70bef0e2f4081b6b69a80ddf7), this tensor should be of [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) or [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9). Zero num_rois is supported for this tensor. - 2: An 1-D [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) tensor, of shape \[num_rois\], specifying the batch index of each box. Boxes with the same batch index are grouped together. Zero num_rois is supported for this tensor. - 3: A 2-D Tensor of shape \[batches, 2\], specifying the information of each image in the batch, each line with format \[image_height, image_width\]. <br /> Outputs: - 0: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) as input0, with shape \[num_rois, num_classes \* 4\], specifying the coordinates of each output bounding box for each class, with format \[x1, y1, x2, y2\]. For type of [ANEURALNETWORKS_TENSOR_QUANT16_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aac04cfb70bef0e2f4081b6b69a80ddf7), the scale must be 0.125 and the zero point must be 0. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_BATCH_MATMUL` | Performs multiplication of two tensors in batches. Multiplies all slices of two input tensors and arranges the individual results in a single output tensor of the same batch size. Each pair of slices in the same batch have identical [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298). Each slice can optionally be adjointed (transpose and conjugate) before multiplication. The two input tensors and the output tensor must be 2-D or higher and have the same batch size. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) - [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) <br /> Supported tensor rank: at least 2 and up to 4 Inputs: - 0: A tensor with 2-D or higher shape \[..., r_x, c_x\]. - 1: A tensor with 2-D or higher shape \[..., r_y, c_y\]. It has the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) and batch size as input0. - 2: An optional [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar adj_x, default to false. Set to true to adjoint the slices of input0. - 3: An optional [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar adj_y, default to false. Set to true to adjoint the slices of input1. <br /> Outputs: - 0: A tensor with 2-D or higher shape \[..., r_o, c_o\], where r_o = c_x if adj_x else r_x c_o = r_y if adj_y else c_y <br /> Available since NNAPI feature level 6. |
| `ANEURALNETWORKS_BATCH_TO_SPACE_ND` | BatchToSpace for N-dimensional tensors. This operation reshapes the batch dimension (dimension 0) into M + 1 dimensions of shape block_shape + \[batch\], interleaves these blocks back into the grid defined by the spatial dimensions \[1, ..., M\], to obtain a result with the same rank as the input. This is the reverse of SpaceToBatch. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: 4, with "NHWC" or "NCHW" data layout. With the default data layout NHWC, the data is stored in the order of: \[batch, height, width, channels\]. Alternatively, the data layout could be NCHW, the data storage order of: \[batch, channels, height, width\]. NCHW is supported since NNAPI feature level 3. Inputs: - 0: An n-D tensor, specifying the tensor to be reshaped - 1: A 1-D Tensor of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896), the block sizes for each spatial dimension of the input tensor. All values must be \>= 1. - 2: An optional [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, default to false. Set to true to specify NCHW data layout for input0 and output0. Available since API level 29. <br /> Outputs: - 0: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) as input0. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scale and zeroPoint must be the same as input0. <br /> Available since NNAPI feature level 2. |
| `ANEURALNETWORKS_BIDIRECTIONAL_SEQUENCE_LSTM` | A recurrent neural network layer that applies an LSTM cell to a sequence of inputs in forward and backward directions. The op supports cross-linking via an auxiliary input. Regular cell feeds one input into the two RNN cells in the following way: ``` INPUT  (INPUT_REVERSED) |         | ``` *** ** * ** *** ## \| FW_LSTM BW_LSTM \| <br /> \| \| FW_OUT BW_OUT An op with cross-linking takes two inputs and feeds them into the RNN cells in the following way: ``` AUX_INPUT   (AUX_INPUT_REVERSED) |             | INPUT | (INPUT_R'D.)| |   |       |     | ``` *** ** * ** *** \| \\ / \\ / \| ## \| FW_LSTM BW_LSTM \| <br /> \| \| FW_OUT BW_OUT The cross-linking mode is enabled iff auxiliary input and auxiliary weights are present. While stacking this op on top of itself, this allows to connect both forward and backward outputs from previous cell to the next cell's input. Since NNAPI feature level 4 parallel linking mode is supported. The mode is enabled if auxiliary input is present but auxiliary weights are omitted. In this case, the cell feeds inputs into the RNN in the following way: ``` INPUT (AUX_INPUT_REVERSED) |         | ``` *** ** * ** *** ## \| FW_LSTM BW_LSTM \| <br /> \| \| FW_OUT BW_OUT While stacking this op on top of itself, this allows to connect both forward and backward outputs from previous cell to the next cell's corresponding inputs. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) <br /> Supported tensor rank: 3, either time-major or batch-major. All input and output tensors must be of the same type. Inputs: - 0: The input. A 3-D tensor of shape: If time-major: \[max_time, batch_size, input_size\] If batch-major: \[batch_size, max_time, input_size\] where "max_time" is the number of timesteps (sequence length), "batch_size" corresponds to the batching dimension, and "input_size" is the size of the input. - 1: The forward input-to-input weights. Optional. A 2-D tensor of shape \[fw_num_units, input_size\], where "fw_num_units" corresponds to the number of forward cell units. - 2: The forward input-to-forget weights. A 2-D tensor of shape \[fw_num_units, input_size\]. - 3: The forward input-to-cell weights. A 2-D tensor of shape \[fw_num_units, input_size\]. - 4: The forward input-to-output weights. A 2-D tensor of shape \[fw_num_units, input_size\]. - 5: The forward recurrent-to-input weights. Optional. A 2-D tensor of shape \[fw_num_units, fw_output_size\], where "fw_output_size" corresponds to either the number of cell units (i.e., fw_num_units), or the second dimension of the "fw_projection_weights", if defined. - 6: The forward recurrent-to-forget weights. A 2-D tensor of shape \[fw_num_units, fw_output_size\]. - 7: The forward recurrent-to-cell weights. A 2-D tensor of shape \[fw_num_units, fw_output_size\]. - 8: The forward recurrent-to-output weights. A 2-D tensor of shape \[fw_num_units, fw_output_size\]. - 9: The forward cell-to-input weights. Optional. A 1-D tensor of shape \[fw_num_units\]. - 10: The forward cell-to-forget weights. Optional. A 1-D tensor of shape \[fw_num_units\]. - 11: The forward cell-to-output weights. Optional. A 1-D tensor of shape \[fw_num_units\]. - 12: The forward input gate bias. Optional. A 1-D tensor of shape \[fw_num_units\]. - 13: The forward forget gate bias. A 1-D tensor of shape \[fw_num_units\]. - 14: The forward cell gate bias. A 1-D tensor of shape \[fw_num_units\]. - 15: The forward output gate bias. A 1-D tensor of shape \[fw_num_units\]. - 16: The forward projection weights. Optional. A 2-D tensor of shape \[fw_output_size, fw_num_units\]. - 17: The forward projection bias. Optional. A 1-D tensor of shape \[fw_output_size\]. - 18: The backward input-to-input weights. Optional. A 2-D tensor of shape \[bw_num_units, input_size\], where "bw_num_units" corresponds to the number of backward cell units. - 19: The backward input-to-forget weights. A 2-D tensor of shape \[bw_num_units, input_size\]. - 20: The backward input-to-cell weights. A 2-D tensor of shape \[bw_num_units, input_size\]. - 21: The backward input-to-output weights. A 2-D tensor of shape \[bw_num_units, input_size\]. - 22: The backward recurrent-to-input weights. Optional. A 2-D tensor of shape \[bw_num_units, bw_output_size\], where "bw_output_size" corresponds to either the number of cell units (i.e., "bw_num_units"), or the second dimension of the "bw_projection_weights", if defined. - 23: The backward recurrent-to-forget weights. A 2-D tensor of shape \[bw_num_units, bw_output_size\]. - 24: The backward recurrent-to-cell weights. A 2-D tensor of shape \[bw_num_units, bw_output_size\]. - 25: The backward recurrent-to-output weights. A 2-D tensor of shape \[bw_num_units, bw_output_size\]. - 26: The backward cell-to-input weights. Optional. A 1-D tensor of shape \[bw_num_units\]. - 27: The backward cell-to-forget weights. Optional. A 1-D tensor of shape \[bw_num_units\]. - 28: The backward cell-to-output weights. Optional. A 1-D tensor of shape \[bw_num_units\]. - 29: The backward input gate bias. Optional. A 1-D tensor of shape \[bw_num_units\]. - 30: The backward forget gate bias. A 1-D tensor of shape \[bw_num_units\]. - 31: The backward cell gate bias. A 1-D tensor of shape \[bw_num_units\]. - 32: The backward output gate bias. A 1-D tensor of shape \[bw_num_units\]. - 33: The backward projection weights. Optional. A 2-D tensor of shape \[bw_output_size, bw_num_units\]. - 34: The backward projection bias. Optional. A 1-D tensor of shape \[bw_output_size\]. - 35: The forward input activation state. A 2-D tensor of shape \[batch_size, bw_output_size\]. - 36: The forward input cell state. A 2-D tensor of shape \[batch_size, bw_num_units\]. - 37: The backward input activation state. A 2-D tensor of shape \[batch_size, bw_output_size\]. - 38: The backward input cell state. A 2-D tensor of shape \[batch_size, bw_num_units\]. - 39: The auxiliary input. Optional. A 3-D tensor of shape \[max_time, batch_size, aux_input_size\], where "batch_size" corresponds to the batching dimension, and "aux_input_size" is the size of the auxiliary input. Optional. See the docs above for the usage modes explanation. - 40: The forward auxiliary input-to-input weights. Optional. See the docs above for the usage modes explanation. A 2-D tensor of shape \[fw_num_units, aux_input_size\]. - 41: The forward auxiliary input-to-forget weights. Optional. See the docs above for the usage modes explanation. A 2-D tensor of shape \[fw_num_units, aux_input_size\]. - 42: The forward auxiliary input-to-cell weights. Optional. See the docs above for the usage modes explanation. A 2-D tensor of shape \[fw_num_units, aux_input_size\]. - 43: The forward auxiliary input-to-output weights. Optional. See the docs above for the usage modes explanation. A 2-D tensor of shape \[fw_num_units, aux_input_size\]. - 44: The backward auxiliary input-to-input weights. Optional. See the docs above for the usage modes explanation. A 2-D tensor of shape \[bw_num_units, aux_input_size\]. - 45: The backward auxiliary input-to-forget weights. Optional. See the docs above for the usage modes explanation. A 2-D tensor of shape \[bw_num_units, aux_input_size\]. - 46: The backward auxiliary input-to-cell weights. Optional. See the docs above for the usage modes explanation. A 2-D tensor of shape \[bw_num_units, aux_input_size\]. - 47: The backward auxiliary input-to-output weights. Optional. See the docs above for the usage modes explanation. A 2-D tensor of shape \[bw_num_units, aux_input_size\]. - 48: The activation function. A value indicating the activation function: - 0: None; - 1: Relu; - 3: Relu6; - 4: Tanh; - 6: Sigmoid. - 49: The clipping threshold for the cell state, such that values are bound within \[-cell_clip, cell_clip\]. If set to 0.0 then clipping is disabled. If all the input tensors have type [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447), this scalar must be of the type [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578), otherwise if all the input tensors have the type [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c), this scalar must be of type [ANEURALNETWORKS_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a823c78695644dea4e94aa04ff2d00cd7). - 50: The clipping threshold for the output from the projection layer, such that values are bound within \[-proj_clip, proj_clip\]. If set to 0.0 then clipping is disabled. If all the input tensors have type [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447), this scalar must be of the type [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578), otherwise if all the input tensors have the type [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c), this scalar must be of type [ANEURALNETWORKS_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a823c78695644dea4e94aa04ff2d00cd7). - 51: merge_outputs An [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar specifying if the outputs from forward and backward cells should be merged. - 52: time_major An [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar specifying the shape format of input and output tensors. - 53: The forward input layer normalization weights. Optional. A 1-D tensor of shape \[fw_num_units\]. Used to rescale normalized inputs to activation at input gate. - 54: The forward forget layer normalization weights. Optional. A 1-D tensor of shape \[fw_num_units\]. Used to rescale normalized inputs to activation at forget gate. - 55: The forward cell layer normalization weights. Optional. A 1-D tensor of shape \[fw_num_units\]. Used to rescale normalized inputs to activation at cell gate. - 56: The forward output layer normalization weights. Optional. A 1-D tensor of shape \[fw_num_units\]. Used to rescale normalized inputs to activation at output gate. - 57: The backward input layer normalization weights. Optional. A 1-D tensor of shape \[bw_num_units\]. Used to rescale normalized inputs to activation at input gate. - 58: The backward forget layer normalization weights. Optional. A 1-D tensor of shape \[bw_num_units\]. Used to rescale normalized inputs to activation at forget gate. - 59: The backward cell layer normalization weights. Optional. A 1-D tensor of shape \[bw_num_units\]. Used to rescale normalized inputs to activation at cell gate. - 60: The backward output layer normalization weights. Optional. A 1-D tensor of shape \[bw_num_units\]. Used to rescale normalized inputs to activation at output gate. <br /> Outputs: - 0: The forward output. A 3-D tensor of shape: If time-major and not merge_outputs: \[max_time, batch_size, fw_output_size\] If time-major and merge_outputs: \[max_time, batch_size, fw_output_size + bw_output_size\] If batch-major and not merge_outputs: \[batch_size, max_time, fw_output_size\] If batch-major and merge_outputs: \[batch_size, max_time, fw_output_size + bw_output_size\] - 1: The backward output. Unused if merge_outputs is true. A 3-D tensor of shape: If time-major: \[max_time, batch_size, bw_output_size\] If batch-major: \[batch_size, max_time, bw_output_size\] - 2: The forward activation state output. A 2-D tensor of shape \[batch_size, fw_output_size\] containing an activation state from the last time step in the sequence. This output is optional and can be omitted. If this output is present then outputs 3-5 must be present as well. Available since NNAPI feature level 4. - 3: The forward cell state output. A tensor of shape \[batch_size, fw_cell_size\] containing a cell state from the last time step in the sequence. This output is optional and can be omitted. If this output is present then outputs 2, 4, 5 must be present as well. Available since NNAPI feature level 4. - 4: The backward activation state output. A 2-D tensor of shape \[batch_size, bw_output_size\] containing an activation state from the last time step in the sequence. This output is optional and can be omitted. If this output is present then outputs 2, 3, 5 must be present as well. Available since NNAPI feature level 4. - 5: The backward cell state output. A tensor of shape \[batch_size, bw_cell_size\] containing a cell state from the last time step in the sequence. This output is optional and can be omitted. If this output is present then outputs 2-4 must be present as well. Available since NNAPI feature level 4. <br /> Available since NNAPI feature level 3. Important: As of NNAPI feature level 3, there is no way to get the output state tensors out and NNAPI does not maintain internal states. This operator does not support the usage pattern in which multiple cells are chained and state tensors are propagated. |
| `ANEURALNETWORKS_BIDIRECTIONAL_SEQUENCE_RNN` | A recurrent neural network layer that applies a basic RNN cell to a sequence of inputs in forward and backward directions. This Op unrolls the input along the sequence dimension, and implements the following operation for each element in the sequence s = 1...sequence_length: fw_outputs\[s\] = fw_state = activation(inputs\[s\] \* fw_input_weights' + fw_state \* fw_recurrent_weights' + fw_bias) And for each element in sequence t = sequence_length : 1 bw_outputs\[t\] = bw_state = activation(inputs\[t\] \* bw_input_weights' + bw_state \* bw_recurrent_weights' + bw_bias) Where: - "{fw,bw}_input_weights" is a weight matrix that multiplies the inputs; - "{fw,bw}_recurrent_weights" is a weight matrix that multiplies the current "state" which itself is the output from the previous time step computation; - "{fw,bw}_bias" is a bias vector (added to each output vector in the batch); - "activation" is the function passed as the "fused_activation_function" argument (if not "NONE"). <br /> The op supports cross-linking via an auxiliary input. Regular cell feeds one input into the two RNN cells in the following way: ``` INPUT  (INPUT_REVERSED) |         | ``` *** ** * ** *** ## \| FW_RNN BW_RNN \| <br /> \| \| FW_OUT BW_OUT An op with cross-linking takes two inputs and feeds them into the RNN cells in the following way: ``` AUX_INPUT   (AUX_INPUT_REVERSED) |             | INPUT | (INPUT_R'D.)| |   |       |     | ``` *** ** * ** *** \| \\ / \\ / \| ## \| FW_RNN BW_RNN \| <br /> \| \| FW_OUT BW_OUT The cross-linking mode is enabled iff auxiliary input and auxiliary weights are present. While stacking this op on top of itself, this allows to connect both forward and backward outputs from previous cell to the next cell's input. Since NNAPI feature level 4 parallel linking mode is supported. The mode is enabled if auxiliary input is present but auxiliary weights are omitted. In this case, the cell feeds inputs into the RNN in the following way: ``` INPUT (AUX_INPUT_REVERSED) |         | ``` *** ** * ** *** ## \| FW_RNN BW_RNN \| <br /> \| \| FW_OUT BW_OUT While stacking this op on top of itself, this allows to connect both forward and backward outputs from previous cell to the next cell's corresponding inputs. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) <br /> The input tensors must all be the same type. Inputs: - 0: input. A 3-D tensor. The shape is defined by the input 6 (timeMajor). If it is set to true, then the input has a shape \[maxTime, batchSize, inputSize\], otherwise the input has a shape \[batchSize, maxTime, inputSize\]. - 1: fwWeights. A 2-D tensor of shape \[fwNumUnits, inputSize\]. - 2: fwRecurrentWeights. A 2-D tensor of shape \[fwNumUnits, fwNumUnits\]. - 3: fwBias. A 1-D tensor of shape \[fwNumUnits\]. - 4: fwHiddenState. A 2-D tensor of shape \[batchSize, fwNumUnits\]. Specifies a hidden state input for the first time step of the computation. - 5: bwWeights. A 2-D tensor of shape \[bwNumUnits, inputSize\]. - 6: bwRecurrentWeights. A 2-D tensor of shape \[bwNumUnits, bwNumUnits\]. - 7: bwBias. A 1-D tensor of shape \[bwNumUnits\]. - 8: bwHiddenState A 2-D tensor of shape \[batchSize, bwNumUnits\]. Specifies a hidden state input for the first time step of the computation. - 9: auxInput. A 3-D tensor. The shape is defined by the input 6 (timeMajor). If it is set to true, then the input has a shape \[maxTime, batchSize, auxInputSize\], otherwise the input has a shape \[batchSize, maxTime, auxInputSize\]. Can be omitted. See the docs above for the usage modes explanation. - 10:fwAuxWeights. A 2-D tensor of shape \[fwNumUnits, auxInputSize\]. Can be omitted. See the docs above for the usage modes explanation. - 11:bwAuxWeights. A 2-D tensor of shape \[bwNumUnits, auxInputSize\]. Can be omitted. See the docs above for the usage modes explanation. - 12:fusedActivationFunction. A [FuseCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ec620045a39909a6bf00b3ee0c4d414) value indicating the activation function. If "NONE" is specified then it results in a linear activation. - 13:timeMajor An [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar specifying the shape format of input and output tensors. - 14:mergeOutputs An [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar specifying if the outputs from forward and backward cells are separate (if set to false) or concatenated (if set to true). Outputs: - 0: fwOutput. A 3-D tensor. The first two dimensions of the shape are defined by the input 6 (timeMajor) and the third dimension is defined by the input 14 (mergeOutputs). If timeMajor is set to true, then the first two dimensions are \[maxTime, batchSize\], otherwise they are set to \[batchSize, maxTime\]. If mergeOutputs is set to true, then the third dimension is equal to (fwNumUnits + bwNumUnits), otherwise it is set to fwNumUnits. - 1: bwOutput. A 3-D tensor. If the input 14 (mergeOutputs) is set to true, then this tensor is not produced. The shape is defined by the input 6 (timeMajor). If it is set to true, then the shape is set to \[maxTime, batchSize, bwNumUnits\], otherwise the shape is set to \[batchSize, maxTime, bwNumUnits\]. - 2: The forward hidden state output. A 2-D tensor of shape \[batchSize, fwNumUnits\] containing a hidden state from the last time step in the sequence. This output is optional and can be omitted. If this output is present then output 3 must be present as well. Available since NNAPI feature level 4. - 3: The backward hidden state output. A 2-D tensor of shape \[batchSize, bwNumUnits\] containing a hidden state from the last time step in the sequence. This output is optional and can be omitted. If this output is present then output 2 must be present as well. Available since NNAPI feature level 4. <br /> Available since NNAPI feature level 3. Important: As of NNAPI feature level 3, there is no way to get the output state tensors out and NNAPI does not maintain internal states. This operator does not support the usage pattern in which multiple cells are chained and state tensors are propagated. |
| `ANEURALNETWORKS_BOX_WITH_NMS_LIMIT` | Greedily selects a subset of bounding boxes in descending order of score. This op applies NMS algorithm to each class. In each loop of execution, the box with maximum score gets selected and removed from the pending set. The scores of the rest of boxes are lowered according to the intersection-over-union (IOU) overlapping with the previously selected boxes and a specified NMS kernel method. Any boxes with score less than a threshold are removed from the pending set. Three NMS kernels are supported: - Hard: score_new = score_old \* (1 if IoU \< threshold else 0) - Linear: score_new = score_old \* (1 if IoU \< threshold else 1 - IoU) - Gaussian: score_new = score_old \* exp(- IoU\^2 / sigma) <br /> Axis-aligned bounding boxes are represented by its upper-left corner coordinate (x1,y1) and lower-right corner coordinate (x2,y2). A valid bounding box should satisfy x1 \<= x2 and y1 \<= y2. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Inputs: - 0: A 2-D Tensor of shape \[num_rois, num_classes\], specifying the score of each bounding box proposal. The boxes are grouped by batches in the first dimension. Zero num_rois is supported for this tensor. - 1: A 2-D Tensor specifying the bounding boxes of shape \[num_rois, num_classes \* 4\], organized in the order \[x1, y1, x2, y2\]. The boxes are grouped by batches in the first dimension. The sequential order of the boxes corresponds with input0. For input0 of type [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3), this tensor should be of [ANEURALNETWORKS_TENSOR_QUANT16_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aac04cfb70bef0e2f4081b6b69a80ddf7), with zeroPoint of 0 and scale of 0.125. For input0 of type [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9), this tensor should be of [ANEURALNETWORKS_TENSOR_QUANT16_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aac04cfb70bef0e2f4081b6b69a80ddf7), with zeroPoint of -128 and scale of 0.125. Zero num_rois is supported for this tensor. - 2: A 1-D [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) tensor, of shape \[num_rois\], specifying the batch index of each box. Boxes with the same batch index are grouped together. - 3: An [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578) scalar, score_threshold. Boxes with scores lower than the threshold are filtered before sending to the NMS algorithm. - 4: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the maximum number of selected bounding boxes for each image. Set to a negative value for unlimited number of output bounding boxes. - 5: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the NMS kernel method, options are 0:hard, 1:linear, 2:gaussian. - 6: An [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578) scalar, specifying the IoU threshold in hard and linear NMS kernel. This field is ignored if gaussian kernel is selected. - 7: An [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578) scalar, specifying the sigma in gaussian NMS kernel. This field is ignored if gaussian kernel is not selected. - 8: An [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578) scalar, nms_score_threshold. Boxes with scores lower than the threshold are dropped during the score updating phase in soft NMS. <br /> Outputs: - 0: A 1-D Tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) as input0, with shape \[num_output_rois\], specifying the score of each output box. The boxes are grouped by batches, but the sequential order in each batch is not guaranteed. For type of [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3), guaranteed. For type of [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) or [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9), the scale and zero point must be the same as input0. - 1: A 2-D Tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) as input1, with shape \[num_output_rois, 4\], specifying the coordinates of each output bounding box with the same format as input1. The sequential order of the boxes corresponds with output0. For type of [ANEURALNETWORKS_TENSOR_QUANT16_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aac04cfb70bef0e2f4081b6b69a80ddf7), the scale must be 0.125 and the zero point must be 0. - 2: A 1-D [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) tensor, of shape \[num_output_rois\], specifying the class of each output box. The sequential order of the boxes corresponds with output0. - 3: A 1-D [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) tensor, of shape \[num_output_rois\], specifying the batch index of each box. Boxes with the same batch index are grouped together. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_CAST` | Casts a tensor to a type. This operation ignores the scale and zeroPoint of quanized tensors, e.g. it treats a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) input as a tensor of uint8 values. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) Since NNAPI feature level 4, casting tensors of the following [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) to the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) is supported: - [ANEURALNETWORKS_TENSOR_BOOL8](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ab275c740307fbffcfec94adcc7b374b9) - [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) - [ANEURALNETWORKS_TENSOR_QUANT16_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aac04cfb70bef0e2f4081b6b69a80ddf7) - [ANEURALNETWORKS_TENSOR_QUANT16_SYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a750fa6aa30c71eb8d093ee1c44d25a12) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) - [ANEURALNETWORKS_TENSOR_QUANT8_SYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7a907ab82a0229f28bd188dd37a1ef52) <br /> Supported tensor rank: from 1 Inputs: - 0: A tensor. <br /> Outputs: - 0: A tensor with the same shape as input0. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_CHANNEL_SHUFFLE` | Shuffle the channels of the input tensor. Given an input tensor and a integer value of num_groups, CHANNEL_SHUFFLE divide the channel dimension into num_groups groups, and reorganize the channels by grouping channels with the same index in each group. Along the channel dimension, the output is calculated using this formula: ``` output_channel[k * num_groups + g] = input_channel[g * group_size + k] ``` <br /> where group_size = num_channels / num_groups The number of channels must be divisible by num_groups. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: up to 4 Inputs: - 0: An n-D tensor, specifying the tensor to be shuffled. - 1: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the number of groups. - 2: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the dimension channel shuffle would be performed on. Negative index is used to specify axis from the end (e.g. -1 for the last axis). Must be in the range \[-n, n). <br /> Outputs: - 0: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) and same shape as input0. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scale and zeroPoint must be the same as input0. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_CONCATENATION` | Concatenates the input tensors along the given dimension. The input tensors must have identical [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) and the same dimensions except the dimension along the concatenation axis. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) (full support since NNAPI feature level 3, see the input section) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: up to 4 Inputs: - 0 \~ n-1: The list of n input tensors, of shape \[D0, D1, ..., Daxis(i), ..., Dm\]. Before NNAPI feature level 3, all input tensors of [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) must have the same scale and zeroPoint as the output tensor. Input tensors of [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) are allowed to have different scale and zeroPoint. Since NNAPI feature level 3, zero-sized tensors are supported. - n: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the concatenation axis. <br /> Outputs: - 0: The output, a tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) as the input tensors. The output shape is \[D0, D1, ..., sum(Daxis(i)), ..., Dm\]. Since NNAPI feature level 3, for a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) tensor, the scale and zeroPoint values can be different from input tensors. Before NNAPI feature level 3 they have to be the same as for the input tensors. <br /> Available since NNAPI feature level 1. |
| `ANEURALNETWORKS_CONV_2D` | Performs a 2-D convolution operation. The CONV_2D op sweeps a 2-D filter that can mix channels together over a batch of images, applying the filter to each window of each image of the appropriate size. The output dimensions are functions of the filter dimensions, stride, and padding. The values in the output tensor are computed as: ``` output[b, i, j, channel] = sum_{di, dj, k} ( input[b, strides[1] * i + di, strides[2] * j + dj, k] * filter[channel, di, dj, k] ) + bias[channel] ``` <br /> Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) configurations: - 32 bit floating point: - \* [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) for input, filter, output, and bias. - Quantized: - \* [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) for input, filter, and output. - \* [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) for bias (with scale set to - \* input.scale \* filter.scale). <br /> Available since NNAPI feature level 3: - 16 bit floating point: - \* [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) for input, filter, output, and bias. - Quantized with symmetric per channel quantization for the filter: - \* [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) for input, and output. - \* [ANEURALNETWORKS_TENSOR_QUANT8_SYMM_PER_CHANNEL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a63c89cf7133314db885eae2abe0acc70) for filter. - \* [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) for bias (scale set to 0.0, - \* each value scaling is separate and equal to input.scale \* filter.scales\[channel\]). <br /> Available since NNAPI feature level 4: - Quantized signed (since NNAPI feature level 4): - \* [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) for input, filter, and output. - \* [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) for bias (with scale set to - \* input.scale \* filter.scale). - Quantized signed with filter symmetric per channel quantization (since NNAPI feature level 4): - \* [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) for input, and output. - \* [ANEURALNETWORKS_TENSOR_QUANT8_SYMM_PER_CHANNEL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a63c89cf7133314db885eae2abe0acc70) for filter. - \* [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) for bias (scale set to 0.0, - \* each value scaling is separate and equal to input.scale \* filter.scales\[channel\]). <br /> Supported tensor rank: 4, with "NHWC" or "NCHW" data layout. With the default data layout NHWC, the data is stored in the order of: \[batch, height, width, channels\]. Alternatively, the data layout could be NCHW, the data storage order of: \[batch, channels, height, width\]. NCHW is supported since NNAPI feature level 3. Both explicit padding and implicit padding are supported. Inputs (explicit padding): - 0: A 4-D tensor, of shape \[batches, height, width, depth_in\], specifying the input. Since NNAPI feature level 3, zero batches is supported for this tensor. - 1: A 4-D tensor, of shape \[depth_out, filter_height, filter_width, depth_in\], specifying the filter. For tensor of type [ANEURALNETWORKS_TENSOR_QUANT8_SYMM_PER_CHANNEL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a63c89cf7133314db885eae2abe0acc70) the channel dimension ([ANeuralNetworksSymmPerChannelQuantParams::channelDim](https://developer.android.com/ndk/reference/struct/a-neural-networks-symm-per-channel-quant-params#struct_a_neural_networks_symm_per_channel_quant_params_1ac5b11412a315cf78a317586e27072ad0)) must be set to 0. - 2: A 1-D tensor, of shape \[depth_out\], specifying the bias. For input tensor of type [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) or [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) the bias must be of the same type. For filter tensor of [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9), the bias should be of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896), with zeroPoint of 0 and bias_scale == input_scale \* filter_scale. For filter tensor of [ANEURALNETWORKS_TENSOR_QUANT8_SYMM_PER_CHANNEL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a63c89cf7133314db885eae2abe0acc70), the bias should be of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896), with zeroPoint of 0 and bias_scale of 0. The actual scale of each value 'i' is equal to bias_scale\[i\] = input_scale \* filter_scale\[i\]. - 3: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the padding on the left, in the 'width' dimension. - 4: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the padding on the right, in the 'width' dimension. - 5: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the padding on the top, in the 'height' dimension. - 6: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the padding on the bottom, in the 'height' dimension. - 7: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the stride when walking through input in the 'width' dimension. - 8: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the stride when walking through input in the 'height' dimension. - 9: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, and has to be one of the [FuseCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ec620045a39909a6bf00b3ee0c4d414) values. Specifies the activation to invoke on the result. - 10: An optional [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, default to false. Set to true to specify NCHW data layout for input0 and output0. Available since NNAPI feature level 3. - 11: An optional [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the dilation factor for width. Defaults to 1. If set to k \> 1, there will be k-1 skipped cells between each filter element on width dimension. If this input is set, input 12 (dilation factor for height) must be specified as well. Available since NNAPI feature level 3. - 12: An optional [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the dilation factor for height. Defaults to 1. If set to k \> 1, there will be k-1 skipped cells between each filter element on height dimension. If this input is set, input 11 (dilation factor for width) must be specified as well. Available since NNAPI feature level 3. <br /> Inputs (implicit padding): - 0: A 4-D tensor, of shape \[batches, height, width, depth_in\], specifying the input. Since NNAPI feature level 3, zero batches is supported for this tensor. - 1: A 4-D tensor, of shape \[depth_out, filter_height, filter_width, depth_in\], specifying the filter. For tensor of type [ANEURALNETWORKS_TENSOR_QUANT8_SYMM_PER_CHANNEL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a63c89cf7133314db885eae2abe0acc70) the channel dimension ([ANeuralNetworksSymmPerChannelQuantParams::channelDim](https://developer.android.com/ndk/reference/struct/a-neural-networks-symm-per-channel-quant-params#struct_a_neural_networks_symm_per_channel_quant_params_1ac5b11412a315cf78a317586e27072ad0)) must be set to 0. - 2: A 1-D tensor, of shape \[depth_out\], specifying the bias. For input tensor of type [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) or [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) the bias must be of the same type. For filter tensor of [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9), the bias should be of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896), with zeroPoint of 0 and bias_scale == input_scale \* filter_scale. For filter tensor of [ANEURALNETWORKS_TENSOR_QUANT8_SYMM_PER_CHANNEL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a63c89cf7133314db885eae2abe0acc70), the bias should be of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896), with zeroPoint of 0 and bias_scale of 0. The actual scale of each value 'i' is equal to bias_scale\[i\] = input_scale \* filter_scale\[i\]. - 3: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the implicit padding scheme, has to be one of the [PaddingCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gab72e9e6263fd5b015bb7f41ec18ce220) values. - 4: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the stride when walking through input in the 'width' dimension. - 5: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the stride when walking through input in the 'height' dimension. - 6: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, and has to be one of the [FuseCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ec620045a39909a6bf00b3ee0c4d414) values. Specifies the activation to invoke on the result. - 7: An optional [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, default to false. Set to true to specify NCHW data layout for input0 and output0. Available since NNAPI feature level 3. - 8: An optional [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the dilation factor for width. Defaults to 1. If set to k \> 1, there will be k-1 skipped cells between each filter element on width dimension. If this input is set, input 9 (dilation factor for height) must be specified as well. Available since NNAPI feature level 3. - 9: An optional [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the dilation factor for height. Defaults to 1. If set to k \> 1, there will be k-1 skipped cells between each filter element on height dimension. If this input is set, input 8 (dilation factor for width) must be specified as well. Available since NNAPI feature level 3. <br /> Outputs: - 0: The output 4-D tensor, of shape \[batches, out_height, out_width, depth_out\]. Before NNAPI feature level 3, for output tensor of [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3), the following condition must be satisfied: output_scale \> input_scale \* filter_scale <br /> Available since NNAPI feature level 1. |
| `ANEURALNETWORKS_DEPTHWISE_CONV_2D` | Performs a depthwise 2-D convolution operation. Given an input tensor of shape \[batches, height, width, depth_in\] and a filter tensor of shape \[1, filter_height, filter_width, depth_out\] containing depth_out convolutional filters of depth 1, DEPTHWISE_CONV applies a different filter to each input channel (expanding from 1 channel to channel_multiplier channels for each), then concatenates the results together. The output has depth_out = depth_in \* depth_multiplier channels. The output dimensions are functions of the filter dimensions, stride, and padding. The values in the output tensor are computed as: ``` output[b, i, j, k * channel_multiplier + q] = sum_{di, dj} ( input[b, strides[1] * i + di, strides[2] * j + dj, k] * filter[1, di, dj, k * channel_multiplier + q] ) + bias[k * channel_multiplier + q] ``` <br /> Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) configurations: - 32 bit floating point: - \* [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) for input, filter, output, and bias. - Quantized: - \* [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) for input, filter, and output. - \* [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) for bias (with scale set to - \* input.scale \* filter.scale). <br /> Available since NNAPI feature level 3: - 16 bit floating point: - \* [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) for input, filter, output, and bias. - Quantized with symmetric per channel quantization for the filter: - \* [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) for input, and output. - \* [ANEURALNETWORKS_TENSOR_QUANT8_SYMM_PER_CHANNEL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a63c89cf7133314db885eae2abe0acc70) for filter. - \* [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) for bias (scale set to 0.0, - \* each value scaling is separate and equal to input.scale \* filter.scales\[channel\]). <br /> Available since NNAPI feature level 4: - Quantized signed (since NNAPI feature level 4): - \* [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) for input, filter, and output. - \* [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) for bias (with scale set to - \* input.scale \* filter.scale). - Quantized signed with filter symmetric per channel quantization (since NNAPI feature level 4): - \* [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) for input, and output. - \* [ANEURALNETWORKS_TENSOR_QUANT8_SYMM_PER_CHANNEL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a63c89cf7133314db885eae2abe0acc70) for filter. - \* [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) for bias (scale set to 0.0, - \* each value scaling is separate and equal to input.scale \* filter.scales\[channel\]). <br /> Supported tensor rank: 4, with "NHWC" or "NCHW" data layout. With the default data layout NHWC, the data is stored in the order of: \[batch, height, width, channels\]. Alternatively, the data layout could be NCHW, the data storage order of: \[batch, channels, height, width\]. NCHW is supported since NNAPI feature level 3. Both explicit padding and implicit padding are supported. Inputs (explicit padding): - 0: A 4-D tensor, of shape \[batches, height, width, depth_in\], specifying the input. - 1: A 4-D tensor, of shape \[1, filter_height, filter_width, depth_out\], specifying the filter. For tensor of type [ANEURALNETWORKS_TENSOR_QUANT8_SYMM_PER_CHANNEL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a63c89cf7133314db885eae2abe0acc70) the channel dimension ([ANeuralNetworksSymmPerChannelQuantParams::channelDim](https://developer.android.com/ndk/reference/struct/a-neural-networks-symm-per-channel-quant-params#struct_a_neural_networks_symm_per_channel_quant_params_1ac5b11412a315cf78a317586e27072ad0)) must be set to 3. - 2: A 1-D tensor, of shape \[depth_out\], specifying the bias. For input tensor of type [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) or [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) the bias must be of the same type. For filter tensor of [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9), the bias should be of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896), with zeroPoint of 0 and bias_scale == input_scale \* filter_scale. For filter tensor of [ANEURALNETWORKS_TENSOR_QUANT8_SYMM_PER_CHANNEL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a63c89cf7133314db885eae2abe0acc70), the bias should be of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896), with zeroPoint of 0 and bias_scale of 0. The actual scale of each value 'i' is equal to bias_scale\[i\] = input_scale \* filter_scale\[i\]. - 3: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the padding on the left, in the 'width' dimension. - 4: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the padding on the right, in the 'width' dimension. - 5: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the padding on the top, in the 'height' dimension. - 6: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the padding on the bottom, in the 'height' dimension. - 7: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the stride when walking through input in the 'width' dimension. - 8: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the stride when walking through input in the 'height' dimension. - 9: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the depthwise multiplier. - 10: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, and has to be one of the [FuseCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ec620045a39909a6bf00b3ee0c4d414) values. Specifies the activation to invoke on the result. - 11: An optional [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, default to false. Set to true to specify NCHW data layout for input0 and output0. Available since NNAPI feature level 3. - 12: An optional [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the dilation factor for width. Defaults to 1. If set to k \> 1, there will be k-1 skipped cells between each filter element on width dimension. If this input is set, input 13 (dilation factor for height) must be specified as well. Available since NNAPI feature level 3. - 13: An optional [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the dilation factor for height. Defaults to 1. If set to k \> 1, there will be k-1 skipped cells between each filter element on height dimension. If this input is set, input 12 (dilation factor for width) must be specified as well. Available since NNAPI feature level 3. <br /> Inputs (implicit padding): - 0: A 4-D tensor, of shape \[batches, height, width, depth_in\], specifying the input. - 1: A 4-D tensor, of shape \[1, filter_height, filter_width, depth_out\], specifying the filter. - 2: A 1-D tensor, of shape \[depth_out\], specifying the bias. For input tensor of type [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) or [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) the bias must be of the same type. For filter tensor of [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9), the bias should be of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896), with zeroPoint of 0 and bias_scale == input_scale \* filter_scale. For filter tensor of [ANEURALNETWORKS_TENSOR_QUANT8_SYMM_PER_CHANNEL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a63c89cf7133314db885eae2abe0acc70), the bias should be of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896), with zeroPoint of 0 and bias_scale of 0. The actual scale of each value 'i' is equal to bias_scale\[i\] = input_scale \* filter_scale\[i\]. - 3: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the implicit padding scheme, has to be one of the [PaddingCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gab72e9e6263fd5b015bb7f41ec18ce220) values. - 4: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the stride when walking through input in the 'width' dimension. - 5: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the stride when walking through input in the 'height' dimension. - 6: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the depthwise multiplier. - 7: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, and has to be one of the [FuseCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ec620045a39909a6bf00b3ee0c4d414) values. Specifies the activation to invoke on the result. - 8: An optional [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, default to false. Set to true to specify NCHW data layout for input0 and output0. Available since NNAPI feature level 3. - 9: An optional [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the dilation factor for width. Defaults to 1. If set to k \> 1, there will be k-1 skipped cells between each filter element on width dimension. If this input is set, input 10 (dilation factor for height) must be specified as well. Available since NNAPI feature level 3. - 10: An optional [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the dilation factor for height. Defaults to 1. If set to k \> 1, there will be k-1 skipped cells between each filter element on height dimension. If this input is set, input 9 (dilation factor for width) must be specified as well. Available since NNAPI feature level 3. <br /> Outputs: - 0: The output 4-D tensor, of shape \[batches, out_height, out_width, depth_out\]. Before NNAPI feature level 3, for output tensor of [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3), the following condition must be satisfied: output_scale \> input_scale \* filter_scale <br /> Available since NNAPI feature level 1. |
| `ANEURALNETWORKS_DEPTH_TO_SPACE` | Rearranges data from depth into blocks of spatial data. More specifically, this op outputs a copy of the input tensor where values from the depth dimension are moved in spatial blocks to the height and width dimensions. The value block_size indicates the input block size and how the data is moved. Chunks of data of size block_size \* block_size from depth are rearranged into non-overlapping blocks of size block_size x block_size. The width of the output tensor is input_depth \* block_size, whereas the height is input_height \* block_size. The depth of the input tensor must be divisible by block_size \* block_size Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: 4, with "NHWC" or "NCHW" data layout. With the default data layout NHWC, the data is stored in the order of: \[batch, height, width, channels\]. Alternatively, the data layout could be NCHW, the data storage order of: \[batch, channels, height, width\]. NCHW is supported since NNAPI feature level 3. Inputs: - 0: A 4-D tensor, of shape \[batches, height, width, depth_in\], specifying the input. - 1: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the block_size. block_size must be \>=1 and block_size \* block_size must be a divisor of the input depth. - 2: An optional [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, default to false. Set to true to specify NCHW data layout for input0 and output0. Available since NNAPI feature level 3. <br /> Outputs: - 0: The output 4-D tensor, of shape \[batch, height\*block_size, width\*block_size, depth/(block_size\*block_size)\]. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scale and zeroPoint must be the same as input0. <br /> Available since NNAPI feature level 1. |
| `ANEURALNETWORKS_DEQUANTIZE` | Dequantizes the input tensor. The formula is: ``` output = (input - zeroPoint) * scale. ``` <br /> Supported input tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_SYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7a907ab82a0229f28bd188dd37a1ef52) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_QUANT8_SYMM_PER_CHANNEL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a63c89cf7133314db885eae2abe0acc70) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported output tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447). <br /> Supported tensor rank: up to 4 Inputs: - 0: A tensor. Since NNAPI feature level 3, this tensor may be zero-sized. <br /> Outputs: - 0: A tensor with the same shape as input0. <br /> Available since NNAPI feature level 1. |
| `ANEURALNETWORKS_DETECTION_POSTPROCESSING` | Apply postprocessing steps to bounding box detections. Bounding box detections are generated by applying transformation on a set of predefined anchors with the bounding box deltas from bounding box regression. A final step of hard NMS is applied to limit the number of returned boxes. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) <br /> Inputs: - 0: A 3-D Tensor of shape \[batches, num_anchors, num_classes\], specifying the score of each anchor with each class. Class 0 for each \[batches, num_anchors, 0\] is background and will be ignored. - 1: A 3-D Tensor of shape \[batches, num_anchors, length_box_encoding\], with the first four values in length_box_encoding specifying the bounding box deltas. The box deltas are encoded in the order of \[dy, dx, dh, dw\], where dy and dx is the linear-scale relative correction factor for the center position of the bounding box with respect to the width and height, dh and dw is the log-scale relative correction factor for the width and height. All the entries in length_box_encoding beyond the first four values are ignored in this operation. - 2: A 2-D Tensor of shape \[num_anchors, 4\], specifying the shape of each predefined anchor, with format \[ctr_y, ctr_x, h, w\], where ctr_y and ctr_x are the center position of the box, and h and w are the height and the width. - 3: An [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578) scalar, specifying the scaling factor for dy in bounding box deltas. - 4: An [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578) scalar, specifying the scaling factor for dx in bounding box deltas. - 5: An [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578) scalar, specifying the scaling factor for dh in bounding box deltas. - 6: An [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578) scalar, specifying the scaling factor for dw in bounding box deltas. - 7: An [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, set to true to use regular multi-class NMS algorithm that do NMS separately for each class, set to false for a faster algorithm that only do one single NMS using the highest class score.. - 8: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, max_num_detections, specifying the maximum number of boxes for the output. Boxes with the lowest scores are discarded to meet the limit. - 9: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, only used when input7 is set to false, specifying the maximum number of classes per detection. - 10: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, only used when input7 is set to true, specifying the maximum number of detections when applying NMS algorithm for each single class. - 11: A scalar, score_threshold. Boxes with scores lower than the threshold are filtered before sending to the NMS algorithm. The scalar must be of [ANEURALNETWORKS_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a823c78695644dea4e94aa04ff2d00cd7) if input0 is of [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) and of [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578) if input0 is of [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447). - 12: A scalar, specifying the IoU threshold for hard NMS. The scalar must be of [ANEURALNETWORKS_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a823c78695644dea4e94aa04ff2d00cd7) if input0 is of [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) and of [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578) if input0 is of [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447). - 13: An [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, set to true to include background class in the list of label map for the output, set to false to not include the background. When the background class is included, it has label 0 and the output classes start at 1 in the label map, otherwise, the output classes start at 0. <br /> Outputs: - 0: A 2-D tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) as input0, with shape \[batches, max_num_detections\], specifying the score of each output detections. - 1: A 3-D tensor of shape \[batches, max_num_detections, 4\], specifying the coordinates of each output bounding box, with format \[y1, x1, y2, x2\]. - 2: A 2-D [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) tensor, of shape \[batches, max_num_detections\], specifying the class label for each output detection. - 3: An 1-D [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) tensor, of shape \[batches\], specifying the number of valid output detections for each batch. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_DIV` | Element-wise division of two tensors. Takes two input tensors of identical [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) and compatible dimensions. The output is the result of dividing the first input tensor by the second, optionally modified by an activation function. For inputs of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896), performs "floor division" ("//" in Python). For example, 5 // 2 = 2 -5 // 2 = -3 Two dimensions are compatible when: 1. they are equal, or 2. one of them is 1 <br /> The size of the output is the maximum size along each dimension of the input operands. It starts with the trailing dimensions, and works its way forward. Example: input1.dimension = {4, 1, 2} input2.dimension = {5, 4, 3, 1} output.dimension = {5, 4, 3, 2} Since NNAPI feature level 3, generic zero-sized input tensor is supported. Zero dimension is only compatible with 0 or 1. The size of the output dimension is zero if either of corresponding input dimension is zero. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) (since NNAPI feature level 4) <br /> Supported tensor rank: up to 4 Inputs: - 0: An n-D tensor, specifying the first input. - 1: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298), and compatible dimensions as input0. - 2: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, and has to be one of the [FuseCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ec620045a39909a6bf00b3ee0c4d414) values. Specifies the activation to invoke on the result. For a [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) tensor, the [FuseCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ec620045a39909a6bf00b3ee0c4d414) must be "NONE". <br /> Outputs: - 0: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) as input0. <br /> Available since NNAPI feature level 2. |
| `ANEURALNETWORKS_ELU` | Computes exponential linear activation on the input tensor element-wise. The output is calculated using the following formula: ``` ELU(x) = max(0, x) + min(0, alpha * (exp(x) - 1)) ``` <br /> Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) <br /> Supported tensor rank: from 1. Inputs: - 0: A tensor, specifying the input. May be zero-sized. - 1: A scalar, specifying the alpha parameter. For input tensor of [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c), the alpha value must be of [ANEURALNETWORKS_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a823c78695644dea4e94aa04ff2d00cd7). For input tensor of [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447), the alpha value must be of [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578). <br /> Outputs: - 0: The output tensor of same shape and type as input0. <br /> Available since NNAPI feature level 4. |
| `ANEURALNETWORKS_EMBEDDING_LOOKUP` | Looks up sub-tensors in the input tensor. This operator takes for input a tensor of values (Values) and a one-dimensional tensor of selection indices (Lookups). The output tensor is the concatenation of sub-tensors of Values as selected by Lookups. Think of Values as being sliced along its first dimension: The entries in Lookups select which slices are concatenated together to create the output tensor. For example, if Values has shape of \[40, 200, 300\] and Lookups has shape of \[3\], all three values found in Lookups are expected to be between 0 and 39. The resulting tensor must have shape of \[3, 200, 300\]. If a value in Lookups is out of bounds, the operation must fail and an error must be reported. Supported value tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) (since NNAPI feature level 4) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported value tensor rank: from 2 Inputs: - 0: Lookups. A 1-D tensor of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896). The values are indices into the first dimension of Values. - 1: Values. An n-D tensor, where n \>= 2, from which sub-tensors are extracted. <br /> Output: - 0: A n-D tensor with the same rank and shape as the Values tensor, except for the first dimension which has the same size as Lookups' only dimension. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scale and zeroPoint must be the same as input1. <br /> Available since NNAPI feature level 1. |
| `ANEURALNETWORKS_EQUAL` | For input tensors x and y, computes x == y elementwise. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_BOOL8](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ab275c740307fbffcfec94adcc7b374b9) - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: from 1 This operation supports broadcasting. Inputs: - 0: A tensor. - 1: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) and dimensions compatible with input0. <br /> Outputs: - 0: A tensor of [ANEURALNETWORKS_TENSOR_BOOL8](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ab275c740307fbffcfec94adcc7b374b9). <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_EXP` | Computes exponential of x element-wise. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) <br /> Supported tensor rank: from 1. Inputs: - 0: A tensor. <br /> Outputs: - 0: The output tensor of same shape as input0. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_EXPAND_DIMS` | Inserts a dimension of 1 into a tensor's shape. Given a tensor input, this operation inserts a dimension of 1 at the given dimension index of input's shape. The dimension index starts at zero; if you specify a negative dimension index, it is counted backward from the end. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: from 1 Inputs: - 0: An n-D tensor. - 1: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar specifying the dimension index to expand. Must be in the range \[-(n + 1), (n + 1)). <br /> Outputs: - 0: An (n + 1)-D tensor with the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) and data as input0. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scale and zeroPoint must be the same as input0. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_FILL` | Creates a tensor filled with a scalar value. Supported output tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) <br /> Supported tensor rank: from 1. Inputs: - 0: A 1-D tensor, specifying the desired output tensor shape. - 1: A scalar, specifying the value to fill the output tensors with. For output tensor of [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c), the scalar must be of [ANEURALNETWORKS_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a823c78695644dea4e94aa04ff2d00cd7). For output tensor of [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447), the scalar must be of [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578). For output tensor of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896), the scalar must be of [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc). <br /> Outputs: - 0: The output tensor. <br /> Available since NNAPI feature level 4. |
| `ANEURALNETWORKS_FLOOR` | Computes element-wise floor() on the input tensor. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) <br /> Supported tensor rank: up to 4 Inputs: - 0: A tensor. <br /> Outputs: - 0: The output tensor, of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) and dimensions as the input tensor. <br /> Available since NNAPI feature level 1. |
| `ANEURALNETWORKS_FULLY_CONNECTED` | Denotes a fully (densely) connected layer, which connects all elements in the input tensor with each element in the output tensor. This layer implements the operation: ``` outputs = activation(inputs * weights’ + bias) ``` <br /> Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: up to 4. Inputs: - 0: A tensor of at least rank 2, specifying the input. If rank is greater than 2, then it gets flattened to a 2-D Tensor. The (flattened) 2-D Tensor is reshaped (if necessary) to \[batch_size, input_size\], where "input_size" corresponds to the number of inputs to the layer, matching the second dimension of weights, and "batch_size" is calculated by dividing the number of elements by "input_size". Since NNAPI feature level 3, zero batch_size is supported for this tensor. - 1: A 2-D tensor, specifying the weights, of shape \[num_units, input_size\], where "num_units" corresponds to the number of output nodes. - 2: A 1-D tensor, of shape \[num_units\], specifying the bias. For input tensor of [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447), the bias should also be of [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447). For input tensor of [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9), the bias should be of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896), with zeroPoint of 0 and bias_scale == input_scale \* filter_scale. - 3: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, and has to be one of the [FuseCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ec620045a39909a6bf00b3ee0c4d414) values. Specifies the activation to invoke on the result. <br /> Outputs: - 0: The output tensor, of shape \[batch_size, num_units\]. Before NNAPI feature level 3, for output tensor of [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3), the following condition must be satisfied: output_scale \> input_scale \* filter_scale. <br /> Available since NNAPI feature level 1. |
| `ANEURALNETWORKS_GATHER` | Gathers values along an axis. Produces an output tensor with shape input0.dimension\[:axis\] + indices.dimension + input0.dimension\[axis + 1:\] where: # Vector indices (output is rank(input0)). <br /> output\[a_0, ..., a_n, i, b_0, ..., b_n\] = input0\[a_0, ..., a_n, indices\[i\], b_0, ..., b_n\] # Higher rank indices (output is rank(input0) + rank(indices) - 1). <br /> output\[a_0, ..., a_n, i, ..., j, b_0, ... b_n\] = input0\[a_0, ..., a_n, indices\[i, ..., j\], b_0, ..., b_n\] Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: from 1 Inputs: - 0: An n-D tensor from which to gather values. - 1: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar specifying the axis. Negative index is used to specify axis from the end (e.g. -1 for the last axis). Must be in the range \[-n, n). - 2: A k-D tensor [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) of indices. The values must be in the bounds of the corresponding dimensions of input0. <br /> Outputs: - 0: An (n + k - 1)-D tensor with the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) as input0. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scale and zeroPoint must be the same as input0. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_GENERATE_PROPOSALS` | Generate aixs-aligned bounding box proposals. Bounding box proposals are generated by applying transformation on a set of predefined anchors with the bounding box deltas from bounding box regression. A final step of hard NMS is applied to limit the number of returned boxes. Axis-aligned bounding boxes are represented by its upper-left corner coordinate (x1,y1) and lower-right corner coordinate (x2,y2). A valid bounding box should satisfy x1 \<= x2 and y1 \<= y2. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Inputs: - 0: A 4-D Tensor specifying the score of each anchor at each location. With "NHWC" data layout, the tensor shape is \[batches, height, width, num_anchors\]. With "NCHW" data layout, the tensor shape is \[batches, num_anchors, height, width\]. - 1: A 4-D Tensor specifying the bounding box deltas. With "NHWC" data layout, the tensor shape is \[batches, height, width, num_anchors \* 4\]. With "NCHW" data layout, the tensor shape is \[batches, num_anchors \* 4, height, width\]. The box deltas are encoded in the order of \[dx, dy, dw, dh\], where dx and dy is the linear-scale relative correction factor for the center position of the bounding box with respect to the width and height, dw and dh is the log-scale relative correction factor for the width and height. The last dimensions is the channel dimension. - 2: A 2-D Tensor of shape \[num_anchors, 4\], specifying the shape of each predefined anchor, with format \[x1, y1, x2, y2\]. For input0 of type [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) or [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9), this tensor should be of [ANEURALNETWORKS_TENSOR_QUANT16_SYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a750fa6aa30c71eb8d093ee1c44d25a12), with scale of 0.125. - 3: A 2-D Tensor of shape \[batches, 2\], specifying the size of each image in the batch, with format \[image_height, image_width\]. For input0 of type [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) or [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9), this tensor should be of [ANEURALNETWORKS_TENSOR_QUANT16_SYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a750fa6aa30c71eb8d093ee1c44d25a12), with scale of 0.125. - 4: An [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578) scalar, specifying the ratio from the height of original image to the height of feature map. - 5: An [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578) scalar, specifying the ratio from the width of original image to the width of feature map. - 6: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the maximum number of boxes before going into the hard NMS algorithm. Boxes with the lowest scores are discarded to meet the limit. Set to a non-positive value for unlimited number. - 7: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the maximum number of boxes returning from the hard NMS algorithm. Boxes with the lowest scores are discarded to meet the limit. Set to a non-positive value for unlimited number. - 8: An [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578) scalar, specifying the IoU threshold for hard NMS. - 9: An [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578) scalar, min_size. Boxes with height or width lower than the absolute threshold are filtered out. - 10: An [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, set to true to specify NCHW data layout for input0 and input1. Set to false for NHWC. <br /> Outputs: - 0: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) as input0, of shape \[num_output_rois\], specifying the score of each output box. The boxes are grouped by batches, but the sequential order in each batch is not guaranteed. For type of [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) or [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9), the scale and zero point must be the same as input0. - 1: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) as input3, of shape \[num_output_rois, 4\], specifying the coordinates of each output bounding box for each class, with format \[x1, y1, x2, y2\]. The sequential order of the boxes corresponds with output0. For type of [ANEURALNETWORKS_TENSOR_QUANT16_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aac04cfb70bef0e2f4081b6b69a80ddf7), the scale must be 0.125 and the zero point must be 0. - 2: A 1-D [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) tensor, of shape \[num_output_rois\], specifying the batch index of each box. Boxes with the same batch index are grouped together. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_GREATER` | For input tensors x and y, computes x \> y elementwise. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_BOOL8](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ab275c740307fbffcfec94adcc7b374b9) - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: from 1 This operation supports broadcasting. Inputs: - 0: A tensor. - 1: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) and dimensions compatible with input0. <br /> Outputs: - 0: A tensor of [ANEURALNETWORKS_TENSOR_BOOL8](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ab275c740307fbffcfec94adcc7b374b9). <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_GREATER_EQUAL` | For input tensors x and y, computes x \>= y elementwise. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_BOOL8](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ab275c740307fbffcfec94adcc7b374b9) - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: from 1 This operation supports broadcasting. Inputs: - 0: A tensor. - 1: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) and dimensions compatible with input0. <br /> Outputs: - 0: A tensor of [ANEURALNETWORKS_TENSOR_BOOL8](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ab275c740307fbffcfec94adcc7b374b9). <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_GROUPED_CONV_2D` | Performs a grouped 2-D convolution operation. Given an input tensor of shape \[batches, height, width, depth_in\] and a filter tensor of shape \[depth_out, filter_height, filter_width, depth_group\] containing depth_out convolutional filters of depth depth_group, GROUPED_CONV applies a group of different filters to each input channel group, then concatenates the results together. Specifically, the input channels are divided into num_groups groups, each with depth depth_group, i.e. depth_in = num_groups \* depth_group. The convolutional filters are also divided into num_groups groups, i.e. depth_out is divisible by num_groups. GROUPED_CONV applies each group of filters to the corresponding input channel group, and the result are concatenated together. The output dimensions are functions of the filter dimensions, stride, and padding. The values in the output tensor are computed as: ``` output[b, i, j, g * channel_multiplier + q] = sum_{di, dj, dk} ( input[b, strides[1] * i + di, strides[2] * j + dj, g * depth_group + dk] * filter[g * channel_multiplier + q, di, dj, dk] ) + bias[channel] ``` <br /> where channel_multiplier = depth_out / num_groups Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) configurations: - 16 bit floating point: - \* [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) for input, filter, output, and bias. - 32 bit floating point: - \* [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) for input, filter, output, and bias. - Quantized: - \* [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) for input, filter, and output. - \* [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) for bias (with scale set to - \* input.scale \* filter.scale). - Quantized signed (since NNAPI feature level 4): - \* [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) for input, filter, and output. - \* [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) for bias (with scale set to - \* input.scale \* filter.scale). - Quantized with symmetric per channel quantization for the filter: - \* [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) for input, and output. - \* [ANEURALNETWORKS_TENSOR_QUANT8_SYMM_PER_CHANNEL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a63c89cf7133314db885eae2abe0acc70) for filter. - \* [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) for bias (scale set to 0.0, - \* each value scaling is separate and equal to input.scale \* filter.scales\[channel\]). - Quantized signed with filter symmetric per channel quantization (since NNAPI feature level 4): - \* [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) for input, and output. - \* [ANEURALNETWORKS_TENSOR_QUANT8_SYMM_PER_CHANNEL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a63c89cf7133314db885eae2abe0acc70) for filter. - \* [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) for bias (scale set to 0.0, - \* each value scaling is separate and equal to input.scale \* filter.scales\[channel\]). <br /> Supported tensor rank: 4, with "NHWC" or "NCHW" data layout. With the default data layout NHWC, the data is stored in the order of: \[batch, height, width, channels\]. Alternatively, the data layout could be NCHW, the data storage order of: \[batch, channels, height, width\]. Both explicit padding and implicit padding are supported. Inputs (explicit padding): - 0: A 4-D tensor, of shape \[batches, height, width, depth_in\], specifying the input, where depth_in = num_groups \* depth_group. - 1: A 4-D tensor, of shape \[depth_out, filter_height, filter_width, depth_group\], specifying the filter, where depth_out must be divisible by num_groups. For tensor of type [ANEURALNETWORKS_TENSOR_QUANT8_SYMM_PER_CHANNEL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a63c89cf7133314db885eae2abe0acc70) the channel dimension (channelDim at [ANeuralNetworksSymmPerChannelQuantParams](https://developer.android.com/ndk/reference/struct/a-neural-networks-symm-per-channel-quant-params#struct_a_neural_networks_symm_per_channel_quant_params)) must be set to 0. - 2: A 1-D tensor, of shape \[depth_out\], specifying the bias. For input tensor of type [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) or [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c), the bias must be of the same type. For filter tensor of [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) the bias should be of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896), with zeroPoint of 0 and bias_scale == input_scale \* filter_scale. For filter tensor of [ANEURALNETWORKS_TENSOR_QUANT8_SYMM_PER_CHANNEL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a63c89cf7133314db885eae2abe0acc70), the bias should be of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896), with zeroPoint of 0 and bias_scale of 0. The actual scale of each value 'i' is equal to bias_scale\[i\] = input_scale \* filter_scale\[i\]. - 3: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the padding on the left, in the 'width' dimension. - 4: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the padding on the right, in the 'width' dimension. - 5: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the padding on the top, in the 'height' dimension. - 6: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the padding on the bottom, in the 'height' dimension. - 7: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the stride when walking through input in the 'width' dimension. - 8: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the stride when walking through input in the 'height' dimension. - 9: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the number of groups. - 10: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, and has to be one of the [FuseCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ec620045a39909a6bf00b3ee0c4d414) values. Specifies the activation to invoke on the result. - 11: An [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, set to true to specify NCHW data layout for input0 and output0. Set to false for NHWC. <br /> Inputs (implicit padding): - 0: A 4-D tensor, of shape \[batches, height, width, depth_in\], specifying the input, where depth_in = num_groups \* depth_group. - 1: A 4-D tensor, of shape \[depth_out, filter_height, filter_width, depth_group\], specifying the filter, where depth_out must be divisible by num_groups. For tensor of type [ANEURALNETWORKS_TENSOR_QUANT8_SYMM_PER_CHANNEL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a63c89cf7133314db885eae2abe0acc70) the channel dimension ([ANeuralNetworksSymmPerChannelQuantParams::channelDim](https://developer.android.com/ndk/reference/struct/a-neural-networks-symm-per-channel-quant-params#struct_a_neural_networks_symm_per_channel_quant_params_1ac5b11412a315cf78a317586e27072ad0)) must be set to 0. - 2: A 1-D tensor, of shape \[depth_out\], specifying the bias. For input tensor of type [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) or [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c), the bias must be of the same [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c), the bias must be of the same type. For filter tensor of [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) the bias should be of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896), with zeroPoint of 0 and bias_scale == input_scale \* filter_scale. For filter tensor of [ANEURALNETWORKS_TENSOR_QUANT8_SYMM_PER_CHANNEL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a63c89cf7133314db885eae2abe0acc70), the bias should be of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896), with zeroPoint of 0 and bias_scale of 0. The actual scale of each value 'i' is equal to bias_scale\[i\] = input_scale \* filter_scale\[i\]. - 3: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the implicit padding scheme, has to be one of the [PaddingCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gab72e9e6263fd5b015bb7f41ec18ce220) values. - 4: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the stride when walking through input in the 'width' dimension. - 5: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the stride when walking through input in the 'height' dimension. - 6: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the number of groups. - 7: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, and has to be one of the [FuseCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ec620045a39909a6bf00b3ee0c4d414) values. Specifies the activation to invoke on the result. - 8: An [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, set to true to specify NCHW data layout for input0 and output0. Set to false for NHWC. <br /> Outputs: - 0: The output 4-D tensor, of shape \[batches, out_height, out_width, depth_out\]. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scale and zeroPoint can be different from inputs' scale and zeroPoint. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_HARD_SWISH` | Computes hard-swish activation on the input tensor element-wise. Hard swish activation is introduced in <https://arxiv.org/pdf/1905.02244.pdf> The output is calculated using the following formula: ``` h-swish(x) = x * max(0, min(6, (x + 3))) / 6 ``` <br /> Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) <br /> Supported tensor rank: from 1. Inputs: - 0: A tensor, specifying the input. May be zero-sized. <br /> Outputs: - 0: The output tensor of same shape and type as input0. Scale and zero point of this tensor may be different from the input tensor's parameters. <br /> Available since NNAPI feature level 4. |
| `ANEURALNETWORKS_HASHTABLE_LOOKUP` | Looks up sub-tensors in the input tensor using a key-value map. This operator takes for input a tensor of values (Values), a one-dimensional tensor of selection values (Lookups) and a one-dimensional tensor that maps these values to Values indexes. The output tensor is the concatenation of sub-tensors of Values as selected by Lookups via Keys. Think of Values as being sliced along its outer-most dimension. The output is a concatenation of selected slices, with one slice for each entry of Lookups. The slice selected is the one at the same index as the Maps entry that matches the value in Lookups. For a hit, the corresponding sub-tensor of Values is included in the Output tensor. For a miss, the corresponding sub-tensor in Output must have zero values. For example, if Values has shape of \[40, 200, 300\], Keys should have a shape of \[40\]. If Lookups tensor has shape of \[3\], three slices are being concatenated, so the resulting tensor must have the shape of \[3, 200, 300\]. If the first entry in Lookups has the value 123456, that value must be located in Keys tensor. If the sixth entry of Keys contains 123456, the sixth slice of Values must be selected. If no entry in Keys has 123456, a slice of zeroes must be concatenated. Supported value tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) <br /> Supported value tensor rank: from 2 Inputs: - 0: Lookups. A 1-D [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) tensor with shape \[ k \]. - 1: Keys. A 1-D [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) tensor with shape \[ n \]; Keys and Values pair represent a map, i.e., the ith element in Keys (Keys\[i\]) is the key to select the ith sub-tensor in Values (Values\[i\]), where 0 \<= i \<= n-1. Keys tensor *MUST* be sorted in ascending order. - 2: Values. A tensor with shape of \[ n, ... \]; i.e., the first dimension must be n. <br /> Outputs: - 0: Output. A tensor with shape \[ k ...\]. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) tensor, the scale and zeroPoint must be the same as input2. - 1: Hits. A boolean tensor with shape \[ k \] indicates whether the lookup hits (True) or not (False). Stored as [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) with offset 0 and scale 1.0f. A non-zero byte represents True, a hit. A zero indicates otherwise. <br /> Available since NNAPI feature level 1. |
| `ANEURALNETWORKS_HEATMAP_MAX_KEYPOINT` | Localize the maximum keypoints from heatmaps. This operation approximates the accurate maximum keypoint scores and indices after bicubic upscaling by using Taylor expansion up to the quadratic term. The bounding box is represented by its upper-left corner coordinate (x1,y1) and lower-right corner coordinate (x2,y2) in the original image. A valid bounding box should satisfy x1 \<= x2 and y1 \<= y2. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: 4, with "NHWC" or "NCHW" data layout. With the default data layout NHWC, the data is stored in the order of: \[batch, height, width, channels\]. Alternatively, the data layout could be NCHW, the data storage order of: \[batch, channels, height, width\]. Inputs: - 0: A 4-D Tensor of shape \[num_boxes, heatmap_size, heatmap_size, num_keypoints\], specifying the heatmaps, the height and width of heatmaps should be the same, and must be greater than or equal to 2. - 1: A 2-D Tensor of shape \[num_boxes, 4\], specifying the bounding boxes, each with format \[x1, y1, x2, y2\]. For input0 of type [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3), this tensor should be of [ANEURALNETWORKS_TENSOR_QUANT16_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aac04cfb70bef0e2f4081b6b69a80ddf7), with zeroPoint of 0 and scale of 0.125. For input0 of type [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9), this tensor should be of [ANEURALNETWORKS_TENSOR_QUANT16_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aac04cfb70bef0e2f4081b6b69a80ddf7), with zeroPoint of -128 and scale of 0.125. - 2: An [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, set to true to specify NCHW data layout for input0. Set to false for NHWC. <br /> Outputs: - 0: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) as input0, with shape \[num_boxes, num_keypoints\], specifying score of the keypoints. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) or [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scale and zeroPoint can be different from input0 scale and zeroPoint. - 1: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) as input1, with shape \[num_boxes, num_keypoints, 2\], specifying the location of the keypoints, the second dimension is organized as \[keypoint_x, keypoint_y\]. For type of [ANEURALNETWORKS_TENSOR_QUANT16_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aac04cfb70bef0e2f4081b6b69a80ddf7), the scale must be 0.125 and the zero point must be 0. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_IF` | Executes one of the two referenced models as determined by a boolean value. The inputs and outputs of the two referenced models must agree with the signature of this operation. That is, if the operation has (3 + n) inputs and m outputs, both models must have n inputs and m outputs with the same types, ranks (if specified), dimensions (if specified), scales, zeroPoints, and other operand parameters as the corresponding operation inputs and outputs. Inputs: - 0: A value of type [ANEURALNETWORKS_TENSOR_BOOL8](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ab275c740307fbffcfec94adcc7b374b9) and shape \[1\] that determines which of the two referenced models to execute. The operand must have fully specified dimensions. - 1: A [ANEURALNETWORKS_MODEL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a66055118088cbd1d1d17dcbcd2c47ed5) reference to the model to be executed if the condition is true. - 2: A [ANEURALNETWORKS_MODEL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a66055118088cbd1d1d17dcbcd2c47ed5) reference to the model to be executed if the condition is false. - 3 \~ (n + 2): Inputs to be passed to the model selected for execution. <br /> Outputs: - 0 \~ (m - 1): Outputs produced by the selected model. <br /> Available since NNAPI feature level 4. |
| `ANEURALNETWORKS_INSTANCE_NORMALIZATION` | Applies instance normalization to the input tensor. The values in the output tensor are computed as: ``` output[b, h, w, c] = (input[b, h, w, c] - mean[b, c]) * gamma / sqrt(var[b, c] + epsilon) + beta ``` <br /> Where the mean and variance are computed across the spatial dimensions: ``` mean[b, c] = sum_{h, w}(input[b, h, w, c]) / sum(1) var[b, c] = sum_{h, w}(pow(input[b, h, w, c] - mean[b, c], 2)) / sum(1) ``` <br /> Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) <br /> Supported tensor rank: 4, with "NHWC" or "NCHW" data layout. With the default data layout NHWC, the data is stored in the order of: \[batch, height, width, channels\]. Alternatively, the data layout could be NCHW, the data storage order of: \[batch, channels, height, width\]. Inputs: - 0: An n-D tensor, specifying the tensor to be normalized. - 1: A scalar, specifying gamma, the scale applied to the normalized tensor. The scalar must be of [ANEURALNETWORKS_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a823c78695644dea4e94aa04ff2d00cd7) if input0 is of [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) and of [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578) if input0 is of [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447). - 2: A scalar, specifying beta, the offset applied to the normalized tensor. The scalar must be of [ANEURALNETWORKS_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a823c78695644dea4e94aa04ff2d00cd7) if input0 is of [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) and of [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578) if input0 is of [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447). - 3: A scalar, specifying epsilon, the small value added to variance to avoid dividing by zero. The scalar must be of [ANEURALNETWORKS_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a823c78695644dea4e94aa04ff2d00cd7) if input0 is of [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) and of [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578) if input0 is of [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447). - 4: An [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, set to true to specify NCHW data layout for input0 and output0. Set to false for NHWC. <br /> Outputs: - 0: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) and same shape as input0. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_L2_NORMALIZATION` | Applies L2 normalization along the axis dimension. The values in the output tensor are computed as: ``` output[batch, row, col, channel] = input[batch, row, col, channel] / sqrt(sum_{c} pow(input[batch, row, col, c], 2)) ``` <br /> By default the axis dimension is the last dimension of the input tensor. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: up to 4 Tensors with rank less than 4 are only supported since NNAPI feature level 3. Inputs: - 0: An n-D tensor, specifying the tensor to be normalized. - 1: An optional [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, default to -1, specifying the dimension normalization would be performed on. Negative index is used to specify axis from the end (e.g. -1 for the last axis). Must be in the range \[-n, n). Available since NNAPI feature level 3. <br /> Outputs: - 0: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) and same shape as input0. For [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3), the scale must be 1.f / 128 and the zeroPoint must be 128. For [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9), the scale must be 1.f / 128 and the zeroPoint must be 0.NOTE: Before NNAPI feature level 4, if the elements along an axis are all zeros, the result is undefined. Since NNAPI feature level 4, if the elements along an axis are all zeros, the result is logical zero. <br /> Available since NNAPI feature level 1. |
| `ANEURALNETWORKS_L2_POOL_2D` | Performs an 2-D L2 pooling operation. The output dimensions are functions of the filter dimensions, stride, and padding. The values in the output tensor are computed as: ``` output[b, i, j, c] = sqrt(sum_{di, dj} pow(input[b, strides[1] * i + di, strides[2] * j + dj, c], 2) / sum(1)) ``` <br /> Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) <br /> Supported tensor rank: 4, with "NHWC" or "NCHW" data layout. With the default data layout NHWC, the data is stored in the order of: \[batch, height, width, channels\]. Alternatively, the data layout could be NCHW, the data storage order of: \[batch, channels, height, width\]. NCHW is supported since NNAPI feature level 3. Both explicit padding and implicit padding are supported. Inputs (explicit padding): - 0: A 4-D tensor, of shape \[batches, height, width, depth\], specifying the input. Since NNAPI feature level 3, zero batches is supported for this tensor. - 1: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the padding on the left, in the 'width' dimension. - 2: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the padding on the right, in the 'width' dimension. - 3: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the padding on the top, in the 'height' dimension. - 4: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the padding on the bottom, in the 'height' dimension. - 5: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the stride when walking through input in the 'width' dimension. - 6: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the stride when walking through input in the 'height' dimension. - 7: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the filter width. - 8: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the filter height. - 9: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, and has to be one of the [FuseCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ec620045a39909a6bf00b3ee0c4d414) values. Specifies the activation to invoke on the result. - 10: An optional [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, default to false. Set to true to specify NCHW data layout for input0 and output0. Available since NNAPI feature level 3. <br /> Inputs (implicit padding): - 0: A 4-D tensor, of shape \[batches, height, width, depth\], specifying the input. Since NNAPI feature level 3, zero batches is supported for this tensor. - 1: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the implicit padding scheme, has to be one of the [PaddingCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gab72e9e6263fd5b015bb7f41ec18ce220) values. - 2: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the stride when walking through input in the 'width' dimension. - 3: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the stride when walking through input in the 'height' dimension. - 4: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the filter width. - 5: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the filter height. - 6: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, and has to be one of the [FuseCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ec620045a39909a6bf00b3ee0c4d414) values. Specifies the activation to invoke on the result. - 7: An optional [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, default to false. Set to true to specify NCHW data layout for input0 and output0. Available since NNAPI feature level 3. <br /> Outputs: - 0: The output 4-D tensor, of shape \[batches, out_height, out_width, depth\]. <br /> Available since NNAPI feature level 1. |
| `ANEURALNETWORKS_LESS` | For input tensors x and y, computes x \< y elementwise. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_BOOL8](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ab275c740307fbffcfec94adcc7b374b9) - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: from 1 This operation supports broadcasting. Inputs: - 0: A tensor. - 1: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) and dimensions compatible with input0. <br /> Outputs: - 0: A tensor of [ANEURALNETWORKS_TENSOR_BOOL8](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ab275c740307fbffcfec94adcc7b374b9). <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_LESS_EQUAL` | For input tensors x and y, computes x \<= y elementwise. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_BOOL8](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ab275c740307fbffcfec94adcc7b374b9) - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: from 1 This operation supports broadcasting. Inputs: - 0: A tensor. - 1: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) and dimensions compatible with input0. <br /> Outputs: - 0: A tensor of [ANEURALNETWORKS_TENSOR_BOOL8](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ab275c740307fbffcfec94adcc7b374b9). <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_LOCAL_RESPONSE_NORMALIZATION` | Applies Local Response Normalization along the depth dimension. The 4-D input tensor is treated as a 3-D array of 1-D vectors (along the last dimension), and each vector is normalized independently. Within a given vector, each component is divided by the weighted, squared sum of inputs within depth_radius. The output is calculated using this formula: ``` sqr_sum[a, b, c, d] = sum( pow(input[a, b, c, d - depth_radius : d + depth_radius + 1], 2)) output = input / pow((bias + alpha * sqr_sum), beta) ``` <br /> For input tensor with rank less than 4, independently normalizes each 1-D slice along specified dimension. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) <br /> Supported tensor rank: up to 4 Tensors with rank less than 4 are only supported since NNAPI feature level 3. Inputs: - 0: A 4-D tensor, of shape \[batches, height, width, depth\], specifying the input. - 1: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the radius of the normalization window. - 2: A scalar, specifying the bias, must not be zero. For input tensor of [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c), the bias value must be of [ANEURALNETWORKS_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a823c78695644dea4e94aa04ff2d00cd7). For input tensor of [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447), the bias value must be of [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578). - 3: A scalar, specifying the scale factor, alpha. For input tensor of [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c), the alpha value must be of [ANEURALNETWORKS_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a823c78695644dea4e94aa04ff2d00cd7). For input tensor of [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447), the alpha value must be of [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578). - 4: A scalar, specifying the exponent, beta. For input tensor of [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c), the beta value must be of [ANEURALNETWORKS_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a823c78695644dea4e94aa04ff2d00cd7). For input tensor of [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447), the beta value must be of [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578). - 5: An optional [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, default to -1, specifying the dimension normalization would be performed on. Negative index is used to specify axis from the end (e.g. -1 for the last axis). Must be in the range \[-n, n). Available since NNAPI feature level 3. <br /> Outputs: - 0: The output tensor of same shape as input0. <br /> Available since NNAPI feature level 1. |
| `ANEURALNETWORKS_LOG` | Computes natural logarithm of x element-wise. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) <br /> Supported tensor rank: from 1. Inputs: - 0: A tensor. <br /> Outputs: - 0: The output tensor of same shape as input0. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_LOGICAL_AND` | Returns the truth value of x AND y element-wise. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_BOOL8](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ab275c740307fbffcfec94adcc7b374b9) <br /> Supported tensor rank: from 1 This operation supports broadcasting. Inputs: - 0: A tensor of [ANEURALNETWORKS_TENSOR_BOOL8](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ab275c740307fbffcfec94adcc7b374b9). - 1: A tensor of [ANEURALNETWORKS_TENSOR_BOOL8](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ab275c740307fbffcfec94adcc7b374b9) and dimensions compatible with input0. <br /> Outputs: - 0: A tensor of [ANEURALNETWORKS_TENSOR_BOOL8](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ab275c740307fbffcfec94adcc7b374b9). <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_LOGICAL_NOT` | Computes the truth value of NOT x element-wise. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_BOOL8](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ab275c740307fbffcfec94adcc7b374b9) <br /> Supported tensor rank: from 1. Inputs: - 0: A tensor. <br /> Outputs: - 0: The output tensor of same shape as input0. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_LOGICAL_OR` | Returns the truth value of x OR y element-wise. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_BOOL8](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ab275c740307fbffcfec94adcc7b374b9) <br /> Supported tensor rank: from 1 This operation supports broadcasting. Inputs: - 0: A tensor of [ANEURALNETWORKS_TENSOR_BOOL8](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ab275c740307fbffcfec94adcc7b374b9). - 1: A tensor of [ANEURALNETWORKS_TENSOR_BOOL8](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ab275c740307fbffcfec94adcc7b374b9) and dimensions compatible with input0. <br /> Outputs: - 0: A tensor of [ANEURALNETWORKS_TENSOR_BOOL8](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ab275c740307fbffcfec94adcc7b374b9). <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_LOGISTIC` | Computes sigmoid activation on the input tensor element-wise. The output is calculated using this formula: ``` output = 1 / (1 + exp(-input)) ``` <br /> Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: up to 4. Inputs: - 0: A tensor, specifying the input. Since NNAPI feature level 3, this tensor may be zero-sized. <br /> Outputs: - 0: The output tensor of same shape as input0. For [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3), the scale must be 1.f / 256 and the zeroPoint must be 0. For [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9), the scale must be 1.f / 256 and the zeroPoint must be -128. <br /> Available since NNAPI feature level 1. |
| `ANEURALNETWORKS_LOG_SOFTMAX` | Computes the log softmax activations given logits. The output is calculated using this formula: ``` output = logits * beta - log(reduce_sum(exp(logits * beta), axis)) ``` <br /> Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) <br /> Supported tensor rank: from 1. Inputs: - 0: A tensor specifying the input logits. - 1: A scalar, specifying the positive scaling factor for the exponent, beta. For input tensor of [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c), the beta value must be of [ANEURALNETWORKS_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a823c78695644dea4e94aa04ff2d00cd7). For input tensor of [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447), the beta value must be of [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578). - 2: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar specifying the axis to reduce across. Negative index is used to specify axis from the end (e.g. -1 for the last axis). Must be in the range \[-n, n). <br /> Outputs: - 0: The output tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) and shape as input0. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_LSH_PROJECTION` | Projects an input to a bit vector via locality senstive hashing. Supported input tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) <br /> Supported input tensor rank: from 1 Inputs: - 0: Hash functions. Dim.size == 2, DataType: Float. Tensor\[0\].Dim\[0\]: Number of hash functions. Tensor\[0\].Dim\[1\]: Number of projected output bits generated by each hash function. If the projection type is Sparse: Tensor\[0\].Dim\[1\] + ceil(log2(Tensor\[0\].Dim\[0\])) \<= 32 - 1: Input. Dim.size \>= 1, no restriction on DataType. - 2: Weight. Optional. Dim.size == 1, DataType: Float. If not set, each input element is considered to have the same weight of 1.0. Tensor\[1\].Dim\[0\] == Tensor\[2\].Dim\[0\] - 3: Type: Sparse: Value LSHProjectionType_SPARSE(=3) (since NNAPI feature level 3). Computed bit vector is considered to be sparse. Each output element is an int32 made up of multiple bits computed from hash functions.NOTE: To avoid collisions across hash functions, an offset value of k \* (1 \<\< Tensor\[0\].Dim\[1\]) will be added to each signature, where k is the index of the hash function.Value LSHProjectionType_SPARSE_DEPRECATED(=1). Legacy behavior that does not include the offset value.Dense: Value LSHProjectionType_DENSE(=2). Computed bit vector is considered to be dense. Each output element represents a bit and can take the value of either 0 or 1. <br /> Outputs: - 0: If the projection type is Sparse: Output.Dim == { Tensor\[0\].Dim\[0\] } A tensor of int32 that represents hash signatures.If the projection type is Dense: Output.Dim == { Tensor\[0\].Dim\[0\] \* Tensor\[0\].Dim\[1\] } A flattened tensor that represents projected bit vectors. <br /> Available since NNAPI feature level 1. The offset value for sparse projections was added in NNAPI feature level 3. |
| `ANEURALNETWORKS_LSTM` | Performs a single time step in a Long Short-Term Memory (LSTM) layer. The LSTM operation is described by the following equations. \\begin{eqnarray\*} i_t =\& \\sigma(W_{xi}x_t+W_{hi}h_{t-1}+W_{ci}C_{t-1}+b_i) \& \\\\ f_t =\& \\sigma(W_{xf}x_t+W_{hf}h_{t-1}+W_{cf}C_{t-1}+b_f) \& \\\\ C_t =\& clip(f_t \\odot C_{t-1} + i_t \\odot g(W_{xc}x_t+W_{hc}h_{t-1}+b_c),\\ t_{cell}) \& \\\\ o_t =\& \\sigma(W_{xo}x_t+W_{ho}h_{t-1}+W_{co}C_t+b_o) \& \\\\ \& \& \\\\ \& clip(W_{proj}(o_t \\odot g(C_t))+b_{proj},\\ t_{proj}) \& if\\ there\\ is\\ a\\ projection; \\\\ h_t =\& \& \\\\ \& o_t \\odot g(C_t) \& otherwise. \\\\ \\end{eqnarray\*} Where: - $x_t$ is the input, - $i_t$ is the input gate, - $f_t$ is the forget gate, - $C_t$ is the cell state, - $o_t$ is the output, - $h_t$ is the output state, - $\\sigma$ is the logistic sigmoid function, - $g$ is the cell input and cell output activation function, usually $tahn$, - $W_{xi}$ is the input-to-input weight matrix, - $W_{hi}$ is the recurrent to input weight matrix, - $W_{ci}$ is the cell-to-input weight matrix, - $b_i$ is the input gate bias, - $W_{xf}$ is the input-to-forget weight matrix, - $W_{hf}$ is the recurrent-to-forget weight matrix, - $W_{cf}$ is the cell-to-forget weight matrix, - $b_f$ is the forget gate bias, - $W_{xc}$ is the input-to-cell weight matrix, - $W_{hc}$ is the recurrent-to-cell weight matrix, - $b_c$ is the cell bias, - $W_{xo}$ is the input-to-output weight matrix, - $W_{ho}$ is the recurrent-to-output weight matrix, - $W_{co}$ is the cell-to-output weight matrix, - $b_o$ is the output gate bias, - $W_{proj}$ is the projection weight matrix, - $b_{proj}$ is the projection bias, - $t_{cell}$ is the threshold for clipping the cell state, and - $t_{proj}$ is the threshold for clipping the projected output. - $\\odot$ is the [Hadamard product](https://en.wikipedia.org/wiki/Hadamard_product_(matrices)) that takes two matrices and produces another matrix, each element of which is the product of the corresponding elements of the input matrices. <br /> Since NNAPI feature level 3 LSTM supports layer normalization. In case layer normalization is used, the inputs to internal activation functions (sigmoid and $g$) are normalized, rescaled and recentered following an approach from section 3.1 from <https://arxiv.org/pdf/1607.06450.pdf> The operation has the following independently optional inputs: - The cell-to-input weights ( $W_{ci}$), cell-to-forget weights ( $W_{cf}$) and cell-to-output weights ( $W_{co}$) either all have values or neither of them have values (i.e., all set to null). If they have values, the peephole optimization is used. - The input-to-input weights ( $W_{xi}$), recurrent-to-input weights ( $W_{hi}$) and input gate bias ( $b_i$) either all have values, or none of them have values. If they have no values, coupling of input and forget gates (CIFG) is used, in which case the input gate ( $i_t$) is calculated using the following equation instead. \\begin{eqnarray\*} i_t = 1 - f_t \\end{eqnarray\*} In case peephole optimization is used and CIFG is not used cell-to-input ( $W_{ci}$) weights must be present. Otherwise, the cell-to-input weights must have no value. - The projection weights ( $W_{proj}$) is required only for the recurrent projection layer, and should otherwise have no value. - The projection bias ( $b_{proj}$) may (but not required to) have a value if the recurrent projection layer exists, and should otherwise have no value. - (NNAPI feature level 3 or later) The four layer normalization weights either all have values or none of them have values. Additionally, if CIFG is used, input layer normalization weights tensor is omitted and the other layer normalization weights either all have values or none of them have values. Layer normalization is used when the values of all the layer normalization weights are present. <br /> References: The default non-peephole non-CIFG implementation is based on: <http://www.bioinf.jku.at/publications/older/2604.pdf> S. Hochreiter and J. Schmidhuber. "Long Short-Term Memory". Neural Computation, 9(8):1735-1780, 1997. The peephole implementation and projection layer is based on: <https://research.google.com/pubs/archive/43905.pdf> Hasim Sak, Andrew Senior, and Francoise Beaufays. "Long short-term memory recurrent neural network architectures for large scale acoustic modeling." INTERSPEECH, 2014. (However, the concept of peephole optimization was introduced in work prior to this paper.) The coupling of input and forget gate (CIFG) is based on: <http://arxiv.org/pdf/1503.04069.pdf> Greff et al. "LSTM: A Search Space Odyssey" The layer normalization is based on: <https://arxiv.org/pdf/1607.06450.pdf> Jimmy Ba et al. "Layer Normalization" Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) <br /> All input and output tensors must be of the same type. Inputs: - 0: The input ( $x_t$). A 2-D tensor of shape \[batch_size, input_size\], where "batch_size" corresponds to the batching dimension, and "input_size" is the size of the input. - 1: The input-to-input weights ( $W_{xi}$). Optional. A 2-D tensor of shape \[num_units, input_size\], where "num_units" corresponds to the number of cell units. - 2: The input-to-forget weights ( $W_{xf}$). A 2-D tensor of shape \[num_units, input_size\]. - 3: The input-to-cell weights ( $W_{xc}$). A 2-D tensor of shape \[num_units, input_size\]. - 4: The input-to-output weights ( $W_{xo}$). A 2-D tensor of shape \[num_units, input_size\]. - 5: The recurrent-to-input weights ( $W_{hi}$). Optional. A 2-D tensor of shape \[num_units, output_size\], where "output_size" corresponds to either the number of cell units (i.e., "num_units"), or the second dimension of the "projection_weights", if defined. - 6: The recurrent-to-forget weights ( $W_{hf}$). A 2-D tensor of shape \[num_units, output_size\]. - 7: The recurrent-to-cell weights ( $W_{hc}$). A 2-D tensor of shape \[num_units, output_size\]. - 8: The recurrent-to-output weights ( $W_{ho}$). A 2-D tensor of shape \[num_units, output_size\]. - 9: The cell-to-input weights ( $W_{ci}$). Optional. A 1-D tensor of shape \[num_units\]. - 10:The cell-to-forget weights ( $W_{cf}$). Optional. A 1-D tensor of shape \[num_units\]. - 11:The cell-to-output weights ( $W_{co}$). Optional. A 1-D tensor of shape \[num_units\]. - 12:The input gate bias ( $b_i$). Optional. A 1-D tensor of shape \[num_units\]. - 13:The forget gate bias ( $b_f$). A 1-D tensor of shape \[num_units\]. - 14:The cell bias ( $b_c$). A 1-D tensor of shape \[num_units\]. - 15:The output gate bias ( $b_o$). A 1-D tensor of shape \[num_units\]. - 16:The projection weights ( $W_{proj}$). Optional. A 2-D tensor of shape \[output_size, num_units\]. - 17:The projection bias ( $b_{proj}$). Optional. A 1-D tensor of shape \[output_size\]. - 18:The output state (in) ( $h_{t-1}$). A 2-D tensor of shape \[batch_size, output_size\]. - 19:The cell state (in) ( $C_{t-1}$). A 2-D tensor of shape \[batch_size, num_units\]. - 20:The activation function ( $g$). A value indicating the activation function: - 0: None; - 1: Relu; - 3: Relu6; - 4: Tanh; - 6: Sigmoid. - 21:The clipping threshold ( $t_{cell}$) for the cell state, such that values are bound within \[-cell_clip, cell_clip\]. If set to 0.0 then clipping is disabled. Until NNAPI feature level 3 this scalar must be of type [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578). Since NNAPI feature level 3, if all the input tensors have type [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447), this scalar must be of the type [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578), otherwise if all the input tensors have the type [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c), this scalar must be of type [ANEURALNETWORKS_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a823c78695644dea4e94aa04ff2d00cd7). - 22:The clipping threshold ( $t_{proj}$) for the output from the projection layer, such that values are bound within \[-proj_clip, proj_clip\]. If set to 0.0 then clipping is disabled. Until NNAPI feature level 3 this scalar must be of type [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578). Since NNAPI feature level 3, if all the input tensors have type [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447), this scalar must be of the type [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578), otherwise if all the input tensors have the type [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c), this scalar must be of type [ANEURALNETWORKS_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a823c78695644dea4e94aa04ff2d00cd7). Since NNAPI feature level 3 there are additional inputs to this op: - 23:The input layer normalization weights. A 1-D tensor of shape \[num_units\]. Used to rescale normalized inputs to activation at input gate. - 24:The forget layer normalization weights. A 1-D tensor of shape \[num_units\]. Used to rescale normalized inputs to activation at forget gate. - 25:The cell layer normalization weights. A 1-D tensor of shape \[num_units\]. Used to rescale normalized inputs to activation at cell gate. - 26:The output layer normalization weights. A 1-D tensor of shape \[num_units\]. Used to rescale normalized inputs to activation at output gate. <br /> Outputs: - 0: The scratch buffer. A 2-D tensor of shape \[batch_size, num_units \* 3\] with CIFG, or \[batch_size, num_units \* 4\] without CIFG. - 1: The output state (out) ( $h_t$). A 2-D tensor of shape \[batch_size, output_size\]. - 2: The cell state (out) ( $C_t$). A 2-D tensor of shape \[batch_size, num_units\]. - 3: The output ( $o_t$). A 2-D tensor of shape \[batch_size, output_size\]. This is effectively the same as the current "output state (out)" value. <br /> Available since NNAPI feature level 1. |
| `ANEURALNETWORKS_MAXIMUM` | Returns the element-wise maximum of two tensors. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: from 1. Inputs: - 0: A tensor. - 1: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) and compatible dimensions with input0. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) tensor, the scales and zeroPoint can be different from input0 scale and zeroPoint. <br /> Outputs: - 0: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) as input0. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) tensor, the scale and zeroPoint can be different from inputs' scale and zeroPoint. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_MAX_POOL_2D` | Performs an 2-D max pooling operation. The output dimensions are functions of the filter dimensions, stride, and padding. The values in the output tensor are computed as: ``` output[b, i, j, channel] = max_{di, dj} ( input[b, strides[1] * i + di, strides[2] * j + dj, channel] ) ``` <br /> Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: 4, with "NHWC" or "NCHW" data layout. With the default data layout NHWC, the data is stored in the order of: \[batch, height, width, channels\]. Alternatively, the data layout could be NCHW, the data storage order of: \[batch, channels, height, width\]. NCHW is supported since NNAPI feature level 3. Both explicit padding and implicit padding are supported. Inputs (explicit padding): - 0: A 4-D tensor, of shape \[batches, height, width, depth\], specifying the input. Since NNAPI feature level 3, zero batches is supported for this tensor. - 1: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the padding on the left, in the 'width' dimension. - 2: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the padding on the right, in the 'width' dimension. - 3: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the padding on the top, in the 'height' dimension. - 4: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the padding on the bottom, in the 'height' dimension. - 5: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the stride when walking through input in the 'width' dimension. - 6: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the stride when walking through input in the 'height' dimension. - 7: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the filter width. - 8: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the filter height. - 9: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, and has to be one of the [FuseCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ec620045a39909a6bf00b3ee0c4d414) values. Specifies the activation to invoke on the result. - 10: An optional [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, default to false. Set to true to specify NCHW data layout for input0 and output0. Available since NNAPI feature level 3. <br /> Inputs (implicit padding): - 0: A 4-D tensor, of shape \[batches, height, width, depth\], specifying the input. Since NNAPI feature level 3, zero batches is supported for this tensor. - 1: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the implicit padding scheme, has to be one of the [PaddingCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gab72e9e6263fd5b015bb7f41ec18ce220) values. - 2: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the stride when walking through input in the 'width' dimension. - 3: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the stride when walking through input in the 'height' dimension. - 4: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the filter width. - 5: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the filter height. - 6: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, and has to be one of the [FuseCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ec620045a39909a6bf00b3ee0c4d414) values. Specifies the activation to invoke on the result. - 7: An optional [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, default to false. Set to true to specify NCHW data layout for input0 and output0. Available since NNAPI feature level 3. <br /> Outputs: - 0: The output 4-D tensor, of shape \[batches, out_height, out_width, depth\]. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scale and zeroPoint must be the same as input0. <br /> Available since NNAPI feature level 1. |
| `ANEURALNETWORKS_MEAN` | Computes the mean of elements across dimensions of a tensor. Reduces the input tensor along the given dimensions to reduce. Unless keep_dims is true, the rank of the tensor is reduced by 1 for each entry in axis. If keep_dims is true, the reduced dimensions are retained with length 1. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: up to 4 Inputs: - 0: A tensor, specifying the input. - 1: A 1-D Tensor of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896). The dimensions to reduce. Must be in the range \[-rank(input_tensor), rank(input_tensor)).NOTE: When the operation was introduced, the documentation incorrectly stated that if dimensions were empty, the operation would reduce across all dimensions. This behavior was never implemented. - 2: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, keep_dims. If positive, retains reduced dimensions with length 1. <br /> Outputs: - 0: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) as input0. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scale and zeroPoint must be the same as input0. If all dimensions are reduced and keep_dims is false, the output shape is \[1\]. <br /> Available since NNAPI feature level 2. |
| `ANEURALNETWORKS_MINIMUM` | Returns the element-wise minimum of two tensors. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: from 1. Inputs: - 0: A tensor. - 1: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) and compatible dimensions with input0. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) tensor, the scales and zeroPoint can be different from input0 scale and zeroPoint. <br /> Outputs: - 0: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) as input0. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) tensor, the scale and zeroPoint can be different from inputs' scale and zeroPoint. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_MIRROR_PAD` | Pads a tensor with mirrored values. This operator specifies one of two padding modes: REFLECT or SYMMETRIC. In the case of REFLECT mode, the mirroring excludes the border element on the padding side. In the case of SYMMETRIC mode, the mirroring includes the border element on the padding side. For example, if the input is the 1-D tensor `[1, 2, 3]` and the padding is `[0, 2]` (i.e., pad no elements before the first (and only) dimension, and two elements after the first (and only) dimension), then: - REFLECT mode produces the output `[1, 2, 3, 2, 1]` - SYMMETRIC mode produces the output `[1, 2, 3, 3, 2]` <br /> Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) - [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) <br /> Supported tensor rank: from 1. Inputs: - 0: An n-D tensor, specifying the tensor to be padded. - 1: A 2-D tensor of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896), the paddings for each spatial dimension of the input tensor. The shape of the tensor must be {rank(input0), 2}. padding\[i, 0\] specifies the number of elements to be padded in the front of dimension i. padding\[i, 1\] specifies the number of elements to be padded after the end of dimension i. Each padding value must be nonnegative. In the case of REFLECT mode, each padding value must be less than the corresponding dimension. In the case of SYMMETRIC mode, each padding value must be less than or equal to the corresponding dimension. - 2: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the mode. Options are 0:REFLECT and 1:SYMMETRIC. <br /> Outputs: - 0: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) as input0. The output tensor has the same rank as input0, and each dimension of the output tensor has the same size as the corresponding dimension of the input tensor plus the size of the padding: output0.dimension\[i\] = padding\[i, 0\] + input0.dimension\[i\] + padding\[i, 1\] For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scale and zeroPoint must be the same as input0. <br /> Available since NNAPI feature level 7. |
| `ANEURALNETWORKS_MUL` | Multiplies two tensors, element-wise. Takes two input tensors of identical [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) and compatible dimensions. The output is the product of both input tensors, optionally modified by an activation function. Two dimensions are compatible when: 1. they are equal, or 2. one of them is 1 <br /> The size of the resulting output is the maximum size along each dimension of the input operands. It starts with the trailing dimensions, and works its way forward. Since NNAPI feature level 3, generic zero-sized input tensor is supported. Zero dimension is only compatible with 0 or 1. The size of the output dimension is zero if either of corresponding input dimension is zero. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) - [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) (since NNAPI feature level 4) <br /> Supported tensor rank: up to 4 Inputs: - 0: A tensor. - 1: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298), and compatible dimensions as input0. - 2: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, and has to be one of the [FuseCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ec620045a39909a6bf00b3ee0c4d414) values. Specifies the activation to invoke on the result. For a [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) tensor, the [FuseCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ec620045a39909a6bf00b3ee0c4d414) must be "NONE". <br /> Outputs: - 0: The product, a tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) as input0. For output tensor of [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9), the following condition must be satisfied: output_scale \> input1_scale \* input2_scale. <br /> Available since NNAPI feature level 1. |
| `ANEURALNETWORKS_NEG` | Computes numerical negative value element-wise. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) <br /> Supported tensor rank: from 1. Inputs: - 0: A tensor. <br /> Outputs: - 0: The output tensor of same shape as input0. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_NOT_EQUAL` | For input tensors x and y, computes x != y elementwise. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_BOOL8](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ab275c740307fbffcfec94adcc7b374b9) - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: from 1 This operation supports broadcasting. Inputs: - 0: A tensor. - 1: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) and dimensions compatible with input0. <br /> Outputs: - 0: A tensor of [ANEURALNETWORKS_TENSOR_BOOL8](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ab275c740307fbffcfec94adcc7b374b9). <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_PACK` | Packs N input tensors (N \>= 1) of rank R into one output tensor of rank R+1. The tensors are packed along a given axis. The input tensors must have identical [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) and dimensions. For example, suppose there are N input tensors of shape (A, B, C). If axis is 0, the output tensor will have shape (N, A, B, C). If axis is 1, the output tensor will have shape (A, N, B, C). All dimensions through the axis dimension determine the output tile count; the remaining dimensions determine the tile shape. Return to the example of N input tensors of shape (A, B, C). If axis is 0, there are N tiles in the output, each of shape (A, B, C). If axis is 1, there are A\*N tiles in the output, each of shape (B, C). The coordinates of a tile within the output tensor are (t\[0\],...,t\[axis\]). The coordinates of a tile within an input tensor are (t\[0\],...,t\[axis-1\]). (If axis is 0, an input tensor consists of a single tile.) If we index input tensors starting with 0 (rather than by operand number), then output_tile\[t\[0\],...,t\[axis\]\] = input_tile\[t\[axis\]\]\[t\[0\],...,t\[axis-1\]\]. That is, all output tile coordinates except for the axis coordinate select the corresponding location within some input tensor; and the axis coordinate selects the input tensor. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) - [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) <br /> Supported input tensor rank: from 1 Inputs: - 0: A scalar of type [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc), specifying the axis along which to pack. The valid range is \[0, R+1). - 1 \~ N: Input tensors to be packed together. For [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensors, the scales and zeroPoint must be the same for all input tensors, and will be the same for the output tensor. <br /> Outputs: - 0: The packed tensor. <br /> Available since NNAPI feature level 6. |
| `ANEURALNETWORKS_PAD` | Pads a tensor. This operation pads a tensor according to the specified paddings. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) (full support since NNAPI feature level 3, see the output section) <br /> Supported tensor rank: up to 4 Inputs: - 0: An n-D tensor, specifying the tensor to be padded. - 1: A 2-D Tensor of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896), the paddings for each spatial dimension of the input tensor. The shape of the tensor must be {rank(input0), 2}. padding\[i, 0\] specifies the number of elements to be padded in the front of dimension i. padding\[i, 1\] specifies the number of elements to be padded after the end of dimension i. <br /> Outputs: - 0: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) as input0. The output tensor has the same rank as input0, and each dimension of the output tensor has the same size as the corresponding dimension of the input tensor plus the size of the padding: output0.dimension\[i\] = padding\[i, 0\] + input0.dimension\[i\] + padding\[i, 1\] For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scale and zeroPoint must be the same as input0.NOTE: Before NNAPI feature level 3, the pad value for [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) is undefined. Since NNAPI feature level 3, the pad value is always the logical zero. <br /> Available since NNAPI feature level 2. |
| `ANEURALNETWORKS_PAD_V2` | Pads a tensor with the given constant value according to the specified paddings. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: up to 4 Inputs: - 0: An n-D tensor, specifying the tensor to be padded. - 1: A 2-D Tensor of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896), the paddings for each spatial dimension of the input tensor. The shape of the tensor must be {rank(input0), 2}. padding\[i, 0\] specifies the number of elements to be padded in the front of dimension i. padding\[i, 1\] specifies the number of elements to be padded after the end of dimension i. - 2: A scalar specifying the value to use for padding input0. For input tensor of [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c), the pad value must be of [ANEURALNETWORKS_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a823c78695644dea4e94aa04ff2d00cd7). For input tensor of [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447), the pad value must be of [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578). For input tensor of [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9), the pad value must be of [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc). The scale and zeroPoint are assumed to be the same as in input0. <br /> Outputs: - 0: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) as input0. The output tensor has the same rank as input0, and each dimension of the output tensor has the same size as the corresponding dimension of the input tensor plus the size of the padding: output0.dimension\[i\] = padding\[i, 0\] + input0.dimension\[i\] + padding\[i, 1\] For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scale and zeroPoint must be the same as input0. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_POW` | Computes the power of one value to another. Given a tensor base and a tensor exponent, this operation computes base\^exponent elementwise. This operations supports broadcasting. The size of the output is the maximum size along each dimension of the input operands. It starts with the trailing dimensions, and works its way forward. For example: base.dimension = {4, 1, 2} exponent.dimension = {5, 4, 3, 1} output.dimension = {5, 4, 3, 2} Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) <br /> Supported tensor rank: from 1 Inputs: - 0: A tensor specifying the base. - 1: A tensor specifying the exponent. <br /> Outputs: - 0: An output tensor. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_PRELU` | Parametric Rectified Linear Unit. It follows: f(x) = alpha \* x for x \< 0, f(x) = x for x \>= 0, where alpha is a learned array with the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) and compatible dimensions as input x. Two dimensions are compatible when: 1. they are equal, or 2. one of them is 1 <br /> The size of the output is the maximum size along each dimension of the input operands. It starts with the trailing dimensions, and works its way forward. Example: input.dimension = {4, 1, 2} alpha.dimension = {5, 4, 3, 1} output.dimension = {5, 4, 3, 2} Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: from 1 Inputs: - 0: A tensor, specifying the input. - 1: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298), and compatible dimensions as input0, specifying the alpha. <br /> Outputs: - 0: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) as input0. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scales and zeroPoint can be different from input0 scale and zeroPoint. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_QUANTIZE` | Quantizes the input tensor. The formula for [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) output tensor is: ``` output = max(0, min(255, round(input / scale) + zeroPoint) ``` <br /> The formula for [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) output tensor is: ``` output = max(-128, min(127, round(input / scale) + zeroPoint) ``` <br /> Supported input tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) <br /> Supported output tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: from 1 Inputs: - 0: A tensor, may be zero-sized. <br /> Outputs: - 0: The output tensor of same shape as input0, but with [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) or. [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9). <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_QUANTIZED_16BIT_LSTM` | A version of quantized LSTM, using 16 bit quantization for internal state. There is no projection layer, so cell state size is equal to the output size. Inputs: - 0: A 2-D tensor of type [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and shape \[numBatches, inputSize\] specifying the input to the LSTM cell. Tensor is quantized with a fixed quantization range of [-1, 127/128](https://developer.android.com/ndk/reference/group/scale = 1/128, zeroPoint = 128). - 1: The input-to-input weights. A 2-D tensor of type [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and shape \[outputSize, inputSize\] specifying input-to-input part of weights for fully-connected layer inside the LSTM cell. Quantization zero point and scale must be the same across all the weights. - 2: The input-to-forget weights. A 2-D tensor of type [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and shape \[outputSize, inputSize\] specifying input-to-forget part of weights for fully-connected layer inside the LSTM cell. Quantization zero point and scale must be the same across all the weights. - 3: The input-to-cell weights. A 2-D tensor of type [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and shape \[outputSize, inputSize\] specifying input-to-cell part of weights for fully-connected layer inside the LSTM cell. Quantization zero point and scale must be the same across all the weights. - 4: The input-to-output weights. A 2-D tensor of type [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and shape \[outputSize, inputSize\] specifying input-to-output part of weights for fully-connected layer inside the LSTM cell. Quantization zero point and scale must be the same across all the weights. - 5: The recurrent-to-input weights. A 2-D tensor of type [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and shape \[outputSize, outputSize\] specifying recurrent-to-input part of weights for fully-connected layer inside the LSTM cell. Quantization zero point and scale must be the same across all the weights. - 6: The recurrent-to-forget weights. A 2-D tensor of type [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and shape \[outputSize, outputSize\] specifying recurrent-to-forget part of weights for fully-connected layer inside the LSTM cell. Quantization zero point and scale must be the same across all the weights. - 7: The recurrent-to-cell weights. A 2-D tensor of type [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and shape \[outputSize, outputSize\] specifying recurrent-to-cell part of weights for fully-connected layer inside the LSTM cell. Quantization zero point and scale must be the same across all the weights. - 8: The recurrent-to-output weights. A 2-D tensor of type [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and shape \[outputSize, outputSize\] specifying recurrent-to-output part of weights for fully-connected layer inside the LSTM cell. Quantization zero point and scale must be the same across all the weights. - 9: The input gate bias. A 1-D tensor of type [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) and shape \[outputSize\] specifying the bias for the fully-connected layer inside the LSTM cell. Bias is quantized with scale being a product of input and weights scales and zeroPoint equal to 0. - 10:The forget gate bias. A 1-D tensor of type [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) and shape \[outputSize\] specifying the bias for the fully-connected layer inside the LSTM cell. Bias is quantized with scale being a product of input and weights scales and zeroPoint equal to 0. - 11:The cell bias. A 1-D tensor of type [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) and shape \[outputSize\] specifying the bias for the fully-connected layer inside the LSTM cell. Bias is quantized with scale being a product of input and weights scales and zeroPoint equal to 0. - 12:The output gate bias. A 1-D tensor of type [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) and shape \[outputSize\] specifying the bias for the fully-connected layer inside the LSTM cell. Bias is quantized with scale being a product of input and weights scales and zeroPoint equal to 0. - 13: A 2-D tensor of type [ANEURALNETWORKS_TENSOR_QUANT16_SYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a750fa6aa30c71eb8d093ee1c44d25a12) and shape \[numBatches, outputSize\] specifying the cell state from the previous time step of the LSTM cell. It is quantized using a quantization range of [-2\^4, 2\^4 \* 32767/32768](https://developer.android.com/ndk/reference/group/scale = 2^4 / 32768, zeroPoint = 0). - 14: A 2-D tensor of type [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and shape \[numBathes, outputSize\] specifying the output of the LSTM cell from previous time-step. Tensor is quantized with a fixed quantization range of [-1, 127/128](https://developer.android.com/ndk/reference/group/scale = 1/128, zeroPoint = 128). <br /> Outputs: - 0: A 2-D tensor of type [ANEURALNETWORKS_TENSOR_QUANT16_SYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a750fa6aa30c71eb8d093ee1c44d25a12) and shape \[numBatches, outputSize\] which contains a cell state from the current time step. Tensor is quantized using a quantization range of [-2\^4, 2\^4 \* 32767/32768](https://developer.android.com/ndk/reference/group/scale = 2^4 / 32768, zeroPoint = 0). - 1: A 2-D tensor of type [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and shape \[numBathes, outputSize\] which contains the output value. Tensor is quantized with a fixed quantization range of [-1, 127/128](https://developer.android.com/ndk/reference/group/scale = 1/128, zeroPoint = 128). <br /> |
| `ANEURALNETWORKS_QUANTIZED_LSTM` | Quantized version of [ANEURALNETWORKS_LSTM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0ad0377e8c305e596fb7f64ff896671fc5). The input and the output use asymmetric quantized types, while the rest use symmetric ones. Inputs: - 0: The input to the LSTM cell. Type: [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) Shape: \[batchSize, inputSize\] - 1: The input-to-input weights. Optional. Type: [ANEURALNETWORKS_TENSOR_QUANT8_SYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7a907ab82a0229f28bd188dd37a1ef52) Shape: \[numUnits, inputSize\] - 2: The input-to-forget weights. Type: [ANEURALNETWORKS_TENSOR_QUANT8_SYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7a907ab82a0229f28bd188dd37a1ef52) Shape: \[numUnits, inputSize\] - 3: The input-to-cell weights. Type: [ANEURALNETWORKS_TENSOR_QUANT8_SYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7a907ab82a0229f28bd188dd37a1ef52) Shape: \[numUnits, inputSize\] - 4: The input-to-output weights. Type: [ANEURALNETWORKS_TENSOR_QUANT8_SYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7a907ab82a0229f28bd188dd37a1ef52) Shape: \[numUnits, inputSize\] - 5: The recurrent-to-input weights. Optional. Type: [ANEURALNETWORKS_TENSOR_QUANT8_SYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7a907ab82a0229f28bd188dd37a1ef52) Shape: \[numUnits, outputSize\] - 6: The recurrent-to-forget weights. Type: [ANEURALNETWORKS_TENSOR_QUANT8_SYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7a907ab82a0229f28bd188dd37a1ef52) Shape: \[numUnits, outputSize\] - 7: The recurrent-to-cell weights. Type: [ANEURALNETWORKS_TENSOR_QUANT8_SYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7a907ab82a0229f28bd188dd37a1ef52) Shape: \[numUnits, outputSize\] - 8: The recurrent-to-output weights. Type: [ANEURALNETWORKS_TENSOR_QUANT8_SYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7a907ab82a0229f28bd188dd37a1ef52) Shape: \[numUnits, outputSize\] - 9: The cell-to-input weights (for peephole). Optional. Type: [ANEURALNETWORKS_TENSOR_QUANT16_SYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a750fa6aa30c71eb8d093ee1c44d25a12) Shape: \[numUnits\] - 10: The cell-to-forget weights (for peephole). Optional. Type: [ANEURALNETWORKS_TENSOR_QUANT16_SYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a750fa6aa30c71eb8d093ee1c44d25a12) Shape: \[numUnits\] - 11: The cell-to-output weights (for peephole). Optional. Type: [ANEURALNETWORKS_TENSOR_QUANT16_SYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a750fa6aa30c71eb8d093ee1c44d25a12) Shape: \[numUnits\] - 12: The input gate bias. Quantized with scale being the product of input and weights scales and zeroPoint equal to 0. Optional. Type: [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) Shape: \[numUnits\] - 13: The forget gate bias. Quantized with scale being the product of input and weights scales and zeroPoint equal to 0. Type: [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) Shape: \[numUnits\] - 14: The cell bias. Quantized with scale being the product of input and weights scales and zeroPoint equal to 0. Type: [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) Shape: \[numUnits\] - 15: The output gate bias. Quantized with scale being the product of input and weights scales and zeroPoint equal to 0. Type: [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) Shape: \[numUnits\] - 16: The projection weights. Optional. Type: [ANEURALNETWORKS_TENSOR_QUANT8_SYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7a907ab82a0229f28bd188dd37a1ef52) Shape: \[outputSize, numUnits\] - 17: The projection bias. Quantized with scale being the product of input and weights scales and zeroPoint equal to 0. Optional. Type: [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) Shape: \[outputSize\] - 18: The output from the previous time step. Type: [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) Shape: \[batchSize, outputSize\] - 19: The cell state from the previous time step. Type: [ANEURALNETWORKS_TENSOR_QUANT16_SYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a750fa6aa30c71eb8d093ee1c44d25a12) Shape: \[batchSize, numUnits\] - 20: The input layer normalization weights. Used to rescale normalized inputs to activation at input gate. Optional. Type: [ANEURALNETWORKS_TENSOR_QUANT16_SYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a750fa6aa30c71eb8d093ee1c44d25a12) Shape: \[numUnits\] - 21: The forget layer normalization weights. Used to rescale normalized inputs to activation at forget gate. Optional. Type: [ANEURALNETWORKS_TENSOR_QUANT16_SYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a750fa6aa30c71eb8d093ee1c44d25a12) Shape: \[numUnits\] - 22: The cell layer normalization weights. Used to rescale normalized inputs to activation at cell gate. Optional. Type: [ANEURALNETWORKS_TENSOR_QUANT16_SYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a750fa6aa30c71eb8d093ee1c44d25a12) Shape: \[numUnits\] - 23: The output layer normalization weights. Used to rescale normalized inputs to activation at output gate. Optional. Type: [ANEURALNETWORKS_TENSOR_QUANT16_SYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a750fa6aa30c71eb8d093ee1c44d25a12) Shape: \[numUnits\] - 24: The cell clip. If provided the cell state is clipped by this value prior to the cell output activation. Optional. Type: [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578). - 25: The projection clip. If provided and projection is enabled, this is used for clipping the projected values. Optional. Type: [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578). - 26: The scale of the intermediate result of matmul, i.e. input to layer normalization, at input gate. Type: [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578). - 27: The scale of the intermediate result of matmul, i.e. input to layer normalization, at forget gate. Type: [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578). - 28: The scale of the intermediate result of matmul, i.e. input to layer normalization, at cell gate. Type: [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578). - 29: The scale of the intermediate result of matmul, i.e. input to layer normalization, at output gate. Type: [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578). - 30: The zero point of the hidden state, i.e. input to projection. Type: [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc). - 31: The scale of the hidden state, i.e. input to projection. Type: [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578). <br /> Outputs: - 0: The output state (out). Type: [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) Shape: \[batchSize, outputSize\] - 1: The cell state (out). Type: [ANEURALNETWORKS_TENSOR_QUANT16_SYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a750fa6aa30c71eb8d093ee1c44d25a12) Shape: \[batchSize, numUnits\] - 2: The output. This is effectively the same as the current "output state (out)" value. Type: [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) Shape: \[batchSize, outputSize\] <br /> Available since NNAPI feature level 4. |
| `ANEURALNETWORKS_RANDOM_MULTINOMIAL` | Draws samples from a multinomial distribution. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) <br /> Inputs: - 0: A 2-D tensor with shape \[batches, classes\], specifying the unnormalized log-probabilities for all classes. - 1: A scalar [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc), specifying the number of independent samples to draw for each row slice. - 2: A 1-D [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) tensor with shape \[2\], specifying seeds used to initialize the random distribution. If both provided seeds are 0, both will be randomly generated. Outputs: - 0: A 2-D [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) tensor with shape \[batches, samples\], containing the drawn samples. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_RANK` | Returns the rank of a tensor. The rank of a tensor is the number of dimensions in it. Also known as "order", "degree", "ndims". Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT16_SYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a750fa6aa30c71eb8d093ee1c44d25a12) - [ANEURALNETWORKS_TENSOR_BOOL8](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ab275c740307fbffcfec94adcc7b374b9) - [ANEURALNETWORKS_TENSOR_QUANT8_SYMM_PER_CHANNEL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a63c89cf7133314db885eae2abe0acc70) - [ANEURALNETWORKS_TENSOR_QUANT16_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aac04cfb70bef0e2f4081b6b69a80ddf7) - [ANEURALNETWORKS_TENSOR_QUANT8_SYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7a907ab82a0229f28bd188dd37a1ef52) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) <br /> Supported tensor rank: from 1. Inputs: - 0: The input tensor. <br /> Outputs: - 0: A scalar of [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc), specifying the rank of the input tensor. <br /> Available since NNAPI feature level 4. |
| `ANEURALNETWORKS_REDUCE_ALL` | Reduces a tensor by computing the "logical and" of elements along given dimensions. If keep_dims is true, the reduced dimensions are retained with length 1. Otherwise, the rank of the tensor is reduced by 1 for each entry in dimensions. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_BOOL8](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ab275c740307fbffcfec94adcc7b374b9) <br /> Supported tensor rank: up to 4 Inputs: - 0: An n-D tensor. - 1: A 1-D tensor of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896). The dimensions to reduce. Dimension values must be in the range \[-n, n). - 2: An [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, keep_dims. If true, retains reduced dimensions with length 1. <br /> Outputs: - 0: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) as input0. If all dimensions are reduced and keep_dims is false, the output shape is \[1\]. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_REDUCE_ANY` | Reduces a tensor by computing the "logical or" of elements along given dimensions. If keep_dims is true, the reduced dimensions are retained with length 1. Otherwise, the rank of the tensor is reduced by 1 for each entry in dimensions. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_BOOL8](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ab275c740307fbffcfec94adcc7b374b9) <br /> Supported tensor rank: up to 4 Inputs: - 0: An n-D tensor. - 1: A 1-D tensor of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896). The dimensions to reduce. Dimension values must be in the range \[-n, n). - 2: An [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, keep_dims. If true, retains reduced dimensions with length 1. <br /> Outputs: - 0: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) as input0. If all dimensions are reduced and keep_dims is false, the output shape is \[1\]. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_REDUCE_MAX` | Reduces a tensor by computing the maximum of elements along given dimensions. If keep_dims is true, the reduced dimensions are retained with length 1. Otherwise, the rank of the tensor is reduced by 1 for each entry in dimensions. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: up to 4 Inputs: - 0: An n-D tensor. - 1: A 1-D tensor of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896). The dimensions to reduce. Dimension values must be in the range \[-n, n). - 2: An [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, keep_dims. If true, retains reduced dimensions with length 1. <br /> Outputs: - 0: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) as input0. If all dimensions are reduced and keep_dims is false, the output shape is \[1\]. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scale and zeroPoint must be the same as input0. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_REDUCE_MIN` | Reduces a tensor by computing the minimum of elements along given dimensions. If keep_dims is true, the reduced dimensions are retained with length 1. Otherwise, the rank of the tensor is reduced by 1 for each entry in dimensions. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: up to 4 Inputs: - 0: An n-D tensor. - 1: A 1-D tensor of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896). The dimensions to reduce. Dimension values must be in the range \[-n, n). - 2: An [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, keep_dims. If true, retains reduced dimensions with length 1. <br /> Outputs: - 0: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) as input0. If all dimensions are reduced and keep_dims is false, the output shape is \[1\]. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scale and zeroPoint must be the same as input0. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_REDUCE_PROD` | Reduces a tensor by multiplying elements along given dimensions. If keep_dims is true, the reduced dimensions are retained with length 1. Otherwise, the rank of the tensor is reduced by 1 for each entry in dimensions. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) <br /> Supported tensor rank: up to 4 Inputs: - 0: An n-D tensor. - 1: A 1-D tensor of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896). The dimensions to reduce. Dimension values must be in the range \[-n, n). - 2: An [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, keep_dims. If true, retains reduced dimensions with length 1. <br /> Outputs: - 0: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) as input0. If all dimensions are reduced and keep_dims is false, the output shape is \[1\]. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_REDUCE_SUM` | Reduces a tensor by summing elements along given dimensions. If keep_dims is true, the reduced dimensions are retained with length 1. Otherwise, the rank of the tensor is reduced by 1 for each entry in dimensions. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) <br /> Supported tensor rank: up to 4 Inputs: - 0: An n-D tensor. - 1: A 1-D tensor of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896). The dimensions to reduce. Dimension values must be in the range \[-n, n). - 2: An [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, keep_dims. If true, retains reduced dimensions with length 1. <br /> Outputs: - 0: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) as input0. If all dimensions are reduced and keep_dims is false, the output shape is \[1\]. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_RELU` | Computes rectified linear activation on the input tensor element-wise. The output is calculated using this formula: ``` output = max(0, input) ``` <br /> Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: up to 4. Inputs: - 0: A tensor, specifying the input. Since NNAPI feature level 3, this tensor may be zero-sized. <br /> Outputs: - 0: The output tensor of same shape as input0. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scale and zeroPoint must be the same as input0. <br /> Available since NNAPI feature level 1. |
| `ANEURALNETWORKS_RELU1` | Computes rectified linear 1 activation on the input tensor element-wise. The output is calculated using this formula: ``` output = min(1.f, max(-1.f, input)) ``` <br /> Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: up to 4. Inputs: - 0: A tensor, specifying the input. Since NNAPI feature level 3, this tensor may be zero-sized. <br /> Outputs: - 0: The output tensor of the same shape as input0. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scale and zeroPoint must be the same as input0. <br /> Available since NNAPI feature level 1. |
| `ANEURALNETWORKS_RELU6` | Computes rectified linear 6 activation on the input tensor element-wise. The output is calculated using this formula: ``` output = min(6, max(0, input)) ``` <br /> Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: up to 4. Inputs: - 0: A tensor, specifying the input. Since NNAPI feature level 3, this tensor may be zero-sized. <br /> Outputs: - 0: The output tensor of same shape as input0. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scale and zeroPoint must be the same as input0. <br /> Available since NNAPI feature level 1. |
| `ANEURALNETWORKS_RESHAPE` | Reshapes a tensor. Given tensor, this operation returns a tensor that has the same values as tensor, but with a newly specified shape. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) - [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) (since NNAPI feature level 6) <br /> Supported tensor rank: up to 4. Inputs: - 0: A tensor, specifying the tensor to be reshaped. - 1: A 1-D tensor of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896), defining the shape of the output tensor. The number of elements implied by shape must be the same as the number of elements in the input tensor.If one component of shape is the special value -1, the size of that dimension is computed so that the total size remains constant. In particular, a shape of \[-1\] flattens into 1-D. At most one component of shape can be -1. <br /> Outputs: - 0: The output tensor, of shape specified by the input shape. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scale and zeroPoint must be the same as input0. <br /> Available since NNAPI feature level 1. |
| `ANEURALNETWORKS_RESIZE_BILINEAR` | Resizes images to given size using the bilinear interpretation. Resized images must be distorted if their output aspect ratio is not the same as input aspect ratio. The corner pixels of output may not be the same as corner pixels of input. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: 4, with "NHWC" or "NCHW" data layout. With the default data layout NHWC, the data is stored in the order of: \[batch, height, width, channels\]. Alternatively, the data layout could be NCHW, the data storage order of: \[batch, channels, height, width\]. NCHW is supported since NNAPI feature level 3. Both resizing by shape and resizing by scale are supported. Inputs (resizing by shape): - 0: A 4-D tensor, of shape \[batches, height, width, depth\], specifying the input. Since NNAPI feature level 3, zero batches is supported for this tensor. - 1: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the output width of the output tensor. - 2: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the output height of the output tensor. - 3: An optional [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, default to false. Set to true to specify NCHW data layout for input0 and output0. Available since NNAPI feature level 3. - 4: Align corners. An optional [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, default to false. If True, the centers of the 4 corner pixels of the input and output tensors are aligned, preserving the values at the corner pixels. Available since NNAPI feature level 4. - 5: Half pixel centers. An optional [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, default to false. If True, the pixel centers are assumed to be at (0.5, 0.5). This is the default behavior of image.resize in TF 2.0. If this parameter is True, then align_corners parameter must be False. Available since NNAPI feature level 4. <br /> Inputs (resizing by scale, since NNAPI feature level 3): - 0: A 4-D tensor, of shape \[batches, height, width, depth\], specifying the input. Zero batches is supported for this tensor. - 1: A scalar, specifying width_scale, the scaling factor of the width dimension from the input tensor to the output tensor. The output width is calculated as new_width = floor(width \* width_scale). The scalar must be of [ANEURALNETWORKS_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a823c78695644dea4e94aa04ff2d00cd7) if input0 is of [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) and of [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578) otherwise. - 2: A scalar, specifying height_scale, the scaling factor of the height dimension from the input tensor to the output tensor. The output height is calculated as new_height = floor(height \* height_scale). The scalar must be of [ANEURALNETWORKS_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a823c78695644dea4e94aa04ff2d00cd7) if input0 is of [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) and of [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578) otherwise. - 3: An optional [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, default to false. Set to true to specify NCHW data layout for input0 and output0. - 4: Align corners. An optional [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, default to false. If True, the centers of the 4 corner pixels of the input and output tensors are aligned, preserving the values at the corner pixels. Available since NNAPI feature level 4. - 5: Half pixel centers. An optional [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, default to false. If True, the pixel centers are assumed to be at (0.5, 0.5). This is the default behavior of image.resize in TF 2.0. If this parameter is True, then align_corners parameter must be False. Available since NNAPI feature level 4. <br /> Outputs: - 0: The output 4-D tensor, of shape \[batches, new_height, new_width, depth\]. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scale and zeroPoint must be the same as input0. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) tensor, the scale and zeroPoint must be the same as input0. <br /> Available since NNAPI feature level 1. |
| `ANEURALNETWORKS_RESIZE_NEAREST_NEIGHBOR` | Resizes images to given size using the nearest neighbor interpretation. Resized images must be distorted if their output aspect ratio is not the same as input aspect ratio. The corner pixels of output may not be the same as corner pixels of input. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: 4, with "NHWC" or "NCHW" data layout. With the default data layout NHWC, the data is stored in the order of: \[batch, height, width, channels\]. Alternatively, the data layout could be NCHW, the data storage order of: \[batch, channels, height, width\]. Both resizing by shape and resizing by scale are supported. Inputs (resizing by shape): - 0: A 4-D tensor, of shape \[batches, height, width, depth\], specifying the input. Zero batches is supported for this tensor. - 1: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the output width of the output tensor. - 2: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the output height of the output tensor. - 3: An [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, default to false. Set to true to specify NCHW data layout for input0 and output0. - 4: Align corners. An optional [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, default to false. If True, the centers of the 4 corner pixels of the input and output tensors are aligned, preserving the values at the corner pixels. Available since NNAPI feature level 4. - 5: Half pixel centers. An optional [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, default to false. If True, the pixel centers are assumed to be at (0.5, 0.5). This is the default behavior of image.resize in TF 2.0. If this parameter is True, then align_corners parameter must be False. Available since NNAPI feature level 4. <br /> Inputs (resizing by scale): - 0: A 4-D tensor, of shape \[batches, height, width, depth\], specifying the input. Zero batches is supported for this tensor. - 1: A scalar, specifying width_scale, the scaling factor of the width dimension from the input tensor to the output tensor. The output width is calculated as new_width = floor(width \* width_scale). The scalar must be of [ANEURALNETWORKS_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a823c78695644dea4e94aa04ff2d00cd7) if input0 is of [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) and of [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578) otherwise. - 2: A scalar, specifying height_scale, the scaling factor of the height dimension from the input tensor to the output tensor. The output height is calculated as new_height = floor(height \* height_scale). The scalar must be of [ANEURALNETWORKS_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a823c78695644dea4e94aa04ff2d00cd7) if input0 is of [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) and of [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578) otherwise. - 3: An [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, default to false. Set to true to specify NCHW data layout for input0 and output0. - 4: Align corners. An optional [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, default to false. If True, the centers of the 4 corner pixels of the input and output tensors are aligned, preserving the values at the corner pixels. Available since NNAPI feature level 4. - 5: Half pixel centers. An optional [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, default to false. If True, the pixel centers are assumed to be at (0.5, 0.5). This is the default behavior of image.resize in TF 2.0. If this parameter is True, then align_corners parameter must be False. Available since NNAPI feature level 4. <br /> Outputs: - 0: The output 4-D tensor, of shape \[batches, new_height, new_width, depth\]. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scale and zeroPoint must be the same as input0. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_REVERSE` | Reverses a specified dimension of a tensor. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) - [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) <br /> Supported tensor rank: up to 8. Inputs: - 0: Input tensor of rank n. - 1: Axis tensor of type [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) and shape \[1\], specifying which dimension of the input tensor is to be reversed. The dimension must be in the range \[0, n). <br /> Outputs: - 0: The reversed tensor of the same shape as the input tensor. For [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensors, the scales and zeroPoint must be the same as input0. <br /> Available since NNAPI feature level 7. |
| `ANEURALNETWORKS_RNN` | A basic recurrent neural network layer. This layer implements the operation: outputs = state = activation(inputs \* input_weights + state \* recurrent_weights + bias) Where: - "input_weights" is a weight matrix that multiplies the inputs; - "recurrent_weights" is a weight matrix that multiplies the current "state" which itself is the output from the previous time step computation; - "bias" is a bias vector (added to each output vector in the batch); - "activation" is the function passed as the "fused_activation_function" argument (if not "NONE"). <br /> Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) <br /> The input tensors must all be the same type. Inputs: - 0: input. A 2-D tensor of shape \[batch_size, input_size\], where "batch_size" corresponds to the batching dimension, and "input_size" is the size of the input. - 1: weights. A 2-D tensor of shape \[num_units, input_size\], where "num_units" corresponds to the number of units. - 2: recurrent_weights. A 2-D tensor of shape \[num_units, num_units\], with columns corresponding to the weights from each unit. - 3: bias. A 1-D tensor of shape \[num_units\]. - 4: hidden state (in). A 2-D tensor of shape \[batch_size, num_units\]. - 5: fused_activation_function. An optional [FuseCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ec620045a39909a6bf00b3ee0c4d414) value indicating the activation function. If "NONE" is specified then it results in a linear activation. <br /> Outputs: - 0: hidden state (out). A 2-D tensor of shape \[batch_size, num_units\]. - 1: output. A 2-D tensor of shape \[batch_size, num_units\]. This is effectively the same as the current state value. <br /> Available since NNAPI feature level 1. |
| `ANEURALNETWORKS_ROI_ALIGN` | Select and scale the feature map of each region of interest to a unified output size by average pooling sampling points from bilinear interpolation. The region of interest is represented by its upper-left corner coordinate (x1,y1) and lower-right corner coordinate (x2,y2) in the original image. A spatial scaling factor is applied to map into feature map coordinate. A valid region of interest should satisfy x1 \<= x2 and y1 \<= y2. No rounding is applied in this operation. The sampling points are unified distributed in the pooling bin and their values are calculated by bilinear interpolation. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: 4, with "NHWC" or "NCHW" data layout. With the default data layout NHWC, the data is stored in the order of: \[batch, height, width, channels\]. Alternatively, the data layout could be NCHW, the data storage order of: \[batch, channels, height, width\]. Inputs: - 0: A 4-D tensor, specifying the feature map. - 1: A 2-D Tensor of shape \[num_rois, 4\], specifying the locations of the regions of interest, each line with format \[x1, y1, x2, y2\]. For input0 of type [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3), this tensor should be of [ANEURALNETWORKS_TENSOR_QUANT16_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aac04cfb70bef0e2f4081b6b69a80ddf7), with zeroPoint of 0 and scale of 0.125. Zero num_rois is supported for this tensor. - 2: An 1-D [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) tensor, of shape \[num_rois\], specifying the batch index of each box. Boxes with the same batch index are grouped together. Zero num_rois is supported for this tensor. - 3: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the output height of the output tensor. - 4: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the output width of the output tensor. - 5: An [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578) scalar, specifying the ratio from the height of original image to the height of feature map. - 6: An [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578) scalar, specifying the ratio from the width of original image to the width of feature map. - 7: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the number of sampling points in height dimension used to compute the output. Set to 0 for adaptive value of ceil(roi_height/out_height). - 8: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the number of sampling points in width dimension used to compute the output. Set to 0 for adaptive value of ceil(roi_width/out_width). - 9: An [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, set to true to specify NCHW data layout for input0 and output0. Set to false for NHWC. <br /> Outputs: - 0: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) as input0. The output shape is \[num_rois, out_height, out_width, depth\]. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scale and zeroPoint can be different from the input0 scale and zeroPoint. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_ROI_POOLING` | Select and scale the feature map of each region of interest to a unified output size by max-pooling. The region of interest is represented by its upper-left corner coordinate (x1,y1) and lower-right corner coordinate (x2,y2) in the original image. A spatial scaling factor is applied to map into feature map coordinate. A valid region of interest should satisfy x1 \<= x2 and y1 \<= y2. Rounding is applied in this operation to ensure integer boundary for regions of interest and pooling bins. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: 4, with "NHWC" or "NCHW" data layout. With the default data layout NHWC, the data is stored in the order of: \[batch, height, width, channels\]. Alternatively, the data layout could be NCHW, the data storage order of: \[batch, channels, height, width\]. Inputs: - 0: A 4-D tensor, specifying the feature map. - 1: A 2-D Tensor of shape \[num_rois, 4\], specifying the locations of the regions of interest, each line with format \[x1, y1, x2, y2\]. For input0 of type [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, this tensor should be of [ANEURALNETWORKS_TENSOR_QUANT16_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aac04cfb70bef0e2f4081b6b69a80ddf7), with zeroPoint of 0 and scale of 0.125. - 2: An 1-D [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) tensor, of shape \[num_rois\], specifying the batch index of each box. Boxes with the same batch index are grouped together. - 3: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the output height of the output tensor. - 4: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the output width of the output tensor. - 5: An [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578) scalar, specifying the ratio from the height of original image to the height of feature map. - 6: An [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578) scalar, specifying the ratio from the width of original image to the width of feature map. - 7: An [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, set to true to specify NCHW data layout for input0 and output0. Set to false for NHWC. <br /> Outputs: - 0: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) as input0. The output shape is \[num_rois, out_height, out_width, depth\]. For input0 of type [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scale and zeroPoint must be the same as input0. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_RSQRT` | Computes reciprocal of square root of x element-wise. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) (since NNAPI feature level 7) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 7) <br /> Supported tensor rank: from 1. Inputs: - 0: A tensor. <br /> Outputs: - 0: The output tensor of same shape as input0. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scale and zeroPoint can be different from inputs' scale and zeroPoint. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_SELECT` | Using a tensor of booleans c and input tensors x and y select values elementwise from both input tensors: O\[i\] = C\[i\] ? x\[i\] : y\[i\]. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: from 1 Inputs: - 0: A tensor of type [ANEURALNETWORKS_TENSOR_BOOL8](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ab275c740307fbffcfec94adcc7b374b9) acting as a mask that chooses, based on the value at each element, whether the corresponding element in the output should be taken from input1 (if true) or input2 (if false). - 1: An input tensor of the same shape as input0. - 2: An input tensor of the same shape and type as input1. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scales and zeroPoint can be different from input1 scale and zeroPoint. <br /> Outputs: - 0: A tensor of the same type and shape as input1 and input2. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) tensor, the scale and zeroPoint can be different from inputs' scale and zeroPoint. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_SIN` | Computes sin of x element-wise. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) <br /> Supported tensor rank: from 1. Inputs: - 0: A tensor. <br /> Outputs: - 0: The output tensor of same shape as input0. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_SLICE` | Extracts a slice of specified size from the input tensor starting at a specified location. The starting location is specified as a 1-D tensor containing offsets for each dimension. The size is specified as a 1-D tensor containing either size of a slice along corresponding dimension or -1. In the latter case, all the remaining elements in dimension are included in the slice. A sum of begin offset and a size of a slice must not exceed size of a corresponding dimension. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: from 1 Inputs: - 0: An n-D tensor to take slice from, may be zero-sized. - 1: A 1-D tensor of type [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) specifying the beginning indices of the slice in each dimension. - 2: A 1-D tensor of type [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) specifying the size of the slice in each dimension. <br /> Outputs: - 0: An n-D tensor of the same type as the input containing the slice. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, its scale and zeroPoint has to be same as the input0 scale and zeroPoint. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_SOFTMAX` | Computes the softmax activation on the input tensor element-wise, per batch, by normalizing the input vector so the maximum coefficient is zero. The output is calculated using this formula: ``` output[batch, i] = exp((input[batch, i] - max(input[batch, :])) * beta) / sum_{k}{exp((input[batch, k] - max(input[batch, :])) * beta)} ``` <br /> For input tensor with rank other than 2, the activation will be applied independently on each 1-D slice along specified dimension. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: up to 4. Tensors with rank other than 2 or 4 are only supported since NNAPI feature level 3. Inputs: - 0: A 2-D or 4-D tensor, specifying the tensor to be reshaped. Since NNAPI feature level 3, this tensor may be zero-sized. - 1: A scalar, specifying the positive scaling factor for the exponent, beta. If input0 is of [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447), [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) or [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9), the scalar must be of [ANEURALNETWORKS_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a6aa658f93a72ca7356d9433f772ef578). If input0 is of [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c), then the scalar must be of [ANEURALNETWORKS_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a823c78695644dea4e94aa04ff2d00cd7). - 2: An optional [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, default to -1, specifying the dimension the activation would be performed on. Negative index is used to specify axis from the end (e.g. -1 for the last axis). Must be in the range \[-n, n). Available since NNAPI feature level 3. <br /> Outputs: - 0: The output tensor of same shape as input0. For [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3), the scale must be 1.f / 256 and the zeroPoint must be 0. For [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9), the scale must be 1.f / 256 and the zeroPoint must be -128. <br /> Available since NNAPI feature level 1. |
| `ANEURALNETWORKS_SPACE_TO_BATCH_ND` | SpaceToBatch for N-Dimensional tensors. This operation divides "spatial" dimensions \[1, ..., M\] of the input into a grid of blocks of shape block_shape, and interleaves these blocks with the "batch" dimension (0) such that in the output, the spatial dimensions \[1, ..., M\] correspond to the position within the grid, and the batch dimension combines both the position within a spatial block and the original batch position. Prior to division into blocks, the spatial dimensions of the input are optionally zero padded according to paddings. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) (full support since NNAPI feature level 3, see the output section) <br /> Supported tensor rank: 4, with "NHWC" or "NCHW" data layout. With the default data layout NHWC, the data is stored in the order of: \[batch, height, width, channels\]. Alternatively, the data layout could be NCHW, the data storage order of: \[batch, channels, height, width\]. NCHW is supported since NNAPI feature level 3. Inputs: - 0: An n-D tensor, specifying the input. - 1: A 1-D Tensor of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896), the block sizes for each spatial dimension of the input tensor. All values must be \>= 1. - 2: A 2-D Tensor of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896), the paddings for each spatial dimension of the input tensor. All values must be \>= 0. The shape of the tensor must be {M, 2}, where M is the number of spatial dimensions. padding\[i, 0\] specifies the number of element to be padded in the front of dimension i. padding\[i, 1\] specifies the number of element to be padded after the end of dimension i. - 3: An optional [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, default to false. Set to true to specify NCHW data layout for input0 and output0. Available since NNAPI feature level 3. <br /> Outputs: - 0: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) as input0. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scale and zeroPoint must be the same as input0.NOTE: Before NNAPI feature level 3, the pad value for [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) is undefined. Since NNAPI feature level 3, the pad value is always the logical zero. <br /> Available since NNAPI feature level 2. |
| `ANEURALNETWORKS_SPACE_TO_DEPTH` | Rearranges blocks of spatial data, into depth. More specifically, this op outputs a copy of the input tensor where values from the height and width dimensions are moved to the depth dimension. The value block_size indicates the input block size and how the data is moved. Chunks of data of size block_size \* block_size from depth are rearranged into non-overlapping blocks of size block_size x block_size. The depth of the output tensor is input_depth \* block_size \* block_size. The input tensor's height and width must be divisible by block_size. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: 4, with "NHWC" or "NCHW" data layout. With the default data layout NHWC, the data is stored in the order of: \[batch, height, width, channels\]. Alternatively, the data layout could be NCHW, the data storage order of: \[batch, channels, height, width\]. NCHW is supported since NNAPI feature level 3. Inputs: - 0: A 4-D tensor, of shape \[batches, height, width, depth_in\], specifying the input. - 1: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the block_size. block_size must be \>=1 and block_size must be a divisor of both the input height and width. - 2: An optional [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, default to false. Set to true to specify NCHW data layout for input0 and output0. Available since NNAPI feature level 3. <br /> Outputs: - 0: The output 4-D tensor, of shape \[batches, height/block_size, width/block_size, depth_in\*block_size\*block_size\]. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scale and zeroPoint must be the same as input0. <br /> Available since NNAPI feature level 1. |
| `ANEURALNETWORKS_SPLIT` | Splits a tensor along a given axis into num_splits subtensors. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: from 1 Inputs: - 0: An n-D tensor to split. - 1: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar specifying the axis along which to split. - 2: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar indicating the number of splits along given axis. Must evenly divide axis size. <br /> Outputs: - 0 \~ (num_splits - 1): Resulting subtensors. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scale and zeroPoint must be the same as input0. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_SQRT` | Computes square root of x element-wise. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) <br /> Supported tensor rank: from 1. Inputs: - 0: A tensor. <br /> Outputs: - 0: The output tensor of same shape as input0. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_SQUEEZE` | Removes dimensions of size 1 from the shape of a tensor. Given a tensor input, this operation returns a tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) with all dimensions of size 1 removed. If you don't want to remove all size 1 dimensions, you can remove specific size 1 dimensions by specifying the axes (input1). Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: up to 4 Inputs: - 0: An n-D tensor, the tensor to be squeezed. - 1: An optional 1-D tensor of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896). The dimensions to squeeze. If specified only squeezes the dimensions listed. Otherwise, squeezes all dimensions. The dimension index starts at 0. An error must be reported if squeezing a dimension that is not 1. <br /> Outputs: - 0: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) as input0. Contains the same data as input, but has one or more dimensions of size 1 removed. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scale and zeroPoint must be the same as input0. If all input dimensions are equal to 1 and are to be squeezed, the output shape is \[1\]. <br /> Available since NNAPI feature level 2. |
| `ANEURALNETWORKS_STRIDED_SLICE` | Extracts a strided slice of a tensor. Roughly speaking, this op extracts a slice of size (end - begin) / stride from the given input tensor. Starting at the location specified by begin the slice continues by adding stride to the index until all dimensions are not less than end. Note that a stride can be negative, which causes a reverse slice. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: up to 4 Inputs: - 0: An n-D tensor, specifying the tensor to be sliced. - 1: begin, a 1-D tensor of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896). The starts of the dimensions of the input tensor to be sliced. The length must be of rank(input0). - 2: end, a 1-D tensor of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896). The ends of the dimensions of the input tensor to be sliced. The length must be of rank(input0). - 3: strides, a 1-D tensor of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896). The strides of the dimensions of the input tensor to be sliced. The length must be of rank(input0). The entries must be non-zero. - 4: begin_mask, an [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar. If the ith bit of begin_mask is set, begin\[i\] is ignored and the fullest possible range in that dimension is used instead. - 5: end_mask, an [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar. If the ith bit of end_mask is set, end\[i\] is ignored and the fullest possible range in that dimension is used instead. - 6: shrink_axis_mask, an [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar. If the ith bit of shrink_axis_mask is set, the ith dimension specification shrinks the dimensionality by 1, taking on the value at index begin\[i\]. In this case, the ith specification must define a slice of size 1, e.g. begin\[i\] = x, end\[i\] = x + 1. <br /> Outputs: - 0: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) as input0 and rank (n - k), where k is the number of bits set in shrink_axis_mask. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scale and zeroPoint must be the same as input0. If shrink_axis_mask is true for all input dimensions, the output shape is \[1\]. <br /> Available since NNAPI feature level 2. |
| `ANEURALNETWORKS_SUB` | Element-wise subtraction of two tensors. Takes two input tensors of identical [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) and compatible dimensions. The output is the result of subtracting the second input tensor from the first one, optionally modified by an activation function. Two dimensions are compatible when: 1. they are equal, or 2. one of them is 1 <br /> The size of the output is the maximum size along each dimension of the input operands. It starts with the trailing dimensions, and works its way forward. Example: input1.dimension = {4, 1, 2} input2.dimension = {5, 4, 3, 1} output.dimension = {5, 4, 3, 2} Since NNAPI feature level 3, generic zero-sized input tensor is supported. Zero dimension is only compatible with 0 or 1. The size of the output dimension is zero if either of corresponding input dimension is zero. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) - [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) (since NNAPI feature level 4) <br /> Supported tensor rank: up to 4 Inputs: - 0: An n-D tensor, specifying the first input. - 1: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298), and compatible dimensions as input0. - 2: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, and has to be one of the [FuseCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ec620045a39909a6bf00b3ee0c4d414) values. Specifies the activation to invoke on the result. For a [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) tensor, the [FuseCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ec620045a39909a6bf00b3ee0c4d414) must be "NONE". <br /> Outputs: - 0: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) as input0. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scale and zeroPoint can be different from inputs' scale and zeroPoint. <br /> Available since NNAPI feature level 2. |
| `ANEURALNETWORKS_SVDF` | SVDF op is a kind of stateful layer derived from the notion that a densely connected layer that's processing a sequence of input frames can be approximated by using a singular value decomposition of each of its nodes. The implementation is based on: <https://research.google.com/pubs/archive/43813.pdf> P. Nakkiran, R. Alvarez, R. Prabhavalkar, C. Parada. "Compressing Deep Neural Networks using a Rank-Constrained Topology". INTERSPEECH, 2015. It processes the incoming input using a 2-stage filtering mechanism: - stage 1 performs filtering on the "features" dimension, whose outputs get pushed into a memory of fixed-size memory_size. - stage 2 performs filtering on the "time" dimension of the memory_size memoized outputs of stage 1. <br /> Specifically, for rank 1, this layer implements the operation: ``` memory = push(conv1d(inputs, weights_feature, feature_dim, "ANEURALNETWORKS_PADDING_VALID")); outputs = activation(memory * weights_time + bias); ``` <br /> Where: - "weights_feature" is a weights matrix that processes the inputs (by convolving the input with every "feature filter"), and whose outputs get pushed, stacked in order, into the fixed-size "memory" (the oldest entry gets dropped); - "weights_time" is a weights matrix that processes the "memory" (by a batched matrix multiplication on the num_units); - "bias" is an optional bias vector (added to each output vector in the batch); and - "activation" is the function passed as the "fused_activation_function" argument (if not "NONE"). <br /> Each rank adds a dimension to the weights matrices by means of stacking the filters. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) <br /> All input tensors must be the same type. Inputs: - 0: input. A 2-D tensor of shape \[batch_size, input_size\], where "batch_size" corresponds to the batching dimension, and "input_size" is the size of the input. - 1: weights_feature. A 2-D tensor of shape \[num_units, input_size\], where "num_units" corresponds to the number of units. - 2: weights_time. A 2-D tensor of shape \[num_units, memory_size\], where "memory_size" corresponds to the fixed-size of the memory. - 3: bias. An optional 1-D tensor of shape \[num_units\]. - 4: state (in). A 2-D tensor of shape \[batch_size, (memory_size - 1) \* num_units \* rank\]. - 5: rank. The rank of the SVD approximation. - 6: fused_activation_function. An optional [FuseCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ec620045a39909a6bf00b3ee0c4d414) value indicating the activation function. If "NONE" is specified then it results in a linear activation. <br /> Outputs: - 0: state (out). A 2-D tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) as the inputs, with shape \[batch_size, (memory_size - 1) \* num_units \* rank\]. - 1: output. A 2-D tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) as the inputs, with shape \[batch_size, num_units\]. <br /> Available since NNAPI feature level 1. |
| `ANEURALNETWORKS_TANH` | Computes hyperbolic tangent of input tensor element-wise. The output is calculated using this formula: ``` output = tanh(input) ``` <br /> Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: up to 4. Inputs: - 0: A tensor, specifying the input. Since NNAPI feature level 3, this tensor may be zero-sized. <br /> Outputs: - 0: The output tensor of same shape as input0. For [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3), the scale must be 1.f / 128 and the zeroPoint must be 128. For [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9), the scale must be 1.f / 128 and the zeroPoint must be 0. <br /> Available since NNAPI feature level 1. |
| `ANEURALNETWORKS_TILE` | Constructs a tensor by tiling a given tensor. This operation creates a new tensor by replicating `input``multiples` times. The output tensor's i-th dimension has `input.dims(i) * multiples[i]` elements, and the values of `input` are replicated `multiples[i]` times along the i-th dimension. For example, tiling `[a b c d]` by `[2]` produces `[a b c d a b c d]`. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: from 1 Inputs: - 0: input, an n-D tensor specifying the input. - 1: multiples, a 1-D tensor of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896). The length of multiples must be n. <br /> Outputs: - 0: A tiled tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) and rank as `input`. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scale and zeroPoint must be the same as input0. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_TOPK_V2` | Finds values and indices of the k largest entries for the last dimension. Resulting values in each dimensions are sorted in descending order. If two values are equal, the one with larger index appears first. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: from 1 Inputs: - 0: input, an n-D tensor specifying the input. - 1: k, an [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the number of top elements to look for along the last dimension. <br /> Outputs: - 0: An n-D tensor of the same type as the input, containing the k largest elements along each last dimensional slice. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scale and zeroPoint must be the same as input0. - 1: An n-D tensor of type [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) containing the indices of values within the last dimension of input. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_TRANSPOSE` | Transposes the input tensor, permuting the dimensions according to the perm tensor. The returned tensor's dimension i corresponds to the input dimension perm\[i\]. If perm is not given, it is set to (n-1...0), where n is the rank of the input tensor. Hence by default, this operation performs a regular matrix transpose on 2-D input Tensors. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) (since NNAPI feature level 3) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) - [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) (since NNAPI feature level 4) <br /> Supported tensor rank: up to 4 Inputs: - 0: An n-D tensor, specifying the tensor to be transposed. Since NNAPI feature level 3, this tensor may be zero-sized. - 1: An optional 1-D Tensor of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896), the permutation of the dimensions of the input tensor. <br /> Outputs: - 0: A tensor of the same [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) as input0. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scale and zeroPoint must be the same as input0. <br /> Available since NNAPI feature level 2. |
| `ANEURALNETWORKS_TRANSPOSE_CONV_2D` | Performs the transpose of 2-D convolution operation. This operation is sometimes called "deconvolution" after Deconvolutional Networks, but is actually the transpose (gradient) of [ANEURALNETWORKS_CONV_2D](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0a34a73b5eaf458b67db5eda71557d1d01) rather than an actual deconvolution. The output dimensions are functions of the filter dimensions, stride, and padding. Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) configurations: - 16 bit floating point: - \* [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) for input, filter, output, and bias. - 32 bit floating point: - \* [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) for input, filter, output, and bias. - Quantized: - \* [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) for input, filter, and output. - \* [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) for bias (with scale set to - \* input.scale \* filter.scale). - Quantized with symmetric per channel quantization for the filter: - \* [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) for input, and output. - \* [ANEURALNETWORKS_TENSOR_QUANT8_SYMM_PER_CHANNEL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a63c89cf7133314db885eae2abe0acc70) for filter. - \* [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) for bias (scale set to 0.0, - \* each value scaling is separate and equal to input.scale \* filter.scales\[channel\]). <br /> Available since NNAPI feature level 4: - Quantized signed (since NNAPI feature level 4): - \* [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) for input, filter, and output. - \* [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) for bias (with scale set to - \* input.scale \* filter.scale). - Quantized signed with filter symmetric per channel quantization (since NNAPI feature level 4): - \* [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) for input, and output. - \* [ANEURALNETWORKS_TENSOR_QUANT8_SYMM_PER_CHANNEL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a63c89cf7133314db885eae2abe0acc70) for filter. - \* [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) for bias (scale set to 0.0, - \* each value scaling is separate and equal to input.scale \* filter.scales\[channel\]). <br /> Supported tensor rank: 4, with "NHWC" or "NCHW" data layout. With the default data layout NHWC, the data is stored in the order of: \[batch, height, width, channels\]. Alternatively, the data layout could be NCHW, the data storage order of: \[batch, channels, height, width\]. Both explicit padding and implicit padding are supported. Inputs (explicit padding): - 0: A 4-D tensor, of shape \[batches, height, width, depth_in\], specifying the input. Since API level 29, zero batches is supported for this tensor. - 1: A 4-D tensor, of shape \[depth_out, filter_height, filter_width, depth_in\], specifying the filter. For tensor of type [ANEURALNETWORKS_TENSOR_QUANT8_SYMM_PER_CHANNEL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a63c89cf7133314db885eae2abe0acc70) the channel dimension ([ANeuralNetworksSymmPerChannelQuantParams::channelDim](https://developer.android.com/ndk/reference/struct/a-neural-networks-symm-per-channel-quant-params#struct_a_neural_networks_symm_per_channel_quant_params_1ac5b11412a315cf78a317586e27072ad0)) must be set to 0. - 2: A 1-D tensor, of shape \[depth_out\], specifying the bias. For input tensor of type [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) or [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c), the bias must be of the same type. For filter tensor of [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9), the bias should be of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896), with zeroPoint of 0 and bias_scale == input_scale \* filter_scale. For filter tensor of [ANEURALNETWORKS_TENSOR_QUANT8_SYMM_PER_CHANNEL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a63c89cf7133314db885eae2abe0acc70), the bias must be of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896), with zeroPoint of 0 and bias_scale of 0. The actual scale of each value 'i' is equal to bias_scale\[i\] = input_scale \* filter_scale\[i\]. - 3: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the padding on the left, in the 'width' dimension. - 4: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the padding on the right, in the 'width' dimension. - 5: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the padding on the top, in the 'height' dimension. - 6: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the padding on the bottom, in the 'height' dimension. - 7: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the stride when walking through input in the 'width' dimension. - 8: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the stride when walking through input in the 'height' dimension. - 9: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, and has to be one of the [FuseCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ec620045a39909a6bf00b3ee0c4d414) values. Specifies the activation to invoke on the result. - 10: An [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, set to true to specify NCHW data layout for input0 and output0. Set to false for NHWC. <br /> Inputs (implicit padding): - 0: A 4-D tensor, of shape \[batches, height, width, depth_in\], specifying the input. Since API level 29, zero batches is supported for this tensor. - 1: A 4-D tensor, of shape \[depth_out, filter_height, filter_width, depth_in\], specifying the filter. For tensor of type [ANEURALNETWORKS_TENSOR_QUANT8_SYMM_PER_CHANNEL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a63c89cf7133314db885eae2abe0acc70) the channel dimension ([ANeuralNetworksSymmPerChannelQuantParams::channelDim](https://developer.android.com/ndk/reference/struct/a-neural-networks-symm-per-channel-quant-params#struct_a_neural_networks_symm_per_channel_quant_params_1ac5b11412a315cf78a317586e27072ad0)) must be set to 0. - 2: A 1-D tensor, of shape \[depth_out\], specifying the bias. For input tensor of type [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) or [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c), the bias should be of the same type. For filter tensor of [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9), the bias should be of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896), with zeroPoint of 0 and bias_scale == input_scale \* filter_scale. For filter tensor of [ANEURALNETWORKS_TENSOR_QUANT8_SYMM_PER_CHANNEL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a63c89cf7133314db885eae2abe0acc70), the bias must be of [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896), with zeroPoint of 0 and bias_scale of 0. The actual scale of each value 'i' is equal to bias_scale\[i\] = input_scale \* filter_scale\[i\]. - 3: An [ANEURALNETWORKS_TENSOR_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ac34965d8e76ac5acfddf5acd9e40f896) tensor, specifying the output tensor shape. - 4: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the implicit padding scheme, has to be one of the [PaddingCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gab72e9e6263fd5b015bb7f41ec18ce220) values. - 5: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the stride when walking through input in the 'width' dimension. - 6: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, specifying the stride when walking through input in the 'height' dimension. - 7: An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar, and has to be one of the [FuseCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ec620045a39909a6bf00b3ee0c4d414) values. Specifies the activation to invoke on the result. - 8: An [ANEURALNETWORKS_BOOL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a7c2a31a0d79ceff65c551e4352515278) scalar, set to true to specify NCHW data layout for input0 and output0. Set to false for NHWC. <br /> Outputs: - 0: The output 4-D tensor, of shape \[batches, out_height, out_width, depth_out\]. For a [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a07984961d5c7c12f0f8c811bedd85dc3) and [ANEURALNETWORKS_TENSOR_QUANT8_ASYMM_SIGNED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0f7c57dd01611105bbdd17922dacbba9) tensor, the scale and zeroPoint can be different from inputs' scale and zeroPoint. <br /> Available since NNAPI feature level 3. |
| `ANEURALNETWORKS_UNIDIRECTIONAL_SEQUENCE_LSTM` | A recurrent neural network specified by an LSTM cell. Performs (fully) dynamic unrolling of input. This Op unrolls the input along the time dimension, and implements the following operation for each element in the sequence s = 1...sequence_length: outputs\[s\] = projection(state = activation(LSTMOp(inputs\[s\]))) Where LSTMOp is the LSTM op as in [ANEURALNETWORKS_LSTM](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0ad0377e8c305e596fb7f64ff896671fc5), the "projection" is an optional projection layer from state and output and the "activation" is the function passed as the "fused_activation_function" argument (if not "NONE"). Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) <br /> Supported tensor rank: 3, either time-major or batch-major. All input and output tensors must be of the same type. Inputs: - 0: The input ( $x_t$). A 3-D tensor of shape: If time-major: \[max_time, batch_size, input_size\] If batch-major: \[batch_size, max_time, input_size\] where "max_time" is the number of timesteps (sequence length), "batch_size" corresponds to the batching dimension, and "input_size" is the size of the input. - 1: The input-to-input weights ( $W_{xi}$). Optional. A 2-D tensor of shape \[num_units, input_size\], where "num_units" corresponds to the number of cell units. - 2: The input-to-forget weights ( $W_{xf}$). A 2-D tensor of shape \[num_units, input_size\]. - 3: The input-to-cell weights ( $W_{xc}$). A 2-D tensor of shape \[num_units, input_size\]. - 4: The input-to-output weights ( $W_{xo}$). A 2-D tensor of shape \[num_units, input_size\]. - 5: The recurrent-to-input weights ( $W_{hi}$). Optional. A 2-D tensor of shape \[num_units, output_size\], where "output_size" corresponds to either the number of cell units (i.e., "num_units"), or the second dimension of the "projection_weights", if defined. - 6: The recurrent-to-forget weights ( $W_{hf}$). A 2-D tensor of shape \[num_units, output_size\]. - 7: The recurrent-to-cell weights ( $W_{hc}$). A 2-D tensor of shape \[num_units, output_size\]. - 8: The recurrent-to-output weights ( $W_{ho}$). A 2-D tensor of shape \[num_units, output_size\]. - 9: The cell-to-input weights ( $W_{ci}$). Optional. A 1-D tensor of shape \[num_units\]. - 10:The cell-to-forget weights ( $W_{cf}$). Optional. A 1-D tensor of shape \[num_units\]. - 11:The cell-to-output weights ( $W_{co}$). Optional. A 1-D tensor of shape \[num_units\]. - 12:The input gate bias ( $b_i$). Optional. A 1-D tensor of shape \[num_units\]. - 13:The forget gate bias ( $b_f$). A 1-D tensor of shape \[num_units\]. - 14:The cell bias ( $b_c$). A 1-D tensor of shape \[num_units\]. - 15:The output gate bias ( $b_o$). A 1-D tensor of shape \[num_units\]. - 16:The projection weights ( $W_{proj}$). Optional. A 2-D tensor of shape \[output_size, num_units\]. - 17:The projection bias ( $b_{proj}$). Optional. A 1-D tensor of shape \[output_size\]. - 18:The output state (in) ( $h_{t-1}$). A 2-D tensor of shape \[batch_size, output_size\]. - 19:The cell state (in) ( $C_{t-1}$). A 2-D tensor of shape \[batch_size, num_units\]. - 20:The activation function ( $g$). A value indicating the activation function: - 0: None; - 1: Relu; - 3: Relu6; - 4: Tanh; - 6: Sigmoid. - 21:The clipping threshold ( $t_{cell}$) for the cell state, such that values are bound within \[-cell_clip, cell_clip\]. If set to 0.0 then clipping is disabled. - 22:The clipping threshold ( $t_{proj}$) for the output from the projection layer, such that values are bound within \[-proj_clip, proj_clip\]. If set to 0.0 then clipping is disabled. - 23:Time-major if true, batch-major if false. - 24:The input layer normalization weights. Optional. A 1-D tensor of shape \[num_units\]. Used to rescale normalized inputs to activation at input gate. - 25:The forget layer normalization weights. Optional. A 1-D tensor of shape \[num_units\]. Used to rescale normalized inputs to activation at forget gate. - 26:The cell layer normalization weights. Optional. A 1-D tensor of shape \[num_units\]. Used to rescale normalized inputs to activation at cell gate. - 27:The output layer normalization weights. Optional. A 1-D tensor of shape \[num_units\]. Used to rescale normalized inputs to activation at output gate. <br /> Outputs: - 0: The output ( $o_t$). A 3-D tensor of shape: If time-major: \[max_time, batch_size, output_size\] If batch-major: \[batch_size, max_time, output_size\] - 1: A tensor of shape \[batch_size, output_size\] containing a hidden state from the last time step in the sequence. This output is optional and can be omitted. If this output is present then output #2 must be present as well. Available since NNAPI feature level 4. - 2: A tensor of shape \[batch_size, cell_size\] containing a cell state from the last time step in the sequence. This output is optional and can be omitted. Available since NNAPI feature level 4. <br /> Available since NNAPI feature level 3. Important: As of NNAPI feature level 3, there is no way to get the output state tensors out and NNAPI does not maintain internal states. This operator does not support the usage pattern in which multiple cells are chained and state tensors are propagated. |
| `ANEURALNETWORKS_UNIDIRECTIONAL_SEQUENCE_RNN` | A recurrent neural network layer that applies a basic RNN cell to a sequence of inputs. This layer unrolls the input along the sequence dimension, and implements the following operation for each element in the sequence s = 1...sequence_length: outputs\[s\] = state = activation(inputs\[s\] \* input_weights' + state \* recurrent_weights' + bias) Where: - "input_weights" is a weight matrix that multiplies the inputs; - "recurrent_weights" is a weight matrix that multiplies the current "state" which itself is the output from the previous time step computation; - "bias" is a bias vector (added to each output vector in the batch); - "activation" is the function passed as the "fused_activation_function" argument (if not "NONE"). <br /> Supported tensor [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298): - [ANEURALNETWORKS_TENSOR_FLOAT16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a0b321966e8b58d48f116abc60af5f63c) - [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) <br /> The input tensors must all be the same type. Inputs: - 0: input. A 3-D tensor. The shape is defined by the input 6 (timeMajor). If it is set to 1, then the input has a shape \[maxTime, batchSize, inputSize\], otherwise the input has a shape \[batchSize, maxTime, inputSize\]. - 1: weights. A 2-D tensor of shape \[numUnits, inputSize\]. - 2: recurrent_weights. A 2-D tensor of shape \[numUnits, numUnits\]. - 3: bias. A 1-D tensor of shape \[numUnits\]. - 4: hidden state A 2-D tensor of shape \[batchSize, numUnits\]. Specifies a hidden state input for the first time step of the computation. - 5: fusedActivationFunction. A [FuseCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ec620045a39909a6bf00b3ee0c4d414) value indicating the activation function. If "NONE" is specified then it results in a linear activation. - 6: timeMajor An [ANEURALNETWORKS_INT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298acb165f692e9d189c820ceba84b3c21dc) scalar specifying the shape format of input and output tensors. Must be set to either 0 or 1. Outputs: - 0: output. A 3-D tensor. The shape is defined by the input 6 (timeMajor). If it is set to 1, then the output has a shape \[maxTime, batchSize, numUnits\], otherwise the output has a shape \[batchSize, maxTime, numUnits\]. - 1: A tensor of shape \[batchSize, numUnits\] containing hidden state from the last time step in the sequence. This output is optional and can be omitted. Available since NNAPI feature level 4. <br /> Available since NNAPI feature level 3. Important: As of NNAPI feature level 3, there is no way to get the output state tensors out and NNAPI does not maintain internal states. This operator does not support the usage pattern in which multiple cells are chained and state tensors are propagated. |
| `ANEURALNETWORKS_WHILE` | Executes the body model until the condition model outputs false. The inputs to this operation are the condition model, the body model, and operand values for the first iteration of the loop. The values are implicitly split into three groups of input-output, state-only, and input-only values, as described below. The outputs of this operation are the final values of input-output operands. Both the condition and body model receive (m + k + n) inputs. - The first m (m \>= 1) inputs are input-output operands. For the first iteration, these are initialized from the corresponding inputs of the WHILE operation. In subsequent iterations, their values come from the corresponding outputs of the body model produced during the previous iteration. - The next k (k \>= 0) inputs are state-only operands. They are similar to the input-output operands, except that their values are no longer available after the loop terminates. - The last n (n \>= 0) inputs are input-only operands. Their values come from the corresponding inputs of the WHILE operation. <br /> The body model produces (m + k) outputs. - The first m outputs are input-output operands. They become the outputs of the WHILE operation when a termination condition is reached. - The last k outputs are state-only operands. Their values are no longer available after the loop terminates. <br /> The numbers m, k, and n are inferred by the runtime as follows: m = (WHILE operation output count) k = (body model output count) - m n = (body model input count) - m - k The pseudo-code below illustrates the flow of a WHILE operation with inputs condition, body, initial_input_output, initial_state, input_only (m = 1, k = 1, n = 1): ``` input_output = initial_input_output state = initial_state while condition(input_output, state, input_only): input_output, state = body(input_output, state, input_only) return input_output ``` <br /> To prevent infinite loops, there is an implicit execution timeout associated with each loop ("loop timeout duration"). See [ANeuralNetworksExecution_setLoopTimeout](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga91a8096a35988e1e5a15d4aa0e9e6a8d). Inputs: - 0: A [ANEURALNETWORKS_MODEL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a66055118088cbd1d1d17dcbcd2c47ed5) reference to the condition model. The model must have (m + k + n) inputs with the same types, ranks (if specified), dimensions (if specified), scales, zeroPoints, and other operand parameters as the corresponding inputs of the WHILE operation and exactly one output of [ANEURALNETWORKS_TENSOR_BOOL8](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298ab275c740307fbffcfec94adcc7b374b9) and shape \[1\]. The output operand must have fully specified dimensions. - 1: A [ANEURALNETWORKS_MODEL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a66055118088cbd1d1d17dcbcd2c47ed5) reference to the body model. The model must have (m + k + n) inputs and (m + k) outputs with the same types, ranks (if specified), dimensions (if specified), scales, zeroPoints, and other operand parameters as the corresponding inputs and outputs of the WHILE operation. - (m inputs): Initial values for input-output operands. - (k inputs): Initial values for state-only operands. - (n inputs): Values for input-only operands. <br /> Outputs: - 0 \~ (m - 1): Outputs produced by the loop. <br /> Available since NNAPI feature level 4. |

### PaddingCode

Declared in `android/NeuralNetworksTypes.h`

```
 PaddingCode
```
Implicit padding algorithms.

Available since NNAPI feature level 1.

| Properties ||
|---|---|
| `ANEURALNETWORKS_PADDING_SAME` | SAME padding. Padding on both ends are the "same": padding_to_beginning = total_padding / 2 padding_to_end = (total_padding + 1)/2. i.e., for even number of padding, padding to both ends are exactly the same; for odd number of padding, padding to the ending is bigger than the padding to the beginning by 1. total_padding is a function of input, stride, dilation and filter size. It could be computed as follows: out_size = (input + stride - 1) / stride effective_filter_size = (filter_size - 1) \* dilation + 1 needed_input = (out_size - 1) \* stride + effective_filter_size total_padding = max(0, needed_input - input_size) The computation is the same for the horizontal and vertical directions. |
| `ANEURALNETWORKS_PADDING_VALID` | VALID padding. No padding. When the input size is not evenly divisible by the filter size, the input at the end that could not fill the whole filter tile will simply be ignored. |

### PreferenceCode

Declared in `android/NeuralNetworksTypes.h`

```
 PreferenceCode
```
Execution preferences.

Available since NNAPI feature level 1.

| Properties ||
|---|---|
| `ANEURALNETWORKS_PREFER_FAST_SINGLE_ANSWER` | Prefer returning a single answer as fast as possible, even if this causes more power consumption. |
| `ANEURALNETWORKS_PREFER_LOW_POWER` | Prefer executing in a way that minimizes battery drain. This is desirable for compilations that will be executed often. |
| `ANEURALNETWORKS_PREFER_SUSTAINED_SPEED` | Prefer maximizing the throughput of successive frames, for example when processing successive frames coming from the camera. |

### PriorityCode

Declared in `android/NeuralNetworksTypes.h`

```
 PriorityCode
```
Relative execution priority.

Available since NNAPI feature level 4.

| Properties ||
|---|---|
| `ANEURALNETWORKS_PRIORITY_DEFAULT` |   |
| `ANEURALNETWORKS_PRIORITY_HIGH` |   |
| `ANEURALNETWORKS_PRIORITY_LOW` |   |
| `ANEURALNETWORKS_PRIORITY_MEDIUM` |   |

### ResultCode

Declared in `android/NeuralNetworksTypes.h`

```
 ResultCode
```
Result codes.

Any NNAPI function can return any result code, including result codes not currently documented. Any value other than [ANEURALNETWORKS_NO_ERROR](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggad8097859ab1bdd06be52a8421df152d4a3d43394f34347d3a8de3c98dbd8a0365) indicates a failure of some kind.

Additional information about the nature of a failure can be obtained from the device log after enabling NNAPI debugging by setting the debug.nn.vlog property to 1, e.g., by calling "adb shell setprop debug.nn.vlog 1".

Available since NNAPI feature level 1.

| Properties ||
|---|---|
| `ANEURALNETWORKS_BAD_DATA` | Failure caused by invalid function arguments, invalid model definition, invalid execution definition or invalid data at execution time. |
| `ANEURALNETWORKS_BAD_STATE` | Failure caused by object being in the wrong state. |
| `ANEURALNETWORKS_DEAD_OBJECT` | Failure indicating an object is in a dead state. Available since NNAPI feature level 4. |
| `ANEURALNETWORKS_INCOMPLETE` |   |
| `ANEURALNETWORKS_MISSED_DEADLINE_PERSISTENT` | Failure because a deadline could not be met for a task, and future deadlines will likely also not be met for the same task even after a short delay. Available since NNAPI feature level 4. |
| `ANEURALNETWORKS_MISSED_DEADLINE_TRANSIENT` | Failure because a deadline could not be met for a task, but future deadlines may still be met for the same task after a short delay. Available since NNAPI feature level 4. |
| `ANEURALNETWORKS_NO_ERROR` | Operation was successful. |
| `ANEURALNETWORKS_OP_FAILED` | Failure caused by failed model execution. |
| `ANEURALNETWORKS_OUTPUT_INSUFFICIENT_SIZE` | Failure caused by insufficient buffer size provided to a model output. |
| `ANEURALNETWORKS_OUT_OF_MEMORY` | Failure caused by not enough available memory. |
| `ANEURALNETWORKS_RESOURCE_EXHAUSTED_PERSISTENT` | Failure because of a resource limitation within the driver, and future calls for the same task will likely also fail even after a short delay. Available since NNAPI feature level 4. |
| `ANEURALNETWORKS_RESOURCE_EXHAUSTED_TRANSIENT` | Failure because of a resource limitation within the driver, but future calls for the same task may still succeed after a short delay. Available since NNAPI feature level 4. |
| `ANEURALNETWORKS_UNAVAILABLE_DEVICE` | Failure caused by a device not being available. |
| `ANEURALNETWORKS_UNEXPECTED_NULL` | Failure caused by unexpected null argument. |
| `ANEURALNETWORKS_UNMAPPABLE` | Failure caused by not being able to map a file into memory. This may be caused by a file descriptor not being mappable, or an AHardwareBuffer not supported by the device. Mitigate by reading its content into memory. |

## Typedefs

### ANeuralNetworksBurst

Declared in `android/NeuralNetworksTypes.h`

```
struct ANeuralNetworksBurst ANeuralNetworksBurst
```
ANeuralNetworksBurst is an opaque type that can be used to reduce the latency of a rapid sequence of executions.

It will likely cause overhead if only used for a single execution.

ANeuralNetworksBurst serves as a context object for any number of inferences using [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) objects. An ANeuralNetworksBurst object and the [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) objects used with it must all have been created from the same [ANeuralNetworksCompilation](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6) object.

This object is also used as a hint to drivers, providing insight to the lifetime of a rapid sequence of executions. For example, a driver may choose to increase the clock frequency of its accelerator for the lifetime of a burst object.

To use:

- Create a new burst object by calling the [ANeuralNetworksBurst_create](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga8837b557b05c7b6e03349fe2c6dbe72f) function.
- For each execution:
  - Create [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) and configure its properties (see [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) for details).
  - Apply the model synchronously with [ANeuralNetworksExecution_burstCompute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gae4f4b99ab910a2397bf1b857c11f7206), reusing the same [ANeuralNetworksBurst](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5548a531e2a408cbe9c36fad1530118f) with the new [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b).
  - Use and free the [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b).
- Destroy the burst with [ANeuralNetworksBurst_free](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaff2fa353d8137ba6ee332f5a86b7f7ce).

<br />

Available since NNAPI feature level 3.

### ANeuralNetworksCompilation

Declared in `android/NeuralNetworksTypes.h`

```
struct ANeuralNetworksCompilation ANeuralNetworksCompilation
```
ANeuralNetworksCompilation is an opaque type that can be used to compile a machine learning model.

To use:

- Create a new compilation instance by calling the [ANeuralNetworksCompilation_create](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaa859b1859f1418a7dc739ba7bb5291e8) function or [ANeuralNetworksCompilation_createForDevices](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga3ef5683b170614a689b6e2e7df78aefd).
- Set any desired properties on the compilation (for example, [ANeuralNetworksCompilation_setPreference](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gae8e5b5b5441eea6113e8a08da5cf5d87)).
- Optionally, set the caching signature and the cache directory on the compilation by calling [ANeuralNetworksCompilation_setCaching](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga825b1b36f8e22aed5e97c8e6d46a844e).
- Complete the compilation with [ANeuralNetworksCompilation_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9ce8960a4c74b9b98878b1798250abde).
- Use the compilation as many times as needed with [ANeuralNetworksExecution_create](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga436633d3e8c4ebf6e3c44778799ca6b4) and [ANeuralNetworksBurst_create](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga8837b557b05c7b6e03349fe2c6dbe72f).
- Destroy the compilation with [ANeuralNetworksCompilation_free](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga8cfcb96d9dd55cd19022b8c98546cda7) once all executions using the compilation have completed.

<br />

A compilation is completed by calling [ANeuralNetworksCompilation_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9ce8960a4c74b9b98878b1798250abde). A compilation is destroyed by calling [ANeuralNetworksCompilation_free](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga8cfcb96d9dd55cd19022b8c98546cda7).

A compilation cannot be modified once [ANeuralNetworksCompilation_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9ce8960a4c74b9b98878b1798250abde) has been called on it.

It is the application's responsibility to make sure that only one thread modifies a compilation at a given time. It is however safe for more than one thread to use the compilation once [ANeuralNetworksCompilation_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9ce8960a4c74b9b98878b1798250abde) has returned.

It is also the application's responsibility to ensure that there are no other uses of the compilation after calling [ANeuralNetworksCompilation_free](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga8cfcb96d9dd55cd19022b8c98546cda7). This includes any execution object or burst object created using the compilation, or any memory descriptor with the compilation as part of one of the roles specified by [ANeuralNetworksMemoryDesc_addInputRole](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga3275184f420acc65e5080df7a308f9b7) or [ANeuralNetworksMemoryDesc_addOutputRole](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga26c6391eb75bb83d14702d80fc4f6c41).

Available since NNAPI feature level 1.

### ANeuralNetworksDevice

Declared in `android/NeuralNetworksTypes.h`

```
struct ANeuralNetworksDevice ANeuralNetworksDevice
```
ANeuralNetworksDevice is an opaque type that represents a device.

This type is used to query basic properties and supported operations of the corresponding device, and control which device(s) a model is to be run on.

Available since NNAPI feature level 3.

### ANeuralNetworksEvent

Declared in `android/NeuralNetworksTypes.h`

```
struct ANeuralNetworksEvent ANeuralNetworksEvent
```
ANeuralNetworksEvent is an opaque type that represents an event that will be signaled once an execution completes.

Available since NNAPI feature level 1.

### ANeuralNetworksExecution

Declared in `android/NeuralNetworksTypes.h`

```
struct ANeuralNetworksExecution ANeuralNetworksExecution
```
ANeuralNetworksExecution is an opaque type that can be used to apply a machine learning model to a set of inputs.

To use:

- Create a new execution instance by calling the [ANeuralNetworksExecution_create](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga436633d3e8c4ebf6e3c44778799ca6b4) function.
- Associate input buffers or memory regions to the model inputs with [ANeuralNetworksExecution_setInput](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gac67f2c8f1ea2136d57bc871da2e6982f) or [ANeuralNetworksExecution_setInputFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga33a63f2ee1b1b17304f76ef8376af224).
- Associate output buffers or memory regions to the model outputs with [ANeuralNetworksExecution_setOutput](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga7c25ad87c553d207efb257d09e62801e) or [ANeuralNetworksExecution_setOutputFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gafcd74c997781e196e081f19108e2c441).
- Optionally, configure the execution with [ANeuralNetworksExecution_setLoopTimeout](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga91a8096a35988e1e5a15d4aa0e9e6a8d), [ANeuralNetworksExecution_setMeasureTiming](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga09e518f7facf0da023bfa13405439301), [ANeuralNetworksExecution_setReusable](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaa4d2abe06303d6728e4864d8f07c1a3a), or [ANeuralNetworksExecution_setTimeout](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gab5896a441a236c08b99fcb7a4d02fe83).
- Apply the model with one of the following:
  - Asynchronously with [ANeuralNetworksExecution_startCompute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5d5dc6f589d19221892c3ccb7b622e33) or with [ANeuralNetworksExecution_startComputeWithDependencies](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga371f25c6c44c05f8d267bb6f27ceeb3a), waiting for the execution to complete with [ANeuralNetworksEvent_wait](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9505d7f3b59a0e089d4ce67f293addfa).
  - Synchronously with [ANeuralNetworksExecution_compute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga52bfde74591c81eae1ff010199f4a2e2).
  - Synchronously as part of an execution burst with [ANeuralNetworksExecution_burstCompute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gae4f4b99ab910a2397bf1b857c11f7206).
  If the execution has been marked as reusable, then you can apply the model more than once.
- Destroy the execution with [ANeuralNetworksExecution_free](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga6e72eaa3a6fb96be9f5ac7f5df4ed7ea).

<br />

An output buffer or memory region must not overlap with any other output buffer or memory region, with an input buffer or memory region, or with an operand value in a memory object ([ANeuralNetworksModel_setOperandValueFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga0a1bcce272ba5ddfaa3c06a53ac7a6ec)).

An execution is in the preparation state after it is created by [ANeuralNetworksExecution_create](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga436633d3e8c4ebf6e3c44778799ca6b4). An execution may only be modified in the preparation state. Scheduling a computation by calling [ANeuralNetworksExecution_burstCompute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gae4f4b99ab910a2397bf1b857c11f7206), [ANeuralNetworksExecution_compute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga52bfde74591c81eae1ff010199f4a2e2), [ANeuralNetworksExecution_startCompute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5d5dc6f589d19221892c3ccb7b622e33), or [ANeuralNetworksExecution_startComputeWithDependencies](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga371f25c6c44c05f8d267bb6f27ceeb3a) will change the state of the execution object to the computation state. When the computation completes, the state of the execution object will change from the computation state to the completed state. The computation is completed when [ANeuralNetworksExecution_compute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga52bfde74591c81eae1ff010199f4a2e2), [ANeuralNetworksExecution_burstCompute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gae4f4b99ab910a2397bf1b857c11f7206), or [ANeuralNetworksEvent_wait](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9505d7f3b59a0e089d4ce67f293addfa) has returned.

An execution can be applied to a model with [ANeuralNetworksExecution_burstCompute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gae4f4b99ab910a2397bf1b857c11f7206), [ANeuralNetworksExecution_compute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga52bfde74591c81eae1ff010199f4a2e2), [ANeuralNetworksExecution_startCompute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5d5dc6f589d19221892c3ccb7b622e33) or [ANeuralNetworksExecution_startComputeWithDependencies](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga371f25c6c44c05f8d267bb6f27ceeb3a) only once. Create new executions to do new evaluations of the model.

Starting at NNAPI feature level 5, the application may call [ANeuralNetworksExecution_setReusable](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaa4d2abe06303d6728e4864d8f07c1a3a) to set an execution to be reusable for multiple computations. The application may schedule and evaluate a computation again from the completed state of a reusable execution. The execution cannot be modified between computations.

It is the application's responsibility to make sure that only one thread modifies an execution at a given time. It is however safe for more than one thread to use [ANeuralNetworksEvent_wait](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9505d7f3b59a0e089d4ce67f293addfa) at the same time.

It is also the application's responsibility to ensure that the execution either has never been scheduled or has completed (i.e., that [ANeuralNetworksExecution_burstCompute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gae4f4b99ab910a2397bf1b857c11f7206), [ANeuralNetworksExecution_compute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga52bfde74591c81eae1ff010199f4a2e2), or [ANeuralNetworksEvent_wait](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9505d7f3b59a0e089d4ce67f293addfa) has returned) before calling [ANeuralNetworksExecution_free](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga6e72eaa3a6fb96be9f5ac7f5df4ed7ea).

.

It is also the application's responsibility to ensure that there are no other uses of the execution after calling [ANeuralNetworksExecution_free](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga6e72eaa3a6fb96be9f5ac7f5df4ed7ea).

It is the application's responsibility to ensure that there are no concurrent computations scheduled and evaluated on the same execution, either by means of [ANeuralNetworksExecution_compute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga52bfde74591c81eae1ff010199f4a2e2) or [ANeuralNetworksExecution_burstCompute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gae4f4b99ab910a2397bf1b857c11f7206) (which are synchronous) in different threads, or by means of [ANeuralNetworksExecution_startCompute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5d5dc6f589d19221892c3ccb7b622e33) or [ANeuralNetworksExecution_startComputeWithDependencies](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga371f25c6c44c05f8d267bb6f27ceeb3a) (which are asynchronous). It is however safe to schedule and evaluate multiple computations on different executions concurrently. (Concurrent uses of [ANeuralNetworksExecution_burstCompute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gae4f4b99ab910a2397bf1b857c11f7206) must be on different burst objects.) The runtime makes no guarantee on the ordering of completion of executions. If it's important to the application, the application should enforce the ordering by ensuring that one execution completes before the next is scheduled (for example, by scheduling all executions synchronously within a single thread, or by scheduling all executions asynchronously and using [ANeuralNetworksEvent_wait](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9505d7f3b59a0e089d4ce67f293addfa) between calls to [ANeuralNetworksExecution_startCompute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5d5dc6f589d19221892c3ccb7b622e33)); or by using [ANeuralNetworksExecution_startComputeWithDependencies](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga371f25c6c44c05f8d267bb6f27ceeb3a) to make the execution wait for a list of events to be signaled before starting the actual evaluation.

Available since NNAPI feature level 1.

### ANeuralNetworksMemory

Declared in `android/NeuralNetworksTypes.h`

```
struct ANeuralNetworksMemory ANeuralNetworksMemory
```
ANeuralNetworksMemory is an opaque type that represents memory.

This type is used to represent shared memory, memory mapped files, and similar memories.

By using shared memory, a program can efficiently communicate to the runtime and drivers the tensors that define a model. See [ANeuralNetworksModel_setOperandValueFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga0a1bcce272ba5ddfaa3c06a53ac7a6ec). An application should typically create one shared memory object that contains every constant tensor needed to define a model. [ANeuralNetworksMemory_createFromFd](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga3a37c44f90bb727dc9eda5f65bb9aa68) can be used to create shared memory from a file handle. [ANeuralNetworksMemory_createFromAHardwareBuffer](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga75725b8ddd87e837937a576183fe6cd4) can be used to create shared memory from an AHardwareBuffer handle.

Memory objects can also be used to specify the input and output arguments of an execution. See [ANeuralNetworksExecution_setInputFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga33a63f2ee1b1b17304f76ef8376af224) and [ANeuralNetworksExecution_setOutputFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gafcd74c997781e196e081f19108e2c441).

When calling [ANeuralNetworksModel_setOperandValueFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga0a1bcce272ba5ddfaa3c06a53ac7a6ec), [ANeuralNetworksExecution_setInputFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga33a63f2ee1b1b17304f76ef8376af224) and [ANeuralNetworksExecution_setOutputFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gafcd74c997781e196e081f19108e2c441), each operand in the shared memory object must be aligned on a boundary of a byte size that is a multiple of the element type byte size, e.g., a tensor with [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) type must be aligned on 4-byte boundary.

It is the application's responsibility to ensure that there are no uses of the memory after calling [ANeuralNetworksMemory_free](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga8db9e0fed5e913a58320fc964288ba70). This includes any model which references this memory because of a call to [ANeuralNetworksModel_setOperandValueFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga0a1bcce272ba5ddfaa3c06a53ac7a6ec), any compilation created using such a model, any execution object or burst object created using such a compilation, or any execution which references this memory because of a call to [ANeuralNetworksExecution_setInputFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga33a63f2ee1b1b17304f76ef8376af224) or [ANeuralNetworksExecution_setOutputFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gafcd74c997781e196e081f19108e2c441).

Available since NNAPI feature level 1.

Starting at NNAPI feature level 4, the application may request creation of device native memory from [ANeuralNetworksMemoryDesc](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga92661bd0904009e8d0c9e8e1bf40bd84) to avoid potential memory copying and transformation overhead between executions. See also [ANeuralNetworksMemoryDesc](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga92661bd0904009e8d0c9e8e1bf40bd84) and [ANeuralNetworksMemory_createFromDesc](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga75511166bfbf29fb97a63548de8135bc).

### ANeuralNetworksMemoryDesc

Declared in `android/NeuralNetworksTypes.h`

```
struct ANeuralNetworksMemoryDesc ANeuralNetworksMemoryDesc
```
ANeuralNetworksMemoryDesc is an opaque type that represents a memory descriptor.

A memory descriptor describes the properties of a memory object, and is used by [ANeuralNetworksMemory_createFromDesc](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga75511166bfbf29fb97a63548de8135bc).

To use:

- Create a new memory descriptor by calling [ANeuralNetworksMemoryDesc_create](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gab0bffa683c1d1adbc5fa094e68304ee2).
- Specify all of the intended input and output roles by calling [ANeuralNetworksMemoryDesc_addInputRole](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga3275184f420acc65e5080df7a308f9b7) and [ANeuralNetworksMemoryDesc_addOutputRole](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga26c6391eb75bb83d14702d80fc4f6c41).
- Optionally, specify the memory dimensions by calling [ANeuralNetworksMemoryDesc_setDimensions](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gac259bcb123a0ea9f868f6aef6b2269c4).
- Complete the memory descriptor with [ANeuralNetworksMemoryDesc_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5e0c5b7ee674a6e3a011be7957986ec8).
- Use the memory descriptor as many times as needed with [ANeuralNetworksMemory_createFromDesc](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga75511166bfbf29fb97a63548de8135bc).
- Destroy the memory descriptor with [ANeuralNetworksMemoryDesc_free](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga010bf0653a9c55f549806c1065636827).

<br />

A memory descriptor is completed by calling [ANeuralNetworksMemoryDesc_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5e0c5b7ee674a6e3a011be7957986ec8). A memory descriptor is destroyed by calling [ANeuralNetworksMemoryDesc_free](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga010bf0653a9c55f549806c1065636827).

A memory descriptor must not be modified once [ANeuralNetworksMemoryDesc_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5e0c5b7ee674a6e3a011be7957986ec8) has been called on it.

It is the application's responsibility to make sure that only one thread modifies a memory descriptor at a given time. It is however safe for more than one thread to use the memory descriptor once [ANeuralNetworksMemoryDesc_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5e0c5b7ee674a6e3a011be7957986ec8) has returned.

It is also the application's responsibility to ensure that there are no other uses of the memory descriptor after calling [ANeuralNetworksMemoryDesc_free](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga010bf0653a9c55f549806c1065636827). It is however safe to continue using a [ANeuralNetworksMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9a6b7719f0613ba9e2c93cffd97ebfc0) object created from the memory descriptor.

Available since NNAPI feature level 4.

### ANeuralNetworksModel

Declared in `android/NeuralNetworksTypes.h`

```
struct ANeuralNetworksModel ANeuralNetworksModel
```
ANeuralNetworksModel is an opaque type that contains a description of the mathematical operations that constitute the model.

Build the model by calling

- [ANeuralNetworksModel_create](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gadefc0c036914549f104237dd88676488)
- [ANeuralNetworksModel_addOperation](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga21fea9a299a4c1437cf1d280436b5381)
- [ANeuralNetworksModel_addOperand](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gabe3ab450ff498af8b3b4b88d5e256a36)

<br />

This forms a graph in which each operation and operand is a node, a directed edge from an operand to an operation indicates that the operand is an input to the operation, and a directed edge from an operation to an operand indicates that the operand is an output from the operation. This graph must be acyclic.

A model is completed by calling [ANeuralNetworksModel_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga74e521efc13d3eba79b8b779b306b53e). A model is destroyed by calling [ANeuralNetworksModel_free](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gae124cb448669f2713497107dfa4a563c).

A model cannot be modified once [ANeuralNetworksModel_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga74e521efc13d3eba79b8b779b306b53e) has been called on it.

It is the application's responsibility to make sure that only one thread modifies a model at a given time. It is however safe for more than one thread to use the model once [ANeuralNetworksModel_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga74e521efc13d3eba79b8b779b306b53e) has returned.

It is also the application's responsibility to ensure that there are no other uses of the model after calling [ANeuralNetworksModel_free](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gae124cb448669f2713497107dfa4a563c). This includes any compilation, execution object or burst object created using the model.

Available since NNAPI feature level 1.

### ANeuralNetworksOperandType

Declared in `android/NeuralNetworksTypes.h`

```
struct ANeuralNetworksOperandType ANeuralNetworksOperandType
```
[ANeuralNetworksOperandType](https://developer.android.com/ndk/reference/struct/a-neural-networks-operand-type#struct_a_neural_networks_operand_type) describes the type of an operand.

This structure is used to describe both scalars and tensors.

A tensor operand type with all dimensions specified is "fully
specified". Whenever possible (i.e., whenever the dimensions are known at model construction time), a tensor operand type should be (but is not required to be) fully specified, in order to enable the best possible performance.

If a tensor operand's type is not fully specified, the dimensions of the operand are deduced from the operand types and values of the operation for which that operand is an output or from the corresponding [ANEURALNETWORKS_IF](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0ad9eb50679d1077710a6a4b3eb5207218) or [ANEURALNETWORKS_WHILE](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0afdc0927832c42f93845fd9a2361b35f9) operation input operand type in the case of referenced model input operands.

In the following situations, a tensor operand type must be fully specified:

- The operand has a constant value, set by [ANeuralNetworksModel_setOperandValue](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga92fd1d7bdf40364620d72fdaaca991f3) (with a non-nullptr buffer) or [ANeuralNetworksModel_setOperandValueFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga0a1bcce272ba5ddfaa3c06a53ac7a6ec).
- The operand is a model input (see [ANeuralNetworksModel_identifyInputsAndOutputs](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gacef56268ac6e5e80fa0b4714f57772ce)) of the main model within a compilation. A fully specified tensor operand type must either be provided to [ANeuralNetworksModel_addOperand](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gabe3ab450ff498af8b3b4b88d5e256a36); or it must be provided to the corresponding [ANeuralNetworksExecution_setInput](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gac67f2c8f1ea2136d57bc871da2e6982f), or [ANeuralNetworksExecution_setInputFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga33a63f2ee1b1b17304f76ef8376af224). EXCEPTION: If the input is optional and omitted (by passing nullptr for buffer to [ANeuralNetworksExecution_setInput](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gac67f2c8f1ea2136d57bc871da2e6982f)) then it need not have a fully specified tensor operand type.
- The operand is a model output (see [ANeuralNetworksModel_identifyInputsAndOutputs](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gacef56268ac6e5e80fa0b4714f57772ce)) of the main model within a compilation and is to be used with [ANeuralNetworksExecution_startComputeWithDependencies](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga371f25c6c44c05f8d267bb6f27ceeb3a). A fully specified tensor operand type must either be provided to [ANeuralNetworksModel_addOperand](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gabe3ab450ff498af8b3b4b88d5e256a36); or it must be provided to the corresponding [ANeuralNetworksExecution_setOutput](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga7c25ad87c553d207efb257d09e62801e), or [ANeuralNetworksExecution_setOutputFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gafcd74c997781e196e081f19108e2c441).

<br />

A tensor operand type of specified rank but some number of unspecified dimensions is represented by setting dimensionCount to the rank and each unspecified dimension to 0.

Available since NNAPI feature level 1.

Starting at NNAPI feature level 3, a tensor operand type of unspecified rank is represented by setting dimensionCount to 0 and dimensions to NULL (just as if it were a scalar operand type).

### ANeuralNetworksOperationType

Declared in `android/NeuralNetworksTypes.h`

```
int32_t ANeuralNetworksOperationType
```
Aliasing to [OperationCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaabbe492c60331b13038e39d4207940e0), used in function [ANeuralNetworksModel_addOperation](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga21fea9a299a4c1437cf1d280436b5381).

### ANeuralNetworksSymmPerChannelQuantParams

Declared in `android/NeuralNetworksTypes.h`

```
struct ANeuralNetworksSymmPerChannelQuantParams ANeuralNetworksSymmPerChannelQuantParams
```
Parameters for ANEURALNETWORKS_TENSOR_QUANT8_SYMM_PER_CHANNEL operand.

## Functions

### ANeuralNetworksBurst_create

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksBurst_create(
  ANeuralNetworksCompilation *compilation,
  https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5548a531e2a408cbe9c36fad1530118f **burst
)
```
Create a [ANeuralNetworksBurst](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5548a531e2a408cbe9c36fad1530118f) to apply the given compilation.

This only creates the burst object. Computation is only performed once [ANeuralNetworksExecution_burstCompute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gae4f4b99ab910a2397bf1b857c11f7206) is invoked with a valid [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) and [ANeuralNetworksBurst](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5548a531e2a408cbe9c36fad1530118f).

The provided compilation must outlive the burst object.

Available since NNAPI feature level 3.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `compilation` | The [ANeuralNetworksCompilation](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6) to be evaluated. | | `burst` | The newly created object or NULL if unsuccessful. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful, ANEURALNETWORKS_BAD_DATA if the compilation is invalid. |

### ANeuralNetworksBurst_free

Declared in `android/NeuralNetworks.h`

```
void ANeuralNetworksBurst_free(
  ANeuralNetworksBurst *burst
)
```
Destroys the burst object.

Available since NNAPI feature level 3.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `burst` | The burst object to be destroyed. Passing NULL is acceptable and results in no operation. | |

### ANeuralNetworksCompilation_create

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksCompilation_create(
  ANeuralNetworksModel *model,
  https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6 **compilation
)
```
Create a [ANeuralNetworksCompilation](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6) to compile the given model.

The model passed to this function is termed the "main model" of the compilation, to distinguish it from other models referred to by an Operand of type [ANEURALNETWORKS_MODEL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a66055118088cbd1d1d17dcbcd2c47ed5) within this compilation.

This function only creates the object. Compilation is only performed once [ANeuralNetworksCompilation_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9ce8960a4c74b9b98878b1798250abde) is invoked.

[ANeuralNetworksCompilation_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9ce8960a4c74b9b98878b1798250abde) should be called once all desired properties have been set on the compilation.

[ANeuralNetworksModel_free](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gae124cb448669f2713497107dfa4a563c) should be called once the compilation is no longer needed.

The provided model must outlive the compilation.

The model must already have been finished by a call to [ANeuralNetworksModel_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga74e521efc13d3eba79b8b779b306b53e).

See [ANeuralNetworksCompilation](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6) for information on multithreaded usage.

Available since NNAPI feature level 1.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `model` | The [ANeuralNetworksModel](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ce6f20a94d3a2de47fa5a810feeb9a4) to be compiled. | | `compilation` | The newly created object or NULL if unsuccessful. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful, ANEURALNETWORKS_BAD_DATA if the model is invalid. |

### ANeuralNetworksCompilation_createForDevices

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksCompilation_createForDevices(
  ANeuralNetworksModel *model,
  const ANeuralNetworksDevice *const *devices,
  uint32_t numDevices,
  ANeuralNetworksCompilation **compilation
)
```
Create a [ANeuralNetworksCompilation](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6) to compile the given model for a specified set of devices.

If more than one device is specified, the compilation will distribute the workload automatically across the devices. The model must be fully supported by the specified set of devices. This means that [ANeuralNetworksModel_getSupportedOperationsForDevices()](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf6b66f5fc0cd447269ad6035f49dbf4d) must have returned true for every operation for that model/devices pair.

The user must handle all compilation and execution failures from the specified set of devices. This is in contrast to a use of [ANeuralNetworksCompilation_create](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaa859b1859f1418a7dc739ba7bb5291e8), where the runtime will attempt to recover from such failures.

The model passed to this function is termed the "main model" of the compilation, to distinguish it from other models referred to by an Operand of type [ANEURALNETWORKS_MODEL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a66055118088cbd1d1d17dcbcd2c47ed5) within this compilation.


Available since NNAPI feature level 3. **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `model` | The [ANeuralNetworksModel](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ce6f20a94d3a2de47fa5a810feeb9a4) to be compiled. | | `devices` | The set of devices. Must not contain duplicates. | | `numDevices` | The number of devices in the set. | | `compilation` | The newly created object or NULL if unsuccessful. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful, ANEURALNETWORKS_BAD_DATA if the model is invalid. |

### ANeuralNetworksCompilation_finish

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksCompilation_finish(
  ANeuralNetworksCompilation *compilation
)
```
Indicate that we have finished modifying a compilation.

Required before calling [ANeuralNetworksBurst_create](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga8837b557b05c7b6e03349fe2c6dbe72f) or [ANeuralNetworksExecution_create](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga436633d3e8c4ebf6e3c44778799ca6b4).

An application must ensure that no other thread uses the compilation at the same time.

This function must only be called once for a given compilation.

If [ANeuralNetworksCompilation_setTimeout](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga05fb09e58595a6f1f2ef2fa8b6e9f557) was called on this compilation, and the compilation is not able to be finished before the timeout duration is exceeded, then compilation may be aborted, in which case ANEURALNETWORKS_MISSED_DEADLINE_\* [ResultCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gad8097859ab1bdd06be52a8421df152d4) will be returned.

See [ANeuralNetworksCompilation](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6) for information on multithreaded usage.

Available since NNAPI feature level 1.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `compilation` | The compilation to be finished. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. |

### ANeuralNetworksCompilation_free

Declared in `android/NeuralNetworks.h`

```
void ANeuralNetworksCompilation_free(
  ANeuralNetworksCompilation *compilation
)
```
Destroy a compilation.

The compilation need not have been finished by a call to [ANeuralNetworksCompilation_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9ce8960a4c74b9b98878b1798250abde).

See [ANeuralNetworksCompilation](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6) for information on multithreaded usage.

Available since NNAPI feature level 1.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `compilation` | The compilation to be destroyed. Passing NULL is acceptable and results in no operation. | |

### ANeuralNetworksCompilation_getPreferredMemoryAlignmentForInput

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksCompilation_getPreferredMemoryAlignmentForInput(
  const ANeuralNetworksCompilation *compilation,
  uint32_t index,
  uint32_t *alignment
)
```
Get the preferred buffer and memory alignment of an input to an execution created from a particular compilation.

The user may use the returned alignment value to guide the layout of the input buffer or memory pool. To achieve the best performance, make sure the address of the buffer passed in [ANeuralNetworksExecution_setInput](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gac67f2c8f1ea2136d57bc871da2e6982f), or the offset value passed in [ANeuralNetworksExecution_setInputFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga33a63f2ee1b1b17304f76ef8376af224), is a multiple of the perferred alignment value of the same input. A driver may choose to allocate a separate buffer and do memory copying if the provided buffer or memory does not satisfy the preferred alignment.

See [ANeuralNetworksCompilation](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6) for information on multithreaded usage.


Available since NNAPI feature level 5. **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `compilation` | The compilation object. It must already have been finished by calling [ANeuralNetworksCompilation_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9ce8960a4c74b9b98878b1798250abde). | | `index` | The index of the input argument we are referencing from the compilation. It is an index into the inputs list passed to [ANeuralNetworksModel_identifyInputsAndOutputs](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gacef56268ac6e5e80fa0b4714f57772ce). It is not the index associated with [ANeuralNetworksModel_addOperand](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gabe3ab450ff498af8b3b4b88d5e256a36). | | `alignment` | The returned preferred alignment in bytes. It will be a power of 2. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. ANEURALNETWORKS_UNEXPECTED_NULL if either compilation or alignment is NULL. ANEURALNETWORKS_BAD_STATE if the compilation has not been finished. ANEURALNETWORKS_BAD_DATA if the index is out of range. |

### ANeuralNetworksCompilation_getPreferredMemoryAlignmentForOutput

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksCompilation_getPreferredMemoryAlignmentForOutput(
  const ANeuralNetworksCompilation *compilation,
  uint32_t index,
  uint32_t *alignment
)
```
Get the preferred buffer and memory alignment of an output to an execution created from a particular compilation.

The user may use the returned alignment value to guide the layout of the output buffer or memory pool. To achieve the best performance, make sure the address of the buffer passed in [ANeuralNetworksExecution_setOutput](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga7c25ad87c553d207efb257d09e62801e), or the offset value passed in [ANeuralNetworksExecution_setOutputFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gafcd74c997781e196e081f19108e2c441), is a multiple of the perferred alignment value of the same output. A driver may choose to allocate a separate buffer and do memory copying if the provided buffer or memory does not satisfy the preferred alignment.

See [ANeuralNetworksCompilation](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6) for information on multithreaded usage.


Available since NNAPI feature level 5. **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `compilation` | The compilation object. It must already have been finished by calling [ANeuralNetworksCompilation_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9ce8960a4c74b9b98878b1798250abde). | | `index` | The index of the output argument we are referencing from the compilation. It is an index into the outputs list passed to [ANeuralNetworksModel_identifyInputsAndOutputs](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gacef56268ac6e5e80fa0b4714f57772ce). It is not the index associated with [ANeuralNetworksModel_addOperand](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gabe3ab450ff498af8b3b4b88d5e256a36). | | `alignment` | The returned perferred alignment in bytes. It will be a power of 2. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. ANEURALNETWORKS_UNEXPECTED_NULL if either compilation or alignment is NULL. ANEURALNETWORKS_BAD_STATE if the compilation has not been finished. ANEURALNETWORKS_BAD_DATA if the index is out of range. |

### ANeuralNetworksCompilation_getPreferredMemoryPaddingForInput

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksCompilation_getPreferredMemoryPaddingForInput(
  const ANeuralNetworksCompilation *compilation,
  uint32_t index,
  uint32_t *padding
)
```
Get the preferred buffer and memory end padding of an input to an execution created from a particular compilation.

The user may use the returned padding value to guide the layout of the input buffer or memory pool. To achieve the best performance, make sure the length value passed in [ANeuralNetworksExecution_setInput](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gac67f2c8f1ea2136d57bc871da2e6982f) or [ANeuralNetworksExecution_setInputFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga33a63f2ee1b1b17304f76ef8376af224) is greater than or equal to the raw size of the input (i.e. the size of an element multiplied by the number of elements) rounding up to a multiple of the perferred padding value of the same input. A driver may choose to allocate a separate buffer and do memory copying if the provided buffer or memory value does not satisfy the preferred padding.

See [ANeuralNetworksCompilation](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6) for information on multithreaded usage. See [ANeuralNetworksExecution_enableInputAndOutputPadding](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga0399f20dfdf762c40d03c306749813a3), [ANeuralNetworksExecution_setInput](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gac67f2c8f1ea2136d57bc871da2e6982f), and [ANeuralNetworksExecution_setInputFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga33a63f2ee1b1b17304f76ef8376af224) for information on passing input buffer or memory padding to the driver.


Available since NNAPI feature level 5. **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `compilation` | The compilation object. It must already have been finished by calling [ANeuralNetworksCompilation_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9ce8960a4c74b9b98878b1798250abde). | | `index` | The index of the input argument we are referencing from the compilation. It is an index into the inputs list passed to [ANeuralNetworksModel_identifyInputsAndOutputs](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gacef56268ac6e5e80fa0b4714f57772ce). It is not the index associated with [ANeuralNetworksModel_addOperand](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gabe3ab450ff498af8b3b4b88d5e256a36). | | `padding` | The returned preferred padding in bytes. It will be a power of 2. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. ANEURALNETWORKS_UNEXPECTED_NULL if either compilation or padding is NULL. ANEURALNETWORKS_BAD_STATE if the compilation has not been finished. ANEURALNETWORKS_BAD_DATA if the index is out of range. |

### ANeuralNetworksCompilation_getPreferredMemoryPaddingForOutput

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksCompilation_getPreferredMemoryPaddingForOutput(
  const ANeuralNetworksCompilation *compilation,
  uint32_t index,
  uint32_t *padding
)
```
Get the preferred memory end padding of an output to an execution created from a particular compilation.

The user may use the returned padding value to guide the layout of the output buffer or memory pool. To achieve the best performance, make sure the length value passed in [ANeuralNetworksExecution_setOutput](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga7c25ad87c553d207efb257d09e62801e) or [ANeuralNetworksExecution_setOutputFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gafcd74c997781e196e081f19108e2c441) is greater than or equal to the raw size of the output (i.e. the size of an element multiplied by the number of elements) rounding up to a multiple of the perferred padding value of the same output. A driver may choose to allocate a separate buffer and do memory copying if the provided buffer or memory value does not satisfy the preferred padding.

See [ANeuralNetworksCompilation](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6) for information on multithreaded usage. See [ANeuralNetworksExecution_enableInputAndOutputPadding](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga0399f20dfdf762c40d03c306749813a3), [ANeuralNetworksExecution_setOutput](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga7c25ad87c553d207efb257d09e62801e), and [ANeuralNetworksExecution_setOutputFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gafcd74c997781e196e081f19108e2c441) for information on passing output buffer or memory padding to the driver.


Available since NNAPI feature level 5. **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `compilation` | The compilation object. It must already have been finished by calling [ANeuralNetworksCompilation_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9ce8960a4c74b9b98878b1798250abde). | | `index` | The index of the output argument we are referencing from the compilation. It is an index into the outputs list passed to [ANeuralNetworksModel_identifyInputsAndOutputs](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gacef56268ac6e5e80fa0b4714f57772ce). It is not the index associated with [ANeuralNetworksModel_addOperand](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gabe3ab450ff498af8b3b4b88d5e256a36). | | `padding` | The returned perferred padding in bytes. It will be a power of 2. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. ANEURALNETWORKS_UNEXPECTED_NULL if either compilation or padding is NULL. ANEURALNETWORKS_BAD_STATE if the compilation has not been finished. ANEURALNETWORKS_BAD_DATA if the index is out of range. |

### ANeuralNetworksCompilation_setCaching

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksCompilation_setCaching(
  ANeuralNetworksCompilation *compilation,
  const char *cacheDir,
  const uint8_t *token
)
```
Sets the compilation caching signature and the cache directory.

Provides optional caching information to the runtime for faster repeated compilation.

See [ANeuralNetworksCompilation](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6) for information on multithreaded usage.


Available since NNAPI feature level 3. **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `compilation` | The compilation to be modified. | | `cacheDir` | The cache directory for the runtime to store and retrieve caching data. It is recommended to use the code cache directory provided by the Android runtime. If not using the code cache directory, the user should choose a directory local to the application, and is responsible for managing the cache entries. | | `token` | The token provided by the user to specify a model must be of length ANEURALNETWORKS_BYTE_SIZE_OF_CACHE_TOKEN. The user should ensure that the token is unique to a model within the application. The NNAPI runtime cannot detect token collisions; a collision will result in a failed execution or in a successful execution that produces incorrect output values. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. |

### ANeuralNetworksCompilation_setPreference

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksCompilation_setPreference(
  ANeuralNetworksCompilation *compilation,
  int32_t preference
)
```
Sets the execution preference.

Provides guidance to the runtime when trade-offs are possible. By default the runtime uses PREFER_SINGLE_FAST_ANSWER

See [ANeuralNetworksCompilation](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6) for information on multithreaded usage.

Available since NNAPI feature level 1.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `compilation` | The compilation to be modified. | | `preference` | Either [ANEURALNETWORKS_PREFER_LOW_POWER](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga034380829226e2d980b2a7e63c992f18a370c42db64448662ad79116556bcec01), [ANEURALNETWORKS_PREFER_FAST_SINGLE_ANSWER](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga034380829226e2d980b2a7e63c992f18af7fff807061a3e9358364a502691d887), or [ANEURALNETWORKS_PREFER_SUSTAINED_SPEED](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga034380829226e2d980b2a7e63c992f18af727c25f1e2d8dcc693c477aef4ea5f5). | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. |

### ANeuralNetworksCompilation_setPriority

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksCompilation_setPriority(
  ANeuralNetworksCompilation *compilation,
  int priority
)
```
Set the execution priority.

Execution priorities are relative to other executions created by the same application (specifically same uid) for the same device. Specifically, priorities of executions from one application will not affect executions from another application. Similarly, priorities of executions on one device will not affect executions on another device.

Higher priority executions may use more compute resources than lower priority executions, and may preempt or starve lower priority executions.

See [ANeuralNetworksCompilation](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6) for information on multithreaded usage.

Available since NNAPI feature level 4.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `compilation` | The compilation to be modified. | | `priority` | The relative priority of the execution compared to other executions created by the application. Must be one of ANEURALNETWORKS_PRIORITY_\*. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. |

### ANeuralNetworksCompilation_setTimeout

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksCompilation_setTimeout(
  ANeuralNetworksCompilation *compilation,
  uint64_t duration
)
```
Set the maximum expected duration for compiling the model.

If the device is not able to complete the compilation within the specified duration, the compilation may be aborted. The timeout duration begins at the call to [ANeuralNetworksCompilation_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9ce8960a4c74b9b98878b1798250abde).

This timeout duration acts as a hint to drivers, and can be used to both free up compute resources within the driver and return control back to the application quicker than is possible without the hint. It enables drivers that are able to estimate how long a compilation will take to abort the compilation before it has even started if the driver believes the compilation cannot be completed within the timeout duration. Similarly, it enables drivers to abort an ongoing compilation if it is taking too long. However, this call does not guarantee that the compilation will complete or abort within the timeout duration.

By default (i.e., unless ANeuralNetworksCompilation_setTimeout is called), the timeout duration for compiling the model is considered infinite.

The [ANeuralNetworksCompilation](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6) must have been created with [ANeuralNetworksCompilation_createForDevices](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga3ef5683b170614a689b6e2e7df78aefd) with numDevices = 1, otherwise this function will fail with ANEURALNETWORKS_BAD_DATA. If the device has a feature level reported by [ANeuralNetworksDevice_getFeatureLevel](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5cc923384065f37721fbbd75f80ecfd4) that is lower than [ANEURALNETWORKS_FEATURE_LEVEL_4](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga5ea86afb2f613025b6af63c1f21ac028acbd6a309bf12692b48dabcdfaefde4e4), then the timeout duration hint will be ignored.

See [ANeuralNetworksCompilation](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6) for information on multithreaded usage.


Available since NNAPI feature level 4. **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `compilation` | The compilation to be modified. | | `duration` | The maximum amount of time in nanoseconds that is expected to be spent finishing a compilation. If this duration is exceeded, the compilation may be aborted. If set to 0, the timeout duration is considered infinite. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. |

### ANeuralNetworksDevice_getFeatureLevel

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksDevice_getFeatureLevel(
  const ANeuralNetworksDevice *device,
  int64_t *featureLevel
)
```
Get the NNAPI feature level of the specified NNAPI device.

Each device has a supported feature level, which is the most advanced NNAPI specification and features this driver implements. For example, if the driver implements the features introduced in [ANEURALNETWORKS_FEATURE_LEVEL_2](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga5ea86afb2f613025b6af63c1f21ac028a38c45ac5eeed83b5234bf2f9271ecad2), but does not implement the features introduced after [ANEURALNETWORKS_FEATURE_LEVEL_2](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga5ea86afb2f613025b6af63c1f21ac028a38c45ac5eeed83b5234bf2f9271ecad2), the value would be [ANEURALNETWORKS_FEATURE_LEVEL_2](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga5ea86afb2f613025b6af63c1f21ac028a38c45ac5eeed83b5234bf2f9271ecad2). Developers could decide whether or not the specified device should be used for a model that has certain feature requirements.

NNAPI device feature level is closely related to NNAPI runtime feature level ([ANeuralNetworks_getRuntimeFeatureLevel](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga70048cdcbc0ec44b141f20eda9d086a5)), which indicates an NNAPI runtime feature level (the most advanced NNAPI specification and features that the runtime implements). An NNAPI device feature level is always less than or equal to the runtime feature level.

This function produces a [FeatureLevelCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5ea86afb2f613025b6af63c1f21ac028) enum value, NOT an Android API level.


Available since NNAPI feature level 3. **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `device` | The representation of the specified device. | | `featureLevel` | [FeatureLevelCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5ea86afb2f613025b6af63c1f21ac028) of the most advanced feature this driver implements. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. |

### ANeuralNetworksDevice_getName

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksDevice_getName(
  const ANeuralNetworksDevice *device,
  const char **name
)
```
Get the name of the specified device.


Available since NNAPI feature level 3. **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `device` | The representation of the specified device. | | `name` | The returned name of the specified device. The name will be in UTF-8 and will be null-terminated. It will be recognizable as a known device name rather than a cryptic string. For devices with feature level reported by [ANeuralNetworksDevice_getFeatureLevel](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5cc923384065f37721fbbd75f80ecfd4) that is [ANEURALNETWORKS_FEATURE_LEVEL_3](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga5ea86afb2f613025b6af63c1f21ac028aada4e57bb24f38676fa38663b6984639) and higher, the format of the name is {VENDOR}-{DEVICE}. For devices with feature level [ANEURALNETWORKS_FEATURE_LEVEL_2](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga5ea86afb2f613025b6af63c1f21ac028a38c45ac5eeed83b5234bf2f9271ecad2) or lower, the format of the name is undefined. The name will remain valid for the duration of the application. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. |

### ANeuralNetworksDevice_getType

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksDevice_getType(
  const ANeuralNetworksDevice *device,
  int32_t *type
)
```
Get the type of a given device.

The device type can be used to help application developers to distribute Machine Learning workloads and other workloads such as graphical rendering. E.g., for an app which renders AR scenes based on real time object detection results, the developer could choose an ACCELERATOR type device for ML workloads, and reserve GPU for graphical rendering.


Available since NNAPI feature level 3. **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `device` | The representation of the specified device. | | `type` | The returned [DeviceTypeCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga61f16b495d2e04593c819c12e42ac9f2) of the specified device. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. |

### ANeuralNetworksDevice_getVersion

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksDevice_getVersion(
  const ANeuralNetworksDevice *device,
  const char **version
)
```
Get the version of the driver implementation of the specified device.

It's the responsibility of the driver implementor to insure that this version string uniquely distinguishes this implementation from all previous implementations.

This version string must not be confused with the feature level which is solely defined by [ANeuralNetworksDevice_getFeatureLevel](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5cc923384065f37721fbbd75f80ecfd4). There is no implicit ordering of the versions. For example, it is not possible to filter all drivers older than a certain version.

Application developers may use this version string to avoid or prefer specific driver implementations. For example, an application may want to do so because:

- A specific version of the driver does not provide the required performance, perhaps because of a performance regression.
- A specific version of the driver has a bug or returns results that don't match the minimum precision requirement for the application.

<br />


Available since NNAPI feature level 3. **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `device` | The representation of the specified device. | | `version` | The returned version string of the driver for the specified device. The string will be in UTF-8 and will be null-terminated. For devices with feature level 28 or lower, "UNKNOWN" will be returned. The version string will remain valid for the duration of the application. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. |

### ANeuralNetworksDevice_wait

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksDevice_wait(
  const ANeuralNetworksDevice *device
)
```
Wait until the device is in a live state.

A device may encounter internal errors and temporarily enter a dead state. A call that uses a device in such a state will return with the error [ANEURALNETWORKS_DEAD_OBJECT](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggad8097859ab1bdd06be52a8421df152d4a1feb6443bf2f3cc97ff33fa4b3dec4a9). ANeuralNetworksDevice_wait will block until the device is in a live state.


Available since NNAPI feature level 4. **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `device` | The representation of the specified device. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. |

### ANeuralNetworksEvent_createFromSyncFenceFd

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksEvent_createFromSyncFenceFd(
  int sync_fence_fd,
  ANeuralNetworksEvent **event
)
```
Create a [ANeuralNetworksEvent](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga8b595e8510f91fa0f7d9eaa09fe6c269) from a sync_fence file descriptor.

The newly created ANeuralNetworksEvent does not take ownership of the provided sync_fence_fd, it will instead dup the provided sync_fence_fd and own the duplicate.


Available since NNAPI feature level 4. **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `sync_fence_fd` | The sync_fence file descriptor. | | `event` | The newly created object or NULL if unsuccessful. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. |

### ANeuralNetworksEvent_free

Declared in `android/NeuralNetworks.h`

```
void ANeuralNetworksEvent_free(
  ANeuralNetworksEvent *event
)
```
Destroys the event.

See [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) for information on multithreaded usage.

Available since NNAPI feature level 1.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `event` | The event object to be destroyed. Passing NULL is acceptable and results in no operation. | |

### ANeuralNetworksEvent_getSyncFenceFd

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksEvent_getSyncFenceFd(
  const ANeuralNetworksEvent *event,
  int *sync_fence_fd
)
```
Get sync_fence file descriptor from the event.

If the ANeuralNetworksEvent is not backed by a sync fence, the sync_fence_fd will be set to -1, and ANEURALNETWORKS_BAD_DATA will be returned.

See [ANeuralNetworksEvent_createFromSyncFenceFd](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga8d5e18cffd8389542af8334513e0ef09) and [ANeuralNetworksExecution_startComputeWithDependencies](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga371f25c6c44c05f8d267bb6f27ceeb3a) to see how to create an event backed by a sync fence.

The user takes ownership of the returned fd, and must close the returned file descriptor when it is no longer needed.


Available since NNAPI feature level 4. **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `event` | An event that is backed by a sync fence. | | `sync_fence_fd` | The sync_fence file descriptor. The file descriptor will be set to -1 if there is an error. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. |

### ANeuralNetworksEvent_wait

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksEvent_wait(
  ANeuralNetworksEvent *event
)
```
Waits until the execution completes.

More than one thread can wait on an event. When the execution completes, all threads will be released.

If [ANeuralNetworksExecution_setTimeout](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gab5896a441a236c08b99fcb7a4d02fe83) was called on the execution corresponding to this event, and the execution is not able to complete before the duration is exceeded, the execution may be aborted, in which case ANEURALNETWORKS_MISSED_DEADLINE_\* [ResultCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gad8097859ab1bdd06be52a8421df152d4) will be returned here.

If the execution contains a [ANEURALNETWORKS_WHILE](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0afdc0927832c42f93845fd9a2361b35f9) operation, and the condition model does not output false within the loop timeout duration, the execution will be aborted, and ANEURALNETWORKS_MISSED_DEADLINE_\* [ResultCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gad8097859ab1bdd06be52a8421df152d4) will be returned here.

See [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) for information on execution states and multithreaded usage.

Available since NNAPI feature level 1.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `event` | The event that will be signaled on completion. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if the execution completed normally. ANEURALNETWORKS_UNMAPPABLE if the execution input or output memory cannot be properly mapped. |

### ANeuralNetworksExecution_burstCompute

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksExecution_burstCompute(
  ANeuralNetworksExecution *execution,
  ANeuralNetworksBurst *burst
)
```
Schedule synchronous evaluation of the execution on a burst object.

Schedules synchronous evaluation of the execution. Returns once the execution has completed and the outputs are ready to be consumed.

If [ANeuralNetworksExecution_setTimeout](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gab5896a441a236c08b99fcb7a4d02fe83) was called on the execution, and the execution is not able to complete before the timeout duration is exceeded, then execution may be aborted, in which case ANEURALNETWORKS_MISSED_DEADLINE_\* [ResultCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gad8097859ab1bdd06be52a8421df152d4) will be returned.

If the execution contains a [ANEURALNETWORKS_WHILE](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0afdc0927832c42f93845fd9a2361b35f9) operation, and the condition model does not output false within the loop timeout duration, then execution will be aborted and ANEURALNETWORKS_MISSED_DEADLINE_\* [ResultCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gad8097859ab1bdd06be52a8421df152d4) will be returned. If the device has a feature level reported by [ANeuralNetworksDevice_getFeatureLevel](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5cc923384065f37721fbbd75f80ecfd4) that is lower than [ANEURALNETWORKS_FEATURE_LEVEL_4](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga5ea86afb2f613025b6af63c1f21ac028acbd6a309bf12692b48dabcdfaefde4e4), then the timeout duration hint will be ignored.

There must be at most one [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) processing at any given time for any given burst object. Any [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) launched before the previous has finished will result in ANEURALNETWORKS_BAD_STATE.

Before NNAPI feature level 5, this function may only be invoked when the execution is in the preparation state. Starting at NNAPI feature level 5, if the user sets the execution to be reusable by [ANeuralNetworksExecution_setReusable](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaa4d2abe06303d6728e4864d8f07c1a3a), this function may also be invoked when the execution is in the completed state.

See [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) for information on execution states and multithreaded usage.

See [ANeuralNetworksExecution_compute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga52bfde74591c81eae1ff010199f4a2e2) for synchronous execution. See [ANeuralNetworksExecution_startCompute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5d5dc6f589d19221892c3ccb7b622e33) for regular asynchronous execution. See [ANeuralNetworksExecution_startComputeWithDependencies](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga371f25c6c44c05f8d267bb6f27ceeb3a) for asynchronous execution with dependencies.

Available since NNAPI feature level 3.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `burst` | The burst object to execute on. | | `execution` | The execution to be scheduled and executed. The execution must be created from the same [ANeuralNetworksCompilation](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6) as the burst object. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if the execution completed normally. |

### ANeuralNetworksExecution_compute

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksExecution_compute(
  ANeuralNetworksExecution *execution
)
```
Schedule synchronous evaluation of the execution.

Schedules synchronous evaluation of the execution. Returns once the execution has completed and the outputs are ready to be consumed.

If [ANeuralNetworksExecution_setTimeout](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gab5896a441a236c08b99fcb7a4d02fe83) was called on this execution, and the execution is not able to complete before the timeout duration is exceeded, then execution may be aborted, in which case ANEURALNETWORKS_MISSED_DEADLINE_\* [ResultCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gad8097859ab1bdd06be52a8421df152d4) will be returned. If the device has a feature level reported by [ANeuralNetworksDevice_getFeatureLevel](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5cc923384065f37721fbbd75f80ecfd4) that is lower than 30, then the timeout duration hint will be ignored.

If this execution contains a [ANEURALNETWORKS_WHILE](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0afdc0927832c42f93845fd9a2361b35f9) operation, and the condition model does not output false within the loop timeout duration, then execution will be aborted and ANEURALNETWORKS_MISSED_DEADLINE_\* [ResultCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gad8097859ab1bdd06be52a8421df152d4) will be returned.

Before NNAPI feature level 5, this function may only be invoked when the execution is in the preparation state. Starting at NNAPI feature level 5, if the user sets the execution to be reusable by [ANeuralNetworksExecution_setReusable](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaa4d2abe06303d6728e4864d8f07c1a3a), this function may also be invoked when the execution is in the completed state.

See [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) for information on execution states and multithreaded usage.

See [ANeuralNetworksExecution_burstCompute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gae4f4b99ab910a2397bf1b857c11f7206) for burst synchronous execution. See [ANeuralNetworksExecution_startCompute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5d5dc6f589d19221892c3ccb7b622e33) for regular asynchronous execution. See [ANeuralNetworksExecution_startComputeWithDependencies](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga371f25c6c44c05f8d267bb6f27ceeb3a) for asynchronous execution with dependencies.

Available since NNAPI feature level 3.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `execution` | The execution to be scheduled and executed. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if the execution completed normally. ANEURALNETWORKS_UNMAPPABLE if the execution input or output memory cannot be properly mapped. |

### ANeuralNetworksExecution_create

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksExecution_create(
  ANeuralNetworksCompilation *compilation,
  https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b **execution
)
```
Create a [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) to apply the given compilation.

This only creates the object. Computation is only performed once [ANeuralNetworksExecution_burstCompute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gae4f4b99ab910a2397bf1b857c11f7206), [ANeuralNetworksExecution_compute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga52bfde74591c81eae1ff010199f4a2e2), [ANeuralNetworksExecution_startCompute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5d5dc6f589d19221892c3ccb7b622e33) or [ANeuralNetworksExecution_startComputeWithDependencies](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga371f25c6c44c05f8d267bb6f27ceeb3a) is invoked.

The provided compilation must outlive the execution.

See [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) for information on multithreaded usage.

Available since NNAPI feature level 1.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `compilation` | The [ANeuralNetworksCompilation](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6) to be evaluated. | | `execution` | The newly created object or NULL if unsuccessful. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful, ANEURALNETWORKS_BAD_DATA if the compilation is invalid. |

### ANeuralNetworksExecution_enableInputAndOutputPadding

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksExecution_enableInputAndOutputPadding(
  ANeuralNetworksExecution *execution,
  bool enable
)
```
Specifies whether the [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) is able to accept padded input and output buffers and memory objects.

By default, the input and output buffers and memory objects of [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) do not allow padding.

Setting the execution to accept padded input and output buffers and memory objects enables the length argument of [ANeuralNetworksExecution_setInput](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gac67f2c8f1ea2136d57bc871da2e6982f), [ANeuralNetworksExecution_setInputFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga33a63f2ee1b1b17304f76ef8376af224), [ANeuralNetworksExecution_setOutput](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga7c25ad87c553d207efb257d09e62801e), and [ANeuralNetworksExecution_setOutputFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gafcd74c997781e196e081f19108e2c441) to be greater than the raw size of the operand (i.e. the size of an element multiplied by the number of elements). The extra bytes at the end of the buffer or memory region may be used by the driver to access data in chunks, for efficiency.

This method must not be called after [ANeuralNetworksExecution_setInput](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gac67f2c8f1ea2136d57bc871da2e6982f), [ANeuralNetworksExecution_setInputFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga33a63f2ee1b1b17304f76ef8376af224), [ANeuralNetworksExecution_setOutput](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga7c25ad87c553d207efb257d09e62801e), or [ANeuralNetworksExecution_setOutputFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gafcd74c997781e196e081f19108e2c441).

See [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) for information on multithreaded usage.


Available since NNAPI feature level 5. **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `execution` | The execution to be modified. | | `enable` | 'true' if the execution is to be able to accept padded input and output buffers and memory objects, 'false' if not. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. ANEURALNETWORKS_UNEXPECTED_NULL if execution is NULL. ANEURALNETWORKS_BAD_STATE if [ANeuralNetworksExecution_setInput](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gac67f2c8f1ea2136d57bc871da2e6982f), [ANeuralNetworksExecution_setInputFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga33a63f2ee1b1b17304f76ef8376af224), [ANeuralNetworksExecution_setOutput](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga7c25ad87c553d207efb257d09e62801e), or [ANeuralNetworksExecution_setOutputFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gafcd74c997781e196e081f19108e2c441) has been called on the execution. |

### ANeuralNetworksExecution_free

Declared in `android/NeuralNetworks.h`

```
void ANeuralNetworksExecution_free(
  ANeuralNetworksExecution *execution
)
```
Destroy an execution.

The execution need not have been scheduled by a call to [ANeuralNetworksExecution_burstCompute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gae4f4b99ab910a2397bf1b857c11f7206), [ANeuralNetworksExecution_compute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga52bfde74591c81eae1ff010199f4a2e2), [ANeuralNetworksExecution_startCompute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5d5dc6f589d19221892c3ccb7b622e33) or [ANeuralNetworksExecution_startComputeWithDependencies](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga371f25c6c44c05f8d267bb6f27ceeb3a); but if it has been scheduled, then the application must not call [ANeuralNetworksExecution_free](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga6e72eaa3a6fb96be9f5ac7f5df4ed7ea) until the execution has completed (i.e., [ANeuralNetworksExecution_burstCompute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gae4f4b99ab910a2397bf1b857c11f7206), [ANeuralNetworksExecution_compute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga52bfde74591c81eae1ff010199f4a2e2), or [ANeuralNetworksEvent_wait](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9505d7f3b59a0e089d4ce67f293addfa) has returned).

See [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) for information on multithreaded usage.

Available since NNAPI feature level 1.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `execution` | The execution to be destroyed. Passing NULL is acceptable and results in no operation. | |

### ANeuralNetworksExecution_getDuration

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksExecution_getDuration(
  const ANeuralNetworksExecution *execution,
  int32_t durationCode,
  uint64_t *duration
)
```
Get the time spent in the latest computation evaluated on the specified [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b), in nanoseconds.

This function may only be invoked when the execution is in the completed state.

See [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) for information on execution states.


Available since NNAPI feature level 3. **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `execution` | The execution to be queried. | | `durationCode` | The measurement to be queried, specified by [DurationCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4adbdd519e2d3f770784fc55d197159f). | | `duration` | The returned duration. If no measurement was requested by [ANeuralNetworksExecution_setMeasureTiming](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga09e518f7facf0da023bfa13405439301), if the device is has a feature level reported by [ANeuralNetworksDevice_getFeatureLevel](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5cc923384065f37721fbbd75f80ecfd4) that is lower than [ANEURALNETWORKS_FEATURE_LEVEL_3](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga5ea86afb2f613025b6af63c1f21ac028aada4e57bb24f38676fa38663b6984639), or for some other reason the duration is not available, UINT64_MAX will be returned. A particular device need not support any given measurement. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. |

### ANeuralNetworksExecution_getOutputOperandDimensions

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksExecution_getOutputOperandDimensions(
  ANeuralNetworksExecution *execution,
  int32_t index,
  uint32_t *dimensions
)
```
Get the dimensional information of the specified output operand of the model of the latest computation evaluated on [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b).

The target output operand cannot be a scalar.

This function may only be invoked when the execution is in the completed state.

See [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) for information on execution states.


Available since NNAPI feature level 3. **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `execution` | The execution to be queried. | | `index` | The index of the output argument we are querying. It is an index into the lists passed to [ANeuralNetworksModel_identifyInputsAndOutputs](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gacef56268ac6e5e80fa0b4714f57772ce). It is not the index associated with [ANeuralNetworksModel_addOperand](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gabe3ab450ff498af8b3b4b88d5e256a36). | | `dimensions` | The dimension array to be filled. The size of the array must be exactly as large as the rank of the output operand to be queried in the model. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful, ANEURALNETWORKS_OUTPUT_INSUFFICIENT_SIZE if the target output is provided an insufficient buffer at execution time, ANEURALNETWORKS_BAD_DATA if the index is invalid or if the target is a scalar. |

### ANeuralNetworksExecution_getOutputOperandRank

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksExecution_getOutputOperandRank(
  ANeuralNetworksExecution *execution,
  int32_t index,
  uint32_t *rank
)
```
Get the dimensional information of the specified output operand of the model of the latest computation evaluated on [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b).

This function may only be invoked when the execution is in the completed state.

See [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) for information on execution states.


Available since NNAPI feature level 3. **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `execution` | The execution to be queried. | | `index` | The index of the output argument we are querying. It is an index into the lists passed to [ANeuralNetworksModel_identifyInputsAndOutputs](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gacef56268ac6e5e80fa0b4714f57772ce). It is not the index associated with [ANeuralNetworksModel_addOperand](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gabe3ab450ff498af8b3b4b88d5e256a36). | | `rank` | The rank of the output operand. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful, ANEURALNETWORKS_OUTPUT_INSUFFICIENT_SIZE if the target output is provided an insufficient buffer at execution time, ANEURALNETWORKS_BAD_DATA if the index is invalid. |

### ANeuralNetworksExecution_setInput

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksExecution_setInput(
  ANeuralNetworksExecution *execution,
  int32_t index,
  const ANeuralNetworksOperandType *type,
  const void *buffer,
  size_t length
)
```
Associate a user buffer with an input of the model of the [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b).

Evaluation of the execution must not have been scheduled. Once evaluation of the execution has been scheduled, the application must not change the content of the buffer until the execution has completed. Evaluation of the execution will not change the content of the buffer.

The provided buffer must outlive the execution.

If the input is optional, you can indicate that it is omitted by passing nullptr for buffer and 0 for length.

Otherwise, if the user has not set the execution to accept padded input buffers by calling [ANeuralNetworksExecution_enableInputAndOutputPadding](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga0399f20dfdf762c40d03c306749813a3), then the length argument must be equal to the raw size of the input (i.e. the size of an element multiplied by the number of elements). Passing a length argument with value not equal to the raw size of the input will result in ANEURALNETWORKS_BAD_DATA.

Otherwise, if the user has set the execution to accept padded input buffers by calling [ANeuralNetworksExecution_enableInputAndOutputPadding](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga0399f20dfdf762c40d03c306749813a3), the length argument may be greater than the raw size of the input, and the extra bytes at the end of the buffer may be used by the driver to access data in chunks, for efficiency. Passing a length argument with value less than the raw size of the input will result in ANEURALNETWORKS_BAD_DATA.

This function may only be invoked when the execution is in the preparation state.

See [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) for information on execution states and multithreaded usage. See [ANeuralNetworksCompilation_getPreferredMemoryAlignmentForInput](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gab39854ccc29b486075fabc26e8fcfdf7) and [ANeuralNetworksCompilation_getPreferredMemoryPaddingForInput](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gac00a1a4200d766d3793327ec616f40f7) for information on getting preferred buffer alignment and padding, to improve performance.

Available since NNAPI feature level 1.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `execution` | The execution to be modified. | | `index` | The index of the input argument we are setting. It is an index into the lists passed to [ANeuralNetworksModel_identifyInputsAndOutputs](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gacef56268ac6e5e80fa0b4714f57772ce). It is not the index associated with [ANeuralNetworksModel_addOperand](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gabe3ab450ff498af8b3b4b88d5e256a36). | | `type` | The [ANeuralNetworksOperandType](https://developer.android.com/ndk/reference/struct/a-neural-networks-operand-type#struct_a_neural_networks_operand_type) of the operand. Unless the input is omitted, this should be used to specify the dimensions that were left unspecified when the operand was added to the model. All other properties of the type must be the same as specified in the model. If the type is the same as specified when the model was built, NULL can be passed. Neither the [ANeuralNetworksOperandType](https://developer.android.com/ndk/reference/struct/a-neural-networks-operand-type#struct_a_neural_networks_operand_type) nor the dimensions it points to need to outlive the call to [ANeuralNetworksExecution_setInput](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gac67f2c8f1ea2136d57bc871da2e6982f). | | `buffer` | The buffer containing the data. | | `length` | The size of the data value in bytes plus any end padding. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful, ANEURALNETWORKS_BAD_DATA if the name is not recognized or the buffer is too small for the input. |

### ANeuralNetworksExecution_setInputFromMemory

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksExecution_setInputFromMemory(
  ANeuralNetworksExecution *execution,
  int32_t index,
  const ANeuralNetworksOperandType *type,
  const ANeuralNetworksMemory *memory,
  size_t offset,
  size_t length
)
```
Associate a region of a memory object with an input of the model of the [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b).

Evaluation of the execution must not have been scheduled. Once evaluation of the execution has been scheduled, the application must not change the content of the region until the execution has completed. Evaluation of the execution will not change the content of the region.

The provided memory must outlive the execution.

If the input is optional, you can indicate that it is omitted by using [ANeuralNetworksExecution_setInput](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gac67f2c8f1ea2136d57bc871da2e6982f) instead, passing nullptr for buffer and 0 for length.

If the memory is an AHardwareBuffer of a format other than AHARDWAREBUFFER_FORMAT_BLOB created from [ANeuralNetworksMemory_createFromAHardwareBuffer](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga75725b8ddd87e837937a576183fe6cd4), or an opaque memory object created from [ANeuralNetworksMemory_createFromDesc](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga75511166bfbf29fb97a63548de8135bc), both offset and length must be 0, indicating the whole memory is used.

Otherwise, if the user has not set the execution to accept padded input memory objects by calling [ANeuralNetworksExecution_enableInputAndOutputPadding](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga0399f20dfdf762c40d03c306749813a3), then the length argument must be equal to the raw size of the input (i.e. the size of an element multiplied by the number of elements). Passing a length argument with value not equal to the raw size of the input will result in ANEURALNETWORKS_BAD_DATA.

Otherwise, if the user has set the execution to accept padded input memory objects by calling [ANeuralNetworksExecution_enableInputAndOutputPadding](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga0399f20dfdf762c40d03c306749813a3), the length argument may be greater than the raw size of the input, and the extra bytes at the end of the memory region may be used by the driver to access data in chunks, for efficiency. Passing a length argument with value less than the raw size of the input will result in ANEURALNETWORKS_BAD_DATA.

This function may only be invoked when the execution is in the preparation state.

See [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) for information on execution states and multithreaded usage. See [ANeuralNetworksMemory_createFromAHardwareBuffer](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga75725b8ddd87e837937a576183fe6cd4) for information on AHardwareBuffer usage. See [ANeuralNetworksMemory_createFromDesc](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga75511166bfbf29fb97a63548de8135bc) for information on usage of memory objects created from memory descriptors. See [ANeuralNetworksCompilation_getPreferredMemoryAlignmentForInput](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gab39854ccc29b486075fabc26e8fcfdf7) and [ANeuralNetworksCompilation_getPreferredMemoryPaddingForInput](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gac00a1a4200d766d3793327ec616f40f7) for information on getting preferred memory alignment and padding, to improve performance.

Available since NNAPI feature level 1.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `execution` | The execution to be modified. | | `index` | The index of the input argument we are setting. It is an index into the lists passed to [ANeuralNetworksModel_identifyInputsAndOutputs](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gacef56268ac6e5e80fa0b4714f57772ce). It is not the index associated with [ANeuralNetworksModel_addOperand](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gabe3ab450ff498af8b3b4b88d5e256a36). | | `type` | The [ANeuralNetworksOperandType](https://developer.android.com/ndk/reference/struct/a-neural-networks-operand-type#struct_a_neural_networks_operand_type) of the operand. This should be used to specify the dimensions that were left unspecified when the operand was added to the model. All other properties of the type must be the same as specified in the model. If the type is the same as specified when the model was built, NULL can be passed. Neither the [ANeuralNetworksOperandType](https://developer.android.com/ndk/reference/struct/a-neural-networks-operand-type#struct_a_neural_networks_operand_type) nor the dimensions it points to need to outlive the call to [ANeuralNetworksExecution_setInputFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga33a63f2ee1b1b17304f76ef8376af224). | | `memory` | The memory containing the data. | | `offset` | This specifies the location of the data within the memory. The offset is in bytes from the start of memory. | | `length` | The size of the data value in bytes plus any end padding. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful, ANEURALNETWORKS_BAD_DATA if the name is not recognized or the buffer is too small for the input. |

### ANeuralNetworksExecution_setLoopTimeout

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksExecution_setLoopTimeout(
  ANeuralNetworksExecution *execution,
  uint64_t duration
)
```
Set the maximum duration of WHILE loops in the specified execution.

This is a fuzzy per-loop timeout intended to prevent infinite loops.

If a WHILE loop condition model does not output false within the specified duration, the execution will be aborted.

See [ANeuralNetworks_getDefaultLoopTimeout](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf60921202ae6128fedcd7a391b198915) and [ANeuralNetworks_getMaximumLoopTimeout](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gac382b8e61eb908bc8d076bce43e561d4) for the default and maximum timeout values.

This function may only be invoked when the execution is in the preparation state.

See [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) for information on execution states and multithreaded usage.


Available since NNAPI feature level 4. **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `execution` | The execution to be modified. | | `duration` | The maximum amount of time in nanoseconds that can be spent executing a WHILE loop. If the specified duration value exceeds the value produced by [ANeuralNetworks_getMaximumLoopTimeout](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gac382b8e61eb908bc8d076bce43e561d4), it will be overridden by that value. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. ANEURALNETWORKS_BAD_STATE if execution has started. ANEURALNETWORKS_UNEXPECTED_NULL if execution is NULL. |

### ANeuralNetworksExecution_setMeasureTiming

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksExecution_setMeasureTiming(
  ANeuralNetworksExecution *execution,
  bool measure
)
```
Specifies whether duration of the [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) is to be measured.

Evaluation of the execution must not have been scheduled.

By default, duration is not measured.

The [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) must have been created from an [ANeuralNetworksCompilation](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6) which in turn was created from [ANeuralNetworksCompilation_createForDevices](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga3ef5683b170614a689b6e2e7df78aefd) with numDevices = 1. If the device has a feature level reported by [ANeuralNetworksDevice_getFeatureLevel](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5cc923384065f37721fbbd75f80ecfd4) that is lower than [ANEURALNETWORKS_FEATURE_LEVEL_3](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga5ea86afb2f613025b6af63c1f21ac028aada4e57bb24f38676fa38663b6984639), then the duration will not be measured.

This function may only be invoked when the execution is in the preparation state.

See [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) for information on execution states and multithreaded usage.

Available since NNAPI feature level 3.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `execution` | The execution to be modified. | | `measure` | 'true' if duration is to be measured, 'false' if not. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. |

### ANeuralNetworksExecution_setOutput

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksExecution_setOutput(
  ANeuralNetworksExecution *execution,
  int32_t index,
  const ANeuralNetworksOperandType *type,
  void *buffer,
  size_t length
)
```
Associate a user buffer with an output of the model of the [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b).

Evaluation of the execution must not have been scheduled. Once evaluation of the execution has been scheduled, the application must not change the content of the buffer until the execution has completed.

The provided buffer must outlive the execution.

If the output is optional, you can indicate that it is omitted by passing nullptr for buffer and 0 for length.

Otherwise, if the user has not set the execution to accept padded output buffers by calling [ANeuralNetworksExecution_enableInputAndOutputPadding](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga0399f20dfdf762c40d03c306749813a3), then the length argument must be equal to the raw size of the output (i.e. the size of an element multiplied by the number of elements). Passing a length argument with value not equal to the raw size of the output will result in ANEURALNETWORKS_BAD_DATA.

Otherwise, if the user has set the execution to accept padded output buffers by calling [ANeuralNetworksExecution_enableInputAndOutputPadding](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga0399f20dfdf762c40d03c306749813a3), the length argument may be greater than the raw size of the output, and the extra bytes at the end of the buffer may be used by the driver to access data in chunks, for efficiency. Passing a length argument with value less than the raw size of the output will result in ANEURALNETWORKS_BAD_DATA.

This function may only be invoked when the execution is in the preparation state.

See [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) for information on execution states and multithreaded usage. See [ANeuralNetworksCompilation_getPreferredMemoryAlignmentForOutput](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gac2845526b544a627b199cdaa3c189b11) and [ANeuralNetworksCompilation_getPreferredMemoryPaddingForOutput](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga77f3f4057228ca355f249bec368588d0) for information on getting preferred buffer alignment and padding, to improve performance.

Available since NNAPI feature level 1.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `execution` | The execution to be modified. | | `index` | The index of the output argument we are setting. It is an index into the lists passed to [ANeuralNetworksModel_identifyInputsAndOutputs](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gacef56268ac6e5e80fa0b4714f57772ce). It is not the index associated with [ANeuralNetworksModel_addOperand](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gabe3ab450ff498af8b3b4b88d5e256a36). | | `type` | The [ANeuralNetworksOperandType](https://developer.android.com/ndk/reference/struct/a-neural-networks-operand-type#struct_a_neural_networks_operand_type) of the operand. Unless the output is omitted, this should be used to specify the dimensions that were left unspecified when the operand was added to the model. All other properties of the type must be the same as specified in the model. If the type is the same as specified when the model was built, NULL can be passed. Neither the [ANeuralNetworksOperandType](https://developer.android.com/ndk/reference/struct/a-neural-networks-operand-type#struct_a_neural_networks_operand_type) nor the dimensions it points to need to outlive the call to [ANeuralNetworksExecution_setOutput](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga7c25ad87c553d207efb257d09e62801e). Since NNAPI feature level 3, the output operand can have unspecified dimensions or rank to be deduced dynamically during the execution. However, the user must provide a large enough buffer. The user can retrieve the output dimensional information after the execution by [ANeuralNetworksExecution_getOutputOperandRank](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga8fb98db582ff0599aade3963694f43f1) and [ANeuralNetworksExecution_getOutputOperandDimensions](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gabefac7caff75fa62ae25964d13d01d61). | | `buffer` | The buffer where the data is to be written. | | `length` | The size of the data value in bytes plus any end padding. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful, ANEURALNETWORKS_BAD_DATA if the name is not recognized or the buffer is too small for the output. |

### ANeuralNetworksExecution_setOutputFromMemory

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksExecution_setOutputFromMemory(
  ANeuralNetworksExecution *execution,
  int32_t index,
  const ANeuralNetworksOperandType *type,
  const ANeuralNetworksMemory *memory,
  size_t offset,
  size_t length
)
```
Associate a region of a memory object with an output of the model of the [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b).

Evaluation of the execution must not have been scheduled. Once evaluation of the execution has been scheduled, the application must not change the content of the region until the execution has completed.

The provided memory must outlive the execution.

If the output is optional, you can indicate that it is omitted by using [ANeuralNetworksExecution_setOutput](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga7c25ad87c553d207efb257d09e62801e) instead, passing nullptr for buffer and 0 for length.

If the memory is an AHardwareBuffer of a format other than AHARDWAREBUFFER_FORMAT_BLOB created from [ANeuralNetworksMemory_createFromAHardwareBuffer](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga75725b8ddd87e837937a576183fe6cd4), or an opaque memory object created from [ANeuralNetworksMemory_createFromDesc](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga75511166bfbf29fb97a63548de8135bc), both offset and length must be 0, indicating the whole memory is used.

Otherwise, if the user has not set the execution to accept padded output memory objects by calling [ANeuralNetworksExecution_enableInputAndOutputPadding](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga0399f20dfdf762c40d03c306749813a3), then the length argument must be equal to the raw size of the output (i.e. the size of an element multiplied by the number of elements). Passing a length argument with value not equal to the raw size of the output will result in ANEURALNETWORKS_BAD_DATA.

Otherwise, if the user has set the execution to accept padded output memory objects by calling [ANeuralNetworksExecution_enableInputAndOutputPadding](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga0399f20dfdf762c40d03c306749813a3), the length argument may be greater than the raw size of the output, and the extra bytes at the end of the memory region may be used by the driver to access data in chunks, for efficiency. Passing a length argument with value less than the raw size of the output will result in ANEURALNETWORKS_BAD_DATA.

This function may only be invoked when the execution is in the preparation state.

See [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) for information on execution states and multithreaded usage. See [ANeuralNetworksMemory_createFromAHardwareBuffer](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga75725b8ddd87e837937a576183fe6cd4) for information on AHardwareBuffer usage. See [ANeuralNetworksMemory_createFromDesc](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga75511166bfbf29fb97a63548de8135bc) for information on usage of memory objects created from memory descriptors. See [ANeuralNetworksCompilation_getPreferredMemoryAlignmentForOutput](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gac2845526b544a627b199cdaa3c189b11) and [ANeuralNetworksCompilation_getPreferredMemoryPaddingForOutput](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga77f3f4057228ca355f249bec368588d0) for information on getting preferred memory alignment and padding, to improve performance.

Available since NNAPI feature level 1.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `execution` | The execution to be modified. | | `index` | The index of the output argument we are setting. It is an index into the lists passed to [ANeuralNetworksModel_identifyInputsAndOutputs](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gacef56268ac6e5e80fa0b4714f57772ce). It is not the index associated with [ANeuralNetworksModel_addOperand](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gabe3ab450ff498af8b3b4b88d5e256a36). | | `type` | The [ANeuralNetworksOperandType](https://developer.android.com/ndk/reference/struct/a-neural-networks-operand-type#struct_a_neural_networks_operand_type) of the operand. This should be used to specify the dimensions that were left unspecified when the operand was added to the model. All other properties of the type must be the same as specified in the model. If the type is the same as specified when the model was built, NULL can be passed. Neither the [ANeuralNetworksOperandType](https://developer.android.com/ndk/reference/struct/a-neural-networks-operand-type#struct_a_neural_networks_operand_type) nor the dimensions it points to need to outlive the call to [ANeuralNetworksExecution_setOutputFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gafcd74c997781e196e081f19108e2c441). Since NNAPI feature level 3, the output operand can have unspecified dimensions or rank to be deduced dynamically during the execution. However, the user must provide a large enough memory. The user can retrieve the output dimensional information after the execution by [ANeuralNetworksExecution_getOutputOperandRank](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga8fb98db582ff0599aade3963694f43f1) and [ANeuralNetworksExecution_getOutputOperandDimensions](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gabefac7caff75fa62ae25964d13d01d61). | | `memory` | The memory where the data is to be stored. | | `offset` | This specifies the location of the data within the memory. The offset is in bytes from the start of memory. | | `length` | The size of the data value in bytes plus any end padding. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful, ANEURALNETWORKS_BAD_DATA if the name is not recognized or the buffer is too small for the output. |

### ANeuralNetworksExecution_setReusable

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksExecution_setReusable(
  ANeuralNetworksExecution *execution,
  bool reusable
)
```
Specifies whether the [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) can be reused for multiple computations.

By default, the [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) is not reusable.

Setting the execution to be reusable enables multiple computations to be scheduled and evaluated on the same execution sequentially, either by means of [ANeuralNetworksExecution_burstCompute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gae4f4b99ab910a2397bf1b857c11f7206), [ANeuralNetworksExecution_compute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga52bfde74591c81eae1ff010199f4a2e2), [ANeuralNetworksExecution_startCompute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5d5dc6f589d19221892c3ccb7b622e33) or [ANeuralNetworksExecution_startComputeWithDependencies](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga371f25c6c44c05f8d267bb6f27ceeb3a): The application may schedule and evaluate a computation again from the completed state of a reusable execution.

This function may only be invoked when the execution is in the preparation state.

See [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) for information on execution states and multithreaded usage.


Available since NNAPI feature level 5. **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `execution` | The execution to be modified. | | `reusable` | 'true' if the execution is to be reusable, 'false' if not. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. ANEURALNETWORKS_UNEXPECTED_NULL if execution is NULL. ANEURALNETWORKS_BAD_STATE if the execution is not in the preparation state. |

### ANeuralNetworksExecution_setTimeout

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksExecution_setTimeout(
  ANeuralNetworksExecution *execution,
  uint64_t duration
)
```
Set the maximum expected duration of the specified execution.

If the device is not able to complete the execution within the specified duration, the execution may be aborted. The timeout duration begins at a call to one of:

- [ANeuralNetworksExecution_burstCompute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gae4f4b99ab910a2397bf1b857c11f7206)
- [ANeuralNetworksExecution_compute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga52bfde74591c81eae1ff010199f4a2e2)
- [ANeuralNetworksExecution_startCompute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5d5dc6f589d19221892c3ccb7b622e33)
- [ANeuralNetworksExecution_startComputeWithDependencies](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga371f25c6c44c05f8d267bb6f27ceeb3a)

<br />

This timeout duration acts as a hint to drivers, and can be used to both free up compute resources within the driver and return control back to the application quicker than is possible without the hint. It enables drivers that are able to estimate how long an execution will take to abort the execution before it has even started if the driver believes the execution cannot be completed within the timeout duration. Similarly, it enables drivers to abort an ongoing execution if it is taking too long. However, this call does not guarantee that the execution will complete or abort within the timeout duration.

By default (i.e., unless ANeuralNetworksExecution_setTimeout is called), the timeout duration for execution is considered infinite.

The [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) must have been created from an [ANeuralNetworksCompilation](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6) which in turn was created from [ANeuralNetworksCompilation_createForDevices](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga3ef5683b170614a689b6e2e7df78aefd) with numDevices = 1, otherwise this function will fail with ANEURALNETWORKS_BAD_DATA. If the device has a feature level reported by [ANeuralNetworksDevice_getFeatureLevel](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5cc923384065f37721fbbd75f80ecfd4) that is lower than [ANEURALNETWORKS_FEATURE_LEVEL_4](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga5ea86afb2f613025b6af63c1f21ac028acbd6a309bf12692b48dabcdfaefde4e4), then the timeout duration hint will be ignored.

This function may only be invoked when the execution is in the preparation state.

See [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) for information on execution states and multithreaded usage.


Available since NNAPI feature level 4. **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `execution` | The execution to be modified. | | `duration` | The maximum amount of time in nanoseconds that is expected to be spent executing a model. If this duration is exceeded, the execution may be aborted. If set to 0, the timeout duration is considered infinite. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. |

### ANeuralNetworksExecution_startCompute

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksExecution_startCompute(
  ANeuralNetworksExecution *execution,
  https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga8b595e8510f91fa0f7d9eaa09fe6c269 **event
)
```
Schedule asynchronous evaluation of the execution.

Schedules asynchronous evaluation of the execution. Once the execution has completed and the outputs are ready to be consumed, the returned event will be signaled. Use [ANeuralNetworksEvent_wait](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9505d7f3b59a0e089d4ce67f293addfa) to wait for that event.

ANeuralNetworksEvent_wait must be called to recuperate the resources used by the execution.

If [ANeuralNetworksExecution_setTimeout](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gab5896a441a236c08b99fcb7a4d02fe83) was called on this execution, and the execution is not able to complete before the timeout duration is exceeded, then execution may be aborted, in which case ANEURALNETWORKS_MISSED_DEADLINE_\* [ResultCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gad8097859ab1bdd06be52a8421df152d4) will be returned through [ANeuralNetworksExecution_startCompute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5d5dc6f589d19221892c3ccb7b622e33) or [ANeuralNetworksEvent_wait](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9505d7f3b59a0e089d4ce67f293addfa) on the event object. If the device has a feature level reported by [ANeuralNetworksDevice_getFeatureLevel](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5cc923384065f37721fbbd75f80ecfd4) that is lower than [ANEURALNETWORKS_FEATURE_LEVEL_4](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga5ea86afb2f613025b6af63c1f21ac028acbd6a309bf12692b48dabcdfaefde4e4), then the timeout duration hint will be ignored.

If this execution contains a [ANEURALNETWORKS_WHILE](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0afdc0927832c42f93845fd9a2361b35f9) operation, and the condition model does not output false within the loop timeout duration, then execution will be aborted and ANEURALNETWORKS_MISSED_DEADLINE_\* [ResultCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gad8097859ab1bdd06be52a8421df152d4) will be returned through [ANeuralNetworksEvent_wait](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9505d7f3b59a0e089d4ce67f293addfa) on the event object.

If the device can detect before the execution has started that the execution will not complete within the timeout duration, the device may choose to skip the execution and instead return ANEURALNETWORKS_MISSED_DEADLINE_\* [ResultCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gad8097859ab1bdd06be52a8421df152d4).

Before NNAPI feature level 5, this function may only be invoked when the execution is in the preparation state. Starting at NNAPI feature level 5, if the user sets the execution to be reusable by [ANeuralNetworksExecution_setReusable](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaa4d2abe06303d6728e4864d8f07c1a3a), this function may also be invoked when the execution is in the completed state.

See [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) for information on execution states and multithreaded usage.

See [ANeuralNetworksExecution_compute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga52bfde74591c81eae1ff010199f4a2e2) for synchronous execution. See [ANeuralNetworksExecution_burstCompute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gae4f4b99ab910a2397bf1b857c11f7206) for burst synchronous execution. See [ANeuralNetworksExecution_startComputeWithDependencies](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga371f25c6c44c05f8d267bb6f27ceeb3a) for asynchronous execution with dependencies.

Available since NNAPI feature level 1.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `execution` | The execution to be scheduled and executed. | | `event` | The event that will be signaled on completion. event is set to NULL if there's an error. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if the evaluation is successfully scheduled. |

### ANeuralNetworksExecution_startComputeWithDependencies

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksExecution_startComputeWithDependencies(
  ANeuralNetworksExecution *execution,
  const ANeuralNetworksEvent *const *dependencies,
  uint32_t num_dependencies,
  uint64_t duration,
  ANeuralNetworksEvent **event
)
```
Schedule asynchronous evaluation of the execution with dependencies.

The execution will wait for all the depending events to be signaled before starting the evaluation. Once the execution has completed and the outputs are ready to be consumed, the returned event will be signaled. Depending on which devices are handling the execution, the event could be backed by a sync fence. Use [ANeuralNetworksEvent_wait](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9505d7f3b59a0e089d4ce67f293addfa) to wait for that event.

ANeuralNetworksEvent_wait must be called to recurperate the resources used by the execution.

If parts of the execution are scheduled on devices that do not support fenced execution, the function call may wait for such parts to finish before returning.

The function will return an error if any of the events in dependencies is already in a bad state. After the execution is scheduled, if any of the events in dependencies does not complete normally, the execution will fail, and [ANeuralNetworksEvent_wait](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9505d7f3b59a0e089d4ce67f293addfa) on the returned event will return an error.

The function will return an error if any of the execution outputs has a tensor operand type that is not fully specified.

The function can be passed a timeout duration in nanoseconds. This timeout duration acts as a hint to drivers in the same way that the timeout durations in [ANeuralNetworksCompilation_setTimeout](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga05fb09e58595a6f1f2ef2fa8b6e9f557) and [ANeuralNetworksExecution_setTimeout](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gab5896a441a236c08b99fcb7a4d02fe83) act as hints to drivers. The duration begins when all waitFor sync fences have been signaled, and can be used together with [ANeuralNetworksExecution_setTimeout](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gab5896a441a236c08b99fcb7a4d02fe83) which specifies the maximum timeout duration beginning at the call to [ANeuralNetworksExecution_startComputeWithDependencies](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga371f25c6c44c05f8d267bb6f27ceeb3a). If the duration is non-zero, the [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) must have been created from an [ANeuralNetworksCompilation](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaaea7d6481c0077bf9547fdb887b55fe6) which in turn was created from [ANeuralNetworksCompilation_createForDevices](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga3ef5683b170614a689b6e2e7df78aefd) with numDevices = 1, otherwise this function will fail with ANEURALNETWORKS_BAD_DATA. If either the timeout duration from [ANeuralNetworksExecution_setTimeout](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gab5896a441a236c08b99fcb7a4d02fe83) or the timeout duration passed to this call is exceeded, the execution may be aborted, in which case ANEURALNETWORKS_MISSED_DEADLINE_\* [ResultCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gad8097859ab1bdd06be52a8421df152d4) will be returned through [ANeuralNetworksExecution_startComputeWithDependencies](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga371f25c6c44c05f8d267bb6f27ceeb3a) or [ANeuralNetworksEvent_wait](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9505d7f3b59a0e089d4ce67f293addfa) on the event object. If the device has a feature level reported by [ANeuralNetworksDevice_getFeatureLevel](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5cc923384065f37721fbbd75f80ecfd4) that is lower than [ANEURALNETWORKS_FEATURE_LEVEL_4](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gga5ea86afb2f613025b6af63c1f21ac028acbd6a309bf12692b48dabcdfaefde4e4), then the timeout duration hints will be ignored.

If this execution contains a [ANEURALNETWORKS_WHILE](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaabbe492c60331b13038e39d4207940e0afdc0927832c42f93845fd9a2361b35f9) operation, and the condition model does not output false within the loop timeout duration, then execution will be aborted and ANEURALNETWORKS_MISSED_DEADLINE_\* [ResultCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gad8097859ab1bdd06be52a8421df152d4) will be returned through [ANeuralNetworksEvent_wait](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9505d7f3b59a0e089d4ce67f293addfa) on the event object.

Before NNAPI feature level 5, this function may only be invoked when the execution is in the preparation state. Starting at NNAPI feature level 5, if the user sets the execution to be reusable by [ANeuralNetworksExecution_setReusable](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaa4d2abe06303d6728e4864d8f07c1a3a), this function may also be invoked when the execution is in the completed state.

See [ANeuralNetworksExecution](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gace4c4f3201c32eba9d18850e86dea33b) for information on execution states and multithreaded usage.

See [ANeuralNetworksExecution_compute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga52bfde74591c81eae1ff010199f4a2e2) for synchronous execution. See [ANeuralNetworksExecution_burstCompute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gae4f4b99ab910a2397bf1b857c11f7206) for burst synchronous execution. See [ANeuralNetworksExecution_startCompute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5d5dc6f589d19221892c3ccb7b622e33) for regular asynchronous execution.


Available since NNAPI feature level 4. **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `execution` | The execution to be scheduled and executed. | | `dependencies` | A set of depending events. The actual evaluation will not start until all the events are signaled. | | `num_dependencies` | The number of events in the dependencies set. | | `duration` | The maximum amount of time in nanoseconds that is expected to be spent executing the model after all dependencies are signaled. If set to 0, the timeout duration is considered infinite. | | `event` | The event that will be signaled on completion. event is set to NULL if there's an error. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if the evaluation is successfully scheduled. |

### ANeuralNetworksMemoryDesc_addInputRole

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksMemoryDesc_addInputRole(
  ANeuralNetworksMemoryDesc *desc,
  const ANeuralNetworksCompilation *compilation,
  uint32_t index,
  float frequency
)
```
Specify that a memory object will be playing the role of an input to an execution created from a particular compilation.

The compilation and the input index fully specify an input operand. This function may be invoked multiple times on the same memory descriptor with different input operands, and the same input operand may be specified on multiple memory descriptors. However, specifying the same input operand on the same memory descriptor more than once will return an error.

The dimensions of the corresponding model operands of all the roles specified by [ANeuralNetworksMemoryDesc_addInputRole](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga3275184f420acc65e5080df7a308f9b7) and [ANeuralNetworksMemoryDesc_addOutputRole](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga26c6391eb75bb83d14702d80fc4f6c41) must be compatible with each other. Two dimensions are incompatible if both ranks are fully specified but have different values, or if there is at least one axis that is fully specified in both but has different values.

At least one of [ANeuralNetworksMemoryDesc_addInputRole](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga3275184f420acc65e5080df7a308f9b7) and [ANeuralNetworksMemoryDesc_addOutputRole](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga26c6391eb75bb83d14702d80fc4f6c41) must be called on a memory descriptor before invoking [ANeuralNetworksMemoryDesc_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5e0c5b7ee674a6e3a011be7957986ec8).

Attempting to modify a memory descriptor once [ANeuralNetworksMemoryDesc_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5e0c5b7ee674a6e3a011be7957986ec8) has been called will return an error.

See [ANeuralNetworksMemoryDesc](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga92661bd0904009e8d0c9e8e1bf40bd84) for information on multithreaded usage.

Available since NNAPI feature level 4.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `desc` | The memory descriptor to be modified. | | `compilation` | The compilation object. It must already have been finished by calling [ANeuralNetworksCompilation_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9ce8960a4c74b9b98878b1798250abde), and must outlive the memory descriptor. | | `index` | The index of the input argument we are referencing from the compilation. It is an index into the inputs list passed to [ANeuralNetworksModel_identifyInputsAndOutputs](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gacef56268ac6e5e80fa0b4714f57772ce). It is not the index associated with [ANeuralNetworksModel_addOperand](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gabe3ab450ff498af8b3b4b88d5e256a36). | | `frequency` | A floating-point value within the range (0.0, 1.0\]. Describes how likely the memory is to be used in the specified role. This is provided as a hint to optimize the case when different roles prefer different memory locations or data layouts. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. |

### ANeuralNetworksMemoryDesc_addOutputRole

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksMemoryDesc_addOutputRole(
  ANeuralNetworksMemoryDesc *desc,
  const ANeuralNetworksCompilation *compilation,
  uint32_t index,
  float frequency
)
```
Specify that a memory object will be playing the role of an output to an execution created from a particular compilation.

The compilation and the output index fully specify an output operand. This function may be invoked multiple times on the same memory descriptor with different output operands, and the same output operand may be specified on multiple memory descriptors. However, specifying the same output operand on the same memory descriptor object more than once will return an error.

The dimensions of the corresponding model operands of all the roles specified by [ANeuralNetworksMemoryDesc_addInputRole](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga3275184f420acc65e5080df7a308f9b7) and [ANeuralNetworksMemoryDesc_addOutputRole](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga26c6391eb75bb83d14702d80fc4f6c41) must be compatible with each other. Two dimensions are incompatible if both ranks are fully specified but have different values, or if there is at least one axis that is fully specified in both but has different values.

At least one of [ANeuralNetworksMemoryDesc_addInputRole](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga3275184f420acc65e5080df7a308f9b7) and [ANeuralNetworksMemoryDesc_addOutputRole](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga26c6391eb75bb83d14702d80fc4f6c41) must be called on the memory descriptor before invoking [ANeuralNetworksMemoryDesc_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5e0c5b7ee674a6e3a011be7957986ec8).

Attempting to modify a memory descriptor once [ANeuralNetworksMemoryDesc_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5e0c5b7ee674a6e3a011be7957986ec8) has been called will return an error.

See [ANeuralNetworksMemoryDesc](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga92661bd0904009e8d0c9e8e1bf40bd84) for information on multithreaded usage.

Available since NNAPI feature level 4.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `desc` | The memory descriptor to be modified. | | `compilation` | The compilation object. It must already have been finished by calling [ANeuralNetworksCompilation_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9ce8960a4c74b9b98878b1798250abde), and must outlive the memory descriptor. | | `index` | The index of the output argument we are referencing from the compilation. It is an index into the outputs list passed to [ANeuralNetworksModel_identifyInputsAndOutputs](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gacef56268ac6e5e80fa0b4714f57772ce). It is not the index associated with [ANeuralNetworksModel_addOperand](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gabe3ab450ff498af8b3b4b88d5e256a36). | | `frequency` | A floating-point value within the range (0.0, 1.0\]. Describes how likely the memory is to be used in the specified role. This is provided as a hint to optimize the case when multiple roles prefer different memory locations or data layouts. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. |

### ANeuralNetworksMemoryDesc_create

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksMemoryDesc_create(
  ANeuralNetworksMemoryDesc **desc
)
```
Create a [ANeuralNetworksMemoryDesc](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga92661bd0904009e8d0c9e8e1bf40bd84) with no properties.

This only creates the memory descriptor. Its properties should be set with calls to [ANeuralNetworksMemoryDesc_addInputRole](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga3275184f420acc65e5080df7a308f9b7), [ANeuralNetworksMemoryDesc_addOutputRole](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga26c6391eb75bb83d14702d80fc4f6c41), and [ANeuralNetworksMemoryDesc_setDimensions](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gac259bcb123a0ea9f868f6aef6b2269c4).

[ANeuralNetworksMemoryDesc_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5e0c5b7ee674a6e3a011be7957986ec8) must be called once all properties have been set.

[ANeuralNetworksMemoryDesc_free](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga010bf0653a9c55f549806c1065636827) must be called once the memory descriptor is no longer needed.

Available since NNAPI feature level 4.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `desc` | The [ANeuralNetworksMemoryDesc](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga92661bd0904009e8d0c9e8e1bf40bd84) to be created. Set to NULL if unsuccessful. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. |

### ANeuralNetworksMemoryDesc_finish

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksMemoryDesc_finish(
  ANeuralNetworksMemoryDesc *desc
)
```
Indicate that we have finished modifying a memory descriptor.

Required before calling [ANeuralNetworksMemory_createFromDesc](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga75511166bfbf29fb97a63548de8135bc).

This function must only be called once for a given memory descriptor.

See [ANeuralNetworksMemoryDesc](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga92661bd0904009e8d0c9e8e1bf40bd84) for information on multithreaded usage.

Available since NNAPI feature level 4.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `desc` | The memory descriptor to be finished. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. |

### ANeuralNetworksMemoryDesc_free

Declared in `android/NeuralNetworks.h`

```
void ANeuralNetworksMemoryDesc_free(
  ANeuralNetworksMemoryDesc *desc
)
```
Destroy a memory descriptor.

The memory descriptor need not have been finished by a call to [ANeuralNetworksMemoryDesc_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5e0c5b7ee674a6e3a011be7957986ec8).

See [ANeuralNetworksMemoryDesc](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga92661bd0904009e8d0c9e8e1bf40bd84) for information on multithreaded usage.

Available since NNAPI feature level 4.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `desc` | The memory descriptor to be destroyed. Passing NULL is acceptable and results in no operation. | |

### ANeuralNetworksMemoryDesc_setDimensions

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksMemoryDesc_setDimensions(
  ANeuralNetworksMemoryDesc *desc,
  uint32_t rank,
  const uint32_t *dimensions
)
```
Set the dimensional information of the memory descriptor.

The specified dimensions must be compatible with the dimensions of the corresponding model operands of all the roles specified by [ANeuralNetworksMemoryDesc_addInputRole](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga3275184f420acc65e5080df7a308f9b7) and [ANeuralNetworksMemoryDesc_addOutputRole](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga26c6391eb75bb83d14702d80fc4f6c41). Two dimensions are incompatible if both ranks are fully specified but have different values, or if there is at least one axis that is fully specified in both but has different values.

Attempting to modify a memory descriptor once [ANeuralNetworksMemoryDesc_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5e0c5b7ee674a6e3a011be7957986ec8) has been called will return an error.

See [ANeuralNetworksMemoryDesc](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga92661bd0904009e8d0c9e8e1bf40bd84) for information on multithreaded usage.

Available since NNAPI feature level 4.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `desc` | The memory descriptor to be modified. | | `rank` | The number of dimensions. Must be 0 for scalars. | | `dimensions` | An array of dimensions. An entry with the value 0 indicates that the corresponding axis has an unknown size. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. |

### ANeuralNetworksMemory_copy

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksMemory_copy(
  const ANeuralNetworksMemory *src,
  const ANeuralNetworksMemory *dst
)
```
Copies data from one memory object to another.

If at most one of the src and dst is created from [ANeuralNetworksMemory_createFromDesc](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga75511166bfbf29fb97a63548de8135bc), the src and dst must have the same logical size:

- If the memory is created from [ANeuralNetworksMemory_createFromFd](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga3a37c44f90bb727dc9eda5f65bb9aa68), or if it is created from [ANeuralNetworksMemory_createFromAHardwareBuffer](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga75725b8ddd87e837937a576183fe6cd4) with format of AHARDWAREBUFFER_FORMAT_BLOB, the logical size equals the size of the memory.
- If the memory is created from [ANeuralNetworksMemory_createFromAHardwareBuffer](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga75725b8ddd87e837937a576183fe6cd4) with a format other than AHARDWAREBUFFER_FORMAT_BLOB, the logical size equals the size when there is no padding and the data is tightly packed. This function may fail if the AHardwareBuffer cannot be accessed.
- If the memory is created from [ANeuralNetworksMemory_createFromDesc](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga75511166bfbf29fb97a63548de8135bc), the logical size equals the size indicated by the [OperandCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaf06d1affd33f3bc698d0c04eceb23298) multiplied by the number of elements. This function will fail if the number of elements is unknown.

<br />

If both src and dst are created from [ANeuralNetworksMemory_createFromDesc](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga75511166bfbf29fb97a63548de8135bc), they must have compatible dimensions. Two dimensions are incompatible if both ranks are fully specified but have different values, or if there is at least one axis that is fully specified in both but has different values. The dst may have unspecified dimensions or rank. In such a case, the dimensions of dst will get updated according to the dimensions of the src.

In both cases, if the src is created from [ANeuralNetworksMemory_createFromDesc](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga75511166bfbf29fb97a63548de8135bc), it must have been used as an output in a successful execution, or used as the destination memory in a successful [ANeuralNetworksMemory_copy](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga58faff2cf57ac7691efc809b83a254da).

The src and dst may have different data layout, in which case the data copying is performed logically with data layout transformation.

Available since NNAPI feature level 4.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `src` | The source memory object. | | `dst` | The destination memory object. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. |

### ANeuralNetworksMemory_createFromAHardwareBuffer

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksMemory_createFromAHardwareBuffer(
  const AHardwareBuffer *ahwb,
  ANeuralNetworksMemory **memory
)
```
Creates a shared memory object from an AHardwareBuffer handle.

If the shared memory is backed by an AHardwareBuffer of AHARDWAREBUFFER_FORMAT_BLOB format, it can be used the same way as shared memory created from a file handle. See [ANeuralNetworksMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9a6b7719f0613ba9e2c93cffd97ebfc0) for a description on how to use this shared memory.

If the shared memory is backed by an AHardwareBuffer of a format other than AHARDWAREBUFFER_FORMAT_BLOB, it can only be used for model inputs and outputs. When calling [ANeuralNetworksExecution_setInputFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga33a63f2ee1b1b17304f76ef8376af224) or [ANeuralNetworksExecution_setOutputFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gafcd74c997781e196e081f19108e2c441) with the shared memory, both offset and length must be set to zero and the entire memory region will be associated with the specified input or output operand. There is no guarantee that an arbitrary AHardwareBuffer_Format and AHardwareBuffer_UsageFlags combination can be used by arbitrary devices. The execution will fail if the selected set of devices cannot consume the buffer.

Calling [ANeuralNetworksModel_setOperandValueFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga0a1bcce272ba5ddfaa3c06a53ac7a6ec) with shared memory backed by an AHardwareBuffer of a format other than AHARDWAREBUFFER_FORMAT_BLOB is disallowed.

The provided AHardwareBuffer must outlive the ANeuralNetworksMemory object.

Available since NNAPI feature level 3.

**See also:** [AHardwareBuffer](https://developer.android.com/ndk/reference/group/a-hardware-buffer#group___a_hardware_buffer_1ga837cf80de697c99501d88bfe2326cfd4)**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `ahwb` | The AHardwareBuffer handle. | | `memory` | The memory object to be created. Set to NULL if unsuccessful. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if the request completed normally. |

### ANeuralNetworksMemory_createFromDesc

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksMemory_createFromDesc(
  const ANeuralNetworksMemoryDesc *desc,
  ANeuralNetworksMemory **memory
)
```
Creates a memory object from a memory descriptor.

The memory object is created with an uninitialized buffer. A memory object with an uninitialized buffer may only be used according to the roles specified by [ANeuralNetworksMemoryDesc_addOutputRole](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga26c6391eb75bb83d14702d80fc4f6c41), or as the destination memory in [ANeuralNetworksMemory_copy](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga58faff2cf57ac7691efc809b83a254da). The buffer of a memory object is initialized after the memory object is used as an output in a successful execution, or used as the destination memory in a successful [ANeuralNetworksMemory_copy](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga58faff2cf57ac7691efc809b83a254da). A memory object with an initialized buffer may be used according to all roles specified in [ANeuralNetworksMemoryDesc](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga92661bd0904009e8d0c9e8e1bf40bd84), or as the source or destination memory in [ANeuralNetworksMemory_copy](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga58faff2cf57ac7691efc809b83a254da). The buffer of a memory object will return to the uninitialized state if the memory object is used as an output in a failed execution, or used as the destination memory in a failed [ANeuralNetworksMemory_copy](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga58faff2cf57ac7691efc809b83a254da).

The dimensions of the memory descriptor are deduced from the dimensions of the corresponding model operands of all the roles specified by [ANeuralNetworksMemoryDesc_addInputRole](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga3275184f420acc65e5080df7a308f9b7) and [ANeuralNetworksMemoryDesc_addOutputRole](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga26c6391eb75bb83d14702d80fc4f6c41), as well as the dimensions set by the call to [ANeuralNetworksMemoryDesc_setDimensions](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gac259bcb123a0ea9f868f6aef6b2269c4), if any. The memory descriptor may have unspecified dimensions or rank. In such a case, the same memory object may be used with different shapes of outputs in different executions. When the memory is used as an input, the input shape must be the same as the output shape from the last execution using this memory object as an output, or the last [ANeuralNetworksMemory_copy](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga58faff2cf57ac7691efc809b83a254da) using this memory object as the destination memory. Creating a memory object with unspecified dimensions or rank may fail for certain sets of roles.

Using the memory in roles or shapes that are not compatible with the rules specified above will return an error.

When calling [ANeuralNetworksExecution_setInputFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga33a63f2ee1b1b17304f76ef8376af224) or [ANeuralNetworksExecution_setOutputFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gafcd74c997781e196e081f19108e2c441) with the memory object, both offset and length must be set to zero and the entire memory region will be associated with the specified input or output operand.

Calling [ANeuralNetworksModel_setOperandValueFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga0a1bcce272ba5ddfaa3c06a53ac7a6ec) with the memory created from this function will return an error.

[ANeuralNetworksMemory_free](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga8db9e0fed5e913a58320fc964288ba70) must be called once the memory is no longer needed.

Attempting to create memory from an unfinished memory descriptor will return an error.

The provided [ANeuralNetworksMemoryDesc](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga92661bd0904009e8d0c9e8e1bf40bd84) need not outlive the [ANeuralNetworksMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9a6b7719f0613ba9e2c93cffd97ebfc0) object.

Available since NNAPI feature level 4.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `desc` | The memory descriptor. | | `memory` | The memory object to be created. Set to NULL if unsuccessful. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful; ANEURALNETWORKS_OP_FAILED if the memory is created with unspecified dimensions or rank and it is not supported for this set of roles. |

### ANeuralNetworksMemory_createFromFd

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksMemory_createFromFd(
  size_t size,
  int protect,
  int fd,
  size_t offset,
  ANeuralNetworksMemory **memory
)
```
Creates a shared memory object from a file descriptor.

The shared memory is backed by a file descriptor via mmap. See [ANeuralNetworksMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga9a6b7719f0613ba9e2c93cffd97ebfc0) for a description on how to use this shared memory.

Available since NNAPI feature level 1.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `size` | The requested size in bytes. Must not be larger than the file size. | | `protect` | The desired memory protection for the mapping. It is either PROT_NONE or the bitwise OR of one or more of the following flags: PROT_READ, PROT_WRITE. | | `fd` | The requested file descriptor. The file descriptor has to be mmap-able. The file descriptor will be duplicated. | | `offset` | The offset to the beginning of the file of the area to map. The offset has to be aligned to a page size. | | `memory` | The memory object to be created. Set to NULL if unsuccessful. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if the request completed normally. |

### ANeuralNetworksMemory_free

Declared in `android/NeuralNetworks.h`

```
void ANeuralNetworksMemory_free(
  ANeuralNetworksMemory *memory
)
```
Delete a memory object.

Destroys the object used by the run time to keep track of the memory. This will free the underlying actual memory if no other code has open handles to this memory.

Available since NNAPI feature level 1.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `memory` | The memory object to be freed. Passing NULL is acceptable and results in no operation. | |

### ANeuralNetworksModel_addOperand

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksModel_addOperand(
  ANeuralNetworksModel *model,
  const ANeuralNetworksOperandType *type
)
```
Add an operand to a model.

The order in which the operands are added is important. The first one added to a model will have the index value 0, the second 1, etc. These indexes are used as operand identifiers in [ANeuralNetworksModel_addOperation](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga21fea9a299a4c1437cf1d280436b5381), [ANeuralNetworksModel_identifyInputsAndOutputs](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gacef56268ac6e5e80fa0b4714f57772ce), [ANeuralNetworksModel_setOperandValue](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga92fd1d7bdf40364620d72fdaaca991f3), [ANeuralNetworksModel_setOperandValueFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga0a1bcce272ba5ddfaa3c06a53ac7a6ec), [ANeuralNetworksExecution_setInput](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gac67f2c8f1ea2136d57bc871da2e6982f), [ANeuralNetworksExecution_setInputFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga33a63f2ee1b1b17304f76ef8376af224), [ANeuralNetworksExecution_setOutput](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga7c25ad87c553d207efb257d09e62801e), and [ANeuralNetworksExecution_setOutputFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gafcd74c997781e196e081f19108e2c441).

Every operand must be referenced in exactly one of the following ways:

- It is identified as a model input with [ANeuralNetworksModel_identifyInputsAndOutputs](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gacef56268ac6e5e80fa0b4714f57772ce).
- It is identified as a constant with [ANeuralNetworksModel_setOperandValue](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga92fd1d7bdf40364620d72fdaaca991f3) or [ANeuralNetworksModel_setOperandValueFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga0a1bcce272ba5ddfaa3c06a53ac7a6ec).
- It is identified as an output of exactly one operation with [ANeuralNetworksModel_addOperation](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga21fea9a299a4c1437cf1d280436b5381).

<br />

An operand that is identified as a model input or as a constant must not also be identified as a model output with [ANeuralNetworksModel_identifyInputsAndOutputs](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gacef56268ac6e5e80fa0b4714f57772ce).

To build a model that can accommodate inputs of various sizes, as you may want to do for a CNN, leave unspecified the dimensions that will vary at run time. If you do so, fully specify dimensions when calling [ANeuralNetworksExecution_setInput](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gac67f2c8f1ea2136d57bc871da2e6982f) or [ANeuralNetworksExecution_setInputFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga33a63f2ee1b1b17304f76ef8376af224).

Attempting to modify a model once [ANeuralNetworksModel_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga74e521efc13d3eba79b8b779b306b53e) has been called will return an error.

See [ANeuralNetworksModel](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ce6f20a94d3a2de47fa5a810feeb9a4) for information on multithreaded usage.

Available since NNAPI feature level 1.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `model` | The model to be modified. | | `type` | The [ANeuralNetworksOperandType](https://developer.android.com/ndk/reference/struct/a-neural-networks-operand-type#struct_a_neural_networks_operand_type) that describes the shape of the operand. Neither the [ANeuralNetworksOperandType](https://developer.android.com/ndk/reference/struct/a-neural-networks-operand-type#struct_a_neural_networks_operand_type) nor the dimensions it points to need to outlive the call to [ANeuralNetworksModel_addOperand](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gabe3ab450ff498af8b3b4b88d5e256a36). | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. |

### ANeuralNetworksModel_addOperation

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksModel_addOperation(
  ANeuralNetworksModel *model,
  ANeuralNetworksOperationType type,
  uint32_t inputCount,
  const uint32_t *inputs,
  uint32_t outputCount,
  const uint32_t *outputs
)
```
Add an operation to a model.


The operands specified by inputs and outputs must have been previously added by calls to [ANeuralNetworksModel_addOperand](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gabe3ab450ff498af8b3b4b88d5e256a36).

| Details ||
|---|---|
| Parameters | |---|---| | `model` | The model to be modified. | | `type` | The [ANeuralNetworksOperationType](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga1aa0c2cbc257093f98d6f0a2eb1932a5) of the operation. | | `inputCount` | The number of entries in the inputs array. | | `inputs` | An array of indexes identifying each operand. | | `outputCount` | The number of entries in the outputs array. | | `outputs` | An array of indexes identifying each operand. | |

Attempting to modify a model once [ANeuralNetworksModel_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga74e521efc13d3eba79b8b779b306b53e) has been called will return an error.

See [ANeuralNetworksModel](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ce6f20a94d3a2de47fa5a810feeb9a4) for information on multithreaded usage.

Available since NNAPI feature level 1.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. |

### ANeuralNetworksModel_create

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksModel_create(
  ANeuralNetworksModel **model
)
```
Create an empty [ANeuralNetworksModel](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ce6f20a94d3a2de47fa5a810feeb9a4).

This only creates the object. Computation is performed once [ANeuralNetworksExecution_burstCompute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gae4f4b99ab910a2397bf1b857c11f7206), [ANeuralNetworksExecution_compute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga52bfde74591c81eae1ff010199f4a2e2), [ANeuralNetworksExecution_startCompute](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5d5dc6f589d19221892c3ccb7b622e33) or [ANeuralNetworksExecution_startComputeWithDependencies](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga371f25c6c44c05f8d267bb6f27ceeb3a) is invoked.

The model should be constructed with calls to [ANeuralNetworksModel_addOperation](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga21fea9a299a4c1437cf1d280436b5381) and [ANeuralNetworksModel_addOperand](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gabe3ab450ff498af8b3b4b88d5e256a36)

[ANeuralNetworksModel_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga74e521efc13d3eba79b8b779b306b53e) should be called once the model has been fully constructed.

[ANeuralNetworksModel_free](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gae124cb448669f2713497107dfa4a563c) should be called once the model is no longer needed.

Available since NNAPI feature level 1.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `model` | The [ANeuralNetworksModel](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ce6f20a94d3a2de47fa5a810feeb9a4) to be created. Set to NULL if unsuccessful. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. |

### ANeuralNetworksModel_finish

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksModel_finish(
  ANeuralNetworksModel *model
)
```
Indicate that we have finished modifying a model.

Required before calling [ANeuralNetworksCompilation_create](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gaa859b1859f1418a7dc739ba7bb5291e8) and [ANeuralNetworksCompilation_createForDevices](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga3ef5683b170614a689b6e2e7df78aefd).

An application must ensure that no other thread uses the model at the same time.

This function must only be called once for a given model.

See [ANeuralNetworksModel](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ce6f20a94d3a2de47fa5a810feeb9a4) for information on multithreaded usage.

Available since NNAPI feature level 1.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `model` | The model to be finished. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. |

### ANeuralNetworksModel_free

Declared in `android/NeuralNetworks.h`

```
void ANeuralNetworksModel_free(
  ANeuralNetworksModel *model
)
```
Destroy a model.

The model need not have been finished by a call to [ANeuralNetworksModel_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga74e521efc13d3eba79b8b779b306b53e).

See [ANeuralNetworksModel](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ce6f20a94d3a2de47fa5a810feeb9a4) for information on multithreaded usage.

Available since NNAPI feature level 1.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `model` | The model to be destroyed. Passing NULL is acceptable and results in no operation. | |

### ANeuralNetworksModel_getSupportedOperationsForDevices

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksModel_getSupportedOperationsForDevices(
  const ANeuralNetworksModel *model,
  const ANeuralNetworksDevice *const *devices,
  uint32_t numDevices,
  bool *supportedOps
)
```
Get the supported operations for a specified set of devices.

If multiple devices are selected, the supported operation list is a union of supported operations of all selected devices.


Available since NNAPI feature level 3. **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `model` | The model to be queried. | | `devices` | The set of devices. Must not contain duplicates. | | `numDevices` | The number of devices in the set. | | `supportedOps` | The boolean array to be filled. True means supported. The size of the boolean array must be at least as large as the number of operations in the model. The order of elements in the supportedOps array matches the order in which the corresponding operations were added to the model. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. |

### ANeuralNetworksModel_identifyInputsAndOutputs

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksModel_identifyInputsAndOutputs(
  ANeuralNetworksModel *model,
  uint32_t inputCount,
  const uint32_t *inputs,
  uint32_t outputCount,
  const uint32_t *outputs
)
```
Specifies which operands will be the model's inputs and outputs.

Every model must have at least one input and one output.

An operand cannot be used for both input and output. Doing so will return an error.


The operands specified by inputs and outputs must have been previously added by calls to [ANeuralNetworksModel_addOperand](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1gabe3ab450ff498af8b3b4b88d5e256a36).

| Details ||
|---|---|
| Parameters | |---|---| | `model` | The model to be modified. | | `inputCount` | The number of entries in the inputs array. | | `inputs` | An array of indexes identifying the input operands. | | `outputCount` | The number of entries in the outputs array. | | `outputs` | An array of indexes identifying the output operands. | |

Attempting to modify a model once [ANeuralNetworksModel_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga74e521efc13d3eba79b8b779b306b53e) has been called will return an error.

See [ANeuralNetworksModel](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ce6f20a94d3a2de47fa5a810feeb9a4) for information on multithreaded usage.

Available since NNAPI feature level 1.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

### ANeuralNetworksModel_relaxComputationFloat32toFloat16

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksModel_relaxComputationFloat32toFloat16(
  ANeuralNetworksModel *model,
  bool allow
)
```
Specifies whether [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) is allowed to be calculated with range and/or precision as low as that of the IEEE 754 16-bit floating-point format.

By default, [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) must be calculated using at least the range and precision of the IEEE 754 32-bit floating-point format.

The relaxComputationFloat32toFloat16 setting of the main model of a compilation overrides the values of the referenced models.


Attempting to modify a model once [ANeuralNetworksModel_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga74e521efc13d3eba79b8b779b306b53e) has been called will return an error.

| Details ||
|---|---|
| Parameters | |---|---| | `model` | The model to be modified. | | `allow` | 'true' indicates [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) may be calculated with range and/or precision as low as that of the IEEE 754 16-bit floating point format. 'false' indicates [ANEURALNETWORKS_TENSOR_FLOAT32](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298aee4bc05d71c31e22e39e05470e965447) must be calculated using at least the range and precision of the IEEE 754 32-bit floating point format. | |

Available since NNAPI feature level 2.

See [ANeuralNetworksModel](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ce6f20a94d3a2de47fa5a810feeb9a4) for information on multithreaded usage. **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

### ANeuralNetworksModel_setOperandSymmPerChannelQuantParams

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksModel_setOperandSymmPerChannelQuantParams(
  ANeuralNetworksModel *model,
  int32_t index,
  const ANeuralNetworksSymmPerChannelQuantParams *channelQuant
)
```
Sets an operand's per channel quantization parameters.

Sets parameters required by a tensor of type [ANEURALNETWORKS_TENSOR_QUANT8_SYMM_PER_CHANNEL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a63c89cf7133314db885eae2abe0acc70). This function must be called for every tensor of type [ANEURALNETWORKS_TENSOR_QUANT8_SYMM_PER_CHANNEL](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ggaf06d1affd33f3bc698d0c04eceb23298a63c89cf7133314db885eae2abe0acc70) before calling [ANeuralNetworksModel_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga74e521efc13d3eba79b8b779b306b53e).

Available since NNAPI feature level 3.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `model` | The model to be modified. | | `index` | The index of the model operand we're setting. | | `channelQuant` | The per channel quantization parameters for the operand. No memory in this struct needs to outlive the call to this function. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. |

### ANeuralNetworksModel_setOperandValue

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksModel_setOperandValue(
  ANeuralNetworksModel *model,
  int32_t index,
  const void *buffer,
  size_t length
)
```
Sets an operand to a constant value.

Values of length smaller or equal to ANEURALNETWORKS_MAX_SIZE_OF_IMMEDIATELY_COPIED_VALUES are immediately copied into the model.

For values of length greater than ANEURALNETWORKS_MAX_SIZE_OF_IMMEDIATELY_COPIED_VALUES, a pointer to the buffer is stored within the model. The application must not change the content of this region until all executions using this model have completed. As the data may be copied during processing, modifying the data after this call yields undefined results. The provided buffer must outlive this model.

For large tensors, using [ANeuralNetworksModel_setOperandValueFromMemory](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga0a1bcce272ba5ddfaa3c06a53ac7a6ec) is likely to be more efficient.

To indicate that an optional operand should be considered missing, pass nullptr for buffer and 0 for length.

Attempting to modify a model once [ANeuralNetworksModel_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga74e521efc13d3eba79b8b779b306b53e) has been called will return an error.

See [ANeuralNetworksModel](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ce6f20a94d3a2de47fa5a810feeb9a4) for information on multithreaded usage.

Available since NNAPI feature level 1.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `model` | The model to be modified. | | `index` | The index of the model operand we're setting. | | `buffer` | A pointer to the data to use. | | `length` | The size in bytes of the data value. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. |

### ANeuralNetworksModel_setOperandValueFromMemory

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksModel_setOperandValueFromMemory(
  ANeuralNetworksModel *model,
  int32_t index,
  const ANeuralNetworksMemory *memory,
  size_t offset,
  size_t length
)
```
Sets an operand to a value stored in a memory object.

The content of the memory is not copied. A reference to that memory is stored inside the model. The application must not change the content of the memory region until all executions using this model have completed. As the data may be copied during processing, modifying the data after this call yields undefined results.

The provided memory must outlive this model.

To indicate that an optional operand should be considered missing, use [ANeuralNetworksModel_setOperandValue](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga92fd1d7bdf40364620d72fdaaca991f3) instead, passing nullptr for buffer.

It is disallowed to set an operand value with shared memory backed by an AHardwareBuffer of a format other than AHARDWAREBUFFER_FORMAT_BLOB.

It is disallowed to set an operand value with memory created from [ANeuralNetworksMemory_createFromDesc](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga75511166bfbf29fb97a63548de8135bc).

Attempting to modify a model once [ANeuralNetworksModel_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga74e521efc13d3eba79b8b779b306b53e) has been called will return an error.

See [ANeuralNetworksModel](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ce6f20a94d3a2de47fa5a810feeb9a4) for information on multithreaded usage. See [ANeuralNetworksMemory_createFromAHardwareBuffer](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga75725b8ddd87e837937a576183fe6cd4) for information on AHardwareBuffer usage.

Available since NNAPI feature level 1.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `model` | The model to be modified. | | `index` | The index of the model operand we're setting. | | `memory` | The memory containing the data. | | `offset` | This specifies the location of the data within the memory. The offset is in bytes from the start of memory. | | `length` | The size in bytes of the data value. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. |

### ANeuralNetworksModel_setOperandValueFromModel

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworksModel_setOperandValueFromModel(
  ANeuralNetworksModel *model,
  int32_t index,
  const ANeuralNetworksModel *value
)
```
Sets an operand to a value that is a reference to another NNAPI model.

The referenced model must already have been finished by a call to [ANeuralNetworksModel_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga74e521efc13d3eba79b8b779b306b53e).

The [ANeuralNetworksModel_relaxComputationFloat32toFloat16](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga21cc8614f46a1553063b8b86d09ce75d) setting of referenced models is overridden by that setting of the main model of a compilation.

The referenced model must outlive the model referring to it.

Attempting to modify a model once [ANeuralNetworksModel_finish](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga74e521efc13d3eba79b8b779b306b53e) has been called will return an error.

See [ANeuralNetworksModel](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga4ce6f20a94d3a2de47fa5a810feeb9a4) for information on multithreaded usage.

Available since NNAPI feature level 4.

**[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `model` | The model to be modified. | | `index` | The index of the model operand we're setting. | | `value` | The model to be referenced. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. |

### ANeuralNetworks_getDefaultLoopTimeout

Declared in `android/NeuralNetworks.h`

```
uint64_t ANeuralNetworks_getDefaultLoopTimeout()
```
Get the default timeout value for WHILE loops.


Available since NNAPI feature level 4. **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| **Returns** | The default timeout value in nanoseconds. |

### ANeuralNetworks_getDevice

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworks_getDevice(
  uint32_t devIndex,
  ANeuralNetworksDevice **device
)
```
Get the representation of the specified device.


Available since NNAPI feature level 3. **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `devIndex` | The index of the specified device. Must be less than the number of available devices. | | `device` | The representation of the specified device. The same representation will always be returned for the specified device. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. |

### ANeuralNetworks_getDeviceCount

Declared in `android/NeuralNetworks.h`

```
int ANeuralNetworks_getDeviceCount(
  uint32_t *numDevices
)
```
Get the number of available devices.


Available since NNAPI feature level 3. **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| Parameters | |---|---| | `numDevices` | Used to return the number of devices. | |
| **Returns** | ANEURALNETWORKS_NO_ERROR if successful. |

### ANeuralNetworks_getMaximumLoopTimeout

Declared in `android/NeuralNetworks.h`

```
uint64_t ANeuralNetworks_getMaximumLoopTimeout()
```
Get the maximum timeout value for WHILE loops.


Available since NNAPI feature level 4. **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.

| Details ||
|---|---|
| **Returns** | The maximum timeout value in nanoseconds. |

### ANeuralNetworks_getRuntimeFeatureLevel

Declared in `android/NeuralNetworks.h`

```
int64_t ANeuralNetworks_getRuntimeFeatureLevel()
```
Get the NNAPI runtime feature level.

Since API level 31 (NNAPI feature level 5), the NNAPI runtime (libneuralnetworks.so) and its API specification can be updated between Android API releases.

On Android devices with API level 31 and newer, for NNAPI runtime feature discovery, the NNAPI runtime feature level must be used instead of the Android device API level.

On Android devices with API level 30 and older, the Android API level of the Android device must be used for NNAPI runtime feature discovery. Enum values in [FeatureLevelCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5ea86afb2f613025b6af63c1f21ac028) from feature level 1 to 5 have their corresponding Android API levels listed in their documentation, and each such enum value equals the corresponding API level. This allows using the Android API level as the feature level. This mapping between enum value and Android API level does not exist for feature levels after NNAPI feature level 5 and API levels after S (31).

Example usage: int device_api_level = [android_get_device_api_level()](https://developer.android.com/ndk/reference/group/apilevels#group__apilevels_1ga79b134cadc2dfed84268e67fd9e2dfd6); int64_t runtime_feature_level = (device_api_level \< **ANDROID_API_S** ) ? device_api_level : [ANeuralNetworks_getRuntimeFeatureLevel()](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga70048cdcbc0ec44b141f20eda9d086a5);

Runtime feature level is closely related to NNAPI device feature level ([ANeuralNetworksDevice_getFeatureLevel](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5cc923384065f37721fbbd75f80ecfd4)), which indicates an NNAPI device feature level (the most advanced NNAPI specification and features that the driver implements). This function expresses NNAPI runtime feature level, which indicates the most advanced NNAPI specification and features the runtime implements. An NNAPI device feature level is always less than or equal to the runtime feature level.

This function returns a [FeatureLevelCode](https://developer.android.com/ndk/reference/group/neural-networks#group___neural_networks_1ga5ea86afb2f613025b6af63c1f21ac028) enum value, which is the NNAPI specification version that this NNAPI runtime implements. It is NOT an Android API level.

Available since NNAPI feature level 5. **[Deprecated.](https://developer.android.com/ndk/reference/deprecated/deprecated)** NNAPI is deprecated. See [this webpage](https://developer.android.com/ndk/guides/neuralnetworks) for more details.