1684-tpu-kernel相关

# TPU-Kernel Samples ## 1. Introduction TPU-Kernel Development Kit provides an easy way to program on TPU directly. Developers can write their codes on device(TPU) and host with C/CPP languages. The device codes will be compiled with the base firmware lib into a full firmware that can be loaded by driver. When the full firmware is loaded, The host codes can call the communication interface to pass the customed protocol parameters to device, and run the functions customized. TPU-Kernel will be used to fulfill the following cases: * Some high-performance senario, such as pre-process, post-processing * Implement some customed algorithm to do computationally intensive tasks * Research on BM1684X architecture and Instruction Sets Here is the main content introduction in TPU-Kernel Development Kit ``` shell ├── README.md # the current file ├── doc │   └── TPU-KERNEL开发参考手册.pdf ├── scripts │   ├── envsetup.sh # set up the environment, including downloading toolchains and set up env │   └── ... ├── include │ ├── tpu_defs.h # some common definitions, can be used for both host and device codes │   ├── tpu_fp16.h # fp16 definitions │   ├── common.h # some type definitions │ ├── device/tpu_kernel.h # device operators interface, ONLY allowed used in device codes │ └── ... ├── lib │ ├── libbm1684x.a # the base firmware lib for device codes to be linked to │ └── ... ├── samples # some samples to demonstrate how to develop │   ├── README.md # usage for compiling and using the codes │   ├── host # codes running on the host │   ├── device # codes running on the device(TPU) │   ├── include # the protocol parameters for host and device communication │   └── ... └── firmware    └── bm1684x.bin_v<VERSION>-<COMMIT>-<DATA> # original firmware to restore the device system ``` ## 2. Environment Set Up TPU-Kernel Development Kit depends on libsophon and cross toolchains ### Install libsophon-dev and driver The following deb package should be downloaded from sophgo website first: * sophon-libsophon_*.deb * sophon-libsophon-dev_*.deb * sophon-driver_*.deb and install: ``` shell sudo dpkg -i sophon-driver*.deb sudo dpkg -i sophon-libsophon*.deb ``` ### Install cross toolchains The following cross compilers will be used for TPU-Kernel development * [gcc-linaro-6.3.1-2017.05-x86_64_aarch64-linux-gnu](https://releases.linaro.org/components/toolchain/binaries/6.3-2017.05/aarch64-linux-gnu/gcc-linaro-6.3.1-2017.05-x86_64_aarch64-linux-gnu.tar.xz) * [gcc-arm-10.3-2021.07-x86_64-aarch64-none-elf](https://developer.arm.com/-/media/Files/downloads/gnu-a/10.3-2021.07/binrel/gcc-arm-10.3-2021.07-x86_64-aarch64-none-elf.tar.xz) We provide an easy way to download and initialize: ``` shell source scripts/envsetup.sh # the scripts do the following things: # 1. Check existance of toolchains_dir # 2. If needed, download the cross toolchains into 'toolchains_dir' # 3. Set CROSS_TOOLCHAINS environment variable. # 4. Set TPU-Kernel base dir to TPUKERNEL_TOP for writing build scripts or other use ``` If you have cross toolchains already, just run the following commands to avoid downloading toolchains from Internet ``` shell export CROSS_TOOLCHAINS=path/to/your/toolchains source scripts/envsetup.sh ``` ## 3. More * Directory 'samples' contains some typical operators including GEMM, TopK and some CV ops, guiding developers to learn how to programming on TPU, how to map algorithm on TPU properly, and so on. * Directory 'doc' provides the programming reference which reveal many TPU details and interfaces can be used.