npu package#
Subpackages#
- npu.build package
- Submodules
- npu.build.appbuilder module
AppBuilderAppBuilder.nameAppBuilder.abAppBuilder.fxtracerAppBuilder.kernelsAppBuilder.connectionsAppBuilder.previous_build_argsAppBuilder.build()AppBuilder.callgraph()AppBuilder.display()AppBuilder.displaymlir()AppBuilder.merge_applications()AppBuilder.metadataAppBuilder.save()AppBuilder.to_handoff()AppBuilder.to_json()AppBuilder.to_metadata()AppBuilder.to_mlir()AppBuilder.to_sequence()AppBuilder.unique_named()AppBuilder.validate_previous_build_args()
- npu.build.appmetadata module
- npu.build.apptracer module
- npu.build.appxclbinbuilder module
- npu.build.buffers module
- npu.build.connections module
- npu.build.itkernel module
- npu.build.kernel module
- npu.build.kernelbuilder module
- npu.build.kernelmeta module
KernelMetaKernelMeta.nameKernelMeta.shortnameKernelMeta.ktypeKernelMeta.ttypeKernelMeta.portsKernelMeta.tlocKernelMeta.disable_unique_name_idKernelMeta.bufferportsKernelMeta.inputbufferportsKernelMeta.metadataKernelMeta.outputbufferportsKernelMeta.reset_unique_names()KernelMeta.rtpportsKernelMeta.to_metadata()KernelMeta.unique_name()KernelMeta.used_names
- npu.build.mlirbuilder module
- npu.build.mlirconnections module
- npu.build.mlirsequencebuilder module
MLIRSequnceBuilderMLIRSequnceBuilder._metadataMLIRSequnceBuilder.aietilesMLIRSequnceBuilder._userbuffersMLIRSequnceBuilder._ubname2externidMLIRSequnceBuilder._ingress_ubMLIRSequnceBuilder._egress_ubMLIRSequnceBuilder._ingress_egress_ubMLIRSequnceBuilder._constants_tableMLIRSequnceBuilder._cons_broadcastsMLIRSequnceBuilder.mlir
UBDataMovement
- npu.build.mlirtiles module
- npu.build.mtkernel module
- npu.build.port module
- npu.build.sequence module
- npu.build.tracekernels module
- npu.build.tracelogger module
- npu.build.userspace module
- npu.build.utils module
- npu.build.wslbuilder module
- Module contents
- npu.lib package
- Subpackages
- npu.lib.applications package
- npu.lib.cached package
- npu.lib.kernels package
- Submodules
- npu.lib.kernels.addweighted module
- npu.lib.kernels.bitwiseand module
- npu.lib.kernels.bitwiseor module
- npu.lib.kernels.filter2d module
- npu.lib.kernels.gray2rgba module
- npu.lib.kernels.inrange module
- npu.lib.kernels.inverse module
- npu.lib.kernels.kernelgenerator module
- npu.lib.kernels.median module
- npu.lib.kernels.plusn module
- npu.lib.kernels.rgba2gray module
- npu.lib.kernels.rgba2hue module
- npu.lib.kernels.rgba_inverse module
- npu.lib.kernels.threshold module
- Module contents
- Module contents
- Subpackages
- npu.runtime package
- Submodules
- npu.runtime.aie_host_utils module
- npu.runtime.apprunner module
- npu.runtime.kernelinstance module
- npu.runtime.pyxrt module
bodeviceert_cmd_stateert_cmd_state.ERT_CMD_STATE_ABORTert_cmd_state.ERT_CMD_STATE_COMPLETEDert_cmd_state.ERT_CMD_STATE_ERRORert_cmd_state.ERT_CMD_STATE_NEWert_cmd_state.ERT_CMD_STATE_NORESPONSEert_cmd_state.ERT_CMD_STATE_QUEUEDert_cmd_state.ERT_CMD_STATE_SKCRASHEDert_cmd_state.ERT_CMD_STATE_SKERRORert_cmd_state.ERT_CMD_STATE_SUBMITTEDert_cmd_state.ERT_CMD_STATE_TIMEOUTert_cmd_state.nameert_cmd_state.value
hw_contextkernelrunuuidxclBOSyncDirectionxclbinxclbinip_vectorxclbinkernel_vectorxclbinmem_vectorxrt_info_devicexrt_info_device.bdfxrt_info_device.dynamic_regionsxrt_info_device.electricalxrt_info_device.hostxrt_info_device.interface_uuidxrt_info_device.kdmaxrt_info_device.m2mxrt_info_device.max_clock_frequency_mhzxrt_info_device.mechanicalxrt_info_device.memoryxrt_info_device.namexrt_info_device.nodmaxrt_info_device.offlinexrt_info_device.pcie_infoxrt_info_device.platformxrt_info_device.thermalxrt_info_device.valuexrt_info_device.vmr
- npu.runtime.sequence module
- Module contents
- npu.utils package
- Submodules
- npu.utils.aiekernels module
- npu.utils.appviz module
- npu.utils.display_widget module
- npu.utils.imgplot module
- npu.utils.imgread module
- npu.utils.nputop module
- npu.utils.svg module
AieTileBoxIfTileImageKernelKernelArcMemTileMemoryBoxRyzenAiArrayRyzenAiArray.draw_app_box()RyzenAiArray.draw_system_memory()RyzenAiArray.generate_svg()RyzenAiArray.generate_svg_image()RyzenAiArray.hide_aie_tiles()RyzenAiArray.hide_if_tiles()RyzenAiArray.hide_interconnect()RyzenAiArray.hide_mem_tiles()RyzenAiArray.hide_memory_connections()RyzenAiArray.hide_tiles()RyzenAiArray.show_aie_tiles()RyzenAiArray.show_if_tiles()RyzenAiArray.show_interconnect()RyzenAiArray.show_mem_tiles()RyzenAiArray.show_tiles()RyzenAiArray.update_hidden_tiles()
RyzenAiColumnRyzenAiColumn.draw_system_memory()RyzenAiColumn.generate_column_svg()RyzenAiColumn.generate_image()RyzenAiColumn.generate_key()RyzenAiColumn.hide_compute_tile()RyzenAiColumn.hide_interface_tile()RyzenAiColumn.hide_memory_tile()RyzenAiColumn.show_compute_tile()RyzenAiColumn.show_interface_tile()RyzenAiColumn.show_memory_tile()
SystemMemoryTileTile.add_ic_animation()Tile.add_single_tile_ic_animation()Tile.add_single_tile_mem_animation()Tile.clear_ic_animation()Tile.draw_ic_connections()Tile.get_hide_tile_svg()Tile.get_ic_animations_svg()Tile.get_ic_connections_svg()Tile.get_memory_animations_svg()Tile.get_memory_connections_svg()Tile.get_tile_svg()Tile.hide_tile()Tile.show_all()Tile.show_tile()
- npu.utils.svg_config module
- npu.utils.test_device module
- npu.utils.videoapps module
- npu.utils.xbutil module
- Module contents
Submodules#
npu.magic module#
- class npu.magic.kernel_magic(shell)#
Bases:
Magics- kernel(_, cell)#
Specify a compute tile C++ kernel and return an npu.build.Kernel object.
This cell magic command allows users to input C++ kernel code within a Jupyter notebook cell. It then returns a corresponding Kernel object that can be compiled into an object file for use in a Riallto application. The Cpp source must return a void type, input and output buffers are specified as pointer types, as parameters are specified with non-pointer types.
Header files included in the directory where the notebook is are permitted.
- Parameters:
cell (str) – The string content of the cell, expected to be C++ code defining the kernel.
- Returns:
Kernel – Returns a Kernel object that has the same name as the last function defined in the cell magic. See npu.build.Kernel.
- Return type:
object
Examples
In a Jupyter notebook %%kernel cell
- void passthrough(uint8_t in_buffer, uint8_t out_buffer, uint32_t nbytes) {
- for(int i=0; i<nbytes; i++) {
out_buffer[i] = in_buffer[i];
}
}
This will construct a passthrough npu.build.Kernel object that can be used within a callgraph to construct a complete application.
- magics = {'cell': {'kernel': 'kernel'}, 'line': {}}#
- registered = True#
npu.repr_dict module#
- class npu.repr_dict.ReprDict(*args, rootname='root', expanded=False, **kwargs)#
Bases:
dictSubclass of the built-in dict that will display using the JupyterLab JSON repr.
The class is recursive in that any entries that are also dictionaries will be converted to ReprDict objects when returned.
Module contents#
NPU#
Documentation is available in the docstrings and online at https://riallto.ai.
- Provides
An easy-to-use runtime library to run custom applications on the NPU.
APIs for building custom applications.
Useful utilities to test and introspect your designs.
Available subpackages#
- build
Tools for building applications.
- lib
Libraries of prebuilt kernels and graphs.
- runtime
Runtime libraries based on XRT.
- utils
Utilities for building, testing and visualization.