#

inference-acceleration

Here are 6 public repositories matching this topic...

autonomi-ai / nos

⚡️ A fast and flexible PyTorch inference server that runs locally, on any cloud or AI HW.

machine-learning computer-vision inference inference-acceleration generative-ai llm-inference

Updated May 23, 2024
Python

jagennath-hari / DepthStream-Accelerator-ROS2-Integrated-Monocular-Depth-Inference

DepthStream Accelerator: A TensorRT-optimized monocular depth estimation tool with ROS2 integration for C++. It offers high-speed, accurate depth perception, perfect for real-time applications in robotics, autonomous vehicles, and interactive 3D environments.

computer-vision deep-learning robotics depth-estimation ros2 monocular-depth-estimation inference-acceleration tensorrt-inference vision-tranformer

Updated Nov 14, 2023
Jupyter Notebook

marty1885 / scirknn

Convert and run scikit-learn MLPs on Rockchip NPU.

scikit-learn rockchip npu inference-acceleration rknn rk3588 rk3566 rknpu2

Updated Jul 13, 2023
Python

fangvv / TLEE

Code for paper "TLEE: Temporal-wise and Layer-wise Early Exiting Network for Efficient Video Recognition on Edge Devices"

inference dnn deep-learning-algorithms resnet action-recognition content-analysis video-recognition video-analytics frame-analysis early-exiting inference-acceleration dynamic-inference dnn-inference

Updated Jul 8, 2023
Python

Bisonai / ncnn

Modified inference engine for quantized convolution using product quantization

quantization product-quantization edge-machine-learning inference-optimization mobile-deep-learning inference-acceleration

Updated Jul 1, 2022
C++

fangvv / MTACP

Code for paper "Deep Reinforcement Learning based Multi-task Automated Channel Pruning for DNNs"

deep-learning impala deep-reinforcement-learning dnn distributed neural-networks reinforcement-learning-algorithms nas multi-task prunning ijcnn inference-acceleration network-architecture-search

Updated Aug 25, 2023
Python

Improve this page

Add a description, image, and links to the inference-acceleration topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the inference-acceleration topic, visit your repo's landing page and select "manage topics."