FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, FEDML Nexus AI (https://fedml.ai) is your generative AI platform at scale.

[ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deployment

MicroPython for K210 RISC-V, let's play with edge AI easier

🦖 Stateful Serverless Framework for building Geo-distributed Edge AI Infra

Deep learning gateway on Raspberry Pi and other edge devices

Real-time portrait segmentation for mobile devices

speech to text benchmark framework

On-Device Training Under 256KB Memory [NeurIPS'22]

A curated list of awesome edge computing, including Frameworks, Simulators, Tools, etc.

A DNN inference latency prediction toolkit for accurately modeling and predicting the latency on diverse edge devices.

An embedded vector database designed to run on edge devices. Lightweight and fast with HNSW indexing algorithm.

💜 The best free Telegram bot for ChatGPT, Microsoft Copilot (aka Bing AI / Sidney / EdgeGPT), Microsoft Copilot Designer (aka BingImageCreator), Gemini and Groq with stream writing, requests with images, multiple languages, admin control, data logging and more!

Model Compression Toolkit (MCT) is an open source project for neural network model optimization under efficient, constrained hardware. This project provides researchers, developers, and engineers advanced quantization and compression tools for deploying state-of-the-art neural networks.

Dual Edge TPU Adapter to use it on a system with single PCIe port on m.2 A/B/E/M slot

Jetson Nano-based smart camera system that measures crowd face mask usage in real-time.

Neuralet is an open-source platform for edge deep learning models on edge TPU, Jetson Nano, and more.

On-device, Offline Spleeter Solution For Mobile

Python sdk for Sipeed Maix-II-Dock(v831). Other board please use https://github.com/sipeed/MaixPy

Social Distancing Detector using deep learning and capable to run on edge AI devices such as NVIDIA Jetson, Google Coral, and more.

FEDn: A production-grade, open federated learning framework. This repository contains the open source Python framework, CLI and API.