ggml-org/llama.cpp

LLM inference in C/C++

microsoft/BitNet

Official inference framework for 1-bit LLMs

FreeCAD/FreeCAD

Official source code of FreeCAD, a free and opensource multiplatform 3D parametric modeler.

openxla/xla

A machine learning compiler for GPUs, CPUs, and ML accelerators

tnodir/fort

Fort Firewall for Windows

zeux/meshoptimizer

Mesh optimization library that makes meshes smaller and faster to render

ROCm/FastFlowLM

Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.

kvcache-ai/Mooncake

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

microsoft/intelligent-terminal

A fork of Windows Terminal with native agent integration, right in your command line.

react/react-native

A framework for building native applications using React

ggml-org/ggml

Tensor library for machine learning

NVIDIA-AI-Blueprints/video-search-and-summarization

NVIDIA AI Blueprint for video search and summarization (VSS) is a GPU-accelerated reference architecture for building video analytics agents with real-time verified alerts, visual Q&A, and automated reporting. The VSS Blueprint uses vision language models (VLMs) such as NVIDIA Cosmos, LLMs such as NVIDIA Nemotron, RAG, and NVIDIA NIMs.

NVIDIA/cccl

CUDA Core Compute Libraries

cactus-compute/cactus

Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.

google-ai-edge/LiteRT

LiteRT, successor to TensorFlow Lite. is Google's On-device framework for high-performance ML & GenAI deployment on edge platforms, via efficient conversion, runtime, and optimization

ClickHouse/ClickHouse

ClickHouse® is a real-time analytics database management system

ApolloAuto/apollo

An open autonomous driving platform

mnh-jansson/open-battery-information

NVIDIA/cutlass

CUDA Templates and Python DSLs for High-Performance Linear Algebra