Typescript SDK for Model Context Protocol servers and clients

LLM inference in C/C++

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

CUDA Core Compute Libraries

cuEquivariance is a math library that is a collective of low-level primitives and tensor ops to accelerate widely-used models, like DiffDock, MACE, Allegro and NEQUIP, based on equivariant neural networks. Also includes kernels for accelerated structure prediction.

Run malcontent security scanner on pull requests to detect malicious behavior changes between commits

Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

The NVIDIA NeMo Agent toolkit is an open-source library for efficiently connecting and optimizing teams of AI agents.

Open-source deep-learning framework for exploring, building and deploying AI weather/climate workflows.

AIStore: scalable storage for AI applications