Containerized inference microservices providing prebuilt APIs for popular AI models on NVIDIA accelerated infrastructure.
NVIDIA NIM is a catalog of containerized inference microservices that package optimized foundation models, retrieval models, vision models, and biology models behind standard REST APIs. Each microservice ships with the model, TensorRT and Triton-based runtime, and tuned configurations for NVIDIA GPUs.
Developers consume NIM through the NVIDIA API catalog at build.nvidia.com or deploy the containers behind a firewall through NVIDIA AI Enterprise on Kubernetes. NIM Agent Blueprints and NeMo microservices extend NIM for agent, RAG, and customer service workloads.
| Attribute | NIM | AI Model Hub, Hugging Face Inference Endpoints | Amazon Bedrock | Fireworks AI Inference | GroqCloud | Modal Cloud | OpenAI API | Replicate Cloud | Together AI Inference | Vertex AI | |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Provider | |||||||||||
| Founded | 1993 | 2016 | 2006 | 2022 | 2016 | 2021 | 2015 | 2019 | 2022 | 1998 | |
| Sells To | Consumers, Enterprise | — | Small Business | Enterprise | Enterprise | Enterprise | Enterprises, Individuals | Enterprise, Small Business | Enterprise | Consumers, Enterprise | |
| Pricing Model | Licensing, Product Sales, Subscription | Usage-based | Recurring | Recurring | Recurring | Recurring, Software | Subscription, Usage-based | Recurring, Software, Usage-based | Recurring | Advertising, Recurring, Transactional | |
| Ownership | Public | Private, Venture Capital | Public | Venture Capital | Venture Capital | Venture Capital | Private, Public Benefit Corporation | Venture Capital | Venture Capital | Public |
Provider NVIDIAnvidia.com$24.1B raised · Public
Founded 1993
Sells To Consumers, Enterprise
Pricing Model Licensing, Product Sales, Subscription
Ownership Public
Provider 
Founded 2016
Sells To —
Pricing Model Usage-based
Ownership Private, Venture Capital
Provider 
Founded 2006
Sells To Small Business
Pricing Model Recurring
Ownership Public
Provider 
Founded 2022
Sells To Enterprise
Pricing Model Recurring
Ownership Venture Capital
Provider 
Founded 2016
Sells To Enterprise
Pricing Model Recurring
Ownership Venture Capital

bVisor

Sailboxes