Containerized inference microservices providing prebuilt APIs for popular AI models on NVIDIA accelerated infrastructure.
NVIDIA NIM is a catalog of containerized inference microservices that package optimized foundation models, retrieval models, vision models, and biology models behind standard REST APIs. Each microservice ships with the model, TensorRT and Triton-based runtime, and tuned configurations for NVIDIA GPUs.
Developers consume NIM through the NVIDIA API catalog at build.nvidia.com or deploy the containers behind a firewall through NVIDIA AI Enterprise on Kubernetes. NIM Agent Blueprints and NeMo microservices extend NIM for agent, RAG, and customer service workloads.
| Attribute | NIM | AI Model Hub, Hugging Face Inference Endpoints | Amazon Bedrock | Fireworks AI Inference | GroqCloud | Modal Cloud | OpenAI API | Replicate Cloud | Together AI Inference | |
|---|---|---|---|---|---|---|---|---|---|---|
| Provider | ||||||||||
| Founded | 1993 | 2016 | 2006 | 2022 | 2016 | 2021 | 2015 | 2019 | 2022 | |
| Sells To | Consumers, Enterprise | — | Small Business | Enterprise | Enterprise | Enterprise | Enterprises, Individuals | Enterprise, Small Business | Enterprise | |
| Pricing Model | Licensing, Product Sales, Subscription | Usage-based | Recurring | Recurring | Recurring | Recurring, Software | Subscription, Usage-based | Recurring, Software, Usage-based | Recurring | |
| Ownership | Public | Private, Venture Capital | Public | Venture Capital | Venture Capital | Venture Capital | Private, Public Benefit Corporation | Venture Capital | Venture Capital |
Provider NVIDIAnvidia.com$24.1B raised · Public
Founded 1993
Sells To Consumers, Enterprise
Pricing Model Licensing, Product Sales, Subscription
Ownership Public
Provider
Hugging Facehuggingface.co$396.4M raised · Series D
Founded 2016
Sells To —
Pricing Model Usage-based
Ownership Private, Venture Capital
Provider
Amazon Web Servicesaws.amazon.comPublic
Founded 2006
Sells To Small Business
Pricing Model Recurring
Ownership Public
Provider
Fireworks AIfireworks.ai$327M raised · Series C
Founded 2022
Sells To Enterprise
Pricing Model Recurring
Ownership Venture Capital
Provider
Groqgroq.com$362.6M raised · Series C
Founded 2016
Sells To Enterprise
Pricing Model Recurring
Ownership Venture Capital