NVIDIA NGC Catalog 🛒

NVIDIA’s app store / registry for GPU software and AI infrastructure.

• Docker Hub: General containers
• NGC: GPU-optimized AI infrastructure ecosystem

NGC vs Docker Hub

NGC provides: Production-ready NVIDIA AI software optimized for GPUs.

Feature	Docker Hub	NGC
General containers	Yes	Limited
GPU optimization	Limited	Excellent
CUDA integration	Manual	Native
AI optimization	Limited	Excellent
NVIDIA support	No	Native
Enterprise AI focus	Moderate	Strong

Why NGC Matters

Without NGC:

• CUDA setup is difficult
• dependency compatibility becomes painful
• GPU optimization requires manual work

NGC simplifies:

• deployment
• reproducibility
• GPU optimization
• enterprise AI operations

What NGC Provides

NGC contains optimized resources for:

Category	Examples
AI Frameworks	PyTorch, TensorFlow
LLMs	Llama, Nemotron
Containers	CUDA, Triton, RAPIDS
Inference	TensorRT-LLM
Training	NeMo
HPC	MPI, CUDA HPC SDK
Kubernetes	GPU Operator
AI Services	NVIDIA NIM

NGC provides:

• pre-trained AI models
• Docker containers
• CUDA images
• TensorRT images
• NeMo models
• Helm charts
• Kubernetes resources
• inference microservices

NGC Architecture

flowchart TD

    A["NGC Catalog"]
        --> B["Containers 🐳"]

    A --> C["Pretrained Models"]

    A --> D["Helm Charts 🪖"]

    A --> E["AI Microservices"]

    B --> F["Kubernetes / Docker ☸️"]

    C --> G["Training / Inference"]

    E --> H["Production AI APIs"]

NGC Containers 🐳

NGC provides GPU-optimized containers.

Examples:

• PyTorch containers
• TensorRT containers
• Triton containers
• RAPIDS containers

These containers already include:

• CUDA
• cuDNN
• NCCL
• optimized drivers
• dependencies

Example NGC Workflow

flowchart TD

    A["NGC Container 📦"]
        --> B["Docker / Kubernetes 🐳"]

    B --> C["CUDA Runtime 📟"]

    C --> D["NVIDIA GPUs 🧮"]

Example:

docker pull nvcr.io/nvidia/pytorch:24.01-py3

This gives:

• optimized PyTorch
• CUDA setup
• NCCL support
• GPU acceleration

without manual installation.

NGC + Triton

Typical production deployment:

flowchart TD

    A["NGC Triton Container 📦"]
        --> B["Kubernetes 🐳"]

    B --> C["TensorRT-LLM"]

    C --> D["NVIDIA GPUs 🧮"]

Example

nvcr.io/nvidia/tritonserver:26.04-vllm-python-py3

NGC + NeMo

NGC hosts:

• NeMo frameworks
• pretrained checkpoints
• enterprise LLMs
• speech models

Example:

• Nemotron
• multilingual ASR models
• TTS models

NVIDIA NIM (Inference Microservices)

Production-ready microservices.

NIM packages:

• optimized inference engines
• APIs
• Triton
• TensorRT-LLM
• model serving

NGC + Kubernetes

NGC integrates heavily with:

• Kubernetes
• GPU Operator: automate the management of all NVIDIA software components needed to provision GPU.
• Helm
• cloud GPU clusters

# Add the NVIDIA Helm repository
helm repo add nvidia https://helm.ngc.nvidia.com/nvidia \
    && helm repo update
    
# Deploy GPU Operator    
helm install --wait --generate-name \
    -n gpu-operator --create-namespace \
    nvidia/gpu-operator    

Example stack:

flowchart TD

    A["NGC Helm Charts 🪖"]
        --> B["GPU Operator 🔰"]

    B --> C["Kubernetes GPU Nodes ☸️"]

    C --> D["AI Workloads 🧮"]

NGC Model Catalog

NGC includes:

• LLMs
• diffusion models
• speech AI
• vision models
• embedding models

optimized for NVIDIA GPUs.

Typical Enterprise AI Stack

flowchart TD

    A["NGC Catalog"]
        --> B["NeMo / TensorRT / Triton Containers 📦"]

    B --> C["Kubernetes ☸️"]

    C --> D["NVIDIA GPU Cluster 🧮"]

    D --> E["Production AI Services"]

Common NGC Use Cases

• LLM deployment
• AI platform engineering
• Kubernetes GPU workloads
• distributed training
• inference serving
• AI research
• enterprise AI infrastructure

---