GPU Pricing

This document contains current GPU rental prices for cost estimates in tutorials.

circle-check

GPU Prices (as of January 2025)

GPU
$/hour
$/day
Best For

RTX 3060 12GB

$0.008

$0.20

Light inference, development

RTX 3070 8GB

$0.010

$0.25

Light inference

RTX 3080 10GB

$0.015

$0.35

Image generation, inference

RTX 3090 24GB

$0.020

$0.50

Training, large models

RTX 4070 12GB

$0.025

$0.60

Inference, image gen

RTX 4080 16GB

$0.035

$0.85

Image gen, video

RTX 4090 24GB

$0.040

$1.00

Production, large models

RTX 5090 32GB

$0.125

$3.00

Heavy workloads

A100 40GB

$0.080

$2.00

Enterprise training

A100 80GB

$0.100

$2.50

Large model training

H100 80GB

$0.170

$4.00

Maximum performance

Cost Estimate Template

When writing cost estimates for tutorials, use this format:

## Cost Estimate

| Task | GPU | Duration | Cost |
|------|-----|----------|------|
| Testing | RTX 3090 | 30 min | ~$0.01 |
| Batch job | RTX 4090 | 2 hours | ~$0.08 |
| Production | A100 | 1 day | ~$2.00 |

Example Calculations

Image Generation (1000 images)

  • RTX 3090: ~2 hours = $0.04

  • RTX 4090: ~1.5 hours = $0.06

  • A100: ~1 hour = $0.08

LLM Inference (1M tokens)

  • RTX 3090: ~30 min = $0.01

  • RTX 4090: ~20 min = $0.015

  • A100: ~10 min = $0.015

Video Generation (10 videos, 6s each)

  • RTX 4090: ~20 min = $0.015

  • A100: ~15 min = $0.02

Model Training (1 epoch, medium dataset)

  • RTX 3090: ~4 hours = $0.08

  • RTX 4090: ~3 hours = $0.12

  • A100: ~2 hours = $0.16

Notes

  • Prices may vary based on availability and demand

  • Spot instances may be cheaper

  • Multi-GPU setups have different pricing

  • Check clore.aiarrow-up-right for current prices

Was this helpful?