Engineering

OOMKilled and Exit Code 137: Why Kubernetes Kills Your Pods and How to Stop It
Exit code 137 means your container was killed by SIGKILL (signal 9) ā 128 +…

TPUs vs GPUs: When to Choose What for AI/ML Workloads
TPU vs GPU for AI/ML workloads: silicon architecture, JAX vs PyTorch fit, H100 pricing, spot…

Karpenter Cost Optimization: Consolidation Benchmark Results (7-Day Run)
Explore four approaches to Karpenter cost optimization in this benchmarking study showcasing the impact of…

The Hackathon Fix That Cut Our Storage Costs by 93%
For the second year running, Cast AI hosted an internal Hackathon during our Vilnius team…

Deploying GPU workload with Dynamic Resource Allocation
Kubernetes DRA replaces legacy GPU counts with structured, attribute-based requirements. This post demonstrates how to…

Tier Your Apps, Cut Your Costs: A Practical Framework for Spot Instances in Production
In this guide, we’ll walk through a practical approach to running Spot Instances in production…

Kubernetes Resource Management: Optimizing High-Resource Initialization Workloads
Kubernetes workloads can fail during startup even when resources look sufficient. CPU spikes in Java…

Multi Cloud Kubernetes: Reducing Cost And ComplexityĀ
Running Kubernetes within a single cloud provider is already a pretty tall order. Multi cloud…

Intelligent Spot Instance Availability: How Machine Learning Reduces Interruptions by up to 94%
Discover how Cast identifies Spot Instances with low interruption rates and prioritizes them when scaling…