Amazon Inferentia 2 is AWS's second-generation inference chip, designed to deliver high-performance, cost-effective AI inference for EC2 Inf2 instances. With support for large language models, computer vision, and recommendation systems, Inferentia 2 offers up to 3x higher throughput and 4x lower latency than Inferentia 1.
Complete technical specifications for the Inferentia 2.