Groq - LPU Language Processing Unit

This is the world’s first Language Processing Unit™ Inference Engine, purpose-built for inference performance and precision. How performant? Today, they are running Llama-2 70B at over 300 tokens per second per user.