Groq

Groq (not to be confused with xAI’s Grok) is a hardware company that built a specialized LPU (Language Processing Unit) to run AI models with near-zero latency.

Core Capabilities

• Extreme Speed: Generates text at 500+ tokens per second (it finishes before you can read).
• Public API: Developers use Groq to build real-time voice assistants and data pipelines.
• Hosted Models: Runs open models like Llama 3 and Mixtral.