Groq

About Groq

Groq is an AI semiconductor company that has built the Language Processing Unit (LPU), a custom chip architecture designed specifically for fast AI inference. Groq's LPU delivers dramatically faster inference speeds than traditional GPU-based solutions, generating hundreds of tokens per second for large language models. Founded by Jonathan Ross, who previously worked on Google's TPU project, Groq has demonstrated record-breaking LLM inference performance. The company offers a free API playground and cloud inference service, making ultra-fast AI accessible to developers. Groq's approach represents a fundamental rethinking of the hardware needed for AI inference at scale.

Key People

Other Startup Companies