Groq
Updated: December 25, 2025
Founder Jonathan Ross
Country: USA | Funding: $1.8B (+)
Founded: 2016
Website: https://groq.com/
Groq creates hardware AI accelerators for large language models that improve performance and reduce power consumption compared to classic GPU accelerators. It produces a Language Processing Unit (LPU) chip that uses exclusively on-chip SRAM memory (without external DRAM/HBM modules), which requires installing multiple chips for scalable payloads. Its architecture minimizes elements associated with unpredictable behavior (branch prediction, caches, etc.). Groq enables best performance for small and medium batch/task sizes, especially if the model fits into their configuration. The software-defined, single-core architecture removes traditional software complexity while continuous, token-based execution delivers consistent performance without tradeoffs. Groq licenses its technology to NVidia. The company also provides its cloud AI inference platform built for developers - available in public, private, or co-cloud instances.
Founded: 2016
Website: https://groq.com/
Groq creates hardware AI accelerators for large language models that improve performance and reduce power consumption compared to classic GPU accelerators. It produces a Language Processing Unit (LPU) chip that uses exclusively on-chip SRAM memory (without external DRAM/HBM modules), which requires installing multiple chips for scalable payloads. Its architecture minimizes elements associated with unpredictable behavior (branch prediction, caches, etc.). Groq enables best performance for small and medium batch/task sizes, especially if the model fits into their configuration. The software-defined, single-core architecture removes traditional software complexity while continuous, token-based execution delivers consistent performance without tradeoffs. Groq licenses its technology to NVidia. The company also provides its cloud AI inference platform built for developers - available in public, private, or co-cloud instances.
