Groq
Low-latency inference on Groq's own LPU chips.
Overview
Groq models are available through Nautili. Requests to them use the same routing, governance and observability as every other request.
Models
- Meta: Llama 3.1 8B Instructmeta-llama/llama-3.1-8b-instructView model: Meta: Llama 3.1 8B Instruct
- Meta: Llama 3.3 70B Instructmeta-llama/llama-3.3-70b-instructView model: Meta: Llama 3.3 70B Instruct
- MiniMax M2.7minimax/minimax-m2.7View model: MiniMax M2.7
- gpt-oss-120bopenai/gpt-oss-120bView model: gpt-oss-120b
- gpt-oss-20bopenai/gpt-oss-20bView model: gpt-oss-20b
- gpt-oss-safeguard-20bopenai/gpt-oss-safeguard-20bView model: gpt-oss-safeguard-20b
Integration
Point your existing SDK or tool at your Nautili endpoint and key. Nautili routes requests to Groq models within your policies.
Managed: use Nautili-issued credentials.
Connect your stack to Nautili
Route across supported providers through one control layer.