OpenInference
Reworks open models to run efficiently on non-GPU accelerators, serving them through OpenRouter.
Overview
OpenInference models are available through Nautili. Requests to them use the same routing, governance and observability as every other request.
Models
- DeepSeek V4 Flash 0423deepseek/deepseek-v4-flashView model: DeepSeek V4 Flash 0423
- DeepSeek V4 Flash 0731deepseek/deepseek-v4-flash-0731View model: DeepSeek V4 Flash 0731
- DeepSeek V4.1 Flashdeepseek/deepseek-v4.1-flashView model: DeepSeek V4.1 Flash
- DeepSeek V4.1 Flash 1017deepseek/deepseek-v4.1-flash-1017View model: DeepSeek V4.1 Flash 1017
- GLM 5.3 Flashz-ai/glm-5.3-flashView model: GLM 5.3 Flash
Integration
Point your existing SDK or tool at your Nautili endpoint and key. Nautili routes requests to OpenInference models within your policies.
Managed: use Nautili-issued credentials.
Connect your stack to Nautili
Route across supported providers through one control layer.