LIVE DEMO
ACTIVE
Systems
LLM Admission Gateway — Reserve, Commit, Expire
A rate limiter for inference traffic, where cost is tokens rather than requests and the dominant part of that cost is u…
TypeScript
Node.js
Redis
Lua
+3