LLM Admission Gateway — Reserve, Commit, Expire
A rate limiter for inference traffic, where cost is tokens rather than requests and the dominant part of that cost is u…
Building the future, one commit at a time. Here are some of my open-source projects and research work.
A rate limiter for inference traffic, where cost is tokens rather than requests and the dominant part of that cost is u…
An event-driven C++20 trading engine built around a hard boundary between a nanosecond fast path and an LLM-scale slow …
A CUDA-level profiling and intelligent multi-model inference scheduling framework for edge AI, achieving 114.67 FPS YOL…
Browser-native vector database in Rust compiled to WebAssembly — HNSW + Flat indices, SIMD128 acceleration for 7 distan…
Multi-paradigm fractal renderer spanning 5 compute backends (JS → WASM → CPU → OpenMP → CUDA) with 125,000x GPU speedup…
Distributed multi-agent coordination runtime with actor model, AST-based conflict detection, backpressure, and circuit …
GC-aware LLM inference engine applying garbage collection semantics (reference counting, generational collection, memor…
Interactive Vulkan learning system with 20 progressive exercises and a final renderer project
An S3-compatible distributed object store with a purpose-built LLM KV-cache engine: radix tree keyed on token prefixes,…