Javier LimNotes on building, shipping, and learning — by Javier Lim, entrepreneur and software engineer.https://blog.javlim.dev/An FP8 KV cache for mini-sglang: what I learned shipping the v1https://blog.javlim.dev/posts/fp8-kv-cache/https://blog.javlim.dev/posts/fp8-kv-cache/Shipping FP8 KV cache for mini-sglang: 2× capacity, up to 27% faster decode, quality intact.Sun, 17 May 2026 00:00:00 GMT