AI API gateway that ends manual channel switching with smart routing, auto failover, exponential cooldown, multi-URL scheduling, live request monitoring and soft-error detection.
-
Updated
Aug 24, 2026 - Go
8000
AI API gateway that ends manual channel switching with smart routing, auto failover, exponential cooldown, multi-URL scheduling, live request monitoring and soft-error detection.
ZAI LLM reverse proxy and metrics dashboard
A local proxy that converts websites and APIs to clean Markdown. Convert HTML pages, JSON APIs, and dynamic sites. Get token counts for LLM budgeting.
Pure-Go LLM tokenizer and tiktoken-compatible token counter for OpenAI BPE, WordPiece, SentencePiece, Gemini, Llama, Mistral, and Hugging Face adapters.
⚡ Production-grade real-time AI cost enforcement system. Sub-5ms balance checks, atomic operations, gRPC + REST APIs. Stop AI overages before they happen.
实时追踪LLM API的每一分钱。Token用量监控、成本分析和智能优化。
LLM context window profiler -- decompose, count tokens, estimate costs
Ultra-fast codebase-to-prompt packer & interactive token optimizer (TUI/CLI) for Claude, ChatGPT & Gemini. Local-first, comment-stripping, secret-scanning.
Add a description, image, and links to the token-counting topic page so that developers can more easily learn about it.
To associate your repository with the token-counting topic, visit your repo's landing page and select "manage topics."