asepharyana
e8f90fc9b1
- /metrics endpoint: request/token/latency counters, tok/s gauge, build info (std-only, no deps) - usage.duration_ms + usage.tokens_per_second in non-streaming and streaming responses - /health now reports uptime_s, n_ctx, version - MAX_TOKENS env config (hard cap, default 2048; 0 = unlimited) - metrics unit tests (counters, prometheus shape, uptime monotonic)
8 lines
100 B
Rust
8 lines
100 B
Rust
//! HTTP handlers.
|
|
|
|
pub mod chat;
|
|
pub mod chat_ui;
|
|
pub mod health;
|
|
pub mod metrics;
|
|
pub mod models;
|