Spaces:
Running
Running
Commit History
-
Extend session visibility in admin dashboard with configurable retention
- Add retention_seconds param to SessionTracker (default 30min) - Sessions now stay visible 30min after last request instead of 2min - Add SESSION_RETENTION_MINUTES env var for configuration - Show Active/Idle status in admin UI (<5min vs >5min idle) Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>6339a53
-
Fix stale sessions in admin dashboard and improve auto-routing health
- Add session cleanup background task (runs every 60s) to remove inactive sessions - Wire cleanup loop into AppRuntime startup/shutdown lifecycle - Per-provider health parameters: NIM gets tighter TTL (15s/2 failures), Zen looser (60s/5) Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>188ffa9
-
Performance optimizations for faster proxy routing
- Remove cleanup from hot path in session tracking - Skip _cleanup_old_sessions on every track_request call - Add track_request_async for contexts needing async guarantees - Add provider warmup on startup to eliminate cold-start penalty - Pre-establish HTTP connections before first request Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>49813da -
Fix: use sync version of track_request to avoid SyntaxError
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>b5bd2a8 -
Performance optimizations for proxy speed and shared sessions
- Per-provider rate limiting: Zen gets unlimited, NVIDIA NIM gets 40/min - Higher Zen concurrency: 4x max_concurrency for fast minimax model - Connection pool tuning: Keepalive connections for faster reuse - Session tracker: Fair resource sharing across Claude Code instances - Smart auto-routing: Prioritize Zen (no limits), then by load Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>cc3287d