Release 1.1.0
This update focuses on enhancing usage tracking capabilities, introducing flexible service tiers and budget management, and delivering deep performance optimizations for the chat experience.
🌟 New Features
Usage Aggregation: Added persistent tracking of total requests, prompt/completion tokens, and total cost (USD) within user profiles, including a detailed breakdown by model.
Service Tiers: Introduced OpenRouter Service Tier support to balance cost and performance:
Flex (0.5x cost): More affordable, but potentially slower or less reliable.
Default (1.0x cost): Standard service level.
Priority (2.5x cost): Fastest response times and highest priority.
Temporary Daily Budget: Added the ability to set a temporary budget override for the current UTC day, allowing short-term flexibility without altering long-term settings.
Usage Sync Tool: A new “Recalculate Usage Statistics” feature in the settings allows users to force a backend scan of all records to synchronize aggregated totals.
⚡ Performance Improvements
Streaming Render Optimization: Implemented a buffering mechanism using requestAnimationFrame in useStore, shifting high-frequency streaming updates from “immediate trigger” to “frame-synced updates,” significantly reducing re-renders and improving UI smoothness.
Refined Auto-Scroll: Overhauled auto-scroll logic in ChatSession to distinguish between session switches, message count changes, and active streaming, ensuring smoother scrolling behavior.
🎨 UI/UX Enhancements
Session Management:
Pagination: Session list now uses lazy loading (“Load More”) instead of loading all sessions at once, improving startup speed.
Quick Actions: Added Pin and Archive capabilities in session menu for better organization.
Settings Panel Upgrade:
Advanced Tab: Introduced a new “Advanced” tab for system maintenance tools and technical information.
Budget UI: Improved budget settings interface with detailed cost multiplier explanations and a dedicated temporary budget input.
System Info: Added visibility for Instance ID and Schema Version.
🛠️ Technical Changes
Backend Architecture: Modularized routing and migrated chat sessions to a Durable Object-based implementation for better state consistency.
Database Migration: Updated user profile schema to support usage aggregation (Schema v13).
Shared Types: Updated UserProfile and ChatGenerationSettings types to support new tracking and configuration options.
Comments 0
No comments yet. Be the first!
Sign in to join the conversation.