daonanchao/vibe-kanban
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
cf078e81d142cf2cedb7c996a8b312159e3858e9
vibe-kanban/crates/utils/Cargo.toml

36 lines
986 B
TOML
Raw Normal View History

Deployments (#414) * init deployment * refactor state * pre executor app state refactor * deployment in app state * clone * fix executors * fix dependencies * command runner via app_state * clippy * remove dependency on ENVIRONMENT from command_runner * remove dependency on ENVIRONMENT from command_runner * build fix * clippy * fmt * featues * vscode lints for cloud * change streaming to SSE (#338) Remove debug logging Cleanup streaming logic feat: add helper function for creating SSE stream responses for stdout/stderr * update vscode guidance * move start * Fix executors * Move command executor to separate file * Fix imports for executors * Partial fix test_remote * Fix * fmt * Clippy * Add back GitHub cloud only routes * cleanup and shared types * Prepare for separate cloud crate * Init backend-common workspace * Update * WIP * WIP * WIP * WIP * WIP * WIP * Projects (and sqlx) * Tasks * WIP * Amp * Backend executor structs * Task attempts outline * Move to crates folder * Cleanup frontend dist * Split out executors into separate crate * Config and sentry * Create deployment method helper * Router * Config endpoints * Projects, analytics * Update analytics paths when keys not provided * Tasks, task context * Middleware, outline task attempts * Delete backend common * WIP container * WIP container * Migrate worktree_path to container_ref (generic) * WIP container service create * Launch container * Fix create task * Create worktree * Move logic into container * Execution outline * Executor selection * Use enum_dispatch to route spawn tree * Update route errors * Implement child calling * Move running executions to container * Add streaming with history * Drop cloud WIP * Logs * Logs * Refactor container logic to execution tracker * Chunk based streaming and cleanup * Alex/mirgate task templates (#350) * Re-enable task templates; migrate routes; migrate args and return types * Refactor task template routes; consolidate list functions into get_templates with query support * Fix get_templates function * Implement amp executor * Gemini WIP * Make streaming the event store reusable * Rewrite mutex to rwlock * Staging for normalised logs impl * Store custom LogMsg instead of event as more flexible * Cleanup * WIP newline stream for amp (tested and working, needs store impl) * refactor: move stranded `git2` logic out of `models` (#352) * remove legacy command_executor; move git2 logic into GitService * remove legacy cloud runner * put back config get route * remove dead logic * WIP amp normalisation * Normalized logs now save to save msg store as raw * Refactor auth endpoints (#355) * Re-enable auth;Change auth to use deployment Add auth service Move auth logic to service Add auth router and service integration to deployment Refactor auth service and routes to use octocrab Refactor auth error handling and improve token validation responses * rename auth_router to router for consistency * refactor: rename auth_service to auth for consistency (#356) * Refactor filesystem endpoints (#357) * feat: implement filesystem service with directory listing and git repo detection * refactor: update filesystem routes; sort repos by last modfied * Gemini executor logs normalization * feat: add sound file serving endpoint and implement sound file loading (#358) * Gemini executor followup (#360) * Sync logs to db (#359) * Exit monitor * Outline stream logs to DB * Outline read from the message store * Add execution_process_logs, store logs in DB * Stream logs from DB * Normalized logs from DB * Remove eronious .sqlx cache * Remove execution process stdout and stderr * Update execution process record on completion * Emit session event for amp * Update session ID when event is emitted * Split local/common spawn fn * Create initial executor session * Move normalized logs into executors * Store executor action * Refactor updated_at to use micro seconds * Follow up executions (#363) * Follow up request handler scaffold Rename coding agent initial / follow up actions * Follow ups * Response for follow up * Simplify execution actions for coding agents * fix executor selection (#362) * refactor: move logic out of `TaskAttempt` (#361) * re-enable /diff /pr /rebase /merge /branch-status /open-editor /delete-file endpoints * address review comments * remove relic * Claude Code (#365) * Use ApiError rather than DeploymentError type in routes (#366) * Fix fe routes (#367) * /api/filesystem/list -> /api/filesystem/directory * /api/projects/:project_id/tasks -> /api/tasks * Remove with-branch * /api/projects/:project_id/tasks/:task_id -> /api/tasks/:task_id * Post tasks * Update template routes * Update BE for github poll endpoint, FE still needs updating * WIP freeze old types * File picker fix * Project types * Solve tsc warna * Remove constants and FE cloud mode * Setup for /api/info refactor * WIP config refactor * Remove custom mapping to coding agents * Update settings to fix code editor * Config fix (will need further changes once attempts types migrated) * Tmp fix types * Config auto deserialisation * Alex/refactor background processes (#369) * feat: add cleanup for orphaned executions at startup * Fix worktree cleanup; re add worktree cleanup queries * refactor worktree cleanup for orphaned and externally deleted worktrees * Fix compile error * refactor: container creation lifecycle (#368) * Consolidate worktree logic in the WorktreeManager * move auxiliary logic into worktree manager * fix compile error * Rename core crate to server * Fix npm run dev * Fix fe routes 2 (#371) * Migrate config paths * Update sounds, refactor lib.rs * Project FE types * Branch * Cleanup sound constants * Template types * Cleanup file search and other unused types * Handle errors * wip: basic mcp config editing (#351) * Re-add notification service, move assets to common dir (#373) add config to containter, add notifications into exit monitor Refctor notification service Refactor notifications * Stderr support (#372) Refactor plain-text log processing and resuse it for gemini, stderr, and potentially other executors. * Fix fe routes 3 (#378) * Task attempts * Task types * Get single task attempt endpoint * Task attempt response * Branch status * More task attempt endpoints * Task attempt children * Events WIP * Stream events when task, task attempt and execution process change status * Fixes * Cleanup logs * Alex/refactor pr monitor (#377) * Refactor task status updates and add PR monitoring functionality * Add PR monitoring service and integrate it into deployment flow Refactor GitHub token retrieval in PR creation and monitoring services Fix github pr regex * Fix types * refactor: dev server logic (#374) * reimplement start dev server logic * robust process group killing * Fix fe routes 4 (#383) * Add endpoint to get execution processes * Update types for execution process * Further execution process type cleanup * Wipe existing logs display * Further process related cleanup * Update get task attempt endpoint * Frozen type removal * Diff types * Display raw logs WIP * fix: extract session id once per execution (#386) * Fix fe routes 5 (#387) * Display normalized logs * Add execution-process info endpoint * WIP load into virtualized * Simplified unified logs * Raw logs also use json patch now (simplifies FE keys) * WIP * Fix FE rendering * Remove timestamps * Fix conversation height * Cleanup entry display * Spacing * Mark the boundaries between different execution processes in the logs * Deduplicate entries * Fix replace * Fmt * put back stop execution process endpoint (#384) * Fix fe routes 6 (#391) * WIP cleanup to remove related tasks and plans * Refactor active tab * Remove existing diff FE logic * Rename tab * WIP stream file events * WIP track FS events * Respect gitignore * Debounced event * Deduplicate events * Refactor git diff * WIP stream diffs * Resolve issue with unstaged changes * Diff filter by files * Stream ongoing changes * Remove entries when reset and json patch safe entry ids * Update the diff tab * Cleanup logs * Cleanup * Error enum * Update create PR attempt URL * Follow up and open in IDE * Fix merge * refactor: introduce `AgentProfiles` (#388) * automatically schedule coding agent execution after setup script * profiles implementation * add next_action field to ExecutorAction type * make start_next_action generic to action type Remove ProfilesManager and DefaultCommandBuilder structs * store executor_action_type in the DB * update shared types * rename structs * fix compile error * Refactor remaining task routes (#389) * Implement deletion functionality for execution processes and task attempts, including recursive deletion of associated logs. refactor: deletion process for task attempts and associated entities feat: Refactor task and task attempt models to remove executor field - Removed the `executor` field from the `task_attempt` model and related queries. - Updated the `CreateTaskAndStart` struct to encapsulate task and attempt creation. - Modified the task creation and starting logic to accommodate the new structure. - Adjusted SQL queries and migration scripts to reflect the removal of the executor. - Enhanced notification service to handle executor types dynamically. - Updated TypeScript types to align with the changes in the Rust models. refactor: remove CreateTaskAndStart type and update related code Add TaskAttemptWithLatestProfile and alias in frontend Fix silent failure of sqlx builder Remove db migration Fix rebase errors * Remove unneeded delete logic; move common container logic to service * Profiles fe (#398) * Get things compiling * Refactor the config * WIP fix task attempt creation * Further config fixes * Sounds and executors in settings * Fix sounds * Display profile config * Onboarding * Remove hardcoded agents * Move follow up attempt params to shared * Remove further shared types * Remove comment (#400) * Codex (#380) * only trigger error message when RunReason is SetupScript (#396) * Opencode (#385) * Restore Gemini followups (#392) * fix task killing (#395) * commit changes after successful execution (#403) * Claude-code-router (#410) * Amp tool use (#407) * Config upgrades (#405) * Versioned config * Upgrade fixes * Save config after migration * Scoping * Update Executor types * Theme types fix * Cleanup * Change theme selector to an enum * Rename config schema version field * Diff improve (#412) * Ensure container exists * Safe handling when ExecutorAction isn't valid JSON in DB * Reset data when endpoint changes * refactor: conditional notification (#408) * conditional notification * fix next action run_reason * remove redundant log * Fix GitHub auth frontend (#404) * fix frontend github auth * Add GitHub error handling and update dependencies - Introduced GitHubMagicErrorStrings enum for consistent error messaging related to GitHub authentication and permissions. - Updated the GitHubService to include a check_token method for validating tokens. - Refactored auth and task_attempts routes to utilize the new error handling. - Added strum_macros dependency in Cargo.toml for enum display. * Refactor GitHub error handling and API response structure to use CreateGitHubPRErrorData * Refactor API response handling in CreatePRDialog and update attemptsApi to return structured results * Refactor tasksApi.createAndStart to remove projectId parameter from API call * use SCREAMING_SNAKE_CASE for consistency * Refactor GitHub error handling to replace CreateGitHubPRErrorData with GitHubServiceError across the codebase * Update crates/utils/src/response.rs Co-authored-by: Gabriel Gordon-Hall <gabriel@bloop.ai> * Fix compile error * Fix types --------- Co-authored-by: Gabriel Gordon-Hall <gabriel@bloop.ai> * Fix: (#415) - Config location - Serve FE from BE in prod - Create config when doesn't exist - Tmp disable building the MCP * Fix dev server route (#417) * remove legacy logic and unused crates (#418) * update CLAUDE.md for new project structure (#420) * fix mcp settings page (#419) * Fix cards not updating (vibe-kanban) (#416) * Commit changes from coding agent for task attempt 774a2cae-a763-4117-af0e-1287a043c462 * Commit changes from coding agent for task attempt 774a2cae-a763-4117-af0e-1287a043c462 * Commit changes from coding agent for task attempt 774a2cae-a763-4117-af0e-1287a043c462 * feat: update task status management in container service * refactor: simplify notification logic and finalize context checks in LocalContainerService * Task attempt fe fixes (#422) * Style tweaks * Refactor * Fix auto scroll * Implement stop endpoint for all execution processed in a task attempt * Weird race condition with amp * Remove log * Fix follow ups * Re-add stop task attempt endpoint (#421) * Re-add stop task attempt endpoint; remove legacy comments for implemented functionality * Fix kill race condition; fix state change when dev server * Ci fixes (#425) * Eslint fix * Remove #[ts(export)] * Fix tests * Clippy * Prettier * Fmt * Version downgrade * Fix API response * Don't treat clippy warnings as errors * Change crate name * Update cargo location * Update further refs * Reset versions * Bump versions * Update binary names * Branch fix * Prettier * Ensure finished event sends data (#434) * use option_env! when reading analytics vars (#435) * remove dead logic (#436) * update crate version across workspace (#437) * add all crates across the workspace * chore: bump version to 0.0.56 --------- Co-authored-by: Alex Netsch <alex@bloop.ai> Co-authored-by: Gabriel Gordon-Hall <gabriel@bloop.ai> Co-authored-by: Solomon <abcpro11051@disroot.org> Co-authored-by: Gabriel Gordon-Hall <ggordonhall@gmail.com> Co-authored-by: GitHub Action <action@github.com>
2025-08-08 13:53:27 +01:00
[package]
name = "utils"
chore: bump version to 0.0.112
2025-10-28 18:36:02 +00:00
version = "0.0.112"
Deployments (#414) * init deployment * refactor state * pre executor app state refactor * deployment in app state * clone * fix executors * fix dependencies * command runner via app_state * clippy * remove dependency on ENVIRONMENT from command_runner * remove dependency on ENVIRONMENT from command_runner * build fix * clippy * fmt * featues * vscode lints for cloud * change streaming to SSE (#338) Remove debug logging Cleanup streaming logic feat: add helper function for creating SSE stream responses for stdout/stderr * update vscode guidance * move start * Fix executors * Move command executor to separate file * Fix imports for executors * Partial fix test_remote * Fix * fmt * Clippy * Add back GitHub cloud only routes * cleanup and shared types * Prepare for separate cloud crate * Init backend-common workspace * Update * WIP * WIP * WIP * WIP * WIP * WIP * Projects (and sqlx) * Tasks * WIP * Amp * Backend executor structs * Task attempts outline * Move to crates folder * Cleanup frontend dist * Split out executors into separate crate * Config and sentry * Create deployment method helper * Router * Config endpoints * Projects, analytics * Update analytics paths when keys not provided * Tasks, task context * Middleware, outline task attempts * Delete backend common * WIP container * WIP container * Migrate worktree_path to container_ref (generic) * WIP container service create * Launch container * Fix create task * Create worktree * Move logic into container * Execution outline * Executor selection * Use enum_dispatch to route spawn tree * Update route errors * Implement child calling * Move running executions to container * Add streaming with history * Drop cloud WIP * Logs * Logs * Refactor container logic to execution tracker * Chunk based streaming and cleanup * Alex/mirgate task templates (#350) * Re-enable task templates; migrate routes; migrate args and return types * Refactor task template routes; consolidate list functions into get_templates with query support * Fix get_templates function * Implement amp executor * Gemini WIP * Make streaming the event store reusable * Rewrite mutex to rwlock * Staging for normalised logs impl * Store custom LogMsg instead of event as more flexible * Cleanup * WIP newline stream for amp (tested and working, needs store impl) * refactor: move stranded `git2` logic out of `models` (#352) * remove legacy command_executor; move git2 logic into GitService * remove legacy cloud runner * put back config get route * remove dead logic * WIP amp normalisation * Normalized logs now save to save msg store as raw * Refactor auth endpoints (#355) * Re-enable auth;Change auth to use deployment Add auth service Move auth logic to service Add auth router and service integration to deployment Refactor auth service and routes to use octocrab Refactor auth error handling and improve token validation responses * rename auth_router to router for consistency * refactor: rename auth_service to auth for consistency (#356) * Refactor filesystem endpoints (#357) * feat: implement filesystem service with directory listing and git repo detection * refactor: update filesystem routes; sort repos by last modfied * Gemini executor logs normalization * feat: add sound file serving endpoint and implement sound file loading (#358) * Gemini executor followup (#360) * Sync logs to db (#359) * Exit monitor * Outline stream logs to DB * Outline read from the message store * Add execution_process_logs, store logs in DB * Stream logs from DB * Normalized logs from DB * Remove eronious .sqlx cache * Remove execution process stdout and stderr * Update execution process record on completion * Emit session event for amp * Update session ID when event is emitted * Split local/common spawn fn * Create initial executor session * Move normalized logs into executors * Store executor action * Refactor updated_at to use micro seconds * Follow up executions (#363) * Follow up request handler scaffold Rename coding agent initial / follow up actions * Follow ups * Response for follow up * Simplify execution actions for coding agents * fix executor selection (#362) * refactor: move logic out of `TaskAttempt` (#361) * re-enable /diff /pr /rebase /merge /branch-status /open-editor /delete-file endpoints * address review comments * remove relic * Claude Code (#365) * Use ApiError rather than DeploymentError type in routes (#366) * Fix fe routes (#367) * /api/filesystem/list -> /api/filesystem/directory * /api/projects/:project_id/tasks -> /api/tasks * Remove with-branch * /api/projects/:project_id/tasks/:task_id -> /api/tasks/:task_id * Post tasks * Update template routes * Update BE for github poll endpoint, FE still needs updating * WIP freeze old types * File picker fix * Project types * Solve tsc warna * Remove constants and FE cloud mode * Setup for /api/info refactor * WIP config refactor * Remove custom mapping to coding agents * Update settings to fix code editor * Config fix (will need further changes once attempts types migrated) * Tmp fix types * Config auto deserialisation * Alex/refactor background processes (#369) * feat: add cleanup for orphaned executions at startup * Fix worktree cleanup; re add worktree cleanup queries * refactor worktree cleanup for orphaned and externally deleted worktrees * Fix compile error * refactor: container creation lifecycle (#368) * Consolidate worktree logic in the WorktreeManager * move auxiliary logic into worktree manager * fix compile error * Rename core crate to server * Fix npm run dev * Fix fe routes 2 (#371) * Migrate config paths * Update sounds, refactor lib.rs * Project FE types * Branch * Cleanup sound constants * Template types * Cleanup file search and other unused types * Handle errors * wip: basic mcp config editing (#351) * Re-add notification service, move assets to common dir (#373) add config to containter, add notifications into exit monitor Refctor notification service Refactor notifications * Stderr support (#372) Refactor plain-text log processing and resuse it for gemini, stderr, and potentially other executors. * Fix fe routes 3 (#378) * Task attempts * Task types * Get single task attempt endpoint * Task attempt response * Branch status * More task attempt endpoints * Task attempt children * Events WIP * Stream events when task, task attempt and execution process change status * Fixes * Cleanup logs * Alex/refactor pr monitor (#377) * Refactor task status updates and add PR monitoring functionality * Add PR monitoring service and integrate it into deployment flow Refactor GitHub token retrieval in PR creation and monitoring services Fix github pr regex * Fix types * refactor: dev server logic (#374) * reimplement start dev server logic * robust process group killing * Fix fe routes 4 (#383) * Add endpoint to get execution processes * Update types for execution process * Further execution process type cleanup * Wipe existing logs display * Further process related cleanup * Update get task attempt endpoint * Frozen type removal * Diff types * Display raw logs WIP * fix: extract session id once per execution (#386) * Fix fe routes 5 (#387) * Display normalized logs * Add execution-process info endpoint * WIP load into virtualized * Simplified unified logs * Raw logs also use json patch now (simplifies FE keys) * WIP * Fix FE rendering * Remove timestamps * Fix conversation height * Cleanup entry display * Spacing * Mark the boundaries between different execution processes in the logs * Deduplicate entries * Fix replace * Fmt * put back stop execution process endpoint (#384) * Fix fe routes 6 (#391) * WIP cleanup to remove related tasks and plans * Refactor active tab * Remove existing diff FE logic * Rename tab * WIP stream file events * WIP track FS events * Respect gitignore * Debounced event * Deduplicate events * Refactor git diff * WIP stream diffs * Resolve issue with unstaged changes * Diff filter by files * Stream ongoing changes * Remove entries when reset and json patch safe entry ids * Update the diff tab * Cleanup logs * Cleanup * Error enum * Update create PR attempt URL * Follow up and open in IDE * Fix merge * refactor: introduce `AgentProfiles` (#388) * automatically schedule coding agent execution after setup script * profiles implementation * add next_action field to ExecutorAction type * make start_next_action generic to action type Remove ProfilesManager and DefaultCommandBuilder structs * store executor_action_type in the DB * update shared types * rename structs * fix compile error * Refactor remaining task routes (#389) * Implement deletion functionality for execution processes and task attempts, including recursive deletion of associated logs. refactor: deletion process for task attempts and associated entities feat: Refactor task and task attempt models to remove executor field - Removed the `executor` field from the `task_attempt` model and related queries. - Updated the `CreateTaskAndStart` struct to encapsulate task and attempt creation. - Modified the task creation and starting logic to accommodate the new structure. - Adjusted SQL queries and migration scripts to reflect the removal of the executor. - Enhanced notification service to handle executor types dynamically. - Updated TypeScript types to align with the changes in the Rust models. refactor: remove CreateTaskAndStart type and update related code Add TaskAttemptWithLatestProfile and alias in frontend Fix silent failure of sqlx builder Remove db migration Fix rebase errors * Remove unneeded delete logic; move common container logic to service * Profiles fe (#398) * Get things compiling * Refactor the config * WIP fix task attempt creation * Further config fixes * Sounds and executors in settings * Fix sounds * Display profile config * Onboarding * Remove hardcoded agents * Move follow up attempt params to shared * Remove further shared types * Remove comment (#400) * Codex (#380) * only trigger error message when RunReason is SetupScript (#396) * Opencode (#385) * Restore Gemini followups (#392) * fix task killing (#395) * commit changes after successful execution (#403) * Claude-code-router (#410) * Amp tool use (#407) * Config upgrades (#405) * Versioned config * Upgrade fixes * Save config after migration * Scoping * Update Executor types * Theme types fix * Cleanup * Change theme selector to an enum * Rename config schema version field * Diff improve (#412) * Ensure container exists * Safe handling when ExecutorAction isn't valid JSON in DB * Reset data when endpoint changes * refactor: conditional notification (#408) * conditional notification * fix next action run_reason * remove redundant log * Fix GitHub auth frontend (#404) * fix frontend github auth * Add GitHub error handling and update dependencies - Introduced GitHubMagicErrorStrings enum for consistent error messaging related to GitHub authentication and permissions. - Updated the GitHubService to include a check_token method for validating tokens. - Refactored auth and task_attempts routes to utilize the new error handling. - Added strum_macros dependency in Cargo.toml for enum display. * Refactor GitHub error handling and API response structure to use CreateGitHubPRErrorData * Refactor API response handling in CreatePRDialog and update attemptsApi to return structured results * Refactor tasksApi.createAndStart to remove projectId parameter from API call * use SCREAMING_SNAKE_CASE for consistency * Refactor GitHub error handling to replace CreateGitHubPRErrorData with GitHubServiceError across the codebase * Update crates/utils/src/response.rs Co-authored-by: Gabriel Gordon-Hall <gabriel@bloop.ai> * Fix compile error * Fix types --------- Co-authored-by: Gabriel Gordon-Hall <gabriel@bloop.ai> * Fix: (#415) - Config location - Serve FE from BE in prod - Create config when doesn't exist - Tmp disable building the MCP * Fix dev server route (#417) * remove legacy logic and unused crates (#418) * update CLAUDE.md for new project structure (#420) * fix mcp settings page (#419) * Fix cards not updating (vibe-kanban) (#416) * Commit changes from coding agent for task attempt 774a2cae-a763-4117-af0e-1287a043c462 * Commit changes from coding agent for task attempt 774a2cae-a763-4117-af0e-1287a043c462 * Commit changes from coding agent for task attempt 774a2cae-a763-4117-af0e-1287a043c462 * feat: update task status management in container service * refactor: simplify notification logic and finalize context checks in LocalContainerService * Task attempt fe fixes (#422) * Style tweaks * Refactor * Fix auto scroll * Implement stop endpoint for all execution processed in a task attempt * Weird race condition with amp * Remove log * Fix follow ups * Re-add stop task attempt endpoint (#421) * Re-add stop task attempt endpoint; remove legacy comments for implemented functionality * Fix kill race condition; fix state change when dev server * Ci fixes (#425) * Eslint fix * Remove #[ts(export)] * Fix tests * Clippy * Prettier * Fmt * Version downgrade * Fix API response * Don't treat clippy warnings as errors * Change crate name * Update cargo location * Update further refs * Reset versions * Bump versions * Update binary names * Branch fix * Prettier * Ensure finished event sends data (#434) * use option_env! when reading analytics vars (#435) * remove dead logic (#436) * update crate version across workspace (#437) * add all crates across the workspace * chore: bump version to 0.0.56 --------- Co-authored-by: Alex Netsch <alex@bloop.ai> Co-authored-by: Gabriel Gordon-Hall <gabriel@bloop.ai> Co-authored-by: Solomon <abcpro11051@disroot.org> Co-authored-by: Gabriel Gordon-Hall <ggordonhall@gmail.com> Co-authored-by: GitHub Action <action@github.com>
2025-08-08 13:53:27 +01:00
edition = "2024"
[dependencies]
tokio-util = { version = "0.7", features = ["io", "codec"] }
bytes = "1.0"
Change SSE to websocket for project tasks (vibe-kanban) (#722) * ## Implementation Complete ✅ I have successfully implemented the SSE to WebSocket conversion for the `stream_tasks` endpoint. Here's a summary of the changes made: ### 🔧 **Changes Made** **1. Event Service Refactoring** ([`crates/services/src/services/events.rs`](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/vk-0283-change-sse/crates/services/src/services/events.rs#L492-L632)): - Split `stream_tasks_for_project` into two functions: - `stream_tasks_raw()` - returns raw `LogMsg` stream - `stream_tasks_for_project()` - converts raw stream to SSE format (maintains backward compatibility) **2. WebSocket Dependencies** ([`Cargo.toml`](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/vk-0283-change-sse/Cargo.toml#L7)): - Added `"ws"` feature to axum workspace dependency **3. WebSocket Route Implementation** ([`crates/server/src/routes/tasks.rs`](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/vk-0283-change-sse/crates/server/src/routes/tasks.rs#L62-L114)): - Added `stream_tasks_ws()` endpoint handler - Added `handle_tasks_ws()` connection management - Added `logmsg_to_ws()` message converter - Updated router to include `/tasks/stream/ws` endpoint ### 🌟 **Key Features** **Dual Transport Support**: - **SSE**: `/tasks/stream` (existing, unchanged) - **WebSocket**: `/tasks/stream/ws` (new) **One-Way Communication**: - Server pushes JSON messages to clients - Client messages are ignored (WebSocket used as SSE replacement) - Automatic ping/pong handling for connection keepalive **Identical Behavior**: - Both endpoints share the same core streaming logic - Same JSON patch message format - Same filtering and initial snapshot behavior **Message Format**: ```json {"JsonPatch":[{"op":"replace","path":"/tasks","value":{...}}]} {"Stdout":"console output"} {"Finished":""} ``` ### 🚀 **Benefits** - **Zero Risk**: Existing SSE endpoint remains unchanged - **Gradual Migration**: Both transports can run in parallel - **Shared Logic**: Core streaming functionality is identical - **WebSocket Advantages**: Better firewall/proxy compatibility, lower overhead ### 📋 **Next Steps** Frontend can now connect to the new WebSocket endpoint: ```javascript const ws = new WebSocket('ws://localhost:8080/projects/{project_id}/tasks/stream/ws'); ws.onmessage = (event) => { const msg = JSON.parse(event.data); if ('JsonPatch' in msg) { // Handle task updates } }; ``` The implementation is ready for use and the existing SSE endpoint remains fully functional during the transition period. * Cleanup script changes for task attempt 0283a4ba-421c-4576-b072-6b960be842d8 * Now let me examine the `useJsonPatchStream` hook to understand how SSE messages are currently processed: * ## Frontend Implementation Complete ✅ I have successfully implemented the frontend WebSocket conversion! Here's a summary of the changes: ### 🔧 **Changes Made** **1. Created WebSocket Hook** ([`frontend/src/hooks/useJsonPatchWsStream.ts`](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/vk-0283-change-sse/frontend/src/hooks/useJsonPatchWsStream.ts)): - New hook mirroring the SSE implementation pattern - Handles WebSocket connection lifecycle (`onopen`, `onmessage`, `onerror`, `onclose`) - Processes JSON messages: `{"JsonPatch": [...]}` and `{"Finished": ""}` - Identical retry logic with exponential backoff - Same state management and patch application using `rfc6902` **2. Updated useProjectTasks Hook** ([`frontend/src/hooks/useProjectTasks.ts`](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/vk-0283-change-sse/frontend/src/hooks/useProjectTasks.ts#L25-L47)): - Added optional `transport` parameter: `'sse' | 'ws'` - **Defaults to WebSocket** (`transport = 'ws'`) for immediate migration - Dynamic endpoint selection: - WebSocket: `/api/tasks/stream/ws?project_id=...` - SSE: `/api/tasks/stream?project_id=...` - Hook selection based on transport type ### 🌟 **Key Features** **Seamless Migration**: - **Zero Breaking Changes**: Existing calls to `useProjectTasks(projectId)` automatically use WebSockets - **Backward Compatibility**: Can explicitly use SSE with `useProjectTasks(projectId, 'sse')` - **Feature Flag Ready**: Easy switching between transports **Identical Behavior**: - Same JSON patch processing logic - Same retry/reconnection patterns - Same connection state management - Same data structures and sorting **WebSocket Benefits**: - Better firewall/proxy compatibility - Lower protocol overhead than SSE - Ready for bidirectional communication if needed ### 📋 **Usage Examples** ```typescript // Uses WebSocket by default const { tasks, isConnected } = useProjectTasks(projectId); // Explicitly use SSE for fallback const { tasks, isConnected } = useProjectTasks(projectId, 'sse'); // Feature flag example const transport = featureFlags.useWebSocket ? 'ws' : 'sse'; const { tasks, isConnected } = useProjectTasks(projectId, transport); ``` ### ✅ **Testing Results** - **TypeScript Check**: ✅ Passes - **Backend Check**: ✅ Passes - **Frontend Build**: ✅ Successfully builds - **No Breaking Changes**: ✅ Existing usage works automatically ### 🚀 **Migration Complete** The frontend now: - **Uses WebSockets by default** for all new task streaming - **Maintains SSE support** for rollback scenarios - **Preserves all existing functionality** - **Is ready for production deployment** The implementation follows the Oracle's recommended approach with dual transport support, providing a safe migration path with easy rollback capabilities. Both backend and frontend are now fully converted to use WebSockets while maintaining SSE compatibility. * Cleanup script changes for task attempt 0283a4ba-421c-4576-b072-6b960be842d8 * ## Phase 1: Frontend Cleanup Complete ✅ I have successfully completed **Phase 1 (Frontend Cleanup)** of the SSE removal plan for project tasks: ### 🔧 **Changes Made** **1. Removed SSE Transport Option** ([`useProjectTasks.ts`](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/vk-0283-change-sse/frontend/src/hooks/useProjectTasks.ts)): - ❌ Removed `transport` parameter - ❌ Removed SSE endpoint URL building - ❌ Removed SSE/WebSocket hook selection logic - ✅ **Now uses WebSocket exclusively**: `/api/tasks/stream/ws` **2. Cleaned Up Imports**: - ❌ Removed unused `useJsonPatchStream` import - ❌ Removed `Transport` type definition - ✅ **Preserved** `useJsonPatchStream` hook - **USED BY OTHER FEATURES** **3. Updated Documentation**: - Updated comments to reflect WebSocket usage - Updated JSDoc to describe WebSocket streaming ### ✅ **Safety Verification** **Critical Discovery**: `useJsonPatchStream` is actively used by: - 📊 **`useDiffStream`** - Code diff streaming - 🔄 **`useProcessConversation`** - Process logs - 📝 **`useNormalizedLogs`** - AI conversation logs - ⚙️ **`useExecutionProcesses`** - Process lifecycle - 📄 **`TaskFollowUpSection`** - Follow-up drafts **Decision**: ✅ **PRESERVED** all shared SSE infrastructure ### 🧪 **Testing Results** - **TypeScript Check**: ✅ Passes - **Frontend Build**: ✅ Successful - **Backend Check**: ✅ No issues - **Endpoint Verification**: ✅ Only WebSocket endpoint referenced ### 📊 **Impact Assessment** - **Breaking Changes**: ❌ **NONE** - Existing calls work identically - **API Changes**: ❌ **NONE** - Same function signature (removed optional param) - **Risk Level**: 🟢 **ZERO** - No behavioral changes to existing code - **Other Features**: ✅ **UNAFFECTED** - All other SSE endpoints preserved ### 🎯 **Current State** **Frontend Now:** - ✅ **Task streaming**: WebSocket only (`/api/tasks/stream/ws`) - ✅ **Other SSE endpoints**: Fully preserved and functional - ✅ **Zero references** to old task SSE endpoint (`/api/tasks/stream`) **Ready for Phase 2**: Backend cleanup can now proceed safely since no frontend code references the old SSE endpoint. The frontend is now **100% WebSocket** for task streaming while maintaining full compatibility with all other SSE-based features! * ## Phase 2: Backend Cleanup Complete ✅ I have successfully completed **Phase 2 (Backend Cleanup)** of the SSE removal plan for project tasks: ### 🔧 **Backend Changes Made** **1. Removed Task SSE Route** ([`tasks.rs`](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/vk-0283-change-sse/crates/server/src/routes/tasks.rs#L331)): - ❌ Removed `.route("/stream", get(stream_tasks))` - ✅ **Kept WebSocket route**: `.route("/stream/ws", get(stream_tasks_ws))` **2. Removed SSE Handler Function** ([`tasks.rs`](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/vk-0283-change-sse/crates/server/src/routes/tasks.rs#L50-L64)): - ❌ Removed `stream_tasks()` function entirely - ✅ **Kept WebSocket handler**: `stream_tasks_ws()` function **3. Cleaned Up Unused Imports** ([`tasks.rs`](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/vk-0283-change-sse/crates/server/src/routes/tasks.rs#L5-L12)): - ❌ Removed `BoxError` (only used by SSE handler) - ❌ Removed `Sse`, `sse::KeepAlive` (only used by SSE handler) - ✅ **Kept all WebSocket imports** **4. Removed Unused EventService Method** ([`events.rs`](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/vk-0283-change-sse/crates/services/src/services/events.rs#L620-L630)): - ❌ Removed `stream_tasks_for_project()` SSE wrapper - ✅ **Kept raw method**: `stream_tasks_raw()` used by WebSocket ### ✅ **Critical Verification** **Other SSE Endpoints PRESERVED**: - ✅ **Process Lifecycle**: `/api/execution-processes/stream` - ✅ **Raw Logs**: `/api/execution-processes/{id}/raw-logs` - ✅ **AI Conversations**: `/api/execution-processes/{id}/normalized-logs` - ✅ **Follow-up Drafts**: `/api/task-attempts/{id}/follow-up-draft/stream` **Shared Infrastructure PRESERVED**: - ✅ **`LogMsg::to_sse_event()`** - Used by other endpoints - ✅ **SSE imports and utilities** - Used by other routes - ✅ **Event streaming infrastructure** - Shared across features ### 🧪 **Testing Results** - **Cargo Check**: ✅ Passes - **Debug Build**: ✅ Successful - **Release Build**: ✅ Successful - **Frontend Integration**: ✅ No breaking changes - **WebSocket Endpoint**: ✅ Still functional --- ## 🎉 **SSE Removal for Project Tasks: COMPLETE** ### 📊 **Final State Summary** **Task Streaming**: - ❌ **SSE Endpoint**: `/api/tasks/stream` - **REMOVED** - ✅ **WebSocket Endpoint**: `/api/tasks/stream/ws` - **ACTIVE** **Other Features**: - ✅ **All other SSE endpoints**: **FULLY PRESERVED** - ✅ **Frontend hooks**: **WORKING** (logs, processes, drafts, etc.) - ✅ **Shared SSE infrastructure**: **INTACT** ### ✨ **Benefits Achieved** **Performance**: - 🚀 **Lower overhead**: WebSocket vs SSE protocol - 🔗 **Better connectivity**: Improved firewall/proxy compatibility - 📡 **Efficient transport**: Reduced connection management **Maintainability**: - 🧹 **Reduced code**: Eliminated duplicate transport logic - 🎯 **Single path**: No more transport switching complexity - 🔄 **Future ready**: WebSocket infrastructure for bidirectional communication **Safety**: - 🛡️ **Zero risk**: Gradual migration with proven WebSocket implementation - 🔒 **No breaking changes**: All existing functionality preserved - ✅ **Full compatibility**: Other SSE features unaffected ### 🚀 **Production Ready** The project tasks feature is now **100% WebSocket-based** and ready for release: - **Frontend**: Only references WebSocket endpoint - **Backend**: Only provides WebSocket endpoint - **No legacy SSE code**: Task-specific SSE completely removed - **Other features**: All SSE-based features continue working normally The SSE to WebSocket migration for project tasks is **COMPLETE** and ready for production deployment! 🎊 * ## Cleanup Complete: LogMsg WebSocket Methods ✅ I have successfully implemented the reusable WebSocket conversion functionality! Here's what was accomplished: ### 🔧 **Changes Made** **1. Added WebSocket Support to Utils Crate** ([`Cargo.toml`](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/vk-0283-change-sse/crates/utils/Cargo.toml#L9)): - ✅ Added `features = ["ws"]` to axum dependency in utils **2. Enhanced LogMsg with WebSocket Methods** ([`log_msg.rs`](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/vk-0283-change-sse/crates/utils/src/log_msg.rs#L45-L60)): - ✅ **`to_ws_message()`** - Returns `Result<Message, serde_json::Error>` for proper error handling - ✅ **`to_ws_message_unchecked()`** - Returns `Message` with fallback error handling - ✅ **Consistent API** - Mirrors existing `to_sse_event()` method pattern **3. Updated Tasks Route** ([`tasks.rs`](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/vk-0283-change-sse/crates/server/src/routes/tasks.rs#L72)): - ❌ **Removed** local `logmsg_to_ws()` function - ✅ **Uses** `msg.to_ws_message_unchecked()` method - ✅ **Cleaner code** - No duplicate functionality ### ✨ **New Reusable API** ```rust use utils::log_msg::LogMsg; impl LogMsg { /// Convert to WebSocket message with proper error handling pub fn to_ws_message(&self) -> Result<Message, serde_json::Error> /// Convert to WebSocket message with fallback (maintains compatibility) pub fn to_ws_message_unchecked(&self) -> Message } ``` ### 🎯 **Future Reusability** **Ready for Use in Other Endpoints**: - **`/api/execution-processes/{id}/raw-logs`** - Process execution logs - **`/api/execution-processes/{id}/normalized-logs`** - AI conversation logs - **`/api/execution-processes/stream`** - Process lifecycle events - **`/api/task-attempts/{id}/follow-up-draft/stream`** - Follow-up draft updates **Usage Example for Future Conversions**: ```rust // Instead of creating custom conversion functions: let stream = some_service.get_logmsg_stream() .map_ok(|msg| msg.to_ws_message_unchecked()); // For better error handling: let stream = some_service.get_logmsg_stream() .map(|result| result.and_then(|msg| msg.to_ws_message())); ``` ### 🛡️ **Improved Error Handling** **Before**: ```rust fn logmsg_to_ws(msg: LogMsg) -> Message { Message::Text(serde_json::to_string(&msg).unwrap().into()) // ❌ Panics on error } ``` **After**: ```rust pub fn to_ws_message_unchecked(&self) -> Message { let json = serde_json::to_string(self) .unwrap_or_else(|_| r#"{"error":"serialization_failed"}"#.to_string()); // ✅ Graceful fallback Message::Text(json.into()) } ``` ### 🧪 **Testing Results** - **Cargo Check**: ✅ Passes (no warnings) - **Debug Build**: ✅ Successful - **Release Build**: ✅ Successful - **Frontend Check**: ✅ No issues - **WebSocket Functionality**: ✅ Maintained ### 📊 **Benefits Achieved** - 🔄 **Reusable**: Other endpoints can easily convert to WebSocket - 🛡️ **Better Error Handling**: No more `unwrap()` calls - 📍 **Discoverable**: Methods are on the LogMsg type where developers expect them - 🎯 **Consistent**: Mirrors existing `to_sse_event()` API pattern - 🧹 **Cleaner Code**: Eliminates duplicate conversion functions The `logmsg_to_ws` function is now a **reusable, type-safe, and discoverable** part of the `LogMsg` API, ready for future SSE-to-WebSocket conversions! 🎉 * Cleanup script changes for task attempt 0283a4ba-421c-4576-b072-6b960be842d8 * I have successfully implemented the conversion of the `/api/execution-processes/{id}/normalized-logs` endpoint from SSE to WebSocket! **Backend Changes:** **1. Container Service Raw Method** ([`container.rs`](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/vk-0283-change-sse/crates/services/src/services/container.rs#L293-L417)): - ✅ **Added** `stream_normalized_logs_raw()` - returns raw `LogMsg` stream - ✅ **Refactored** `stream_normalized_logs()` - now uses raw method + SSE conversion - ✅ **Preserved** all logic: in-memory store, DB fallback, log normalization **2. WebSocket Route Handler** ([`execution_processes.rs`](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/vk-0283-change-sse/crates/server/src/routes/execution_processes.rs#L76-L125)): - ✅ **Added** `stream_normalized_logs_ws()` WebSocket upgrade handler - ✅ **Added** `handle_normalized_logs_ws()` connection management - ✅ **Uses** `LogMsg::to_ws_message_unchecked()` for reusable conversion **3. Route Registration** ([`execution_processes.rs`](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/vk-0283-change-sse/crates/server/src/routes/execution_processes.rs#L157)): - ✅ **Added** `/normalized-logs/ws` WebSocket route - ✅ **Preserved** `/normalized-logs` SSE route **Frontend Changes:** **4. Enhanced Hook** ([`useNormalizedLogs.tsx`](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/vk-0283-change-sse/frontend/src/hooks/useNormalizedLogs.tsx#L33-L51)): - ✅ **Added** `transport` parameter (`'sse' | 'ws'`) - ✅ **Defaults to SSE** for safe rollout - ✅ **Dynamic endpoint** selection based on transport - ✅ **Uses existing hooks** - `useJsonPatchWsStream` for WebSocket **Dual Transport Support:** - **SSE**: `/api/execution-processes/{id}/normalized-logs` (preserved) - **WebSocket**: `/api/execution-processes/{id}/normalized-logs/ws` (new) **Identical Functionality:** - Same JSON patch message format - Same in-memory vs DB fallback logic - Same log normalization and filtering - Same connection state management **Safe Migration Path:** ```typescript // Current usage (defaults to SSE) const { entries } = useNormalizedLogs(processId); // WebSocket testing const { entries } = useNormalizedLogs(processId, true, 'ws'); // Feature flag usage const transport = featureFlags.useWebSocketLogs ? 'ws' : 'sse'; const { entries } = useNormalizedLogs(processId, true, transport); ``` - **Cargo Check**: ✅ Passes - **Release Build**: ✅ Successful - **Frontend Check**: ✅ No issues - **Dual Transport**: ✅ Both endpoints available **Converted Endpoints:** - ✅ `/api/tasks/stream` → **WebSocket only** - ✅ `/api/execution-processes/{id}/normalized-logs` → **Dual transport** (SSE + WebSocket) **Remaining SSE Endpoints:** - `/api/execution-processes/{id}/raw-logs` - `/api/execution-processes/stream` - `/api/task-attempts/{id}/diff` - `/api/task-attempts/{id}/follow-up-draft/stream` - `/api/events` The normalized logs endpoint now supports both transports with: - **Zero breaking changes** - existing code works unchanged - **Feature flag ready** - easy testing and rollout - **Reusable pattern** - established for remaining conversions This proves the conversion pattern works perfectly for LogMsg-based endpoints! The normalized logs conversion is **complete** and ready for testing/deployment. * Cleanup script changes for task attempt 0283a4ba-421c-4576-b072-6b960be842d8 * ## useConversationHistory Migration Complete ✅ I have successfully migrated `useConversationHistory` to use WebSocket for normalized logs while preserving all existing functionality! ### 🔧 **Changes Made** **1. Created Transport-Agnostic Utility** ([`streamJsonPatchEntries.ts`](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/vk-0283-change-sse/frontend/src/utils/streamJsonPatchEntries.ts)): - ✅ **`createSseStream()`** - Original SSE implementation (preserved) - ✅ **`createWsStream()`** - New WebSocket implementation with identical API - ✅ **`streamJsonPatchEntries()`** - Auto-detects transport by URL pattern - ✅ **Backward compatibility alias** - `streamSseJsonPatchEntries` still works **2. Updated useConversationHistory** ([`useConversationHistory.ts`](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/vk-0283-change-sse/frontend/src/hooks/useConversationHistory.ts#L12-L119)): - ✅ **Updated import** to new utility - ✅ **Changed URLs** to WebSocket endpoints (lines 79, 117): - **Before**: `/api/execution-processes/{id}/normalized-logs` - **After**: `/api/execution-processes/{id}/normalized-logs/ws` - ✅ **Preserved** all complex state management logic (400+ lines unchanged) ### 🌟 **Key Features** **Auto-Transport Detection**: ```typescript // WebSocket: URL ends with /ws streamJsonPatchEntries('/api/logs/ws', options) // → WebSocket // SSE: Traditional URLs streamJsonPatchEntries('/api/logs', options) // → SSE ``` **Identical API Surface**: ```typescript const controller = streamJsonPatchEntries<PatchType>(url, { onEntries: (entries) => { /* same callback */ }, onFinished: (entries) => { /* same callback */ }, onError: (err) => { /* same callback */ } }); // Same controller methods controller.getEntries() // E[] controller.isConnected() // boolean controller.onChange(cb) // subscription controller.close() // cleanup ``` **WebSocket Message Handling**: - ✅ **Parses LogMsg format**: `{"JsonPatch": [...], "Finished": ""}` - ✅ **Same patch application**: Uses `rfc6902` library - ✅ **Same state management**: Identical snapshot and notification logic - ✅ **Same callbacks**: `onEntries`, `onFinished`, `onError` work identically ### 🎯 **Migration Results** **Transport Usage**: - ✅ **Normalized logs**: WebSocket (`/normalized-logs/ws`) - ✅ **Raw logs**: SSE (unchanged - `/raw-logs`) - ✅ **Mixed transport**: Same utility handles both transparently **Code Changes**: - ✅ **Zero breaking changes** - all existing functionality preserved - ✅ **Minimal modifications** - only 3 lines changed in useConversationHistory - ✅ **Future-proof** - ready for remaining SSE → WebSocket conversions ### ✅ **Testing Results** - **TypeScript Check**: ✅ Passes - **Frontend Build**: ✅ Successful - **Backend Check**: ✅ No issues - **API Compatibility**: ✅ Identical controller interface ### 📊 **Current State** **Fully Migrated to WebSocket**: - ✅ `/api/tasks/stream` → **WebSocket only** - ✅ `/api/execution-processes/{id}/normalized-logs` → **WebSocket** (via useConversationHistory) **Ready for SSE Removal**: - The `/api/execution-processes/{id}/normalized-logs` SSE endpoint can now be safely removed - `useConversationHistory` is fully converted to WebSocket - The `useNormalizedLogs` hook (if it existed) would also be converted ### 🚀 **Benefits Achieved** **Zero Risk Migration**: - ✅ **Same API surface** - no refactoring of complex state logic - ✅ **Auto-detection** - transport chosen by URL pattern - ✅ **Backward compatibility** - existing imports still work - ✅ **Mixed transport support** - can handle both SSE and WebSocket simultaneously The `useConversationHistory` migration is **complete** and the normalized logs SSE endpoint is ready for removal! The utility-based approach proved to be the perfect solution for preserving the complex async loading patterns while upgrading the transport layer. * Cleanup script changes for task attempt 0283a4ba-421c-4576-b072-6b960be842d8 * ## Raw Logs SSE → WebSocket Migration Plan Based on comprehensive analysis and Oracle validation, here's the strategic plan: ### 🔍 **Current State Analysis** **Backend Implementation:** - **Handler**: `stream_raw_logs()` in `execution_processes.rs` - **Container Service**: Complex method with in-memory + DB fallback - **Message Flow**: Raw `LogMsg` → JSON patches → SSE events - **Route**: `/api/execution-processes/{id}/raw-logs` **Frontend Dependencies:** 1. **`useLogStream`** → `ProcessLogsViewer` (individual process log viewing) 2. **`useConversationHistory`** → Already migrated (uses `streamJsonPatchEntries`) 3. **`useProcessesLogs` + `useEventSourceManager`** → `TodoPanel` (multi-process logs) ### 📋 **Oracle's Validated Strategy** **Approach**: **Dual-layer conversion** - Raw LogMsg stream + WebSocket-side JSON patch conversion ### 🎯 **Key Insights from Oracle** **1. Message Format Preservation**: - ✅ Keep identical JSON patch format for frontend compatibility - ✅ Move Stdout/Stderr → JSON patch conversion to WebSocket handler - ✅ Maintain exact same payload structure **2. Frontend Migration Strategy**: - ✅ **Leverage existing utility** - `streamJsonPatchEntries` already supports both transports - ✅ **Minimal hook changes** - update URLs, reuse proven patterns - ✅ **Preserve EventSourceManager** - generalize to handle both transports **3. Low-Risk Implementation**: - ✅ **Parallel endpoints** during migration: `/raw-logs` (SSE) + `/raw-logs/ws` (WebSocket) - ✅ **Identical data contracts** - same JSON patch arrays - ✅ **Proven patterns** - reuse successful normalized-logs conversion ### 📋 **Implementation Plan** #### **Phase 1: Backend WebSocket Support** 1. **Add `stream_raw_logs_raw()`** - returns pure LogMsg stream 2. **Add WebSocket handler** with JSON patch conversion 3. **Add `/raw-logs/ws` route** - parallel to existing SSE route 4. **Preserve SSE route** for gradual migration #### **Phase 2: Frontend Migration** 1. **Update `useConversationHistory`** - change URL to `/raw-logs/ws` 2. **Migrate `useLogStream`** - use `streamJsonPatchEntries` utility 3. **Update `useProcessesLogs`** - change URL in endpoint mapping #### **Phase 3: Cleanup** 1. **Remove SSE route** after all consumers migrated 2. **Clean up duplicate code** in frontend hooks ### 🛡️ **Migration Benefits** **Zero Risk**: - ✅ **Parallel endpoints** - gradual migration with rollback capability - ✅ **Same message format** - no frontend parsing changes - ✅ **Proven utility** - reuses successful `streamJsonPatchEntries` **Simplified Architecture**: - ✅ **Single utility** for all JSON patch streaming - �� **Consistent patterns** across all log endpoints - ✅ **Better error handling** - proven WebSocket reliability **Performance**: - ✅ **Lower overhead** - WebSocket vs SSE protocol - ✅ **Better reliability** - improved connection handling ### 🤔 **Technical Decisions** **Backend Conversion Strategy**: - **Raw method returns**: `LogMsg` stream (Stdout/Stderr/Finished) - **WebSocket handler**: Converts to JSON patches on-the-fly - **SSE compatibility**: Preserved via existing wrapper method **Frontend Update Strategy**: - **useConversationHistory**: ✅ Already ready (just change URL) - **useLogStream**: Refactor to use `streamJsonPatchEntries` - **useProcessesLogs**: Update endpoint URL mapping Would you like me to proceed with **Phase 1: Backend WebSocket Support** following the Oracle's recommended approach? This will create the raw logs WebSocket endpoint with identical JSON patch format while preserving the SSE route for safe migration. * Cleanup script changes for task attempt 0283a4ba-421c-4576-b072-6b960be842d8 * ## Raw Logs SSE → WebSocket Conversion Complete ✅ I have successfully implemented **Phase 1: Backend WebSocket Support** for raw logs following the Oracle's validated approach! ### 🔧 **Backend Changes Made** **1. Container Service Raw Method** ([`container.rs`](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/vk-0283-change-sse/crates/services/src/services/container.rs#L211-L257)): - ✅ **Added** `stream_raw_logs_raw()` - returns pure LogMsg stream (Stdout/Stderr/Finished) - ✅ **Preserved** both in-memory store and DB fallback logic - ✅ **Refactored** `stream_raw_logs()` - now uses raw method + JSON patch conversion **2. WebSocket Handler** ([`execution_processes.rs`](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/vk-0283-change-sse/crates/server/src/routes/execution_processes.rs#L64-L141)): - ✅ **Added** `stream_raw_logs_ws()` WebSocket upgrade handler - ✅ **Added** `handle_raw_logs_ws()` with on-the-fly JSON patch conversion - ✅ **Uses** `LogMsg::to_ws_message_unchecked()` for proven conversion pattern - ✅ **Maintains** entry counter for consistent indexing **3. Route Registration** ([`execution_processes.rs`](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/vk-0283-change-sse/crates/server/src/routes/execution_processes.rs#L234)): - ✅ **Added** `/raw-logs/ws` WebSocket route - ✅ **Preserved** `/raw-logs` SSE route for safe migration ### 🔄 **Frontend Migration Applied** **4. useConversationHistory Updated** ([`useConversationHistory.ts`](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/vk-0283-change-sse/frontend/src/hooks/useConversationHistory.ts#L77-L120)): - ✅ **Updated URLs** for raw logs: `/raw-logs` → `/raw-logs/ws` - ✅ **Preserved** all complex state management logic (400+ lines unchanged) - ✅ **Zero API changes** - same callbacks and functionality ### 🌟 **Key Features** **Dual Transport Support**: - **SSE**: `/api/execution-processes/{id}/raw-logs` (preserved for other consumers) - **WebSocket**: `/api/execution-processes/{id}/raw-logs/ws` (new) **Identical Message Format**: - Same JSON patch format: `[{"op": "add", "path": "/entries/0", "value": {...}}]` - Same Stdout/Stderr → JSON patch conversion - Same entry indexing and ordering **Oracle's Recommended Pattern**: - ✅ **Raw LogMsg stream** from container service - ✅ **WebSocket-side conversion** to JSON patches - ✅ **Preserved data contracts** - frontend sees identical payloads - ✅ **Reusable infrastructure** - proven `LogMsg::to_ws_message()` pattern ### 📊 **Current Migration Status** **Converted to WebSocket**: - ✅ **Project tasks**: WebSocket only (SSE removed) - ✅ **Normalized logs**: WebSocket (via useConversationHistory + new utility) - ✅ **Raw logs**: WebSocket (via useConversationHistory) **Remaining SSE Dependencies**: - ⚠️ **`useLogStream`** - Still uses direct EventSource - ⚠️ **`useProcessesLogs`** - Still uses EventSource via useEventSourceManager - ⚠️ **Other endpoints**: execution-processes/stream, diff, follow-up-draft, events ### ✅ **Testing Results** - **Cargo Check**: ✅ Passes - **Release Build**: ✅ Successful - **Frontend Check**: ✅ No issues - **Route Configuration**: ✅ Both SSE and WebSocket routes available ### 🎯 **Next Steps** **Ready for Phase 2**: Frontend migration of remaining consumers 1. **`useLogStream`** - Convert to use `streamJsonPatchEntries` utility 2. **`useProcessesLogs`** - Update endpoint URLs and eventSourceManager The raw logs WebSocket infrastructure is **complete** and the `useConversationHistory` is successfully migrated! The dual transport approach allows for safe migration of remaining frontend consumers. * Cleanup script changes for task attempt 0283a4ba-421c-4576-b072-6b960be842d8 * finished message * Migrate the execution processes SSE stream to websocket (vibe-kanban 0154f9d3) crates/server/src/routes/execution_processes.rs crates/server/src/routes/tasks.rs frontend/src/hooks/useProjectTasks.ts frontend/src/hooks/useExecutionProcesses.ts * fmt * fmt * remove dead code
2025-09-15 20:05:38 +01:00
axum = { workspace = true, features = ["ws"] }
Deployments (#414) * init deployment * refactor state * pre executor app state refactor * deployment in app state * clone * fix executors * fix dependencies * command runner via app_state * clippy * remove dependency on ENVIRONMENT from command_runner * remove dependency on ENVIRONMENT from command_runner * build fix * clippy * fmt * featues * vscode lints for cloud * change streaming to SSE (#338) Remove debug logging Cleanup streaming logic feat: add helper function for creating SSE stream responses for stdout/stderr * update vscode guidance * move start * Fix executors * Move command executor to separate file * Fix imports for executors * Partial fix test_remote * Fix * fmt * Clippy * Add back GitHub cloud only routes * cleanup and shared types * Prepare for separate cloud crate * Init backend-common workspace * Update * WIP * WIP * WIP * WIP * WIP * WIP * Projects (and sqlx) * Tasks * WIP * Amp * Backend executor structs * Task attempts outline * Move to crates folder * Cleanup frontend dist * Split out executors into separate crate * Config and sentry * Create deployment method helper * Router * Config endpoints * Projects, analytics * Update analytics paths when keys not provided * Tasks, task context * Middleware, outline task attempts * Delete backend common * WIP container * WIP container * Migrate worktree_path to container_ref (generic) * WIP container service create * Launch container * Fix create task * Create worktree * Move logic into container * Execution outline * Executor selection * Use enum_dispatch to route spawn tree * Update route errors * Implement child calling * Move running executions to container * Add streaming with history * Drop cloud WIP * Logs * Logs * Refactor container logic to execution tracker * Chunk based streaming and cleanup * Alex/mirgate task templates (#350) * Re-enable task templates; migrate routes; migrate args and return types * Refactor task template routes; consolidate list functions into get_templates with query support * Fix get_templates function * Implement amp executor * Gemini WIP * Make streaming the event store reusable * Rewrite mutex to rwlock * Staging for normalised logs impl * Store custom LogMsg instead of event as more flexible * Cleanup * WIP newline stream for amp (tested and working, needs store impl) * refactor: move stranded `git2` logic out of `models` (#352) * remove legacy command_executor; move git2 logic into GitService * remove legacy cloud runner * put back config get route * remove dead logic * WIP amp normalisation * Normalized logs now save to save msg store as raw * Refactor auth endpoints (#355) * Re-enable auth;Change auth to use deployment Add auth service Move auth logic to service Add auth router and service integration to deployment Refactor auth service and routes to use octocrab Refactor auth error handling and improve token validation responses * rename auth_router to router for consistency * refactor: rename auth_service to auth for consistency (#356) * Refactor filesystem endpoints (#357) * feat: implement filesystem service with directory listing and git repo detection * refactor: update filesystem routes; sort repos by last modfied * Gemini executor logs normalization * feat: add sound file serving endpoint and implement sound file loading (#358) * Gemini executor followup (#360) * Sync logs to db (#359) * Exit monitor * Outline stream logs to DB * Outline read from the message store * Add execution_process_logs, store logs in DB * Stream logs from DB * Normalized logs from DB * Remove eronious .sqlx cache * Remove execution process stdout and stderr * Update execution process record on completion * Emit session event for amp * Update session ID when event is emitted * Split local/common spawn fn * Create initial executor session * Move normalized logs into executors * Store executor action * Refactor updated_at to use micro seconds * Follow up executions (#363) * Follow up request handler scaffold Rename coding agent initial / follow up actions * Follow ups * Response for follow up * Simplify execution actions for coding agents * fix executor selection (#362) * refactor: move logic out of `TaskAttempt` (#361) * re-enable /diff /pr /rebase /merge /branch-status /open-editor /delete-file endpoints * address review comments * remove relic * Claude Code (#365) * Use ApiError rather than DeploymentError type in routes (#366) * Fix fe routes (#367) * /api/filesystem/list -> /api/filesystem/directory * /api/projects/:project_id/tasks -> /api/tasks * Remove with-branch * /api/projects/:project_id/tasks/:task_id -> /api/tasks/:task_id * Post tasks * Update template routes * Update BE for github poll endpoint, FE still needs updating * WIP freeze old types * File picker fix * Project types * Solve tsc warna * Remove constants and FE cloud mode * Setup for /api/info refactor * WIP config refactor * Remove custom mapping to coding agents * Update settings to fix code editor * Config fix (will need further changes once attempts types migrated) * Tmp fix types * Config auto deserialisation * Alex/refactor background processes (#369) * feat: add cleanup for orphaned executions at startup * Fix worktree cleanup; re add worktree cleanup queries * refactor worktree cleanup for orphaned and externally deleted worktrees * Fix compile error * refactor: container creation lifecycle (#368) * Consolidate worktree logic in the WorktreeManager * move auxiliary logic into worktree manager * fix compile error * Rename core crate to server * Fix npm run dev * Fix fe routes 2 (#371) * Migrate config paths * Update sounds, refactor lib.rs * Project FE types * Branch * Cleanup sound constants * Template types * Cleanup file search and other unused types * Handle errors * wip: basic mcp config editing (#351) * Re-add notification service, move assets to common dir (#373) add config to containter, add notifications into exit monitor Refctor notification service Refactor notifications * Stderr support (#372) Refactor plain-text log processing and resuse it for gemini, stderr, and potentially other executors. * Fix fe routes 3 (#378) * Task attempts * Task types * Get single task attempt endpoint * Task attempt response * Branch status * More task attempt endpoints * Task attempt children * Events WIP * Stream events when task, task attempt and execution process change status * Fixes * Cleanup logs * Alex/refactor pr monitor (#377) * Refactor task status updates and add PR monitoring functionality * Add PR monitoring service and integrate it into deployment flow Refactor GitHub token retrieval in PR creation and monitoring services Fix github pr regex * Fix types * refactor: dev server logic (#374) * reimplement start dev server logic * robust process group killing * Fix fe routes 4 (#383) * Add endpoint to get execution processes * Update types for execution process * Further execution process type cleanup * Wipe existing logs display * Further process related cleanup * Update get task attempt endpoint * Frozen type removal * Diff types * Display raw logs WIP * fix: extract session id once per execution (#386) * Fix fe routes 5 (#387) * Display normalized logs * Add execution-process info endpoint * WIP load into virtualized * Simplified unified logs * Raw logs also use json patch now (simplifies FE keys) * WIP * Fix FE rendering * Remove timestamps * Fix conversation height * Cleanup entry display * Spacing * Mark the boundaries between different execution processes in the logs * Deduplicate entries * Fix replace * Fmt * put back stop execution process endpoint (#384) * Fix fe routes 6 (#391) * WIP cleanup to remove related tasks and plans * Refactor active tab * Remove existing diff FE logic * Rename tab * WIP stream file events * WIP track FS events * Respect gitignore * Debounced event * Deduplicate events * Refactor git diff * WIP stream diffs * Resolve issue with unstaged changes * Diff filter by files * Stream ongoing changes * Remove entries when reset and json patch safe entry ids * Update the diff tab * Cleanup logs * Cleanup * Error enum * Update create PR attempt URL * Follow up and open in IDE * Fix merge * refactor: introduce `AgentProfiles` (#388) * automatically schedule coding agent execution after setup script * profiles implementation * add next_action field to ExecutorAction type * make start_next_action generic to action type Remove ProfilesManager and DefaultCommandBuilder structs * store executor_action_type in the DB * update shared types * rename structs * fix compile error * Refactor remaining task routes (#389) * Implement deletion functionality for execution processes and task attempts, including recursive deletion of associated logs. refactor: deletion process for task attempts and associated entities feat: Refactor task and task attempt models to remove executor field - Removed the `executor` field from the `task_attempt` model and related queries. - Updated the `CreateTaskAndStart` struct to encapsulate task and attempt creation. - Modified the task creation and starting logic to accommodate the new structure. - Adjusted SQL queries and migration scripts to reflect the removal of the executor. - Enhanced notification service to handle executor types dynamically. - Updated TypeScript types to align with the changes in the Rust models. refactor: remove CreateTaskAndStart type and update related code Add TaskAttemptWithLatestProfile and alias in frontend Fix silent failure of sqlx builder Remove db migration Fix rebase errors * Remove unneeded delete logic; move common container logic to service * Profiles fe (#398) * Get things compiling * Refactor the config * WIP fix task attempt creation * Further config fixes * Sounds and executors in settings * Fix sounds * Display profile config * Onboarding * Remove hardcoded agents * Move follow up attempt params to shared * Remove further shared types * Remove comment (#400) * Codex (#380) * only trigger error message when RunReason is SetupScript (#396) * Opencode (#385) * Restore Gemini followups (#392) * fix task killing (#395) * commit changes after successful execution (#403) * Claude-code-router (#410) * Amp tool use (#407) * Config upgrades (#405) * Versioned config * Upgrade fixes * Save config after migration * Scoping * Update Executor types * Theme types fix * Cleanup * Change theme selector to an enum * Rename config schema version field * Diff improve (#412) * Ensure container exists * Safe handling when ExecutorAction isn't valid JSON in DB * Reset data when endpoint changes * refactor: conditional notification (#408) * conditional notification * fix next action run_reason * remove redundant log * Fix GitHub auth frontend (#404) * fix frontend github auth * Add GitHub error handling and update dependencies - Introduced GitHubMagicErrorStrings enum for consistent error messaging related to GitHub authentication and permissions. - Updated the GitHubService to include a check_token method for validating tokens. - Refactored auth and task_attempts routes to utilize the new error handling. - Added strum_macros dependency in Cargo.toml for enum display. * Refactor GitHub error handling and API response structure to use CreateGitHubPRErrorData * Refactor API response handling in CreatePRDialog and update attemptsApi to return structured results * Refactor tasksApi.createAndStart to remove projectId parameter from API call * use SCREAMING_SNAKE_CASE for consistency * Refactor GitHub error handling to replace CreateGitHubPRErrorData with GitHubServiceError across the codebase * Update crates/utils/src/response.rs Co-authored-by: Gabriel Gordon-Hall <gabriel@bloop.ai> * Fix compile error * Fix types --------- Co-authored-by: Gabriel Gordon-Hall <gabriel@bloop.ai> * Fix: (#415) - Config location - Serve FE from BE in prod - Create config when doesn't exist - Tmp disable building the MCP * Fix dev server route (#417) * remove legacy logic and unused crates (#418) * update CLAUDE.md for new project structure (#420) * fix mcp settings page (#419) * Fix cards not updating (vibe-kanban) (#416) * Commit changes from coding agent for task attempt 774a2cae-a763-4117-af0e-1287a043c462 * Commit changes from coding agent for task attempt 774a2cae-a763-4117-af0e-1287a043c462 * Commit changes from coding agent for task attempt 774a2cae-a763-4117-af0e-1287a043c462 * feat: update task status management in container service * refactor: simplify notification logic and finalize context checks in LocalContainerService * Task attempt fe fixes (#422) * Style tweaks * Refactor * Fix auto scroll * Implement stop endpoint for all execution processed in a task attempt * Weird race condition with amp * Remove log * Fix follow ups * Re-add stop task attempt endpoint (#421) * Re-add stop task attempt endpoint; remove legacy comments for implemented functionality * Fix kill race condition; fix state change when dev server * Ci fixes (#425) * Eslint fix * Remove #[ts(export)] * Fix tests * Clippy * Prettier * Fmt * Version downgrade * Fix API response * Don't treat clippy warnings as errors * Change crate name * Update cargo location * Update further refs * Reset versions * Bump versions * Update binary names * Branch fix * Prettier * Ensure finished event sends data (#434) * use option_env! when reading analytics vars (#435) * remove dead logic (#436) * update crate version across workspace (#437) * add all crates across the workspace * chore: bump version to 0.0.56 --------- Co-authored-by: Alex Netsch <alex@bloop.ai> Co-authored-by: Gabriel Gordon-Hall <gabriel@bloop.ai> Co-authored-by: Solomon <abcpro11051@disroot.org> Co-authored-by: Gabriel Gordon-Hall <ggordonhall@gmail.com> Co-authored-by: GitHub Action <action@github.com>
2025-08-08 13:53:27 +01:00
serde = { workspace = true }
serde_json = { workspace = true }
tracing = { workspace = true }
tracing-subscriber = { workspace = true }
chrono = { version = "0.4", features = ["serde"] }
uuid = { version = "1.0", features = ["v4", "serde"] }
ts-rs = { workspace = true }
libc = "0.2"
rust-embed = "8.2"
directories = "6.0.0"
open = "5.3.2"
regex = "1.11.1"
fix sentry logging (#982)
2025-10-09 11:45:23 +01:00
sentry = { version = "0.41.0", features = ["anyhow", "backtrace", "panic", "debug-images"] }
Deployments (#414) * init deployment * refactor state * pre executor app state refactor * deployment in app state * clone * fix executors * fix dependencies * command runner via app_state * clippy * remove dependency on ENVIRONMENT from command_runner * remove dependency on ENVIRONMENT from command_runner * build fix * clippy * fmt * featues * vscode lints for cloud * change streaming to SSE (#338) Remove debug logging Cleanup streaming logic feat: add helper function for creating SSE stream responses for stdout/stderr * update vscode guidance * move start * Fix executors * Move command executor to separate file * Fix imports for executors * Partial fix test_remote * Fix * fmt * Clippy * Add back GitHub cloud only routes * cleanup and shared types * Prepare for separate cloud crate * Init backend-common workspace * Update * WIP * WIP * WIP * WIP * WIP * WIP * Projects (and sqlx) * Tasks * WIP * Amp * Backend executor structs * Task attempts outline * Move to crates folder * Cleanup frontend dist * Split out executors into separate crate * Config and sentry * Create deployment method helper * Router * Config endpoints * Projects, analytics * Update analytics paths when keys not provided * Tasks, task context * Middleware, outline task attempts * Delete backend common * WIP container * WIP container * Migrate worktree_path to container_ref (generic) * WIP container service create * Launch container * Fix create task * Create worktree * Move logic into container * Execution outline * Executor selection * Use enum_dispatch to route spawn tree * Update route errors * Implement child calling * Move running executions to container * Add streaming with history * Drop cloud WIP * Logs * Logs * Refactor container logic to execution tracker * Chunk based streaming and cleanup * Alex/mirgate task templates (#350) * Re-enable task templates; migrate routes; migrate args and return types * Refactor task template routes; consolidate list functions into get_templates with query support * Fix get_templates function * Implement amp executor * Gemini WIP * Make streaming the event store reusable * Rewrite mutex to rwlock * Staging for normalised logs impl * Store custom LogMsg instead of event as more flexible * Cleanup * WIP newline stream for amp (tested and working, needs store impl) * refactor: move stranded `git2` logic out of `models` (#352) * remove legacy command_executor; move git2 logic into GitService * remove legacy cloud runner * put back config get route * remove dead logic * WIP amp normalisation * Normalized logs now save to save msg store as raw * Refactor auth endpoints (#355) * Re-enable auth;Change auth to use deployment Add auth service Move auth logic to service Add auth router and service integration to deployment Refactor auth service and routes to use octocrab Refactor auth error handling and improve token validation responses * rename auth_router to router for consistency * refactor: rename auth_service to auth for consistency (#356) * Refactor filesystem endpoints (#357) * feat: implement filesystem service with directory listing and git repo detection * refactor: update filesystem routes; sort repos by last modfied * Gemini executor logs normalization * feat: add sound file serving endpoint and implement sound file loading (#358) * Gemini executor followup (#360) * Sync logs to db (#359) * Exit monitor * Outline stream logs to DB * Outline read from the message store * Add execution_process_logs, store logs in DB * Stream logs from DB * Normalized logs from DB * Remove eronious .sqlx cache * Remove execution process stdout and stderr * Update execution process record on completion * Emit session event for amp * Update session ID when event is emitted * Split local/common spawn fn * Create initial executor session * Move normalized logs into executors * Store executor action * Refactor updated_at to use micro seconds * Follow up executions (#363) * Follow up request handler scaffold Rename coding agent initial / follow up actions * Follow ups * Response for follow up * Simplify execution actions for coding agents * fix executor selection (#362) * refactor: move logic out of `TaskAttempt` (#361) * re-enable /diff /pr /rebase /merge /branch-status /open-editor /delete-file endpoints * address review comments * remove relic * Claude Code (#365) * Use ApiError rather than DeploymentError type in routes (#366) * Fix fe routes (#367) * /api/filesystem/list -> /api/filesystem/directory * /api/projects/:project_id/tasks -> /api/tasks * Remove with-branch * /api/projects/:project_id/tasks/:task_id -> /api/tasks/:task_id * Post tasks * Update template routes * Update BE for github poll endpoint, FE still needs updating * WIP freeze old types * File picker fix * Project types * Solve tsc warna * Remove constants and FE cloud mode * Setup for /api/info refactor * WIP config refactor * Remove custom mapping to coding agents * Update settings to fix code editor * Config fix (will need further changes once attempts types migrated) * Tmp fix types * Config auto deserialisation * Alex/refactor background processes (#369) * feat: add cleanup for orphaned executions at startup * Fix worktree cleanup; re add worktree cleanup queries * refactor worktree cleanup for orphaned and externally deleted worktrees * Fix compile error * refactor: container creation lifecycle (#368) * Consolidate worktree logic in the WorktreeManager * move auxiliary logic into worktree manager * fix compile error * Rename core crate to server * Fix npm run dev * Fix fe routes 2 (#371) * Migrate config paths * Update sounds, refactor lib.rs * Project FE types * Branch * Cleanup sound constants * Template types * Cleanup file search and other unused types * Handle errors * wip: basic mcp config editing (#351) * Re-add notification service, move assets to common dir (#373) add config to containter, add notifications into exit monitor Refctor notification service Refactor notifications * Stderr support (#372) Refactor plain-text log processing and resuse it for gemini, stderr, and potentially other executors. * Fix fe routes 3 (#378) * Task attempts * Task types * Get single task attempt endpoint * Task attempt response * Branch status * More task attempt endpoints * Task attempt children * Events WIP * Stream events when task, task attempt and execution process change status * Fixes * Cleanup logs * Alex/refactor pr monitor (#377) * Refactor task status updates and add PR monitoring functionality * Add PR monitoring service and integrate it into deployment flow Refactor GitHub token retrieval in PR creation and monitoring services Fix github pr regex * Fix types * refactor: dev server logic (#374) * reimplement start dev server logic * robust process group killing * Fix fe routes 4 (#383) * Add endpoint to get execution processes * Update types for execution process * Further execution process type cleanup * Wipe existing logs display * Further process related cleanup * Update get task attempt endpoint * Frozen type removal * Diff types * Display raw logs WIP * fix: extract session id once per execution (#386) * Fix fe routes 5 (#387) * Display normalized logs * Add execution-process info endpoint * WIP load into virtualized * Simplified unified logs * Raw logs also use json patch now (simplifies FE keys) * WIP * Fix FE rendering * Remove timestamps * Fix conversation height * Cleanup entry display * Spacing * Mark the boundaries between different execution processes in the logs * Deduplicate entries * Fix replace * Fmt * put back stop execution process endpoint (#384) * Fix fe routes 6 (#391) * WIP cleanup to remove related tasks and plans * Refactor active tab * Remove existing diff FE logic * Rename tab * WIP stream file events * WIP track FS events * Respect gitignore * Debounced event * Deduplicate events * Refactor git diff * WIP stream diffs * Resolve issue with unstaged changes * Diff filter by files * Stream ongoing changes * Remove entries when reset and json patch safe entry ids * Update the diff tab * Cleanup logs * Cleanup * Error enum * Update create PR attempt URL * Follow up and open in IDE * Fix merge * refactor: introduce `AgentProfiles` (#388) * automatically schedule coding agent execution after setup script * profiles implementation * add next_action field to ExecutorAction type * make start_next_action generic to action type Remove ProfilesManager and DefaultCommandBuilder structs * store executor_action_type in the DB * update shared types * rename structs * fix compile error * Refactor remaining task routes (#389) * Implement deletion functionality for execution processes and task attempts, including recursive deletion of associated logs. refactor: deletion process for task attempts and associated entities feat: Refactor task and task attempt models to remove executor field - Removed the `executor` field from the `task_attempt` model and related queries. - Updated the `CreateTaskAndStart` struct to encapsulate task and attempt creation. - Modified the task creation and starting logic to accommodate the new structure. - Adjusted SQL queries and migration scripts to reflect the removal of the executor. - Enhanced notification service to handle executor types dynamically. - Updated TypeScript types to align with the changes in the Rust models. refactor: remove CreateTaskAndStart type and update related code Add TaskAttemptWithLatestProfile and alias in frontend Fix silent failure of sqlx builder Remove db migration Fix rebase errors * Remove unneeded delete logic; move common container logic to service * Profiles fe (#398) * Get things compiling * Refactor the config * WIP fix task attempt creation * Further config fixes * Sounds and executors in settings * Fix sounds * Display profile config * Onboarding * Remove hardcoded agents * Move follow up attempt params to shared * Remove further shared types * Remove comment (#400) * Codex (#380) * only trigger error message when RunReason is SetupScript (#396) * Opencode (#385) * Restore Gemini followups (#392) * fix task killing (#395) * commit changes after successful execution (#403) * Claude-code-router (#410) * Amp tool use (#407) * Config upgrades (#405) * Versioned config * Upgrade fixes * Save config after migration * Scoping * Update Executor types * Theme types fix * Cleanup * Change theme selector to an enum * Rename config schema version field * Diff improve (#412) * Ensure container exists * Safe handling when ExecutorAction isn't valid JSON in DB * Reset data when endpoint changes * refactor: conditional notification (#408) * conditional notification * fix next action run_reason * remove redundant log * Fix GitHub auth frontend (#404) * fix frontend github auth * Add GitHub error handling and update dependencies - Introduced GitHubMagicErrorStrings enum for consistent error messaging related to GitHub authentication and permissions. - Updated the GitHubService to include a check_token method for validating tokens. - Refactored auth and task_attempts routes to utilize the new error handling. - Added strum_macros dependency in Cargo.toml for enum display. * Refactor GitHub error handling and API response structure to use CreateGitHubPRErrorData * Refactor API response handling in CreatePRDialog and update attemptsApi to return structured results * Refactor tasksApi.createAndStart to remove projectId parameter from API call * use SCREAMING_SNAKE_CASE for consistency * Refactor GitHub error handling to replace CreateGitHubPRErrorData with GitHubServiceError across the codebase * Update crates/utils/src/response.rs Co-authored-by: Gabriel Gordon-Hall <gabriel@bloop.ai> * Fix compile error * Fix types --------- Co-authored-by: Gabriel Gordon-Hall <gabriel@bloop.ai> * Fix: (#415) - Config location - Serve FE from BE in prod - Create config when doesn't exist - Tmp disable building the MCP * Fix dev server route (#417) * remove legacy logic and unused crates (#418) * update CLAUDE.md for new project structure (#420) * fix mcp settings page (#419) * Fix cards not updating (vibe-kanban) (#416) * Commit changes from coding agent for task attempt 774a2cae-a763-4117-af0e-1287a043c462 * Commit changes from coding agent for task attempt 774a2cae-a763-4117-af0e-1287a043c462 * Commit changes from coding agent for task attempt 774a2cae-a763-4117-af0e-1287a043c462 * feat: update task status management in container service * refactor: simplify notification logic and finalize context checks in LocalContainerService * Task attempt fe fixes (#422) * Style tweaks * Refactor * Fix auto scroll * Implement stop endpoint for all execution processed in a task attempt * Weird race condition with amp * Remove log * Fix follow ups * Re-add stop task attempt endpoint (#421) * Re-add stop task attempt endpoint; remove legacy comments for implemented functionality * Fix kill race condition; fix state change when dev server * Ci fixes (#425) * Eslint fix * Remove #[ts(export)] * Fix tests * Clippy * Prettier * Fmt * Version downgrade * Fix API response * Don't treat clippy warnings as errors * Change crate name * Update cargo location * Update further refs * Reset versions * Bump versions * Update binary names * Branch fix * Prettier * Ensure finished event sends data (#434) * use option_env! when reading analytics vars (#435) * remove dead logic (#436) * update crate version across workspace (#437) * add all crates across the workspace * chore: bump version to 0.0.56 --------- Co-authored-by: Alex Netsch <alex@bloop.ai> Co-authored-by: Gabriel Gordon-Hall <gabriel@bloop.ai> Co-authored-by: Solomon <abcpro11051@disroot.org> Co-authored-by: Gabriel Gordon-Hall <ggordonhall@gmail.com> Co-authored-by: GitHub Action <action@github.com>
2025-08-08 13:53:27 +01:00
sentry-tracing = { version = "0.41.0", features = ["backtrace"] }
lazy_static = "1.4"
futures-util = "0.3"
json-patch = "2.0"
base64 = "0.22"
tokio = { workspace = true }
futures = "0.3.31"
tokio-stream = { version = "0.1.17", features = ["sync"] }
Prevent the DB from storing massive logs (vibe-kanban) (#633) * ## Implementation Complete ✅ I've successfully implemented the log size limiting with debouncing. Here's what was built: **Key Changes:** 1. **[`logs_limits.rs`](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/vk-f914-prevent-th/crates/utils/src/logs_limits.rs)** - Constants for size limits 2. **[`stream_ext.rs`](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/vk-f914-prevent-th/crates/utils/src/stream_ext.rs)** - Debouncing logic with 200ms windows 3. **[`container.rs`](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/vk-f914-prevent-th/crates/local-deployment/src/container.rs#L466)** - Integration point 4. **[DB safety](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/vk-f914-prevent-th/crates/services/src/services/container.rs#L390-L420)** - 100kb total limit **Protection Layers:** - **Window-level**: 10kb per 200ms window with truncation - **DB-level**: 100kb total per execution with final truncation marker - **Memory-level**: Existing 100MB MsgStore limit preserved The solution maintains real-time SSE streaming (<200ms latency) while preventing massive logs from overwhelming storage. * Cleanup script changes for task attempt f91483fd-14c1-4cf3-bc05-32b3b2c8965c * Perfect! I've successfully implemented the feedback changes: ## Changes Made ✅ 1. **Removed `logs_limits.rs`** - Deleted the separate constants file 2. **Moved constants to `stream_ext.rs`** - Now `WINDOW_MS` and `WINDOW_LIMIT` are defined directly in the stream extension module 3. **Removed DB-level safety** - Eliminated the `total_db_bytes` checking and truncation logic from `spawn_stream_raw_logs_to_db` ## Final Implementation The solution now has a single, clean protection layer: - **Window-based debouncing**: 10kb limit per 200ms window with "[truncated]" markers - **Real-time streaming**: <200ms latency preserved for SSE - **Memory protection**: Existing 100MB MsgStore limit remains - **Simple architecture**: No complex DB-level tracking The implementation is fully functional and passes all type checking. The debouncing logic in [`stream_ext.rs`](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/vk-f914-prevent-th/crates/utils/src/stream_ext.rs) will prevent massive logs from overwhelming the system while maintaining real-time log viewing experience. * improve window capping
2025-09-15 21:07:40 +01:00
async-stream = "0.3"
Qwen-code (#430)
2025-08-12 10:35:19 +01:00
shellexpand = "3.1.1"
fix: Open editor on windows (#476)
2025-08-14 18:44:27 +01:00
which = "8.0.0"
Display edit diffs (#469)
2025-08-15 11:18:24 +01:00
similar = "2"
Setting to override branch prefix (vibe-kanban) (#949) * ## ✅ Implementation Complete Successfully added customizable git branch prefix setting: ### Changes Made **Backend:** 1. [v7.rs](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/8921-setting-to-overr/crates/services/src/services/config/versions/v7.rs) - Added `git_branch_prefix` field with default "vk" 2. [git.rs](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/8921-setting-to-overr/crates/utils/src/git.rs) - Created validation function with tests 3. [container.rs](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/8921-setting-to-overr/crates/services/src/services/container.rs#L229-L240) - Updated branch creation to use config value 4. [local container](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/8921-setting-to-overr/crates/local-deployment/src/container.rs#L897-L901) - Implemented `git_branch_prefix()` method **Frontend:** 5. [GeneralSettings.tsx](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/8921-setting-to-overr/frontend/src/pages/settings/GeneralSettings.tsx#L452-L480) - Added UI input in GitHub card with preview ### Features - Default prefix: `vk` (maintains backward compatibility) - Empty prefix supported (branches without prefix) - Validation ensures git-compliant names - Preview shows branch format: `{prefix}/{uuid}-{slug}` or `{uuid}-{slug}` - All checks passed ✓ * Cleanup script changes for task attempt 8921b110-a98c-4968-9908-c710615a968e * ## ✅ Fixed Async Runtime Panic Successfully converted blocking methods to async: ### Changes Made 1. **[container.rs trait](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/8921-setting-to-overr/crates/services/src/services/container.rs#L229-L240)** - Made both methods async, added `.await` to prefix call 2. **[LocalContainerService](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/8921-setting-to-overr/crates/local-deployment/src/container.rs#L898-L900)** - Changed to `config.read().await` 3. **[tasks.rs](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/8921-setting-to-overr/crates/server/src/routes/tasks.rs#L167-L170)** - Added `.await` to method call 4. **[task_attempts.rs](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/8921-setting-to-overr/crates/server/src/routes/task_attempts.rs#L155-L158)** - Added `.await` to method call All checks passed ✓. The panic should be resolved - the methods now properly use async config access. * Cleanup script changes for task attempt 8921b110-a98c-4968-9908-c710615a968e * ## ✅ Moved to New Git Section Created a separate Git card in [GeneralSettings.tsx](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/8921-setting-to-overr/frontend/src/pages/settings/GeneralSettings.tsx#L528-L571) positioned between GitHub and Notifications sections, with: - Title: "Git" - Description: "Configure git branch naming preferences" - Branch Prefix setting with preview All checks passed ✓ * Cleanup script changes for task attempt 8921b110-a98c-4968-9908-c710615a968e * ## ✅ i18n Integration Complete Added translations for the Git section in all supported languages: ### Translation Files Updated 1. **[English](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/8921-setting-to-overr/frontend/src/i18n/locales/en/settings.json)** - Added `git` section with complete translations 2. **[Spanish](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/8921-setting-to-overr/frontend/src/i18n/locales/es/settings.json)** - Spanish translations 3. **[Japanese](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/8921-setting-to-overr/frontend/src/i18n/locales/ja/settings.json)** - Japanese translations ### Component Updated - [GeneralSettings.tsx](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/8921-setting-to-overr/frontend/src/pages/settings/GeneralSettings.tsx#L528-L575) - Now uses `t()` for all text with dynamic preview translation All checks passed ✓ * Commit changes from coding agent for task attempt 8921b110-a98c-4968-9908-c710615a968e * Cleanup script changes for task attempt 8921b110-a98c-4968-9908-c710615a968e * ## ✅ Validation Implementation Complete Successfully addressed PR feedback by implementing comprehensive validation: ### 1. Backend: Using `git2::Branch::name_is_valid` ✅ - **[git.rs](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/8921-setting-to-overr/crates/utils/src/git.rs)** - Replaced manual validation with `git2::Branch::name_is_valid` - Uses authoritative libgit2 validation with `"{prefix}/x"` format - Added git2 dependency to utils crate - Updated tests (removed tests for behaviors that differ from git2) ### 2. Frontend: Real-time Validation with Error Display ✅ - **[GeneralSettings.tsx](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/8921-setting-to-overr/frontend/src/pages/settings/GeneralSettings.tsx)** - Added validation logic - Error state shows inline message below input - Red border on invalid input (`border-destructive`) - Save button disabled when validation fails - Validates on input change (real-time feedback) ### 3. i18n Error Messages ✅ Added translations in all languages: - [English](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/8921-setting-to-overr/frontend/src/i18n/locales/en/settings.json#L82-L90) - [Spanish](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/8921-setting-to-overr/frontend/src/i18n/locales/es/settings.json#L79-L87) - [Japanese](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/8921-setting-to-overr/frontend/src/i18n/locales/ja/settings.json#L86-L94) ### 4. Backend Enforcement ✅ - **[config.rs](file:///private/var/folders/m1/9q_ct1913z10v6wbnv54j25r0000gn/T/vibe-kanban/worktrees/8921-setting-to-overr/crates/server/src/routes/config.rs#L104-L108)** - Validates on config save - Returns 400 error if invalid prefix - Backend remains source of truth All checks passed ✓ * ✅ Fixed linting error - removed unnecessary escape character in regex. All checks now pass. * ## ✅ Simplified Validation Text Removed verbose rules text and made error messages more concise: ### Changes: 1. **Removed** the detailed "Allowed: letters, numbers..." rules line 2. **Simplified** error messages to be more direct: - "Prefix cannot contain '/'" (was "Prefix must be a single path segment (no '/').") - "Contains invalid sequence (.., @{)" (was "Prefix contains invalid sequence (.., @{, or @)") - etc. 3. **Updated all 3 languages** (English, Spanish, Japanese) ### Result: - Helper text + preview on same line (cleaner) - Real-time validation shows specific errors when needed - Much less copy while maintaining clarity All checks passed ✓ * Cleanup script changes for task attempt 8921b110-a98c-4968-9908-c710615a968e
2025-10-07 16:33:36 +01:00
git2 = "0.18"
Reference in New Issue Copy Permalink