Files
kandev/apps/backend/internal/github/store_multi_repo_test.go
T
João Salavisa fd79d6170f feat(tasks): multi-branch tasks — N (repo, branch) pairs per task (#1226)
* feat(tasks): multi-branch tasks — N (repo, branch) pairs per task

Extends multi-repo into multi-branch so a single task can hold multiple
worktrees on the same repo (one per branch). Sibling worktrees layout at
<task>/<repo>/ + <task>/<repo>-<slug>/, dedicated PRWatch per branch,
live agentctl tracker rescan + frontend store updates so the UI splits
PRs / files / commits per branch without a session restart. MCP
add_branch_to_task_kandev tool is shielded to the worktree executor.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>

* fix(web): unify multi-branch repo label as <repo> · <branch> across panels

PR Changes and Commits panels rendered repo labels differently for multi-branch
tasks — Commits showed "kandev · feature/x" while PR Changes leaked the raw
"kandev-feature-x" agentctl tracker tag. Reformat tracker-tagged repo names via
formatRepoLabel using the longest known-repo prefix so kandev-cli-* doesn't
collapse to kandev · cli-*.

* fix(tasks): address multi-branch PR review — data races, slug collisions, MCP error codes

Backend
- agentctl process.Manager: add repoTrackersMu RWMutex guarding repoTrackers
  + workspaceTracker. Reads snapshot under RLock; RescanRepositories builds
  trackers first, takes Lock for swap/append. Validates newWorkDir via
  os.Stat before publishing cfg.WorkDir.
- worktree.Manager: reject invalid explicit BranchSlug up-front; cache key
  uses sanitized wt.BranchSlug so read/write paths are symmetric.
- worktree.store: narrow isDuplicateColumnError to "duplicate column name".
- task service AddBranchToTask: slug-collision guard rejects feat/a vs feat-a.
- orchestrator resolvePushRepo: two-pass exact-name match before subdir
  prefix fallback so "backend" doesn't swallow pushes for "backend-admin".
- executor buildRepoSpecs: duplicate repos always get a non-empty BranchSlug
  (falls back to branch-N when both branch fields sanitize to empty).
- MCP handler: classifyAddBranchError maps service errors to NOT_FOUND /
  CONFLICT / VALIDATION_ERROR; add ErrorCodeConflict constant.
- MCP server: extract registerAddBranchToTaskTool, register in task mode
  only (external mode contract: config tools + create_task_kandev).
- workspace_rescan handler: reject malformed JSON with 400 instead of
  silently rescanning the current root.
- branch_materializer: split MaterializeBranch into prepare + finalize
  helpers to satisfy the 80-line cap.

Frontend
- existingPrUrl returns undefined when a task has >1 PR so per-repo View PR
  buttons take over (no silent linking to a sibling).
- formatRepoLabel checks exact known-repo match before prefix splitting so
  "kandev-cli" isn't mislabeled as "kandev · cli".
- Repo chip key now includes base_branch so siblings differing only on
  base render as distinct chips.

Docs
- multi-branch spec uniqueness wording aligned with the canonical 4-column
  key (task_id, repository_id, base_branch, checkout_branch).
- worktree.CreateRequest.BranchSlug doc describes the sibling layout
  (<repo>-<slug>) instead of the obsolete nested form.

* fix(tasks): scope slug-collision check to repo only + use errors.Is for ErrTaskNotFound

- service_branches: drop base_branch from the slug-collision check. Worktree
  path is (repo, slug); two rows on the same repo cut from different bases
  still collide on disk.
- service_branches: prepareBranchAdd wraps taskrepo.ErrTaskNotFound via
  fmt.Errorf with %w so classifiers don't have to substring-match the
  formatted task UUID.
- mcp handlers: classifyAddBranchError uses errors.Is(err, ErrTaskNotFound).

* fix(agentctl): sanitize rescan work_dir before os.Stat to clear CodeQL path-injection

CodeQL flagged the rescan endpoint as a path-injection sink (the
HTTP-supplied work_dir flowed straight into os.Stat and downstream
scanRepositorySubdirs). Add validateRescanPath which:
- requires the input to be a clean absolute path with no ".." segments
- rejects anything that isn't equal to or an ancestor of the current
  cfg.WorkDir — the only legitimate use case is the branch materializer
  promoting <task>/<repo>/ to <task>/

Defense in depth: agentctl binds to localhost, but any colocated process
could otherwise direct it at /etc or the user's home by POSTing
/api/v1/workspace/rescan.

* fix(agentctl): tighten validateRescanPath, close TOCTOU on existingTrackers, add tests

- Drop the strings.Contains(clean, "..") guard. filepath.Clean already
  resolves traversal; the substring check rejects legitimate names like
  /home/u/..hidden without adding defense (the ancestor check via
  filepath.Rel is the real boundary).
- Drop the rel == "." branch in the ancestor check — early return for
  clean == currentClean already covers identity.
- Read existingTrackers inside the write-lock section (not under RLock
  then re-Lock) so two concurrent rescans can't both see 0 trackers and
  double-bootstrap the multi-repo set.
- Add table-driven TestValidateRescanPath covering rejection paths
  (relative, descendant, sibling, traversal-cleaned, empty input),
  legitimate ancestor promotion, exact match, no-anchor first-launch,
  and a /home/u/..hidden dotted-segment case.

* fix(agentctl): break taint flow into os.Stat — derive rescan path from cfg, not HTTP body

CodeQL's go/path-injection trace still flagged manager_rescan.go after the
prior sanitizer because the user-supplied newWorkDir flowed (after
validation) into os.Stat and then into cfg.WorkDir → tracker paths →
workspace_monitor os.Stat sinks.

Replace validateRescanPath with resolveRescanPath: it returns a path
DERIVED from currentWorkDir (no-op = currentClean, promotion =
filepath.Dir(currentClean)) and uses newPath only for comparison, never
as a source for the returned string. os.Stat now receives a path whose
provenance is trusted manager config.

Functionally the legitimate caller (branch materializer promoting
<task>/<repo>/ to <task>/) is unchanged.

* test(agentctl): make TestResolveRescanPath windows-portable

The Linux Backend Tests job passed but the Backend (windows) job rejected
every "absolute" case because filepath.IsAbs("/task/repo") is false on
Windows (no volume letter).

Build inputs via filepath.Join against absRoot() (filepath.Abs of "/" /
"\\") so the same table covers POSIX (`/...`) and Windows (`C:\...`)
without per-OS branches. Keep the traversal-after-Clean case POSIX-only
since filepath.Clean is the shared primitive and that input form needs a
volume to be considered absolute on Windows anyway.

* fix(agentctl): serialize RescanRepositories + re-check trackers under write lock

Two concurrent RescanRepositories calls could both observe an empty
tracker set (between the snapshot read and the bootstrap branch) and both
enter transitionToMultiRepoMode, leaking a duplicate bare-root tracker
and duplicate per-repo trackers. Same race in appendNewRepoTrackers would
double-append the same new child across both callers.

Fix:
- Add rescanMu sync.Mutex on Manager. Acquired for the full body of
  RescanRepositories so the snapshot → branch → mutate sequence is
  serialized. repoTrackersMu still guards individual field reads from
  unrelated goroutines (subscribe/unsubscribe/poll-mode).
- appendNewRepoTrackers re-checks membership inside the write-lock
  before appending and drops already-present trackers (Stop + detach
  outside the lock). Defense in depth.
- Test: add `dotted segment is legal as promotion` case so the
  ..hidden-segment promotion path stays exercised.

---------

Co-authored-by: Kandev Agent <agent@kandev.dev>
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
2026-06-01 19:36:20 +01:00

349 lines
12 KiB
Go

package github
import (
"context"
"path/filepath"
"testing"
"time"
"github.com/jmoiron/sqlx"
"github.com/kandev/kandev/internal/db"
)
func newTestStore(t *testing.T) *Store {
t.Helper()
tmp := t.TempDir()
dbPath := filepath.Join(tmp, "github.db")
dbConn, err := db.OpenSQLite(dbPath)
if err != nil {
t.Fatalf("open db: %v", err)
}
sqlxDB := sqlx.NewDb(dbConn, "sqlite3")
t.Cleanup(func() { _ = sqlxDB.Close() })
if _, err := sqlxDB.Exec(`CREATE TABLE tasks (id TEXT PRIMARY KEY, archived_at DATETIME)`); err != nil {
t.Fatalf("create tasks table: %v", err)
}
store, err := NewStore(sqlxDB, sqlxDB)
if err != nil {
t.Fatalf("new store: %v", err)
}
return store
}
func TestTaskPR_PerRepoStorage(t *testing.T) {
store := newTestStore(t)
ctx := context.Background()
now := time.Now().UTC()
prFront := &TaskPR{
TaskID: "task-1", RepositoryID: "repo-front",
Owner: "kdlbs", Repo: "kandev", PRNumber: 100,
PRURL: "https://github.com/kdlbs/kandev/pull/100",
PRTitle: "frontend changes", HeadBranch: "feat/x", BaseBranch: "main",
State: "open", CreatedAt: now,
}
prBack := &TaskPR{
TaskID: "task-1", RepositoryID: "repo-back",
Owner: "kdlbs", Repo: "kandev-backend", PRNumber: 200,
PRURL: "https://github.com/kdlbs/kandev-backend/pull/200",
PRTitle: "backend changes", HeadBranch: "feat/x", BaseBranch: "main",
State: "open", CreatedAt: now,
}
if err := store.CreateTaskPR(ctx, prFront); err != nil {
t.Fatalf("create front PR: %v", err)
}
if err := store.CreateTaskPR(ctx, prBack); err != nil {
t.Fatalf("create back PR: %v", err)
}
gotFront, err := store.GetTaskPRByRepository(ctx, "task-1", "repo-front")
if err != nil {
t.Fatalf("get front: %v", err)
}
if gotFront == nil || gotFront.PRNumber != 100 {
t.Errorf("expected front PR #100, got %+v", gotFront)
}
gotBack, err := store.GetTaskPRByRepository(ctx, "task-1", "repo-back")
if err != nil {
t.Fatalf("get back: %v", err)
}
if gotBack == nil || gotBack.PRNumber != 200 {
t.Errorf("expected back PR #200, got %+v", gotBack)
}
all, err := store.ListTaskPRsByTask(ctx, "task-1")
if err != nil {
t.Fatalf("list: %v", err)
}
if len(all) != 2 {
t.Errorf("expected 2 PRs for task, got %d", len(all))
}
}
// TestTaskPR_ReplaceTaskPR_PreservesSiblingsAndUpserts locks the
// multi-branch upsert semantics of ReplaceTaskPR. The function now
// upserts on (task_id, repository_id, pr_number) instead of wiping all
// rows for (task, repo). Effects:
//
// - Different repo (repo-b) stays untouched.
// - Different PR number on the same repo (repo-a, pr=1) stays as a
// sibling — multi-branch tasks need this so two PRs on the same repo
// coexist instead of one clobbering the other.
// - Same (task, repo, pr_number) is overwritten (the upsert).
func TestTaskPR_ReplaceTaskPR_PreservesSiblingsAndUpserts(t *testing.T) {
store := newTestStore(t)
ctx := context.Background()
now := time.Now().UTC()
if err := store.CreateTaskPR(ctx, &TaskPR{
TaskID: "task-2", RepositoryID: "repo-a",
Owner: "o", Repo: "r", PRNumber: 1, CreatedAt: now,
}); err != nil {
t.Fatalf("create A#1: %v", err)
}
if err := store.CreateTaskPR(ctx, &TaskPR{
TaskID: "task-2", RepositoryID: "repo-b",
Owner: "o", Repo: "r2", PRNumber: 2, CreatedAt: now,
}); err != nil {
t.Fatalf("create B#2: %v", err)
}
// Add a new PR #99 on repo-a — must NOT delete repo-a's PR #1
// (multi-branch) nor repo-b's #2 (multi-repo).
if err := store.ReplaceTaskPR(ctx, &TaskPR{
TaskID: "task-2", RepositoryID: "repo-a",
Owner: "o", Repo: "r", PRNumber: 99, CreatedAt: now,
}); err != nil {
t.Fatalf("replace A#99: %v", err)
}
all, _ := store.ListTaskPRsByTask(ctx, "task-2")
if len(all) != 3 {
t.Fatalf("expected 3 PR rows (multi-branch siblings + multi-repo), got %d", len(all))
}
// Now overwrite repo-a #99 by calling ReplaceTaskPR with the same
// (task, repo, pr_number) and a different field — upsert path.
if err := store.ReplaceTaskPR(ctx, &TaskPR{
TaskID: "task-2", RepositoryID: "repo-a",
Owner: "o", Repo: "r", PRNumber: 99, PRTitle: "updated", CreatedAt: now,
}); err != nil {
t.Fatalf("upsert A#99: %v", err)
}
all, _ = store.ListTaskPRsByTask(ctx, "task-2")
if len(all) != 3 {
t.Fatalf("expected 3 rows after upsert, got %d", len(all))
}
}
// Regression: a task that pre-dated the multi-repo schema kept a row with
// repository_id=”, then a later sync inserted a NEW row under the resolved
// repository_id — leaving two rows for the same PR and "+2" badges on the
// kanban card. backfillTaskPRsRepositoryID must dedup the legacy row.
func TestBackfillTaskPRsRepositoryID_DedupsLegacyEmptyRow(t *testing.T) {
store := newTestStore(t)
ctx := context.Background()
now := time.Now().UTC()
// Insert a legacy row (repository_id = '') and a per-repo row for the
// same (task, owner, repo, pr_number). The unique index is
// (task_id, repository_id, pr_number), so both rows can coexist.
if err := store.CreateTaskPR(ctx, &TaskPR{
ID: "legacy", TaskID: "task-x", RepositoryID: "",
Owner: "kdlbs", Repo: "kandev", PRNumber: 767, CreatedAt: now,
}); err != nil {
t.Fatalf("create legacy: %v", err)
}
if err := store.CreateTaskPR(ctx, &TaskPR{
ID: "scoped", TaskID: "task-x", RepositoryID: "repo-1",
Owner: "kdlbs", Repo: "kandev", PRNumber: 767, CreatedAt: now,
}); err != nil {
t.Fatalf("create scoped: %v", err)
}
if err := store.backfillTaskPRsRepositoryID(); err != nil {
t.Fatalf("backfill: %v", err)
}
all, _ := store.ListTaskPRsByTask(ctx, "task-x")
if len(all) != 1 {
t.Fatalf("expected 1 PR after dedup, got %d", len(all))
}
if all[0].RepositoryID != "repo-1" {
t.Errorf("expected scoped row to win, got repository_id=%q", all[0].RepositoryID)
}
// Idempotent: second pass is a no-op.
if err := store.backfillTaskPRsRepositoryID(); err != nil {
t.Fatalf("second backfill: %v", err)
}
all2, _ := store.ListTaskPRsByTask(ctx, "task-x")
if len(all2) != 1 {
t.Errorf("idempotent expected 1 PR, got %d", len(all2))
}
}
// When task_repositories does not exist (e.g. github-store unit tests that
// init only this package's schema), backfill must skip the cross-package
// UPDATE rather than erroring out.
func TestBackfillTaskPRsRepositoryID_SkipsWhenTaskRepositoriesAbsent(t *testing.T) {
store := newTestStore(t)
if err := store.backfillTaskPRsRepositoryID(); err != nil {
t.Fatalf("backfill on store without task_repositories: %v", err)
}
}
// Regression: a single-repo task created before the multi-repo migration
// kept its github_pr_watches row with repository_id=”. The orchestrator's
// reconciler then created a SECOND watch row with the resolved
// repository_id (because (session_id, ”) != (session_id, 'X') in its dedup
// set). Both watches polled independently, so when the user opened a PR
// each one called AssociatePRWithTask with its own RepositoryID — leaving
// two github_task_prs rows for the same PR and a "+2" badge on the kanban
// card. backfillPRWatchesRepositoryID must dedup the legacy row so the
// reconciler's existence-check finds it under the resolved repository_id.
func TestBackfillPRWatchesRepositoryID_DedupsLegacyEmptyRow(t *testing.T) {
store := newTestStore(t)
ctx := context.Background()
now := time.Now().UTC()
// Legacy watch row (repository_id='') and the per-repo row that the
// reconciler inserted post-migration. Both reference the same session.
if err := store.CreatePRWatch(ctx, &PRWatch{
ID: "legacy-w", SessionID: "sess-1", TaskID: "task-w", RepositoryID: "",
Owner: "kdlbs", Repo: "kandev", PRNumber: 0, Branch: "feat/x",
CreatedAt: now, UpdatedAt: now,
}); err != nil {
t.Fatalf("create legacy watch: %v", err)
}
if err := store.CreatePRWatch(ctx, &PRWatch{
ID: "scoped-w", SessionID: "sess-1", TaskID: "task-w", RepositoryID: "repo-1",
Owner: "kdlbs", Repo: "kandev", PRNumber: 0, Branch: "feat/x",
CreatedAt: now, UpdatedAt: now,
}); err != nil {
t.Fatalf("create scoped watch: %v", err)
}
if err := store.backfillPRWatchesRepositoryID(); err != nil {
t.Fatalf("backfill: %v", err)
}
all, err := store.ListPRWatchesBySession(ctx, "sess-1")
if err != nil {
t.Fatalf("list: %v", err)
}
if len(all) != 1 {
t.Fatalf("expected 1 watch after dedup, got %d", len(all))
}
if all[0].RepositoryID != "repo-1" {
t.Errorf("expected scoped row to win, got repository_id=%q", all[0].RepositoryID)
}
// Idempotent: second pass is a no-op.
if err := store.backfillPRWatchesRepositoryID(); err != nil {
t.Fatalf("second backfill: %v", err)
}
all2, _ := store.ListPRWatchesBySession(ctx, "sess-1")
if len(all2) != 1 {
t.Errorf("idempotent expected 1 watch, got %d", len(all2))
}
}
// When task_repositories does not exist, the watch backfill must skip the
// cross-package UPDATE rather than erroring out — same contract as the
// task-PR backfill.
func TestBackfillPRWatchesRepositoryID_SkipsWhenTaskRepositoriesAbsent(t *testing.T) {
store := newTestStore(t)
if err := store.backfillPRWatchesRepositoryID(); err != nil {
t.Fatalf("backfill on store without task_repositories: %v", err)
}
}
// The orphan case — a single-repo task whose pre-migration watch never had a
// per-repo counterpart. The dedup pass leaves it alone; the UPDATE has to
// stamp its repository_id from task_repositories. This is what stops the
// reconciler from inserting a duplicate watch on the next poll tick.
func TestBackfillPRWatchesRepositoryID_BackfillsOrphanRow(t *testing.T) {
store := newTestStore(t)
ctx := context.Background()
if _, err := store.db.Exec(`CREATE TABLE task_repositories (
id TEXT PRIMARY KEY, task_id TEXT NOT NULL,
repository_id TEXT NOT NULL, position INTEGER DEFAULT 0
)`); err != nil {
t.Fatalf("create task_repositories: %v", err)
}
if _, err := store.db.Exec(
`INSERT INTO task_repositories VALUES ('r1','task-z','repo-abc',0)`,
); err != nil {
t.Fatalf("seed task_repositories: %v", err)
}
now := time.Now().UTC()
if err := store.CreatePRWatch(ctx, &PRWatch{
ID: "legacy-orphan", SessionID: "sess-2", TaskID: "task-z", RepositoryID: "",
Owner: "o", Repo: "r", PRNumber: 0, Branch: "feat/y",
CreatedAt: now, UpdatedAt: now,
}); err != nil {
t.Fatalf("create legacy: %v", err)
}
if err := store.backfillPRWatchesRepositoryID(); err != nil {
t.Fatalf("backfill: %v", err)
}
all, _ := store.ListPRWatchesBySession(ctx, "sess-2")
if len(all) != 1 {
t.Fatalf("expected 1 watch, got %d", len(all))
}
if all[0].RepositoryID != "repo-abc" {
t.Errorf("expected backfilled repository_id='repo-abc', got %q", all[0].RepositoryID)
}
}
// Covers the UPDATE path: a legacy row with repository_id=” and NO per-repo
// counterpart should get its repository_id stamped from task_repositories,
// not deleted. This is the most common case in real upgrades — a task that
// has only ever had one PR (so no duplicate to dedup) but pre-dates the
// per-repo schema.
func TestBackfillTaskPRsRepositoryID_BackfillsOrphanRow(t *testing.T) {
store := newTestStore(t)
ctx := context.Background()
if _, err := store.db.Exec(`CREATE TABLE task_repositories (
id TEXT PRIMARY KEY, task_id TEXT NOT NULL,
repository_id TEXT NOT NULL, position INTEGER DEFAULT 0
)`); err != nil {
t.Fatalf("create task_repositories: %v", err)
}
if _, err := store.db.Exec(
`INSERT INTO task_repositories VALUES ('r1','task-y','repo-abc',0)`,
); err != nil {
t.Fatalf("seed task_repositories: %v", err)
}
// Orphan legacy row: no per-repo counterpart, so the dedup DELETE leaves
// it alone and the UPDATE has to do the healing.
if err := store.CreateTaskPR(ctx, &TaskPR{
ID: "legacy2", TaskID: "task-y", RepositoryID: "",
Owner: "o", Repo: "r", PRNumber: 1, CreatedAt: time.Now().UTC(),
}); err != nil {
t.Fatalf("create legacy: %v", err)
}
if err := store.backfillTaskPRsRepositoryID(); err != nil {
t.Fatalf("backfill: %v", err)
}
all, _ := store.ListTaskPRsByTask(ctx, "task-y")
if len(all) != 1 {
t.Fatalf("expected 1 row, got %d", len(all))
}
if all[0].RepositoryID != "repo-abc" {
t.Errorf("expected backfilled repository_id='repo-abc', got %q", all[0].RepositoryID)
}
}