Files
kandev/apps/backend/internal/review/parse.go
T
João Salavisa 57adf1449c feat(review): native code-review agent with inline findings in the Changes panel (#1957)
* feat(review): persist and publish native code-review findings

Adds the backend core for reviewing a task's working diff before a PR
exists: task-scoped review runs and anchored, advisory findings that the
Changes/Review panel can render as inline comments.

- task_review_runs / task_review_findings schema, models, and repository,
  with supersede-on-re-review and a restart sweep that cancels in-flight
  runs rather than leaving them looking alive.
- ReviewService as the single write path, publishing bus events that the
  WS gateway forwards to the client.
- internal/review: reviewer-identity resolution (agent profile > code-review
  utility agent > user default, failing closed on passthrough-only profiles),
  change-set collection, prompt batching, response parsing, anchor
  extraction, and run orchestration.
- publish_review_findings_kandev MCP tool plus the task.review.* WS actions.
- Go djb2 that matches apps/web/lib/utils/hash.ts, asserted from shared
  fixtures on both sides so stale detection agrees across the wire.

Spec: docs/specs/native-code-review/spec.md
Plan: docs/plans/native-code-review/plan.md

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>

* feat(review): add run_code_review workflow step and wire the review runner

Makes a review pass triggerable both ways and actually runnable end to end.

- run_code_review on_enter action across models, engine compile, and an
  orchestrator callback that logs rather than propagates failures, so a task
  never gets stuck in a step because no reviewer was configured.
- The step's optional agent_profile_id is what lets a step review with a
  different model than it implemented with; export/import swap it for a
  portable agent name/model/mode so it survives a cross-workspace round trip
  instead of carrying a dangling id.
- Concrete adapters for reviewer identity, changed-file collection, prompt
  rendering from the code-review utility agent's editable prompt, and
  inference (session-bound agentctl, falling back to the host instance so a
  review works on a task whose agent is not running).
- Boot sweep cancels review runs interrupted by a restart; the E2E reset
  clears review state before deleting the tasks that own it.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>

* feat(web): add review findings state, helpers, and live updates

Frontend plumbing for native code review, ahead of the UI that renders it.

- Review types, WS message map, and an API client that preserves the backend's
  machine-readable failure code so the surface can show an actionable message.
- A review store slice that merges findings by id (a re-publish refreshes an
  issue rather than listing it twice) and keeps a bounded run history.
- Findings helpers: composite file keys matching reviewFileKey, staleness via
  the same per-file diff hash that drives review marks, and best-effort
  re-anchoring from the stored anchor text so a moved finding follows the code
  it was written about instead of pointing at whatever now occupies its line.
- Hooks for backfill, resolve/dismiss/reopen with optimistic rollback, and
  sending a finding to the agent as follow-up context without changing its
  status — handing a finding to an agent is not the human accepting it.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>

* feat(web): render review findings inline in the Changes diff

Findings now appear where the code is, in the same annotation surface as
anchored review comments, with the run control that produces them.

- ReviewFindingCard: severity chip, category, Markdown body, and the three
  advisory actions. A suggestion is labelled "not applied automatically"
  because it is display-only in this iteration. Resolved and dismissed
  findings collapse to one muted line with an Undo, so a reviewed diff does
  not stay cluttered while the human can still change their mind.
- A review-finding annotation type threaded through the diff viewer, anchored
  from the same per-file diff hash the backend stamped. A finding whose diff
  moved is re-anchored from its stored text when that text survives, and
  otherwise reported as unanchored rather than placed against unrelated code.
- Review changes control with idle / running / cancel / failed states, and an
  inline Settings link for the one failure the user can actually fix.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>

* feat(web): make the review control reachable from the Review toolbar

Mounts the Review changes control next to the walkthrough action and lets an
inline finding wire its own actions.

The finding card container now reads the active task and session from the store
instead of taking four callbacks threaded through FileDiffViewer and DiffViewer;
an inline finding annotation only exists when the active task has findings, so
the store is always present and every other diff consumer is spared the
plumbing. Staleness likewise hashes the diff the viewer already holds, which is
already normalized, so it matches the hash the backend stamped without passing
it down.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>

* feat(web): surface stale review findings above their file's diff

A finding whose diff moved and whose anchor text is gone had nowhere to render,
so it was silently dropped. It now appears in a collapsed per-file banner above
the diff: the finding may still be valid, and placing it at its stored line
would point at whatever code now occupies that line instead.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>

* docs(review): mark the landed native code-review plan tasks done

Tasks 01-09 (backend persistence through inline diff rendering) are
implemented, tested, and committed. Tasks 10-13 — findings overview and step
editor, mobile parity, E2E, and public docs — remain pending.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>

* test(review): cover the on-demand review path end to end

Adds the mock-agent review responder and a Playwright spec, so both the happy
path and the no-reviewer path are verified against a real backend.

The mock agent answers any prompt carrying the review sentinel with fenced JSON,
deriving its anchors from the prompt's own diff rather than hardcoding them, so
findings land on files and lines the fixture really changed. It includes one
deliberately malformed entry to exercise the rejected-entry path.

Writing it caught an off-by-one shared by three diff walkers: splitting on "\n"
leaves an empty element after a trailing newline, which carries no diff marker
and was being counted as a context line, pushing new-side numbering one past the
end of a hunk. Interior blank lines still count, since a whitespace-stripped
blank context line legitimately appears as "".

Also adds a listInferenceAgents helper: default_utility_agent_id needs the
registered agent-type id, and an agent row UUID is rejected as not
inference-capable.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>

* fix(review): close review-run races and stale client findings

Addresses the three blockers and three suggestions from the PR #1957 automated
reviews. Two independent reviewers found each blocker separately.

- Launch claimed the task slot only after inserting the run row, so two
  concurrent launches both created a run and the loser returned a pending row
  with no goroutine behind it — a review that never finished until the next
  restart. The slot is now claimed before any DB write, and freed on every
  early return.
- Cancelling only marked the row. The goroutine ran on the shared background
  context, finished inference, and its completion overwrote the cancelled
  status and published findings the user had declined. Runs now carry a cancel
  handle, the WS action routes through the runner so the live context is
  cancelled, CompleteRun/FailRun refuse to resurrect a terminal run, and a
  cancelled pass neither publishes nor re-reports itself as failed.
- The backend deletes a superseded finding and inserts a replacement with a new
  id, but the publish event carried only the new one, so every open browser
  showed both at the same anchor until a reload. The event now names the
  superseded ids and the slice drops them.
- Run() waited on the shared WaitGroup, blocking on every other task's review;
  it now waits on its own pass only.
- createReviewSlice is typed over the `set` it actually uses, so call sites no
  longer pass superfluous arguments (CodeQL js/superfluous-trailing-arguments).
- A GetAgentProfile fault no longer collapses into "profile not found", which
  would have told the user to configure an agent they already have.

The cancel bug exposed a hole in the original tests: they asserted cancel could
not override a terminal run, but never the reverse. Both directions are covered
now, along with the concurrent-launch race, per-run waiting, and the supersede
path on both sides of the wire. Test fakes now mirror the service's terminal
guard rather than hiding it.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>

---------

Co-authored-by: Kandev Agent <agent@kandev.dev>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-07-26 15:05:56 +01:00

251 lines
7.9 KiB
Go

package review
import (
"encoding/json"
"fmt"
"strings"
"unicode/utf8"
"github.com/kandev/kandev/internal/task/models"
)
// maxAnchorTextBytes bounds the stored anchor snippet. Long enough to relocate a
// moved block, short enough that a large review does not bloat the row.
const maxAnchorTextBytes = 2000
// maxTitleRunes matches the spec's title constraint.
const maxTitleRunes = 120
// maxCategoryRunes matches the spec's category-slug constraint.
const maxCategoryRunes = 40
// FindingInput is one finding as reported by a reviewer, before it is anchored
// against the change set. Field names match both the reviewer's JSON contract
// and the `publish_review_findings_kandev` MCP schema, so the two paths share
// one validation surface.
type FindingInput struct {
Repo string `json:"repo"`
File string `json:"file"`
Line int `json:"line"`
LineEnd int `json:"line_end"`
Side string `json:"side"`
Severity string `json:"severity"`
Category string `json:"category"`
Title string `json:"title"`
Body string `json:"body"`
Suggestion string `json:"suggestion"`
}
// reviewerResponse is the JSON envelope the code-review prompt asks for.
type reviewerResponse struct {
Summary string `json:"summary"`
Findings []FindingInput `json:"findings"`
}
// ParseResult is the outcome of reading one reviewer reply.
type ParseResult struct {
Summary string
// Findings passed structural validation. May be empty: a clean review is a
// valid, successful result.
Findings []FindingInput
// Rejected counts entries that were individually malformed and dropped. The
// run still completes and reports the count, because a reviewer that got one
// entry wrong usually got the rest right.
Rejected int
}
// ParseFindings extracts the findings envelope from a reviewer's raw reply.
//
// Real agents wrap JSON in prose and fences even when told not to, so this
// accepts a ```json fenced block, a bare fenced block, or a raw object embedded
// in surrounding text. It returns ErrUnparseableResponse only when no findings
// array can be recovered at all — that is a run failure, because silently
// treating unreadable output as "no issues found" would be a false all-clear.
func ParseFindings(response string) (ParseResult, error) {
for _, candidate := range jsonCandidates(response) {
var envelope reviewerResponse
if err := json.Unmarshal([]byte(candidate), &envelope); err != nil {
continue
}
if envelope.Findings == nil && !hasFindingsKey(candidate) {
// Parsed as JSON but is not the review envelope (for example a bare
// string or an unrelated object). Keep looking.
continue
}
return validateFindings(envelope), nil
}
return ParseResult{}, fmt.Errorf("%w: no findings array in reviewer response", ErrUnparseableResponse)
}
func hasFindingsKey(candidate string) bool {
return strings.Contains(candidate, `"findings"`)
}
// jsonCandidates yields possible JSON payloads inside a reply, most-likely
// first: fenced blocks in order, then the widest brace-balanced span.
func jsonCandidates(response string) []string {
trimmed := strings.TrimSpace(response)
if trimmed == "" {
return nil
}
candidates := extractFencedBlocks(trimmed)
if span := widestObjectSpan(trimmed); span != "" {
candidates = append(candidates, span)
}
return candidates
}
// extractFencedBlocks returns the contents of every ``` fenced block, dropping
// an optional language tag on the opening fence.
func extractFencedBlocks(text string) []string {
const fence = "```"
var blocks []string
rest := text
for {
start := strings.Index(rest, fence)
if start < 0 {
return blocks
}
rest = rest[start+len(fence):]
// Drop the language tag, if any, up to the end of the line.
if nl := strings.IndexByte(rest, '\n'); nl >= 0 {
firstLine := strings.TrimSpace(rest[:nl])
if !strings.Contains(firstLine, "{") && !strings.Contains(firstLine, "[") {
rest = rest[nl+1:]
}
}
end := strings.Index(rest, fence)
if end < 0 {
// Unterminated fence: take everything that is left.
block := strings.TrimSpace(rest)
if block != "" {
blocks = append(blocks, block)
}
return blocks
}
block := strings.TrimSpace(rest[:end])
if block != "" {
blocks = append(blocks, block)
}
rest = rest[end+len(fence):]
}
}
// widestObjectSpan returns the text from the first '{' to the last '}', which
// recovers a bare object surrounded by prose.
func widestObjectSpan(text string) string {
start := strings.IndexByte(text, '{')
end := strings.LastIndexByte(text, '}')
if start < 0 || end <= start {
return ""
}
return text[start : end+1]
}
// validateFindings drops individually-invalid entries and normalizes the rest.
func validateFindings(envelope reviewerResponse) ParseResult {
result := ParseResult{Summary: strings.TrimSpace(envelope.Summary)}
for i := range envelope.Findings {
normalized, err := NormalizeFindingInput(envelope.Findings[i])
if err != nil {
result.Rejected++
continue
}
result.Findings = append(result.Findings, normalized)
}
return result
}
// NormalizeFindingInput trims, defaults, and validates one reported finding.
// Shared by the inference path (which drops a bad entry and continues) and the
// MCP path (which rejects the whole call so the agent can retry).
func NormalizeFindingInput(in FindingInput) (FindingInput, error) {
out := FindingInput{
Repo: strings.TrimSpace(in.Repo),
File: strings.TrimSpace(in.File),
Line: in.Line,
LineEnd: in.LineEnd,
Side: strings.TrimSpace(in.Side),
Severity: strings.ToLower(strings.TrimSpace(in.Severity)),
Category: normalizeCategory(in.Category),
Title: normalizeTitle(in.Title),
Body: strings.TrimSpace(in.Body),
Suggestion: strings.TrimSpace(in.Suggestion),
}
if out.File == "" {
return FindingInput{}, fmt.Errorf("file is required")
}
if out.Line <= 0 {
return FindingInput{}, fmt.Errorf("line must be positive, got %d", out.Line)
}
if out.LineEnd == 0 {
out.LineEnd = out.Line
}
if out.LineEnd < out.Line {
return FindingInput{}, fmt.Errorf("line_end %d is before line %d", out.LineEnd, out.Line)
}
if !models.ValidReviewSeverity(models.ReviewSeverity(out.Severity)) {
return FindingInput{}, fmt.Errorf("unknown severity %q", in.Severity)
}
if out.Title == "" {
return FindingInput{}, fmt.Errorf("title is required")
}
if out.Body == "" {
return FindingInput{}, fmt.Errorf("body is required")
}
if out.Side != models.ReviewSideDeletions {
out.Side = models.ReviewSideAdditions
}
return out, nil
}
// normalizeTitle collapses newlines and caps the length; a multi-line title
// would break the single-line finding header.
func normalizeTitle(title string) string {
flat := strings.Join(strings.Fields(strings.ReplaceAll(title, "\n", " ")), " ")
return truncateRunes(flat, maxTitleRunes)
}
// normalizeCategory lowercases and kebab-cases the slug so grouping is stable
// regardless of how the reviewer phrased it.
func normalizeCategory(category string) string {
lower := strings.ToLower(strings.TrimSpace(category))
var b strings.Builder
lastDash := false
for _, r := range lower {
switch {
case (r >= 'a' && r <= 'z') || (r >= '0' && r <= '9'):
b.WriteRune(r)
lastDash = false
default:
if !lastDash && b.Len() > 0 {
b.WriteByte('-')
lastDash = true
}
}
}
return truncateRunes(strings.Trim(b.String(), "-"), maxCategoryRunes)
}
func truncateRunes(s string, limit int) string {
runes := []rune(s)
if len(runes) <= limit {
return s
}
return string(runes[:limit])
}
// TruncateAnchorText caps a stored anchor snippet, cutting on a rune boundary so
// the stored text stays valid UTF-8. Trimming back at most three bytes is enough
// to drop any partial sequence, including a dangling lead byte.
func TruncateAnchorText(s string) string {
if len(s) <= maxAnchorTextBytes {
return s
}
cut := s[:maxAnchorTextBytes]
for len(cut) > 0 && !utf8.ValidString(cut) {
cut = cut[:len(cut)-1]
}
return cut
}