Files
kandev/apps/backend/internal/plugins/state/store.go
T
João Salavisa e145d48f22 feat: add plugin system with grpc runtime and native ui plugins (#1742)
* feat: add plugin system with grpc runtime and native ui plugins

- go plugin backends ship as release tarballs (per-platform binaries, checksums) that
  kandev installs from url/upload or filesystem sideload+sync, then spawns and
  supervises via hashicorp/go-plugin (unix socket / loopback tcp+automtls)
- strict typed grpc contract (kandev.plugin.v1): DeliverEvent/InvokeTool/HandleWebhook
  plus a capability-gated host service (state, secrets, emit); author sdk in
  pkg/pluginsdk; packaging cli in cmd/plugin-pack
- native frontend bundles: window.registerKandevPlugin + registry/host loader with
  dynamic routes, nav items, slots and ws handlers; plugins settings page with
  install dialog, sync button and enable/disable/uninstall
- gated behind the plugins feature flag (prod off, dev/e2e on); covered by unit and
  integration tests plus playwright e2e against a real packaged fixture plugin

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

* fix(plugins): hydrate base app context on plugin routes

Plugin-owned SPA routes classify as RouteUnknown, so the boot payload shipped
only feature flags — no workspaces, workflows, or kanban context. Native plugin
UI (e.g. host.ui.TaskCreateDialog) then had an empty store. Hydrate the same
base context as the Home route for unknown SPA routes.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

* feat(plugins): expose TaskCreateDialog on host.ui

Lets a native plugin open kandev's real create-task modal (prefilled via
initialValues) instead of POSTing directly.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

* fix(plugins): harden filesystem/URL sinks against CodeQL findings

Add sink-level guards on the plugin trust boundary: securejoin containment on
archive extraction (zip-slip), plugin-id validation before every fs_store path,
http/https scheme validation on install-from-URL, and non-interpolated ws-handler
error logging.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

* fix(plugins): address review findings (races, resource caps, lifecycle)

- serialize per-plugin startup to close a TOCTOU double-spawn race, and let a
  plugin restart after exhausting attempts
- bound plugin startup with an explicit 30s timeout
- reject backslash paths and cap decompressed bytes by actual size in pkgtar;
  only mark a package Signed when a verifier actually ran and passed
- delete plugin_state on uninstall; validate webhook keys against the manifest
  and cap webhook body size; restart an active plugin when a new version installs

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

* fix(plugins): sanitize plugin-id path sinks for CodeQL

Pin the plugin id to a single path segment with filepath.Base at recordPath/
configPath and pkgtar.Remove — a barrier the taint analysis recognizes.
Behaviour-identical for valid ids (already validated by safePluginID); clears
the go/path-injection alerts.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

* fix(plugins): inline plugin-id validation at path sinks for CodeQL

filepath.Base does not strip '..', so it is not a path-injection barrier. Call
the recognized safePluginID / id-pattern guard inline in Delete/GetConfig/
SetConfig and pkgtar.Remove — the same barrier that already cleared the Get sink.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

* fix(plugins): address code-review findings (backend)

- add capability-gating tests for the Host RPC service (was untested)
- close a stop-during-start orphan race so Disable/Uninstall can't leave a
  supervised subprocess behind
- on failed upgrade, remove only the new version dir (not all versions + data);
  restart the prior version
- validate manifest version and reject ids ending in .config (record-file alias)
- make Deliverer.Refresh non-blocking and cancel in-flight delivery on worker stop
- clamp out-of-range webhook status, skip-and-warn corrupt records in List,
  write records atomically, semver-aware sideload version pick

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

* fix(plugins): address code-review findings (frontend)

- wrap plugin routes + settings routes in a shared PluginErrorBoundary so a
  throwing plugin page shows a fallback instead of white-screening the SPA
- fix disable/re-enable in one session: keep the cached registration and
  re-run initialize instead of relying on a cached ES-module re-import
- prefix root-relative bundle/style URLs with apiBaseUrl (split-origin/Tauri)
- surface partial-install warnings via toast.warning instead of a bare success
- dedupe/remove injected style links on unload; gate PluginNavItems on the flag

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

* fix(plugins): serialize per-plugin lifecycle + guard config writes

- add a per-plugin keyed lock in Service so concurrent Enable/Disable/Install/
  Uninstall/UpdateConfig for one id are serialized (no status-machine race)
- take s.mu in SetConfig/GetConfig and write config atomically
- bound each plugin initialize() with a timeout so one hung bundle can't stall
  the rest of the boot load

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

* test(plugins): split service_test.go to satisfy file-length lint

Move the install/URL test group into service_install_test.go; no logic change.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

* ci: build and ship the e2e fixture plugin package to E2E shards

The plugin E2E specs' global-setup requires apps/backend/.build/kandev-plugin-e2e-1.0.0.tar.gz.
Build it in the E2E build job, upload it as an artifact, and download it in both
the regular and container shard jobs.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

---------

Co-authored-by: Kandev Agent <agent@kandev.dev>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-07-17 12:00:26 +01:00

153 lines
5.5 KiB
Go

// Package state provides a plugin-scoped key/value store backed by SQLite.
// Plugins read and write arbitrary JSON values under a (scope, scope_id, key)
// tuple, always filtered by plugin_id so a plugin can never read or write
// another plugin's state (spec: docs/specs/plugins/spec.md, "plugin_state").
package state
import (
"context"
"database/sql"
"encoding/json"
"errors"
"fmt"
"time"
"github.com/google/uuid"
"github.com/jmoiron/sqlx"
"github.com/kandev/kandev/internal/db"
)
// StateEntry is a single row returned by List.
type StateEntry struct {
Key string `db:"state_key" json:"key"`
Value json.RawMessage `db:"value_json" json:"value"`
UpdatedAt time.Time `db:"updated_at" json:"updated_at"`
}
// Store persists plugin-scoped KV state in the plugin_state table.
type Store struct {
db *sqlx.DB
ro *sqlx.DB
}
// NewStore creates a Store and initializes the plugin_state schema if needed.
func NewStore(pool *db.Pool) (*Store, error) {
s := &Store{db: pool.Writer(), ro: pool.Reader()}
if err := s.initSchema(); err != nil {
return nil, fmt.Errorf("plugin state schema init: %w", err)
}
return s, nil
}
// initSchema creates the plugin_state table. scope_id is declared NOT NULL
// with an empty-string default (the instance-scope sentinel) rather than a
// nullable column as the spec's illustrative DDL shows. SQLite's UNIQUE
// index treats every NULL as distinct, so a nullable scope_id would let
// ON CONFLICT(plugin_id, scope, scope_id, state_key) silently miss conflicts
// between rows that are both "no scope" (e.g. two instance-scope Set calls
// for the same key), producing duplicate rows instead of an upsert. Empty
// string is unambiguous under ordinary equality/uniqueness and matches this
// codebase's existing convention for optional scope-like columns (see
// base_schema.go: executor_id, repository_id, declared TEXT DEFAULT empty).
func (s *Store) initSchema() error {
_, err := s.db.Exec(`
CREATE TABLE IF NOT EXISTS plugin_state (
id TEXT PRIMARY KEY,
plugin_id TEXT NOT NULL,
scope TEXT NOT NULL DEFAULT 'instance',
scope_id TEXT NOT NULL DEFAULT '',
state_key TEXT NOT NULL,
value_json TEXT NOT NULL,
updated_at TEXT NOT NULL,
UNIQUE (plugin_id, scope, scope_id, state_key)
);
`)
return err
}
// Get returns the value stored for the given plugin/scope/scopeID/key.
// scopeID is "" for instance-scoped state. found is false if no row exists.
func (s *Store) Get(ctx context.Context, pluginID, scope, scopeID, key string) (json.RawMessage, bool, error) {
var raw string
err := s.ro.QueryRowContext(ctx, s.ro.Rebind(`
SELECT value_json FROM plugin_state
WHERE plugin_id = ? AND scope = ? AND scope_id = ? AND state_key = ?
`), pluginID, scope, scopeID, key).Scan(&raw)
if err != nil {
if errors.Is(err, sql.ErrNoRows) {
return nil, false, nil
}
return nil, false, err
}
return json.RawMessage(raw), true, nil
}
// Set upserts the value for the given plugin/scope/scopeID/key, setting
// updated_at to the current time in RFC3339 UTC.
func (s *Store) Set(ctx context.Context, pluginID, scope, scopeID, key string, value json.RawMessage) error {
now := time.Now().UTC().Format(time.RFC3339)
_, err := s.db.ExecContext(ctx, s.db.Rebind(`
INSERT INTO plugin_state (id, plugin_id, scope, scope_id, state_key, value_json, updated_at)
VALUES (?, ?, ?, ?, ?, ?, ?)
ON CONFLICT(plugin_id, scope, scope_id, state_key)
DO UPDATE SET value_json = excluded.value_json, updated_at = excluded.updated_at
`), uuid.New().String(), pluginID, scope, scopeID, key, string(value), now)
return err
}
// Delete removes the row for the given plugin/scope/scopeID/key. It is not
// an error if no matching row exists.
func (s *Store) Delete(ctx context.Context, pluginID, scope, scopeID, key string) error {
_, err := s.db.ExecContext(ctx, s.db.Rebind(`
DELETE FROM plugin_state
WHERE plugin_id = ? AND scope = ? AND scope_id = ? AND state_key = ?
`), pluginID, scope, scopeID, key)
return err
}
// DeleteAll removes every row for pluginID, across every scope and
// scope_id. Called by Service.Uninstall so a plugin's entire plugin_state
// footprint is removed alongside its extracted package and registry
// record — otherwise a reinstalled (or id-reused) plugin would silently
// inherit stale state from a previous install. Not an error if pluginID has
// no stored state.
func (s *Store) DeleteAll(ctx context.Context, pluginID string) error {
_, err := s.db.ExecContext(ctx, s.db.Rebind(`
DELETE FROM plugin_state WHERE plugin_id = ?
`), pluginID)
return err
}
// List returns all state entries for the given plugin/scope/scopeID.
func (s *Store) List(ctx context.Context, pluginID, scope, scopeID string) ([]StateEntry, error) {
rows, err := s.ro.QueryContext(ctx, s.ro.Rebind(`
SELECT state_key, value_json, updated_at FROM plugin_state
WHERE plugin_id = ? AND scope = ? AND scope_id = ?
ORDER BY state_key
`), pluginID, scope, scopeID)
if err != nil {
return nil, err
}
defer func() { _ = rows.Close() }()
var entries []StateEntry
for rows.Next() {
var (
key, raw, updatedAtStr string
)
if err := rows.Scan(&key, &raw, &updatedAtStr); err != nil {
return nil, err
}
updatedAt, err := time.Parse(time.RFC3339, updatedAtStr)
if err != nil {
return nil, fmt.Errorf("parse updated_at for key %q: %w", key, err)
}
entries = append(entries, StateEntry{Key: key, Value: json.RawMessage(raw), UpdatedAt: updatedAt})
}
if err := rows.Err(); err != nil {
return nil, err
}
return entries, nil
}