Skip to content

chore(eve): testing - compile memory fixtures through source graph - #2418

Open
AndrewBarba wants to merge 1 commit into
barba/agent-info-v3from
barba/canonical-memory-compiler
Open

chore(eve): testing - compile memory fixtures through source graph#2418
AndrewBarba wants to merge 1 commit into
barba/agent-info-v3from
barba/canonical-memory-compiler

Conversation

@AndrewBarba

@AndrewBarba AndrewBarba commented Aug 22, 2026

Copy link
Copy Markdown
Collaborator

Summary

Related to #2347. This layer of stack #2420 is stacked on #2417.

Replace the integration harness's direct manifest fabrication with an ordinary programmatic application source. Synthetic agent.ts, tool, and skill modules now occupy their canonical logical paths and pass through the same source composition, primitive normalization, framework-default, binding-validation, and kernel-preparation pipeline as filesystem-authored agents. The in-process module map consumes the same complete binding collection as generated artifacts and preserves real namespaces and callbacks.

This PR also removes the narrow capability adapter retained in #2410 so that the earlier core PR can land independently. Programmatic application origins remain source-neutral and cannot recursively introduce subagents. The harness API becomes asynchronous because it now executes the real normalizers.

Scope boundary: the memory-vs-disk lifecycle-equivalence proof remains a required follow-up in the research plan and is intentionally not claimed here. Stack-level docs, deterministic e2e coverage, and the minor changeset follow in #2419.

Validation

The exact final stack tree passed the full eve unit suite with 7,051 tests and 1 skip, plus 26 focused compiler and agent-info scenarios. Formatting, workspace typecheck, lint, invariant checks, and docs validation are green. Local integration coverage reaches the canonical compiler path; three cancellation cases remain blocked locally by a microsandbox database containing migrations unavailable in this checkout. The full unit, Linux and Windows integration, scenario, TUI, typecheck, lint, invariant, and docs gates are independently green in exact-head CI.

Checklist

  • This change was requested or approved by a maintainer
  • I ran the relevant checks from CONTRIBUTING.md
  • I added tests and documentation where relevant
  • I added a changeset if this touches the published eve package (the stack-level minor changeset follows in docs(eve): agent sources - document canonical composition #2419)
  • DCO sign-off passes for every commit (git commit --signoff)

Diff size

Docs — 0 files · +0 / -0

Documentation and release metadata intentionally follow in #2419.

Implementation — 8 files · +381 / -277

The canonical compiler path replaces the direct manifest shortcut and extends the shared programmatic binding machinery needed by in-memory sources.

Tests — 14 files · +176 / -151

Harness and execution tests migrate from patched empty namespaces to real authored module definitions and callbacks.

@vercel

vercel Bot commented Aug 22, 2026

Copy link
Copy Markdown
Contributor

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
eve-docs Ready Ready Preview, v0 Aug 22, 2026 3:49pm
eve-docs-4759 Ready Ready Preview, v0 Aug 22, 2026 3:49pm
1 Skipped Deployment
Project Deployment Actions Updated (UTC)
eve-pkg Skipped Skipped v0 Aug 22, 2026 3:49pm

@github-actions

github-actions Bot commented Aug 22, 2026

Copy link
Copy Markdown
Contributor

Bundle + Package Summary: apps/fixtures/weather-agent

Key takeaways

  • No notable deltas vs barba/agent-info-v3 (0498eef).

Delta vs barba/agent-info-v3 (0498eef)

Area Metric Baseline Current Delta
Package Packed tarball 8.19 MB 8.19 MB +324 B ⚠️
Package Unpacked publish size 30.85 MB 30.85 MB +3.9 kB ⚠️
Package Installed footprint 75.04 MB 75.04 MB +3.9 kB ⚠️
Package Published files 3470 3470 0
Package Installed files 7184 7184 0
Package Installed package instances 35 35 0
Package Distinct installed package names 34 34 0
Package Installed dependency edges 53 53 0
Package Installed optional peer edges 47 47 0
Runtime Unique function payloads 2 2 0
Runtime Total function bytes 18.25 MB 18.25 MB +204 B ⚠️
Runtime Public routes 16 16 0
Changed function payloads vs barba/agent-info-v3 (0498eef) (2)
Function Status Baseline Current Delta Route changes
functions/__server.func changed 9.12 MB 9.12 MB +102 B ⚠️ none
functions/.well-known/workflow/v1/flow.func changed 9.12 MB 9.12 MB +102 B ⚠️ none

eve init install

Metric Baseline Current Delta
Installed footprint 113.45 MB 113.45 MB +3.9 kB ⚠️
Installed packages 121 121 0
dependencies 4 4 0
devDependencies 2 2 0
Dependency package bytes 45.41 MB 45.41 MB +3.9 kB ⚠️
devDependency package bytes 5.04 MB 5.04 MB 0 B ➖
Build Metadata
  • Preset: vercel
  • Nitro: nitro@3.0.260610-beta
  • Output directory: apps/fixtures/weather-agent/.vercel/output
  • Build metadata timestamp: 2026-08-22T15:50:30.594Z
  • Route aliases: 16 public, 1 internal (17 total aliases)
  • Vercel routes in config: 19
  • Severity legend: 🔴 dominant/large, 🟠 notable, 🟡 watch, ⚪ small
Package Drill-Down

Package Details

  • Package: eve@0.44.0
  • Package directory: packages/eve
  • Tarball: 8.19 MB (eve-0.44.0.tgz)
  • Unpacked payload: 30.85 MB across 3470 published files
  • Installed footprint: 75.04 MB across 7184 installed files
  • Installed root package: 29.50 MB
  • Installed dependencies: 45.55 MB
  • Installed package instances: 35
  • Distinct installed package names: 34
  • Installed dependency edges: 53
  • Installed optional peer edges: 47
  • Runtime dependencies: 2
  • Peer dependencies: 5 (4 optional)

Installed footprint is measured from an isolated temporary npm install of the packed tarball.
Graph metrics read only package.json files in package directories directly beneath a node_modules boundary, including nested boundaries. Each directory is one package instance; distinct names come from those manifests. Dependency edges count each unique name in dependencies or optionalDependencies per instance; optional peer edges count peerDependencies marked optional.

Heavy installed dependencies

  • eve: 29.50 MB (39.3%)
  • @rolldown/binding-linux-x64-gnu: 19.91 MB (26.5%)
  • ai: 6.75 MB (9.0%)
  • zod: 5.07 MB (6.8%)
  • undici: 3.50 MB (4.7%)
Publish payload breakdown
Published file size
🔴 dist/src/compiled/shadcn-registry/index.js       [###############.........] 9.76 MB 31.6%
🟠 dist/src/compiled/@photon-ai/chat-adapter-ime... [####....................] 2.44 MB 7.9%
🟠 dist/src/compiled/experimental-ai-sdk-code-mo... [##......................] 1.51 MB 4.9%
🟡 dist/src/compiled/_chunks/workflow/undici-Dzn... [#.......................] 512.7 kB 1.7%
🟡 dist/src/compiled/_chunks/node/undici-CUIybhQ... [#.......................] 508.8 kB 1.6%
🔴 Other published files                            [########################] 16.12 MB 52.3%
Installed footprint breakdown
Installed package size
🔴 eve                             [########################] 29.50 MB 39.3%
🔴 @rolldown/binding-linux-x64-gnu [################........] 19.91 MB 26.5%
🔴 ai                              [#####...................] 6.75 MB 9.0%
🔴 zod                             [####....................] 5.07 MB 6.8%
🟠 undici                          [###.....................] 3.50 MB 4.7%
🟠 nitro                           [##......................] 2.41 MB 3.2%
🔴 Other installed packages        [######..................] 7.90 MB 10.5%
Runtime dependencies (2)
Package Range Notes
nitro 3.0.260610-beta
undici 8.9.0
Peer dependencies (5)
Package Range Notes
@opentelemetry/api ^1.0.0 optional peer
ai catalog:
braintrust ^3.0.0 optional peer
just-bash ^3.0.0 optional peer
microsandbox ^0.5.0 optional peer
eve init install drill-down

eve init install details

  • Command: eve init my-agent
  • Package manager: npm
  • Installed footprint: 113.45 MB across 9060 installed files
  • Installed packages: 121 total (115 transitive-only)
  • dependencies: 4 direct packages totaling 45.41 MB
  • devDependencies: 2 direct packages totaling 5.04 MB
  • Other transitive package files: 63.00 MB

Installed footprint is measured from an isolated temporary eve init my-agent using the current packed eve tarball.

Heavy installed dependencies

  • eve: 29.50 MB (26.0%)
  • @typescript/typescript-linux-x64: 27.95 MB (24.6%)
  • @rolldown/binding-linux-x64-gnu: 19.91 MB (17.6%)
  • zod: 9.02 MB (8.0%)
  • ai: 6.75 MB (6.0%)
Installed footprint breakdown
Installed package size
🔴 eve                              [########################] 29.50 MB 26.0%
🔴 @typescript/typescript-linux-x64 [#######################.] 27.95 MB 24.6%
🔴 @rolldown/binding-linux-x64-gnu  [################........] 19.91 MB 17.6%
🔴 zod                              [#######.................] 9.02 MB 8.0%
🔴 ai                               [#####...................] 6.75 MB 6.0%
🟠 undici                           [###.....................] 3.50 MB 3.1%
🔴 Other installed packages         [##############..........] 16.82 MB 14.8%
dependencies (4)
Package Range Installed size Share
@vercel/connect 0.4.3 141.0 kB 0.1%
ai ^7.0.58 6.75 MB 6.0%
eve file:eve-0.44.0.tgz 29.50 MB 26.0%
zod 4.4.3 9.02 MB 8.0%
devDependencies (2)
Package Range Installed size Share
@types/node 24.x 2.54 MB 2.2%
typescript 7.0.2 2.50 MB 2.2%
Function Drill-Down

Payload Size Graph

Unique function payload size and share of total
🔴 functions/.well-known/workflow/v1/flow.func     [########################] 9.12 MB 50.0%
🔴 functions/__server.func                         [########################] 9.12 MB 50.0%

Top Function Payloads

🟠 functions/.well-known/workflow/v1/flow.func • 1 public route • 9.12 MB
Metric Value
Public routes /.well-known/workflow/v1/flow
Runtime nodejs24.x
Handler index.mjs
Payload 9.12 MB
Function files 9.12 MB across 49 files
Traced dependencies 0 B
Signal 🟠 Bundled file index.mjs is 2.86 MB (31.3%)

🟠 🔎 Dependency Analysis

📦 Bundled files:

Bundled file size
🟠 index.mjs                     [########################] 2.86 MB 31.3%
🟠 _chunks/runtime-artifacts.mjs [#########...............] 1.03 MB 11.3%
🟡 _libs/undici.mjs              [########................] 980.5 kB 10.7%
🟡 _chunks/sandbox.mjs           [#######.................] 781.9 kB 8.6%
🟡 _chunks/frames-Dl2Hcma4.mjs   [######..................] 678.7 kB 7.4%
🟠 Other bundled files           [#######################.] 2.80 MB 30.7%

🧾 Vercel Config

{
  "handler": "index.mjs",
  "launcherType": "Nodejs",
  "shouldAddHelpers": false,
  "supportsResponseStreaming": true,
  "runtime": "nodejs24.x",
  "maxDuration": "max",
  "experimentalTriggers": [
    {
      "type": "queue/v2beta",
      "topic": "__eve776561746865722d6167656e74_wkf_workflow_*",
      "consumer": "default",
      "retryAfterSeconds": 5,
      "initialDelaySeconds": 0
    }
  ],
  "environment": {
    "WORKFLOW_PRECONDITION_GUARD": "1"
  }
}

🟠 functions/__server.func • 15 public routes, 1 internal alias • 9.12 MB
Metric Value
Public routes /
/eve/v1/callback/[token]
/eve/v1/connections/[name]/callback/[attemptId]/[token]
/eve/v1/connections/[name]/callback/[token]
/eve/v1/health
/eve/v1/info
/eve/v1/session
/eve/v1/session/[parentSessionId]/subagents/[callId]/[childSessionId]/stream
/eve/v1/session/[sessionId]
/eve/v1/session/[sessionId]/cancel
/eve/v1/session/[sessionId]/clear
/eve/v1/session/[sessionId]/compact
/eve/v1/session/[sessionId]/reset
/eve/v1/session/[sessionId]/stream
/eve/v1/task-input/[token]
Internal aliases /__server
Runtime nodejs24.x
Handler index.mjs
Payload 9.12 MB
Function files 9.12 MB across 49 files
Traced dependencies 0 B
Signal 🟠 Bundled file index.mjs is 2.86 MB (31.3%)

🟠 🔎 Dependency Analysis

📦 Bundled files:

Bundled file size
🟠 index.mjs                     [########################] 2.86 MB 31.3%
🟠 _chunks/runtime-artifacts.mjs [#########...............] 1.03 MB 11.3%
🟡 _libs/undici.mjs              [########................] 980.5 kB 10.7%
🟡 _chunks/sandbox.mjs           [#######.................] 781.9 kB 8.6%
🟡 _chunks/frames-Dl2Hcma4.mjs   [######..................] 678.7 kB 7.4%
🟠 Other bundled files           [#######################.] 2.80 MB 30.7%

🧾 Vercel Config

{
  "handler": "index.mjs",
  "launcherType": "Nodejs",
  "shouldAddHelpers": false,
  "supportsResponseStreaming": true,
  "runtime": "nodejs24.x"
}

Build Timing: e2e/fixtures/agent-tools-sandbox

This is an informational timing measurement inside eve build, from preflight through publication. Output-size measurement and profile writing are excluded.

Build mode: deployable Vercel build with sandbox template prewarm included.

  • Build pipeline: 2.21 s -> 2.21 s (-3.2 ms) vs barba/agent-info-v3 (0498eef).
  • Timing is informational: shared GitHub runners are too variable for a hard timing budget.
Detailed phase timings vs `barba/agent-info-v3 (0498eef)`
Phase Baseline Current Delta
extension.check 11.4 ms 10.8 ms -0.6 ms
project.resolve 0.3 ms 0.3 ms 0.0 ms
workspace.create 0.6 ms 0.7 ms +0.1 ms
host.prepare 287.4 ms 252.8 ms -34.6 ms
vercel.service-prefix.resolve 1.5 ms 1.7 ms +0.2 ms
nitro.create 197.0 ms 205.3 ms +8.3 ms
sandbox.prewarm 220.1 ms 291.8 ms +71.7 ms
nitro.cache.prepare 0.2 ms 0.2 ms 0.0 ms
nitro.prepare 0.8 ms 0.7 ms -0.1 ms
nitro.public-assets 0.7 ms 0.7 ms 0.0 ms
nitro.prerender 0.4 ms 0.4 ms 0.0 ms
nitro.bundle 1.44 s 1.38 s -54.9 ms
nitro.cache.write 0.3 ms 0.3 ms 0.0 ms
vercel.workflow-function.materialize 50.6 ms 58.4 ms +7.8 ms
agent-summary.emit 0.8 ms 0.7 ms -0.1 ms
nitro.close 0.2 ms 0.2 ms 0.0 ms
output.publish 4.0 ms 3.0 ms -1.0 ms
workspace.remove 1.7 ms 1.7 ms 0.0 ms

Replace the test-only compiled descriptor shortcut with an ordinary programmatic application source. Compile agent config, tools, skills, framework defaults, bindings, and module namespaces through the canonical compiler path.

Signed-off-by: Andrew Barba <barba@hey.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant