Skip to content

fix: cap recall injection size to prevent context bloat in long sessions #77

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
evilh2019 wants to merge 1 commit into
base: main
Choose a base branch
from
Open

fix: cap recall injection size to prevent context bloat in long sessions #77

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
19 changes: 15 additions & 4 deletions src/format/assemble.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -103,8 +103,19 @@ export function assembleContext(
b.pagerank - a.pagerank
);

// recall 返回的已经是 PPR 排序过的，全量放入
const selected = sorted;
// 体量控制：recalled 全保留（≤ recallMaxNodes）+ 本会话最近 MAX_ACTIVE 个 active，
// 防止长会话累积节点（400+）全量注入导致上下文爆满触发 compaction 抢占工具
// 针对性召回优先：注入主体 = recall(query) 的召回节点（recalled ≤ recallMaxNodes）。
// 语义检索已覆盖本会话相关节点，active 不按时间堆叠注入（曾导致 400+ 节点全量
// 注入、上下文爆满触发 compaction 抢占工具）。仅当召回为空时兜底最近 3 个。
const recalledAll = sorted.filter((n) => n.src === "recalled");
const activeFallback = recalledAll.length
? []
: sorted
.filter((n) => n.src === "active")
.sort((a, b) => (b.updatedAt ?? 0) - (a.updatedAt ?? 0))
.slice(0, 3);
const selected = [...recalledAll, ...activeFallback];

if (!selected.length) return { xml: null, systemPrompt: "", tokens: 0, episodicXml: "", episodicTokens: 0 };

Expand Down Expand Up @@ -180,11 +191,11 @@ export function assembleContext(
if (!node.sourceSessions?.length) continue;
// 取最近的 2 个 session
const recentSessions = node.sourceSessions.slice(-2);
const msgs = getEpisodicMessages(db, recentSessions, node.updatedAt, 500);
const msgs = getEpisodicMessages(db, recentSessions, node.updatedAt, 30);
if (!msgs.length) continue;

const lines = msgs.map(m =>
` [${m.role.toUpperCase()}] ${escapeXml(m.text.slice(0, 200))}`
` [${m.role.toUpperCase()}] ${escapeXml(m.text.slice(0, 120))}`
).join("\n");
episodicParts.push(` <trace node="${node.name}">\n${lines}\n </trace>`);
}
Expand Down