Skip to content

Enhance memory performance and fix browser response handling - #3243

Merged
Hillary Mutisya (hillary-mutisya) merged 18 commits into
mainfrom
dev/hillarym/memoryHub2
Oct 30, 2026
Merged

Hillary Mutisya (hillary-mutisya) merged 18 commits into
mainfrom
dev/hillarym/memoryHub2

Conversation

@hillary-mutisya

Copy link
Copy Markdown
Collaborator

Summary

  • Reduce repeated memory read/index work with committed-generation reads,
    immutable reader/view caches, parallel retrieval and paced background warmup.
  • Add opt-in serving experiments and independent query, initial-reader and
    deeper-answer model roles, with cancellation, timing and structured-response
    validation.
  • Align Memory Hub Search/Ask and Understanding with the explanation-first
    design while preserving grounding, exact-revision inspection and follow-ons.
  • Repair the inherited memory MCP manifest ordering violation so the repository
    policy check passes; dependency versions and manifest semantics are unchanged.

Base integration

Fetched origin/main before publication. Its latest commit, 2ff659b94, was
already an ancestor of this branch; git merge origin/main reported already
up to date. No conflicts or artificial merge commit were needed.

Motivation

Long imported conversations and maintained knowledge views expose expensive
repeated index loading and serial reading work. Users also need a readable
explanation of the evidence, not a page dominated by metadata or visual modules.
This change improves the normal read path and makes performance alternatives
measurable without promoting experimental quality/recall tradeoffs to defaults.

Behavior and configuration

  • Foreground reads use available committed generations rather than waiting on
    background ingestion/maintenance. Warm a collection when opened and pace
    background warmup five seconds after completion, with a startup trigger.
  • Reuse immutable readers and view indexes with bounded cache ownership and
    invalidation. Retain corpus scope, cancellation and exact-revision semantics.
  • P2/P3 serving alternatives remain opt-in through
    TYPEAGENT_MEMORY_PERF_EXPERIMENTS; unknown switches fail explicitly.
    Provisional source previews are not validated answers or follow-on handles.
  • Support independently configured query/initial/deeper model roles and Terra
    capacity metadata. Responses API calls preserve structured-output schemas.
    A status/reference disagreement permits one same-model regeneration; other
    invalid responses are not converted into successful answers.
  • Search/Ask keeps answer and original evidence in the main column, with typed
    insights in a supporting rail. Understanding adds readable state badges,
    formatted prose, in-flow unknowns, compact source disclosures and a follow-on
    composer directly beneath the explanation. Existing theme tokens remain.
  • No attachment/depth UI, new multi-collection guarantees or automatic promotion
    of the experimental fast-reader configuration.

Validation

Verified locally on Windows with Node 24.22.1, at head 63679076a:

  • Full pnpm run build passed in 67.583 seconds.
  • Browser-client suite: 44 suites / 444 tests passed.
  • Additional focused offline check-in regression run: 335 passed, including
    memory service (191), KnowPro (35), AI client (52), agent server (7),
    conversation persistence (20), and gateway/benchmark tooling (30).
  • One existing disabled mock-REST host-enablement test remains skipped; the
    focused native model-option/startup tests pass. No new skips were introduced.
  • Lint, complexity, circular-dependency and focused/skipped-test gates passed
    against origin/main; formatting passed. Ratchets were run on the committed
    final head, not an incomplete uncommitted file selection.
  • Actual product renderers were checked with synthetic RPC responses at
    390/1600 pixels in light/dark themes. Overflow and desktop reading/rail
    geometry checks pass. These fixtures are not live retrieval/latency evidence.
  • Repository policy: 12,104 checks passed. The manifest-only repair was also
    checked for parsed-JSON equality before and after the ordering change.

Share bounded view readers and committed projections, overlap retrieval, batch evidence validation, and cancel obsolete Understanding operations while preserving privacy and publication checks.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Preserve non-ASCII answer titles in browser network consumers and verify the SSE charset and Unicode event payload.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Apply translation caching after the document-scoped translator is installed. Declare verified full GPT-5.4 mini capacities without introducing generation caps. Retain private benchmark failures and allow bounded case selection.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Preserve native extraction settings through a built-in index settings factory. Keep query roles fixed, retain existing translator decorators, and reject ambiguous opaque factory overrides.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Keep grounding strict, isolate query and initial-reader roles, and retain opt-in private model diagnostics for reliability measurements.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
…onstruction

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Keep query and answer roles independently selectable. Preserve Responses API JSON output schemas, add verified Terra capacities, and observe Responses calls in latency benchmarks.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Require schema presence for Responses and Chat Completions while retaining Messages omission and exact inspection/dispatch equality checks.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Choose retry target versions and history head under the admission writer instead of consuming a potentially lagging committed inventory. Preserve public expected-head and support guards and exercise a deterministic stale foreground inventory in maintenance failure recovery tests.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Preserve checkpoint-aware maintenance scheduling and writer-scoped retry admission alongside committed-generation reads.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Observe the authoritative store read while retaining nonempty and all-exclusive lease assertions. Include full publication diagnostics without weakening the ready-state assertion.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@hillary-mutisya
Hillary Mutisya (hillary-mutisya) merged commit d2b5229 into main Oct 30, 2026
30 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant