Skip to content

[Feature] [runtime] Support batched summarization for long-term memory. #384

@wenjin272

Description

@wenjin272

Search before asking

  • I searched in the issues and found nothing similar.

Description

Currently, we feed all items to the LLM at once, which may exceed the LLM's context window. We need to support batched summary generation.

Are you willing to submit a PR?

  • I'm willing to submit a PR!

Metadata

Metadata

Assignees

No one assigned

    Labels

    feature[Issue Type] New features or improvements to existing features.priority/majorDefault priority of the PR or issue.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions