Skip to content

epic: document and design how to handle chunked responses #31

@julianstephen

Description

@julianstephen

Problem

As responses from mcp server tools can be chunked or streamed we need to design how the plugin adapter will invoke guardrails. E.g., options can be:

  1. Wait for full response and then invoke guardrails (increased user wait time, and in case of very long running tools can break functionality)
  2. Call guardrails with all partial responses (depending on the guardrail, this may be ineffective in specific situations)

Goals and non-goals

  • Goals: Document usability and technical tradeoffs, and howtos.

Success criteria

  • tests that simulate chunked behavior for future features
  • docs that describe expected behaviors

Stories to be associated with this epic

No response

Additional Context

No response

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions