🐛 Adapter rollover may lead to MCP stream errors #25
Description
Describe the bug
When the plugins adapter deployment rolls over, even if there is no "downtime" for pods, the first few calls to the new pod generally lead to MCP stream errors through the MCP inspector on tool calls. This may potentially be mitigable with deployment configuration but would have to be verified.
Steps To Reproduce
- Make sure tool calls are already leveraging the plugins adapter through the envoy filter
- Roll over/restart the plugins adapter deployment
- Make continuous tool calls
Expected Behavior
Plugins adapter deployment rollover should not impact usage
Additional Context
No response