feat: add streaming tool activity messages during task execution #999

MkDev11 · 2026-01-21T13:18:00Z

Streaming Tool Activity During Task Execution

What's the problem?

Users couldn't see what agents were doing in real-time during task execution.

What this PR does

Shows real-time tool activity messages while agents work - letting users see what tools are being executed.

Note: This does NOT fully address #87, which requests streaming model text output. Model text streaming is blocked by a camel library limitation (AsyncChatCompletionStreamManager error when streaming with tools). This PR provides tool activity feedback as a partial improvement.

What you'll see

While tasks run, you'll see messages like:

[Tool] Shell Exec...
[Tool] Write Content To File...
[Tool] List Running Server...

This gives users real-time feedback on what the agent is doing.

What did I change?

Added streaming tool activity events:

Modified @listen_toolkit decorator to send ActionStreamingAgentOutputData events when tools start
Added streaming events in _execute_tool and _aexecute_tool methods
Frontend already handles streaming_agent_output events and displays them in the UI

Disabled model streaming for worker agents:

The camel library throws AsyncChatCompletionStreamManager errors when streaming with tools
Disabled to prevent crashes while still providing tool activity feedback

Commits

e1ee5c1 - fix: disable streaming for worker agents to prevent camel library error
- Disable model streaming for agents with tools (prevents crash)
- Add streaming infrastructure for future use
- Handle AsyncStreamingChatAgentResponse in single_agent_worker.py
abae378 - feat: add streaming tool activity messages during task execution
- Add streaming events in @listen_toolkit decorator
- Add streaming events in _execute_tool and _aexecute_tool
- Replace emoji with [Tool] text for compatibility

Files changed

backend/app/utils/agent.py - Add streaming events in tool execution, disable model streaming
backend/app/utils/listen/toolkit_listen.py - Add streaming events in @listen_toolkit decorator
backend/app/utils/single_agent_worker.py - Handle streaming responses properly

Testing

Submit a task like "Create a simple HTML page with a button that shows an alert when clicked, save it as index.html, then use Python's http.server to serve it on port 8080 and tell me the URL"
Watch the Developer Agent card while it's running
You should see [Tool] Shell Exec... messages appear in real-time
Task completes successfully

MkDev11 · 2026-01-21T13:36:57Z

@a7m-1st @fengju0213 could you please review the changes and let me know your feedback? thanks!

a7m-1st · 2026-01-21T18:07:26Z

Thanks for the PR @MkDev11 , I don't think I can manage to test this by today (UTC +3).
But have you taken a look at #767 ? kind of similar.

But UI wise can you attach a screenshot of which part you are exactly streaming? Just to get a faster picture !

The camel library throws 'AsyncChatCompletionStreamManager object has no attribute choices' when streaming is enabled for agents with tools attached. Changes: - Disable streaming for all astep calls in ListenChatAgent to avoid the error - Preserve model_config_dict when cloning agents (for future streaming support) - Add streaming infrastructure (ActionStreamingAgentOutputData) for when camel library support is available - Handle AsyncStreamingChatAgentResponse in single_agent_worker.py Note: Streaming text output for worker agents is blocked by upstream camel library limitation. Task decomposition streaming still works via decompose_text.

Shows real-time '[Tool] Shell Exec...', '[Tool] Write File...' etc. messages in the UI while tools are executing, giving users feedback on agent activity. Changes: - Add ActionStreamingAgentOutputData events in @listen_toolkit decorator - Add streaming events in _execute_tool and _aexecute_tool methods - Disable model streaming for worker agents (camel library limitation) - Replace emoji with [Tool] text for better compatibility Closes eigent-ai#87

MkDev11 · 2026-01-22T13:49:45Z

@a7m-1st I added some changes and updated the description. This PR adds some real-time feedback while tasks are running.

Before, you'd just see the task start and then wait until it finished. Now you'll see messages like [Tool] Shell Exec... pop up as the agent works, so you know what's actually happening behind the scenes.

I originally wanted to stream the model's actual thinking text (like ChatGPT does), but hit a wall - the camel library we use crashes when you try to stream with tools enabled. Since pretty much every agent uses tools, I pivoted to showing tool activity instead. Not quite what issue #87 asked for, but it's still a nice improvement.

MkDev11 · 2026-01-22T13:51:42Z

a7m-1st · 2026-01-22T16:36:52Z

I see awesome then Thanks @MkDev11, I need time so far as I am little occupied with other tasks. I will catch up with this PR once I got the chance.

MkDev11 · 2026-01-22T16:37:57Z

Cool!

…

On Thu, Jan 22, 2026 at 11:37 AM Ahmed Awelkair A ***@***.***> wrote: *a7m-1st* left a comment (eigent-ai/eigent#999) <#999 (comment)> I see awesome then Thanks @MkDev11 <https://github.com/MkDev11>, I need time so far as I am little occupied with other tasks. I will catch up with this PR once I got the chance. — Reply to this email directly, view it on GitHub <#999 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AWOUTY6VPENCFY57A6CZXZT4ID4DVAVCNFSM6AAAAACSM4HTTSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZTOOBVGM4DQMRSGM> . You are receiving this because you were mentioned.Message ID: ***@***.***>

a7m-1st · 2026-01-22T16:46:03Z

Hi there @Wendong-Fan , I think this would be a cool feature maybe Douglas can confirm if the UI meets expectations?

fengju0213 · 2026-01-23T07:17:15Z

@MkDev11 thanks for your contribution，i noticed that you mentioned that the camel library throws AsyncChatCompletionStreamManager errors when streaming with tools，however, Camel normally supports tool calls in streaming mode. Could I please tell you under what circumstances you encounter the error?

MkDev11 · 2026-01-23T09:02:13Z

@MkDev11 thanks for your contribution，i noticed that you mentioned that the camel library throws AsyncChatCompletionStreamManager errors when streaming with tools，however, Camel normally supports tool calls in streaming mode. Could I please tell you under what circumstances you encounter the error?

Hey @fengju0213, good catch - my comment in the code was a bit misleading. It's not streaming + tools that's the issue, it's streaming + response_format (structured output).

Here's what happens:

model = ModelFactory.create(
    model_platform=ModelPlatformType.OPENAI,
    model_type=ModelType.GPT_4O_MINI,
    model_config_dict={'stream': True}
)
agent = ChatAgent(system_message='...', model=model)

# this breaks
response = await agent.astep('query', response_format=SomePydanticModel)
async for chunk in response:
    print(chunk)

You get:

AttributeError: 'AsyncChatCompletionStreamManager' object has no attribute 'choices'

The problem is in _handle_batch_response (chat_agent.py:3743) - it tries to do for choice in response.choices but OpenAI returns an AsyncChatCompletionStreamManager when you combine streaming with structured output, and that object doesn't have .choices.

So I just disable streaming when we need structured output:

worker_agent.model_backend.model_config_dict["stream"] = False
response = await worker_agent.astep(prompt, response_format=TaskResult)

Let me know what you think

The issue is streaming + response_format (structured output), not streaming + tools

…nt-output

…enerating functions

- Add is_final field to AgentMessage type in chatbox.d.ts - Simplify chatStore.ts streaming handler (remove type cast, use currentTaskId) - Use deep copy for model_config_dict to ensure isolation between cloned agents

…treaming Per a7m-1st's review: activate_toolkit already provides sufficient tool activity info. Streaming infrastructure preserved in ListenChatAgent for future model output streaming once CAMEL PR #3743 is merged.

MkDev11 · 2026-01-23T23:55:44Z

@a7m-1st please review the changes

fengju0213 · 2026-01-24T02:45:31Z

@MkDev11 thanks for your contribution，i noticed that you mentioned that the camel library throws AsyncChatCompletionStreamManager errors when streaming with tools，however, Camel normally supports tool calls in streaming mode. Could I please tell you under what circumstances you encounter the error?

Hey @fengju0213, good catch - my comment in the code was a bit misleading. It's not streaming + tools that's the issue, it's streaming + response_format (structured output).

Here's what happens:
model = ModelFactory.create(
    model_platform=ModelPlatformType.OPENAI,
    model_type=ModelType.GPT_4O_MINI,
    model_config_dict={'stream': True}
)
agent = ChatAgent(system_message='...', model=model)

# this breaks
response = await agent.astep('query', response_format=SomePydanticModel)
async for chunk in response:
    print(chunk)
You get:
AttributeError: 'AsyncChatCompletionStreamManager' object has no attribute 'choices'
The problem is in _handle_batch_response (chat_agent.py:3743) - it tries to do for choice in response.choices but OpenAI returns an AsyncChatCompletionStreamManager when you combine streaming with structured output, and that object doesn't have .choices.

So I just disable streaming when we need structured output:
worker_agent.model_backend.model_config_dict["stream"] = False
response = await worker_agent.astep(prompt, response_format=TaskResult)
Let me know what you think

thank you very much！i will investigate this issue

src/components/WorkFlow/node.tsx

Per Douglasymlai's review - improves text readability for users

The fix was merged upstream in camel-ai/camel#3743. Once camel-ai is updated to include this fix, streaming with structured output will work correctly without disabling streaming.

…gle_agent_worker The fix was merged upstream in camel-ai/camel#3743.

Includes fix for AsyncChatCompletionStreamManager from PR #3743

a7m-1st · 2026-01-26T22:42:56Z

Hopfully we an resolve this in camel-ai/camel#3743

I believe we can simplify the configs now bcz it has been fixed @MkDev11 or are they unrelated? i.e. the manual setting of steam mode and on clone too

Remove specific mention of stream setting since the workaround for AsyncChatCompletionStreamManager is no longer needed.

MkDev11 · 2026-01-26T22:57:18Z

Hopfully we an resolve this in camel-ai/camel#3743

I believe we can simplify the configs now bcz it has been fixed @MkDev11 or are they unrelated? i.e. the manual setting of steam mode and on clone too

yep, I've simplified it! Removed the workarounds from both agent.py and single_agent_worker.py, and updated camel-ai to 0.2.85 which includes the fix. The stream mode settings and clone preservation are intentional config, not workarounds, so those stay.

MkDev11 · 2026-01-26T22:57:34Z

@a7m-1st please review the changes again

a7m-1st · 2026-01-27T13:51:03Z

All right sure, let me run it through the debugger to reconfirm the flow.
Aside than this, if @Wendong-Fan and @Douglasymlai find it a cool feature, I think it should be good 👍

MkDev11 · 2026-01-30T21:53:16Z

hello @Wendong-Fan can you review the changes again and let me know your feedback? I am still waiting for you

…nt structure

MkDev11 · 2026-02-01T19:05:17Z

hello @Wendong-Fan I am really sorry for tagging you, could you please give me any update for me?

…ent output

…ature

Wendong-Fan requested review from a7m-1st and fengju0213 and removed request for a7m-1st January 21, 2026 13:35

MkDev11 closed this Jan 22, 2026

MkDev11 force-pushed the feature/streaming-agent-output branch from d81f18c to 35f4ca2 Compare January 22, 2026 02:08

.

b3b7ed6

MkDev11 reopened this Jan 22, 2026

MkDev11 added 2 commits January 22, 2026 13:50

MkDev11 changed the title ~~feat: implement streaming output for agent responses~~ feat: add streaming tool activity messages during task execution Jan 22, 2026

Merge branch 'main' into feature/streaming-agent-output

d1e0e99

a7m-1st assigned MkDev11 Jan 22, 2026

a7m-1st added the Review Required label Jan 22, 2026

MkDev11 added 2 commits January 22, 2026 11:50

Merge branch 'main' into feature/streaming-agent-output

70b2357

Merge branch 'main' into feature/streaming-agent-output

15d5d7e

Wendong-Fan requested review from 4pmtong and Douglasymlai January 23, 2026 01:04

Merge branch 'main' into feature/streaming-agent-output

12a1a5c

fix: correct comment about streaming error cause

309883d

The issue is streaming + response_format (structured output), not streaming + tools

MkDev11 mentioned this pull request Jan 23, 2026

fix: detect AsyncChatCompletionStreamManager by class name camel-ai/camel#3743

Merged

6 tasks

Merge remote-tracking branch 'origin/main' into feature/streaming-age…

e7b2269

…nt-output

a7m-1st and others added 3 commits January 24, 2026 02:23

enhance: use _schedule_async_task to avoid async race conditions in g…

9edb548

…enerating functions

fix: address PR review comments from a7m-1st

8a44f38

- Add is_final field to AgentMessage type in chatbox.d.ts - Simplify chatStore.ts streaming handler (remove type cast, use currentTaskId) - Use deep copy for model_config_dict to ensure isolation between cloned agents

MkDev11 requested a review from a7m-1st January 25, 2026 00:17

MkDev11 and others added 3 commits January 25, 2026 01:32

Merge upstream/main into feature/streaming-agent-output

8902bdb

Merge branch 'main' into feature/streaming-agent-output

8c54244

Merge branch 'main' into feature/streaming-agent-output

9a3c256

Douglasymlai reviewed Jan 26, 2026

View reviewed changes

src/components/WorkFlow/node.tsx Show resolved Hide resolved

MkDev11 and others added 6 commits January 26, 2026 07:45

Merge branch 'main' into feature/streaming-agent-output

460eda5

style: change leading-tight to leading-normal for better readability

ceddf47

Per Douglasymlai's review - improves text readability for users

Merge branch 'main' into feature/streaming-agent-output

6ff3915

refactor: remove AsyncChatCompletionStreamManager workaround

81b5f6e

The fix was merged upstream in camel-ai/camel#3743. Once camel-ai is updated to include this fix, streaming with structured output will work correctly without disabling streaming.

refactor: remove AsyncChatCompletionStreamManager workaround from sin…

f4574ac

…gle_agent_worker The fix was merged upstream in camel-ai/camel#3743.

chore: update camel-ai to 0.2.85

6759353

Includes fix for AsyncChatCompletionStreamManager from PR #3743

refactor: update clone preservation comment

32316d2

Remove specific mention of stream setting since the workaround for AsyncChatCompletionStreamManager is no longer needed.

a7m-1st mentioned this pull request Jan 27, 2026

feat: add RAG toolkit for knowledge base queries #1003

Open

4 tasks

Merge upstream/main - port streaming output feature to refactored age…

523ba97

…nt structure

MkDev11 force-pushed the feature/streaming-agent-output branch from 800cebd to 523ba97 Compare January 30, 2026 22:08

MkDev11 added 4 commits February 1, 2026 20:11

Merge upstream/main - resolve frontend conflicts and add streaming ag…

78d7962

…ent output

fix: PEP8 line too long in task.py

5c65669

style: yapf format task.py

927244f

fix: resolve conflict in node.tsx, preserve streaming agent output fe…

1087a17

…ature

feat: add streaming tool activity messages during task execution #999

Are you sure you want to change the base?

feat: add streaming tool activity messages during task execution #999

Conversation

MkDev11 commented Jan 21, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Streaming Tool Activity During Task Execution

What's the problem?

What this PR does

What you'll see

What did I change?

Commits

Files changed

Testing

Uh oh!

MkDev11 commented Jan 21, 2026

Uh oh!

a7m-1st commented Jan 21, 2026

Uh oh!

MkDev11 commented Jan 22, 2026

Uh oh!

MkDev11 commented Jan 22, 2026

Uh oh!

a7m-1st commented Jan 22, 2026

Uh oh!

MkDev11 commented Jan 22, 2026 via email

Uh oh!

a7m-1st commented Jan 22, 2026

Uh oh!

fengju0213 commented Jan 23, 2026

Uh oh!

MkDev11 commented Jan 23, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

MkDev11 commented Jan 23, 2026

Uh oh!

fengju0213 commented Jan 24, 2026

Uh oh!

Uh oh!

a7m-1st commented Jan 26, 2026

Uh oh!

MkDev11 commented Jan 26, 2026

Uh oh!

MkDev11 commented Jan 26, 2026

Uh oh!

a7m-1st commented Jan 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

MkDev11 commented Jan 30, 2026

Uh oh!

MkDev11 commented Feb 1, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

MkDev11 commented Jan 21, 2026 •

edited

Loading

MkDev11 commented Jan 23, 2026 •

edited

Loading

a7m-1st commented Jan 27, 2026 •

edited

Loading

MkDev11 commented Feb 1, 2026 •

edited

Loading