add bedrock prompt caching #6151

fbalicchia · 2025-12-17T11:34:18Z

Summary

Implemented prompt caching for Anthropic Claude models on AWS Bedrock to reduce costs
Introduced an intelligent cache point placement strategy that complies with AWS Bedrock’s four cache point limitation.
Added the BEDROCK_ENABLE_CACHING configuration parameter

Testing

Verify caching is enabled for Claude models by default
Test that cache points are correctly placed in system prompts
Test that cache points are correctly placed in user/assistant messages
Verify cache point limit (4 max) is respected

crates/goose/src/providers/bedrock.rs

crates/goose/src/providers/formats/bedrock.rs

Signed-off-by: fbalicchia <fbalicchia@cuebiq.com>

fbalicchia · 2026-01-08T12:05:22Z

Hi @DOsinga , I’ve pushed some updates to this PR. When you have a moment, could you please take another look? Thanks!

Signed-off-by: Abhijay007 <Abhijay007j@gmail.com>

…lock#6374)

…ock#6191) Signed-off-by: rabi <ramishra@redhat.com>

…865) (block#6372)

…p-apps resources (block#6378)

…ock#6369)

…n modal overlay (block#6386)

…ositive rates (block#6390) Signed-off-by: Dorien Koelemeijer <dkoelemeijer@squareup.com>

Co-authored-by: Douwe Osinga <douwe@squareup.com>

…ck#6404)

…ssion (block#6057)

thanks from shanto12 (PR#6349 which has original code)

…6367) Signed-off-by: Adrian Cole <adrian@tetrate.io>

Signed-off-by: Yelsin Sepulveda <yelsinsepulveda@gmail.com>

Co-authored-by: Douwe Osinga <douwe@squareup.com>

Signed-off-by: rabi <ramishra@redhat.com>

Signed-off-by: Rodolfo Olivieri <rodolfo.olivieri3@gmail.com>

Signed-off-by: Fatih Kadir Akın <fatihkadirakin@gmail.com>

Signed-off-by: Rodolfo Olivieri <rodolfo.olivieri3@gmail.com>

Signed-off-by: Sai Karthik <kskarthik@disroot.org>

Co-authored-by: Douwe Osinga <douwe@squareup.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

Co-authored-by: Douwe Osinga <douwe@squareup.com>

Signed-off-by: rabi <ramishra@redhat.com>

block#6419) Signed-off-by: Abhijay007 <Abhijay007j@gmail.com>

… in /ui/desktop (block#6375) Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

…lock#6408) Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

…k#6315) Signed-off-by: Abhijay007 <Abhijay007j@gmail.com>

Signed-off-by: The-Best-Codes <bestcodes.official@gmail.com>

Signed-off-by: Adrian Cole <adrian@tetrate.io>

…esult (block#6439)

fbalicchia · 2026-01-13T10:33:38Z

After making a bit of a mess with the branch I close this pr in favor of 6463

fbalicchia requested a review from a team as a code owner December 17, 2025 11:34

fbalicchia changed the title ~~add prompt caching~~ add bedrock prompt caching Dec 17, 2025

DOsinga approved these changes Dec 17, 2025

View reviewed changes

crates/goose/src/providers/bedrock.rs Outdated Show resolved Hide resolved

crates/goose/src/providers/formats/bedrock.rs Show resolved Hide resolved

fbalicchia requested a review from DOsinga December 18, 2025 15:31

fbalicchia added 4 commits January 7, 2026 09:57

add prompt caching

32c673d

Signed-off-by: fbalicchia <fbalicchia@cuebiq.com>

remove no necessary comment

1b03d74

Signed-off-by: fbalicchia <fbalicchia@cuebiq.com>

apply fmt

df07fc1

Signed-off-by: fbalicchia <fbalicchia@cuebiq.com>

applied change requested

fcac5be

Signed-off-by: fbalicchia <fbalicchia@cuebiq.com>

fbalicchia force-pushed the add-prompt-bedrock-cache branch from 381bf24 to fcac5be Compare January 7, 2026 08:57

Abhijay007 and others added 20 commits January 13, 2026 09:52

fix: Show platform-specific keyboard shortcuts in UI (block#6323)

547c056

Signed-off-by: Abhijay007 <Abhijay007j@gmail.com>

fix: prevent infinite loop of tool-input notifications in MCP Apps (b…

da62fb0

…lock#6374)

Blog: edit links in mcp apps post (block#6371)

49d982c

feat(providers): add streaming support for Google Gemini provider (bl…

ac04ec5

…ock#6191) Signed-off-by: rabi <ramishra@redhat.com>

fix: update MCP Apps _meta.ui.resourceUri to use nested format (SEP-1…

8573633

…865) (block#6372)

fix: prevent duplicate rendering when tool returns both mcp-ui and mc…

3c184de

…p-apps resources (block#6378)

Handling special claude model response in github copilot provider (bl…

08ab993

…ock#6369)

changed z-index to make sure the search highlighter does not appear o…

2526130

…n modal overlay (block#6386)

docs: add MCP Apps tutorial and documentation updates (block#6384)

06290ab

fix ResultsFormat error when loading old sessions (block#6385)

eee1f06

docs: update custom extensions tutorial (block#6388)

5034962

Add ML-based prompt injection detection (block#5623)

31dc8a0

Update confidence levels prompt injection detection to reduce false p…

211f622

…ositive rates (block#6390) Signed-off-by: Dorien Koelemeijer <dkoelemeijer@squareup.com>

Fixed fonts (block#6389)

977a1ab

Co-authored-by: Douwe Osinga <douwe@squareup.com>

Update MCP apps tutorial: fix _meta structure and version prereq (blo…

263334c

…ck#6404)

added validation and debug for invalid call tool result (block#6368)

cc00c92

Sort keys in canonical models (block#6403)

cdbf419

Add support for changing working dir and extensions in same window/se…

e7373a1

…ssion (block#6057)

feat: http proxy support

aa1fe79

thanks from shanto12 (PR#6349 which has original code)

fix(ci): add missing dependencies to openapi-schema-check job (block#…

ca19490

…6367) Signed-off-by: Adrian Cole <adrian@tetrate.io>

dianed-square and others added 26 commits January 13, 2026 09:52

docs: claude prompt caching note (block#6429)

4c39922

Avoid using cliclack.confirm in non-interactive session (block#6412)

37e1deb

update[doc]: Add tip for GitHub Copilot Provider (block#6441)

84687ac

Signed-off-by: Yelsin Sepulveda <yelsinsepulveda@gmail.com>

fix[desktop]: Improve UX for ExtensionItem component (block#6443)

5e4a1bb

Signed-off-by: Yelsin Sepulveda <yelsinsepulveda@gmail.com>

CLI show extension errors (block#6398)

b30a110

Co-authored-by: Douwe Osinga <douwe@squareup.com>

More 3.7 removal (block#6414)

1767c1e

Co-authored-by: Douwe Osinga <douwe@squareup.com>

chore: break up process agent response (block#6348)

9dd261d

perf(code_execution): cache tools in ExtensionManager (block#6433)

fb543c8

Signed-off-by: rabi <ramishra@redhat.com>

Remove unused dependencies across workspace (block#6380)

8796812

Signed-off-by: Rodolfo Olivieri <rodolfo.olivieri3@gmail.com>

docs: Add prompts.chat MCP configuration to servers.json (block#6342)

3e4aa42

Signed-off-by: Fatih Kadir Akın <fatihkadirakin@gmail.com>

Use crunchy from crates instead of git fork (block#6415)

5ed7baf

Signed-off-by: Rodolfo Olivieri <rodolfo.olivieri3@gmail.com>

fix(cli): incorrect bin name in shell completions (block#6444)

1c2d10e

Signed-off-by: Sai Karthik <kskarthik@disroot.org>

File bug directly (block#6413)

aca65ce

Co-authored-by: Douwe Osinga <douwe@squareup.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

Spell check setting (block#6446)

9eceb20

Co-authored-by: Douwe Osinga <douwe@squareup.com>

fix deeplink recipe launch cold start (block#6210)

71df31c

feat(vertexai): Add streaming support (block#6409)

bfa0135

Signed-off-by: rabi <ramishra@redhat.com>

fix: inconsistent API url requirement between desktop and CLI versions (

9c755c9

block#6419) Signed-off-by: Abhijay007 <Abhijay007j@gmail.com>

chore(deps-dev): bump @modelcontextprotocol/sdk from 1.24.0 to 1.25.2…

f37ee6b

… in /ui/desktop (block#6375) Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

chore(deps): bump lru from 0.12.5 to 0.16.3 (block#6379)

f43f58c

Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

chore(deps): bump react-router and react-router-dom in /ui/desktop (b…

ed5a99e

…lock#6408) Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

upgraded safe npm packages (block#6450)

2d40d40

refactor: include hidden dotfiles folders in file picker search (bloc…

42f7036

…k#6315) Signed-off-by: Abhijay007 <Abhijay007j@gmail.com>

fix: add gap between buttons in MacDesktopInstallButtons.js (block#6452)

9b1d73a

Signed-off-by: The-Best-Codes <bestcodes.official@gmail.com>

fix: correct Cloudinary extension command and env variable (block#6453)

d24d49d

docs: remove SSE transport and rename to Streamable HTTP (block#6319)

171ac7c

Signed-off-by: Adrian Cole <adrian@tetrate.io>

Fix: Small update in how ML-based prompt injection determines final r…

731b6f2

…esult (block#6439)

fbalicchia force-pushed the add-prompt-bedrock-cache branch from efd24a6 to 731b6f2 Compare January 13, 2026 08:54

fbalicchia mentioned this pull request Jan 13, 2026

Enable bedrock prompt cache #6463

Open

fbalicchia closed this Jan 13, 2026

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

add bedrock prompt caching #6151

add bedrock prompt caching #6151

Uh oh!

fbalicchia commented Dec 17, 2025

Uh oh!

Uh oh!

Uh oh!

fbalicchia commented Jan 8, 2026

Uh oh!

fbalicchia commented Jan 13, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

19 participants

add bedrock prompt caching #6151

add bedrock prompt caching #6151

Uh oh!

Conversation

fbalicchia commented Dec 17, 2025

Summary

Testing

Uh oh!

Uh oh!

Uh oh!

fbalicchia commented Jan 8, 2026

Uh oh!

fbalicchia commented Jan 13, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

19 participants