agentjido / req_llm / 1ec7c9f2d937b8497dc0de132c80db6649a90a57

49%

Build Type

push

github

Committed by web-flow

Commit Message

Add Bedrock prompt caching support (#138)

Extends Anthropic prompt caching to AWS Bedrock provider by reusing
native Anthropic caching functions and adding smart API selection.

Changes:
- Made Anthropic caching functions public for reuse
- Added tools support to Bedrock Anthropic formatter
- Auto-switch to native API when caching enabled with tools
- Added comprehensive tests for auto-switching behavior

Bedrock Converse API only caches entire system prompts, while native
API supports granular cache control on system, tools, and messages.
When both caching and tools are present, automatically use native API
with a warning that can be silenced via explicit use_converse setting.

Tested live with AWS credentials showing 90% cost savings and cache
hit behavior working correctly with tools.

Run Details

22 of 22 new or added lines in 2 files covered. (100.0%)

3 existing lines in 2 files now uncovered.

3635 of 6924 relevant lines covered (52.5%)

434.44 hits per line