agentjido / req_llm / 384594a252082a2e360a1388eb999e7b808c8b22

49%

Build Type

push

github

Committed by web-flow

Commit Message

Add AWS Bedrock provider with streaming support (#66)

* Add example scripts for context reuse, cross-model context, and reasoning tokens

- Introduced new example scripts demonstrating various functionalities of the ReqLLM library, including:
  - `context_reuse.exs`: Shows how the same context can be passed between different API functions without modifications.
  - `context_cross_model.exs`: Demonstrates context reuse across different models and providers.
  - `reasoning_tokens.exs`: Illustrates reasoning token usage with models that support extended thinking.
  - `run_all.sh`: A script to run all example scripts sequentially for demonstration purposes.

- Updated README.md to include usage instructions and examples for the new scripts, enhancing documentation and usability for users.

This commit aims to enrich the library's examples and improve user experience by providing runnable scripts for various functionalities.

* Add AWS Bedrock provider with streaming support

Implements AWS Bedrock provider with pluggable streaming protocol architecture.

Features:
- Support for Anthropic Claude models on AWS Bedrock
- Streaming and non-streaming request support
- AWS Event Stream binary protocol parser (not SSE)
- AWS Signature V4 authentication using aws_auth fork (OTP 27 compatible)
- Pluggable streaming via parse_stream_protocol/2 callback
- Dependency injection in StreamServer for protocol parsers
- Comprehensive test suite with fixtures

The streaming implementation allows providers to use custom protocols while maintaining a consistent interface. Bedrock uses AWS Event Stream format while other providers default to SSE.

* Rename Bedrock to AmazonBedrock and address all review feedback

- Rename all modules from Bedrock to AmazonBedrock per review request
- Use :amazon_bedrock provider ID to match upstream models.dev
- Move AWS Event Stream parser under AmazonBedrock namespace
- Remove debug.log file
- Revert changes to priv/models_dev/amazon-bedro... (continued)

Run Details

346 of 518 new or added lines in 12 files covered. (66.8%)

5 existing lines in 3 files now uncovered.

3255 of 6526 relevant lines covered (49.88%)

180.98 hits per line