fogfish / iq / 20696539747

39%

main: 31%

Pull #87

github

Implement #81: Pipeline integration with storage sink and emit execution

Added storage-based sink with emit context support for pipeline integration:

- Created StorageSink that wraps Storage interface with emit support
- Updated all step types (Agent, Router, Foreach, Run) to set emit context
- ForeachStep now manages iteration counters for nested loops
- Each step propagates emit prefix through execution context
- Storage sink applies emit prefix and counters to output keys
- Added Storage() method to sink builder for emit-aware output
- Added comprehensive tests for StorageSink with emit and counters

This enables emit-based output control where workflow steps can specify
output key prefixes via 'emit' attribute. Foreach loops add iteration
counters (e.g., file.000001.txt, file.000002.txt) for multi-item processing.

The implementation:
- Preserves emit context across step execution using context.Context
- Supports nested foreach with stacked counters
- Maintains backward compatibility (emit is optional)
- Uses existing Storage interface for filesystem operations

Example usage:
  steps:
    - uses: prompts/summarize.md
      emit: summaries  # Output to summaries/doc.txt

    - foreach:
        selector: document
        emit: processed  # Output to processed/doc.000001.txt, etc.

42 of 87 new or added lines in 3 files covered. (48.28%)

1628 of 4106 relevant lines covered (39.65%)

0.43 hits per line