sisl / astra-rl / 19796596440

35%

Build Type

push

github

Committed by web-flow

Commit Message

Llamaguard 3 Granular Scorer and Wildguard Scorer (#31)

# Llamaguard 3 Harm Categories and Wildguard Scorer

## Description
New support for granular harm categories for Llamaguard 3 and added
support for Wildguard toxicity classifier.


### Added
- The LlamaguardScorer now takes at initialization the `harm_category`
parameter which lets the user set the harm category (S1-14) or "all"
- WildguardScorer is an implementation of Wildguard by AI2 which takes
the `scoring_target` parameter (`harmful_request`, `response_refusal`,
`harmful_response`) based on the scoring criteria of the Wildguard
toxicity classifier
- Documentation for both LlamaguardScorer and WildguardScorer has been
added

### Changed
- Both the Llamaguard and Wildguard scorers now take either a list of
strings as input `x` or a list of conversation histories. This is to
support future multi-turn red-teaming.
- Changes to `astra_rl.scorers` module init to import the Wildguard
Scorer
- Added/changed the files so the WildguardScorer shows up in the docs

### Fixed
None

### Removed
None

## Related Issue
None

## Note to Reviewers
Did testing by passing in lists of strings to see that output is
correct. Also passed incorrect input to see if safeguards trigger.

Run Details

17 of 80 new or added lines in 3 files covered. (21.25%)

2 existing lines in 1 file now uncovered.

323 of 866 relevant lines covered (37.3%)

0.75 hits per line