• Home
  • Features
  • Pricing
  • Docs
  • Announcements
  • Sign In

sisl / astra-rl / 19796596440
35%

Build:
DEFAULT BRANCH: main
Ran 30 Nov 2025 09:02AM UTC
Jobs 2
Files 31
Run time 1min
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst

25 Nov 2025 11:48PM UTC coverage: 37.298% (-1.5%) from 38.778%
19796596440

push

github

web-flow
Llamaguard 3 Granular Scorer and Wildguard Scorer (#31)

# Llamaguard 3 Harm Categories and Wildguard Scorer

## Description
New support for granular harm categories for Llamaguard 3 and added
support for Wildguard toxicity classifier.


### Added
- The LlamaguardScorer now takes at initialization the `harm_category`
parameter which lets the user set the harm category (S1-14) or "all"
- WildguardScorer is an implementation of Wildguard by AI2 which takes
the `scoring_target` parameter (`harmful_request`, `response_refusal`,
`harmful_response`) based on the scoring criteria of the Wildguard
toxicity classifier
- Documentation for both LlamaguardScorer and WildguardScorer has been
added

### Changed
- Both the Llamaguard and Wildguard scorers now take either a list of
strings as input `x` or a list of conversation histories. This is to
support future multi-turn red-teaming.
- Changes to `astra_rl.scorers` module init to import the Wildguard
Scorer
- Added/changed the files so the WildguardScorer shows up in the docs

### Fixed
None

### Removed
None

## Related Issue
None

## Note to Reviewers
Did testing by passing in lists of strings to see that output is
correct. Also passed incorrect input to see if safeguards trigger.

17 of 80 new or added lines in 3 files covered. (21.25%)

2 existing lines in 1 file now uncovered.

323 of 866 relevant lines covered (37.3%)

0.75 hits per line

New Missed Lines in Diff

Lines Coverage ∆ File
19
23.68
-1.32% src/astra_rl/scorers/llamaguard.py
44
16.98
src/astra_rl/scorers/wildguard.py

Uncovered Existing Lines

Lines Coverage ∆ File
2
23.68
-1.32% src/astra_rl/scorers/llamaguard.py
Jobs
ID Job ID Ran Files Coverage
1 19796596440.1 30 Nov 2025 09:02AM UTC 31
37.3
GitHub Action Run
2 19796596440.2 30 Nov 2025 09:02AM UTC 31
37.3
GitHub Action Run
Source Files on build 19796596440
  • Tree
  • List 31
  • Changed 2
  • Source Changed 0
  • Coverage Changed 2
Coverage ∆ File Lines Relevant Covered Missed Hits/Line
  • Back to Repo
  • 4873e87f on github
  • Prev Build on main (#19531303825)
  • Next Build on main (#19817058034)
STATUS · Troubleshooting · Open an Issue · Sales · Support · CAREERS · ENTERPRISE · START FREE · SCHEDULE DEMO
ANNOUNCEMENTS · TWITTER · TOS & SLA · Supported CI Services · What's a CI service? · Automated Testing

© 2025 Coveralls, Inc