You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
BUG: MAJORITY scorer explanation describes a tie as a strict false majority #3900
The MAJORITY true/false aggregator correctly returns False for a tie, but describes the tied result as a strict majority of constituent scorers not returning True. The wording overstates the evidence. Keep the existing verdict and change only the explanation.
Source: pyrit/score/true_false/true_false_score_aggregator.py:198-207,233-238 at the tested revision.
Return False and explain that a strict majority returning True was not reached, or distinguish a tie explicitly. Add description assertions for tied votes and actual true/false majorities.
Actual Results
False
A strict majority of constituent scorers did not return True in a MAJORITY composite scorer.
The same false explanation is used for [False, False, True], where a strict false majority actually exists. This is a wording issue only, not an incorrect aggregate verdict.
Screenshots
N/A.
Versions
Linux; Python 3.12.3; PyRIT 1.2.0.dev0 at 01ce6ca66a315770b36c7dca1f320668c0d92d7c. Actual models/aggregator in a standalone probe; no inference or persistence. Full package-version output was not collected.
Activity
VISHNU0906 commentedon Nov 4, 2026
I would like to take this.