pyrit.score.ScorerMetricsWithIdentity

pyrit.score.ScorerMetricsWithIdentity#

class ScorerMetricsWithIdentity(scorer_identifier: ScorerIdentifier, metrics: M)[source]#

Bases: Generic[M]

Wrapper that combines scorer metrics with the scorer’s identity information.

This class provides a clean interface for working with evaluation results, allowing access to both the scorer configuration and its performance metrics.

Generic over the metrics type M, so: - ScorerMetricsWithIdentity[ObjectiveScorerMetrics] has metrics: ObjectiveScorerMetrics - ScorerMetricsWithIdentity[HarmScorerMetrics] has metrics: HarmScorerMetrics

Parameters:

  • scorer_identifier (ScorerIdentifier) – The scorer’s configuration identifier.

  • metrics (M) – The evaluation metrics (ObjectiveScorerMetrics or HarmScorerMetrics).

__init__(scorer_identifier: ScorerIdentifier, metrics: M) → None#

Methods

__init__(scorer_identifier, metrics)

Attributes

scorer_identifier

metrics

metrics: M#
scorer_identifier: ScorerIdentifier#
Contents