pyrit.score.TrueFalseInverterScorer

pyrit.score.TrueFalseInverterScorer#

class TrueFalseInverterScorer(*, scorer: TrueFalseScorer, validator: ScorerPromptValidator | None = None)[source]#

A scorer that inverts a true false score.

Initialize the TrueFalseInverterScorer.

Parameters:

scorer (TrueFalseScorer) – The underlying true/false scorer whose results will be inverted.
validator (Optional[ScorerPromptValidator]) – Custom validator. Defaults to None. Note: This parameter is present for signature compatibility but is not used.

Methods

`__init__`(*, scorer[, validator])	Initialize the TrueFalseInverterScorer.
`get_identifier`()	Returns an identifier dictionary for the scorer.
`get_scorer_metrics`(dataset_name[, metrics_type])	Returns evaluation statistics for the scorer using the dataset_name of the human labeled dataset that this scorer was run against.
`scale_value_float`(value, min_value, max_value)	Scales a value from 0 to 1 based on the given min and max values.
`score_async`(request_response, *[, ...])	Score the request_response, add the results to the database and return a list of Score objects.
`score_image_async`(image_path, *[, objective])	Scores the given image using the chat target.
`score_image_batch_async`(*, image_paths[, ...])
`score_prompts_batch_async`(*, request_responses)	Score multiple prompts in batches using the provided objectives.
`score_response_async`(*, response[, ...])	Score a response using an objective scorer and optional auxiliary scorers.
`score_response_multiple_scorers_async`(*, ...)	Score a response using multiple scorers in parallel.
`score_text_async`(text, *[, objective])	Scores the given text based on the task using the chat target.
`validate_return_scores`(scores)	Validates the scores returned by the scorer.

Attributes