pyrit.score.ObjectiveHumanLabeledEntry

class ObjectiveHumanLabeledEntry(conversation: List[PromptRequestResponse], human_scores: List[bool], objective: str)

Bases: HumanLabeledEntry

A class that represents a human-labeled dataset entry for a specific objective. This class includes the PromptRequestResponses and a list of human scores, which are booleans indicating whether the response/conversation meets the objective (e.g., 0 for not meeting the objective, 1 for meeting the objective). The objective is a string that represents the objective (e.g., “how to make a Molotov cocktail?).

__init__(conversation: List[PromptRequestResponse], human_scores: List[bool], objective: str) → None

Methods

__init__(conversation, human_scores, objective)

Attributes

human_scores
objective
conversation

human_scores: List[bool]

objective: str