RubricGenerationSpec

Specification for how rubrics should be generated.

Fields
promptTemplate string

Template for the prompt used to generate rubrics. The details should be updated based on the most-recent recipe requirements.

rubricContentType enum ( RubricContentType )

The type of rubric content to be generated.

rubricTypeOntology[] string

Optional. An optional, pre-defined list of allowed types for generated rubrics. If this field is provided, it implies include_rubric_type should be true, and the generated rubric types should be chosen from this ontology.

modelConfig object ( AutoraterConfig )

Configuration for the model used in rubric generation. Configs including sampling count and base model can be specified here. Flipping is not supported for rubric generation.

JSON representation
 { 
 "promptTemplate" 
 : 
 string 
 , 
 "rubricContentType" 
 : 
 enum (  RubricContentType 
 
) 
 , 
 "rubricTypeOntology" 
 : 
 [ 
 string 
 ] 
 , 
 "modelConfig" 
 : 
 { 
 object (  AutoraterConfig 
 
) 
 } 
 } 

RubricContentType

Specifies the type of rubric content to generate.

Enums
RUBRIC_CONTENT_TYPE_UNSPECIFIED The content type to generate is not specified.
PROPERTY Generate rubrics based on properties.
NL_QUESTION_ANSWER Generate rubrics in an NL question answer format.
PYTHON_CODE_ASSERTION Generate rubrics in a unit test format.
Design a Mobile Site
View Site in Mobile | Classic
Share by: