Class EvaluationMetric (1.36.4)

  EvaluationMetric 
 ( 
 bleu 
 : 
 typing 
 . 
 Optional 
 [ 
 float 
 ] 
 = 
 None 
 , 
 rougeLSum 
 : 
 typing 
 . 
 Optional 
 [ 
 float 
 ] 
 = 
 None 
 ) 
 

The evaluation metric response.

Parameters

Name
Description
bleu
float

Optional. BLEU (Bilingual evauation understudy). Scores based on sacrebleu implementation.

rougeLSum
float

Optional. ROUGE-L (Longest Common Subsequence) scoring at summary level.

Properties

input_dataset_paths

The Google Cloud Storage paths to the dataset used for this evaluation.

task_name

The type of evaluation task for the evaluation..