The Eval function input values are supported below:
classExampleAll(Evaluator):defevaluate(self,input,output,dataset_row,metadata,**kwargs) -> EvaluationResult: print("Evaluator Using All Inputs")classExampleDatasetrow(Evaluator):defevaluate(self,dataset_row,**kwargs) -> EvaluationResult: print("Evaluator Using dataset_row ")classExampleInput(Evaluator):defevaluate(self,input,**kwargs) -> EvaluationResult: print("Evaluator Using Input")classExampleOutput(Evaluator):defevaluate(self,output,**kwargs) -> EvaluationResult: print("Evaluator Using Output")
Output: EvaluationResult
The EvaluationResult results can be a score, label, tuple (score, label, explanation) or a Class EvaluationResult
The Eval function input values are supported below:
classExampleResult(Evaluator):defevaluate(self,input,output,dataset_row,metadata,**kwargs) -> EvaluationResult: print("Evaluator Using All Inputs")return(EvaluationResult(score=score, label=label, explanation=explanation)classExampleScore(Evaluator):defevaluate(self, input, output, dataset_row, metadata, **kwargs) -> EvaluationResult:print("Evaluator Using A float")return1.0classExampleLabel(Evaluator):defevaluate(self, input, output, dataset_row, metadata, **kwargs) -> EvaluationResult:print("Evaluator label")return"good"