The evaluator of run_experiment can be a callable function. The function should have optional inputs of the following:
Parameter name
Description
Example
Define Function Evaluator and Run Experiment
Evaluator as a Class
Refer to the following example:
Users have the option to run an experiment by creating an evaluator that inherits from the base class in the Arize Python SDK. The evaluator takes in a single dataset row as input and returns an dataclass.