Recording Outcomes

A prediction's details (Details and feedback on the Predictions tab) show its input and output (when the model records them), its actual and its reward, and let you record:

• The actual: the true label for a classifier, the true number for a regression model, or for a model whose predictions are reviewed, a Verdict (is this prediction correct?): Correct or Incorrect. It is recorded with the model's actuals, so drift and performance count it too.
• Reward (0 to 1): how good the outcome was. A multi-armed bandit learns from rewards (LinUCB together with the prediction's recorded inputs), and an experiment on Feedback reward measures them. Recording a reward again replaces it; a bandit counts only the difference.

Applications can record rewards and actuals through the REST API or the Python SDK, keyed by the prediction id the test returned. To record actuals in bulk, import them on the model's Monitoring tab (see Actuals).