# How is the model trained and tested? Why doesn’t my model completely match the historical data?

Tell me a little more about how models are trained and tested.

##### Post Metadata
- Posted at: about 7 years ago
- Net upvotes: 1


## Comments
### Comment 1

The model is built, or “trained”, on a training dataset that is a subset of the original dataset you select. Kraken automatically splits your dataset randomly and performs five-fold cross-validation. 

Predictions are made with each row of data in the test dataset and compared to the actual result, producing the accuracy measures with which the models are scored.

It may seem slightly counterintuitive that the model can’t get it completely right against the historical data – after all, those events already happened. All that really means is that the model is not predicting with 100% accuracy, so some of the “predictions” (on a historical data point) don’t match what actually happened. This is not necessarily a bad thing; in fact, any model that predicts with 100% accuracy against the test dataset should at least be scrutinized further to see if overfitting or other errors may be occurring.

##### Comment Metadata
- Posted at: about 7 years ago
- Author title: Director of Product Marketing




## Related Product
[Qlik Predict](https://www.g2.com/products/qlik-predict/reviews)

## Related Category
[Data Science and Machine Learning Platforms](https://www.g2.com/categories/data-science-and-machine-learning-platforms)

## Related discussions
- [How well does Trello scale into a larger team?](https://www.g2.com/discussions/1-how-well-does-trello-scale-into-a-larger-team)
  - Posted at: about 13 years ago
  - Comments: 6
- [Can we please add a new section](https://www.g2.com/discussions/2-can-we-please-add-a-new-section)
  - Posted at: about 13 years ago
  - Comments: 0
- [Quantifiable benefits from implementing your CRM](https://www.g2.com/discussions/quantifiable-benefits-from-implementing-your-crm)
  - Posted at: about 13 years ago
  - Comments: 4