12: Validation

Objectives

Reading

• A debugging manifesto
  • She runs a great blog. See Making Hard Things Easy for another example.
• More interactive articles written by Amazon’s Machine Learning team:
  • Logistic Regression
  • Cross Validation
• Browse the sklearn documentation:
  • Cross Validation in the User Guide
  • sklearn.model_selection.train_test_split
  • sklearn.model_selection.cross_val_score

Additional perspectival readings are on the Perusall assignment. Don’t try to read all of them, just pick one or two.

In case Perusall isn’t working, here’s the direct links:

• Moneyball: the Oakland A’s and the transformation of baseball data - Marketplace
• The copyright fight over authors and OpenAI’s ChatGPT - Vox or Authors sue OpenAI for using copyrighted material

Optional Activities

• Equality of Odds
• a fun classifier example: Blabrecs