The Quarterback Prediction Problem: Forecasting the Performance of College Quarterbacks Selected in the NFL Draft

National Football League (NFL) teams spend substantial time and money trying to predict which college quarterbacks eligible to be drafted into the NFL will have successful professional careers. But despite this investment of resources, it is common for quarterbacks to perform much better or worse than anticipated. Prior work on this "quarterback prediction problem" has concluded that NFL teams are poor at determining which quarterbacks are likely to be successful based on information available prior to the draft. However, these analyses have generally focused only on quarterbacks who played in the NFL, ignoring those who were drafted but did not appear in a professional game. Using data on all quarterbacks drafted since 1997, we considered the problem of predicting NFL success as defined by two metrics (games played and Net Points), based on when a quarterback was drafted and his performances in college and at the NFL Combine. Our analyses suggest that college and combine statistics have little value for predicting whether a quarterback will be successful in the NFL. Contrary to previous work, we conclude that NFL teams aggregate pre-draft information-including qualitative observations-quite effectively, and their inability to consistently identify college quarterbacks who will excel in the professional ranks is a consequence of random variability in future performance due to factors which are unlikely to be observable.