Friday, July 19, 2024

Sample Size

Make sure we've seen enough to make a rational judgment. Win over critics with competence and competitiveness. 

"Show out." Decision-making involves mental models (how we think) and cognitive biases (conscious and unconscious influences upon us). Sample size is a mental model that takes the volume of observations into account. If we flip a coin five times and get consecutive heads, the likelihood of heads on the next flip is still 50 percent. With 50% to the fifth power, we have a 1/32 chance of getting five consecutive heads. With more observations, we know the answers will converge on 50 percent. 

In coaching and other evaluation, we have 'analytics' and the 'eyeball test'. For example, in the NBA draft, the best predictors of NBA success are age at drafting, college attended, and basketball performance. Young players a the "blue chip" programs who perform well (e.g. Jayson Tatum) are more likely to succeed. 

Coaches have biases in projection, too. That could include size, athleticism measures (e.g. vertical jump or 20-yard shuttle), or knowing the player's previous coach. 

Coaches also have 'idiosyncratic' (personal) bias. UCONN women's basketball coach Geno Auriemma tells assistants that they should be able to identify the prospect being scouted within a few minutes. 

Also, "coaches eyes" are not the same as "friends and family." Coaches assess "athletic explosiveness," "sport-specific IQ," and "compete level" more objectively. 

Evaluators make projections and can be deceptive. Red Auerbach went to scout Dave Cowens and walked out "disgusted" before halftime. Auerbach wanted to throw the competition off the scent. Cowens was his top draft choice. 

Successful programs want sustainable competitive advantage and that usually means detailed and multiple evaluations. For example, coaches aren't going to judge players off "highlight reels" because performance is "cherry-picked." Watching game tape and seeing the player in person allows for more thorough evaluation.

Lagniappe. Serve receive drills with high goals. 

No comments: