In past writings, I have used a baseball anecdote to help point out the drawbacks of traditional fire department performance measures, and I think that it bears repeating here.
The New York Yankees played the Pittsburgh Pirates in the 1960 World Series. The Series went to seven games, with the Yankees amassing 55 runs v. 27 for the Pirates. If we used aggregated data like total runs to determine the winner, it would be clear that the Yankees won the Series. They didn't.
The Pirates won the Series because they won more games (4-3). Here is the game-by-game breakdown:
Pittsburgh Yankees
Game One 6 4
Game Two 3 16
Game Three 0 10
Game Four 3 2
Game Five 5 2
Game Six 0 12
Game Seven 10 9
Total Runs 27 55
The records show that the Yankees earned most of their runs in three blowouts in games Two, Three and Six. However, the Pirates won four of the seven games and took the championship.
The statistic of Total Runs for the Series tells us nothing about why each game turned the way it did. For that, we have to look at the outcome of each game. We can also evaluate each game to determine why the score turned out the way it did. Taking Game Two as an example, what factors allowed the Yankees to score 16 runs and hold the Pirates to three? Was the Pirates loss a factor of poor pitching, fielding or a combination of both? What did the Pirates have to change in order to win against the Yankees?
Total runs in baseball are similar to statistics like annual fire loss. They give us general information but do not tell us how responders faired at each incident. Without knowing whether a fire incident ended up as a "Win" or "Loss," we cannot figure out the most effective way to improve our performance. The role of the pitcher in baseball is similar to the role of fire prevention in public fire protection. Just as strong pitching reduces the number of hits, strong fire prevention reduces the number of fires that kill, injure and damage property.
Carrying the metaphor a little farther, manual suppression is similar to fielding. It is reactive instead of proactive and has its limits. If a batter overcomes a pitch and hits one out of the park, the best fielders in the world are helpless. Just as it takes a team of skilled individuals to win more baseball games than their rivals, it takes a team of skilled individuals to improve a fire department's record of Wins v. Losses. Fire chiefs who continue to rely upon aggregated data and ignore the outcomes of individual fire incidents cannot find the most cost effective ways to improve their department's performance.