Exclusive Interview with Head Analyst of the NPLB
Well, the NPLB, or "No Points Left Behind" analysts are at it again.
This time around they have taken to looking at personnel early and often for the Broncos, hoping to avoid the end of season workload that they had to suffer through last year. Curious about their early start this year, I asked them about what went down last year in the situation room (the room where they do their super computer analysis of the Broncos), and what was to be expected this year. Head Analyst was kind enough to take some time and answer my questions.
styg50: You've said things need to change for the NPLB analysts this year. Could you explain that?
Head Analyst: (sighing heavily) You should have seen it in there last year Styg. It was a mess, with half cocked theories, endless calculations and feathers everywhere. We made the mistake of getting started on the analysis much too late... with only 3 or 4 weeks left in the season if I recall correctly. Our first report was after the Chicago game I think. Part of that was, of course, funding. It wasn't until you got that NPLB Bill passed in the MHR Congress that we were really able to sink our teeth into the numbers, but we should have been organized way before that. But I don't want to make excuses, I just want to get the analysis in. To that end, I'm getting the troops armed early this year.
styg50: I'll say. Don't you think pre-season is a little TOO early for this kind of thing? I mean, we don't even know who the team is going to consist of yet.
HA: Now is the perfect time. It is a chance to test the theory. If it meshes with the results, the players who make the roster, then we have got something we can work with. Better to know now than when the Broncs are on their way to New York to play the Bretts... Keep in mind this is going to be a much different analysis from last year. We are striving for a good comparative structure for the reports on the players. That means trial and error. Theory just won't cut it.
styg50: You mention comparative structure. Care to elaborate? I know last year the focus was on drive comparison, so what exactly is going to change?
HA: This is really the heart of the whole system. Last year we worked from the drive charts. We were trying to establish trends and find the signature inconsistencies that would help point us in the right direction for our analysis of the film. We got lucky early when the analysts, on a hunch, focused on Matt Lepsis. At the time no one was questioning the ProBowler, but I think a lot of the work the NPLB did was able to shed some light on that issue. That saved us a lot of work, which was essential to turning out reliable reports at the time, as late in the season as it was. Can you imagine if the hunch had been wrong? How much time we would have spent breaking down non-critical film? Total we broke down 10 games for 2007, 4 in situ, and 6 from earlier in the season, 3 of the worst and 3 of the best.
styg50: And this year?
HA: We want to remove the need for a lucky hunch from the equation. That means tracking EVERY player, every down, every minute of the every game. More work from week to week, but less risk of overworking at the end of the season when the answers are most needed. The early numbers say that this is a borderline playoff team. Our goal is to present a record of this team that is unassailable. Win-Loss records can be questioned. Stats can be questioned. We want a document in hand that serves as a definitive answer.
styg50: Lofty goal.
HA: Perhaps. All I know is we have about fifteen coffee and coke-zero loving analysts who think its possible.
styg50: So where does the comparative structure come into the picture?
HA: The work the analysts are doing right now consists of essentially scouting every play, and every player for the Broncos. DTs are scouted as DTS, QBs are scouted as QBs. They are graded individually for technique, and the game itself, the context if you will, is graded ond overlaid on their evaluations. The second part is a work in progress and will be ready for the home-opener in oakland, but the personnel evaluations are going in full force. After we have individual grades for each player we establish an average, or baseline, for that player, that we subsequently compare to their evaluation, which we score on a rising scale (i.e 1-10 or whatever, it is different for different positions). The result is a percentage, a number universally consistent from player to player.
styg50: I see. With numbers for different positions that mean the same thing, you are able to compare them. But why would you want that?
HA: That is the comparative structure. When a DT can be compared to a QB, or when a MLB can be compared to a tailback, you gain perspective on who is contibuting and who isn't. Instead of relying on a hunch you have objective data to direct your focus. The hope is that the comparisons will allow you to cut through the mess of the game logs we are recording, and find the exact moments and players that require deeper analysis. The logs are huge. Sifting through them at the end of the season is too late to be truly objective and useful, but with a tool like the comparative structure, finding what you are looking for will be fast and easy. And accurate. Above all, acurate.
styg50: Sounds like a real asset. Speaking of game logs, huge is a good word. The one you turned in for the Dallas game was 36 pages long! Impressive figuring that you don't have any thumbs... I'm looking forward to breaking it down using the NPLB Comparative Structure (CS). I figured I would start with OLine and QBs.
HA: Starting at the begining is always a good idea. Good luck and GO BRONCOS!!!
Coming Tomorrow: NPLB Offensive Personnel Report--OLine and QBs!
This is a Fan-Created Comment on MileHighReport.com. The opinion here is not necessarily shared by the editorial staff of MHR
3 recs |
8 comments
Comments
NPLB?
Is not something I’m familiar with. I’m interested to know what they’re looking at at Offensive line or Defensive line and how can that lead to a meaningfull comparison to a RB or QB in terms of overall contribution. Stats are definitely not me forte.
by UnarmingMermaid on
Aug 19, 2008 12:51 AM MDT
reply
actions
0 recs
My understanding
is that the players are scouted play by play, and their performance is compared to what SHOULD have been. Their “score” and the ideal score are compared, and a grade is generated. That grade is comparable to other players grades.
Note that stats have really nothing to do with it. I asked some other questions about how highly the analysts might rate a lot of receptions or yards, and they said they aren’t looking specifically at that. An example they gave was that a RB might not be penalized for being tackled in the backfield in this system, whereas if you are following stats, -2 yards rushing looks bad for that RB. Using the scouting system, EVERY player on the play is evaluated from a technique standpoint, and if the center didn’t get his hips low and ended up getting bowled over backwards, clogging the lane, and allowing a DT to penetrate and get a tackle than the Center will be penalized. If on the same play the guard releases to the second level without bumping the penetrating DT, and ends up way ahead of the play, 8 yards down the field instead of 5, he will be penalized as well.
On the other hand, a RB that fails to bounce a run outside when that happens on a the type of play that gives him enough room to change directions may be penalized even if he is recognized as not being too shifty or having good vision (note that a true FB may be exempt from this consideration, since they train to play the game differently from a RB).
As you can see, rarely do the stats come into the evaluation. Head Analyst did say that higher scores are associated with TD plays, either by virtue of work done after the catch or when the back reaches the 2nd level, or because in the redzone offensive plays become more difficult to execute. Critical downs with limited options, like fourth and one are also scored higher.
From what I have seen of the oline and QB scores, positive numbers are good, negative numbers are bad, and 0 is a completely average baseline player who is effective on a regular basis, but isn’t the kind of guy that can beat double coverage or make a diving catch out of bounds.
Obviously the larger the sample size the more accurate the grades will be, and the goal wasn’t to have a week by week predictive tool, though an insightful user could certainly use it like that. For example I can predict that Gandy will not make the team based on his scores. The real value of the CS is that it can give an objective framework for precise analysis. For example, I look at Ramsey’s score and note that while it isn’t good, it isn’t nearly as bad as I thought it was going to be. At looking at his score per play I can see that he started very rough, evened out, then struggled slightly late.
One element that is being left out of the preseason evaluations is the nature of the playcalling. The plays don’t happen in a vacuum so it is important to not penalize or reward players for things that are out of their control. That will be in effect during the regular season but not now. For now, the reports are only meant to grade the players from a technique, execution and production standpoint. In the final analysis, that is 90% of what matters.
Mountains, forest, sea: these render man fierce, but yet do not destroy the man.
by styg50 on
Aug 19, 2008 8:48 AM MDT
up
reply
actions
0 recs
NLPB or "No Points Left Behind" was a great series of articles written last year
to examine why “WE SUCKED AT SCORING IN THE RED ZONE” and other things. lol Most of us Bronco fans were getting fed up with the field goals, hence the birth of this group of posts. ;)
If God is not a Bronco fan, then WHY are sunsets Blue and Orange? - Jon Tollerud 5/22/08
I got a high ankle sprain in college and it still hurts! ~ TSG 8/13/08
by Zappa on
Aug 19, 2008 11:14 AM MDT
up
reply
actions
0 recs
Im still fuzy
So does is this grade an after game evaulation? So with them anaylizing the preseason does it give some idea how the team could fare in the regular season? I dont remember this from last year.
by broncfanstuckinsd on
Aug 19, 2008 11:46 AM MDT
reply
actions
0 recs
Yes.
it will serve primarily as an evaluation, but it can be added up, so that you get an evaluation for any period of time that you have the numbers for: the whole season, the first quarter of a game, the last quarter of a season, whatever.
And it is a lot different from last year. One thing about the NPLB guys, they don’t rest on their laurels…
Mountains, forest, sea: these render man fierce, but yet do not destroy the man.
by styg50 on
Aug 19, 2008 1:28 PM MDT
up
reply
actions
0 recs
Dang! This is great
Many thanks to Styg and ihs cardre of crazed stat-geeks. There is no higher honor…
Atwater for the Hall!
by broncobear on
Aug 19, 2008 10:20 PM MDT
reply
actions
0 recs



























