Friday, January 11, 2019

NFL Punt Safety: The Return Safe Zone


Kaggle recently ran a data analytics competition tasking users with investigating punt data provided by the NFL with the goal of making rule suggestions to reduce concussions on punt plays. The following post is a port of my submission notebook for the competition. The plots will not have their interactive functionality in this blog post. In addition, the code and code output buttons will only work on the original notebook. I also removed embedded videos of concussion-causing plays as they do not seem to work on Blogger. Link to the project page on Kaggle to view the interactive plots, videos, code and code output.



Introduction

The National Football League is America's most popular sports league, comprised of 32 teams that play 16 games apiece over the course of a season for a chance to compete in the NFL Playoffs. The NFL Playoffs are a single-elimination tournament of the league's top 12 teams from the regular season, culminating in the Super Bowl, the final championship game. According to Nielsen Media Research, the 2017 Super Bowl drew over 110 million TV viewers and generated over 190 million social media interactions,1making it the world's largest annual sporting event.
The NFL is known for its athletic, physical play style, where heavily padded players clash with the offense attempting to advance the football toward an end zone and the defense attempting to tackle a ball-carrier to prevent his advance. Gritty physical play is a hallmark of the NFL and one of the reasons for its popularity, but it can also lead to injuries. According to ESPN, there were 281 reported concussions during the NFL preseason and regular season (including practices) in 2017, which was the highest recorded number of concussions since the NFL began sharing concussion data in 2012.2
The NFL is committed to promoting player safety. Over the past several seasons, the NFL has made several changes to kickoff rules to address the disproportionately high incidence of concussions on kickoff plays. As a part of its ongoing health and safety efforts, the NFL has tasked the Kaggle community to perform data analysis with the end goal of making rule recommendations to reduce concussions on punt plays.
In this notebook, I will present my analysis of the data provided by the NFL to reveal which play features are strongly associated with concussions, as well as proposals for specific rule modifications informed by the analysis and my knowledge of football as a long-time fan and former player. The goal of this project is to propose rule changes that will increase punt play safety, while working within the confines of the existing rules so that changes are minimally invasive and maintain the excitement and integrity of the game.
Output
Code
Output
Code

How Punts Work and Current Punt Rules

To analyze punt data and make rule recommendations, it is vital to understand the subject of the analysis: punt plays and the rules that govern them. In a punt play, a kicking team transfers possession of the football to the receiving team, with the goal of setting back the receiving team as far away as possible from the end zone they need to reach to score. After the ball is kicked, a player on the receiving team may catch the ball and then advance it until he is tackled. If the receiving team does not wish to return the ball, the receiver may indicate a “fair catch” by waving his hand and then the ball is downed after the catch at the spot of the catch. Alternatively, if the ball is not caught or picked up by a receiver, it is downed wherever it comes to rest.
The rules that govern punts are covered in the official NFL rule book in Rule 9 entitled “SCRIMMAGE KICK” and Rule 10 entitled “OPPORTUNITY TO CATCH A KICK, FAIR CATCH.” The sections start on pages 36 and 40 respectively.

In brief, Rule 9 lays out the core rules that govern punt plays, including how the ball can be kicked, touched and returned. Rule 9, Section 1, Articles 2 and 3 are of particular interest as they govern “KICKING TEAM PLAYERS ON LINE DURING KICK” and “DEFENSIVE TEAM FORMATION” respectively. The changes the NFL made to kickoff rules in 2018 largely dealt with player formations, so these are potential areas for rule modifications.

Rule 10 lays out core rules that govern fair catches. Rule 10, Section 1, Article 1 entitled “INTERFERENCE” is of particular interest as it lays out rules aimed at giving the receiver adequate time to catch a kick without being touched or impeded by the kicking team, regardless of whether he signals for a fair catch. These three Articles seem most promising as potential areas for rule improvement to increase safety.

Punt Video Review

Before digging into the data, I will take a moment to review the video footage of concussion-causing punt plays and note key observations. I've embedded all 37 videos below. Click "output" if you would like the view the videos.
Output
Code
The video footage contains a variety of punt plays including a fake punt (video 17) a punt return for a touchdown (video 24) and a muffed reception (video 12). The videos contain only one successful fair catch (video 14) and one other attempted fair catch (video 30). By contrast, the 37 control videos without injuries contain 11 fair catches, suggesting injuries are unlikely to occur on punts that result in a fair catch.
Output
Code
To get a better sense of the overall fair catch rate in football, I've uploaded aggregate punt records available on ESPN for the 20163and 20174 regular seasons. The aggregate punt data shows that the fair catch rate was 27% across both seasons. If we assume a 27% fair catch rate, the chances of seeing one fair catch or less out of 37 punt plays due to chance is 0.01%. (See code and output above.). This is strong evidence in support of what may seem intuitively obvious: that punt plays that result in fair catches tend to be relatively safe.

Punt Meta Data Exploration and Analysis

I will begin my data analysis by investigating the punt data other than the "Next Gen Stats" data. Click "Output" below if you'd like to see the structure of the data.
Output
Code
The injury data includes 37 observations with 41 variables. Although 37 is large number of concussions in terms of player safety in the real world--ideally that number would be zero--it is a small number in terms of data analysis. With "only" 37 observations to work with, only large differences in concussion rates across features may prove significant. Although there are 41 features, I will focus on those that are most relevant to the issue of safety.
First, I will create a plot investigating concussions by player activity and team.
Code

Players involved in activities associated with the kicking team--tackling and being blocked--were more likely to experience concussions. Overall, the kicking team suffered 27 concussions while the receiving team suffered 10. If the chances of a concussion occurring is assumed to be equally likely for both teams, a result this extreme would be expected to occur about 0.38% of the time (see hidden code and output above.). This suggests that there is a real difference in concussion rates for players on the kicking team versus the receiving team and perhaps counter-intuitively, it is more dangerous to be on the kicking team.
To investigate further, I will make a plot of concussions that occur due to friendly fire (players on the same team hurting one another.). This could provide insight into the higher incidence of injuries on the kicking team.
Code
Most concussions occur due to contact between players of opposing teams, but of the 6 friendly fire injuries, all 6 occurred on the kicking team. This makes intuitive sense, because on the kicking team, tacklers could hurt one another if they attempt to tackle the receiver at the same time.
Next, I will create a plot investigating concussions by impact type, to see if the way players collide has a strong association with concussions.
Code

There is no discernible connection between impact type and concussions with an equal number coming from both helmet-to-helmet and helmet-to-body collisions and similar numbers occurring on both teams.
I will proceed by checking whether concussions rates vary depending on whether the game was played in the preseason, regular season or postseason.
Code
Season TypeConcussionsProportionGamesPuntsConcussion_RatePunts_Per_GameCRate_Per_Game
Pre1232.4%13014620.82%11.259.23%
Reg2567.6%51250230.5%9.814.88%
Post00%241960%8.170%
Output
Code
Although more total concussions occur in the regular season, the preseason has fewer total games played, giving it a higher concussion rate on both a per play and per game basis. Overall, the preseason had a concussion rate on punts of roughly 9% per game and 0.8% per play, while the regular season had a concussion rate of 5% per game and 0.5% per play. If we assume there is no difference between concussion rates and the number of punts per game in the preseason, regular season and postseason, we'd expect to see a difference this extreme about 4.4% of the time (see hidden code and output above.). This is not overwhelming evidence, but it does suggest that punt plays tend to be more dangerous in the preseason. It is not particularly surprising that no concussions were recorded in the postseason, since the data only includes 24 postseason games.
As a precursor to looking at player positions in the "Next Gen Stats" data, I will check whether the distance of a kick influences concussions. Punt distance can be extracted from the play description variable.
Code

Concussions are relatively evenly distributed across punts of varying distances.
To conclude the initial data exploration, I will investigate player role data to explore whether certain punt roles are more prone to injury than others. It should be noted that there are more possible roles on both the coverage and return sides than players on the field, so certain roles may be less common than others.
Code

On the kicking team, every player on or near the line of scrimmage had some risk of concussion. On the return side, the linemen and blockers were relatively safe, while the kick returner suffered 50% of return team concussions.
I will repeat the same process for the player referred to in the data set as the "primary partner"--the other player involved in the collision. I will also refer to the primary partner as the injury partner and the player that caused the injury.
Code

Output
Code
On the kicking team, the front line is responsible for the majority of concussions, but the gunners on the far edges of the field--roles GL and GR--were collectively involved in 9 concussion-related events either as the injured player or injury partner. This suggests the gunners are disproportionately likely to reach the receiver and make injury-causing tackles.
The punt receiver was the injury partner in 8 concussions, so incoming tacklers often hurt themselves as they hit the receiver. In total, punt receivers were involved in 13 of 37 or roughly 35% of punt play concussions. As only one of 22 players on the field, this high chance of concussion involvement of receivers is almost certainly not due to chance (See hidden code and output above.). This means the data strongly support the intuition that as the focal point of the return and a ball-carrier eligible to be tackled, the punt receiver is at the highest risk of being involved in concussion-causing events of any player on the field.

Initial Data Analysis: Key Takeaways

  1. The kicking team is more likely to suffer concussions than the receiving team.
  2. Concussions are more likely to occur in the preseason than the regular season or postseason.
  3. The punt receiver is the most likely player to be involved in concussion-causing impacts.

NGS Data Exploration and Analysis

The Next Gen Stats punt data provides player positions and direction readings during all punt plays for 2016 and 2017 as well as the distance traveled since the previous time step. Readings were recorded once every tenth of a second.
Output
Code
First and foremost, it should be noted that the NGS data likely have significant measurement error for player position and distance traveled. After calculating player speed from distance traveled per 0.1 seconds, the data show that during concussion-causing plays, players traveled at roughly 3.77 miles per hour, on average, but the maximum speed recorded was 60.14 miles per hour.
Since the fastest players in the NFL clock in at around 22 miles per hour,5 this is clearly not an accurate measurement. Further exploration shows that most injury-causing plays contain maximum speeds beyond what is reasonably possible for an NFL player. Roughly 1 in 2000 records list speeds faster than 22 miles per hour; to correct this problem I will round all speed readings above 22.5 miles per hour down to 22.5 mph.
With that in mind, I will begin by plotting the maximum speeds achieved by injured players and injury partners during concussion-causing plays.
Code

The plot shows that injured players tend to reach maximum speeds in the 16 to 22 mile per hour range, while injury partners tended to reach speeds bewteen 12 and 22 miles per hour. This shows that both parties involved in concussions often travel at speeds near the limit of what NFL players can achieve at some point during plays where concussions occur.
The bimodal density curve of players uninvolved in the injury divides players on punt plays into two general categories: those who tend to travel at slow speeds of 10 mile per hour or less and those who tend to travel at fast speeds of 13 miles per hour or more. Injured players were overwhelmingly likely travel at speeds that would put them in fast group, so high speeds are associated with an elevated the risk of concussion.
To get a better sense of how player speed and direction relate to injuries and when speeds are at their highest, I will generate an animated plot showing player position, speed and direction for the first play in the data set. In the interest of time and performance, I will limit the animation to one frame per second. Use the slider to adjust the time scale manually for quicker viewing. I will also embed the associated video below the animated plot. Click "Output" below to view the video.
Note: animations and video playback are not precisely synced. Animations only work in the original notebook. For the blog post, I am posting static images of the moment before impact.
Code

Output
Code
The animation shows that players involved in the concussion were traveling at approximately 15 miles per hour just prior to impact at a playtime of 22 seconds. The injured player experienced a deceleration from 15 miles per hour to 4.5 miles per hour in less than a second.
Here is one more example:
Code

Output
Code
In the play above, the receiver is injured by the right gunner during the catch. The incoming tackler is traveling at 19 miles per hour just prior to contact at a play time of 9 seconds. It should be noted that while no fair catch was signaled, the tackler was called for an interference penalty since the receiver was not allowed to catch the ball before contact was made.
Note: I have provided code below to recreate the play animation for all other plays where an injury partner could be determined. This code is not run by default in the interest of brevity and performance.
Output
Code
Recreating the animation for other injury-causing plays reveals a consistent pattern: in most plays, just prior to impact, at least one of the two players involved in the concussion is traveling at a speed of 15 miles per hour or faster.
To investigate further, I will generate a plot of the maximum speeds achieved by injured players and injury partners when they are in close proximity to one another to get a sense of speeds surrounding injury-causing events. I will define close proximity as a distance of two yards or less.
Code
The plot above shows that over half (18 of 33) of concussion-causing plays where an injury partner could be determined involved at least one player traveling at a speed of 15 miles per hour or faster when players were within two yards of one another. Ten injuries involved moderate speeds with at least one player traveling between 10 and 15 per hour and only 5 injuries occurred at low speed with neither player traveling faster than 10 miles per hour.
As seen in the second injury play animation shown earlier, fast-moving tacklers can potentially reach the receiver before he catches the ball. This can result in situations where the receiver has little or no time to react to an incoming tackle. To illustrate this point, I will create a plot of punt hang time and punt distance on injury-causing plays, as well as a line that highlights how far a fast tackler traveling at 10 yards per second would be able to travel while the ball is in the air. This will provide a sense of how close tacklers could potentially get to receivers before the catch.
Code

The plot shows that in 8 of the 28 concussion-causing plays where the ball was tracked as being punted and received, a fast gunner could have reached the receiver while the ball was in the air. In an additional 16 plays, a fast tackler could have come within 10 yards of the receiver.
I will investigate this point further by creating a histogram of the actual distances of the closest coverage player to the punt receiver at the time of the catch.
Code
The plot above shows that in 16 of 30 injury-causing plays with a recorded punt reception, the closest defender was within 10 yards of the receiver at the time of the catch. This means that in about half of concussion-causing plays, the receiver would have a second or less to respond to an incoming tackler running at 10 yards per second.
The previous plot shows the actual distance of closest defenders to receivers at the time of the catch in terms of straight line, Euclidean distance, but in football, rules are often framed in terms of yard lines: distances along the x-axis of the field. As such, I will create a second plot showing the yard line distance (x-axis distance) of the closest defender at the time of the catch. I will plot the yard line distance by the speed of the punt, to get a sense of how punt speed (punt distance divided by hang time) is related to the proximity of the closest defender.
Code
The plot shows that in 8 of 30 plays with a reception, a tackler was within 5 yard lines of the receiver and in 18 of 30 plays, a tackler was within 10 yard lines. The moderate positive correlation seen in the graph shows that tacklers tend to get closer to receivers during slow punts. Every punt with a speed of 10 yards per second or less allowed a defender to get within 10 yard lines of the receiver by the time the ball was caught.
The preceding plots show that punts create the conditions for high speed collisions between receivers, tacklers and blockers, where the receiver tends to have little time to react to fast-moving tacklers. To get a sense of the effect these high speed collisions have on players, I will conclude my analysis by plotting the maximum magnitude of acceleration (greatest change in speed) experienced by concussed players and their injury partners when they are in close proximity to one another.
Code
The plot shows that most injured players experienced changes in speed of 20 miles per hour per second or more, while within two yards of their injury partners. Fourteen injured players experienced acceleration with a magnitude of 35 miles per hour per second or more. For context, imagine cruising down the road at 35 miles per hour and coming to a complete stop in the span of a second. This would constitute an violent, abrupt stop that would engage a seat-belt and likely hurt the occupants. In a car, however, the seat-belt distributes the force across the body. In concussion-causing plays, the brunt of the force is often concentrated in the upper torso and helmet.
Injury partners also tended to experience rapid speed changes while close to the players they hurt, although fewer experienced speed changes of 35 miles per hour per second or more. Cases where speed changes of 60 miles per hour per second or more were recorded could be a result of measurement error in the next gen stats data. Still, this paints a clear picture: collisions are happening at high speeds causing both players involved to experience forces that could lead to concussions.
Based on the preceding analysis, I believe the most promising way to reduce concussions on punts, without reducing the number of punt plays or punt returns, is to introduce rules that give the receiver adequate time to catch the ball safely without facing an immediate tackle attempt and to generally reduce the speed at which tacklers contact blockers and the receiver.

NGS Analysis Key Takeaways

  1. Injured players and their partners often reach speeds near the limits of what NFL players are capable of prior to injury.
  2. Coverage players often get within 10 yards of the receiver by the time he catches the football.
  3. Injured players tend to experience violent changes in speed when they are in close proximity to injury partners.

Rule Change Philosophy

Based on the preceding video review, data analysis and my knowledge of football, as I see it, there are three ways to potentially reduce punt play concussions:
  1. Reduce the number of punt plays.
  2. Reduce the likelihood of punt returns and/or increase the likelihood of fair catches.
  3. Improve player safety during the catch and return, such as by reducing player speed.
I will take a moment to assess the merits and drawbacks of each of these three general strategies before making my rule change prescriptions.
Reducing the number of punt plays is perhaps the most sure-fire way to reduce punt play injuries. If you don't have as many punts, you will tend to have fewer total injuries on punt plays.
On the down side, reducing the number of punt plays does nothing to address the likelihood of a concussion occurring during any particular punt play. In addition, extreme solutions like getting rid of punting entirely would greatly disrupt the flow and balance of play, harming the integrity of the game. Therefore, reducing the number of punt plays should not be the focus of the rule changes.
Reducing the likelihood that a player attempts a return on a punt play or conversely increasing the likelihood of a fair catch is a way to reduce the expected number of injuries on punts without changing the total number of punts that occur. This is a more promising route for addressing the problem than reducing the absolute number of punt plays, since it would actually reduce the chances of an injury occurring on any given punt play.
The main downside of disincentivizing punt returns is that fewer returns means there would be fewer exciting run backs for the fans to enjoy. Avoiding returns also doesn't do anything to address the safety of players in plays where returns actually occur. There would be fewer returns, but the returns that do happen would be just as dangerous.
The final strategy--improving player safety during the return--is the ideal goal for reducing injuries. If players could be made safer during punt plays, reducing the number of punts or punt returns would not be necessary. Unfortunately, rules aimed at improving player safety are not likely to be as effective as avoiding problem plays entirely. Even if you could introduce a "speed limit" forcing all players to run 15 miles per hour or less, injuries would still occur on occasion.
Nonetheless, I believe enhancing player safety should be the main focus of rule changes aimed at reducing punt play concussions. Just because an ideal is difficult to achieve, it does not mean it is not worth striving toward. Therefore, my primary goal is to propose rule changes that will promote player safety without significantly reducing the number punt plays or punt returns.
If reducing the number of punt returns is ultimately deemed necessary, the league could use the preseason as a test bed for more extreme rule changes. The league could even maintain a different rule set for the preseason and regular season to eliminate the roughly 32 percent of punt play concussions that occur during the preseason without affecting the regular or post seasons.

Rule Change Proposals

1. Dedicated Return Blocker


Exploration of the data reveals that punt receivers and the left and right gunners on the kicking team are involved in a disproportionate number of concussions. Review of the videos and NGS play animation plots reveals that tackle attempts are often made on receivers at high speed during or immediately after the catch.
My first rule proposal is to require the return team to have a “Dedicated Return Blocker” line up within 10 yards of the punt receiver on plays where the return team intends to return the punt. Requiring a Dedicated Return Blocker will ensure that the return team always has a man in position to impede the advance of the fastest gunners on the kicking team. This rule is designed both to slow down the speed at which first contact is made with the receiver as well as provide a basis for the second rule proposal.
In the event of a short kick, the Dedicated Return Blocker may signal for a fair catch and receive the ball (or let the ball hit the ground), but he may not return the kick. The return team may elect not to have a Dedicated Return Blocker, in which case the receiver may not return the ball and instead must make a fair catch or let the ball hit the ground. On a punt without a Dedicated Return Blocker, all return team players other than the receiver must line up within 10 yards of the line of scrimmage to clearly indicate that there is no Dedicated Return Blocker. These options are not intended to increase the rate of fair catches, but rather to give the return team more options as to how they wish to approach the play.

2. Return Safe Zone


A single Dedicated Return Blocker may be able to slow the advance of the fastest coverage player, but a Dedicated Return Blocker is insufficient to create the sort of overall speed reduction that would be necessary to improve player safety on punt plays. Therefore, a broader rule that affects all incoming coverage players is necessary.
My second rule proposal is to introduce a “Return Safe Zone” between the receiver and the Dedicated Return Blocker. If the coverage team enters the Return Safe Zone or contacts the Dedicated Return Blocker before the receiver catches the punt or the ball touches the ground, it will be charged with a 15 yard interference penalty, assessed from the spot of the return, fair catch or downed ball. After the punt is caught or touches the ground, play proceeds as it normally would without a Return Safe Zone.
The figure below illustrates the Return Safe Zone and Dedicated Return Blocker in the context of existing punt roles:
Code

If a player on the punt coverage team reaches the Return Safe Zone while the Dedicated Return Blocker is more than 10 yards from the receiver, the play will be whistled dead and the return team will be charged with a 5 yard illegal formation penalty from the spot of the catch. A coverage player is considered to have reached the Return Safe Zone if he comes within two yard lines of it. This means that the Dedicated Return Blocker must strive to remain within 10 yards of the receiver to create a Return Safe Zone with a width of 10 yards or less, since allowing the Return Safe Zone to become wider than 10 yards risks a penalty.
Defining the Return Safe Zone as the area between the receiver and Dedicated Return Blocker provides a clear reference point for players, officials and fans to judge whether coverage players have violated the safe zone. It should be much easier for coverage players to judge whether they have bypassed the Dedicated Return Blocker too early than it would be for them to judge whether they have come within an arbitrary distance of the receiver, such as 5 or 10 yards, in the heat of the moment.
The establishment of a Return Safe Zone will prevent the problem of receivers being hit during or immediately after catching punts. It will also serve to slow the overall speed of the incoming coverage players and give the receiving team blockers more time to get into position, improving player safety. My earlier analysis showed that in 18 of 30 plays with a recorded punt reception, a coverage player was within 10 yard lines of the receiver at the time of the catch. This means the Punt Safe Zone would have forced incoming tacklers to slow down on about half of injury-causing plays. It is likely that the Return Safe Zone would also cause defenders who come within 10 to 15 yard lines of the receiver to slow down a bit as well, to avoid the possibility of violating the Return Safe Zone before the catch.

3. Fair Catch Compensation


The first two rules are designed to promote player safety during punt returns, but they could lead to an unintended consequence: fewer fair catches. The establishment of a Return Safe Zone means receivers will typically have plenty of time to make a catch safely and gain at least a few yards on the return, reducing the incentive to make a fair catch.
My third rule proposal is to introduce “Fair Catch Compensation” to counterbalance the likely increase in average return yardage resulting from the establishment of the Return Safe Zone. Fair Catch Compensation will grant the receiving team a 5 yard bonus when making a fair catch from the spot of the catch.
The amount of Fair Catch Compensation could be increased if a 5 yard bonus does not provide adequate incentive for players to make fair catches at rates similar to the current rates.

Expectations and Considerations


Creating rules to provide a Dedicated Return Blocker and Return Safe Zone will promote player safety by reducing player speeds and giving the receiver adequate time to safely catch the ball and react to incoming tacklers. Providing Fair Catch Compensation will allow for the creation of the Return Safe Zone without drastically reducing fair catches.
The rule changes I propose will, in general, make punts somewhat less effective for the kicking team, since the receiving team is expected to gain more yardage on the return and 5 extra yards on fair catches. This could result in more fourth down conversion attempts and fewer punt plays. This is not the intent of the proposed rule changes and I believe the advantage to the receiving team would not be so significant as to greatly reduce the number of punts or disrupt the normal strategy of the game.
The presence of a Dedicated Return Blocker may shift some of the danger of concussion from the receiver to the Dedicated Return Blocker. Since the Dedicated Return Blocker is not eligible to return the ball, however, the coverage team cannot tackle him and has no incentive to make contact with him. The Return Safe Zone also forces the defense to wait to touch or bypass the Dedicated Return Blocker until the punt lands, which means the fastest coverage players will typically have to slow down before any contact with the Dedicated Return Blocker occurs. Overall, the Dedicated Return Blocker may face a higher risk of being involved in concussions than the average player on the field, but his presence along with the Return Safe Zone will reduce the total incidence of high speed collisions and concussions.

Final Thoughts

Reducing concussions on punt plays is a difficult problem without a perfect solution. The physical nature of football carries some irreducible risk of injury, no matter how players are constrained by the rules. Avoiding problem plays like punts and kickoffs by drastically reducing returns or eliminating them altogether is perhaps the only certain way to greatly reduce injuries, but I believe it is best to take a measured approach and try to improve player safety during the course of play.

References

No comments:

Post a Comment

Note: Only a member of this blog may post a comment.