You are here

Article Text

Article menu

Download PDFPDF

Original article
Banning open carry of unloaded handguns decreases firearm-related fatalities and hospital utilization
  1. Rachael A Callcut1,2,
  2. Anamaria Joyce Robles1,2,
  3. Matthew W Mell3
  1. 1 Department of Surgery, University of California, San Francisco, California, USA
  2. 2 Department of Surgery, San Francisco General Hospital, San Francisco, California, USA
  3. 3 Department of Surgery, University of California, Sacramento, California, USA
  1. Correspondence to Dr Rachael A Callcut, Department of Surgery, University of California, San Francisco, CA 94110, USA; rachael.callcut{at}ucsf.edu

Abstract

Background Since 1967, in California it has been illegal to openly carry a loaded firearm in public except when engaged in hunting or law enforcement. However, beginning January 1, 2012, public open carry of unloaded handguns also became illegal. Fatal and non-fatal (NF) firearm injuries were examined before and after adoption of the 2012 ban to quantify the effect of the new law on public health.

Methods State-level data were obtained directly from California and nine other US state inpatient and emergency department (ED) discharge databases, and the Centers for Disease Control Web-Based Injury Statistics Query and Reporting System. Case numbers of firearm fatalities, NF hospitalizations, NF ED visits, and state-level population estimates were extracted. Each incident was classified as unintentional, self-inflicted, or assault. Crude incidence rates were calculated. The strength of gun laws was quantified using the Brady grade. There were no changes to open carry in these nine states during the study. Using a difference-in-difference technique, the rate trends 3 years preban and postban were compared.

Results The 2012 open carry ban resulted in a significantly lower incident rate of both firearm-related fatalities and NF hospitalizations (p<0.001). The effect of the law remained significant when controlling for baseline state gun laws (p<0.001). Firearm incident rate drops in California were significant for male homicide (p=0.023), hospitalization for NF assault (p=0.021 male; p=0.025 female), and ED NF assault visits (p=0.04). No significant decreases were observed by sex for suicides or unintentional injury. Changing the law saved an estimated 337 lives (3.6% fewer deaths) and 1285 NF visits in California during the postban period.

Discussion Open carry ban decreases fatalities and healthcare utilization even in a state with baseline strict gun laws. The most significant impact is from decreasing firearm-related fatal and NF assaults.

Level of evidence III, epidemiology.

  • gunshot
  • health care policy

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/

https://doi.org/10.1136/tsaco-2018-000196

Statistics from Altmetric.com

    Request Permissions

    If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

    Introduction

    Gun violence in America claims the lives of over 32 000 persons per year or 88 per day,1 with nearly 74 000 more experiencing non-fatal (NF) injuries.2 Firearms are the second leading cause of injury-associated death.2 It is estimated that over 300 million guns are owned in the USA, and we have the highest death rate from guns among all industrialized nations.3 4 In 2016, seven physician societies in conjunction with the American Public Health Association and the American Bar Association (ABA) called for policies designed to “reduce the rate of firearm injuries and deaths in the United States.”3 The ABA inclusion is important as they are “committed to helping lawyers and the public understand that the Second Amendment does not impede reasonable measures to limit firearm violence.”3 Key to the policies is driving high-quality research to understand the components that contribute to gun violence and investigating strategies to address this public health emergency.

    Despite being well recognized as a public health crisis,5 the mechanisms to curb death and decrease injury from gun violence are controversial, with legislative approaches the most debated. Unfortunately, there has been a paucity of high-quality research since the Dickey Amendment (1996), which prohibited the Centers for Disease Control (CDC) from using federal funds to advocate for or promote gun control.5 6 This ban was lifted in 2013 after several mass shootings,6 and there has been a steady increase in the number of investigations. Although studies have shown that states with the most restrictive gun laws have lower homicide rates1 3 and suicide rates,7–9 it is not clear if further restricting laws on gun possession, including open carry, have additional benefits. In recent years, some states, including Texas (2015), have repealed bans on open carry, whereas others like California have strengthened bans.

    Since 1967, in California it has been illegal to openly carry a loaded firearm in public except when engaged in hunting or law enforcement. However, beginning January 1, 2012, public open carry of unloaded guns also became illegal (California Penal Code 26350).10 The aim of this study is to investigate the effect of the 2012 ban on open carry of unloaded firearms on fatal and NF firearm injuries using a difference-in-difference (DID) technique.11

    Methods

    Data for 3 years preceding (2009, 2010, 2011) and following (2012, 2013, 2014) the law enactment were extracted from state-level publicly available data. Firearm case fatality numbers were obtained for California and nine other US states (Florida, Arizona, Oregon, Minnesota, Virginia, New York, Illinois, North Carolina, and Michigan) from the CDC Web-Based Injury Statistics Query and Reporting System (WISQARS).12 These comparison states were chosen to constitute the “control” group as they had no significant changes to open carry or strength of gun laws during the study period. The strength of gun laws was quantified using the Brady grade categories13 (A: California, New York; B: Illinois; C: Minnesota, Michigan; D: Oregon, Virginia; F: Florida, Arizona, North Carolina).

    WISQARS data included classification as unknown intent, unintentional, self-inflicted, or violence-related (included assault/homicide/police intervention). Overall fatality rates represent all violence-related, suicides, and unintentional deaths. Subset analysis on only homicide was also performed. Data were extracted by sex, race, and year. Race is reported as white, black, Asian American, and Native American. Data were not available at the state level for categories with less than 10 persons. Due to low incidence numbers of Asian American and Native American, these two groups were combined (“Other”). Crude population and age-adjusted fatality rates were determined using the CDC state population stratified for sex. Rates were reported per 100 000 persons.

    The CDC data do not contain information to allow state-specific comparisons of NF hospitalizations or emergency department (ED) visits. Therefore, state-level data were obtained from state inpatient databases, ED discharge databases, and vital statistics departments. Only California, Florida, and Minnesota report data consistent with the categorization of unintentional, self-inflicted, or assault/homicide stratified by sex and race. California data were provided by the California Department of Public Health Office of Statewide Planning and Development (ED and inpatient discharge databases). Florida data were obtained from the Department of Health Office, Injury Prevention Section (Agency for Health Care Administration, ED discharge and hospital discharge databases). Minnesota data were provided by the Department of Health Injury and Violence Prevention Unit Minnesota Injury Data Access System (MIDAS) reports.

    Overall rate trends preban and postban were compared to determine if the 2012 law decreased fatalities and hospital visits using the DID technique with robust SEs (for clustering) and controlling for strength of gun laws (Brady grade). The DID model also controlled for difference in patient populations across the states (online supplementary etable 1), including sex, Hispanic ethnicity, and race. Age-adjusted rates were used to account for differences in distribution of age across states.

    Supplemental material

    The DID is used to compare outcomes observed between groups over two time periods.11 Groups should have no intervention exposure in the first period and satisfy the parallel trend assumption. During the second time period, the intervention exposure only occurs for the study group. The technique allows the estimation of the net outcome of an intervention over time through comparing the changes in a population that is exposed to the policy change with a population not exposed.11

    The parallel trend assumption establishes that the trends in outcomes between treated and comparison groups must be the same preintervention. To assess this, linear regression was used to determine if the age-adjusted rate trends across the preintervention years were statistically different. Within each group, there was no difference (California p=0.40, control p=0.73). The difference between California and the control states during the preintervention period was also assessed and there was no difference (p=0.21). In addition, an analysis of the preintervention year-by-year trend by individual states was conducted and no state had a statistically significant difference at the p<0.05 level. Thus, the parallel assumption criteria were satisfied.

    A sensitivity analysis of the DID analysis was performed to examine the effect of potential bias in the individual states that may have affected the results. First, the analysis was repeated given potential law changes postintervention in the state of New York could have affected the results. Next, any state with a preintervention year-to-year trend analysis with a p<0.10 was excluded to insure that small, but not statistically significant changes in the preintervention period year-to-year rates did not account for the net effect of the DID results. Arizona was the only state meeting this criteria. Finally, despite no statistically significant difference in the preintervention year-to-year trend lines for California, qualitative analysis is used commonly when assessing the parallel assumption trends. The rate in California from 2009 to 2010 appears visually to have decreased significantly. Given this visual assessment, the DID analysis was repeated excluding 2009.

    To understand the impact of each type of fatal and NF injury on the overall rate changes, the trends in incidence rates over time were compared using linear regression. The percent change is based on the preintervention and postintervention periods using the preintervention as the baseline. Each time period average rate is calculated as the average during the 3 years. For example, the rate/100 000 is averaged for years 2009, 2010, and 2011 to provide the preintervention average rate. The percent change from baseline is then determined by (((postrate − prerate)/prerate)×100).

    For crude rate estimates, the mean rate can be calculated as the average of the yearly estimates. For age-adjusted rates, yearly rates must account for the differences in populations during the time period. The average rate for a given category and time period was calculated by multiplying the age-adjusted rate by the population in that category for the specific year. The total for each year was summed together and then divided by the total population. This results in the average age-adjusted rate for the time period and is represented by (sum total (year-specific age-adjusted rate × year-specific population))/(sum total (population for the total time period)). The control group average age-adjusted rate was calculated similarly and represented by average age-adjusted rate=(sum total (state population × state-level age-adjusted rate))/(sum total (state population)).

    To determine lives saved and visits avoided by the law, the average rates preintervention and postintervention were first calculated for case fatalities and visits. The preintervention rate was multiplied by the average population in the postperiod to determine the expected number of deaths (or visits) had no intervention occurred. This number was then compared with the actual observed number in the postperiod. The difference between the two represents the lives lost (or visits) that were avoided due to the legislative change. Statistical significance was determined at the p<0.05 level. All analyses were performed using STATA V.14.2.

    Results

    The DID analysis demonstrated NF hospital admissions and overall fatalities attributed to firearm injury decreased in California compared with the control states after the enactment of the open carry ban (table 1).

    View this table:
    Table 1

    Healthcare utilization and fatalities from firearm injuries

    Total hospital utilization (ED outpatient visits and NF hospitalizations) resulted in an age-adjusted rate of 17.24 injuries per 100 000 persons in the preban time period compared with 16.16 per 100 000 persons postban. The largest decrease was seen in NF hospitalizations, with a relative decrease from the preban period of 9.30% (table 1). In contrast, the rate of hospitalization fell only 1.23% in the non-intervention group (p<0.001). There was no statistical difference between the two groups in the rate of NF ED outpatient visits.

    The DID analysis controlling for strength of gun laws, sex, race, and ethnicity also demonstrated the ban resulted in a significantly lower incidence of firearm-related fatalities (figure 1; p<0.001; online supplementary etable 2). Excluding deaths from unknown intent and legal intervention, the crude case fatality rates decreased 3.6% in California, whereas the rate rose 1.9% in the controls (table 1; p<0.001). Similarly, the age-adjusted case fatality rate decreased 4.17% in California while rising 0.32% in the controls (table 1; p<0.001; online supplementary etable 3). Changing the law saved an estimated 337 lives in California (3.6% fewer deaths) and 1285 NF visits during the postban period (table 1).

    Figure 1
    Figure 1

    Case fatality rates preintervention and postintervention. CA, California.

    Sensitivity analysis

    For the DID analysis of the age-adjusted case fatality rates, a sensitivity analysis was conducted to account for potential confounders that could have affected the results. First, New York, which had some minor law changes in the postintervention period, was excluded. The effect of the DID analysis remained unchanged (p=0.002). Next, Arizona was excluded from the analysis given potential violation of the parallel trend assumption as the state-specific year-to-year trend rate had a p<0.1. The DID analysis remained with a significant difference between California and the control states (p=0.028). Finally, given the visual assessment of the rates in California appeared to show a potential decrease in case fatality rates from year 2009 to 2010 (indicating a potential parallel trend assumption violation), the analysis was repeated excluding 2009 for all states. The DID results remained significant (p=0.042).

    The role of injury intent

    The intent to harm through firearm assault had the largest decrease in California hospital utilization (10.16% decrease; preban age-adjusted rate 12.11 visits/100 000 persons vs. 10.88 postban, p=0.022; table 2).

    View this table:
    Table 2

    Injuries by intent between California and the control states

    Although the absolute rate also fell in the controls, this small decrease within group yearly trend was not statistically significant (p=0.728). To determine if the rate change in California was statistically different from the controls, a DID analysis controlling for strength of gun laws, sex, race, and ethnicity was performed. The rate of NF assault in California was significantly decreased compared with the controls (p=0.010; table 2). Similarly, a decrease in homicide rate was the largest driver of decreased firearm fatalities in California (table 2). The California homicide rate was 6.74% lower in the postban era (p=0.026), whereas the rate in the controls only fell 3.52% (p=0.67). However, when comparing between-group differences, the rate of change was not statistically different (table 2).

    The rates of NF suicide attempts and unintentional injury demonstrated no statistical within-group difference in either California or the controls (table 2). However, in comparing California with the controls, there was a statistically significant difference in suicide attempts, with a slight fall in the control states compared with essentially no change in California (table 2; p=0.001). Unfortunately, this lower rate of NF suicide attempts in the control group is tempered by the finding that there was a rise in the rate of lives lost in the same time period as the result of suicide. Thus, postban the net effect was a decrease in lives lost within California from suicide compared with the control states (p<0.001; table 2).

    Impact of sex

    Hospitalization for NF assault (p=0.021 male; p=0.025 female) and ED NF assault visits (total p=0.04; p=0.035 male; p=0.114 female) both dropped after the law enactment. The rates of suicide and unintentional injury remained stable (table 3).

    View this table:
    Table 3

    California firearm case fatality rates by year for violence-related*, suicide, and unintentional injury

    For men, the rate of suicide was no different (7.59 preban, 7.40 postban; p=0.061) and unintentional injury was uncommon (0.12 preban and 0.13 postban; p=0.646). Female suicide rates also remained stable (0.89 preban and postban) and unintentional injury was extremely rare (0.02 preban and postban).

    For violence-related deaths, both male and female rates trended down. Male homicide rates dropped from 6.97 per 100 000 to 5.85 per 100 000 for a relative decrease of 16.1% (p=0.02). There was also a proportional decrease in female homicide rates by 7.87% (0.89 preban and 0.82 postban). During the 6-year study, the female homicide rate dropped from 0.87 per 100 000 in 2009 to 0.78 per 100 000 in 2014, but this trend did not reach statistical significance (p=0.077). This likely reflects the low overall case numbers in women.

    The role of race on fatalities was also examined stratified by sex. The law appeared to have the most significant effect on white, male homicide rates (table 4).

    View this table:
    Table 4

    California case fatality* rates by sex and race

    Whereas this group saw a 9.20% drop in case fatality rates (p=0.01), black men only had a 1.56% drop (p=0.27) after the ban. The rate of black male homicide remains dauntingly high with a case fatality rate of 30.21 per 100 000 compared with a rate of only 4.64 per 100 000 in white men. Although overall the number of affected women is much lower, proportionally, black women still suffer homicide at a rate fourfold higher than white women (table 4).

    Discussion

    Firearm injury is a public health crisis in the USA claiming more than 300 000 persons in the last decade and injuring far more.1 2 4 14 The annual estimated cost of injuries exceeded $174 billion in 20103 and NF injuries are 40 times more common than fatal injuries.14 Despite small decreases, the incidence of gun violence still far outpaces other nations.3 4 14 Australia adopted a panel of strict gun laws in 1996 after a mass shooting.15 16 As a result, the case fatality rate is now 134 times smaller than in the USA despite only a 13.7-fold population difference.15 16 Likewise, firearm-related homicide is 27 times higher in the USA.15 16

    The underlying causes are a complicated, multifaceted issue that spans cultural, economic, behavioral including substance abuse, firearm safety, and legislative factors that contribute to the staggering statistics.2 15 17 Although no single law is likely to have an overwhelming effect, continuing to assess and implement strategies that contribute to driving this rate down is a key principle for curbing this public health emergency. Even former Representative Jay Dickey, the author of the amendment banning gun violence research, has evolved to state that funding is needed and that “doing nothing is no longer an acceptable solution.”6

    This study examines the role of legislative action on injuries through expanded restriction of open carry laws. California has the strongest gun laws, ranking highest on the Brady scale in the nation with 104 separate laws.13 18 19 The impact of open carry laws on firearm injuries had not previously been investigated. Demonstrating the expansion of the open carry law had a measurable effect on decreasing firearm death and injury in a state already with the most restrictive gun regulations in the nation suggests that this type of gun control measure has incremental added benefit.

    The ABA and multiple physician stakeholder groups have jointly advocated for both increased research and regulations.3 20 To be accepted, legislation must respect the second amendment, be rational in implementation, and based on fundamentally sound research. Fatality rates are lower in states that have more restrictive overall gun laws.21–23 However, simply having more laws is not the answer22; uncovering which specific laws actually make a difference is important for both public safety and advocacy efforts. For example, the ban on open carry had only a small effect on suicide rates and this is not surprising. Overall access to guns is a far more important factor in suicide prevention.1 24 25

    California also has a sizeable number of gun owners with over 2.9 million handguns purchased in the last 9 years, with men having the highest rate at 242 handguns per 10 000 persons compared with a rate of 25 per 10 000 for women.1 There is also racial differences (white: 209 per 10 000; black: 80 per 10 0001 26). Multiple studies have shown that firearm ownership is a risk factor for both suicide and homicide.1 3 7–9 19 27 28 Interestingly, the largest reduction in firearm fatalities and hospital utilization in this study was seen in white men. This suggests that this law was particularly effective in this subgroup.

    Homicide and NF injury disproportionately affect black men and women.14 22 29 The case fatality rate was greater than fourfold higher in both black men and women compared with white men and women, respectively. Unfortunately, the implementation of the open carry ban on unloaded guns had minimal effect on blacks. Although only speculative, this further highlights that there are likely differing risk factors across racial groups, making subgroup analyses of legislative changes extremely important.

    Although suicide makes up the largest proportion of firearm deaths, those from homicide have fueled the debate on tougher gun control legislation. As mass shootings have become more common, the debate over gun control has found renewed visibility.28 The reality is that the number of persons killed or injured each year is astronomically higher from interpersonal violence than from mass shootings. In fact, mass shootings make up less than 1% of all firearm deaths.1 Contributing to the controversy is a lack of literature examining the specific impact of the new legislation.

    The DID regression analysis is a commonly employed strategy in health policy research when assessing the longitudinal outcomes after changes in legislation.11 Research approaches that compare outcomes with differing state gun laws can be biased by the multitude of causative factors affecting gun violence that are not able to be controlled for in the analyses.18 Reporting before and after results in the intervention group would not be sufficient to draw conclusions as there are multiple other unmeasured confounders that could have effective changes in case numbers.

    The DID is a robust alternative method for overcoming these potential biases, and any differences found between groups are interpreted as being a causal effect of the policy.11 This technique is particularly important when observational studies or randomized control trials are not available. The findings are most helpful when comparison groups are large and the data span enough time to see the longitudinal impact of a legislative change.18 This study included a large number of states in the control group with differing overall strength of gun laws and used multiyear data. This provided enough observations and statistical power to uncover important differences in case fatality rates and hospitalization usage.

    The DID also relies on two key assumptions. The first assumption is parallel trends. The trends in outcomes between the treated and comparison groups must be the same prior to the intervention. If they are not, the DID cannot be used. Regression modeling was used to determine if the trends are statistically different across the years of the preintervention. There was no statistically significant difference in trends in the preintervention period within or between groups. In the sensitivity analysis, the results remained statistically significant, supporting the difference seen was not attributable to a violation of the parallel trend assumption.

    The second key assumption is that of “common shocks assumptions.” This assumption states “that any events occurring during or after the time of the policy changed will equally affect the treatment and comparison groups.”30 These are considered unexpected and unpredictable events that are unrelated to the policy.30 In our study time period, there was several highly visible events in the USA involving firearms, including the Fort Hood shooting (Texas 2009), Binghamton shootings (New York 2009), the Geneva county shooting (Alabama 2009), the Sandy Hook Elementary School shooting (Connecticut 2012), the Aurora Theater shooting (Colorado 2012), and the Washington Naval Yard shooting (DC 2013).

    There is no plausible reason to think that the control or treatment groups would have been differentially affected by these events which were widely carried on national news coverage. However, it is acknowledged that there could be unaccounted variables that changed over time that could not be measured or controlled for that differentially affected a control state. The DID analysis is strongest when control groups are as large as possible to minimize the effect of this unknown “common shock.” Therefore, the control group includes all the states with stable gun laws during the study period.

    The 2012 ban on open carry resulted in a significant decrease in both firearm-related fatalities and hospital utilization. Changing the law led to 3.7% less fatalities and 6.5% fewer hospital visits in California. This translates to 337 saved lives and 1285 fewer hospital visits. Although these decreases are modest, extrapolated nationwide, this would represent almost 1200 fewer deaths per year and over 4800 fewer costly hospital visits. Although the data demonstrate the net effect of banning open carry was a reduction in fatalities and hospital utilization, the vast majority of this effect was from the decrease in assaults. During the last 20 years, efforts have been under way, including legislative actions, to curb loss of life from interpersonal gun violence. These data suggest that these legislative actions have an effect on at least a portion of the intended at-risk groups, but that effect varies by race.

    This study has several limitations. The most significant is the limited number of Brady grade A states with no changes to open carry during the study period. New York had no appreciable change in their Brady grade, but did enact a controversial law, the Secure Ammunition and Firearms (SAFE) Act, during 2013. This law was widely challenged in court and was not settled until 2015. The act contained multiple provisions including the ban on assault weapons and expanded background checks, and made internet sales of ammunition illegal. Although there was no change in Brady grade, the inclusion of New York in the controls could have affected our results; however, it would be expected to bias the results toward the null as these provisions strengthened laws. We also performed a sensitivity analysis without New York in the controls. The DID analysis remained significant (p=0.002) and the net effect of the difference in fatality rates between California and the control states was even greater. Therefore, we think that our inclusion of New York provides a conservative estimate of the net effect of the ban on open carry.

    Further limitations include the small number of states reporting data for NF injuries in publicly available data sets. The control group for these analyses relies on only two comparison states. Although this is considered an adequate sample size in a DID analysis, the limited variety of the included states could have biased the results. Additionally, the categorization of race is limited to only white, black, and other due to the restrictions in reporting for CDC data. Finally, case numbers are quite small, especially for women by race categories, making reporting relative changes somewhat misleading. Large relative changes can be seen for incidence rates with quite small absolute changes.

    Conclusions

    Open carry ban decreases fatalities and healthcare utilization even in a state with baseline strict gun laws. The most significant impact is from decreasing firearm-related fatal and NF assaults.

    References

    1. 1.↵
      2. Studdert DM ,
      3. Zhang Y ,
      4. Rodden JA ,
      5. Hyndman RJ ,
      6. Wintemute GJ
      . Handgun acquisitions in california after two mass shootings. Ann Intern Med 2017;166:698–706.doi:10.7326/M16-1574
      OpenUrlCrossRefPubMed
    2. 2.↵
      2. Butkus R ,
      3. Doherty R ,
      4. Daniel H , Health and Public Policy Committee of the American College of Physicians
      . Reducing firearm-related injuries and deaths in the United States: executive summary of a policy position paper from the American College of Physicians. Ann Intern Med 2014;160:858–60.doi:10.7326/M14-0216
      OpenUrlCrossRefPubMedWeb of Science
    3. 3.↵
      2. Weinberger SE ,
      3. Hoyt DB ,
      4. Lawrence HC ,
      5. Levin S ,
      6. Henley DE ,
      7. Alden ER ,
      8. Wilkerson D ,
      9. Benjamin GC ,
      10. Hubbard WC
      . Firearm-related injury and death in the United States: a call to action from 8 health professional organizations and the American Bar association. Ann Intern Med 2015;162:513–6.doi:10.7326/M15-0337
      OpenUrlCrossRefPubMed
    4. 4.↵
      2. Crandall M ,
      3. Eastman A ,
      4. Violano P ,
      5. Greene W ,
      6. Allen S ,
      7. Block E ,
      8. Christmas AB ,
      9. Dennis A ,
      10. Duncan T ,
      11. Foster S , et al
      . Prevention of firearm-related injuries with restrictive licensing and concealed carry laws: an eastern association for the surgery of trauma systematic review. J Trauma Acute Care Surg 2016;81:952–60.doi:10.1097/TA.0000000000001251
      OpenUrl
    5. 5.↵
      2. Dyer O
      . AMA calls for end to ban on gun violence research. BMJ 2016;353:i3529.doi:10.1136/bmj.i3529
    6. 6.↵
      2. Betz ME ,
      3. Ranney ML ,
      4. Wintemute GJ
      . Frozen funding on firearm research: "doing nothing is no longer an acceptable Solution". West J Emerg Med 2016;17:91–3.doi:10.5811/westjem.2016.1.29767
      OpenUrl
    7. 7.↵
      2. Anestis M ,
      3. Capron DW
      . The associations between state veteran population rates, handgun legislation, and statewide suicide rates. J Psychiatr Res 2016;74:30–4.doi:10.1016/j.jpsychires.2015.12.014
      OpenUrl
    8. 8.↵
      2. Anestis MD ,
      3. Khazem LR ,
      4. Law KC ,
      5. Houtsma C ,
      6. LeTard R ,
      7. Moberg F ,
      8. Martin R
      . The association between state laws regulating handgun ownership and statewide suicide rates. Am J Public Health 2015;105:2059–67.doi:10.2105/AJPH.2014.302465
      OpenUrl
    9. 9.↵
      2. Anestis MD ,
      3. Selby EA ,
      4. Butterworth SE
      . Rising longitudinal trajectories in suicide rates: the role of firearm suicide rates and firearm legislation. Prev Med 2017;100:159–66.doi:10.1016/j.ypmed.2017.04.032
      OpenUrl
    10. 10.↵
      1. State of California
      . 2017.ARTICLE 1: crime of openly carrying an unloaded handgun [26350- 26350]. http://leginfo.legislature.ca.gov/faces/codes_displaySection.xhtml?lawCode=PEN&sectionNum=26350 (accessed 25 Jul 2017).
    11. 11.↵
      2. Gertler PJ MS ,
      3. Premand P ,
      4. Rawlings LB
      . WHO - Impact evaluation in practice, Chapter 6. Geneva: World Health Organization, 2011.
    12. 12.↵
      1. National Center for Injury Prevention and Control (NCIPC)
      . Data & statistics (WISQARS). Atlanta, GA: Centers for Disease Control, 2017.
    13. 13.↵
      1. Brady Campaign to Prevent Gun Violence
      . 2013.State Scorecard 2013. Brady Campaign website http://www.bradycampaign.org/2013-state-scorecard (accessed 15 Dec 2016).
    14. 14.↵
      2. Kalesan B ,
      3. French C ,
      4. Fagan JA ,
      5. Fowler DL ,
      6. Galea S
      . Firearm-related hospitalizations and in-hospital mortality in the United States, 2000-2010. Am J Epidemiol 2014;179:303–12.doi:10.1093/aje/kwt255
      OpenUrlCrossRefPubMedWeb of Science
    15. 15.↵
      2. Chapman S ,
      3. Alpers P
      . Gun-related deaths: how Australia stepped off "the American path". Ann Intern Med 2013;158:770–1.doi:10.7326/0003-4819-158-10-201305210-00624
      OpenUrl
    16. 16.↵
      2. Chapman S ,
      3. Alpers P ,
      4. Jones M
      . Association between gun law reforms and intentional firearm deaths in Australia, 1979-2013. JAMA 2016;316:291–9.doi:10.1001/jama.2016.8752
      OpenUrl
    17. 17.↵
      2. Braga AA ,
      3. Weisburd DL
      . Focused deterrence and the prevention of violent gun injuries: practice, theoretical principles, and scientific evidence. Annu Rev Public Health 2015;36:55–68.doi:10.1146/annurev-publhealth-031914-122444
      OpenUrlCrossRefPubMed
    18. 18.↵
      2. Siegel M ,
      3. Pahn M ,
      4. Xuan Z ,
      5. Ross CS ,
      6. Galea S ,
      7. Kalesan B ,
      8. Fleegler E ,
      9. Goss KA
      . Firearm-related laws in all 50 US States, 1991-2016. Am J Public Health 2017;107:1122–9.doi:10.2105/AJPH.2017.303701
      OpenUrl
    19. 19.↵
      2. Kalesan B ,
      3. Mobily ME ,
      4. Keiser O ,
      5. Fagan JA ,
      6. Galea S
      . Firearm legislation and firearm mortality in the USA: a cross-sectional, state-level study. Lancet 2016;387:1847–55.doi:10.1016/S0140-6736(15)01026-0
      OpenUrl
    20. 20.↵
      2. Kuhls DA ,
      3. Campbell BT ,
      4. Burke PA ,
      5. Allee L ,
      6. Hink A ,
      7. Letton RW ,
      8. Masiakos PT ,
      9. Coburn M ,
      10. Alvi M ,
      11. Lerer TJ , et al
      . Survey of American college of surgeons committee on trauma members on firearm injury: consensus and opportunities. J Trauma Acute Care Surg 2017;82:877–86.doi:10.1097/TA.0000000000001405
      OpenUrl
    21. 21.↵
      2. Lee LK ,
      3. Fleegler EW ,
      4. Farrell C ,
      5. Avakame E ,
      6. Srinivasan S ,
      7. Hemenway D ,
      8. Monuteaux MC
      . Firearm laws and firearm homicides: a systematic review. JAMA Intern Med 2017;177:106–19.doi:10.1001/jamainternmed.2016.7051
      OpenUrl
    22. 22.↵
      2. Fleegler EW ,
      3. Lee LK ,
      4. Monuteaux MC ,
      5. Hemenway D ,
      6. Mannix R
      . Firearm legislation and firearm-related fatalities in the United States. JAMA Intern Med 2013;173:732–40.doi:10.1001/jamainternmed.2013.1286
      OpenUrl
    23. 23.↵
      2. Santaella-Tenorio J ,
      3. Cerdá M ,
      4. Villaveces A ,
      5. Galea S
      . What do we know about the association between firearm legislation and firearm-related injuries? Epidemiol Rev 2016;38:140–57.doi:10.1093/epirev/mxv012
      OpenUrlCrossRefPubMed
    24. 24.↵
      2. Anglemyer A
      . Guns, suicide, and homicide. Ann Intern Med 2014;160:876.doi:10.7326/L14-5012
    25. 25.↵
      2. Anglemyer A ,
      3. Horvath T ,
      4. Rutherford G
      . The accessibility of firearms and risk for suicide and homicide victimization among household members: a systematic review and meta-analysis. Ann Intern Med 2014;160:101–10.doi:10.7326/M13-1301
      OpenUrlPubMed
    26. 26.↵
      2. Studdert DM ,
      3. Donohue JJ ,
      4. Mello MM
      . Testing the immunity of the firearm industry to tort litigation. JAMA Intern Med 2017;177:102–5.doi:10.1001/jamainternmed.2016.7043
      OpenUrl
    27. 27.↵
      2. Mann JJ ,
      3. Michel CA
      . Prevention of firearm suicide in the United States: what works and what is possible. Am J Psychiatry 2016;173:969–79.doi:10.1176/appi.ajp.2016.16010069
      OpenUrl
    28. 28.↵
      2. Monuteaux MC ,
      3. Lee LK ,
      4. Hemenway D ,
      5. Mannix R ,
      6. Fleegler EW
      . Firearm ownership and violent crime in the U.S : an ecologic study. Am J Prev Med 2015;49:207–14.doi:10.1016/j.amepre.2015.02.008
      OpenUrl
    29. 29.↵
      2. Kalesan B ,
      3. Vasan S ,
      4. Mobily ME ,
      5. Villarreal MD ,
      6. Hlavacek P ,
      7. Teperman S ,
      8. Fagan JA ,
      9. Galea S
      . State-specific, racial and ethnic heterogeneity in trends of firearm-related fatality rates in the USA from 2000 to 2010. BMJ Open 2014;4:e005628.doi:10.1136/bmjopen-2014-005628
    30. 30.↵
      2. Dimick JB ,
      3. Ryan AM
      . Methods for evaluating changes in health care policy: the difference-in-differences approach. JAMA 2014;312:2401–2.doi:10.1001/jama.2014.16153
      OpenUrlCrossRefPubMed

    Footnotes

    • Presented at 76th Annual Meeting of the American Association for the Surgery of Trauma (AAST), September 14, 2017, Baltimore, Maryland.

    • Contributors RAC: literature search, study design, data collection, analysis, interpretation, writing. AMJR: literature search, study design, interpretation, critical review. MWM: study design, data analysis, interpretation, critical review.

    • Funding The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.

    • Competing interests None declared.

    • Patient consent Not required.

    • Provenance and peer review Not commissioned; externally peer reviewed.

    • Data sharing statement There are no unpublished data. All data are from publicly available data sets.