0
Brief Report |

Application of the TIMI Risk Score for ST-Elevation MI in the National Registry of Myocardial Infarction 3 FREE

David A. Morrow, MD; Elliott M. Antman, MD; Lori Parsons, BS; James A. de Lemos, MD; Christopher P. Cannon, MD; Robert P. Giugliano, MD, SM; Carolyn H. McCabe, BS; Hal V. Barron, MD; Eugene Braunwald, MD
[+] Author Affiliations

Author Affiliations: Department of Medicine, Brigham & Women's Hospital, Boston, Mass (Drs Morrow, Antman, Cannon, Giugliano, and Braunwald and Ms McCabe); Ovation Research Group, Seattle, Wash (Ms Parsons); Donald W. Reynolds Cardiovascular Clinical Research Center, University of Texas Southwestern, Dallas (Dr de Lemos); and Department of Medicine, University of California, San Francisco, and Department of Medical Affairs, Genentech Inc, San Francisco (Dr Barron).


JAMA. 2001;286(11):1356-1359. doi:10.1001/jama.286.11.1356.
Text Size: A A A
Published online

Context The Thrombolysis in Myocardial Infarction (TIMI) risk score for ST-elevation myocardial infarction (STEMI) is a simple integer score for bedside risk assessment of patients with STEMI. Developed and validated in multiple clinical trials of fibrinolysis, the risk score has not been validated in a community-based population.

Objective To validate the TIMI risk score in a population of STEMI patients reflective of contemporary practice.

Design, Setting, and Participants The risk score was evaluated among 84 029 patients with STEMI from the National Registry of Myocardial Infarction 3 (NRMI 3), which collected data on consecutive patients with myocardial infarction (MI) from 1529 US hospitals between April 1998 and June 2000.

Main Outcome Measures Ability of the TIMI risk score to correctly predict risk of death in terms of model discrimination (c statistic) and calibration (agreement of predicted and observed death rates).

Results Patients in NRMI 3 tended to be older, to be more often female, and to have a history of coronary disease more often than those in the derivation set. Forty-eight percent received reperfusion therapy. The TIMI risk score revealed a significant graded increase in mortality with rising score (range, 1.1%-30.0%; P<.001 for trend). The risk score showed strong prognostic capacity overall (c = 0.74 vs 0.78 in derivation set) and among patients receiving acute reperfusion therapy (c = 0.79). Predictive behavior of the risk score was similar between fibrinolytic-treated patients (n = 23 960; c = 0.79) and primary percutaneous coronary intervention patients (n = 15 348; c = 0.80). In contrast, among patients not receiving reperfusion therapy, the risk score underestimated death rates and offered lower discriminatory capacity (c = 0.65).

Conclusions Sufficiently simple to be practical at the bedside and effective for risk assessment across a spectrum of patients, the TIMI risk score may be useful in triage and treatment of patients with STEMI who are treated with reperfusion therapy.

Figures in this Article

Effective risk stratification is integral to management of acute coronary syndromes.1 Even among patients with ST-elevation myocardial infarction (STEMI), for whom initial therapeutic options are well-defined, patient risk characteristics impact short- and long-term medical decision making.24 Early risk assessment guides triage to alternative levels of hospital care, decisions regarding therapeutic interventions, and application of clinical pathways that direct patient care and use of clinical resources. Despite well-characterized risk predictors,57 reliable quantitative estimation of risk is challenging, as patients present with complex risk profiles requiring integration of numerous elements of qualitative and quantitative data. Thus, practical tools that enhance clinicians' ability to rapidly and accurately assess risk are of substantial interest.

The Thrombolysis in Myocardial Infarction (TIMI) risk score for STEMI is a simple integer score that can be used at the bedside for risk stratification of patients at presentation with ST-elevation acute coronary syndromes.8 Derived from 14 114 patients enrolled in the InTIME II (Intravenous nPA for Treatment of Infarcting Myocardium Early) trial, the TIMI risk score is a robust clinical tool for mortality risk prediction in fibrinolytic-eligible patients with STEMI.8 Although it is documented to perform well among patients receiving fibrinolytics in clinical trials,8 the TIMI risk score has not been validated in a general population of patients with STEMI, including those treated with primary coronary revascularization or not receiving any form of acute reperfusion therapy. Since prospective validation in a data set reflective of contemporary practice is important prior to widespread application of any prediction rule, we evaluated the prognostic performance of the TIMI risk score in a heterogeneous population treated in US hospitals for acute myocardial infarction (MI) and entered into the National Registry of Myocardial Infarction 3 (NRMI 3).

The third NRMI is a prospective, observational database of demographics, practice patterns, and health outcomes among patients with acute MI.9 Data were collected on consecutive patients with MI from 1529 hospitals between April 1998 and June 2000. All treatment decisions were made at the discretion of the treating physicians. The present analysis included patients with ST elevation or presumed new left bundle-branch block who completed their stay at the admitting hospital and were not in cardiogenic shock at the initial evaluation.

The TIMI risk score for STEMI is a weighted integer score based on 8 clinical risk indicators that can be easily ascertained at presentation (Table 1).8 For each patient, the score is calculated as the arithmetic sum of the points for each risk feature present (range, 0-14). The TIMI risk score was developed using multivariable methods among patients from the InTIME II trial, a phase 3 trial of lanoteplase vs alteplase reperfusion therapy.8 The risk score was derived based on mortality through 30 days after presentation but showed stable prognostic performance across multiple time points, including time to discharge (c = 0.78).8

Table Graphic Jump LocationTable 1. Elements of the TIMI Risk Score*

Evaluation of the TIMI risk score was based on NRMI 3 patients with complete baseline data (89%). The prognostic discriminatory capacity of the TIMI risk score was expressed as the c statistic, representing the area under the receiver operating characteristic curve for prediction of in-hospital death.10 Differences in event rates with increasing risk scores were assessed using the χ2 test for trend. Model calibration was assessed by construction of plots of predicted vs actual death rates across the entire spectrum of predicted risk. Testing for differences in mortality gradients among groups with different treatment modes was performed using logistic regression analysis with interaction terms. The prognostic contributions of variables not included in the risk score were assessed by stepwise logistic regression. Patients who did not receive any reperfusion therapy were not assessed for the predictor variable of time to reperfusion therapy. Two-tailed P values <.05 were considered significant. Analyses were performed using SAS, version 8.0 (SAS Institute Inc, Cary, NC).

The analysis included 84 029 patients with STEMI. Baseline characteristics are summarized in Table 2. Patients from NRMI 3 tended to be older; were more often female; and tended to have more heart failure, previous MIs, and prior coronary revascularization procedures than patients in the derivation set.8 Among the NRMI 3 validation set, 40 214 patients (48%) were treated with pharmacological or mechanical reperfusion therapy. Those who underwent primary percutaneous coronary intervention (n = 15 348) represented 38% of patients who received reperfusion therapy. Patients treated without reperfusion therapy had more frequent high-risk features and a higher median TIMI risk score (Table 2).

Table Graphic Jump LocationTable 2. Baseline Characteristics of the NRMI 3 Validation and InTIME II Derivation Sets*

In-hospital mortality was 12.6% (n = 10 612). Application of the TIMI risk score in the overall population from NRMI 3 revealed a significant, nearly 30-fold graded increase in risk between patients with a score of 0 and those with a score of 8 or higher (range, 1.1%-30.0%; P<.001 for trend). Assessed by the area under the receiver operating characteristic curve, the risk score showed a strong prognostic capacity (c = 0.74) that was comparable with the risk score performance in the InTIME II trial (c = 0.78).8

Stratification of the population into those who were treated with vs without reperfusion therapy revealed substantial differences in risk score discriminatory performance as well as in calibration. The prognostic capacity of the TIMI risk score among patients treated with acute reperfusion therapy (c = 0.79) was unchanged compared with InTIME II and was similar between patients treated with fibrinolytics and those who underwent primary percutaneous coronary interventions (c = 0.79 vs 0.80), with no significant difference in the slope of the risk gradient between the 2 groups (P = .09 for interaction).

Figure 1 shows the behavior of the TIMI risk score in terms of predicting death across the spectrum of expected risk. The observed mortality rates for patients in NRMI 3 receiving reperfusion therapy were strongly concordant with risk estimates derived from InTIME II (r = 0.99; Figure 1), indicating good model calibration. Among patients treated without reperfusion therapy, a significant graded relationship between the TIMI risk score and mortality was also evident (P<.001 for trend; Figure 1). Of note, however, the slope of the risk gradient in this group was less steep owing to a pattern of higher mortality among patients with risk scores in the low and middle range (P<.001 for interaction; c = 0.65). As such, the quantitative mortality estimates from InTIME II underestimated the risk for patients treated without reperfusion therapy except those with the highest predicted death rates.

Figure. Prediction of In-Hospital Mortality With TIMI Risk Score for STEMI
Graphic Jump Location
STEMI indicates ST-elevation myocardial infarction; NRMI 3, the National Registry of Myocardial Infarction 3. Data for the Intravenous nPA for Treatment of Infarcting Myocardium Early (InTIME II) trial are from Morrow.8

Exploratory analysis was performed to identify additional important predictors in patients treated without reperfusion therapy. Among the variables considered, bleeding risk (active internal bleeding or recent surgery/trauma), uncertainty regarding diagnosis, major organ failure, and chronic renal failure added significantly to the multivariable model including each of the risk score predictors (c = 0.746; P<.001). While history of smoking and prior stroke added further to the model, the improvement in discriminatory capacity was small (c = 0.750).

Results from risk prediction tools developed in carefully selected patients enrolled in clinical trials may not be generalizable to heterogeneous, "real-world" patient populations. This analysis demonstrates the robust prognostic performance of the TIMI risk score in a general population of patients with ST-elevation acute coronary syndromes treated with acute reperfusion therapy in a diverse group of US hospitals. The strong predictive capacity of the risk score was evident among patients treated with either pharmacological or mechanical reperfusion therapy. These observations establish the prognostic efficacy of the TIMI risk score in a large group of patients representative of contemporary clinical practice.

Patients who were not administered reperfusion therapy showed a pattern of higher mortality risk. Although the difference in outcomes may be due in part to the established benefits of reperfusion therapy, we identified several high-risk features not included in the TIMI risk score that are likely related to the decision not to administer reperfusion therapy, and offer additional predictive information. While the quantitative mortality estimates from InTIME II do not apply to these patients, the TIMI risk score may aid in their categorization into groups of low, moderate, and high relative risk. Limited information is available regarding the performance of other validated models stratified by use of reperfusion therapy. Our data suggest that future work should include evaluation of existing and new models in these important subgroups of the overall population with acute MI (Table 3).

Table Graphic Jump LocationTable 3. Adjusted Mortality Risk Relationships in NRMI 3 vs InTIME II*

The TIMI risk score was developed with the objective of creating a risk assessment tool that is both effective and convenient for use at patient presentation. With just a few important clinical factors, the risk score captures the majority of prognostic information available from more complex models among patients treated with reperfusion therapy.8 The discriminatory capacity of the model could be increased by inclusion of additional variables or more complex modeling, but at the cost of hindering practical application. Other well-validated models have been derived for the purpose of risk-adjusted analysis of hospital outcomes to direct quality improvement efforts.7,11 Such models have incorporated data acquired during hospitalization to provide high-discriminatory capacity with respect to long-term outcomes. In contrast, the TIMI risk score is based on clinical information that is available at the time of hospital arrival and, thus, is suitable for early risk stratification at the bedside without the need for a computer. The impact of differences in treatment, along with noninvasive and invasive data accrued during the course of hospitalization, should be considered by clinicians in a continuous process of updating the initial assessment of risk offered by the TIMI risk score.

Sufficiently simple to be practical at the bedside and effective for risk assessment across a heterogeneous spectrum of patients, the TIMI risk score may be clinically useful in the triage and treatment of patients with STEMI who undergo acute reperfusion therapy.

Maseri A, Rebuzzi AG, Cianflone D. Need for a composite risk stratification of patients with unstable coronary syndromes tailored to clinical practice.  Circulation.1997;96:4141-4142.
Fibrinolytic Therapy Trialists' Collaborative Group.  Indications for fibrinolytic therapy in suspected acute myocardial infarction.  Lancet.1994;343:311-322.
Becker RC, Burns M, Gore JM.  et al.  Early assessment and in-hospital management of patients with acute myocardial infarction at increased risk for adverse outcomes.  Am Heart J.1998;135:786-796.
Hochman JS, Sleeper LA, Webb JG.  et al.  Early revascularization in acute myocardial infarction complicated by cardiogenic shock.  N Engl J Med.1999;341:625-634.
Lee KL, Woodlief LH, Topol EJ.  et al.  Predictors of 30-day mortality in the era of reperfusion for acute myocardial infarction.  Circulation.1995;91:1659-1668.
Jacobs Jr DR, Kroenke C, Crow R.  et al.  PREDICT: a simple risk score for clinical severity and long-term prognosis after hospitalization for acute myocardial infarction or unstable angina: the Minnesota Heart Survey.  Circulation.1999;100:599-607.
Krumholz HM, Chen J, Wang Y, Radford MJ, Chen YT, Marciniak TA. Comparing AMI mortality among hospitals in patients 65 years of age and older.  Circulation.1999;99:2986-2992.
Morrow DA, Antman EM, Charlesworth A.  et al.  TIMI risk score for ST-elevation myocardial infarction: a convenient, bedside, clinical score for risk assessment at presentation: an InTIME II trial substudy.  Circulation.2000;102:2031-2037.
Rogers WJ, Bowlby LJ, Chandra NC.  et al.  Treatment of myocardial infarction in the United States (1990 to 1993): observations from the National Registry of Myocardial Infarction.  Circulation.1994;90:2103-2114.
Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve.  Radiology.1982;143:29-36.
Tu JV, Austin PC, Walld R.  et al.  Development and validation of the Ontario acute myocardial infarction mortality prediction rules.  J Am Coll Cardiol.2001;37:992-997.

Figures

Figure. Prediction of In-Hospital Mortality With TIMI Risk Score for STEMI
Graphic Jump Location
STEMI indicates ST-elevation myocardial infarction; NRMI 3, the National Registry of Myocardial Infarction 3. Data for the Intravenous nPA for Treatment of Infarcting Myocardium Early (InTIME II) trial are from Morrow.8

Tables

Table Graphic Jump LocationTable 1. Elements of the TIMI Risk Score*
Table Graphic Jump LocationTable 2. Baseline Characteristics of the NRMI 3 Validation and InTIME II Derivation Sets*
Table Graphic Jump LocationTable 3. Adjusted Mortality Risk Relationships in NRMI 3 vs InTIME II*

References

Maseri A, Rebuzzi AG, Cianflone D. Need for a composite risk stratification of patients with unstable coronary syndromes tailored to clinical practice.  Circulation.1997;96:4141-4142.
Fibrinolytic Therapy Trialists' Collaborative Group.  Indications for fibrinolytic therapy in suspected acute myocardial infarction.  Lancet.1994;343:311-322.
Becker RC, Burns M, Gore JM.  et al.  Early assessment and in-hospital management of patients with acute myocardial infarction at increased risk for adverse outcomes.  Am Heart J.1998;135:786-796.
Hochman JS, Sleeper LA, Webb JG.  et al.  Early revascularization in acute myocardial infarction complicated by cardiogenic shock.  N Engl J Med.1999;341:625-634.
Lee KL, Woodlief LH, Topol EJ.  et al.  Predictors of 30-day mortality in the era of reperfusion for acute myocardial infarction.  Circulation.1995;91:1659-1668.
Jacobs Jr DR, Kroenke C, Crow R.  et al.  PREDICT: a simple risk score for clinical severity and long-term prognosis after hospitalization for acute myocardial infarction or unstable angina: the Minnesota Heart Survey.  Circulation.1999;100:599-607.
Krumholz HM, Chen J, Wang Y, Radford MJ, Chen YT, Marciniak TA. Comparing AMI mortality among hospitals in patients 65 years of age and older.  Circulation.1999;99:2986-2992.
Morrow DA, Antman EM, Charlesworth A.  et al.  TIMI risk score for ST-elevation myocardial infarction: a convenient, bedside, clinical score for risk assessment at presentation: an InTIME II trial substudy.  Circulation.2000;102:2031-2037.
Rogers WJ, Bowlby LJ, Chandra NC.  et al.  Treatment of myocardial infarction in the United States (1990 to 1993): observations from the National Registry of Myocardial Infarction.  Circulation.1994;90:2103-2114.
Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve.  Radiology.1982;143:29-36.
Tu JV, Austin PC, Walld R.  et al.  Development and validation of the Ontario acute myocardial infarction mortality prediction rules.  J Am Coll Cardiol.2001;37:992-997.
CME
Meets CME requirements for:
Browse CME for all U.S. States
Accreditation Information
The American Medical Association is accredited by the Accreditation Council for Continuing Medical Education to provide continuing medical education for physicians. The AMA designates this journal-based CME activity for a maximum of 1 AMA PRA Category 1 CreditTM per course. Physicians should claim only the credit commensurate with the extent of their participation in the activity. Physicians who complete the CME course and score at least 80% correct on the quiz are eligible for AMA PRA Category 1 CreditTM.
Note: You must get at least of the answers correct to pass this quiz.
You have not filled in all the answers to complete this quiz
The following questions were not answered:
Sorry, you have unsuccessfully completed this CME quiz with a score of
The following questions were not answered correctly:
Commitment to Change (optional):
Indicate what change(s) you will implement in your practice, if any, based on this CME course.
Your quiz results:
The filled radio buttons indicate your responses. The preferred responses are highlighted
For CME Course: A Proposed Model for Initial Assessment and Management of Acute Heart Failure Syndromes
Indicate what changes(s) you will implement in your practice, if any, based on this CME course.
NOTE:
Citing articles are presented as examples only. In non-demo SCM6 implementation, integration with CrossRef’s "Cited By" API will populate this tab (http://www.crossref.org/citedby.html).

Multimedia

Some tools below are only available to our subscribers or users with an online account.

Web of Science® Times Cited: 106

Related Content

Customize your page view by dragging & repositioning the boxes below.

Articles Related By Topic
Related Topics
JAMAevidence.com

Users' Guides to the Medical Literature
Clinical Resolution

Users' Guides to the Medical Literature
Clinical Scenario