0
Commentary |

Safety Issues Involving Medical Devices: Title and subTitle BreakImplications of Recent Implantable Cardioverter-Defibrillator Malfunctions

William H. Maisel, MD, MPH
[+] Author Affiliations

Author Affiliation: Cardiovascular Division, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Mass.

More Author Information
JAMA. 2005;294(8):955-958. doi:10.1001/jama.294.8.955
Text Size: A A A
Published online

This past spring, Joshua Oukrop, a 21-year old Minnesota college student with familial hypertrophic cardiomyopathy, died of cardiac arrest when his implantable cardioverter-defibrillator (ICD) short-circuited and failed to resuscitate him.1 Guidant Corporation (Indianapolis, Ind), the maker of his ICD, was aware of the potential for this type of malfunction, having observed 26 similar failures out of 37 000 devices.1 - 2 The company, however, decided not to notify physicians of the flaw for more than 3 years after first detecting it.1 - 2 As implantations of complex electrophysiological devices become increasingly commonplace, the number of patients affected by defective devices can be expected to increase. Understanding the history of medical device regulation, the benefits and limitations of technology, the obligations of manufacturers, the expectations of physicians and patients, and the responsibilities of national physician and industry organizations can provide a framework for improving the medical device reporting and notification systems.

Prompted by a number of fatalities due to contaminated elixir of sulfanilamide, Congress enacted the Federal Food, Drug, and Cosmetic Act of 1938.3 This legislation charged the US Food and Drug Administration (FDA) with the task of establishing the safety of new drugs prior to their general distribution.4 The law required medical devices to bear accurate labeling and sufficient instructions for proper use but gave the FDA no authority to review devices before they were released to the market.4 FDA regulation of medical devices, therefore, was after-the-fact and required intervention primarily via the courts with injunctions, criminal actions, and civil seizures of product.4 Isolated efforts by the FDA to regulate some devices as drugs, which had more stringent controls, were time-consuming and ineffective.4

By the mid-1960s, close to 1300 medical device manufacturers shipped products with a total value that exceeded $1 billion.4 - 5 President Lyndon Baines Johnson’s administration introduced proposed legislation called the Medical Device Act of 1967, but it was not until almost a decade later, after several high-profile medical device safety questions arose, that Congress finally acted.4 Theodore Cooper, MD, PhD, then director of the National Heart and Lung Institute, chaired a committee that released a 1970 report documenting over 10 000 injuries attributable to medical devices, including 731 deaths.6 - 7 In 1974, the Dalkon Shield intrauterine device (A.H. Robins Co, Richmond, Va) was withdrawn from the market after reports of 209 second-trimester septic abortions and 11 maternal deaths.5 ,8

Ultimately, Congress enacted the Medical Device Amendments of 1976 to better enable the FDA to establish the safety and effectiveness of medical devices.5 The legislation was based on the concept that the degree of device regulation should correlate with device complexity and perceived risk.5 During the 1980s, however, manufacturers were criticized for inadequate reporting of adverse events to the FDA, and for failing to report or conduct recalls.5 As further evidence of inadequate postmarket surveillance, some cited the withdrawal of the mechanical Bjork-Shiley convexo-concave heart valve from the market due to premature strut failure that ultimately affected 633 patients and was fatal in two thirds of those cases.9 - 10

In response, Congress enacted the Safe Medical Devices Act of 1990, and the Medical Device Amendments of 1992.5 Postmarket surveillance was strengthened by requiring health care facilities to report device-related serious injuries or deaths, by establishing tracking of certain high-risk devices, and by giving the FDA authority to require tracking for any other device.5 Manufacturers were required to report to the FDA any device malfunction that causes, or could cause, significant injury to a patient.5 As a result of this legislation, the FDA has received numerous device-related adverse event reports, including approximately 160 487 reports submitted in 2004 alone.11 The vast majority of the reports are directly from manufacturers.11

The first human use of an ICD was reported in 1980.12 Subsequently, a number of well-conducted randomized clinical trials conclusively demonstrated that ICDs improve survival in select populations at high risk for sudden cardiac death.13 - 15 Today, ICDs are a multibillion-dollar industry with approximately 125 000 new patient implants annually in the United States.16

Like many technologies, ICDs have undergone remarkable changes in the 2 decades since initial FDA approval. Random access memory has increased 50-fold while device size has decreased by a factor of 8.17 Modern ICDs are implanted transvenously, provide physiologic pacing in up to 3 cardiac chambers, perform a number of automated functions and self-checks, and can deliver pacing or high-voltage therapies to treat life-threatening arrhythmias. A pacemaker-dependent ICD patient will receive more than 100 million paced beats over the device lifetime, a truly remarkable technological accomplishment.

Given the complexity of ICDs, it is not surprising that they occasionally malfunction. Several database registries have monitored the performance of ICDs in the past and have reported hundreds of device malfunctions affecting dozens of models.18 In addition, approximately 29 FDA safety alerts and recalls (collectively referred to as advisories) affecting nearly 337 000 ICDs have been issued since 1990.2 ,18 - 19 In June 2005 alone, Guidant reported additional ICD-related safety problems that resulted in the voluntary recall of approximately 62 000 ICDs.2 ,20 Malfunctions involving ICDs, however, are not unique to Guidant. Medtronic Inc (Minneapolis, Minn), St Jude Medical Inc (St Paul, Minn), Biotronik Inc (Oswego, Ore), and ELA Medical LLC (Plymouth, Minn) have also issued advisories and/or physician notification letters in 2005 involving close to 141 000 ICDs.19 ,21 - 22

These recent events highlight a number of shortcomings in the current device malfunction reporting and notification system and suggest a need for several important changes.

Manufacturers Should Annually Publish Detailed Data on Device Reliability. Remarkably, despite millions of ICD implants worldwide, public reporting of the number, type, and rates of malfunction have never been required of manufacturers. Previous calls to publicly report these data have gone unheeded.23 - 24 Product performance reports are provided by manufacturers25 - 27 but these publications do not include specific information regarding type, number, rate, or seriousness of device malfunctions. In addition, all malfunctions are not the same. A distinction should be made between a major malfunction that may preclude delivery of life-sustaining therapy, and a minor malfunction where the observed abnormality does not jeopardize life.

Detailed public reporting of medical device malfunctions and device reliability should be required by law to allow consumers, including physicians and patients, to make educated decisions about which product to choose. Public reporting would make safety a market force. Physicians and patients could choose products that have been documented as safe and reliable and avoid those that are less dependable. To maintain or increase market share, manufacturers would be forced to develop safer, more reliable devices. Ironically, consumers can learn more about the safety of the car they intend to purchase than they can about the reliability of their potentially life-saving ICD. Improved public device reliability reporting should remedy this inconsistency.

Manufacturers Should Publicly Report Every Confirmed Device Malfunction. Manufacturers are required to report to the FDA any device malfunction that causes or could cause significant injury.5 The decision for a manufacturer, however, of whether or not to notify physicians, patients, or the public about an observed malfunction is less straightforward. Historically, judgments have been made on a case-by-case basis by considering factors such as rate of malfunction, likelihood of patient injury, cause of device failure, and potential to mitigate the problem with an intervention. Because of the enormous financial consequences of the manufacturer’s decision, there is an inherent conflict of interest.

Some physicians argue that notification about every malfunction is too burdensome and results in significant physician liability. This argument, however, ignores the physician’s responsibility to act in the patient’s best interest. Public reporting does not necessarily need to be in the form of a direct physician or patient letter. Updated malfunction information, for example, could be provided on the manufacturer’s Web site. Direct physician notification, FDA advisories, and manufacturer press releases would be warranted for particularly important safety issues, such as observation of a recurrent malfunction, or identification of a product that does not meet expectations for reliability.

Physicians and Patients Should Be Educated to Have a More Realistic Expectation of Device Reliability. Accurate reporting of device malfunction rates would provide physicians and patients with a more realistic expectation of device reliability. Nearly one third of surveyed Heart Rhythm Society physicians reported that they would replace an ICD if the device had a 1 in 10 000 chance of failing.28 Yet, according to Guidant, a 1 in 10 000 failure rate exceeds the reliability of all known ICDs.29 This paradox is typical of the misperception of device reliability among physicians and patients.

Complicating matters further is the fact that it is often difficult for a manufacturer to estimate the true incidence of an observed malfunction.5 St Jude Medical, for example, issued an advisory in 2000 after a microprocessor anomaly was observed in 20 out of 144 000 Trilogy pacemakers.30 In response to this notification, an additional 350 problem devices were identified.30 The observed device failure rate will always be an underestimate of the true malfunction rate due to underreporting and patient deaths from unrecognized malfunction.

Patients Should Be Directly Notified About Safety Issues. If a patient’s medical device is recalled, the patient is not directly notified about the malfunction—the physician is. This contrasts with consumer product recalls, such as those affecting automobiles or children’s car seats, where the product owner is directly notified by the manufacturer. The outdated medical device notification system is rooted in the concept that medical information contained in a recall notice is too complex for a patient to understand. However, modern patients are knowledgeable, informed, and proactive, and they have the right to know about malfunctions or potential defects affecting their implantable device. Physician notification should remain in place and patients should be advised to seek the counsel of their physician when deciding on the clinical management of their recalled device. Ideally, a staged notification system would be initiated, whereby physicians are notified first and are given the opportunity to contact their patients. Patients would then be contacted directly to ensure that all those affected are notified.

National Physician and Medical Device Organizations Must Provide Guidance to Physicians, Patients, Regulators, and Industry. Even though an estimated 1 million pacemaker and ICD patients have been affected by device advisories in the past 15 years,2 ,18 - 19 no uniform standards for reporting and managing advisories have been developed.

The clinical decision of whether or not to replace a potentially defective device is a challenging one. The benefits of device replacement must be weighed carefully against the risks of replacement. In some cases, close follow-up without device replacement may be the best strategy. For example, the Telectronics Accufix pacing electrode was prone to fracture.31 On rare occasions, the lead fractured, perforated the heart or aorta, and caused death.31 Many patients underwent pacemaker lead extraction, although ultimately more patients were harmed by lead extraction than by the lead failure itself.31

In addition, expert physicians diverge on their clinical recommendations for many common advisory scenarios and do not always make the right choices.29 Evidence-based guidelines should be developed by the Heart Rhythm Society to assist physicians and patients in the clinical management of safety alerts and recalls. The Heart Rhythm Society has formed a task force on device performance and plans to convene a policy conference in the September 2005 to bring industry, regulators, clinicians, patient advocates, and the public together to develop guidelines for clinicians and industry. Other industry organizations, such as the Advanced Medical Technology Association (AdvaMed), the world’s largest medical technology association, will play critical roles in developing guidance for industry to ensure the prompt and effective notification of physicians, patients, and the public when malfunctions do occur.32

History teaches that device regulation and malfunction reporting experience recurrent growing pains as technologies evolve. Indeed, ICDs are a complex, life-sustaining technology and they are not unique in their potential to malfunction. It is inevitable that other complex implantable devices, such as left ventricular assist devices and total artificial hearts, will experience flaws that may result in device failure, patient morbidity, and mortality. Device safety issues will undoubtedly become more prevalent as physicians and patients increasingly rely on technological advances to treat medical conditions and prolong life. With expanding patient populations, more device implants, and increasing device complexity, it will be critical to ensure that continued advances do not come at the expense of decreased device reliability. The solution is not to refrain from developing these important products but rather to monitor device performance carefully, to report device malfunctions publicly, and to demand improvements in reliability as technologies mature.

Corresponding Author: William H. Maisel, MD, MPH, Cardiovascular Division, Beth Israel Deaconess Medical Center, 185 Pilgrim Rd, Baker 4, Boston, MA 02215 (wmaisel@bidmc.harvard.edu).

Financial Disclosures: None reported.

Disclaimer: Dr Maisel is the chair of the FDA Circulatory System Medical Devices Advisory Panel and a member of the Heart Rhythm Society Health Policy Committee. The opinions expressed herein are the personal views of the author and do not necessarily represent the policies, practices, positions, or opinions of the FDA or the Heart Rhythm Society.

Meier B. Maker of heart device kept flaw from doctors. New York Times. May 24, 2005:1
Guidant Corporation Web site.  Physician communications providing important safety information. Available at: http://www.guidant.com/physician_communications/. Accessed June 28, 2005
Burditt GM. The history of food law.  Food Drug Law J. 1995;50197-201
PubMed
Munsey RR. Trends and events in FDA regulation of medical devices over the last fifty years.  Food Drug Law J. 1995;50(spec)  163-177
PubMed
Maisel WH. Medical device regulation: an introduction for the practicing physician.  Ann Intern Med. 2004;140296-302
PubMed
Pilot LR, Waldmann DR. Food and Drug Administration Modernization Act of 1997: medical device provisions.  Food Drug Law J. 1998;53267-295
PubMed
Monsein LH. Primer on medical device regulation, part I: history and background.  Radiology. 1997;2051-9
PubMed
Pritchard WF, Carey RF. US Food and Drug Administration and regulation of medical devices in radiology.  Radiology. 1997;20527-36
PubMed
O’Neill WW, Chandler JG, Gordon RE.  et al.  Radiographic detection of strut separations in Bjork-Shiley convexo-concave mitral valves.  N Engl J Med. 1995;333414-419
PubMed
Blot WJ, Ibrahim MA, Ivey TD.  et al.  Twenty-five-year experience with the Bjork-Shiley convexoconcave heart valve: a continuing clinical concern.  Circulation. 2005;1112850-2857
PubMed
US Department of Health and Human Services.  Center for Device and Radiologic Health (CDRH) FY 2004 annual report. Available at: http://www.fda.gov/cdrh/annual/fy2004/. Accessed July 13, 2005
Mirowski M, Reid PR, Mower MM.  et al.  Termination of malignant ventricular arrhythmias with an implantable automatic defibrillator in human beings.  N Engl J Med. 1980;303322-324
PubMed
Antiarrhythmics Versus Implantable Defibrillator (AVID) Investigators.  A comparison of antiarrhythmic-drug therapy with implantable defibrillators in patients resuscitated from near-fatal ventricular arrhythmias.  N Engl J Med. 1997;3371576-1583
PubMed
Moss AJ, Zareba W, Hall WJ.  et al.  Prophylactic implantation of a defibrillator in patients with myocardial infarction and reduced ejection fraction.  N Engl J Med. 2002;346877-883
PubMed
Bardy GH, Lee KL, Mark DB.  et al. Sudden Cardiac Death in Heart Failure Trial (SCD-HeFT) Investigators.  Amiodarone or an implantable cardioverter-defibrillator for congestive heart failure.  N Engl J Med. 2005;352225-237
PubMed
St Jude Medical Center Web site.  St Jude Medical 1st quarter 2005 analyst presentation. Available at: http://www.sjm.com/documents/companyinformation/1qt2005anlaystpreso.ppt. Accessed July 13, 2005
Maisel WH. Cardiovascular device development: lessons learned from pacemaker and implantable cardioverter-defibrillator therapy.  Am J Ther. 2005;12183-185
PubMed
Maisel WH, Sweeney MO, Stevenson WG, Ellison KE, Epstein LM. Recalls and safety alerts involving pacemakers and implantable cardioverter-defibrillator generators.  JAMA. 2001;286793-799
PubMed
US Food and Drug Administration Web site.  FDA enforcement report index. Available at: http://www.fda.gov/opacom/Enforce.html. Accessed July 13, 2005
US Food and Drug Administration Web site.  FDA statement on Guidant Corporation’s worldwide physician communications. Available at: http://www.fda.gov/bbs/topics/NEWS/2005/NEW01192.html. Accessed June 28, 2005
St Jude Medical Web site.  St Jude Medical announces ICD software upgrade notification to physician customers. Available at: http://phx.corporate-ir.net/phoenix.zhtml?c=73836&p=irol-newsreleases#. Accessed June 28, 2005.
US Food and Drug Administration Web site.  Medtronic issues notification regarding certain implantable defibrillator models. Available at http://www.fda.gov/oc/po/firmrecalls/medtronic02_05.html. Accessed June 28, 2005
Maisel WH, Stevenson WG, Epstein LM. Safety of implantable cardiac devices [letter].  JAMA. 2002;287839-840
PubMed
Stanton M. Safety of implantable cardiac devices [letter].  JAMA. 2002;287839
PubMed
Medtronic Web site.  Medtronic CRM Product Performance Report: 2004 2nd Edition. Available at: http://www.medtronic.com/crm/performance/downloads/mdt_prod_performance_2004_2_en.pdf. Accessed May 21, 2005
Guidant Corporation Web site.  Guidant cardiac rhythm management product performance report. Available at: http://www.guidant.com/physician/2004_crm_performance_report.pdf. Accessed May 21, 2005
St Jude Medical Web site.  St Jude Medical product performance report cardiac rhythm management: September 2004. Available at: http://www.sjm.com/documents/productperfreport.pdf. Accessed May 21, 2005
Maisel WH. Physician management of pacemaker and implantable cardioverter-defibrillator advisories.  Pacing Clin Electrophysiol. 2004;27437-442
PubMed
 ICD/Pacer advisory standards should be developed–FDA panel chair.  Medical Devices, Diagnostics & Instrumentation. 2005;315-6
Levine PA, Stanton MS, Sims JJ. High quality performance of pacemakers and implantable defibrillators.  Pacing Clin Electrophysiol. 2002;251667-1669
PubMed
Maisel WH, Stevenson WG, Epstein LM. Changing trends in pacemaker and implantable-cardioverter defibrillator generator advisories.  Pacing Clin Electrophysiol. 2002;251670-1678
PubMed
AdvaMed Web site.  AdvaMed supports prompt and effective notification of physicians, patients, and public. Available at: http://www.advamed.org/publicdocs/PR-279.htm. Accessed June 28, 2005

First Page Preview

First page PDF preview

Figures

Tables

Interactive Graphics

Video

Country-Specific Mortality and Growth Failure in Infancy and Yound Children and Association With Material Stature

Use interactive graphics and maps to view and sort country-specific infant and early dhildhood mortality and growth failure data and their association with maternal

Meier B. Maker of heart device kept flaw from doctors. New York Times. May 24, 2005:1
Guidant Corporation Web site.  Physician communications providing important safety information. Available at: http://www.guidant.com/physician_communications/. Accessed June 28, 2005
Burditt GM. The history of food law.  Food Drug Law J. 1995;50197-201
PubMed
Munsey RR. Trends and events in FDA regulation of medical devices over the last fifty years.  Food Drug Law J. 1995;50(spec)  163-177
PubMed
Maisel WH. Medical device regulation: an introduction for the practicing physician.  Ann Intern Med. 2004;140296-302
PubMed
Pilot LR, Waldmann DR. Food and Drug Administration Modernization Act of 1997: medical device provisions.  Food Drug Law J. 1998;53267-295
PubMed
Monsein LH. Primer on medical device regulation, part I: history and background.  Radiology. 1997;2051-9
PubMed
Pritchard WF, Carey RF. US Food and Drug Administration and regulation of medical devices in radiology.  Radiology. 1997;20527-36
PubMed
O’Neill WW, Chandler JG, Gordon RE.  et al.  Radiographic detection of strut separations in Bjork-Shiley convexo-concave mitral valves.  N Engl J Med. 1995;333414-419
PubMed
Blot WJ, Ibrahim MA, Ivey TD.  et al.  Twenty-five-year experience with the Bjork-Shiley convexoconcave heart valve: a continuing clinical concern.  Circulation. 2005;1112850-2857
PubMed
US Department of Health and Human Services.  Center for Device and Radiologic Health (CDRH) FY 2004 annual report. Available at: http://www.fda.gov/cdrh/annual/fy2004/. Accessed July 13, 2005
Mirowski M, Reid PR, Mower MM.  et al.  Termination of malignant ventricular arrhythmias with an implantable automatic defibrillator in human beings.  N Engl J Med. 1980;303322-324
PubMed
Antiarrhythmics Versus Implantable Defibrillator (AVID) Investigators.  A comparison of antiarrhythmic-drug therapy with implantable defibrillators in patients resuscitated from near-fatal ventricular arrhythmias.  N Engl J Med. 1997;3371576-1583
PubMed
Moss AJ, Zareba W, Hall WJ.  et al.  Prophylactic implantation of a defibrillator in patients with myocardial infarction and reduced ejection fraction.  N Engl J Med. 2002;346877-883
PubMed
Bardy GH, Lee KL, Mark DB.  et al. Sudden Cardiac Death in Heart Failure Trial (SCD-HeFT) Investigators.  Amiodarone or an implantable cardioverter-defibrillator for congestive heart failure.  N Engl J Med. 2005;352225-237
PubMed
St Jude Medical Center Web site.  St Jude Medical 1st quarter 2005 analyst presentation. Available at: http://www.sjm.com/documents/companyinformation/1qt2005anlaystpreso.ppt. Accessed July 13, 2005
Maisel WH. Cardiovascular device development: lessons learned from pacemaker and implantable cardioverter-defibrillator therapy.  Am J Ther. 2005;12183-185
PubMed
Maisel WH, Sweeney MO, Stevenson WG, Ellison KE, Epstein LM. Recalls and safety alerts involving pacemakers and implantable cardioverter-defibrillator generators.  JAMA. 2001;286793-799
PubMed
US Food and Drug Administration Web site.  FDA enforcement report index. Available at: http://www.fda.gov/opacom/Enforce.html. Accessed July 13, 2005
US Food and Drug Administration Web site.  FDA statement on Guidant Corporation’s worldwide physician communications. Available at: http://www.fda.gov/bbs/topics/NEWS/2005/NEW01192.html. Accessed June 28, 2005
St Jude Medical Web site.  St Jude Medical announces ICD software upgrade notification to physician customers. Available at: http://phx.corporate-ir.net/phoenix.zhtml?c=73836&p=irol-newsreleases#. Accessed June 28, 2005.
US Food and Drug Administration Web site.  Medtronic issues notification regarding certain implantable defibrillator models. Available at http://www.fda.gov/oc/po/firmrecalls/medtronic02_05.html. Accessed June 28, 2005
Maisel WH, Stevenson WG, Epstein LM. Safety of implantable cardiac devices [letter].  JAMA. 2002;287839-840
PubMed
Stanton M. Safety of implantable cardiac devices [letter].  JAMA. 2002;287839
PubMed
Medtronic Web site.  Medtronic CRM Product Performance Report: 2004 2nd Edition. Available at: http://www.medtronic.com/crm/performance/downloads/mdt_prod_performance_2004_2_en.pdf. Accessed May 21, 2005
Guidant Corporation Web site.  Guidant cardiac rhythm management product performance report. Available at: http://www.guidant.com/physician/2004_crm_performance_report.pdf. Accessed May 21, 2005
St Jude Medical Web site.  St Jude Medical product performance report cardiac rhythm management: September 2004. Available at: http://www.sjm.com/documents/productperfreport.pdf. Accessed May 21, 2005
Maisel WH. Physician management of pacemaker and implantable cardioverter-defibrillator advisories.  Pacing Clin Electrophysiol. 2004;27437-442
PubMed
 ICD/Pacer advisory standards should be developed–FDA panel chair.  Medical Devices, Diagnostics & Instrumentation. 2005;315-6
Levine PA, Stanton MS, Sims JJ. High quality performance of pacemakers and implantable defibrillators.  Pacing Clin Electrophysiol. 2002;251667-1669
PubMed
Maisel WH, Stevenson WG, Epstein LM. Changing trends in pacemaker and implantable-cardioverter defibrillator generator advisories.  Pacing Clin Electrophysiol. 2002;251670-1678
PubMed
AdvaMed Web site.  AdvaMed supports prompt and effective notification of physicians, patients, and public. Available at: http://www.advamed.org/publicdocs/PR-279.htm. Accessed June 28, 2005
CME Course for:


You need to register in order to view this quiz.


To understand the clinical management of acute heart failure syndromes.
Accreditation Information The American Medical Association is accredited by the Accreditation Council for Continuing Medical Education to provide continuing medical education for physicians.
The AMA designates this journal-based CME activity for a maximum of 1 AMA PRA Category 1 CreditTM per course. Physicians should claim only the credit commensurate with the extent of their participation in the activity.
Physicians who complete the CME course and score at least 80% correct on the quiz are eligible for AMA PRA Category 1 CreditTM.
Note: You must get at least of the answers correct to pass this quiz.
Note: You must get at least of the answers correct to pass this quiz.
You have not filled in all the answers to complete this quiz
The following questions were not answered:
Sorry, you have unsuccessfully completed this CME quiz with a score of
The following questions were not answered correctly:
For CME Course: A Proposed Model for Initial Assessment and Management of Acute Heart Failure Syndromes
Indicate what changes(s) you will implement in your practice, if any, based on this CME course.
To view and print your certificate and access a summary of your CME courses go to My CME.
NOTE:
Citing articles are presented as examples only. In non-demo SCM6 implementation, integration with CrossRef’s “Cited By” API will populate this tab (http://www.crossref.org/citedby.html).
Submit a Response

Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging & repositioning the boxes below.

Articles Related By Topic
Related Topics
PubMed Articles