Skip Navigation
American College of Physicians Logo
  • Subscribe
  • Submit a Manuscript
  • Sign In
    Sign in below to access your subscription for full content
    INDIVIDUAL SIGN IN
    Sign In|Set Up Account
    You will be directed to acponline.org to register and create your Annals account
    INSTITUTIONAL SIGN IN
    Open Athens|Shibboleth|Log In
    Annals of Internal Medicine
    SUBSCRIBE
    Subscribe to Annals of Internal Medicine.
    You will be directed to acponline.org to complete your purchase.
Annals of Internal Medicine Logo Menu
  • Latest
  • Issues
  • Channels
  • CME/MOC
  • In the Clinic
  • Journal Club
  • Web Exclusives
  • Author Info
Advanced Search
  • ‹ PREV ARTICLE
  • This Issue
  • NEXT ARTICLE ›
Editorials |1 September 2009

Toward Reuse of Clinical Data for Research and Quality Improvement: The End of the Beginning? Free

Mark G. Weiner, MD; Peter J. Embi, MD, MS

Mark G. Weiner, MD

Peter J. Embi, MD, MS

Article, Author, and Disclosure Information
Author, Article, and Disclosure Information
Grant Support: Dr. Weiner's contributions were supported in part by the Agency for Healthcare Quality and Research (5-R18-HS-017099-02, “Crossing the Quality Assessment Chasm: Aligning Measured and True Quality of Care”) and the National Center for Research Resources, National Institutes of Health (1-UL1-RR-024134-04, Institutional Clinical and Translational Science Award). Dr. Embi's contributions were supported in part by the National Center for Research Resources, National Institutes of Health (1-UL1-RR-026314-01, Institutional Clinical and Translational Science Award) and the National Library of Medicine, National Institutes of Health (1-R01-LM-009533-01A1, “Evaluating EHR-based, Point-of-Care Trial Recruitment Across Clinical Settings”).
Potential Financial Conflicts of Interest:Grants received: M.G. Weiner (National Heart, Lung, and Blood Institute).
Requests for Single Reprints: Mark G. Weiner, MD, University of Pennsylvania, 423 Guardian Drive, Room 1116, Philadelphia, PA 19104; e-mail, mweiner@mail.med.upenn.edu.
Current Author Addresses: Dr. Weiner: University of Pennsylvania, 423 Guardian Drive, Room 1116, Philadelphia, PA 19104.
Dr. Embi: University of Cincinnati, 231 Albert Sabin Way, Box 670840, Cincinnati, OH 45267.
  • From University of Pennsylvania, Philadelphia, PA 19104, and University of Cincinnati, Cincinnati, OH 45267.
×
  • ‹ PREV ARTICLE
  • This Issue
  • NEXT ARTICLE ›
Jump To
  • Full Article
  • FULL ARTICLE
  • FULL ARTICLE
      1. References
  • Figures
  • Tables
  • Supplements
  • Audio/Video
  • Summary for Patients
  • Clinical Slide Sets
  • CME / MOC
  • Comments
  • Twitter Link
  • Facebook Link
  • Email Link
More
  • LinkedIn Link
Today's health information technology (HIT) landscape provides an unprecedented convergence of comprehensive electronic health records, robust computational processing power, data-sharing capabilities, and emerging financial incentives that favor the widespread adoption and meaningful use of such systems. Even as the primary value proposition for HIT adoption by clinical practices remains a matter of debate (1), 2 articles in this issue (2, 3) help to illustrate the potential for secondary benefits by discussing the value of distributed health data networks for improving research and health care quality.
The multiple goals of population health, pharmaceutical surveillance, comparative effectiveness research, and other major initiatives being advanced to address the needs of our health care and research enterprises have created a growing need for access to high-quality, patient-level health information. One approach to enabling such access is the creation of centralized repositories to which data can be transferred and then readily accessed to answer questions, an approach that certainly has its merits. Alternatively, the distributed health data networks described in this issue can be designed with appropriate methods, policies, and systems to enable access and use of data housed in their original, disparate locations. As Maro and colleagues point out (2), a distributed approach has potential advantages—given today's regulatory, economic, and cultural realities—and the technological capabilities to enable such an approach exist today. Why, then, do we not see more widespread use of such systems?
The history of HIT successes and failures indicates that the technological challenges involved often pale in comparison with the many socio-organizational issues that must be understood and addressed to enable HIT advances (4). Any visitor to a local technology superstore knows how easy and inexpensive it is to collect and store vast amounts of data—the equivalent of thousands of patient records—in a device that fits as easily in a shirt pocket today as a 1.44-megabyte floppy disk did in 1990. However, the ease of information dissemination this capability enables appropriately raises personal privacy and intellectual property concerns. Adequate funding is another important factor to the success of HIT initiatives; however, funding alone does not guarantee success. One need only look at the many recent examples of failed regional health information organizations—and their successful counterparts—to appreciate the importance of effective governance structures, regulatory policies, and properly aligned organizational incentives in establishing and sustaining an effective distributed health data network (5).
In addition to these prerequisites, developers and those who attempt to leverage HIT resources have recognized even more fundamental issues inherent to reusing clinical data. Although systems to enable clinical research from large health information collections have been around for some time (6–9), they have often been criticized because the quality and comprehensiveness of the clinical data were not up to research standards or the analytical methods used to overcome these limitations were inadequate to overcome systematic biases inherent to data collected primarily for clinical care (10–12).
Has data quality improved since the time of these earlier systems? In recent years, increased data capture in electronic systems, improvements in the speed and standardization of data transfers between systems, and the ability to leverage data from multiple clinical sources (such as objective test results or therapeutic information) have reduced the oft-criticized reliance on administrative and billing data sources. However, no purely technical solution can overcome the capture of inaccurate information by the user of a clinical information system. As such, nontechnical innovations that help improve the accuracy of recorded information and incentivize consistently accurate data collection are critical to the success of research initiatives that rely on the presence of such data.
Is data capture more comprehensive now than in the earlier systems? Comprehensive data capture all relevant exposures and outcomes, features that are essential to meaningful comparative effectiveness assessments. Within a single health system, improved technology has facilitated the automated capture of more comprehensive data in electronic form, which minimizes the need for laborious manual data extraction from paper charts. However, many patients receive care across several health systems and alternative health care settings, such that a single, comprehensive, longitudinal record rarely exists for any given patient. Unfortunately, the goal of widespread information system interoperability—to enable integrated health information access that spans different health systems and vendor products—remains elusive. Achieving interoperability and ensuring adherence to common standards will be critical to the success of secondary-use initiatives (13). Without it, distributed data access could have limited value—or lead to misinterpretation of the prevalence of and relationships between exposures and outcomes.
Finally, have the methods for analyzing routinely collected clinical data improved? The process of clinical care introduces treatment bias, in which the statistical association between therapy and outcome is confounded by measured and unmeasured factors that influence both the choice of treatment and the likelihood of the outcome. Instrumental variable and propensity score analyses, which have been applied for years in the social sciences, and new methods, such as prior-event rate ratios (14), are increasingly being applied in the medical domain to overcome treatment biases, with variable degrees of success and acceptance. Understanding the clinical circumstances and types of research questions for which these methods may yield valid results—perhaps even consistent with those of traditional clinical studies—requires simulations, sensitivity analyses, and validation against the findings of randomized trials.
The promises of our current HIT environment are clearly great and growing. The efforts of biomedical informaticians, health services researchers, biostatisticians, and others have significantly advanced our knowledge of how to collect, organize, retrieve, analyze, and apply health data to improve individual patient care, as well as for such additional purposes as population health and biomedical research. However, significant collaborative effort by many of the stakeholders involved, including health care institutions and clinicians, HIT vendors, researchers, informaticians, regulators and policymakers, payers, and patients, is required to realize the full promise of these resources. If history is any indication, fostering and nurturing this collaboration will be challenging and take some time. Nevertheless, as the 2 articles in this issue help illustrate, current technology and existing models of success have put us in a better position today than we have been in before to realize the promises of HIT to advance research and create a safer and more efficient health care enterprise. To quote Sir Winston Churchill, “This is not the end. It is not even the beginning of the end. But it is, perhaps, the end of the beginning.”
Mark G. Weiner, MD
University of Pennsylvania
Philadelphia, PA 19104
Peter J. Embi, MD, MS
University of Cincinnati
Cincinnati, OH 45267

References

  1. Blumenthal
    D
    .  
    Stimulating the adoption of health information technology.
    N Engl J Med
    2009
    360
    1477
    9
     PubMed
    CrossRef
  2. Maro
    JC
    ,  
    Platt
    R
    ,  
    Holmes
    JH
    ,  
    Strom
    BL
    ,  
    Hennessy
    S
    ,  
    Lazarus
    R
    .  et al. 
    Design of a national distributed health data network.
    Ann Intern Med
    2009
    151
    341
    4
  3. Pace
    WD
    ,  
    Cifuentes
    M
    ,  
    Valuck
    RJ
    ,  
    Staton
    EW
    ,  
    Brandt
    EC
    ,  
    West
    DR
    .  
    An electronic practice-based network for observational comparative effectiveness research.
    Ann Intern Med
    2009
    151
    338
    40
  4. Kaplan
    B
    ,  
    Harris-Salamone
    KD
    .  
    Health IT success and failure: recommendations from literature and an AMIA workshop.
    J Am Med Inform Assoc
    2009
    16
    291
    9
     PubMed
  5. Adler-Milstein
    J
    ,  
    McAfee
    AP
    ,  
    Bates
    DW
    ,  
    Jha
    AK
    .  
    The state of regional health information organizations: current activities and financing.
    Health Aff (Millwood)
    2008
    27
    w60
    9
     PubMed
  6. Johnson
    SB
    ,  
    Hripcsak
    G
    ,  
    Chen
    J
    ,  
    Clayton
    P
    .  
    Accessing the Columbia Clinical Repository.
    Proc Annu Symp Comput Appl Med Care
    1994
    281
    5
     PubMed
  7. Steib
    SA
    ,  
    Reichley
    RM
    ,  
    McMullin
    ST
    ,  
    Marrs
    KA
    ,  
    Bailey
    TC
    ,  
    Dunagan
    WC
    .  et al. 
    Supporting ad-hoc queries in an integrated clinical database.
    Proc Annu Symp Comput Appl Med Care
    1995
    62
    6
     PubMed
  8. Tierney
    WM
    ,  
    McDonald
    CJ
    .  
    Practice databases and their uses in clinical research.
    Stat Med
    1991
    10
    541
    57
     PubMed
  9. Safran
    C
    ,  
    Porter
    D
    ,  
    Lightfoot
    J
    ,  
    Rury
    CD
    ,  
    Underhill
    LH
    ,  
    Bleich
    HL
    .  et al. 
    ClinQuery: a system for online searching of data in a teaching hospital.
    Ann Intern Med
    1989
    111
    751
    6
     PubMed
  10. Hlatky
    MA
    .  
    Using databases to evaluate therapy.
    Stat Med
    1991
    10
    647
    52
     PubMed
  11. Byar
    DP
    .  
    Problems with using observational databases to compare treatments.
    Stat Med
    1991
    10
    663
    6
     PubMed
  12. McDonald
    CJ
    ,  
    Hui
    SL
    .  
    The analysis of humongous databases: problems and promises.
    Stat Med
    1991
    10
    511
    8
     PubMed
  13. Safran
    C
    ,  
    Bloomrosen
    M
    ,  
    Hammond
    WE
    ,  
    Labkoff
    S
    ,  
    Markel-Fox
    S
    ,  
    Tang
    PC
    .  et al. 
    Toward a national framework for the secondary use of health data: an American Medical Informatics Association White Paper.
    J Am Med Inform Assoc
    2007
    14
    1
    9
     PubMed
  14. Tannen
    RL
    ,  
    Weiner
    MG
    ,  
    Xie
    D
    .  
    Use of primary care electronic medical record database in drug efficacy research on cardiovascular outcomes: comparison of database and randomised controlled trial findings.
    BMJ
    2009
    338
    b81
     PubMed

Clinical Slide Sets

Terms of Use

The In the Clinic® slide sets are owned and copyrighted by the American College of Physicians (ACP). All text, graphics, trademarks, and other intellectual property incorporated into the slide sets remain the sole and exclusive property of the ACP. The slide sets may be used only by the person who downloads or purchases them and only for the purpose of presenting them during not-for-profit educational activities. Users may incorporate the entire slide set or selected individual slides into their own teaching presentations but may not alter the content of the slides in any way or remove the ACP copyright notice. Users may make print copies for use as hand-outs for the audience the user is personally addressing but may not otherwise reproduce or distribute the slides by any means or media, including but not limited to sending them as e-mail attachments, posting them on Internet or Intranet sites, publishing them in meeting proceedings, or making them available for sale or distribution in any unauthorized form, without the express written permission of the ACP. Unauthorized use of the In the Clinic slide sets will constitute copyright infringement.

This feature is available only to Registered Users

Subscribe/Learn More
Submit a Comment

0 Comments

PDF
Not Available
Citations
Citation

Weiner MG, Embi PJ. Toward Reuse of Clinical Data for Research and Quality Improvement: The End of the Beginning?. Ann Intern Med. 2009;151:359–360. doi: https://doi.org/10.7326/0003-4819-151-5-200909010-00141

Download citation file:

  • Ris (Zotero)
  • EndNote
  • BibTex
  • Medlars
  • ProCite
  • RefWorks
  • Reference Manager

© 2019

×
Permissions

Published: Ann Intern Med. 2009;151(5):359-360.

DOI: 10.7326/0003-4819-151-5-200909010-00141

58 Citations

See Also

An Electronic Practice-Based Network for Observational Comparative Effectiveness Research
Design of a National Distributed Health Data Network
View MoreView Less

Related Articles

Impact of Primary Care Intensive Management on High-Risk Veterans' Costs and Utilization: A Randomized Quality Improvement Trial
Annals of Internal Medicine; 168 (12): 846-854
Do Patient-Centered Medical Homes Enhance Patients' Medication Adherence? Findings on the Next Frontier in Quality Improvement
Annals of Internal Medicine; 166 (2): 146-147
In refractory chronic cough, physiotherapy plus speech and language therapy improved quality of life at 4 weeks
Annals of Internal Medicine; 166 (2): JC3
A Flawed Revision of the Common Rule
Annals of Internal Medicine; 165 (2): 143-144
View MoreView Less

Journal Club

In refractory chronic cough, physiotherapy plus speech and language therapy improved quality of life at 4 weeks
Annals of Internal Medicine; 166 (2): JC3
Review: Quality improvement strategies reduce HbA1c, LDL cholesterol, and BP in diabetes
Annals of Internal Medicine; 157 (8): JC4-11
In moderate-to-severe sciatica, pregabalin did not reduce leg pain intensity or improve quality of life
Annals of Internal Medicine; 167 (2): JC4
Long-term antibiotics after ceftriaxone did not improve quality of life in persistent Lyme disease
Annals of Internal Medicine; 165 (2): JC5
View MoreView Less

Related Topics

Healthcare Delivery and Policy

Healthcare Delivery and Policy.

PubMed Articles

Effectiveness of Prompt Mental Health Care, the Norwegian Version of Improving Access to Psychological Therapies: A Randomized Controlled Trial.
Psychother Psychosom 2019.
Learning No-Reference Quality Assessment of Multiply and Singly Distorted Images with Big Data.
IEEE Trans Image Process 2019.
View More

Results provided by: PubMed

CME/MOC Activity Requires Users to be Registered and Logged In.
Sign in below to access your subscription for full content
INDIVIDUAL SIGN IN
Sign In|Set Up Account
You will be directed to acponline.org to register and create your Annals account
Annals of Internal Medicine
CREATE YOUR FREE ACCOUNT
Create Your Free Account|Why?
To receive access to the full text of freely available articles, alerts, and more. You will be directed to acponline.org to complete your registration.
×
The Comments Feature Requires Users to be Registered and Logged In.
Sign in below to access your subscription for full content
INDIVIDUAL SIGN IN
Sign In|Set Up Account
You will be directed to acponline.org to register and create your Annals account
Annals of Internal Medicine
CREATE YOUR FREE ACCOUNT
Create Your Free Account|Why?
To receive access to the full text of freely available articles, alerts, and more. You will be directed to acponline.org to complete your registration.
×
link to top

Content

  • Home
  • Latest
  • Issues
  • Channels
  • CME/MOC
  • In the Clinic
  • Journal Club
  • Web Exclusives

Information For

  • Author Info
  • Reviewers
  • Press
  • Readers
  • Institutions / Libraries / Agencies
  • Advertisers

Services

  • Subscribe
  • Renew
  • Alerts
  • Current Issue RSS
  • Latest RSS
  • In the Clinic RSS
  • Reprints & Permissions
  • Contact Us
  • Help
  • About Annals
  • About Mobile
  • Patient Information
  • Teaching Tools
  • Annals in the News
  • Share Your Feedback

Awards and Cover

  • Personae (Cover Photo)
  • Junior Investigator Awards
  • Poetry Prize

Other Resources

  • ACP Online
  • Career Connection
  • ACP Advocate Blog
  • ACP Journal Wise

Follow Annals On

  • Twitter Link
  • Facebook Link
acp link acp
silverchair link silverchair

Copyright © 2019 American College of Physicians. All Rights Reserved.

Print ISSN: 0003-4819 | Online ISSN: 1539-3704

Privacy Policy

|

Conditions of Use

This site uses cookies. By continuing to use our website, you are agreeing to our privacy policy. | Accept
×

You need a subscription to this content to use this feature.

×
PDF Downloads Require Access to the Full Article.
Sign in below to access your subscription for full content
INDIVIDUAL SIGN IN
Sign In|Set Up Account
You will be directed to acponline.org to register and create your Annals account
INSTITUTIONAL SIGN IN
Open Athens|Shibboleth|Log In
Annals of Internal Medicine
PURCHASE OPTIONS
Buy This Article|Subscribe
You will be redirected to acponline.org to sign-in to Annals to complete your purchase.
CREATE YOUR FREE ACCOUNT
Create Your Free Account|Why?
To receive access to the full text of freely available articles, alerts, and more. You will be directed to acponline.org to complete your registration.
×
Access to this Free Content Requires Users to be Registered and Logged In. Please Choose One of the Following Options
Sign in below to access your subscription for full content
INDIVIDUAL SIGN IN
Sign In|Set Up Account
You will be directed to acponline.org to register and create your Annals account
Annals of Internal Medicine
CREATE YOUR FREE ACCOUNT
Create Your Free Account|Why?
To receive access to the full text of freely available articles, alerts, and more. You will be directed to acponline.org to complete your registration.
×