The Glass Cage: Automation and Us (14 page)

Other studies back up the latest RAND conclusions. Although EMR systems are becoming common in the United States, and have been common in other countries, such as the United Kingdom and Australia, for years, evidence of their benefits remains elusive. In a broad 2011 review, a team of British public-health researchers examined more than a hundred recently published studies of computerized medical systems. They concluded that when it comes to patient care and safety, there’s “a vast gap between the theoretical and empirically demonstrated benefits.” The research that has been used to promote the adoption of the systems, the scholars found, is “weak and inconsistent,” and there is “insubstantial evidence to support the cost-effectiveness of these technologies.” As for electronic medical records in particular, the investigators reported that the existing research is inconclusive and provides “only anecdotal evidence of the fundamental expected benefits and risks.”
⁶
Some other researchers offer slightly sunnier assessments. Another 2011 literature review, by Department of Health and Human Services staffers, found that “a large majority of the recent studies show measurable benefits emerging from the adoption of health information technology.” But noting the limitations of the existing research, they also concluded that “there is only suggestive evidence that more advanced systems or specific health IT components facilitate greater benefits.”
⁷
To date, there is no strong empirical support for claims that automating medical record keeping will lead to major reductions in health-care costs or significant improvements in the well-being of patients.

But if doctors and patients have seen few benefits from the scramble to automate record keeping, the companies that supply the systems have profited. Cerner Corporation, a medical software outfit, saw its revenues triple, from $1 billion to $3 billion, between 2005 and 2013. Cerner, as it happens, was one of five corporations that provided RAND with funding for the original 2005 study. The other sponsors, which included General Electric and Hewlett Packard, also have substantial business interests in health-care automation. As today’s flawed systems are replaced or upgraded in the future, to fix their interoperability problems and other shortcomings, information technology companies will reap further windfalls.

T
HERE’S NOTHING
unusual about this story. A rush to install new and untested computer systems, particularly when spurred by grand claims from technology companies and analysts, almost always produces great disappointments for the buyers and great profits for the sellers. That doesn’t mean that the systems are doomed to be a bust. As bugs are worked out, features refined, and prices cut, even overhyped systems can eventually save companies a lot of money, not least by reducing their need to hire wage-earning workers. (The investments are, of course, far more likely to generate attractive returns when businesses are spending taxpayer money rather than their own.) This historical pattern seems likely to unfold again with EMR applications and related systems. As physicians and hospitals continue to computerize their record keeping and other operations—the generous government subsidies are still flowing—demonstrable efficiency gains may be achieved in some areas, and the quality of care may well improve for some patients, particularly when that care requires the coordinated efforts of several specialists. The fragmentation and cloistering of patient data are real problems in medicine, which well-designed, standardized information systems can help fix.

Beyond standing as yet another cautionary tale about rash investments in unproven software, the original RAND report, and the reaction to it, provide deeper lessons. For one thing, the projections of “computer simulation models” should always be viewed with skepticism. Simulations are also simplifications; they replicate the real world only imperfectly, and their outputs often reflect the biases of their creators. More important, the report and its aftermath reveal how deeply the substitution myth is entrenched in the way society perceives and evaluates automation. The RAND researchers assumed that beyond the obvious technical and training challenges in installing the systems, the shift from writing medical reports on paper to composing them with computers would be straightforward. Doctors, nurses, and other caregivers would substitute an automated method for a manual method, but they wouldn’t significantly change how they practice medicine. In fact, studies show that computers can “profoundly alter patient care workflow processes,” as a group of doctors and academics reported in the journal
Pediatrics
in 2006. “Although the intent of computerization is to improve patient care by making it safer and more efficient, the adverse effects and unintended consequences of workflow disruption may make the situation far worse.”
⁸

Falling victim to the substitution myth, the RAND researchers did not sufficiently account for the possibility that electronic records would have ill effects along with beneficial ones—a problem that plagues many forecasts about the consequences of automation. The overly optimistic analysis led to overly optimistic policy. As the physicians and medical professors Jerome Groopman and Pamela Hartzband noted in a withering critique of the Obama administration’s subsidies, the 2005 RAND report “essentially ignore[d] downsides to electronic medical records” and also discounted earlier research that failed to find benefits in shifting from paper to digital records.
⁹
RAND’s assumption that automation would be a substitute for manual work proved false, as human-factors experts would have predicted. But the damage, in wasted taxpayer money and misguided software installations, was done.

EMR systems are used for more than taking and sharing notes. Most of them incorporate decision-support software that, through on-screen checklists and prompts, provides guidance and suggestions to doctors during the course of consultations and examinations. The EMR information entered by the doctor then flows into the administrative systems of the medical practice or hospital, automating the generation of bills, prescriptions, test requests, and other forms and documents. One of the unexpected results is that physicians often end up billing patients for more and more costly services than they would have before the software was installed. As a doctor fills out a computer form during an examination, the system automatically recommends procedures—checking the eyes of a diabetes patient, say—that the doctor might want to consider performing. By clicking a checkbox to verify the completion of the procedure, the doctor not only adds a note to the record of the visit, but in many cases also triggers the billing system to add a new line item to the bill. The prompts may serve as useful reminders, and they may, in rare cases, prevent a doctor from overlooking a critical component of an exam. But they also inflate medical bills—a fact that system vendors have not been shy about highlighting in their sales pitches.
¹⁰

Before doctors had software to prompt them, they were less likely to add an extra charge for certain minor procedures. The procedures were subsumed into more general charges—for an office visit, say, or a yearly physical. With the prompts, the individual charges get added to the invoice automatically. Just by making an action a little easier or a little more routine, the system alters the doctor’s behavior in a small but meaningful way. The fact that the doctor often ends up making more money by following the software’s lead provides a further incentive to defer to the system’s judgment. Some experts worry that the monetary incentive may be a little too strong. In response to press reports about the unforeseen increase in medical charges resulting from electronic records, the federal government launched, in October 2012, an investigation to determine whether the new systems were abetting systematic overbilling or even outright fraud in the Medicare program. A 2014 report from the Office of the Inspector General warned that “health care providers can use [EMR] software features that may mask true authorship of the medical record and distort information in the record to inflate health care claims.”
¹¹

There’s also evidence that electronic records encourage doctors to order unnecessary tests, which also ends up increasing rather than reducing the cost of care. One study, published in the journal
Health Affairs
in 2012, showed that when doctors are able to easily call up a patient’s past x-rays and other diagnostic images on a computer, they are more likely to order a new imaging test than if they lacked immediate access to the earlier images. Overall, doctors with computerized systems ordered new imaging tests in 18 percent of patient visits, while those without the systems ordered new tests in just 13 percent of visits. One of the common assumptions about electronic records is that by providing easy and immediate access to past test results, they would reduce the frequency of diagnostic testing. But this study indicates that, as its authors put it, “the reverse may be true.” By making it so easy to receive and review test results, the automated systems appear to “provide subtle encouragement to physicians to order more imaging studies,” the researchers argue. “In borderline situations, substituting a few keystrokes for the sometimes time-consuming task of tracking down results from an imaging facility may tip the balance in favor of ordering a test.”
¹²
Here again we see how automation changes people’s behavior, and the way work gets done, in ways that are virtually impossible to predict—and that may run directly counter to expectations.

T
HE INTRODUCTION
of automation into medicine, as with its introduction into aviation and other professions, has effects that go beyond efficiency and cost. We’ve already seen how software-generated highlights on mammograms alter, sometimes for better and sometimes for worse, the way radiologists read images. As physicians come to rely on computers to aid them in more facets of their everyday work, the technology is influencing the way they learn, the way they make decisions, and even their bedside manner.

A study of primary-care physicians who adopted electronic records, conducted by Timothy Hoff, a professor at SUNY’s University at Albany School of Public Health, reveals evidence of what Hoff terms “deskilling outcomes,” including “decreased clinical knowledge” and “increased stereotyping of patients.” In 2007 and 2008, Hoff interviewed seventy-eight physicians from primary-care practices of various sizes in upstate New York. Three-fourths of the doctors were routinely using EMR systems, and most of them said they feared computerization was leading to less thorough, less personalized care. The physicians using computers told Hoff that they would regularly “cut-and-paste” boilerplate text into their reports on patient visits, whereas when they dictated notes or wrote them by hand they “gave greater consideration to the quality and uniqueness of the information being read into the record.” Indeed, said the doctors, the very process of writing and dictation had served as a kind of “red flag” that forced them to slow down and “consider what they wanted to say.” The doctors complained to Hoff that the homogenized text of electronic records can diminish the richness of their understanding of patients, undercutting their “ability to make informed decisions around diagnosis and treatment.”
¹³

Doctors’ growing reliance on the recycling, or “cloning,” of text is a natural outgrowth of the adoption of electronic records. EMR systems change the way clinicians take notes just as, years ago, the adoption of word-processing programs changed the way writers write and editors edit. The traditional practices of dictation and composition, whatever their benefits, come to feel slow and cumbersome when forced to compete with the ease and speed of cut-and-paste, drag-and-drop, and point-and-click. Stephen Levinson, a physician and the author of a standard textbook on medical record keeping and billing, sees extensive evidence of the rote reuse of old text in new records. As doctors employ computers to take notes on patients, he says, “records of every visit read almost word for word the same except for minor variations confined almost exclusively to the chief complaint.” While such “cloned documentation” doesn’t “make sense clinically” and “doesn’t satisfy the patient’s needs,” it nevertheless becomes the default method simply because it is faster and more efficient—and, not least, because cloned text often incorporates lists of procedures that serve as another trigger for adding charges to patients’ bills.
¹⁴