Sie sind auf Seite 1von 16

Clinical Review & Education

Special Communication | SCIENTIFIC DISCOVERY AND THE FUTURE OF MEDICINE

The Anatomy of Medical Research


US and International Comparisons
Hamilton Moses III, MD; David H. M. Matheson, JD, MBA; Sarah Cairns-Smith, PhD; Benjamin P. George, MD, MPH;
Chase Palisch, MPhil; E. Ray Dorsey, MD, MBA

Editorials pages 143 and 145


IMPORTANCE Medical research is a prerequisite of clinical advances, while health service Supplemental content at
research supports improved delivery, access, and cost. Few previous analyses have compared jama.com
the United States with other developed countries.

OBJECTIVES To quantify total public and private investment and personnel (economic inputs)
and to evaluate resulting patents, publications, drug and device approvals, and value created
(economic outputs).

EVIDENCE REVIEW Publicly available data from 1994 to 2012 were compiled showing trends
in US and international research funding, productivity, and disease burden by source and
industry type. Patents and publications (1981-2011) were evaluated using citation rates and
impact factors.

FINDINGS (1) Reduced science investment: Total US funding increased 6% per year
(1994-2004), but rate of growth declined to 0.8% per year (2004-2012), reaching $117 billion
(4.5%) of total health care expenditures. Private sources increased from 46% (1994) to 58%
(2012). Industry reduced early-stage research, favoring medical devices, bioengineered
drugs, and late-stage clinical trials, particularly for cancer and rare diseases. National Insitutes
of Health allocations correlate imperfectly with disease burden, with cancer and HIV/AIDS
receiving disproportionate support. (2) Underfunding of service innovation: Health services
research receives $5.0 billion (0.3% of total health care expenditures) or only 1/20th of
science funding. Private insurers ranked last (0.04% of revenue) and health systems 19th
(0.1% of revenue) among 22 industries in their investment in innovation. An increment of
$8 billion to $15 billion yearly would occur if service firms were to reach median research
and development funding. (3) Globalization: US government research funding declined from
57% (2004) to 50% (2012) of the global total, as did that of US companies (50% to 41%),
with the total US (public plus private) share of global research funding declining from 57% to
44%. Asia, particularly China, tripled investment from $2.6 billion (2004) to $9.7 billion
(2012) preferentially for education and personnel. The US share of life science patents
declined from 57% (1981) to 51% (2011), as did those considered most valuable, from 73%
(1981) to 59% (2011).

CONCLUSIONS AND RELEVANCE New investment is required if the clinical value of past
scientific discoveries and opportunities to improve care are to be fully realized. Sources could
include repatriation of foreign capital, new innovation bonds, administrative savings, patent
Author Affiliations: The Alerion
pools, and public-private risk sharing collaborations. Given international trends, the United Institute and Alerion Advisors LLC,
States will relinquish its historical international lead in the next decade unless such measures North Garden, Virginia (Moses);
are undertaken. Johns Hopkins School of Medicine,
Baltimore, Maryland (Moses); Boston
Consulting Group, Boston,
Massachusetts (Matheson, Cairns-
Smith, Palisch); University of
Rochester School of Medicine,
Rochester, New York (George,
Dorsey); Stanford University School
of Medicine, Stanford, California
(Palisch).
Corresponding Author: Hamilton
Moses III, MD, Alerion, PO Box 150,
North Garden, VA 22959
JAMA. 2015;313(2):174-189. doi:10.1001/jama.2014.15939 (hm@alerion.us).

174 (Reprinted) jama.com

Copyright 2014 American Medical Association. All rights reserved.

Downloaded From: http://jama.jamanetwork.com/ by a Pontificia Universidad Javerian User on 12/14/2015


The Anatomy of Medical Research Special Communication Clinical Review & Education

T
he promise of new drugs, vaccines, medical procedures, and gest remedies for the various stakeholders to explore as they seek
devices captures the imaginations of the public, scien- greater benefit for their investment.
tists, and physicians alike. For the last century, medical re-
search, including public health advances, has been the primary source
of and an essential contributor to improvement in the health and lon-
Key Questions
gevity of individuals and populations in developed countries. The
United States has historically been where research has found the We address 3 major trends:
greatest support and has generated more than half the worlds fund- 1. Diminished funding in the United States from both public and pri-
ing for many decades. Although US-based companies, founda- vate sponsors at a time when scientific opportunity has never
tions, and public agencies have sponsored most research, that re- been greater but when support for sustained, long-term invest-
search is conducted by an array of autonomous university ments is limited and short-term performance is rewarded dis-
laboratories, study groups, and coalitions of researchers. This orga- proportionately
nization contrasts with that found in most other countries, where 2. Establishing strong incentives for investment in health service and
government laboratories are predominant and where health sys- delivery innovations and better ways to deliver care
tems and insurers conduct and finance service innovations di- 3. The implications of globalization
rectly. Better understanding of these factors is required if the full prom-
Expectations for medical research vary sharply, depending on ise of the cumulative investment in biomedical science and oppor-
the observers perspective. For a patient affected by disease, it is a tunity for improved services are to be realized.
source of hope. For a parent of a child with a serious condition, it Information in 8 areas has been assembled to inform the dis-
evokes both expectation and frustration over the pace of progress. cussion (Figure 1). Two areas involve the current and historical land-
Where a physician may seek a route to better care, an economist sees scape in the United States of investment and employment in medi-
an engine of growth and a politician sees high-skill jobs and im- cal research, placing the United States in an international context.
proved national competitiveness. Hospital executives expect re- Two areas examine funding on biomedical and health services re-
search to spawn new services, whereas pharmaceutical CEOs must search separately. Four areas quantify the value of that investment
have new products. An insurance executive doubts instinctively that as judged by resulting patents, publications, drug and device ap-
the value of research will outweigh its incremental cost. A regula- provals, and public market performance of life science and health
tor aims for the appropriate amount of risk while still getting inno- service companies.
vations that matter to the market. For philanthropists and public
health campaigners, research represents the best hope for alleviat-
ing the worlds most immediate health-related problems. To a sci-
Methods
entist, research deepens critical knowledge and the way intelli-
gence and organized effort can improve health. All of these To describe and document the current anatomy and historical trends
constituents play a role in how research is funded and brought from of medical research, we assembled an array of information from vari-
bench to bedside. Meeting their collective needs produces a com- ous data sources. We relied on publicly available data, recalculated
plex set of hurdles. those data for display when necessary, reconciled inconsistent
This Special Communication examines developments over the sources, and included years for which data are complete (in gen-
past 2 decades in the pattern of who conducts and who supports eral, from 1994 to 2012). The Box contains a list of the included and
medical research, as well as resulting patents, publications, and new supplementary figures and tables.
drug and device approvals. We place the United States in an inter- Methods were similar to those we have used previously.1-3 Ad-
national context to understand the key forces of change and sug- ditionally, in this study, the 40 largest developed nations were ex-

Figure 1. The Anatomy of Medical Research: US and International Comparisons

Medical Research Funding Medical Research Activities Medical Research Output


Sources of funding Patents
Government, industry, International comparison
foundations, charities, Biomedical research of patenting activity
and universities Historical funding trends
Historical trends Funding by phase of Publications
International comparisons research International comparison
Funding by therapeutic area of publication activity

New drugs and devices


New drug and device
Science and Technology Health services research approvals by FDA and EMA
Workforce Historical funding trends
Industrial sector comparisons Market performance
Workforce size Health care sector
Historical trends performance compared
International comparisons EMA indicates European Medicines
with market average
Agency; FDA, US Food and Drug
Administration.

jama.com (Reprinted) JAMA January 13, 2015 Volume 313, Number 2 175

Copyright 2014 American Medical Association. All rights reserved.

Downloaded From: http://jama.jamanetwork.com/ by a Pontificia Universidad Javerian User on 12/14/2015


Clinical Review & Education Special Communication The Anatomy of Medical Research

Box. List of Included and Supplementary Figures and Tables

Included figures Supplementary figures and tables


Figure 1. The Anatomy of Medical Research: US and International eFigure 1. Historical Growth Trajectory of US Medical Research Fund-
Comparisons ing, 1994-2012
Figure 2. US Funding for Medical Research by Source, 1994- eFigure 2. Historical Trajectory of NIH Medical Research Funding,
2012 1994-2012
Figure 3. Growth in US Funding for Medical Research by Source, eFigure 3. Venture Capital Investment in Biotechnology Compa-
1994-2012 nies, 1995-2013
Figure 4. Pharmaceutical Industry Medical Research Funding by eFigure 4. Relationship Between NIH Disease-Specific Research
Phase of Research, 2004-2011 Funding and Burden of Disease for Selected Conditions
Figure 5. Medicines in Development for Top 10 Therapeutic Areas, eFigure 5. Growth in Global Medical Research Funding in Select Coun-
2013 tries/Regions, 2004-2011
Figure 6. US Funding for Health Services Research by Source, 2004- eFigure 6. Medical Research and Development Funding and Sci-
2011 ence and Technology Workforces in Select Countries/Regions, 2011
Figure 7. Research and Development Investment Ranking of Indus- eFigure 7. European Life Science Patent Applications by Country of
trial Sectors Among US-Based Companies, 2011 Origin, 1981-2011
Figure 8. Global Medical Research Funding in Select Countries/ eFigure 8. Highly Valuable European Life Science Patents by Coun-
Regions, 2011 try of Origin, 1981-2011
Figure 9. Top 10 Countries by Size of Science and Technology Work- eFigure 9. Comparison of New Approvals by US Food and Drug Ad-
force, 1996-2011 ministration and European Medicines Agency, 2003-2013
Figure 10. Global Life Science Patent Applications by Country of eTable 1. US Funding for Medical Research by Source, 1994-2012
Origin, 1981-2011 eTable 2. NIH Medical Research Funding by Type of Research, 2004-
Figure 11. US Life Science Patent Applications by Country of Origin, 2012
1981-2011 eTable 3. NIH Disease Research Funding and Burden of Disease for
Figure 12. Highly Valuable US Life Science Patents by Country of Selected Conditions
Origin, 1981-2011 eTable 4. Medical Research Funding From (A) Public Charities and
Figure 13. Medical Research Articles and Citations by Selected (B) Private Foundations, 2011
Countries/Regions, 2000-2010 eTable 5. US Funding for Health Services Research by Source, 2004-
Figure 14. Market Performance of Publicly Traded Life Sciences 2012
and Health Care Companies, 2003-2013 eTable 6. Methods and Data Sources for Medical Research Funding
by Select Countries/Regions

amined using comparable, standard measures of investment, em- research investment remained stable, ranging between 4.2% and
ployment, economic value, patents, and publications. 4.7% from 2004 to 2012 (eFigure 1).
Although reliable international comparisons of biomedical sci- In 1994, the National Institutes of Health (NIH) budget
ence funding are possible, comparable data for health services re- totaled $17.6 billion and in 2004 reached a peak of $35.6 billion
search are not available because other countries do not distinguish (Figure 3). Following a decade of remarkable public sponsorship
them from costs of insurance and expenditures on provision of care. of medical research with growth exceeding 7% per year in
A complete description of methods is included in the foot- the1990s, funding from the NIH declined nearly 2% per year in
notes accompanying each table and figure. real terms (Figure 3) after the mid-2000s. This decrease repre-
sents a 13% decrease in NIH purchasing power (after inflation
adjustment) since 2004 (eFigure 2 in the Supplement), which
may be more severe when considering NIH appropriations
Information, Trends, and Analysis
through 2013.5 Other sources of US investment were not immune
Medical Research Funding to slowed growth. Funding from major sources of investment
In 2012, total US funding of biomedical and health services either slowed or declined over the past 10 years, with the excep-
research was $116.5 billion (Figure 2 and eTable 1 in the Supple- tion of other federal support, which includes organizations such
ment), or 0.7% of gross domestic product (GDP). The largest as the Agency for Healthcare Research and Quality (AHRQ).
increase in funding occurred between 1994 and 2004, when From 1994 to 2004, the medical device, biotechnology, and
funding grew at 6% per year. However, from 2004 to 2012, the pharmaceutical industries had annual growth rates greater than
rate of investment growth declined to 0.8% annually and (in real 6% per year (Figure 3), with biotechnology demonstrating the
terms) decreased in 3 of the last 5 years (eFigure 1 in the Supple- largest increases. The share of US medical research funding from
ment). The exceptions were 2009 and 2010, accountable to industry accounted for 46% in 1994 and grew to 58% in 2012.
stimulus from the American Recovery and Reinvestment Act Although much of the growth in medical research funding over
(ARRA). As a percentage of national health expenditures, medical the past 20 years can be attributed to industry, investment still

176 JAMA January 13, 2015 Volume 313, Number 2 (Reprinted) jama.com

Copyright 2014 American Medical Association. All rights reserved.

Downloaded From: http://jama.jamanetwork.com/ by a Pontificia Universidad Javerian User on 12/14/2015


The Anatomy of Medical Research Special Communication Clinical Review & Education

slowed (medical device, 6.6% to 6.2% in 1994-2004 vs 2004-


Figure 2. US Funding for Medical Research by Source, 1994-2012
2012; biotechnology, 14.1% to 4.6% in 1994-2004 vs 2004-
2012), or declined (pharmaceutical firms, 6.8% to 0.6% in 1994- Funding source
2004 vs 2004-2012). Foundations, charities, and other private funds Medical device firms
State and local government Biotechnology firmsc
Research Funding Other federalb Pharmaceutical firms
Biomedical Research National Institutes of Healthb

The distribution of investments across the types of medical re-


Compound annual growth Compound annual growth
search changed from 2004 to 2011. Pharmaceutical companies rate, 6.3% d rate, 0.8% d
shifted funding to late-phase clinical trials and away from discov-
140
ery activity such as target identification and validation. The share

Medical Research Funding, $, in Billions a


of pharmaceutical industry funding (including that by US compa- 120
nies outside of the United States) spent on phase 3 trials increased
100
by 36% (5%/year growth rate) from 2004 to 2011 (Figure 4), and
the share of investment in prehuman/preclinical activities de- 80
creased by 4% (2%/year average decline). This shift toward clinical
60
research and development reflects the increasing costs, complex-
ity, and length of clinical trials but may also reflect a deemphasis of 40
early discovery efforts by the US pharmaceutical industry. While in-
20
dustry has shifted funding to clinical trials, the share of NIH contri-
butions dedicated to basic science and clinical research was un- 0
1994 1996 1998 2000 2002 2004 2006 2008 2010 2012
changed (eTable 2 in the Supplement), with the majority of funds
Year Includes
still focused on basic research. These data may not accurately re-
ARRA Fundingb
flect the true division of NIH investment for basic science vs disease-
focused research, as a growing proportion of NIH expenditures is Data were calculated according to methods outlined in eTable 1 in the
for projects having potential clinical application in many diseases or Supplement. ARRA indicates American Recovery and Reinvestment Act.
organ systems.7 a
Data were adjusted to 2012 dollars using the Biomedical Research and
In real terms, venture capital investment in biotechnology com- Development Price Index.4
b
panies steadily increased from $1.5 billion in 1995 to a peak of $7.0 The National Institutes of Health and other federal sources include stimulus
provided by ARRA in 2009 and 2010.
billion in 2007 (eFigure 3 in the Supplement). During that period, c
Data from 1994-2002 and 2011-2012 were estimated based on linear
investment in biotechnology companies as a share of total venture regression analysis of industry market share.
capital investment increased from 10% to 18%, and the number of d
Compound annual growth rate (CAGR) supposing that year A is x and year B is
investments increased from 176 to 538. Investment levels and the y, CAGR = (y/x){1/(BA)}1. The CAGR was calculated separately for 2 different
number of transactions of biotechnology decreased following the periods with a single overlapping year: 1994-2004 and 2004-2012. The cut
point was chosen at 2004 given the changes seen in funding from the
financial crisis in 2008-2009, declining to a low of $4.3 billion in
National Institutes of Health in that year.
2009. Venture capital investment still has not recovered to its pre-
2008 levels, with only $4.5 billion invested in 2013. Size of invest-
ment per transaction (median, $11 million, inflation adjusted) has re- to provisions of the Orphan Drug Act and relative ease of clinical
mained unchanged for 2 decades. trials. Investment can be expected to increase as diseases are
Public funding of medical research by condition was only mar- defined by biomarkers that allow the development of targeted
ginally associated with disease burden in the United States in 2010 therapies.12
(eFigure 4 in the Supplement). A set of 27 diseases that account Support from private foundations, public charities, and other
for 84% of US mortality, 52% of years of life lived with disability, entities comes from only a few organizations. In 2011, 42% of total
84% of years of life lost, and 70% of disability-adjusted life-years not-for-profit funding was by the top 10 public medical charities and
receive 48% of NIH funding (R2 = 0.26) (eTable 3 in the Supple- top 10 private foundations (eTable 4 in the Supplement). The How-
ment). Several factors other than disease burden may influence ard Hughes Medical Institute (which supports domestic research pri-
funding, including the quality of research, scientific opportunity, marily) and the Bill and Melinda Gates Foundation (which supports
portfolio diversification, or building of infrastructure, and the com- international research primarily) account for 87% of biomedical re-
bination of these factors complicates the relationship of funding to search funding by private foundations (eTable 4, panel B). United
particular conditions.8,9 Cancer and HIV/AIDS were funded well Statesbased medical charities direct most monies in the United
above the predicted levels based on US disability alone (eFigure 4 States, though the amount spent on research (as opposed to edu-
in the Supplement), with cancer accounting for 16% ($5.6 billion) cation, disease screening, and other activities) cannot be quanti-
of total NIH funding and 25% of all medicines currently in clinical fied using public data.
trials (Figure 5).
Rare diseases have emerged for industry as a preferential area Health Services Research Funding
of therapeutic development, with nearly as many compounds in Health services research, which examines access to care, the qual-
trials as analgesics and antidiabetic drugs (Figure 5). Industry ity and cost of care, and the health and well-being of individuals,
favors rare diseases because they are commercially attractive due communities, and populations, accounted for between 0.2% and

jama.com (Reprinted) JAMA January 13, 2015 Volume 313, Number 2 177

Copyright 2014 American Medical Association. All rights reserved.

Downloaded From: http://jama.jamanetwork.com/ by a Pontificia Universidad Javerian User on 12/14/2015


Clinical Review & Education Special Communication The Anatomy of Medical Research

Figure 3. Growth in US Funding for Medical Research by Source, 1994-2012

Medical Research Funding, Compound Annual


$ (%), in Billions a Growth Rate, % b
120
Funding Source 1994 2004 2012 1994-2004 2004-2012

100
Foundations, charities, other private 2.6 (4) 3.9 (4) 4.2 (4) 4.2 1.0
Medical Research Funding,

State and local government 3.9 (7) 5.9 (5) 6.3 (5) 4.1 0.9
80 Other federal 8.0 (13) 4.8 (4) 7.1 (6) 4.9 5.0
$, in Billionsa

National Institutes of Health 17.6 (29) 35.6 (33) 30.9 (27) 7.3 1.8
60
Medical device firms 3.8 (6) 7.1 (6) 11.5 (10) 6.6 6.2
40 Biotechnology firms 3.7 (6) 13.7 (12) 19.6 (17) 14.1 4.6
Pharmaceutical firms 20.0 (34) 38.6 (35) 36.8 (32) 6.8 0.6
20 Overall 59.5 109.7 116.5 6.3 0.8

0
1994 2004 2012
Year

b
Data were calculated according to methods outlined in eTable 1 in the Compound annual growth rate (CAGR) supposing that year A is x and year B is
Supplement. y, CAGR = (y/x){1/(BA)}1.
a
Adjusted to 2012 dollars using the Biomedical Research and Development
Price Index.4

Figure 4. Pharmaceutical Industry Medical Research Funding by Phase of Research, 2004-2011

Industry Medical Research Compound Annual


Funding, $, (%), in Billions a Growth Rate, % b
Phase of Research 2004 2011 2004-2011
50
Uncategorizedc 4.2 (9) 1.7 (3) 11.9
Industry Medical Research
Funding, $, in Billionsa

40 Phase 4 6.4 (13) 4.8 (10) 3.9


Approval 4.5 (9) 4.1 (8) 1.2
30
Phase 3 12.6 (26) 17.6 (36) 4.9
20 Phase 2 4.9 (10) 6.2 (13) 3.3
10 Phase 1 3.2 (7) 4.3 (9) 4.1
Prehuman/preclinical 12.5 (26) 10.6 (22) 2.3
0
2004 2011 Overall 48.3 49.3 0.3

a
Pharmaceutical industry funding by phase was obtained from Pharmaceutical Data were adjusted to 2012 dollars using the Biomedical Research and
Research and Manufacturers of America (PhRMA) annual reports, 2004-2011.6 Development Price Index.4
Data were 2 years old at time of publication and include both domestic and b
Compound annual growth rate (CAGR) supposing that year A is x and year B is
international research funding from PhRMA members. y, CAGR = (y/x){1/(BA)}1.
c
Uncategorized funding could not be allotted to a single phase of research.

0.3% of national health expenditures between 2003 and 2011, an ing, or 1.7%-2.5% of revenue). Health insurers may provide addi-
approximately 20-fold difference in comparison with total medical tional health services research funding that cannot be distin-
research funding (eFigure 1 in the Supplement). Health services guished from the insurance industry as a whole, although these
research funding increased 4.6% per year from $3.7 billion in funds are small and unlikely to change the results for industry
2004 to $5.0 billion in 2011 (Figure 6 and eTable 5 in the Supple- funding (Figure 7).
ment). Investment from foundations decreased in real terms at 1%
per year over the period, following declines after the recession of International Medical Research Funding
2008. Increases in health services research funding were largely Global medical research expenditures by public and industry sources
driven by AHRQ (15.8%/year growth) and the health care services in the United States, Europe, Asia, Canada, and Australia combined
industry (11.0%/year growth), which includes hospitals, ambula- increased from $208.8 billion in 2004 to $265.0 billion in 2011, grow-
tory health care services, and nursing care facilities. Although ing at 3.5% annually (Figure 8 and eTable 6 in the Supplement). Al-
health care industry funding is likely underestimated because though there may be medical research funding from other areas of
research funds may not account for hidden costs of quality the world (eg, South America), these data represent the most reli-
improvement, research investment was especially low when com- able and current sources of global medical research investment.
pared with other industrial sectors (Figure 7). Insurers and health Among the regions included in the analysis, the United States dem-
systems rank among the lowest in research and development onstrated the slowest annual growth in investment (1.5%/year), fol-
(funding $1.3 billion, or 0.1% of revenue), which was well below lowed by Europe (4.1%/year) and Canada (4.5%/year). Asian coun-
the median for industrial sectors ($5.5-$7.3 billion for total fund- tries increased from $28.0 billion in 2004 to $52.4 billion in 2011,

178 JAMA January 13, 2015 Volume 313, Number 2 (Reprinted) jama.com

Copyright 2014 American Medical Association. All rights reserved.

Downloaded From: http://jama.jamanetwork.com/ by a Pontificia Universidad Javerian User on 12/14/2015


The Anatomy of Medical Research Special Communication Clinical Review & Education

or 9.4% per year, with especially large increases in China, India, South Although China led the world in the overall size of their science
Korea, and Singapore. and technology workforce, it had only 1.9 science and technology
These trends resulted in the restructuring of the share of total workers per 100 000 full-time equivalents, the lowest among the
global investment (eFigure 5 in the Supplement). As a percentage countries included in the analysis (Figure 9). The United States em-
of global funding, the United States declined by approximately 13% ployed 8.1 science and technology workers per 100 000 full-time
from 2004 to 2012, and Asian economies increased by approxi- equivalents in its total workforce, or the median for the 10 largest
mately the same share (13% in 2004 to 20% in 2011). Although ab- workforces in the world.
solute growth of Asian investment from 2004 to 2011 reached $24 The investment in capital terms and in labor terms differ widely
billion, the United States remained the leading sponsor of global across countries and regions. The United States contributes 44.2%
medical research in 2011 (44% share), and Europe the next largest of global medical research funding but comprises only 21.2% of the
sponsor (33% share).
Overall growth was slightly greater for industry outside the
United States compared with public sources (4.3% vs 2.2%), and in- Figure 5. Compounds in Development for Top 10 Therapeutic Areas, 2013
dustry accounted for two-thirds of funds in 2011. However, US con-
Therapeutic areaa
tributions increased slowly from both public (0.1%/year) and indus-
Anticancer, otherb
try sources (1.7%/year).
Anticancer,
Public funding in the United States decreased to a 49% share immunological
of the worlds public research investment by 2011, down from 57% Prophylactic vaccine,
anti-infective
in 2004 (Figure 8). United States industry, which accounted for
Antidiabetic
nearly half of global industry medical research expenditures in 2004, Analgesic
declined to 41% of global industry funding in 2011 (Figure 8). Japan
Rare diseasec
demonstrated the greatest increase in the worlds share of indus-
Anti-inflammatory
try funding (+3.9%), and European countries gained the most in pub-
Recombinant vaccine
lic investment (+3.5%). Despite decreases in the US share of invest-
Cognition enhancer
ment, the United States remained the worlds leading sponsor for
0 200 400 600 800 1000 1200 1400 1600 1800
both public and industry medical research funding in 2011.
No. of Compounds in Clinical Trialsa

Science and Technology Workforce Data for the number of compounds in development were from the Citeline
From 1996 to 2011, the US science and technology workforce in- Pharma R&D Annual Review 2014.10 Data for rare diseases were from the
creased by 2.7% annually to reach 1.25 million workers (Figure 9). Pharmaceutical Research and Manufacturers of America.11
a
Over the same period, Chinas workforce increased 6% annually to Number of compounds in clinical trials or under review by the US Food and
Drug Administration. This includes a total of 10 479 compounds in 2013.
reach 1.31 million workers, making it the largest national science and
b
Includes all nonimmunological anticancer compounds.
technology workforce in the world. Reliable information about the
c
Rare diseases were defined as those affecting 200 000 or fewer people in the
proportion of medical researchers could not, however, be ob-
United States.
tained.

Figure 6. US Funding for Health Services Research by Source, 2004-2011

Health Services Research Compound Annual


Funding, $, in Millions (%) a Growth Rate, % b
Funding source 2004 2011 2004-2011
6
Health services industryc 653 (18) 1352 (27) 11.0
Health Services Research
Funding, $, in Billions a

AHRQ 365 (10) 1018 (20) 15.8


4 NIH 1158 (32) 1189 (24) 0.4
Other federald 442 (12) 494 (10) 1.6

2 Foundationse 1034 (28) 967 (19) 1.0


Overall 3652 5019 4.6

0
2004 2011

AHRQ indicates Agency for Healthcare Research and Quality; NIH, National health services research and quality improvement initiatives for the US health
Institutes of Health. Data were calculated according to methods outlined in care services industry.
eTable 5 in the Supplement. d
Other federal funding includes the Centers for Disease Control and Prevention,
a
Adjusted to 2012 dollars using the Biomedical Research and Development Centers for Medicare & Medicaid Services, Veterans Health Administration,
Price Index.4 Health Resources and Services Administration, and Patient Centered
b
Compound annual growth rate (CAGR) supposing that year A is x and year B is Outcomes Research Institute (in 2011 only).
y, CAGR = (y/x){1/(BA)}1. e
Foundation funding includes total giving from the Robert Wood Johnson
c
Health services industry includes funding from hospitals, ambulatory health Foundation, California Endowment, Pew Charitable Trusts, W. K. Kellogg
care services, nursing and residential facilities. Health insurance companies Foundation, and Commonwealth Fund.
were not included. Data may not fully capture the entirety of funding for

jama.com (Reprinted) JAMA January 13, 2015 Volume 313, Number 2 179

Copyright 2014 American Medical Association. All rights reserved.

Downloaded From: http://jama.jamanetwork.com/ by a Pontificia Universidad Javerian User on 12/14/2015


Clinical Review & Education Special Communication The Anatomy of Medical Research

Figure 7. Research and Development Investment Ranking of Industrial Sectors Among US-Based Companies, 2011

Total research and development fundinga Share of revenue spent on research and developmenta

Pharmaceuticals and biotechnology Pharmaceuticals and biotechnology


Computer and electronics manufacturing Internet service provider and web search

Software and paper publishing Software and paper publishing

Automobiles and parts Physical, engineering, and life sciences

Medical devices Computer and electronics manufacturing

Machinery Medical devices

Computer software and systems design Aerospace and defense

Chemicals Computer software and systems design

Aerospace and defense Data processing and hosting

Plastics, minerals, and metal products Machinery

Internet service provider and web search Median Automobiles and parts Median
Food and beverage Chemicals

Mining, extraction, and support activities Plastics, minerals, and metal products

Data processing and hosting Mining, extraction, and support activities

Banking, credit, and securities Architectual engineering

Telecommunications Food and beverage

Physical, engineering, and life sciences Telecommunications

Architectual engineering Utilities

Health care servicesc Banking, credit, and securities

Utilities Health care servicesc


Domestic
Insurance carriers Foreign Transportation services 0.04

Transportation services 0.2 Insurance carriers 0.04


0 20 40 60 80 0 5 10 15
Research and Development Research and Development
Spending, $, in Billions b Spending as % of Revenue

a
Research and development expenditures for US-based companies performing The pharmaceuticals and biotechnology, medical devices, and health care
research by the industrial sector were obtained from the National Science services industries are highlighted in red.
Foundation.13 Data include research funds spent both domestically and abroad. b
Adjusted to 2012 dollars using the Biomedical Research and Development
Industry revenues were obtained from the National Science Foundation13 or US Price Index.4
Census Bureau14 based on the availability of data. Revenues and research and c
Health care services industry includes US-based hospitals, ambulatory health
development expenditures were matched by industry using North American
care services, and nursing and residential facilities.
Industry Classification System codes.

global science and technology workforce (eFigure 6 in the Supple- eFigure 7 in the Supplement). The proportion of US inventors filing
ment). Conversely, China contributes only 1.8% of global funding for patents in the United States decreased from 57% to 51% from 1981
medical research but comprises 22.3% of the global science and tech- to 2011. During the same period, the share of highly valuable pat-
nology workforce. This difference in investment represents a natu- ents filed by US inventors decreased between from 73% to 59%
ral experiment in productivity management and has broad implica- (Figure 12), while all other countries in the analysis increased their
tions for patents and intellectual property ownership, which will share of highly valuable patents. Similar trends were observed for
evolve over the next few years. highly valuable patents filed through the European Patent Office
(eFigure 8 in the Supplement). Highly valuable patents are defined
Outputs of Medical Research by the frequency they are cited by other inventors in subsequent
Life Science Patent Filings patent applications (Figure 12, footnote b)
China filed 30% of global life science patent applications in 2011, in-
creasing from 1% of global applications in 1991 (Figure 10). This in- Publications
cludes applications from a number of patenting offices throughout The United States led the world with 33% of published biomedical
the world, including offices in China, the United States, and the research articles in 2009 (Figure 13A). In the United States, the num-
European Union. The United States followed with 24% of patent fil- ber of biomedical research articles increased at 0.6% per year from
ings globally, increasing from an 11% share in 1991. 2000 to 2009. During the same period, the number of articles pub-
United States inventors led in the number of life science pat- lished in China increased by 18.7% annually.
ent filings in both the United States and EU, where China ac- The United States also leads the world in its share of the most
counted for less than 2% of filings in both regions (Figure 11 and highly cited biomedical research articles, with 63% of the top cited

180 JAMA January 13, 2015 Volume 313, Number 2 (Reprinted) jama.com

Copyright 2014 American Medical Association. All rights reserved.

Downloaded From: http://jama.jamanetwork.com/ by a Pontificia Universidad Javerian User on 12/14/2015


The Anatomy of Medical Research Special Communication Clinical Review & Education

Figure 8. Global Medical Research Funding in Select Countries/Regions, 2011

280
260 Publicb

Medical Research Funding, in Billionsa


240
Industryc
220
200
180
160
140
120
100
80
60
40
20
0
Globale United Europe Japan China Other Canada Australia
States Asiaf
Medical research funding,
$, in billions (%) a
Overall 265.0 (100) 117.2 (44) 88.6 (33) 37.8 (14) 4.9 (1.2) 9.7 (4) 3.1 (1.2) 3.8 (1.4)
Publicb 102.8 (100) 50.5 (49) 26.9 (26) 17.0 (17) 1.3 (2) 2.4 (2) 1.8 (2) 2.8 (3)
Industryc 162.2 (100) 66.6 (41) 61.6 (38) 20.8 (13) 3.6 (0.8) 7.3 (4) 1.3 (0.8) 1.0 (0.6)
Compound annual growth 3.5 1.0 4.1 6.8 16.9 20.8 4.5 9.3
rate, % (2004-2011)d

b
The regions/countries/economies in the analysis include the major countries of Public research and development funding included that from government
North America (United States, Canada), Europe (including the 10 largest agencies, higher educational institutes, and not-for-profit organizations.
European countries in the Organisation for Economic Co-operation and c
Industry research and development funding included pharmaceutical,
Development), and Asia-Oceania (Australia, China, India, Japan, Singapore, and biotechnology, and medical device firms.
South Korea). Data for African and South American countries and Russia were d
Compound annual growth rate (CAGR) supposing that year A is x and year B is
not available. Data were calculated according to methods outlined in eTable 6 in
y, CAGR = (y/x){1/(BA)}1.
the Supplement.
e
a Global total for medical research funding includes research and development
Data were converted to US currency using an average annual exchange rate
expenditures from 36 major world countries across 4 continents.
for the respective year15 and adjusted to 2012 dollars using the Biomedical
f
Research and Development Price Index.4 Other Asia includes India, Singapore, and South Korea.

articles in 2000 and 56% in 2010; however, the growth of highly pharmaceutical, and biotechnology companies as well as hospi-
cited literature published by the United States trails other major coun- tals, nursing homes, and other health service suppliers) as mea-
tries, regions, and economies (Figure 13B). After controlling for the sured by the Dow Jones US Health Care Index increased 8.2% an-
share of the worlds biomedical research articles using a citation in- nually, closely trailing the Standard & Poors 500 (8.3%) (Figure 14).
dex, the United States declined from 2000 to 2010 at 0.2% per Market returns for biotechnology and health insurance companies
year as the rest of the world increased by approximately 1% per year. outperformed the market, growing at 18.5% and 13.8% per year, re-
spectively. Medical device companies, pharmaceutical companies,
New Drugs and Devices and hospital chains underperformed compared with the Standard
Since 2003, drug approvals by the US Food and Drug Administra- & Poors 500, increasing annually at 7.3%, 6.8%, and 5.8%, respec-
tion (FDA) have remained unchanged with an average of 26 approv- tively. The financial crisis of 2008 led to a decrease in market per-
als per year. Although drug approvals increased slightly in 2011 and formance for all life sciences industries. Generally, all sectors recov-
2012, they returned closer to average in 2013 with 27 approvals (eFig- ered in the years following, and biotechnology companies, hospital
ure 9 in the Supplement). United States device approvals have also chains, and health insurance companies performed exceptionally well
remained relatively constant over the last decade. While the num- since their decline in 2008-2009.
ber of approvals steadily increased from 15 approvals in 2009 to 39
approvals in 2012, only 22 new devices were approved in 2013.
During the same period, the European Medicines Agency (EMA)
Discussion and Implications
averaged a higher number of both applications (55/year) and ap-
provals (42/year) than the FDA (eFigure 9). In 2013, the EMA re- Medical research in the United States remains the primary source
ceived 22 more applications and approved 16 more drugs than the of new discoveries, drugs, devices, and clinical procedures for the
FDA. world, although the US lead in these categories is declining. For ex-
ample, whereas the United States funded 57% of medical research
Life Sciences Market Performance in 2004, in 2011 that had declined to 44%. Basic research and prod-
Equity (stock) markets reflect broad public perception of one in- uct development are central to the health of countries economies.
dustrys value in comparison with others. Since 2003, market re- However, changes in the pattern of investment, particularly level
turn for the entire health care industry (including medical device, funding by US government and foundation sponsors, with a de-

jama.com (Reprinted) JAMA January 13, 2015 Volume 313, Number 2 181

Copyright 2014 American Medical Association. All rights reserved.

Downloaded From: http://jama.jamanetwork.com/ by a Pontificia Universidad Javerian User on 12/14/2015


Clinical Review & Education Special Communication The Anatomy of Medical Research

Figure 9. Top 10 Countries by Size of Science and Technology Workforce, 1996-2011

A Work force sizea

1400

1996

Full-time Equivalents, in Thousands


1200
2011
1000

800

600

400

200

0
Chinac United Japan Russian Germany United Korea France Canada Spain
States Federation Kingdom
Compound annual growth 6.0 2.7 0.4 1.5 2.6 3.7 7.4 3.2 3.8 6.4
rate, % (1996-2011)b

B Work force size per 1000 total employment

12

1996
10
No. per 1000 Total Employment

2011

0
Korea Japan France Canada United Germany United Russian Spain Chinac
States Kingdom Federation
Compound annual growth 6.2 0.5 2.5 2.2 1.8 2.2 2.9 2.1 4.1 5.2
rate, % (1996-2011)b

b
The sizes of national science and technology workforces were obtained from Compound annual growth rate (CAGR) supposing that year A is x and year B is
the Organisation for Economic Co-operation and Development.16 y, CAGR = (y/x){1/(BA)}1.
a c
Workforce size was measured in number of full-time equivalents and includes Annual growth in Chinas science and technology workforce may be
all science and technology sectors (eg, engineering, physical sciences) in underestimated because of a change in reporting methods for China in 2009.
addition to the medical and health sciences.

cline in real terms, combined with companies focus on late-stage The information assembled demonstrates that 3 factors, wa-
products (with diminished discovery-level investment) indicate that vering financial support for science, underinvestment in service in-
difficulties may soon appear in the ability of clinicians to fully real- novation, and globalization, pose the chief challenges of the cur-
ize the value of past investments in basic biology. rent era.
In addition, the limited support of ambitious but scientifically
rigorous methods to improve delivery of health services repre- Biomedical Research
sents a major missed opportunity to improve many aspects of health, New knowledge about disease has a 15- to 25-year gestation from
especially as the burden of chronic illness, aging populations, and basic discovery to clinical application, an interval that may be
the need for more effective ways to deliver care are appreciated.1 lengthening.22,23 Hence, the cumulative investment in biomedical
Over the past 2 decades, the period of this analysis, medical re- research of the past 3 decades will soon mature. Therefore, ensur-
search has become global. It has been transformed by multiple, com- ing sufficient support for its clinical development is a pressing need.
plex and subtle transitions, from small laboratories to large, in- Equally important are stable academic institutions and companies
dustrial-scale institutes, from hypothesis-driven inquiries to data- along with skilled researchers that have the capability to organize
driven compilations, from experiments by single individuals to those the research process and to sustain the innovation cycle,24 particu-
requiring large teams, and from finding causes of specific diseases larly since the size of research teams and scale of activities have
to learning how entire systems become disordered.21 grown. Year to year variability in funding is a threat to that stability.

182 JAMA January 13, 2015 Volume 313, Number 2 (Reprinted) jama.com

Copyright 2014 American Medical Association. All rights reserved.

Downloaded From: http://jama.jamanetwork.com/ by a Pontificia Universidad Javerian User on 12/14/2015


The Anatomy of Medical Research Special Communication Clinical Review & Education

Figure 10. Global Life Science Patent Applications by Country of Origin, 1981-2011

No. of patent family applications Percentage distribution by country


in life sciencea
400 000 100
Other Other
Germany Germany
Japanb 80 Japanb
300 000
Russia Russia

Percentage
Taiwan 60 Taiwan
No.

200 000 India India


Australia 40 Australia
Canada Canada
100 000 Korea Korea
20
United States United States
China China
0 0
1981 1991 2001 2011 1981 1991 2001 2011
Year Year

The number of patent family applications by country filed was calculated based biotechnology, pharmaceuticals, macromolecular chemistry and polymers,
on data obtained from Thomson Innovation.17 Only the most recent patent and microstructural and nanotechnology.
application in a patent family was counted for this analysis. Data are included for b
Only patent grants, not all patent applications, are counted for Japan, which
all countries available in the Thomson data set. tends toward patent applications with narrower definitions and therefore
a
Life science was defined to include the following categories: analysis of much greater numbers relative to the number of patents ultimately granted.
biological materials, medical technology, organic fine chemistry,

Figure 11. US Life Science Patent Applications by Country of Origin, 1981-2011

No. of patent application families Percentage distribution


in life science by country of inventor a by country of inventor
80 000 100
The number of patent application
Other Other families by country was calculated
Netherlands Netherlands counting the most recent application
China 80 China
60 000 in family of patents based on data
Taiwan Taiwan obtained from Thomson Innovation.17
Percentage

Switzerland 60 Switzerland Data are included for all countries


No.

40 000 Korea Korea available in the Thomson data set.


Great Britain 40 Great Britain a
Life science was defined to include
France France the following categories: analysis of
20 000 Germany Germany
20 biological materials, medical
Japan Japan technology, organic fine chemistry,
United States United States biotechnology, pharmaceuticals,
0 0
1981 1991 2001 2011 1981 1991 2001 2011 macromolecular chemistry and
Year Year polymers, and microstructural and
nanotechnology.

Although the biomedical research enterprise is basically healthy, ment of cell maturation and differentiation) show potential clinical
to fully capture the clinical value of past investment in science and value. This is an unfortunate paradox because many of the dis-
its promise for the future, 2 areas require particular attention: (1) in- eases associated with substantial morbidity and mortality may ben-
creased financial support for critical early studies that validate ba- efit the most from these new discoveries.
sic biological discoveries and demonstrate their relevance to dis- Various new sources for long-term investments have been pro-
ease (establishing proof of concept) and (2) greater productivity, posed. Most often, public funds have been sought, by expansion of
especially acceleration of the application of new findings to dis- the NIH budget, appropriations by state legislatures, or earmarked
ease. federal appropriations for threatened epidemics or defense-
related biological risks. Most advocates look to government for sup-
Financing That Can Sustain Long-term Investment port of high-risk, early-stage research, given private companies fo-
In the United States and Europe, private companies will not likely cus on development of new technologies at their later stage. Private
have the latitude from their investors, or governments the political foundations and public charities, though small, play an essential role
will, to continue to make long-term investments at historical levels. in filling that gap, especially for the most speculative undertakings
Todays political and commercial environment leads to this conclu- or where commercial incentives are insufficient. However, it is un-
sion. Many new basic discoveries that have probable clinical value likely that these conventional sources of research investment will
are stymied by financial constraints at the critical proof-of-concept be sufficient to meet the challenges of an aging population, the ag-
stage, where utility in humans is demonstrated. That number can gregate burden of disease, or the promise of emerging science.
be expected to increase once platform technologies (such as high- The reduced funding of large pharmaceutical and biotechnol-
resolution mapping of the central nervous system, analysis of com- ogy companies on early, basic, discovery-stage research (with con-
plex biological systems and networks, or insights into develop- comitant growth of late-stage clinical trials) is apparent from our

jama.com (Reprinted) JAMA January 13, 2015 Volume 313, Number 2 183

Copyright 2014 American Medical Association. All rights reserved.

Downloaded From: http://jama.jamanetwork.com/ by a Pontificia Universidad Javerian User on 12/14/2015


Clinical Review & Education Special Communication The Anatomy of Medical Research

Figure 12. Highly Valuable US Life Science Patents by Country of Origin, 1981-2011

No. of life science patent applications Percentage distribution of top 10%


in top 10% of patents by inventor countrya,b of patents by country of inventor b
8000 100
Other Other
China China
Netherlands 80 Netherlands
6000
Korea Korea

Percentage
Canada 60 Canada
No.

4000 Switzerland Switzerland


France 40 France
Great Britain Great Britain
2000 Germany Germany
20
Japan Japan
United States United States
0 0
1981 1991 2001 2011 1981 1991 2001 2011
Year Year

The number of patent application families by country was calculated counting and microstructural and nanotechnology.
the most recent application in family of patents based on data obtained from b
Top 10% of patents ranked by year using BCG Quality Index. The BCG Quality
Thomson Innovation.17 Data are included for all countries available in the Index is made up of 3 components; specifically, forward citations of a patent in
Thomson data set. newer patents adjusted for the patents age, the number of patent claims, and
a
Life science was defined to include the following categories: analysis of the strength of a patents backward citations. The components and
biological materials, medical technology, organic fine chemistry, corresponding weights used by the quality index are a product of proprietary
biotechnology, pharmaceuticals, macromolecular chemistry and polymers, Boston Consultng Group research.

Figure 13. Medical Research Articles and Citations by Selected Countries/Regions, 2000-2010

No. of Medical Annual


A No. of medical research articles
Research Articles Growth Rate, % a
2000 2009 2000-2009
400 000
Otherb 49 946 63 483 2.7
Other Asiac 10 029 20 790 8.4
300 000
China 3937 18 399 18.7
No.

200 000 Japan 26 755 21 477 2.4


European Uniond 114 970 120 421 0.5
100 000 United States 116 156 122 659 0.6
Overall 321 795 367 229 1.5
0
2000 2009
Year Compound
No. of Highly Cited Citation Index Annual Growth
Medical Research of Highly Rate (Citation
B No. of highly cited medical research articles
Articles Cited Articles Index), % a
2000 2010 2000 2010 2000-2009
12 000
Otherb 763 1034 0.57 0.59 0.4
10 000 Other Asiac 20 113 0.1 0.22 8.6
8000 China 16 82 0.22 0.22 0.3
No.

6000 Japan 345 294 0.5 0.45 1.0

4000 European Uniond 2079 2936 0.68 0.86 2.5


United States 5402 5729 1.67 1.63 0.2
2000
Overall 8626 10 189 NA NA NA
0
2000 2009
Year

NA indicates not available. Medical research was defined as the life sciences and 1% cited biomedical research articles divided by the share of the worlds
psychology, excluding agricultural science. Article counts reported by the biomedical research articles in the cited year window.
National Science Foundation were from the Thomas Reuters Science Citation a
Compound annual growth rate (CAGR) supposing that year A is x and year B is
Index and Social Science Citation Index,18 classified by year of publication and y, CAGR = (y/x){1/(BA)}1.
assigned to countries on the basis of institutional addresses listed on each b
Other includes the remaining 159 nations of the world within the original
article. Articles were counted on a fractional basis; ie, for articles with
database.
collaborating institutions from multiple countries, each country received
c
fractional credit on the basis of proportion of its participating institutions. Other Asia includes India, Indonesia, Malaysia, Philippines, Singapore, South
Citations were based on a 3-year period with 2-year lag; eg, citations for 2000 Korea, Taiwan, and Thailand.
are references made in articles in 2000 to articles published in 1996-1998. The d
The European Union includes 27 European nations.
citation index of highly cited articles was defined as the share of the worlds top

184 JAMA January 13, 2015 Volume 313, Number 2 (Reprinted) jama.com

Copyright 2014 American Medical Association. All rights reserved.

Downloaded From: http://jama.jamanetwork.com/ by a Pontificia Universidad Javerian User on 12/14/2015


The Anatomy of Medical Research Special Communication Clinical Review & Education

Figure 14. Market Performance of Publicly Traded Life Sciences and Health Care Companies, 2003-2013

NYSE Arca Biotechnology Index


700 Health insurance
Standard & Poor 500 index

Value of $100 Invested January 2003, $


Dow Jones US health care index
600
Dow Jones US medical equipment index
NYSE Arca Pharmaceutical Index
500 Hospital chains

400
NYSE indicates New York Stock
Exchange. Data on market
300 performance was accessed from
Bloomberg market data. Market
200 performance was calculated as the
return on investment of US $100 on
100 January 3, 2003, at various future
time points. More detail regarding the
0 indexes can be found at Standard &
2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 Poors Dow Jones and New York
Year Stock Exchange sector
classifications.19,20

analysis. This trend will likely continue. A combination of the lim- Productivity
ited recent record of industry research and development and the un- New science and technology have been slow to address the mor-
predictability of outcomes and length of time required to observe bidity and cost of chronic diseases and the growing number of el-
results produces uncertain returns on investment, which are not tol- derly persons. Consequently, some have suggested that changing
erated in an economy that values short-term performance dispro- patient behavior and education (for adherence and lifestyle modi-
portionally. fication), not technology, should become the priority.29 Others fo-
Therefore, altogether new funding sources are required. As we cus on changing the NIH mission to emphasize prevention and clini-
and others have proposed previously,25,26 a variety of new financ- cal evaluation rather than basic scientific discovery, or altering
ing vehicles are feasible and attractive. These might include incentives of industry to encourage their investment in high-
Foreign capital repatriation, with new tax provisions that allow com- prevalence, high-cost conditions rather than lucrative niches such
panies to return funds held outside the United States if used for as cancer and orphan diseases.8,9,12 Some observers have even sug-
research.27 Because of the size of these holdings, a yearly incre- gested that expectations for science and technology be reduced,
ment of 25% to 50% of total research funding is feasible over the given the long cycle time from discovery to clinical application.30
next decade. Declining productivity is at the root of many of these dissatis-
Biomedical research bonds, analogous to those used to finance factions. Therefore, greater attention is required to introduce meth-
sports stadiums and airports, could be issued by federal, state, or ods that enhance the pace of research with few additional costs.
local governments, with amortization from patent royalties or con- Improve the scientific process. As our analysis confirms, research
verted to equity in new companies created. Historically, bonds have is costly, capital intensive, and, above all, collaborative. More-
funded infrastructure investments but are now being adapted for over, researchers depend on one another for a source of new ideas,
environmental and green projects, which have economics that as well as access to material, reagents, clinical information, samples,
resemble medical research.28 and ultimately patients who are willing to participate in clinical trials.
Research innovation trusts could be formed to allow private and Therefore, recent efforts have been aimed at facilitating those criti-
public entities to join forces for innovation in high-priority dis- cal interactions. An example is the Accelerating Medicines
eases or those of high public health importance, in return for tax Partnership31 (between companies and the NIH), which identi-
credits (not deductions), as have been used previously to pre- fied common diseases for which few effective therapies exist but
serve land, create parks, and build factories. These new trusts can science is especially promising. Four conditions meeting those cri-
be structured to permit investments by public and company pen- teria were selected: Alzheimer disease, type 2 diabetes, rheuma-
sion funds or individual retirement programs, which are currently toid arthritis, and systemic lupus erythematosus. In each, specific
precluded from most early-stage, speculative investments. Aus- biological questions were identified that can best be answered using
tralia, Canada, and the United Kingdom have used such research resources from industry, the NIH, and academic investigators com-
and development trusts effectively. bined, who would otherwise be limited if working on their own.
Tax checkoffs, whereby individuals can specify a portion of their Enhance benefits of large-scale, industrialized biology and small-
tax payment to be diverted to research, as is currently the prac- scale investigators laboratories. The past 2 decades investment
tice for public funding of elections. A few states (eg, California, in large projects, such as sequencing the human genome and its
Maryland, New York, and Oregon) have made science a priority successors for proteins, the microbiome, or the nervous system
using tax checkoffs. connectome, is unlikely to realize its full value without interpreta-
Each of these financial innovations could be invoked without di- tion and application by skilled individual scientists. Many astute ob-
rect federal or state funding. They potentially can mobilize new pri- servers suggest that the desirable balance has not yet been struck
vate sources of funds without requiring tax increases or direct pub- between industrial-scale and individual-inspired laboratories.21 Spe-
lic appropriations. cifically, further experimentation with new organizational models

jama.com (Reprinted) JAMA January 13, 2015 Volume 313, Number 2 185

Copyright 2014 American Medical Association. All rights reserved.

Downloaded From: http://jama.jamanetwork.com/ by a Pontificia Universidad Javerian User on 12/14/2015


Clinical Review & Education Special Communication The Anatomy of Medical Research

should be aimed at obviating current limitations of the existing bal- ventions that sustain better practices, with lessons adopted from
kanized corporate, venture capital, NIH, and university practices. other complex organizations (eg, military or transportation).
Examples of new models are the Broad Institute in Cambridge, Mas- Neither the organizations nor finances exist to innovate on the
sachusetts (genomics), BioDesign Institute at Arizona State Uni- scale required. Small, incremental federal or foundation grants are
versity, Tempe (biomedical engineering), and Allen Institute for an ineffective spur of sustained change in clinical practice because
Brain Sciences, Seattle, Washington (neurological and psychiatric behavioral and cultural issues remain unaddressed. It is unlikely that
disease). Each of these seeks to optimize individual and institu- recent federal and state risk sharing (accountable care organiza-
tional contributions while ensuring funding. Each orchestrates ex- tions) or other incentives will prove to be adequate for the same rea-
ternal relationships. son. Therefore, more fundamental changes are needed. In particu-
lar, 3 changes should be considered.
Underinvestment in Improving Delivery of Health Services Additional investment by insurers and health systems in delivery
Investment in new ways to deliver better, more effective, and less innovation to bring them to the median of other service indus-
expensive medical care has neither economic impetus nor profes- tries. This increment could produce an annual influx of $8 billion
sional recognition compared with technological innovation or ba- to $15 billion, potentially quadrupling the level of effort overall, and
sic discovery. can be funded from administrative simplification and savings.
Funding for health services research has increased 37% from Sharply increasing federal support of service sector innovation,
$3.7 billion to $5.0 billion over the last decade (Figure 6). However, which can be channeled through the Centers for Disease Control
this growth has occurred on a very small base. Total funding for health and Prevention, Public Health Service, AHRQ, Centers for Medi-
services research is 0.3% of total health care funding (eFigure 1 in care & Medicaid (CMS), Patient-Centered Outcomes Research In-
the Supplement) compared with 4% toward new drugs and de- stitute, and NIH. Funds might be generated by allocating 50% all
vices. That is, the United States spends $116 billion on research aimed savings generated over the next decade by CMS demonstration
at 13% of total health care costs but only $5.0 billion aimed at the projects and by creating new regional private hospitalphysician
remaining 87% of costs.1 insurer innovation consortia to undertake wholesale change in de-
Why the disparity in investment? One major difference is that livery.
new drugs and devices command favorable prices, and their value Encouragement of new entrants who are prepared to make basic,
accrues directly to the firm that invests in them. In contrast, ser- highly disruptive changes in service delivery (via tax credits and
vice innovations can reduce morbidity and mortality while also re- other incentives that are comparable with those now available for
ducing cost, but financial returns to innovators may be negligible or investment in plant and equipment). Examples now on the hori-
even negative. For example, as shown by Arriaga et al32 and Prono- zon include provision by pharmacies of chronic disease care (for
vost and Wachter,33 procedure checklists and other simple precau- hypertension and depression) and use of simple self-monitoring
tions are effective but may result in lower payments to hospitals.34 technologies linked by a ubiquitous internet-of-things to auto-
This mismatch between who invests (the hospital) and who is re- mated artificial intelligence agents for asthma and diabetes con-
warded (the insurer) is a fundamental barrier, even though clinical trol. Such examples are threatening to many physicians and hos-
benefit is enormous and total savings may exceed the return on many pitals but have the potential to lower costs and improve quality.41
categories of blockbuster drugs.35
Three other factors pose barriers: The Challenge of Globalization
Behavior change. Disruption of the current patterns of care is threat- Biomedical science and improved health are tied closely to growth
ening to physicians and hospitals, even when shown to produce of a countrys general economy.42 The primacy of the United States
comparable or better clinical outcomes, higher patient satisfac- as the source of biomedical technology (and until recently, longev-
tion, and lower cost than traditional care.36 Examples include tele- ity) has corresponded with a 4-decade-long improvement in real per-
medicine, daily monitoring, and intensive in-home services. sonal incomes. In turn, investment in science and technology has
Data quality. Claims databases, electronic medical records, and been a potent force producing higher personal incomes and total
other sources of clinical information are not yet sufficiently reli- GDP, with the longer life expectancy that was achieved between 1970
able to inform research. Recent initiatives are aimed at linking sepa- and 1990 estimated to have added about 35% to US GDP by 2000.43
rate sources of data and introducing standards to support Some have suggested that a domestic, US-centric perspective
research34-37 and are a specific goal of international measure- is antiquated and parochial in an era of globalization because people,
ment collaborations for chronic illnesses (eg, the International Con- ideas, capital, and information are highly mobile.44 The United States
sortium for Health Outcomes Measurement),38 and alliances has been the worlds leader for 6 decades in investment in science
among insurers, hospitals, and clinicians for the most severely ill and technology research and development. In 2012, the United
patients (eg, Wellpoint/Emory Health).39 States spent $366 billion on all research and development, or 2.8%
Communications. Clinical service innovation is more difficult than of GDP.45 However, the United States declined from sixth in 2000
the introduction of a new drug or procedure because it requires to 10th in 2012 in its proportion of research and development in-
many individuals to adjust the way they interact, communicate, and vestment compared with the 34-country Organisation for Eco-
use information. Moreover, to have any effect, culture change must nomic Co-operation and Development. In Asia, South Korea and
occur throughout large, hierarchical organizations. Cultural barri- China now each spend about 2% of GDP, with China expected to sur-
ers are potent reasons why small-scale demonstration projects are pass the United States in absolute funding within a decade.45 This
rarely generalized, even when they are initially effective.40 There- trend, along with aggressive patent practices by some countries (no-
fore, research should focus on devising reliable, effective inter- tably China) or disregard of intellectual property rights (in Africa, Cen-

186 JAMA January 13, 2015 Volume 313, Number 2 (Reprinted) jama.com

Copyright 2014 American Medical Association. All rights reserved.

Downloaded From: http://jama.jamanetwork.com/ by a Pontificia Universidad Javerian User on 12/14/2015


The Anatomy of Medical Research Special Communication Clinical Review & Education

tral Europe, and India), raise barriers to the diffusion of clinical in- ated by intellectual property practices, which reward patenting any
novations between countries. discovery or technique, no matter how incremental or trivial.
Two areas are of particular concern: erosion of the publics sup- A patents primary purpose is to foster innovation by making new
port for science in the United States and hesitancy to reform the pat- knowledge generally available in order that successors may im-
ent system. prove on the original invention. In return, the inventor receives a tem-
porary monopoly. Recently, however, patents have been used to cap-
Public Opinion ture financial value of a discovery or product at the expense of further
Recent polls show erosion of public support for biomedical re- invention, a practice known as rent-seeking. Current intellectual
search compared with other priorities. Support has declined steadily property practices inhibit rather than enhance biological discovery
since 2000 and is now well behind concerns about the economy, and clinical innovation.50
domestic security, immigration, crime, and the US role in interna- Several factors bear on the global pattern we observed in this
tional affairs.46,47 The trend is not confined to the United States but analysis: patents on basic discoveries before utility is demon-
is also evident in Europe. Despite the demonstrable successes of ear- strated (such as of cancer-related genes), tying surgical proce-
lier decades, the primacy of science as the source of improved health dures (such as deep brain stimulation) to specific patented de-
is today questioned because of the convergence of several forces. vices, abuse of the litigation process by patent aggregators (known
First, despite bold promises, advances visible to the public have formally as nonperforming entities or pejoratively as patent trolls),
been less frequent because solutions to many conditions like au- and the high cost of patent filing and defense in multiple countries.
tism, Alzheimer disease, and most cancers remain elusive, with nei- Universities and investigators alike see that patenting early-stage dis-
ther effective prevention nor treatment, despite intensive re- coveries rarely results in financial returns because costs exceed roy-
search. Second, drug discovery has proven more difficult and less alty revenue, except for occasional, high-value findings, which are
predictable than many had expected, with a decline over the past 2 serendipitous and economically unpredictable.
decades in altogether new classes of drugs, new registrations, and Three changes can align intellectual property protections with
drugs in clinical trials. Third, the economics of medical advances are incentives for substantive, clinically important advances and would
being scrutinized as a source of added insurance cost, with grow- be accomplished by changes to current federal law.51,52
ing pressure to justify clinical value using objective criteria, formal Defer patents to later in the discovery chain, awarding to the en-
tools of technology assessment, and consideration of quality-of- tity demonstrating clinical utility as well as the inventor. Because
life measures separately from those that affect mortality. Some tech- costs are greatest and risks highest to those who finance and con-
nology skeptics have even urged that the United States take a tech- duct later-stage clinical development, those risks should be re-
nology holiday for a decade, suggesting that the money saved be flected in intellectual property protections.
spent on ensuring that everyone receives existing preventive and Ensure that patents are granted only for truly novel, not just in-
therapeutic means, even if this slows scientific discovery.48 cremental, technologies, with clinical procedures remaining in the
Such tensions are perhaps inevitable, given the high cost and public domain.
poor performance of US health care as judged by international mor- Establish patent pools, which allow innovators to share value and
tality comparisons. Skepticism of medical research is evident in re- cost to encourage free exchange of information and set technol-
cent US budget discussions, which have favored the physical sci- ogy standards. Patent pools have operated successfully since the
ences as faster, reliable, and more predictable routes to US 19th century and are today common in semiconductors, aero-
competitiveness than the uncertainties of medicine. Also, medical space, and entertainment.51,53
devices and new manufacturing practices for large-molecule bio- Taken together, these changes could foster fundamental, not
pharmaceuticals are heavily driven by engineering advances, which incremental, innovation and could facilitate more effective collabo-
in turn depend more on the physical sciences and less on the bio- rations. They are also prerequisites for generating new sources of
logical sciences. These trends imply that pressure will mount to di- investment.
vert resources away from challenging but high-potential avenues in
biology.

Conclusions
Patents and Intellectual Property
As this analysis demonstrates, at the same time support for bio- The information assembled in this article does not do justice to the
medical research in the United States has wavered, global interest breadth and depth of medical research in the United States and other
in biomedical research is increasing.49 Asia and Europe are now on countries. For any current or future patient, research provides hope.
par with the United States in the relative number of researchers, and For the researcher, unanswered biological and clinical questions are
Asia, especially China, is making rapid gains in life science patents endlessly fascinating. For a company or its investors, new products
and highly cited publications. Although the United States is far from and services promise financial return, often at levels greater than
losing its preeminent role in biomedical research, similar historical other industries. For the policy maker, biomedical research is a route
changes have occurred in other industries (eg, electronics, automo- to national competitiveness as well as to enhanced public health and
biles, industrial manufacturing) that over time reshaped the coun- economic vitality.
trys competitiveness. Many in the United States applaud the new Our perspective for this examination has been primarily eco-
interest in other countries as a reflection of the truly international nomic, although the value of research surely is not solely eco-
reach of science, since discoveriesmade anywherecan be ap- nomic. Therefore, in our view, biomedical science and technology
plied here. This optimistic view neglects the strong barriers cre- must be seen in a broader context, with its myriad roles recog-

jama.com (Reprinted) JAMA January 13, 2015 Volume 313, Number 2 187

Copyright 2014 American Medical Association. All rights reserved.

Downloaded From: http://jama.jamanetwork.com/ by a Pontificia Universidad Javerian User on 12/14/2015


Clinical Review & Education Special Communication The Anatomy of Medical Research

nized: as a source of competitiveness on the international stage; as The analysis underscores the need for the United States to find
a vehicle to satisfy curiosity; as a means to provide realistic hope to new sources to support medical research, if the clinical value of its
patients and families who must confront grave conditions. None of past science investment and opportunities to improve care are to
those roles will necessarily be reflected in reduced health care costs. be fully realized. Substantial new private resources are feasible,
Therefore, a new calculus is required to weigh them as decisions of though public funding can play a greater role. Both will require non-
cost and value are made. traditional approaches if they are to be politically and economically
Clearly, the pace of scientific discovery and need for service im- realistic. Given global trends, the United States will relinquish its his-
provement have outstripped the capacity of current financial and torical innovation lead in the next decade unless such measures are
organizational models to support the opportunities afforded. undertaken.

ARTICLE INFORMATION 6. Pharmaceutical Research and Manufacturers of 21. Stevens H. Life Out of Sequence: A Data-Driven
Author Contributions: Dr Moses had full access to America. 2013 Biopharmaceutical Research Industry History of Bioinformatics. Chicago, IL: University of
all of the data in the study and takes responsibility Profile. July 2013. http://www.phrma.org/sites Chicago Press; 2013.
for the integrity of the data and the accuracy of the /default/files/pdf/PhRMA%20Profile%202013.pdf. 22. Goodwin I. Engineers proclaim top
data analysis. Dr George and Mr Palisch contributed Accessed November 24, 2014. achievements of 20th century, but neglect
equally. 7. Chatterjee SK, Rohrbaugh ML. NIH inventions attributing feats to roots in physics. Phys Today.
Study concept and design: Moses, Matheson, translate into drugs and biologics with high public 2000;53(5):48-49.
Cairns-Smith, Dorsey. health impact. Nat Biotechnol. 2014;32(1):52-58. 23. Fortunato S. Prizes: Growing time lag threatens
Acquisition, analysis, or interpretation of data: All 8. Gross CP, Anderson GF, Powe NR. The relation Nobels. Nature. 2014;508(7495):186.
authors. between funding by the National Institutes of
Drafting of the manuscript: Moses, Matheson, 24. Daniels RJ, Rothman P. How to reverse
Health and the burden of disease. N Engl J Med. the graying of scientific research. March 4, 2014.
Cairns-Smith, George, Palisch. 1999;340(24):1881-1887.
Critical revision of the manuscript for important http://online.wsj.com/news/articles
intellectual content: All authors. 9. Gillum LA, Gouveia C, Dorsey ER, et al. NIH /SB10001424052702304026804579411293375850348.
Statistical analysis: Moses, George, Palisch. disease funding levels and burden of disease. PLoS Accessed April 15, 2014.
Administrative, technical, or material support: One. 2011;6(2):e16837. 25. Moses H III, Martin JB. Biomedical research and
Moses, Matheson, Cairns-Smith, Dorsey. 10. Citeline. Citeline Pharma R&D Annual Review health advances. N Engl J Med. 2011;364(6):567-571.
Study supervision: Moses, Matheson, Cairns-Smith, 2014. 2014. http://www.citeline.com/resource 26. Crowley WF Jr, Sherwood L, Salber P, et al.
Dorsey. -center/whitepapers/. Accessed April 21, 2014. Clinical research in the United States at a
Conflict of Interest Disclosures: All authors have 11. Pharmaceutical Research and Manufacturers of crossroads: proposal for a novel public-private
completed and submitted the ICMJE Form for America. Rare Disease: A Report on Orphan Drugs partnership to establish a national clinical research
Disclosure of Potential Conflicts of Interest. Dr in the Pipeline. http://www.phrma.org/sites/default enterprise. JAMA. 2004;291(9):1120-1126.
Moses reports membership in a variety of /files/pdf/Rare_Diseases_2013.pdf. Accessed April 21, 27. Bridging the gap. The Economist. June 28, 2014.
foundation and company boards in health care and 2014. http://www.economist.com/news/united-states
financial services. Dr Moses, Messrs Matheson and 12. Reardon S. Regulators adopt more orphan /21605932-country-where-everyone-drives-
Palisch, and Dr Cairns-Smith report providing drugs. Nature. 2014;508(7494):16-17. america-has-shoddy-roads-bridging-gap. Accessed
management consulting services to hospital November 26, 2014.
systems, insurers, foundations, and 13. National Science Foundation. Business R&D and
pharmaceutical, device, and IT companies. Dr innovation survey. http://www.nsf.gov/statistics 28. Green bonds: spring in the air. The Economist.
Dorsey reports consultancy for Amgen, Avid /srvyindustry/about/brdis/. Accessed April 21, 2014. March 22, 2014. http://www.economist.com/news
Radiopharmaceuticals, Clintrex, Lundbeck, 14. US Census Bureau. Annual and quarterly /finance-and-economics/21599400-bonds-tied
Medtronic, the National Institute of Neurological services. http://www.census.gov/services/. Accessed -green-investments-are-booming-spring-air. Accessed
Disorders and Stroke, and Transparency Life April 21, 2014. April 21, 2014.
Sciences; a filed patent related to telemedicine and 15. Currency converterforeign exchange rates. http: 29. Orszag PR, Emanuel EJ. Health care reform and
neurology; and stock/stock options in Grand //www.oanda.com/currency/converter/. Accessed cost control. N Engl J Med. 2010;363(7):601-603.
Rounds (a second opinion service). No other December 23, 2013. 30. Callahan D. Taming the Beloved Beast: How
disclosures were reported. Medical Technology Costs Are Destroying Our Health
16. Organisation for Economic Co-operation and
Development. OECD science, technology and R&D Care System. Princeton, NJ: Princeton University
REFERENCES Press; 2009.
statistics. http://www.oecd-ilibrary.org/science
1. Moses H III, Matheson DHM, Dorsey ER, George -and-technology/data/oecd-science-technology 31. Mullard A. Drug makers and NIH team up to find
BP, Sadoff D, Yoshimura S. The anatomy of health -and-r-d-statistics_strd-data-en. Accessed April 21, and validate targets. Nat Rev Drug Discov. 2014;13
care in the United States. JAMA. 2013;310(18):1947- 2014. (4):241-243.
1963.
17. Thomson Innovation. http://info 32. Arriaga AF, Gawande AA, Raemer DB, et al;
2. Moses H III, Dorsey ER, Matheson DH, Thier SO. .thomsoninnovation.com/. Accessed April 21, 2014. Harvard Surgical Safety Collaborative. Pilot testing
Financial anatomy of biomedical research. JAMA. of a model for insurer-driven, large-scale
2005;294(11):1333-1342. 18. National Science Foundation. Science and
engineering indicators 2012: outputs of S&E multicenter simulation training for operating room
3. Dorsey ER, de Roulet J, Thompson JP, et al. research: articles and patents. http://www.nsf.gov teams. Ann Surg. 2014;259(3):403-410.
Funding of US biomedical research, 2003-2008. /statistics/seind12/c5/c5s4.htm. Accessed April 21, 33. Pronovost PJ, Wachter RM. Progress in patient
JAMA. 2010;303(2):137-143. 2014. safety: a glass fuller than it seems. Am J Med Qual.
4. National Institutes of Health Office of Budget. 19. McGraw Hill Financial. S&P Dow Jones indices 2014;29(2):165-169.
Price indexes. 2013. http://officeofbudget.od.nih data services. http://www.djindexes.com 34. Eappen S, Lane BH, Rosenberg B, et al.
.gov/gbiPriceIndexes.html. Accessed December 23, /dataservices/?go=sectorclassification. Accessed April Relationship between occurrence of surgical
2013. 21, 2014. complications and hospital finances. JAMA. 2013;
5. Johnson JA. Brief History of NIH Funding: Fact 20. New York Stock Exchange. Index services. http: 309(15):1599-1606.
Sheet. Washington, DC: Congressional Research //www1.nyse.com/about/listed/mkt_indexes_other 35. Semel ME, Resch S, Haynes AB, et al. Adopting
Service; 2013. http://www.fas.org/sgp/crs/misc _us.shtml. Accessed November 24, 2014. a surgical safety checklist could save money and
/R43341.pdf. Accessed April 15, 2014.

188 JAMA January 13, 2015 Volume 313, Number 2 (Reprinted) jama.com

Copyright 2014 American Medical Association. All rights reserved.

Downloaded From: http://jama.jamanetwork.com/ by a Pontificia Universidad Javerian User on 12/14/2015


The Anatomy of Medical Research Special Communication Clinical Review & Education

improve the quality of care in US hospitals. Health 42. Mokyr J. The Lever of Riches: Technological //www.people-press.org/2009/07/09/public
Aff (Millwood). 2010;29(9):1593-1599. Creativity and Economic Progress. Oxford, England: -praises-science-scientists-fault-public-media/.
36. Cryer L, Shannon SB, Van Amsterdam M, Leff Oxford University Press; 1990. Accessed April 15, 2014.
B. Costs for hospital at home patients were 19% 43. Murphy K, Topel R. Diminishing returns? the 48. Hoffman A, Emanuel EJ. Reengineering US
lower, with equal or better outcomes compared to costs and benefits of improving health. Perspect health care. JAMA. 2013;309(7):661-662.
similar inpatients. Health Aff (Millwood). 2012;31(6): Biol Med. 2003;46(3)(suppl):S108-S128. 49. Chakma J, Sun GH, Steinberg JD, Sammut SM,
1237-1243. 44. Fingar T, Jishe F. Ties that bind: strategic Jagsi R. Asias ascentglobal trends in biomedical
37. Pearl R. Kaiser Permanente Northern California: stability in the US-China relationship. Wash Q. 2013; R&D expenditures. N Engl J Med. 2014;370(1):3-6.
current experiences with Internet, mobile, and 36(4):125-138. 50. Stewart TA. The Wealth of Knowledge:
video technologies. Health Aff (Millwood). 2014;33 45. Battelle. 2012 Global R&D Funding Forecast. Intellectual Capital and the Twenty-First Century
(2):251-257. December 2011. http://www.google.com Organization. New York, NY: Crown Publishing Group;
38. International Consortium for Health Outcomes /url?sa=t&rct=j&q=&esrc=s&source=web&cd 2007.
Measurement. http://www.ichom.org/the-global =1&sqi=2&ved=0CB4QFjAA&url=http%3A%2F 51. Lerner J, Tirole J. Intellectual property: a better
-standard/. Accessed April 15, 2014. %2Fbattelle.org%2Fdocs%2Fdefault-document route to tech standards. Science. 2014;343(6174):
39. Mathews AW. WellPoint advises -library%2F2012_global_forecast.pdf&ei 972-973.
health-care providers. March 18, 2014. =F2Z2VOXTOK_0iAL9t4HwBQ&usg
=AFQjCNHrfksQwizVx6NpJHsMu-3D52dXGw&sig2 52. Azoulay P, Lerner J. Technological innovation
http://online.wsj.com/news/articles and organizations. In: Gibbons R, Roberts J, eds.
/SB10001424052702303563304579447632330535824. =J1eOrORABYjbIfm9GPTDmA&bvm=bv
.80642063,d.cGE. Accessed November 26, 2014. The Handbook of Organizational Economics.
Accessed April 15, 2014. Princeton, NJ: Princeton University Press; 2013:575-
40. Urbach DR, Govindarajan A, Saskin R, Wilton 46. Emanuel EJ. The future of biomedical research. 603.
AS, Baxter NN. Introduction of surgical safety JAMA. 2013;309(15):1589-1590.
53. Rai AK, Eisenberg RS. Bayh-Dole reform and
checklists in Ontario, Canada. N Engl J Med. 2014; 47. Pew Research Center. Public praises science; the progress of biomedicine. Am Sci. 2003;2003
370(11):1029-1038. scientists fault public, media. July 9, 2009. http: (66):289-314.
41. Cortese DA. A health care encounter of the 21st
century. JAMA. 2013;310(18):1937-1938.

jama.com (Reprinted) JAMA January 13, 2015 Volume 313, Number 2 189

Copyright 2014 American Medical Association. All rights reserved.

Downloaded From: http://jama.jamanetwork.com/ by a Pontificia Universidad Javerian User on 12/14/2015

Das könnte Ihnen auch gefallen