Beruflich Dokumente
Kultur Dokumente
Benchmark
Report
An Inside Look at What’s
Happening at the Benchtop
TABLE OF CONTENTS
1. INTRODUCTION 3
2. OBJECTIVES 4
What Are CRISPR Researchers Working On?
Is CRISPR Hard?
Are CRISPR Researchers Satisfied With Their Results?
3. SURVEY RESULTS 6
CRISPR Researchers Have Professionally Diverse Profiles
Do-It-Yourself CRISPR Is Hard. Now We Know Why
CRISPR Researchers Are Not Satisfied With Their Results
INTRODUCTION
CRISPR genome editing is revolutionizing the way researchers can analyze, with unprecedented
precision and control, how genes are linked to biological function. CRISPR shows promise in
several areas, particularly in the field of personalized gene therapies.
We at Synthego are just as excited about the present and future applications of CRISPR as you
are, but we need to acknowledge that it is an emerging technology that is just starting to be
adopted within the workflows of academic and industry labs.
Making the best choice between a completely in-house CRISPR workflow or outsourcing all or
part of the effort can be confusing, what with all the noise in the marketplace. Plus, the workflow
is complex, with multiple factors impacting the outcome of CRISPR experiments. Any misstep
could cost months of wasted time and thousands of dollars.
We wanted to take a closer look at what CRISPR researchers are experiencing in their own labs
to see what we can learn from our scientific community. Accordingly, we surveyed 207 scientists
using CRISPR to find out about their challenges, applications, success levels, and satisfaction with
their experimental results. This report provides a detailed summary of the responses and patterns
that emerged from the survey.
We hope that this information will help researchers choose the best tools and realistically
estimate the time, labor, and cost investment required for a successful CRISPR journey.
3
02 OBJECTIVES
OBJECTIVES
Most researchers take up the CRISPR challenge and embark on the do-it-yourself (DIY) route to
gain professional expertise in CRISPR. But CRISPR is complicated. Is the guide design right? How
many optimizations does my cell type need? Which transfection method should I use? These are
just a few of the questions that researchers need to grapple with when planning their CRISPR
experiment.
Yet, researchers have to balance complicated CRISPR workflows in the lab while managing their
project goals and deadlines.
4
02 OBJECTIVES
The utility of CRISPR is expanding every day, and we wanted to understand the current trends in
the field. We investigated applications, researcher experience levels, research focus areas, and
editing methods to understand the profiles of CRISPR researchers.
2. Is CRISPR Hard?
What is the most challenging part of the CRISPR workflow? How much time are researchers
devoting to each step?
We wanted to learn about researchers’ experience of running a CRISPR experiment, so our survey
included questions regarding the details of the DIY CRISPR experimental workflow. We were
particularly interested in understanding how factors such as transfection method, optimization
levels, CRISPR formats, and cell types, to name a few, impact the outcome of the experiment.
Besides understanding the challenges in a CRISPR experiment, we were also curious about the
perception of success among researchers. We asked if researchers are satisfied with the editing
efficiencies that they achieve in their CRISPR experiments. We also sought to determine the
ideal number of gene targets that they would like to study in parallel, as well their willingness to
outsource experiments while balancing their desire to master the CRISPR technique.
Our survey focused on the time and effort invested in experiments, but we also wanted to uncover
the true cost for researchers to execute the entire CRISPR workflow in their own lab. In the last
section in this report, we calculate the real cost of CRISPR based on data regarding hands-on
time, the duration for experimental completion, and the number of attempts before researchers
succeed.
5
03 RESULTS - CRISPR RESEARCHERS ARE DIVERSE
The survey respondents, in a nutshell, were professionally diverse. They ranged from graduate
students to executives, worked on a wide variety of applications and research areas, and
possessed CRISPR expertise, ranging from fewer than 6 months to more than 2 years. The
majority of the respondents worked in academia (66%), while 25% worked in industry settings,
such as biotechs and pharmaceuticals.
11.3%
Post-Doc
19.1%
16.7%
Staff
Scientist
Graduate
Student
6
03 RESULTS - CRISPR RESEARCHERS ARE DIVERSE
What
What Application
Application AreaArea is Research
is Your Your Research
FocusedIn?
On?
23.2%
19.3%
13.0%
9.2%
8.2%
7.2% 6.8% 6.3%
4.8%
1.9%
Animal Disease Screening/ Primary Other Diagnostics Target iPS Pathway Safety/Tox
Models Models Target ID and Stem Validation Cells Analysis
Cells
We included general questions in our survey to get an understanding of the popular research
application areas.
CRISPR can be used to do genome editing in animal models at various developmental stages,
often to understand particular diseases. It came as no surprise that animal and disease modeling
applications, which bring research one step closer to clinical applications, together formed the
focus of 42.5% of the researchers.
The remaining respondents were spread across other application areas, such as screening and
target ID applications (13%) and primary and stem cell studies (9.2%). Recently, there has been a
surge in target validation (6.8%) applications, particularly in protein biology and immunotherapy
and in pathway analysis studies (4.8%) that elucidate the function and interplay of genes involved
in a biological pathway or specific disease.
7
03 RESULTS - CRISPR RESEARCHERS ARE DIVERSE
What
What SpecificResearch
Specific Research Area
AreaAre
AreYou Studying?
You Studying?
18.0%
15.1%
12.2%
7.8%
6.8% 6.8% 6.3% 5.9%
4.4% 3.9% 3.4% 2.9% 2.4% 2.0% 2.0%
Cancer Neuroscience Basic Drug Immunology Cell and Dev Infectious Agriculture Therapeutics Other Immuno- Clinical Plant Metabolomics
Research Discovery Gene Biology Disease oncology Diagnostics Research
Therapy
The responses to the “Research Area” question were distributed across a wide spectrum of topics
indicating the diversity of areas in which CRISPR genome editing can play a role. Given the surge
of research in CAR T therapies and neurodegenerative disease research, it was no surprise that
cancer (18%) and neuroscience (15.1%) were the top two most studied research areas. Despite
CRISPR’s promising potential in cell and gene therapies and agriculture, basic research emerged
as a popular focus area among 12.2% of the survey participants.
Other interesting areas of focus included immunology, developmental biology, therapeutics, and
clinical diagnostics.
Resources
Curious about how CRISPR is being used in these application areas?
Check out our Application pages for descriptions of each of these areas.
8
03 RESULTS - CRISPR RESEARCHERS ARE DIVERSE
9
03 RESULTS - CRISPR RESEARCHERS ARE DIVERSE
12.8%
immortalized cell lines.
31.6%
Stem 13.8%
These days, more and more researchers are Cells
10
03 RESULTS - CRISPR RESEARCHERS ARE DIVERSE
Interestingly, these stats were consistent even when we analyzed researchers in academia
(68.2%) and industry (62.7%) separately. These data reaffirm the importance of CRISPR skills
among all researchers in the field.
11
03 RESULTS - DO-IT-YOURSELF CRISPR IS HARD
While CRISPR has promising potential and the scientific community is focused on its applications,
the issues that scientists face when dealing with CRISPR on a day-to-day basis are rarely given
as much attention. The major part of our survey investigated researchers’ experience with the
CRISPR workflow, including the time investment, success rate, and challenges in particular steps,
to name a few. As the results from the survey rolled in, one thing was clear—CRISPR is hard.
CRISPR is Tedious
Researchers spend an average of 61 hours of total hands-on time on a DIY
CRISPR experiment without accounting for the time spent on clones
The CRISPR workflow is tedious and labor-intensive. Planning and executing a successful CRISPR
experiment involves numerous steps, as each of them heavily influences the final outcome of the
experiment. On investigating the hands-on time that researchers spend on each step, the data
showed that researchers spend an average of 61 hours of hands-on time, without accounting
for the time spent on isolating clones.
HowMuch
How MuchHands-On
Hands-OnTime
Time is
is Required
Required Prior
Prior To
ToClonal
ClonalIsolation
Isolation Optimization
was the most
time-consuming
24 24 24 24 24
hours
6 18
hours
6 18
hours
6 18
hours
6 18
hours
6
step, accounting
12 12 12 12 12 for an average
Design Guide Optimization Transfection Analysis of 19.1 hours of
Preparation
researchers’ time.
31%
consider this step to be
the most challenging part
of the CRISPR workflow
Researchers also spent a significant amount of time on transfection (13.7 hours) and analysis (14.2
hours) steps.
12
03 RESULTS - DO-IT-YOURSELF CRISPR IS HARD
While the average hands-on time for all the CRISPR steps is reportedly 61 hours, the process
itself is spread out over several weeks. Researchers report an average duration of 10 weeks to
complete the guide design, guide preparation, optimization, transfection, and analysis steps of the
CRISPR experiment. Screening and isolation of clones with the desired edit reportedly requires an
additional 9 weeks, on average. This is the best-case scenario if researchers succeed in their first
attempt.
researchers are left with no choice but to repeat the whole experiment. Our survey results showed
that researchers restart their CRISPR experiments about 7 times, on average, before they obtain
their desired edit.
HowMany
How ManyTimes
Times
DoDo
YouYou Restart
Restart Your This means that the real-time investment
YourExperiment?
Experiment?
of CRISPR is 70 weeks, not 10 weeks, just
to obtain an edit.
29.2%
23.6%
The additional 9 weeks to take the successfully
edited cells to clone compounds the time
14.6%
13.5% 13.5%
investment even further. These numbers
indicate that a CRISPR experiment could easily
5.6%
cost researchers years of their time and effort,
13
03 RESULTS - DO-IT-YOURSELF CRISPR IS HARD
outcome.
What
What StepDo
Step DoYou
You Find
Find the
theMost
MostChallenging?
Challenging?
Design 17.5%
Optimization 30.8%
Transfection 9.9%
Analysis 8.8%
0% 20% 40%
Sometimes that’s enough, but sometimes it is not. Even after these optimizations, researchers
may end up with poor editing efficiencies. While Synthego offers a 200-point optimization to
ensure consistently high editing efficiencies for each cell type, performing a large number of
optimizations is challenging for labs that lack automation. Many researchers may thus not be able
to adequately assess their transfection parameters.
15
03 RESULTS - DO-IT-YOURSELF CRISPR IS HARD
Analysis Paralysis
About 48% of researchers don’t analyze indels; those that do analyze them report
an average editing efficiency of 43%
22.1%
I do not
Not analyzing indels is a risky move.
analyze
indels
Researchers who skip this step rely on
Next-generation
sequencing non-genomic methods as validation.
A large proportion (48.4%) of researchers reported that they don’t even genotypically analyze their
edits, and move directly to subsequent assays.
Researchers who
WhatWhat
Is Your Average
Is Your AverageEditing Efficiency?
Editing Efficiency?
do measure their
100%
success report an
average editing
Industry: 48% efficiency of 43%,
Academic: 40%
indicating that
fewer than half the
target sequences
are edited. Surprisingly, the stats did not change much even when we examined just knockouts,
which are generally known to have better efficiencies than knock-ins. Moreover, the survey data
showed that editing efficiencies achieved by researchers in academia and industry settings
were comparable at 40% and 48%, respectively. Interestingly, editing efficiency stats were not
correlated with years of CRISPR expertise.
16
03 RESULTS - DO-IT-YOURSELF CRISPR IS HARD
How
How ManyClones
Many Clones Do
DoYou
YouScreen?
Screen?
58.8%
Outsourcing to
Academic
53.3% Industry companies that
can offer efficiently
edited cells could
largely reduce the
25.3%
23.5% time spent on the
clonal isolation
10.7%
8.0% step.
5.9% 5.9% 5.9%
2.7%
Researchers noted that they screen about 137 cells on average in their experiment to identify
clones with the desired edit. While academic users screen 117 clones, researchers from industrial
settings reported screening an average of 206 cells to isolate clones with their desired edit.
These numbers are rather high, but quite expected if the editing efficiency is low. For comparison,
researchers who purchased a Synthego Knockout Cell Pool can screen just 20 clones on average
to obtain their desired edit, thanks to the high editing efficiencies (78%) of the pools.
Resources
Why is sgRNA increasingly being chosen over plasmids? Find out in this blog post.
Curious about the issues of using selectable markers in CRISPR? Learn more in this blog post.
Switching over from IVT to sgRNA format? Our Tips & Tricks guide has you covered!
Curious about our automated platform for optimizing CRISPR knockouts? Check out our
CRISPR Knockout Optimization application note!
Not sure which transfection method to choose? Here’s our online guide to help you decide.
Need reliable transfection protocols? Check out our Nucleofection, Electroporation, and Lipofection protocols.
Struggling with knock-ins? We’ve got you covered with our Tips & Tricks: Knock-ins resource.
17
03 RESULTS - RESEARCHERS NOT SATISFIED WITH RESULTS
While one objective of our survey was to understand the challenges that researchers face in
their DIY CRISPR workflows, we were also curious about their post-experiment status. Were
researchers satisfied with their editing efficiencies? Did they find the hard work worth it upon
crossing the finish line?
Long story short, the survey data says “no.” We elaborate on the data around researcher
satisfaction and speculate about the cause of their distress in the following section.
18
03 RESULTS - RESEARCHERS NOT SATISFIED WITH RESULTS
As noted in the previous section, researchers reported an average editing efficiency of 43%. The
number did not fluctuate drastically when comparing editing efficiencies of academic (40%) and
industry (48%) researchers.
Automation and engineering facilities enable Synthego to achieve 80% editing efficiencies in
different cell types, but these success levels are difficult to achieve consistently with limited
resources in the lab. It is no surprise that an even lower percentage of academic researchers
(12.2%) reported being “very satisfied” with their results. Researchers from industry seemed to fare
slightly better with 23.8% reporting being “very satisfied” with their average editing efficiencies.
It is worth noting from the data that an average of 48.4% of researchers, irrespective of whether
they are in academia or industry, are settling for editing efficiencies that they find only somewhat
satisfying.
19
03 RESULTS - RESEARCHERS NOT SATISFIED WITH RESULTS
CRISPR users reported that they would The time and cost spent in guide RNA design,
ideally like to study 17 gene targets at a time. genomic analysis, and clonal isolation steps, when
Yet, the complications and time constraints studying multiple gene targets, can compound to
of the CRISPR workflow allow them to a level where manual parallel processing becomes
investigate only 7 gene targets at a time. difficult and impractical.
This is not surprising, as targeting multiple
gene targets is not cost-free. While it might There is no single magic formula that works for
seem prudent to test multiple genes in everyone. Every research team defines their
the cell type optimization and transfection own “too much” and decides at what point they
steps, the hands-on time for other steps might look to outsourcing of one or more steps
adds up due to the individual complexities that allow them to study multiple gene targets in
and challenges each gene target presents. parallel to expedite their CRISPR experiment.
20
03 RESULTS - RESEARCHERS NOT SATISFIED WITH RESULTS
Are You Willing To Outsource On the other hand, researchers have to meet
AreYour
You CRISPR
Willing To Outsource Your
Experiment?
CRISPR Experiment? their project deadlines and/or accelerate their
Academic Industry
publications—a major career driver—while
learning on the go.
21
CRISPR Key Findings
Benchmark 2019 Edition
Report
An Inside Look at What’s Happening at the Benchtop
31%
43%
7 attempts
to achieve a successful find optimization to be
Editing efficiency CRISPR-edited cell the most challenging step
15%
report being
very satisfied studying 7 targets, however ideally
with their results would like to study 17 targets
$15,340 + $3,054
spent on hands-on spent on reagents
labor cost
472 hours
resulting in
=
hands-on time
across all 7 attempts to $18,394
successfully complete
the CRISPR workflow total cost of a successful
CRISPR experiment
04 CONCLUSION - DO-IT-YOURSELF CRISPR IS EXPENSIVE
Despite a majority of researchers finding it important to master the CRISPR technique, they are
not blind to its risks and associated time and cost investment. In the survey, a whopping 71% of
CRISPR DIYers said they would outsource their CRISPR experiments. When asked about the main
factor that would impact their decision, 46.1% noted their main concern was the price.
Price 46.1%
0% 20% 40%
This seems reasonable, but the “right duration of time required to complete the
price” is rather subjective. In order to help experiment, the number of clones screened (if
researchers put the true cost of DIY CRISPR any), and the number of failed attempts before
in perspective, we have calculated the cost of successfully generating their desired edit. Lab
a DIY CRISPR workflow. reagent and personnel labor costs were assumed
based on academic and industry-standard labor
Based on survey responses, we calculated rates and typical vendor reagent costs. Capital
the typical costs, hands-on time, and equipment and common wet laboratory costs
duration required to complete a successful (e.g., incubators, pipette tips, cell culture plates)
CRISPR editing experiment. We considered were assumed in the cost and were not included
the reported hands-on time that researchers in the calculation. Refer to the Appendix for
spend on each step of the CRISPR workflow, complete cost analysis and assumptions.
23
04 CONCLUSION - DO-IT-YOURSELF CRISPR IS EXPENSIVE
Average
24
05 APPENDIX
We conducted a blind online survey through various third-party life science publications that cater
to a scientific audience. The survey contained 36 questions, and respondents who did not have
any CRISPR experience were automatically disqualified. Survey respondents received a $25 gift
card for their participation.
For analyses, we received 207 responses to the survey from researchers that have either
previously done or are currently doing CRISPR experiments.
25
05 APPENDIX
REAGENT COSTS
# rxns Cost per
Step Reagent Cost Unit size Amount/rxn Cost/rxn required experiment TOTAL REAGENT COST
Transfection CRISPRMax $180.00 100 2 $3.60 13 $46.80
Culture/Cloning Media (DMEM + FBS) $70.00 1 1 $70.00 2 $140.00
Edit Transfection Plasmid + sgRNA + Cas9 $0.00 0 0 $0.00 0 $0.00
Analysis DNA extraction $168.00 50 1 $3.36 13 $43.68
Analysis Sanger sequencing $5.00 1 1 $5.00 26 $130.00 $360.48 Pool
Cloning Media (DMEM + FBS) $70.00 1 1 $70.00 2 $140.00
Analysis DNA extraction $355.00 96 1 $3.70 40 $148.00
Clonal Isolation
Analysis Clean Up Kit $103.00 96 1 $1.07 40 $42.80
Analysis Sanger sequencing $5.00 1 1 $5.00 40 $200.00 $530.80 Clone
$891.28 Total clone
LABOR COSTS
# of Hours Cost (Hours x $/hour)*
Desgin 7 $227.50
Synthesis 7 $227.50
Optimization 19 $617.50
Tranfection 14 $455.00 Time (pool) Labor (pool)
Analysis 14 $455.00 61 $1,982.50
Clone 45 $1,462.50 Time (clone) Labor (clone)
106 $3,445.00
26