Implementation and Satisfaction of RapidPlan Knowledge-based Planning Software in the

Clinical Setting
Lauren Brandl, BS; Marc Anderson, BS, RT(T); Renee Jackson, BS, RT(T); Nishele Lenards,
PhD, CMD, RT(R)(T); Matt Tobler, RT(T), CMD; Ashley Hunzeker, MS, CMD
Medical Dosimetry Program at University of Wisconsin, La Crosse, WI
Key Words: RapidPlan, Knowledge-based Treatment Planning, Varian, Automated Planning
Introduction
Creating a high-quality radiation therapy plan may be a challenging and time-consuming
process. There are many crucial steps that must occur when developing a successful treatment
plan. Perhaps one of the most important steps is the analysis of the anatomy and target as well as
the prediction of reasonable plan results; both of which are skills that require years of experience
to master. In recent years, radiation oncology vendors have developed technology capable of
automatically creating radiation treatment plans by doing exactly that – developing dose
predictions by looking at the targets and anatomy of previously developed plans as a template
from which to “learn.” One program that has gained popularity since its release in 2014 is
RapidPlan, developed by Varian Medical Systems.
RapidPlan is a knowledge-based planning system that provides clinicians with models
based on clinical practices from leading institutions. RapidPlan was released with the goal to
provide consistent, efficient, and higher quality plans for individualized treatments with less
variability.1 RapidPlan operates by evaluating the data set and comparing the geometric
proportions of new patient anatomy to the model that has been used for learning. By reviewing
the dose distributions of past plans with similar anatomy, the RapidPlan software can predict a
reasonable dose volume histogram (DVH) for nearby critical structures. The predictions are then
converted to optimization objectives which may be used to develop an intensity modulated
radiation therapy (IMRT) or volumetric modulated arc therapy (VMAT) plan.1
The utilization of a knowledge-based planning system, such as RapidPlan, proves to be a
promising method for improving the quality and efficiency of treatment planning.1,2 However,
there is a gap in the literature regarding the adoption, usage, and satisfaction levels of RapidPlan
users in radiation oncology departments. The purpose of this study was to determine if
RapidPlan is a desirable program for clinics to adopt and use, and to identify key components
that may improve a clinic's experience with the program. By creating a survey, we were able to
gauge interest levels in acquiring the software and understand what factors may affect current
users’ satisfaction with the program, ultimately leading to its implementation and further usage.
Materials and Methods
Study Population
The respondent population consisted of American Association of Medical Dosimetrists
(AAMD) 2019 National Conference attendees, specifically a convenience sample of those
participating in the three “Eclipse Advanced Users” treatment planning workshops and the
“Varian Velocity” workshop. The intent was to distribute the surveys to Varian users; the
population most likely to have prior knowledge of or experience with RapidPlan. Participation in
the survey was limited to active Certified Medical Dosimetrists and Medical Physicists
regardless of experience using RapidPlan. The study was limited to these positions in order to
collect responses from those regularly planning treatments. A survey was distributed to all of
those in attendance of the four workshops.
Survey
In order to gain insight, an anonymous survey was created in Qualtrics in an effort to
gauge participant's knowledge, satisfaction and implementation of RapidPlan. Survey questions
were categorized into 3 basic types; the first identified professional status and familiarity with
RapidPlan. The second group of questions were directed only to those professionals that have
implemented RapidPlan in their radiation oncology departments. The third group of questions
were general questions concerning model-based planning and potential future use of Rapid plan.
The questionnaire was estimated to take no longer than 3 minutes to complete. The survey may
be viewed in the appendix.
Data Collection
Hard-copy surveys were distributed and collected from medical physicists and medical
dosimetrists attending the four treatment planning sessions. In addition to distribution of hard
copies to attendees, an online link to the survey was also provided. Once completed, the printed
surveys were collected. In order to store the responses in a digital format, each paper survey was
entered manually into an online survey tool. Entry accuracy was verified by two additional
individuals.
Statistical Analysis
 The survey was conducted in June of 2019 and compiled in July 2019. Data analysis was
performed to acquire a greater understanding of perceived adequacy and adoption. Survey
responses to RapidPlan-user dependent questions answered by those who do not have the
software were removed from recorded data. The results were then described in percentages of
usable responses for each question. The Qualtrics survey tool was used to house the data and
calculate the provided chart percentages, means, and standard deviations. Statistical significance
could not be achieved, therefore the summary of results were perceived qualitatively.
Results
Sixty-seven responses were collected from those attending the Varian workshops at the
AAMD national conference. An online link to the survey was also provided as an alternative to
the hard copies; none of the population used this tool. It is important to note not every question
required or received a response due to the question not applying to the situation of the
respondent, or simply the respondent not providing an answer.
Thirty percent of the respondents stated their department did have RapidPlan; however, 3
of those whose clinic did not have RapidPlan stated in a comment box that their department
would be implementing the software within the next 6 months. Of those who did not have access
to RapidPlan, 81% (n=42) gave a favorable response regarding their interest in adapting a
knowledge-based planning system into their department (Figure 1). A value of 6 or above on a
scale of 0-10, with 10 denoting “extremely interested” was deemed favorable.
Fifteen of the 21 departments (71%) with access to RapidPlan are using the program.
Results from the survey also showed the frequency in which clinics with access are using
RapidPlan. Fifteen responses were collected, and it was generally used on less than 10 patients
per week (69%). The prostate (25%) and the head and neck (23%) proved to be the most
common anatomic sites for which departments were equipped with models (Figure 2). Three
medical dosimetrists or medical physicists selected the choice, “Other,” with two writing in their
clinic also had sarcoma and oligometastases models, while one made known their department
replaced the original head and neck model to fit their clinical standards. With that being said, it
was found that a large majority (61%) of departments using RapidPlan have both added and
made adjustments to the models in use, while only 17% have made no changes (n=18) (Figure
3).
 There was significant interest in the 6 respondents with RapidPlan that are not utilizing
the program. However, only 5 responded to the following question regarding their rationale
behind not adopting the technology. Figure 4 demonstrates the responses received and the list of
potential reasons that may apply to their situation, with some checking multiple. “Insufficient
time to learn and adapt new technology” was the most commonly selected, chosen 3 times as the
reason for not using RapidPlan. The answer “Other” was chosen twice, in which one explained
they were waiting on a software upgrade, while the other was waiting on implementation of the
software.
When prompted to rank 7 theoretical advantageous features of a knowledge-based
planning system, “Speed of plan generation” was believed to be the most beneficial, having been
ranked in the top position in 50% of responses (n=47) (Figure 5). “Superior plan quality” was the
second most common response, receiving 23% of the remaining votes for the number 1 rank.
Speed was also the most common response when asked which of the above applied to their
actual experience using RapidPlan, with 81% selecting “Speed of plan generation” as part of or
their sole answer to the question (Figure 6).
Expected future use of RapidPlan was believed to increase in the departments of 13
(65%) of the respondents (n=20), while only 1 (5%) believed it would decrease. The survey
demonstrated overall satisfaction with RapidPlan when available in the department. The same 1-
10 scale as earlier was used, with 10 now denoting “Extremely satisfied.” Seventy-nine percent
gave favorable responses of a value of 6 or above, and 8 was discovered to be the most common
satisfaction level (26%, n=19) (Figure 7). Nearly every respondent with access to RapidPlan that
provided an answer (94%, n=17) declared they would recommend RapidPlan to other radiation
oncology departments.
Discussion
The purpose of this study was to determine if RapidPlan is a desirable program for clinics
to adopt and use, and to identify key components that may improve a clinic's experience with the
program. It was found that 69% (n=46) of those surveyed during the workshops have not
acquired RapidPlan software. However, 93% (n=39) of these individuals expressed interest in
adopting the planning system. It was also noteworthy that the most common response to this
question was the maximum interest level of 10, suggesting enthusiasm amongst medical
dosimetrists and medical physicists to employ such knowledge-based technology.
 According to a 2019 paper by Ge and Wu,3 the number of published articles regarding
RapidPlan was continually increasing, demonstrating a rising interest in the planning system. The
authors performed a meta-analysis of 73 manuscripts and stated that a majority of the research
demonstrated benefits of knowledge-based planning. The results of the current study support
previous literature by demonstrating that RapidPlan continues to gain popularity as the software
produces dependable, higher quality plans with less variability.1-4 According to Hao et al,2 it is
also a favorable solution to increase plan quality and reduce planning time.
In the clinical setting, time is undeniably valuable. Of the 21 facilities who currently own
RapidPlan software, 71% (n=15) of the facilities used its capabilities while 29% (n=6) did not. In
the current study analysis, the most common reason facilities were not utilizing RapidPlan
software was due to insufficient time to learn and adapt to new technology. New technology may
be intensely complex and hard to learn, and the training process and validation testing may be
tremendously time-consuming.4,5 Such factors could potentially add pressure to an already busy
schedule.5 However, ease of use was the second most common answer when asked which
beneficial features applied to the experience of RapidPlan users. In addition, the time it may take
to implement and learn the technology may quickly be made up in time saved using RapidPlan.4
The use of RapidPlan provides a greater potential of creating a high-quality radiation therapy
plan in less time for users of all ability levels.2,4
RapidPlan also allows clinicians to either use provided sample models shared from other
institutions or to develop models by creating their own database of plans.1 The current research
survey indicated the vast majority of clinical sites have added and/or adjusted plans which
RapidPlan uses as qualified models. The minimum number of plans required to create a model is
20, although expanding the amount used to build a model will increase the probability of a
higher quality treatment plan.1,6 Bodez et al6 demonstrated the effect of increasing the number of
previous treatments from which RapidPlan may “learn.” By extending the number of plans in the
model from 36 to 116, the chance of meeting criteria in a single optimization increased from
60% to 83.2%. The results of the study conducted by Bodez et al6 proved the value of adding to
and adjusting the model, which has been done by 61% (n=11) of the current research survey
respondents.
The findings of the current research survey showed that prostate and head and neck
cancers were the most common anatomical sites that facilities were using RapidPlan software for
planning assistance. The majority of knowledge-based planning studies have concentrated on
prostate, head and neck, and lung cancers.3 According to Ge and Wu,3 there are currently 60
articles available about knowledge-based planning for prostate, head & neck and lung, compared
to only 28 articles involving other anatomic sites.
The current study revealed that 68% (n=11) of the clinics utilized RapidPlan for less than
10 patients per week. The results may be due to clinic size or insufficient staff, but it is a number
that is expected to rise as the technology develops and more data is collected for each system.7 In
addition, more facilities are expected to capitalize on the potential increase in efficiency,
consistency, and quality of treatment plans offered by knowledge-based planning software such
as RapidPlan.6-8 The realization and understanding of this potential was observed in the results of
the survey, as 65% (n=13) of those already using RapidPlan expected their use of the program to
increase going forward. By incorporating such innovation into the workflow, cancer treatment
delivery and patient care as a whole have the potential to improve significantly.8 Following this
notion of embracing technology, it was found that 94% (n=16) would recommend RapidPlan to
other radiation oncology departments. As technology has helped increase the capabilities of a
dosimetrist, it was not a surprise that the overall user satisfaction with RapidPlan was
compellingly favorable.9
Conclusion
The purpose of this study was to determine if RapidPlan is a desirable program for clinics
to adopt and use, and to identify key components that may improve a clinic's experience with the
program. At the time of the survey, most departments employing RapidPlan were using the
program after some adjustment and/or addition to the models, suggesting an increase in user
satisfaction as modification is often associated with improved model performance. Although
most of the clinics with RapidPlan software were employing the technology, the most common
rationale for not using RapidPlan was insufficient time to learn and adapt new technology.
However, “Speed of plan generation” was the most commonly reported advantageous feature
while using RapidPlan, as well as the most theoretically advantageous feature of a planning
system. After putting in the necessary time to implement the program, the study suggests the
potential time saved by using RapidPlan may have a profound effect on user experience. The
above factors were found most likely to enhance user satisfaction with RapidPlan, ultimately
leading to its implementation and further usage in the department.
 Furthermore, the results of the survey did in fact demonstrate the desirability of
RapidPlan, as a majority of those surveyed who did not have access to RapidPlan showed
overwhelming interest in adopting the program into the clinic. Moreover, the vast majority of
those possessing the software did anticipate an increased presence of RapidPlan in the workflow.
Overall, nearly every respondent using the program would recommend RapidPlan to other
radiation oncology departments, confirming RapidPlan to be a desirable program used within the
clinic.
The current study had several limitations. As RapidPlan is a highly specialized program
pertaining only to the field of medical dosimetry, data collection was limited to only those
attending the 2019 AAMD national conference. The survey was provided to the small non-
random convenience sample of those who participated in the 4 Varian workshops. Further
research into the topic may benefit by polling a random, statistically significant sample
population. Second, the survey was created and printed to hard copies for participants to fill out.
Some surveys were excluded due to incomplete answers or responses not relevant to the situation
of the respondent. Time constraints were also a limitation, as the research was conducted as part
of a medical dosimetry program and deadlines were a concern. Finally, the survey did not
question how many patients per week on average are treated at each facility, which may affect
the interpretation of certain answers. Future research may address this regarding the proportion
of the patients being treated at a clinic in which RapidPlan was a part of the planning process.
 Acknowledgements
The authors would like to thank Dr. David Reineke and the UWL Statistical Consulting Center
for assistance in analysis and interpretation of statistical results of the study.
I would like to thank the Statistical Consulting Center at UW-La Crosse for its assistance with
Figure 5 and the analysis of data; however, any errors of fact or interpretation remain the sole
responsibility of the author.
 References
1. RapidPlan Knowledge Based Planning Software. Varian Medical Systems.
https://www.varian.com/oncology/products/software/treatment-planning/rapidplan-knowledge-
based-planning. Accessed April 20, 2019.
2. Hao W, Fan J, Haizhen Y, et al. Applying a RapidPlan model trained on a technique and
orientation to another: a feasibility and dosimetric evaluation. Radiat Oncol. 2016;11(108):1-7.
https://dx.doi.org/10.1186/s13014-016-0684-9
3. Ge Y, Wu Q, Knowledge-based planning for intensity modulated radiation therapy: A review of
data-driven approaches. Med Phys. 2019;46(6):2760-2775. https://dx.doi.org/10.1002/mp.13526
4. Li N, Carmona R, Sirak I, et al. Highly efficient training, refinement, and validation of a
knowledge-based plan quality control system for radiotherapy clinical trials. Int J Radiat Oncol
Biol Phys. 2017;97(1):164-172. https:/dx./doi.org/10.1016/j.ijrobp.2016.10.005
5. Garrett P, Brown A, Hart-Hester S, et al. Identifying barriers to the adoption of new technology
in rural hospitals: A case report. Perspect Health Inf Manag. 2006;3(9):1-11.
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2047308/
6. Bodez V, Khamphan C, Francois G, et al. Feedback on use of the RapidPlan™ knowledge-
based planning system for the realization of prostatic treatment planning in volumetric
modulated arc therapy. Physica Medica. 2017;44(1):6-7.
https://dx.doi.org/10.1016/j.ejmp.2017.10.037
7. Hussein M, South C, Barry M, et al. Clinical validation and benchmarking of knowledge-based
IMRT and VMAT treatment planning in pelvic anatomy. Radiat Ther Oncol. 2016;120(3):473-
479. https://dx.doi.org/10.1016/j.radonc.2016.06.022
8. Thompson R, Valdes G, Fuller C et al. Artificial intelligence in Radiation Oncology: A
specialty-wide disruptive transformation? Radiat Ther Oncol. 2018;129(3):421-426.
https://dx.doi.org/10.1016/j.radonc.2018.05.030
9. Mell L, Roeske J, Mundt A. A survey of intensity modulated radiation therapy in the United
States. Cancer. 2003;98(1):204-211 https://dx.doi.org/10.1002/cncr.11489
 Figures

Figure 1. Interest level displayed on a scale of 0 to 10, with 0 being not at all interested and 10
being extremely interested.

Figure 2. Anatomic sites for which users have RapidPlan models.

Figure 3. Manipulation of RapidPlan models when available in the department.

Figure 4. Rationale for not using RapidPlan when available in the department.
Figure 5. Rank Placement of Proposed Advantageous Features of a Knowledge-Based Planning
System.

Figure 6. Proposed advantageous features that have applied to the experience of RapidPlan
users.
Figure 7. Overall user satisfaction of RapidPlan when available in the department on a scale of 0
to 10, with 0 being not at all satisfied and 10 being extremely satisfied.
 Appendix
Questions and Answers to RapidPlan Survey
Questions Answers
1. What is your position in the radiation Medical Dosimetrist
oncology department? Medical Physicist
2. Does your department have the
Yes
knowledge-based planning program,
No
RapidPlan?
3. If your answer to question 2 was ""No:""
What is your overall interest level in
adapting a knowledge-based planning 0 (Not at all interested) - 10 (Extremely
system such as RapidPlan into your Interested)
department? (After responding, please
proceed to Question 9)
4. If your answer to question 2 was ""Yes:""
Is your department currently utilizing the Yes
RapidPlan knowledge-based planning No
software?
Cost of additional licenses or software
upgrades
Awaiting model availability in additional
anatomical sites
Awaiting further endorsement from larger
5. If your department has the RapidPlan number of clinics and peers
software but is not currently utilizing the Insufficient time to learn and adapt new
program, please check all applicable reasons technology
below as to why your department is not Insufficient resources to accommodate new
using RapidPlan. technology
Uninterested in automated planning method
Unsatisfied with existing model
performance
Program not user-friendly
Other (please list in text box)
6. If your department is currently utilizing
<10 patients per week
RapidPlan: For how many patients a week,
10-20 patients per week
on average, is RapidPlan a part of the plan
>20 patients per week
development process?
Head and Neck
7. For which of the following anatomic sites Liver
are you using RapidPlan models? Please GYN
check all that apply. Prostate
Lung
 Spine
Pancreas
Lymphoma
Other (Please list in text box)
Yes: Added to Model
8. Has your department adjusted or added to Yes: Adjusted Model
any of these models? Yes: Added and Adjusted
No
Speed of plan generation
9. Theoretically, what do you feel is the Plan quality measure
most advantageous feature of a knowledge- Ease of use
based planning system? Please drag to rank Superior plan quality
the following responses in order with 1 Ability to add to library and
being the most advantageous to 7 being least update/manipulate model
advantageous. If you are using a paper copy, Exposure to new technology in field of
please write in ranks 1-7 to the left of radiation oncology
choices. Ability to download and share existing
models amongst institutions
Speed of plan generation
Plan quality measure
Ease of use
Superior plan quality
10. Which of the above advantageous
Ability to add to library and
features apply to your experience with
update/manipulate model
RapidPlan? Please check all that apply.
Exposure to new technology in field of
radiation oncology
Ability to download and share existing
models amongst institutions
11. Would you recommend RapidPlan to Yes
other radiation oncology departments? No
Increased usage of RapidPlan
12. How do you foresee the utilization of Maintained usage of RapidPlan
RapidPlan in your department? Decreased usage of RapidPlan
Ceased usage of RapidPlan
13. Please rate your overall satisfaction with
0 (Not at all satisfied) - 10 (Extremely
the RapidPlan knowledge-based planning
satisfied)
software.
14. If you would like to leave the name of
your clinic, please do so below.