TRG Val Aibf Assign3 pc002pt2 Instructions v1

Canadian Forces Training Development Centre (CFTDC)
Training Validation Course (AIBF)

PC 002 Part 2 (Assignment 3) – Analyze Validation Data
AIM
1. The aim of this assignment is to confirm your ability to analyze validation data and
ultimately propose evidence-based recommendations (i.e. recommendations based on the data)
to improve the Bison Driver course.
INSTRUCTIONS
2. As part of your data collection and after consultation with your stakeholders, you already
sent surveys to the graduates of the Bison Driver course and their immediate supervisors.
Because of the importance of this validation, your chain of command wanted to gather data from
the past three years.
3. Most of the surveys were returned completed and you used your geek skills to collate all
the answers in tables for easier analysis. After this hard work, you are ready to analyze your
data to find trends.
4. You organized your validation data in two parts:
a. Part 1 – Data collected from graduates; and
b. Part 2 – Data collected from supervisors;
5. As the Validation representative, your task is to analyze the data collected from the
Bison Driver validation surveys to provide recommendations. To do this, you must:
a. read the raw data included in Annex B;
b. group data and find trends as part of your findings;
c. determine conclusions based on your findings; and
d. provide evidence-based recommendations (i.e. recommendations based on the

data).
6. The analysis of your data is a critical phase of your validation. To ensure you
demonstrate a sound analysis, complete the provided template for both the graduate and
supervisor responses. Your final document should have:
a. Introduction:
(1) purpose of the study;
(2) data collection tool used;
(3) duration of data collection period;
(4) summary of the data collected, such as:
1
(a) overall demographics;
(b) number of closed-ended questions;
(c) number of open-ended questions; and
(d) return rate;
(5) determination of decision criteria:
(a) closed-ended questions percentage to be considered of interest

(e.g. tasks performed on the job by less than 70% of respondents
might be good to analyse to figure out why it is not performed that
often); and
(b) number of times a comment is made in response to an open-

ended question to be considered of interest (e.g. a comment must
be mentioned at least three times to be considered of interest for
this study).
b. Observations / Trends in the data:
(1) demographics’ numbers and percentages;
(2) trends in closed-ended questions responses percentage, such as:
(a) number / percentage of abstentions to closed-ended questions (if

relevant);
(b) tasks not being performed often on the job (based on decision
criteria); and
(c) confidence level after the course;
(3) number of times a comment is repeated as per open-ended questions

responses;
(4) summary of training for baseline tasks, considering:
(a) tasks requiring more training;
(b) tasks requiring less training; and
(c) tasks requiring improvement to training;
c. Considerations for analysis:
(1) note any irregularities in the data;
2
(2) potential political issues (i.e. problems with discrimination, gender

inequality, harassment, failure to follow the TP, not enabling training in
both official languages, etc.); and
(3) individuals in a position that require (or do not require) this qualification;
d. Completed FCR Chart, with a minimum of 3 recommendations:
(1) Organize findings by theme;
(2) Findings supported by data;
(3) Conclusions summarize the findings and determine causes of the

problematic finding; and
(4) Recommendations based on conclusions and will most likely fix the
problematic finding;
e. Conclusion:
(1) appropriateness of the tool for data collection;
(2) quantity and quality of data collected for the analysis; and
(3) next phase of the validation study.
7. While providing your recommendations, keep in mind the information from the scenario
in Assignment 1 and your validation plan to address the issues that started the validation
process and to improve the Bison Driver course.
RESOURCES
8. References:
a. CFTDC Training Validation (AIBF) course website;
b. CFITES vol. 8, Validation of Instructional Programmes;
c. CFITES vol. 11(1), Evaluation and Validation Techniques; and
d. Bison Driver (AGMP) Qualification Standard and Training Plan (QSTP).
9. Useful files:
a. Validation analysis template;
b. Annex A – PC 002 part 2 checklist; and
c. Annex B – Data collected from graduates and supervisors.
3
DELIVERABLES
10. Submit your analysis in one file.
11. You can create charts and graphs to illustrate your findings (this is good to “see the
data” and this will be useful in your next assignment). If you do, put them in an Annex to your
analysis document.
12. Name the file, the header of each file AND the submission email using the following
naming convention: PC002pt2_Name_Three last.
13. Submit email with attached file to CFTDC.validation@gmail.com.
IMPORTANT NOTES
14. To successfully complete this assignment, you MUST provide a summary of the analysis
of graduates’ data AND supervisor’s data, along with an FCR Chart as specified in the
deliverables. Assessment criteria are found below.
15. PC assessment criteria are found in Annex A. Failure to appropriately complete this
assignment as above means failure of this assignment. Failure of the assignment constitutes a
failure of the Performance Check (PC). This assignment is PC 002 Part 2. The impact of the
student’s failure of this PC is an Independent Review Board (IRB) or a Progress Review Board
(PRB). See the Assessment Plan (Annex C) of the Training Validation (AIBF) Training Plan
below for further details.
FEEDBACK
16. Feedback will be provided individually by the instructor ASAP (NLT 24 hours after
submission) because feedback from this assignment will be required to complete the next
assignment. While waiting for your feedback, you can start the next portion of the course, but
ensure you receive feedback before submitting the next assignment.
4
Annex A – Assignment 3 – Checklist
AIBF – PC 002 part 2 – Analyze Validation Data

Candidate Name Assessor Name Date Course session
UN
ITEM SAT COMMENTS
SAT
1. The Validation analysis document shall contain:
Introduction
- purpose of the study
- data collection tool used
- duration of data collection period
- summary of the data collected
- determination of decision criteria
Observations / Trends in the data

- demographics’ numbers and percentages
- trends in closed-ended questions responses percentage
- number of times a comment is repeated as per open-
ended questions responses
- summary of training for baseline tasks (if applicable)
o tasks requiring more training
o tasks requiring less training
o tasks requiring improvement to training
- All statements justified by data
- Accurate quantitative data analysis (i.e. analysis of
closed-ended questions)
- Accurate qualitative data analysis (i.e. analysis of open-
ended questions)
Considerations for analysis

- Note any irregularities in the data
- Consideration for political issues
- Consideration for individuals in a position that requires
or does not require the qualification
FCR chart (minimum of 3)
- Data in findings are relevant
- Data in findings are presented clearly
- Use of FCR Chart clearly links findings, conclusions, and
recommendations
- Recommendations are realistic and achievable
Data analysis conclusion

- Appropriateness of the data collection tool
- Quantity and quality of data collected for the analysis
- Link to next phase of the validation
A – 1/2
Annex A – Assignment 3 – Checklist
ADDITIONAL COMMENTS
Strengths: Areas of development:
The candidate has received a debrief and seen the content of this assessment
Overall Assessment (circle one) PASS FAIL
Name Date Signature
Assessor
Candidate
Assessment notes:
1. Failure to appropriately complete any item of the above checklist means failure of this assignment and
failure of Performance Check (PC) 002 part 2.
2. As per the Training Validation (AIBF) Training Plan (TP), “a candidate will normally be permitted 1 x
repeat PCs on any failed PO to a maximum of 2 x POs […]”. The candidate will receive remedial training in the
form of individualized feedback / discussion with the instructor before being given a supplementary attempt to
modify and resubmit the PC.
3. If still unsuccessful, as per CFTDC SOP 4000-2 “CFTDC Student Progress Review”, an Independent
Review Board (IRB) or a Progress Review Board (PRB) may be convened. See the Assessment Plan in Annex
C for further details of each assessment.
A – 2/2
Annex B – Assignment 3 – Raw Data from Data Collection
PART I – DATA COLLECTED FROM GRADUATES
The following data was compiled from a survey sent to graduates from the last three
sessions of the Bison Driver course. It is considered raw data not yet analyzed.
Table 1 – Total number of graduates for survey / questionnaire, interview or

focus-group
Number of Graduates
Number Number Surveys
Year course
Surveyed/Interviewees/Focus- Returned/Interviewed/Focus-
completed
group Participants Requested grouped Participants
2018 40 31
2019 148 133
2020 24 20
Total 212 184
Table 2 – Graduates’ demographics / general information for survey /

questionnaire, interview or focus-group
Graduates’ Demographics / General Information

Yes 166
Since graduation, have you been in a
No 15
position requiring this qualification?
Other (explain) 3
Less than 3 20
3-6 125
What are your years of service? 7-10 21
11-20 17
21 or more 1
Same occupation 150
Your supervisor is Different occupation 34
Civilian 0
Operational (deployed or un-deployed) 18
What category best describes your unit? Non operational 149
Headquarters 17
What is your first official language? English 110
B – 1/30
French 74
Regular 184
What is your component?
Reserve 0
1. Validation Survey for the BISON DRIVER (AGMP) / Questionnaire de validation

CONDUCTEUR DE BISON (AGMP) - STUDENT
What is your rank? / Quel est votre grade actuel?
CWO/Adjuc
Number Of

Responses:0 Percentage
Of Responses(0%)
MWO/Adjum
Number Of

Of Responses(0%)
WO/Adj
Number Of

Of Responses(0%)
Sgt/Sgt
Number Of

Of Responses(1%)
MCpl/Cplc
Number Of

Of Responses(16%)
Cpl/Cpl
Number Of

Of Responses(72%)
Pte/Sdt
Number Of

Of Responses(11%)
Total: 184
1. PO 002: Operate the Bison

Have you completed the following tasks since the end of your course?
Execute move off, stop, steer and reverse manoeuvre with the Bison
OREN 002: Utilisation du Bison
B – 2/30
Avez-vous accompli les tâches suivantes depuis la fin de votre cours?

Exécution de manœuvres en marche avant ou arrière et de manœuvres d’arrêt et de virage avec
le Bison
Yes/Oui
Number Of

Of Responses(90%)
No/Non
Number Of

Of Responses(9%)
Not yet/Pas encore

Number Of

Of Responses(1%)
Total: 184
2. Negotiate obstacles with the Bison. / Franchissement d’obstacles avec le Bison
Yes/Oui
Number Of

Of Responses(77%)
No/Non
Number Of

Of Responses(20%)
Not yet/Pas encore

Number Of

Of Responses(3%)
Total: 184
3. Drive the Bison tactically. / Conduite tactique du Bison
Yes/Oui
Number Of

Responses109 Percentage
Of Responses(59%)
No/Non
Number Of

Of Responses(33%)
Not yet/Pas encore

Number Of
B – 3/30
Of Responses(8%)
Total: 184
4. Driving the Bison cross country. / Conduite hors route du Bison
Yes/Oui
Number Of

Of Responses(69%)
No/Non
Number Of

Of Responses(26%)
Not yet/Pas encore

Number Of

Of Responses(5%)
Total: 184
5. Driving the Bison in black out drive. / Conduite du Bison avec extinction des feux et phares
Yes/Oui
Number Of

Of Responses(58%)
No/Non
Number Of

Of Responses(31%)
Not yet/Pas encore

Number Of

Of Responses(11%)
Total: 184
6. Driving the Bison with night driving aid. / Conduite du Bison avec le dispositif d’aide à la
conduite de nuit
Yes/Oui
Number Of

Of Responses(39%)
No/Non
Number Of

Of Responses(49%)
Not yet/Pas encore

Number Of
B – 4/30
Of Responses(11%)
Total: 184
7. Execute road movement with the Bison. / Exécution de mouvements routiers avec le Bison
Yes/Oui
Number Of

Of Responses(79%)
No/Non
Number Of

Of Responses(17%)
Not yet/Pas encore

Number Of

Of Responses(3%)
Total: 184
8. Driving on roads and built up areas with the Bison. / Conduite du Bison sur des routes et
dans des zones bâties
Yes/Oui
Number Of

Of Responses(78%)
No/Non
Number Of

Of Responses(17%)
Not yet/Pas encore

Number Of

Of Responses(5%)
Total: 184
9. Load/unload the Bison on transporters/rail cars. / Chargement et déchargement du Bison
avec des dispositifs de transport et des charriots sur rail
Yes/Oui
Number Of

Of Responses(36%)
No/Non
Number Of

Of Responses(51%)
Not yet/Pas encore
B – 5/30
Number Of

Of Responses(13%)
Total: 184
10. If you indicated that you have not performed either some or all of the tasks in PO 002 since
your course. Why? / Si vous avez mentionné que vous n’aviez pas exécuté certaines des tâches
ou que n’aviez exécuté aucune des tâches de l’OREN 002 depuis la fin du cours; expliquez
pourquoi.

Not Applicable (Completed all tasks) / Non applicable

Number Of

Of Responses(26%)
Lack of equipment or resources/Manque d’équipement ou de ressources

Number Of

Of Responses(8%)

Not in a position required to perform that task/Ces tâches ne font pas partie du poste
occupé
Number Of

Of Responses(31%)
Lack of opportunity/Il n’y pas eu d’occasions

Number Of

Of Responses(33%)
Other/Autres
Number Of

Of Responses(2%)
Total: 184
11. PO 002: If "Other", please explain. / OREN 002: Si "Autre", s'il vous plaît expliquer
je ne suis pas attitrer comme chauffeur bison presentement (not yet trained to drive Bison)
Number Of

Of Responses(8%)
Apres mon cours de Bison , entant que Techinicienne Medical, j<ai ete poste a la clinique.
Number Of

Of Responses(8%)

nous some pas autoriser a conduire avec le night vision (We’re not authorized to drive with the night
driving aid)
Number Of

Of Responses(8%)
B – 6/30

2-4 Bisons - between 6 - 12 drivers in SQ at any given time And I am currently working in a Stores
Position
Number Of

Of Responses(8%)
Never had night-time driving aid available.

Number Of

Of Responses(8%)
haven’t touched it since my course. being medically released

Number Of

Of Responses(8%)
Night driving aid was not taught or used during course.

Number Of

Of Responses(8%)
la conduite avec le dispositif de nuit (Night driving aid)

Number Of

Of Responses(8%)

Il n'y a pas de systeme de vision nocturne disponible a mon unite (night driving aid not available at
my unit).
Number Of

Of Responses(8%)
nil
Number Of

Of Responses(8%)
Total: 13
12. Please rate how confident you feel in your abilities to perform the tasks of PO 002 today. /
Veuillez indiquer votre niveau de confiance dans votre aptitude à exécuter aujourd’hui les
tâches de l’OREN 002.

Very confident/ Très confiant

Number Of

Of Responses(60%)
Confident/ Confiant
Number Of

Of Responses(27%)
Somewhat confident/ Relativement confiant

Number Of
B – 7/30
Of Responses(10%)
Not confident/ Je ne suis pas confiant

Number Of

Of Responses(3%)
Total: 184
13. How often are you provided with opportunities to use the skills gained from this course
during garrison and field training events/exercises? /
Au cours de l’instruction en garnison et des exercices/activités d’entraînement en campagne, à
quelle fréquence avez vous l’occasion de mettre en pratique les compétences que vous avez
acquises dans le cadre de ce cours?
Daily/ Tous les jours

Number Of

Of Responses(14%)
Weekly/ Toutes les semaines

Number Of

Of Responses(22%)
Monthly/ Tous les mois

Number Of

Of Responses(17%)
Quarterly/ Tous les trois mois

Number Of

Of Responses(17%)
Semi-Annually/ Tous les six mois

Number Of

Of Responses(7%)
Annually/ Chaque année

Number Of

Of Responses(23%)
Total: 184
14. How would you assess the timing of this course in your career? / Considérez-vous avoir
suivi le cours à un moment opportun dans votre carrière?

This course was conducted at the right time/Ce cours a eu lieu au bon moment.
Number Of

Of Responses(50%)

I would have benefited more if I had taken it earlier/Ce cours m’aurait été plus profitable si je l’avais
suivi plus tôt.
B – 8/30
Number Of

Of Responses(36%)

I would have benefited more if I had taken it later/Ce cours m’aurait été plus profitable si je l’avais
suivi plus tard.
Number Of

Of Responses(2%)
I do not know yet/Je ne sais pas encore.

Number Of

Of Responses(12%)
Total: 184
15. Was the duration of the course adequate in length? / La durée du cours était-elle adéquate?

Yes/Oui
Number Of

Of Responses(81%)
The course duration should be shortened/Le cours devrait être moins long.
Number Of

Of Responses(7%)
The course duration should be lengthened/Le cours devrait être plus long.
Number Of

Of Responses(10%)
Uncertain/Incertain
Number Of

Of Responses(3%)
Total: 184
16. How would you rate your overall level of satisfaction with the course? / Quel est votre degré
de satisfaction général par rapport au cours?
Very Satisfied / Très satisfait

Number Of

Of Responses(38%)
Satisfied / Satisfait
Number Of

Of Responses(57%)
Dissatisfied / Insatisfait
Number Of

Of Responses(4%)
B – 9/30
Very Dissatisfied / Très insatisfait

Number Of Responses:2

Percentage Of
Responses(1%)
Total: 184
17. If you answered "Dissatisfied" or "Very Dissatisfied" please explain why: / Si vous avez
répondu « Insatisfait » ou « Très insatisfait », veuillez expliquer pourquoi :

I am a vehicle technician so i feel that it was a waste of time for me to do the driver maint. portion of
the course since i do all the maint on the bison
Number Of

Of Responses(9%)
As a maintainer I should of recieved coyote quals along with this course so as to be able to test drive

coyote after repairs were completed. It would save alot of time and money for the DND if We were
qualified coyote along with bison on this course.
Number Of

Of Responses(9%)
More time spent driving cross country

Number Of

Of Responses(9%)
Great instructors and well taught, but 4 or 5 day course not sufficient to cover every single aspect of
the vehicle and get familiar with functions of vehicle that chain of command would expect you to be
familiar with such as (remote control) winch operation, generator operation, ration heater operation,
tire chain installation, some maintenance procedures, etc. I have been verbally reprimanded for not
having sufficient knowledge about the bison features that were not covered or breezed over in
passing in training because of the usual time constraints in the military. Crash courses and condensed
versions of courses certainly are practical and can meet a basic operational requirement, but when

courses are condensed (trimming the fat) like is happening in many courses in the military, the
general chain of command should be notified that participants and successful graduates of these
courses are getting basic training and not in depth training. Of course, the age old problem also is
getting the training and then not touching the equipment for many months after training is
completed and being expected to remember. For example, in my unit I may drive the bison for a few
exercises during one season of the year on built up roads to the FOB where it sits at the CP and then
is driven back after EX. Not enough exposure to become confident and competent both on course
and exposure on job.
Number Of

Of Responses(9%)

I simply have not been in a position to drive or service the Bison since my course; which has been over
a year ago. Also, the course content was reduced to fit a time table / schedule.
Number Of

Of Responses(9%)
B – 10/30
The course material was skipped over a lot by the staff. My confidence level of being able to maintain

the vehicle was depicted earlier in this survey, and my previous statement is the reasoning. The junior
staff we had instructing stated most of the material being taught was not for the operator to sustain
but for the mechanics.
Number Of

Of Responses(9%)
The instructor I had was very unfamiliar with the vehicle and unprepared for lectures. My unit

transport was also completely unfamiliar with whether or not a road test was needed and my permit
lapsed before they could figure out it was not needed.
Number Of

Of Responses(9%)
Instructors were not very knowledgeable on the Bison. Often would call vital components by the
wrong name. Or not emphasize important maintenance subjects. The course never installed chains.
Did not teach importance of tire pressure. On the driving circuit encouraged students to go full

throttle into large bodies of water, causing water and mud to unnecessary enter vehicle, this is not a
good practice to teach people, instead could have properly demonstrated pushing the water and
driving behind it. Neither instructors knew where the seat lock was on drivers seat( very dangerous
and should have been highlighted as a major safety hazard.) however if you don’t even know the
vehicle you should not be teaching others it.
Number Of

Of Responses(9%)
Total: 11
18. Please add any additional comments or observations about the course or this survey. /
Veuillez ajouter vos commentaires ou remarques sur le cours ou le sondage.
The course could definitely be expanded on to cover MRT/MRV/Amb and CP variants. Each variant
covers different equipment and ancillary devices.
Number Of

Of Responses(3%)
Instructors need to provide more emphasis on the maintenance responsibilities between the driver

and the mechanics. Such as whose responsibility it is to conduct oil changes and brake shoe
replacements. It seems there's some confusion or just plain laziness taking affect.
Number Of

Of Responses(3%)
some of the instructors were exemplary however the several were not.
Number Of

Of Responses(3%)
bon cours / (good course)

Number Of
B – 11/30
Of Responses(3%)
J'ai trouvé que l'opération du bison en mode black out, atch down était particulièrement dangereuse

et stressante. Je n'ai aucune envie de revivre l'expérience. (I found operating in blackout mode
extremely dangerous and stressful. I don’t want to do it again.)
Number Of

Of Responses(3%)

Our variant of the Bison was in the list provided, it have its own specific training requirements such as
height and weight of the vehicle. Variant; Bison MEWT
Number Of

Of Responses(3%)
Maint And Troubleshoot EOs Not long or in depth enough

Number Of

Of Responses(3%)

I am a V-Tech and these driver courses are essential for us to be able to completely perform our jobs
effectively as we perform most of the tasks listed above on a daily basis.
Number Of

Of Responses(3%)

should have more field time in a training area such as wainright for more time to practice armoured
convoys and cross country driving cfb Edmonton’s training area is lacking for area to practice in
Number Of

Of Responses(3%)

This course was taken in SVC and directly related to daily activity. Since then I am posted to a unit
without Bison and have no further interaction with the vehicle to improve or remember the skills.
Number Of

Of Responses(3%)

The course I was on was very well done. I found urban/built up areas, driving was the hard part of the
course. We did enough urban driving to make me feel confident in that regard.
Number Of

Of Responses(3%)

Not as many opportunities as I would like to drive, but they do come around, in the up-coming
exercises may provide more of an opportunity to use this qualification.
Number Of

Of Responses(3%)

Sur le cours, on n'a pas eu asser de temps de conduite. (on the course, we didn’t have enough driving
time)
B – 12/30
Number Of

Of Responses(3%)

Knowledge on how components work was pushed to much on our level more focus on maintaining at
these parts should have been done more.
Number Of

Of Responses(3%)
I am now working at RCEME school CFB Borden, so I no longer have as much activities with the Bison

as before. I believe as a vehicle tech it would be very useful to get this training as part of my OJT
portion of my DP1. Also as a maintainer the course should be modified as the basic DI and other
service oriented EOs should be either taken out or lengthen to better utilise the time.
Number Of

Of Responses(3%)

I was moved to a new job role within 6 months of completion of my course, and because of this I was
not in a position to have daily interaction with the vehicle and perform many of the tasks listed above.
Number Of

Of Responses(3%)
Bon cours. bonne instructions. (good course and good training)

Number Of

Of Responses(3%)

More driving time. Course should strive for more then just minimum KM required to pass. Some
people felt unconfident and should have gotten some more time driving one.
Number Of

Of Responses(3%)
The course was a very good course. a lot of information was passed on during the course. The only
thing that I think the course needs to emphasize a bit more is the safety of the driver seat. It is

mentioned in the course that there is a locking pin in there that when you do maintenance on the
vehicle you need to lock the seat in place. I know for a fact that we were taught this on our course but
I talked to some other drivers and they didint know that there was a pin to lock the seat in place.
Number Of

Of Responses(3%)
Recently changed position, new position does not have Bisons.

Number Of

Of Responses(3%)
trop de theorie sur la mecanique (too much mechanical/engine theory)

Number Of

Of Responses(3%)
good, course , taught by maintainers , very knowledgeable staff.
B – 13/30
Number Of

Of Responses(3%)
The question above... "How often are you provided with opportunities to use the skills gained from

this course during garrison and field training events/exercises?" Doesn't allow me to properly answer
it. Since my course, I have not been near or touched a Bison.
Number Of

Of Responses(3%)
I am ASCC bison qualified which is the CP version.

Number Of

Of Responses(3%)
Today I moved to a new squadron in my regiment so it should be noted I will no longer be operating

the Bison. The only time I ever drove the Bison after my course was either to second line maintenance
or the fuel pumps. It was almost constantly grounded for something.
Number Of

Of Responses(3%)
Tire chain install, Prepare Bison for air, rail, land and sea moves, driving the bison tactically and doing
night driving, execute move off, stop, steer and reverse manoeuvre with the Bison and Load/unload
the Bison on transporters/rail cars does not seem to happen at all unless if mission specific. Driving

the bison with the night driving aid made it hard for my eyes to focus, as opposed to driving in
blackout mode. I would like to the the use of the night driving aid (or the fish bowl) done away with.
These listed items above are what my confidence is generally intended for as somewhat confident.
Some have not been done at all.
Number Of

Of Responses(3%)
Great course! But could have used more night driving practice.
Number Of

Of Responses(3%)
B – 14/30
PART II – DATA COLLECTED FROM SUPERVISORS
The following data was compiled from supervisors of graduates of the last three years of
the Bison Driver course. It is considered raw data not yet analyzed.
Table 3 – Number of supervisors
Number of Supervisors
Number Number Surveys
Surveyed/Interviewees/Focus-group Returned/Interviewed/Focus-
Participants Requested grouped Participants
Total 85 79
Table 4 – Supervisors’ demographics / general information for survey /

questionnaire, interview or focus-group
Supervisors’ Demographics / General Information

Less than 6 months 9
Since when, have you been in a supervisor 6-12 months 20

position for graduates? 12- 18 months 30
18 and plus months 20
Less than 3 3
3-6 10
What are your years of service? 7-10 26
11-20 30
21 or more 10
Same occupation 60
Your graduate is Different occupation 19
Civilian 0
Operational (deployed or un-deployed) 66
What category best describes your unit? Non operational (incl PRes unit) 11
Headquarters 2
English 51
What is your first official language?
French 28
Regular 72
What is your component?
Reserve 7
B – 15/30
1. Validation Survey for the BISON DRIVER (AGMP) - Supervisor

Questionnaire de validation CONDUCTOR DE BISON (AGMP)
What is your rank? / Quel est votre grade actuel?
Maj/Maj
Number Of

Of Responses(0%)
Capt/Capt
Number Of
Of Responses(1%)
Lt/Lt
Number Of
Of Responses(1%)
CWO/Adjuc
Number Of

Of Responses(0%)
MWO/Adjum
Number Of
Of Responses(1%)
WO/Adj
Number Of

Of Responses(14%)
Sgt/Sgt
Number Of

Of Responses(39%)
MCpl/Cplc
Number Of

Of Responses(38%)
Cpl/Cpl
Number Of

Of Responses(5%)
Total: 79
2. PO 002: Operate the Bison

Has your subordinate completed the following tasks since the end of their course?
Execute move off, stop, steer and reverse manoeuvre with the Bison
B – 16/30
OREN 002 : Utilisation du Bison

A votre subordonné exécuté les tâches suivantes depuis la fin de leur cours?
Exécution de manœuvres en marche avant ou arrière et de manœuvres d’arrêt et de virage
avec le Bison
Yes/Oui
Number Of

Of Responses(90%)
No/Non
Number Of

Of Responses(8%)
Not yet/Pas encore

Number Of

Of Responses(3%)
Total: 79
3. Negotiate obstacles with the Bison / Franchissement d’obstacles avec le Bison
Yes/Oui
Number Of

Of Responses(87%)
No/Non
Number Of

Of Responses(10%)
Not yet/Pas encore

Number Of

Of Responses(3%)
Total: 79
4. Drive the Bison tactically / Conduite tactique du Bison
Yes/Oui
Number Of

Of Responses(66%)
No/Non
Number Of

Of Responses(20%)
B – 17/30
Not yet/Pas encore

Number Of

Of Responses(14%)
Total: 79
5. Driving the Bison cross country / Conduite hors route du Bison
Yes/Oui
Number Of

Of Responses(84%)
No/Non
Number Of

Of Responses(14%)
Not yet/Pas encore

Number Of

Of Responses(3%)
Total: 79
6. Driving the Bison in black out drive. / Conduite du Bison avec extinction des feux et phares
Yes/Oui
Number Of

Of Responses(62%)
No/Non
Number Of

Of Responses(20%)

Not yet/Pas encore

Number Of

Of Responses(18%)
Total: 79
7. Driving the Bison with night driving aid / Conduite du Bison avec le dispositif d’aide à la
conduite de nuit
Yes/Oui
Number Of

Of Responses(39%)
No/Non
B – 18/30
Number Of

Of Responses(33%)
Not yet/Pas encore

Number Of

Of Responses(28%)
Total: 79
8. Execute road movement with the Bison / Exécution de mouvements routiers avec le Bison
Yes/Oui
Number Of

Of Responses(89%)
No/Non
Number Of

Of Responses(9%)
Not yet/Pas encore

Number Of

Of Responses(3%)
Total: 79
9. Driving on roads and built up areas with the Bison / Conduite du Bison sur des routes et
dans des zones bâties
Yes/Oui
Number Of

Of Responses(86%)
No/Non
Number Of

Of Responses(11%)
Not yet/Pas encore

Number Of

Of Responses(3%)
Total: 79
10. Load/unload the Bison on transporters/rail cars / Chargement et déchargement du Bison

avec des dispositifs de transport et des charriots sur rail
Yes/Oui
B – 19/30
Number Of

Of Responses(28%)
No/Non
Number Of

Of Responses(39%)
Not yet/Pas encore

Number Of

Of Responses(33%)
Total: 79
11. If you indicated that your subordinate did not perform some or all of the tasks in PO 002
since your course. Why?
Select all that apply:
Si vous avez indiqué que votre subordonné n’a pas accompli une ou plusieurs tâche de l’OREN
002 depuis son cour
Choisissez toutes les réponses pertinentes:

Not Applicable (Completed all tasks) / Non applicable

Number Of

Of Responses(25%)
Lack of equipment or resources/Manque d’équipement ou de ressources

Number Of

Of Responses(3%)

Not in a position required to perform that task/Ces tâches ne font pas partie du poste
occupé
Number Of

Of Responses(20%)
Lack of opportunity/Il n’y pas eu d’occasions

Number Of

Of Responses(48%)
Other/Autres
Number Of

Of Responses(4%)
Total: 79
12. PO 002: If "Other", please explain / OREN 002: Si "Autre", s'il vous plaît expliquer
Members were qualified during the Bge reconstibution phase, not field Ex that required us to bring

B – 20/30
our Bison.
Number Of

Of Responses(20%)
Manque d’équipement. Il n’y pas eu d’occasions.

Number Of

Of Responses(20%)

Sur quatre candidats, il y a un seul candidat qui ne peut faire aucune de ses tâches avec confiance. Les
autres candidats sont confiant.
Number Of

Of Responses(20%)

As Vehicle techs they need to "prove" their repairs and must operate the equipment to confirm this.
We have no Bisson vehicles at my unit.
Number Of

Of Responses(20%)
do no have a bison
Number Of

Of Responses(20%)
Total: 5
13. Please rate how confident you feel in your subordinates abilities to perform the tasks of PO
002 today. / SVP indiquez votre niveau de confiance en les habilités de votre subordonné à
accomplir les tâches de l’OREN 002.

Very confident/ Très confiant

Number Of

Of Responses(47%)
Confident/ Confiant
Number Of

Of Responses(46%)
Somewhat confident/ Relativement confiant

Number Of

Of Responses(6%)
Not confident/ Je ne suis pas confiant

Number Of
Of Responses(1%)
Total: 79
B – 21/30
14. Is your subordinate in a job that requires this qualification? / Est-ce que votre
subordonné est employé dans une position qui requiert cette qualification?

Yes / Oui
Number Of

Of Responses(85%)
No / Non
Number Of

Of Responses(14%)
They should be within the next 6 months / Le sera dans les prochains six mois
Number Of
Of Responses(1%)
Total: 79
15. How often has your subordinate(s) used the skills gained from this course? / Combien de
fois votre (vos) subordonné(s) a-t-il mis à profit les compétences acquises pendant le cours?
Daily/ Tous les jours

Number Of

Of Responses(15%)
Weekly/ Toutes les semaines

Number Of

Of Responses(37%)
Monthly/ Tous les mois

Number Of

Of Responses(29%)
Quarterly/ Tous les trois mois

Number Of

Of Responses(8%)
Semi-Annually/ Tous les six mois

Number Of
Of Responses(1%)
Annually/ Chaque année

Number Of

Of Responses(10%)
Total: 79
B – 22/30
16. How would you assess the timing of this course for your Subordinate? / Comment évaluez-
vous le calendrier de ce cours pour votre subalterne?

This course was conducted at the right time/Ce cours a eu lieu au bon moment.
Number Of

Of Responses(56%)

I would have benefited more if I had taken it earlier/Ce cours m’aurait été plus profitable si je l’avais
suivi plus tôt.
Number Of

Of Responses(22%)

I would have benefited more if I had taken it later/Ce cours m’aurait été plus profitable si je l’avais
suivi plus tard.
Number Of

Of Responses(4%)
I do not know yet/Je ne sais pas encore.

Number Of

Of Responses(19%)
Total: 79
17. Did your subordinate have the necessary combination of training and experience prior to
starting this course? / Est-ce que votre subordonné avait la combinaison necessaire
d’entraînement et d’expérience pour entâmer ce cours?
Yes / Oui
Number Of

Of Responses(87%)
No / Non
Number Of

Of Responses(3%)
Uncertain / Incertain
Number Of

Of Responses(10%)
Total: 79
18. Do you feel that the duration of the course was adequate in length to prepare your
subordinate(s) for their duties? / Croyez-vous que la durée du cours était adéquate pour
preparer votre (vos) subordonné(s) à remplir ses fonctions?

Yes / Oui

Number Of
B – 23/30
Of Responses(73%)
The course duration should be shortened / Le cours devrait être moins long.
Number Of
Of Responses(1%)
The course duration should be lengthened / Le cours devrait être plus long.
Number Of

Of Responses(13%)
Number Of

Of Responses(13%)
Total: 79
19. How satisfied are you with your subordinate’s training from this course? / Êtes-vous
satisfait de l’instruction reçue par votre subordonnénpendant ce cours?

Very Satisfied / Très satisfait

Number Of

Of Responses(56%)
Satisfied / Satisfait
Number Of

Of Responses(42%)
Dissatisfied / Insatisfait
Number Of
Of Responses(1%)
Very Dissatisfied / Très insatisfait

Number Of
Of Responses(1%)
Total: 79
20. Is there anything that should be removed or covered in less detail from this course? /
Indiquez s'il y a quelque chose qui, selon vous, devrait être retiré de l'instruction ou couvert de
façon moins détaillée?

Yes / Oui
Number Of

Of Responses(23%)
No / Non
B – 24/30
Number Of

Of Responses(53%)
Number Of

Of Responses(24%)
Total: 79
21. If yes, please explain / Si oui, s'il vous plaît expliquer
Theory of Operation with the Night Sight.

Number Of

Of Responses(14%)

The member is a DP2 Veh Tech. If the course is to be taught to a member of this level of qualifacation,

it should be modified to target areas of needed improvement such as night driving and not to review
already confirmed knowledge of the vehicle.
Number Of

Of Responses(14%)
The theory of thermal imagery could easily be removed.

Number Of

Of Responses(14%)
Again, mbr is not currently in a position that requires her to drive the Bison.
Number Of

Of Responses(14%)
I cannot speak on the most recent layout or instruction of the Bison as I did the course in 2006, but I

have utilized the Bison on many road moves, taskings and Exercises and haven't had much issues WRT
my training, but I have heard my subordinates mention how they need more training on night driving
and blackout driving.
Number Of

Of Responses(14%)
Total: 7
22. Is there anything that should be added or covered in more detail on this course? /
Indiquez s'il y a quelque chose qui, selon vous, devrait être ajouté à l'instruction ou couvert de
façon plus détaillée?

Yes / Oui

Number Of
B – 25/30
Of Responses(19%)
No / Non
Number Of

Of Responses(51%)
Number Of

Of Responses(30%)
Total: 79
23. If yes, please explain / Si oui, s'il vous plaît expliquer

More emphasis should be placed on driving tactically cross country and blackout/night driving. This
phase of the course was limited and is what the students do most following completion of the course.
Number Of

Of Responses(6%)
More off road driving, as a Veh Tech, more towing of other Bisons
Number Of

Of Responses(6%)
Conduite hors route - Les conditions ne le permettaient pas en février. Plus de temps de conduite

avec le dispositif d’aide à la conduite de nuit - Les conditions ne le permettaient pas en février. (More
off-road and night driving – the conditions in February didn’t allow them to do these things then)
Number Of

Of Responses(6%)

Les circonstances et les situations que nous devont utilisé le ¨FAST IDLE¨. (More training on FAST
IDLE)
Number Of

Of Responses(6%)
Courses to Veh tech 00129, should be completed at a much earlier state in the members career. If the
training were to take place at the completion of the DP1.1 level, the member would be able to

operate MRT's that they will tasked to in the nearest future. Also, this would give the CAF the option
of modifying the course to cater to the specific trade and save a considerable amount of time and
money on future training.
Number Of

Of Responses(6%)

more maintence on the Bison, wheel changes, oil and filter changes, and include the oran generator as
part of the course
Number Of

Of Responses(6%)
B – 26/30
If possible, have maintainers conduct the maintenance portion of the course. having the vehicle

mechanics teach provides far more insight that just some random trade. Our courses were lucky in
that we had maintainers as instructors who went above and beyond to teach the students about the
maintainance portion.
Number Of

Of Responses(6%)
While teaching troubleshooting it is tough to "manufacture" problems. The theory of common

problems is easy to cover, but nobody wants vehicles to break down during a course, so they are
treated gently. By adding more driving time (all aspects - built up areas and tactical/night driving
especially) there is more chance of real life break downs, which would force proper fixes rather than

instructions on theory. Also, with different variants of a Bison, some aspects may be left out, whereas
if all variants can be covered, it can add to the knowledge. Example - A Signaller may learn on a CP
variant with APU, but not know the accessories of an AMB or MRV/MRT. Mechanics may learn on an
MRT but not understand the APU. Comms system could easily be covered in more depth in this
course. Or make ATCIS(intermediate) a pre-req of the course. Pers should be able to troubleshoot
comms problems if they arise, as the crew commander must be able to communicate with the driver.
Number Of

Of Responses(6%)
MORE NIGHT DRIVIN TIME

Number Of

Of Responses(6%)
Entretient et heures de conduite

Number Of

Of Responses(6%)
Driving with "Fishbowl" night sights was not taught. NVG's were used instead.
Number Of

Of Responses(6%)

La maintenance opérateur est une partie importante du cours il doit connaître son véhicule et en
prend soin
Number Of

Of Responses(6%)
driver maintenance
Number Of

Of Responses(6%)
more night driving time

Number Of

Of Responses(6%)
B – 27/30
Same as above, I do have some subordinates that are Bison qualified and I feel confident in the

training that they received because I haven't had any issues since I came into their command WRT
utilizing the Bison.
Number Of

Of Responses(6%)
Total: 17
24. Please add any additional comments or observations about the course or this survey. /
Veuillez ajouter vos commentaires ou remarques sur le cours ou le sondage.
I was also the course programmer for the course. In my opinion the course was well run, at the right

time in most of the students careers and only requires minor adjustments – one of which being
procuring more blackout kits for night driving. Our unit got raided and took 4/6 kits we had due to
deployment.
Number Of

Of Responses(6%)

My current position has no Bison AVGP vehicles. My previous positions did, however, that was over a
year ago. My drivers then completed their course late 2018 while I completed mine in 2015.
Number Of

Of Responses(6%)
Cette formation devrait être donné plus souvent car ce sont de bon véhicule pour des Poste de

Commande et beaucoup plus mobile en terrain Hors route que les VSLR. Présentement nous utilison
ce véhicule comme PC CCSAO (au sein du STA) et les conducteurs sont une ressource qui se fait rare.
Number Of

Of Responses(6%)
Our students benefited greatly as we used a mechanic to explain in depth the coolant systems, turbo

even having the students not just remove the tires but change them of the rims and shown how to
plug them as well. At our unit there were always 2 or 3 Bisons in different stages of repair inside the
mechanics bay so we had the opportunity to have them see close up how to maintain and fix them.
Number Of

Of Responses(6%)
As a member of the Royal Canadian Dragoons, most MRT's are Bison MRT's and integrated into a Sqn.

It it essential that all members of Maintenance Troop have the Bison qualification to be able to
perform their job. There may be a need to run more courses due to APS each year.
Number Of

Of Responses(6%)
Bien que bien placé dans le tempo de l'Unité, ce cours aurait été plus profitable avec le dispositif

d’aide à la conduite de nuit. (Given our unit Operational tempo, this course would have been
beneficial to add more night driving training).
B – 28/30
Number Of

Of Responses(6%)
Resources and time are always problems. Without the TP changing, units will not allocate time
accordingly. Even by adding a few more days (max 5) and more Km (max 500) driver knowledge

retention and comfort (with size and handling of the vehicle) can be increased greatly. Special note
regarding Comms above... comms should be a pre-req or spend a minimum of 1-2 days to cover
basics, and basic troubleshooting. This will be even more important as these vehicles are updated
from IRIS to ELAN.
Number Of

Of Responses(6%)
le cours a été très bien monter. Le temp alloué a été adéquat et à la fin du cours les candidats était

confian avec le Bison. (The course was well run. Looks like the time allocated was adequate as the
students were confident driving the Bison)
Number Of

Of Responses(6%)
The member performed well during the major exercise he encountered since completing the course.
Number Of

Of Responses(6%)
The course is sufficient and gives all necessary information – but more night driving training would

better help them be ready for field EXs as soon as they get here. Luckily I am in a position where we
use these vehicles often and do not experience much skill fade.
Number Of

Of Responses(6%)

More time off-road would make for a more confident driver. Often the emphasis on getting required
km's equals more highway and less off-road.
Number Of

Of Responses(6%)
bonne formation (Good training)

Number Of

Of Responses(6%)
Total: 18
B – 29/30
Annex C – Assessment Plan
Ref: Training Validation (AIBF) Training Plan, 14 Apr 2009, Annex B - Assessment Plan
PC/EC Scope Purpose How When Time Resources Limitations Impact

PC 001 EO 001.01 – To assess the Practical At completion of N/A Office workstation, Candidate will not be IRB/PRB process applies
EO 001.03 candidate's ability to assessment EO 001.03 scenario, access to expected to plan strategic
plan a validation based on a DIN, references validation. The planning will
scenario be limited to the scenario and
may not take into
consideration all factors
involved in planning
PC 002 EO 002.01 To assess the practical At completion of N/A Office workstation, Candidate will not be IRB/PRB process applies
candidate's ability to assessment EO 002.01 scenario, access to expected to plan strategic
Part 1 create a validation based on a DIN, references validation. The planning will
tool scenario be limited to the scenario and
may not take into
involved in conducting a
validation including:
- conduct of validation via
interviews or observation
Part 2 analyze validation based on a DIN, references validation. The planning will
data scenario be limited to the scenario and
may not take into
Part 3 report validation based on a DIN, references validation. The planning will
findings scenario be limited to the scenario and
may not take into
C – 1/1

TRG Val Aibf Assign3 pc002pt2 Instructions v1

Hochgeladen von

Dokumentinformationen

Originaltitel

Copyright

Verfügbare Formate

Dieses Dokument teilen

Dokument teilen oder einbetten

Freigabeoptionen

Stufen Sie dieses Dokument als nützlich ein?

Sind diese Inhalte unangemessen?

Copyright:

Verfügbare Formate

TRG Val Aibf Assign3 pc002pt2 Instructions v1

Hochgeladen von

Copyright:

Verfügbare Formate

Canadian Forces Training Development Centre (CFTDC)

Training Validation Course (AIBF)

4. You organized your validation data in two parts:

a. Part 1 – Data collected from graduates; and

b. Part 2 – Data collected from supervisors;

a. read the raw data included in Annex B;

b. group data and find trends as part of your findings;

c. determine conclusions based on your findings; and

d. provide evidence-based recommendations (i.e. recommendations based on the

(1) purpose of the study;

(2) data collection tool used;

(3) duration of data collection period;

(4) summary of the data collected, such as:

(a) overall demographics;

(b) number of closed-ended questions;

(c) number of open-ended questions; and

(d) return rate;

(5) determination of decision criteria:

(a) closed-ended questions percentage to be considered of interest

(b) number of times a comment is made in response to an open-

b. Observations / Trends in the data:

(1) demographics’ numbers and percentages;

(2) trends in closed-ended questions responses percentage, such as:

(a) number / percentage of abstentions to closed-ended questions (if

(c) confidence level after the course;

(3) number of times a comment is repeated as per open-ended questions

(4) summary of training for baseline tasks, considering:

(a) tasks requiring more training;

(b) tasks requiring less training; and

(c) tasks requiring improvement to training;

c. Considerations for analysis:

(1) note any irregularities in the data;

(2) potential political issues (i.e. problems with discrimination, gender

d. Completed FCR Chart, with a minimum of 3 recommendations:

(1) Organize findings by theme;

(2) Findings supported by data;

(3) Conclusions summarize the findings and determine causes of the

(1) appropriateness of the tool for data collection;

(3) next phase of the validation study.

a. CFTDC Training Validation (AIBF) course website;

b. CFITES vol. 8, Validation of Instructional Programmes;

c. CFITES vol. 11(1), Evaluation and Validation Techniques; and

d. Bison Driver (AGMP) Qualification Standard and Training Plan (QSTP).

a. Validation analysis template;

b. Annex A – PC 002 part 2 checklist; and

c. Annex B – Data collected from graduates and supervisors.

10. Submit your analysis in one file.

13. Submit email with attached file to CFTDC.validation@gmail.com.

AIBF – PC 002 part 2 – Analyze Validation Data

Observations / Trends in the data

Considerations for analysis

Data analysis conclusion

PART I – DATA COLLECTED FROM GRADUATES

Table 1 – Total number of graduates for survey / questionnaire, interview or

Table 2 – Graduates’ demographics / general information for survey /

Graduates’ Demographics / General Information

1. Validation Survey for the BISON DRIVER (AGMP) / Questionnaire de validation

What is your rank? / Quel est votre grade actuel?

1. PO 002: Operate the Bison

OREN 002: Utilisation du Bison

Avez-vous accompli les tâches suivantes depuis la fin de votre cours?

Not yet/Pas encore

Not yet/Pas encore