Analysis of results of the survey circulated by

WG C and dealing with the integration of an

FDM Programme into an operator processes
Author : EOFDM WG C

Forewords
The European Operators Flight Data Monitoring (EOFDM) forum is a voluntary partnership between European
operators and the European Aviation Safety Agency (EASA) in order to:

facilitate the implementation of FDM programmes;

help operators in drawing the maximum safety benefits from an FDM programme.

There are four working groups (WG) in EOFDM, of which WG C focuses on the Integration of an FDM
programme into operator processes:

To define solutions for the integration of FDM into an operators Safety Management System (SMS);

To provide guidance that will help an operator to best manage:

limited resources;
relationships with top-management and unions;
the application of just culture or safety culture in the use of FDM data;
the dissemination of lessons learned from FDM within each company.

To identify best practice with regard to data handling:

during day-to-day operation (transfer from the aircraft to the ground, handling of memory media,
etc.);
in the long term, the de-identification of data and the storage in a secure way.

EOFDM WG C

Forewords
As a part of this work, WG C established a survey to determine the current practice by
operators as well as to identify best practice by industry. It could also be used to identify areas
where improvement could be encouraged.
The survey was conducted towards the end of 2013 and was closed in the second half of
January 2014. With 74 questions and a wealth of narrative text that was provided by survey
participants, once analysed the survey has provided a good deal of valuable data. Of the 50 full
responses, mostly coming from scheduled passenger operations, 80%

originated in EASA

Member States.

EOFDM WG C

The survey
The purpose of this survey was to establish what
forms of outputs operators have from their FDM
programmes.

All information collected are confidential and

de-identified;
The survey consists of around 70 questions;
Around 50 organisations answer.

NB: The survey contains MAIN questions with YES or NO answer. The answer NO to the
main question inhibits the following questions related to the same topic to be shown to the
interviewed
EOFDM WG C

The survey

PLEASE SELECT A
TO PI C O R CLI CK
TO CO N TI N UE

The survey covers the following topics:

OPERATOR GENERAL INFORMATION

view results

FDM TEAM

view results

THE FDM REPORT

view results

FEEDBACK TO CREWS/PERSONNEL

view results

USE OF FDM FOR TRAINING PURPOSES

view results

FEEDBACK TO FLIGHT OPERATIONS

view results

FEEDBACK TO OTHER AREAS

view results

WI TH THE WHO LE
PRESEN TATI O N

(FRMS, MAINTENANCE AND ATC)

view results

TOP MANAGEMENT REPORTS

CONCLUSIONS

view conclusions

EOFDM WG C

The survey
OPERATOR GENERAL INFORMATION

THE PICTURE OF THE REPORTER

FDM WITHIN THE OPERATOR

THE FDM SOFTWARE

MEMORANDUM OF UNDERSTANDING

VIEW ALL

BACK TO SURVEY
MAIN MENU

EOFDM WG C

OPERATOR GENERAL INFORMATION

The picture of the reporter

EOFDM WG C

NEXT SLIDE
BACK TO MENU

SURVEY MAIN
MENU

OPERATOR GENERAL INFORMATION

FDM within the operator

EOFDM WG C

NEXT SLIDE
BACK TO MENU

SURVEY MAIN
MENU

OPERATOR GENERAL INFORMATION

The FDM software

NEXT SLIDE
BACK TO MENU

SURVEY MAIN
MENU

OUTSOURCED :18%

Is your FDM programme

outsourced or run in-house

No link between the dimension of the

fleet and the choice to outsource

IN HOUSE :82%

Does your reporting software interface with your FDM software?

NO 78%
YES 20%

No reporting software available : 2%

EOFDM WG C

OPERATOR GENERAL INFORMATION

Memorandum of Understanding

NEXT SLIDE
BACK TO MENU

SURVEY MAIN
MENU

Does your organization have

an MOU with pilots on your FDM program?
YES 86%

NO 14%

No link between the dimension of the fleet or the type of operations and the adoption of the MoU

Is non-punitive use of FDM data covered by your

MOU?
YES
91,5%

NO
8,5%
EOFDM WG C

10

The survey
THE FDM TEAM

TEAM COMPOSITION

TRAINING AND EXPERIENCE

VIEW ALL

BACK TO SURVEY
MAIN MENU

EOFDM WG C

11

NEXT SLIDE

THE FDM TEAM

Team Composition

BACK TO MENU

SURVEY MAIN
MENU

Only 1

Full time members

From 2 to 4
From 5 to 7

50%

Part time
members

36%

14%

Only 1

From 2 to 4

From 5 to 7

more than 7

34%

56%

4%

6%

YES
66%

Pilot representative
within the team
EOFDM WG C

NO
34%

12

NEXT SLIDE

THE FDM TEAM

Training and Experience

BACK TO MENU

SURVEY MAIN
MENU

EOFDM WG C

An acting pilot.
2 or more years of FDM experience
13

The survey
THE FDM REPORT

FREQUENCY OF FDM REPORTS

TYPES OF FDM REPORTS

VIEW ALL

BACK TO SURVEY
MAIN MENU

EOFDM WG C

14

THE FDM REPORT

Frequency of FDM reports

EOFDM WG C

NEXT SLIDE
BACK TO MENU

SURVEY MAIN
MENU

15

NEXT SLIDE

THE FDM REPORT

Types of FDM reports

BACK TO MENU

SURVEY MAIN
MENU

What types of report do you produce?

UNSCHEDULED REPORTS

82%

INDIVIDUAL PILOTS REPORTS

43%

REPORTS FOR AREAS OF OPERATIONS

53%

AIRFIELD SPECIFIC REPORTS

74%

AUTOMATED REPORTS

57%

OTHER TYPES OF REPORTS PRODUCED:

Aircraft group by
areas of ops

If requested by
pilot

Unscheduled
report following
investigations

Automated fuel
monitoring
reports

Automated
engine reports
CAT C
Airports

Home base

EOFDM WG C

16

The survey
THE FEEDBACK TO CREW/PERSONNEL

GENERAL FEEDBACK

INDIVIDUAL FEEDBACK

IS YOUR FEEDBACK EFFECTIVE?

ACCEPTABLE OR UNACCEPTABLE?

PROTECTION OF DATA

VIEW ALL
BACK TO SURVEY
MAIN MENU

EOFDM WG C

17

THE FEEDBACK TO CREW/PERSONNEL

General feedback

NEXT SLIDE
BACK TO MENU

SURVEY MAIN
MENU

98% of the interviewed provides feedback to pilots

on FDM programme. In which form (multiple choice):
81,3% Newsletters

35,4% Replay

21% Dedicated newsletter

79% Flight safety newsletter
37,5% Fleet specific newsletter

68,8% Email
31,3% Web based

16,7% Video remote play

12,5% Roadshow
16,7% Posters

16,7% Other (Seminars, initial & recurrent training, magazines)

EOFDM WG C

18

THE FEEDBACK TO CREW/PERSONNEL

General feedback

NEXT SLIDE
BACK TO MENU

SURVEY MAIN
MENU

98% of the interviewed provides feedback to pilots on FDM

programme.
How often?:

Do you publicise trends?

YES: 80%
NO: 20%

How do you de-identify data (m.c.)?

Remove LOCATION: 24%
Remove CREW: 86%
Remove DATE AND TIME: 94%
Remove
EOFDM
WG C A/C REGISTRATION: 2%

19

THE FEEDBACK TO CREW/PERSONNEL

Individual pilot feedback

NEXT SLIDE
BACK TO MENU

SURVEY MAIN
MENU

75% of the interviewed provides INDIVIDUAL feedback to

pilots on FDM programme (main question)
1. What is the method (m.c.*)?

2. What is the content (m.c.)?

Phone call: 73%

Email: 89%
Letter: 11%
Text message: 3%
Face to face: 8%
Web based feedback: 5%

Request of a report: 72%

Notification/review of an excedeence: 77%
Request for contact (SM or Pilot rep): 65%

*m.c. = multiple choice

3. Which department/role provides

the feedback?(m.c.)?
Air Safety Office: 51%
Flight operations: 8%
Honest Broker/Gatekeeper: 35%
Union representative: 5%
Outsourced entity: 0%
EOFDM WG C

20

THE FEEDBACK TO CREW/PERSONNEL

How do you determine if feedback is effective?

NEXT SLIDE
BACK TO MENU

SURVEY MAIN
MENU

How is feedback determined on an individual basis?

(open answer)
CHECK OF INDIVIDUAL REPORTS TO VERIFY ANY CHANGE OF BEHAVIOUR

DIALOGUE AND DISCUSSION WITH THE CREW MEMBER

NO INDIVIDUAL FEEDBACK PROVIDED:

IT IS NOT ALLOWED TO ANALYSE THE PERFORMANCE OF A SPECIFIC CREW MEMBER

EOFDM WG C

21

THE FEEDBACK TO CREW/PERSONNEL

How do you determine if feedback is effective?

NEXT SLIDE
BACK TO MENU

SURVEY MAIN
MENU

How is feedback determined on an group basis?

(open answer)
Safety culture indicators (ex. ASR/1000 sectors) increase

Discussion during recurrent training or other sessions

General Crew Surveys

Monitoring of the group performance

Trend analysis or analysis of a specific type of event

EOFDM WG C

22

THE FEEDBACK TO CREW/PERSONNEL

Acceptable or unacceptable?

NEXT SLIDE
BACK TO MENU

SURVEY MAIN
MENU

Do you define circumstances where protection is

removed for a pilot or crew?
YES: 83%
NO:17%

Do you explain to your pilots who draw the line between

acceptable and unacceptable?
YES: 81%
NO:19%

Do you explain to your pilots what is considered

unacceptable?
YES: 92%
NO:8%
EOFDM WG C

23

THE FEEDBACK TO CREW/PERSONNEL

How is the data protected?

NEXT SLIDE
BACK TO MENU

SURVEY MAIN
MENU

How is the data protected? (open answer)

Secure database/server/special arrangements
with IT
Limited access (group limitation, password
protected access)
Outsourced FDM program with various rights
profiles depending on the role in the FDM group.
Flights are codified
Data Protection Acts
EOFDM WG C

24

The survey
USE OF FDM for TRAINING PURPOSES

THE WAY TRAINING IS PROVIDED

ATQP AND SIMULATOR EXERCISES

FDM AND RECURRENT TRAINING

VIEW ALL

BACK TO SURVEY
MAIN MENU

EOFDM WG C

25

USE OF FDM for TRAINING PURPOSES

The Way Training is provided

NEXT SLIDE
BACK TO MENU

SURVEY MAIN
MENU

Do you provide data from your FDM programme to your training

department? (main question)
YES 92%
NO 8%
Do you provide statistical data?

YES 98%

NO 2%

Do you use FDM data for event analysis for training?

YES 84%

NO 16%

Do you provide replays (m.c.)?

group basis: 29%

individually: 33%
EOFDM WG C

on request 64%

no: 18%
26

USE OF FDM for TRAINING PURPOSES

ATQP and Simulator Exercises

NEXT SLIDE
BACK TO MENU

SURVEY MAIN
MENU

Is the re a n AT QP in y o ur c o mp a ny ? (main question)

R e s p o ns e
Pe rc e nt

Ans we r Op tio ns
Yes
No

22.9%
77.1%

D o y o u inc lud e tra ining mo d ule s b a s e d o n FD M tre nd s / e v e nts

next slide
in s imula to r e xe rc is e s ? Ple a s e g iv e a n e xa mp le .
R e s p o ns e
Pe rc e nt

Ans we r Op tio ns
Yes
No

55.3%
44.7%

EOFDM WG C

27

USE OF FDM for TRAINING PURPOSES

ATQP and Simulator Exercises

NEXT SLIDE
BACK TO MENU

SURVEY MAIN
MENU

FDM Results in simulator exercises examples:

Approach to stalls, upset recovery,

Severe wake turbulence encounter during cruise

TCAS handling

FOR APPROACH AND LANDING:

Correct landing techniques to prevent "long landing" or flat landings

Stabilised and unstable approaches, go around

Go around with two engine following some level bust events
Training of special circle to land procedures, airport approaches with specific
conditions
Visual approaches or changes on route by ATC lead to unstable approaches
EOFDM WG C

28

USE OF FDM for TRAINING PURPOSES

FDM and Recurrent Training

NEXT SLIDE
BACK TO MENU

SURVEY MAIN
MENU

H o w d o y o u inc lud e a ny FD M fe e d b a c k in re c urre nt g ro und s c ho o l

mo d ule s ?
R e s p o ns e
P e rc e nt

A ns we r Op tio ns
Video
Tactical questionnaires(e.g what would you have done?)
Airport awareness
Posters
Other (please specify)

reports

presentations

61.5%
20.5%
41.0%
20.5%

statistics/trends

FDM incidents review

briefing packages
EOFDM WG C

verbal briefings
29

The survey
FEEDBACK to FLIGHT OPERATIONS

INTERVAL AND TYPE OF REPORT

FDM AND FUEL SAVING

VIEW ALL

BACK TO SURVEY
MAIN MENU

EOFDM WG C

30

FEEDBACK to FLIGHT OPERATIONS

Interval and Type of Report

NEXT SLIDE
BACK TO MENU

SURVEY MAIN
MENU

98% of the interviewed provides data from FDM

programme to the Flight Operations Department.
over what interval?

EOFDM WG C

31

FEEDBACK to FLIGHT OPERATIONS

NEXT SLIDE
BACK TO MENU

Interval and Type of Report

FDM & FLIGHT OPERATIONS

SURVEY MAIN
MENU

YES

NO

Do you provide trending data?

95,7%

4,3%

Do you provide event analysis?

82,6%

17,4%

Is FDM data used to verify the events associated with an Air

Safety Report?

95,6%

4,4%

EOFDM WG C

32

FEEDBACK to FLIGHT OPERATIONS

FDM and Fuel Saving

NEXT SLIDE
BACK TO MENU

SURVEY MAIN
MENU

Is FDM data used to monitor fuel efficiency?

EOFDM WG C

accuracy of flight
planning software
Follow up on clean-up
altitudes and use of air
condition during take-off
Remaining fuel
planned fuel vs. fuel used

33

The survey
THE FEEDBACK TO OTHER AREAS

FATIGUE RISK MANAGEMENT SYSTEM

MAINTENANCE

AIR TRAFFIC CONTROL

VIEW ALL

BACK TO SURVEY
MAIN MENU

EOFDM WG C

34

FEEDBACK to OTHER AREAS

Fatigue Risk Management System
Do you use FDM data as part of a Fatigue Risk
Management System?

NEXT SLIDE
BACK TO MENU

SURVEY MAIN
MENU

(main question)

NO 69%

YES 31%

Do you correlate event trends/rates against

fatigue reports?
YES 80%

NO 20%
EOFDM WG C

35

FEEDBACK to OTHER AREAS

Fatigue Risk Management System

FDM and FRMS

NEXT SLIDE
BACK TO MENU

SURVEY MAIN
MENU

YES

NO

Do you merge FDM data to planned/flown roster for

FDM purposes?

46,7% 53,3%

Do you monitor event rates against flight couplings?

(Mirroring)

46,7% 53,3%

EOFDM WG C

36

FEEDBACK to OTHER AREAS

Maintenance
FDM & MAINTENANCE

NEXT SLIDE
BACK TO MENU

SURVEY MAIN
MENU

YES

NO

87,5%

12,5%

1.1 Do you use FDM data for maintenance investigation?

(e.g Structural limit exceedence, flaps, landing gear)

100%

0%

1.2 Do you use FDM data to verify the maintenance status of any systems?
(e.g. anti-icing, air conditioning etc)

45,2%

54,8%

1.3 Do you use FDM data for engine condition monitoring?

64,3%

35,7%

1. Is FDM data used to investigate events for Maintenance purposes?

(main question)

EOFDM WG C

37

FEEDBACK to OTHER AREAS

Air Traffic Control

FDM & ATC

NEXT SLIDE
BACK TO MENU

SURVEY MAIN
MENU

YES

NO

Do you share any ATM relevant FDM event with ANSP or NAA?

41,7%

58,3%

Do you use FDM to monitor speed control compliance?

(e.g taxi speed, approach speed)

95,8%

4,2%

50%

50%

58,3%

41,7%

Noise abatement procedures or SID compliance?

Rushed approaches caused by ATC?

EOFDM WG C

38

The survey
TOP MANAGEMENT REPORT

TOP MANAGEMENT REPORT

VIEW ALL

BACK TO SURVEY
MAIN MENU

EOFDM WG C

39

TOP MANAGEMENT REPORTS

NEXT SLIDE
BACK TO MENU

SURVEY MAIN
MENU

Do you provide FDM reports to the

management/board level of your organisation?
(main question)

YES 87,5%

What format is used?

NO 12,5%

What is the reporting frequency?

EOFDM WG C

40

TOP MANAGEMENT REPORTS

NEXT SLIDE
BACK TO MENU

D o y o u inc lud e a ny Ke y Pe rfo rma nc e Ind ic a to rs o n the

e ffe c tiv e ne s s o f the FD M p ro g ra mme in the s e re p o rts ?

SURVEY MAIN
MENU

R e s p o ns e
Pe rc e nt

Ans we r Op tio ns
Event rates
Capture rates

86.8%
63.2%
D o y o u p ro v id e tre nd ing d a ta ?
R e s p o ns e
Pe rc e nt

Ans we r Op tio ns
Yes
No

97.6%
2.4%

D o y o u inc lud e s p e c ific flig ht re p la y s in b rie fing s e nio r

ma na g e me nt?
R e s p o ns e
Pe rc e nt

Ans we r Op tio ns
Yes
No

EOFDM WG C

22.0%
78.0%

41

TOP MANAGEMENT REPORTS

NEXT SLIDE
BACK TO MENU

SURVEY MAIN
MENU

How do you report and monitor adverse trends to your

top management? (1/2)
As this was an open question, the answers have been summarised as follow:

1.What is provided?
(content included in the report)

2. When is it provided?

Statistics

Trends of specific high risk events

In some cases FDM events included in KPIs

Various intervals (monthly, quarterly, annually)

Immediately for high severity events or trends

In many cases management informed during SRB

EOFDM WG C

42

TOP MANAGEMENT REPORTS

NEXT SLIDE
BACK TO MENU

SURVEY MAIN
MENU

How do you report and monitor adverse trends to your

top management? (2/2)
As this was an open question, the answers have been summarised as follow:

3. In which form is it provided?

Various forms used:

Verbally/personally

Information sent via email

Specific written reports or presentations

Dashboards with real time information

EOFDM WG C

43

TOP MANAGEMENT REPORTS

NEXT SLIDE
BACK TO MENU

SURVEY MAIN
MENU

Does the management usually act upon

FDM reports?
YES 75,6%

NO 24,4%

Some of the interviewed underline that no targets are defined

In several cases management ask for more details on specific parameters

Follow up is usually provided during specific meetings

EOFDM WG C

44

NEXT SLIDE

CONCLUSIONS

SURVEY MAIN
MENU

Conclusions

Due to the type of participants to the survey, results should be intended as a

picture for FDM in passenger transport operators flying airplanes;

It is still preferred to keep FDM Activity in house;

No magic software available, issue of dedicated experienced resources still open;

FDM reports different in form and issuing timeframe;

The majority of companies has adopted a MoU

Individual feedback is largely used as well as individual performance monitoring;

FDM is commonly used for crew training purposes, the use in other activities
(maintenance, crew planning) is still limited.
EOFDM WG C

45

Thank you