An Examination of the Factor Structure of the Emotional Skills Assessment Process (ESAP-CV) Instrument Using Confirmatory Factor Analysis

William C. Bailey, Ph.D.

Associate Professor

Christina Chi, Ph.D.

Assistant Professor School of Human Environmental Sciences Dale Bumpers College of Agricultural, Food and Life Sciences University of Arkansas

Emotional Skills Assessment Process (ESAP)

Nelson and Low (1999, 2004) created the ESAP scale in order to assist students in academic achievement, career success, personal health, and leadership. ESAP was revised from a 213 item selfassessment instrument evaluating 10 strengths and 3 problem areas

ESAP-CV

This study used a revised form of the ESAP with 104 items. Evaluates five emotional skills Assertion Stress Management Drive Strength Time Management Commitment Ethic One Problem Area-- Change Orientation

Data Collection

Data were collected using a questionnaire placed on www.surveymonkey.com Students were sent an email and asked to respond from a variety of University core classes to ensure diversity In addition to the ESAP-CV, there were demographic items such as gender, age, ethnicity, and college classification A total of 458 usable responses were collected

Sample Split In Halves

The sample was randomly assigned to 2 groupsboth groups were a little more than 250 each. Because the largest subscale was 25 items, there was sufficient power for this analysis (1 item with at least 10 respondents). One group was analyized by exploratory factor analysis (EFA) and the other by confirmatory factory analysis (CFA).

Exploratory Factor Analysis (EFA)

In order to evaluate the initial structure of each of the subscales, EFA was performed using SPSS 13.0. The Extraction Method was Principal Axis Factoring in order to maximize loadings and eliminate double loadings Loading factor of .40 was selected as item criteria.

Results of EFA was Followed by Confirmatory Factor Analysis (CFA)

CFA gives the researcher complete control of the specifications of each of the subscale constructs. CFA also allows for a statistical test of the goodness-of-fit for the proposed solution. AMOS 5.0 was used for analysis

Goodness-of-Fit Analysis Statistics #1

Overall Chi-square statisticprovides a test of whether the sample covariance matrix is equivalent to the model-implied covariance matrix within sample error. Rule of thumb p values larger than .05 or .10. However, this is effected by sample size and should be interpreted with caution.

Goodness-of-Fit Analysis Statistics #2

The CFI was created to compare the fit of the proposed model to the worst case alternative.
This is a null baseline model where every measure is modeled as being uncorrelated with every other measure. CFI ranges between 0 and 1. Rule: CFI values .90 are above are adequate of the model.

Commitment Ethic EFA Factor

This 12 item scale measured one construct according to EFA. However, only 10 items loaded at better than .40 Item 5I have a solid feeling of confidence in my ability to create a good life for myself. Item 7I do not procrastinate.

Commitment Ethics Item Loadings

Item # 6 11 2 Factor Loading .72 .68 .67

10
4 1 8 9 5

.67
.62 .61 59 .57 .50

Due to EFA resulting in a single factor, CFA was not conduced.

12
3

.43
.40

EFA of Assertion

The Assertion portion of the ESAP has a total of 18 items. It has a unique design. The word Situation is used prior to three similar statements creating 6 items clusters. The EFA indicated there were only 5 items clusters of varying from 2 to 3 items. Items 1, 6, 16, 17, and 18 failed to load at .40 or better.

CFA Model of Assertion

Chi square CFI RMSEA *p. = .000 73.132* 0.975 0.038

Five Suggested Factor Names for Assertion

Items 10, 11, & 12 Response to Requests Items 5 & 6 Aware of Anothers Anger Items 7, 8, & 9 Communication with Authority Items 13, 14, & 15 Making Demands of Others Items 2 & 3 Anger Directed at Another Person

EFA Analysis Drive Strength

Drive Strength has 25 items EFA generated Five Factors Five items failed to load .40 or better

CFA Model of Drive Strength

246.169* 0.934 0.048

Chi square CFI RMSEA

*p. = .000

Five Suggested Factor Names for Drive Strengths

Factor 1 Self Starter Factor 2 Self Challenger Factor 3 Project Focus Factor 4 Planning for the Future Factor 5 Personal Success Strategies

Time Management EFA

12 items Resulted in 2 Factors All 12 items loaded at better than .40

CFA of Time Management

Chi square CFI RMSEA

85.445* 0.967 0.051

*p. = .000

Suggested Names for Time Management Factors

Factor 1 Effective Time Management Skills Factor 2 Punctuality

EFA of Stress Management

25 items EFA generated 4 Factors Five items failed to load at .40 or better

Unable to Show CFA Model

Chi square 301.39* CFI RMSEA 0.904 0.06

Suggested Names for 4 Stress Factors

Factor 1- Stress Obstructing Sense of Well-Being Factor 2 Coping by Relaxing Factor 3 Stress and Impatience Factor 4 Unable to Cope

EFA Analysis for Problem Area Change Orientation

12 items 2 Factors Generated 2 items failed to load at better than .40

CFA for Change Orientation

Chi square CFI RMSEA

114.359* 0.906 0.101

Unable to Name Factors

Modest Suggestions and Conclusions

Several of the ESAP-CV scales measure more than one concept Reduction of items on some scales may be appropriate Some of the CFA models are statistically more powerful than others Small number of items subscales will be difficult to norm and title

Future Directions for Research

Does the ESAP-CV really have predictive validity? What can it predict? Developing norms based on gender, ethnicity, or age? ????????????