SEMINARIO Y PRCTICA: ADULT EDUCATION RESEARCH SEMINAR

Prof. Negrn Rubio, I. & Pino Castillo, P.

2016

Guidelines for the Research Study: Second Progress Report

Content
As you are aware, the second report includes the theoretical framework and the methodology of your study.
Also, it must include the key components of the research problem and the details of how data collection materials,
techniques and procedures were analysed in terms of trustworthiness. For this analysis, the present study guide will
provide you with an explanation of the procedure and deadlines. First of all, let us remember the contents of chapters
2 and 3, theoretical and methodological framework, respectively.
Chapter II: Theoretical framework. This chapter presents the definitions for the main variables or key
categories in the study, and discusses the different definitions for each of these firstly from a general or historical
perspective, into a more specific tailor-made definition for the purposes of the study. The chapter starts with an
introductory paragraph and mind map of the main concepts and the authors associated to these concepts, an
introductory paragraph explaining this mind map, then different sections for the discussion of the key categories or
variables, from the most general or historical perspective into the most specific and relevant perspective. The closing
section of this chapter summarises the conceptual definitions of each variable or key category, and explains how
these are related.
Chapter III: Methodological framework. This chapter of the study explains the method used in order to fulfil
the research objectives or to corroborate the working hypothesis. It includes a brief explanation of the research
paradigm, the approach, design, procedure (methodological steps), operational (working) definitions, data collection
materials and proposed data analysis techniques, including considerations of trustworthiness matching the
paradigmatic perspective. Data collection materials must be clearly and explicitly justified to ensure validity and rigour,
and they must be presented to your advisor before any validation procedure so that adjustments are made before
collection.
Analysis of Data Collection Materials
For our present course, in order to assess the quality of data collection materials, you must subject your
materials to analysis by different judges. You will likewise contribute to the analysis of 2 materials as well. The different
analyses and deadlines for this procedure are detailed as follows. The guidelines for analysis of your peers materials
is detailed below. The form that you must complete is given in a separate file.
1
2
3

Procedure
Date or Deadline
Create your data collection materials in the form summary of objectives and Friday 28 October
materials and send the form to your advisor for analysis.
Check your advisors comments on your objectives and materials.
Friday 4 November

Make the necessary adjustments to your materials, according to your advisors Friday 4 November
comments, and ask more information if necessary.
Send the final version of your materials back to your advisor and your 2 designated Tuesday 8 November
peer-judges in the form objectives and materials for analysis.
Your advisor will send the form to an external advisor.
Tuesday 8 November

Analyse the 2 forms you received from your classmates.

Tuesday 8 November

SEMINARIO Y PRCTICA: ADULT EDUCATION RESEARCH SEMINAR

Prof. Negrn Rubio, I. & Pino Castillo, P.

2016

Send your advisor the 2 forms with comments on the 2 materials you were assigned Friday 11 November
to analyse.
Receive the final feedback from your peer judges and from the external advisor.
Friday 18 November

Make the final changes to your materials, according to the feedback received.

10 Submit your report including the final version of your materials.

Friday 18 November
Friday 25 November

Peer Judge Analysis Guidelines

As you receive your classmates data collection materials, and considering their research question, general
objective and specific objectives, analyse their data collection materials explained in the corresponding box and make
comments on the trustworthiness of these materials in the box with the title Comments on Trustworthiness. As a way
to guide you in this analysis, make notes on the following questions. Please remember each data collection material
should try to ensure the collection of true data, with a consistent procedure that is neutral, and possibly applicable
to other contexts, bearing in mind your classmates epistemological standpoint.
1. How coherent are the materials presented with the research question? Are they sufficient to provide data that
will answer the question? What else would you suggest?
2. What are the strengths of the materials to be used considering their trustworthiness? What aspects in these
materials do you think should be highlighted and used by other studies?
3. What are the weaknesses of the materials to be used considering their trustworthiness? What could go
wrong? What suggestions would you make to these in order to ensure trustworthiness?
Please remember to adopt a critical and sceptic perspective, think about all the possible problems and
situations that may not allow your classmate to carry out the study as they expect, and help them improve their
materials before they are applied. Below are some concepts we studied, to help you of what to consider.
-

Qualitative Perspective
prolonged and varied field experience
time sampling
diverse triangulations
member checks
peer examination (debriefing)
thick description
observers paradox and Hawthorne effect
halo effect
key informants, theoretical sampling
emic (intersubjective) perspective

Structure of the Second Progress Report

1. Cover. Use the standardised format for research project.
2. Table of contents.

Quantitative Perspective
construct (operational) validity
content (representative) validity
predictive validity
criterion-related validity
face validity
external validity (generalisability)
pre-test post-test
control and experimental groups
random sampling
etic (objective) perspective

SEMINARIO Y PRCTICA: ADULT EDUCATION RESEARCH SEMINAR

Prof. Negrn Rubio, I. & Pino Castillo, P.

2016

3. Introduction. You will introduce the educational context for the research study, with details on the internship
experience that led you to identify the object of study as well as the sources for your interest in the topic area.
The introduction must purposefully lead the reader into the topic area, from the most general perspective into
the most specific and relevant description for the purposes of the study. After this introduction, you will restate
the perfected version of your research purpose, question, objectives and assumptions or hypotheses, and
explain the contents of the second report.
4. Theoretical Framework. This chapter presents:
- A concept map with the key categories or variables in your study, each of these with at least two authors,
clearly showing the main concepts and how they are related.
- An introductory paragraph explaining the key categories in the concept map and how these categories
are related, giving way to the discussion of each of these concepts.
- Critical discussion of different definitions of each of the key categories. This discussion must lead the
reader from the most general and traditional definition of the construct into the most relevant definition
for the purposes of the study (conceptual definition).
- A final summary of the conceptual definitions of the study and their relationship (theoretical stance).
5. Methodological Framework. This chapter presents:
- The research paradigm of the study, supporting it with at least one reliable reference, and relating this
description to the purpose of the study.
- The research approach that the study will employ, relating it to the nature of data, method of collection
and technique for analysis.
- The research design for the study, supporting the definition with at least one reliable source, and relating
this choice to the research objective.
- The methodological procedure, describing step by step what activities the study will involve and how this
procedure matches the description of the design.
- Sample and setting or scenarios and participants must be described with the thickness or narrowness
that the paradigm and approach necessitate.
- Instrumentation or data collection materials must be explained, starting from the conceptual definition,
into the operational definition, supporting the choice of materials and describing their features.
- Proposed data analysis techniques must be explained, according to the paradigm and approach, and
bearing in mind the research objectives which are sought to be fulfilled.
- Trustworthiness (validity or rigour) must be explained, not only making reference to the analysis of
materials, but supporting through discussion of the different features of the procedure and materials how
the method will provide true, neutral, consistent and applicable data and findings.
6. References. In alphabetical order and format according to the APA style guide 6 th edition
7. Appendices. This section includes all the forms used in the analysis of trustworthiness, the final version of
the data collection materials and letters of informed consent (if applicable).
Format
Printed in letter page size and spiral-bound. Arial font, size 12, normal margins, justified text, headings
according to the APA style guide 6th edition, line spacing 1.5. Use the standardised format and guidelines within it.
Assessment
Assessment of the progress report will be carried out by means of an assessment rubric, in which the scores
are explained as follows. Any criterion will be given 0 points if it is absent or if it does not fulfil the descriptor for 1
point. The deadline for this report is 25 November and you will be given progress points for the following activities:
Tuesday 25 or Friday 28 October. You must submit the summary of your objectives and data collection
materials in the corresponding form, summary of objectives and materials.

SEMINARIO Y PRCTICA: ADULT EDUCATION RESEARCH SEMINAR

Prof. Negrn Rubio, I. & Pino Castillo, P.

2016

Friday 4 November. You must submit the matrix for key definitions and materials for inspection by your
professor. This matrix is a summary you will be using to ensure your conceptual definitions, operational definitions
and data collection materials are coherent.
Tuesday 8 November. You must send your advisor the final version of your data collection materials after
receiving feedback in the form called objectives and materials for analysis, and you must also send these material
to 2 other classmates from the same section, who will be assigned to you.
Friday 11 November. You must send your advisor the 2 other data collection materials you received, with
your comments on trustworthiness.
Tuesday 15 or Friday 18 November. You must present the draft of your research project so far. This is a
brief, 5-minute presentation on your objectives, key definitions, procedures and materials.

SEMINARIO Y PRCTICA: ADULT EDUCATION RESEARCH SEMINAR

Prof. Negrn Rubio, I. & Pino Castillo, P.

2016

Assessment Rubrics
Form (30%)
Criterion

Presentation &
Mechanics

- Includes all elements requested

- The cover abides by the format
requested and the title is coherent
with the research problem.
- No spelling or punctuation mistakes
are observed.

Grammar &
Discourse

- the outline and paragraphing of the

report are logical, cohesive and
completely relevant
- uses appropriate simple and
complex grammatical constructions
with no mistakes at all

APA 6th
Edition
Standards

- The heading structure completely

abides by the APA 6th conventions.
- All in-text references abide by the
APA format, using page or
paragraph number for direct quotes.
- The reference section is completely
consistent with in-text citations and
completely abides by APA 6th format.

Content (70%)
Criterion
Summary of the
Research
Problem

Presentation of
the Theoretical
Framework

Presentation of
Constructs and
Conceptual
Definitions

Score
2
- There are up to two elements
missing from the ones requested.
- The cover does not completely abide
by the norms requested.
- There are up to three spelling or
punctuation mistakes in the whole
report.
- The outline and paragraphing of the
report are not entirely logical or
cohesive; sometimes it is difficult to
follow.
- Uses mostly simple grammatical
constructions with no mistakes, and
makes some mistakes in complex
ones.
- The heading structure does not
completely abide by APA 6th edition
norms.
- Most in-text references abide by APA
6th format, and page or paragraph
number is missing for direct quotes.
- Reference section is mostly
consistent with in-text citations and
mostly abides by APA 6th format.

1
- There are more than two elements
missing from the ones requested.
- The cover is orderly but does not
abide by the norms requested.
- There are between three and ten
spelling or punctuation mistakes in
the whole report.
- The outline and paragraphing of the
report make the text difficult to follow
and redundant.
- Uses only simple grammatical forms
with no mistakes or makes many
mistakes in complex grammatical
forms.
- The heading structure is orderly, but
does not abide by APA 6th norms.
- In-text citations are clear but do not
abide by APA 6th format.
- The reference section presents more
than three inconsistencies with intext citations or does not abide by
APA 6th norms.

Score
2

- Clearly and appropriately introduces

and contextualises the research
problem.
- Clearly and accurately presents the
research questions and research
objectives which will guide the study.
- Clearly and accurately presents the
research
assumptions
or
hypotheses.
- Clearly introduces the theoretical
framework by means of a graphic
organiser and an introductory
paragraph.
- The main concepts introduced are
completely relevant and coherent
with the research question, objective
and/or hypothesis.
- The concepts to be addressed
completely suffice the explanation or
understanding of the research
problem,
according
to
the
predominant paradigm.

- Introduction and contextualisation of

the research problem is mostly clear
and appropriate.
- The presentation of research
questions and research objectives
are mostly clear and accurate.
- The presentation of research
assumptions or hypotheses are
mostly clear and accurate.
- The introduction of the theoretical
framework by means of a graphic
organiser and an introductory
paragraph is mostly clear.
- The main concepts introduced are
mostly relevant and coherent with
the research question, objective
and/or hypothesis.
- The concepts to be addressed nearly
suffice
the
explanation
or
understanding of the research
problem,
according
to
the
predominant paradigm.

- Introduction and contextualisation of

the research problem is not very
clear or appropriate.
- The presentation of research
questions and research objectives
are not very clear or accurate.
- The presentation of research
assumptions or hypotheses are not
very clear or accurate.

- Every construct is presented firstly

from a general or traditional
perspective, into a more relevant
conceptual definition.

- Most constructs are presented firstly

from a general or traditional
perspective, into a more relevant
conceptual definition.

- Some/Few constructs are presented

firstly from a general or traditional
perspective, into a more relevant
conceptual definition.

- The introduction of the theoretical

framework by means of a graphic
organiser and an introductory
paragraph is not very clear.
- The main concepts introduced are
not very relevant and coherent with
the research question, objective
and/or hypothesis.
- The concepts to be addressed do
not really suffice the explanation or
understanding of the research
problem,
according
to
the
predominant paradigm.

SEMINARIO Y PRCTICA: ADULT EDUCATION RESEARCH SEMINAR

Prof. Negrn Rubio, I. & Pino Castillo, P.

- All sources chosen for the discussion

of each variable or key concept are
reliable, diverse and relevant.
- Every construct is presented with at
least two references, one of which is
traditional and the other one is
recent.
- The working definitions for every
construct are explicitly stated and are
completely relevant and coherent
with the research problem.

2016

- Most of the sources chosen for the

discussion of each variable or key
concept are reliable, diverse and
relevant.
- Most constructs are presented with
at least two references, one of which
is traditional and the other one is
recent.
- The working definitions for most
constructs are explicitly stated and
are completely relevant and
coherent with the research problem.

- Some of the sources chosen for the

discussion of each variable or key
concept are reliable, diverse and
relevant.
- Some/Few constructs are presented
with at least two references, one of
which is traditional and the other one
is recent.
- The working definitions for some
constructs are explicitly stated and
are completely relevant and
coherent with the research problem.

Synthesis or
Theoretical
Stance

- The chapter ends with a closing

synthesis or explicit explanation of
the theoretical stance which
readdresses
the
conceptual
definitions and summarises their
relationship.
- The relationship among the theories
presented and the objectives is clear
and logical.
- The closing synthesis effectively
provides the researchers chosen
theoretical perspective for each
variable or key concept.
- The closing synthesis is clearly
aligned with the research problem
and predominant paradigm and
approach, and paves the way into
the methodological framework.

- The closing synthesis or explanation

of the theoretical stance is mostly
explicit and clear. The link between
the theories presented and the
objectives
requires
further
development.
- The closing synthesis is mostly
effective
in
explaining
the
researchers chosen theoretical
perspective for each construct.
- The closing synthesis is mostly
aligned with the research problem
and predominant paradigmatic
approach and paves the way into the
methodological framework.

- The closing synthesis or explanation

of the theoretical stance is not very
explicit or clear. The link between
the theories presented and the
objectives is unclear
- The closing synthesis provides
some hints on the researchers
chosen theoretical perspective for
each construct.
- The closing synthesis is not very
aligned with the research problem
and predominant paradigmatic
approach and mentions the coming
methodological framework.

Statement of
the Paradigm
and Approach

- Clearly states the paradigm chosen

for the proposal, which is supported
by at least one reliable reference.
- Clearly explains the approach to
explaining or understanding the
research problem according to the
paradigm.
- The paradigm and approach are
completely coherent with the
research problem presented.

- The chosen paradigm needs

clarification or needs more
theoretical support.
- The approach to explaining or
understanding the research problem
needs further details or is not
completely coherent with the
paradigm.
- The paradigm and approach are not
completely coherent with the
research problem presented.

- The chosen paradigm fails to

account for the research objectives
and/or no reliable references were
used.
- The approach to explaining or
understanding the research problem
is not coherent with the paradigm.
- The paradigm and approach are not
coherent with the research problem
presented.

Statement of
the Research
Design

- Clearly states the research design

selected for the study and supports it
with at least one reliable reference.
- Clearly explains how the selected
design will ensure the attainment of
the research objectives.
- The design selected is completely
coherent with the research problem
and paradigmatic approach.

- The chosen research design needs

clarification and/ or at least one
reliable reference must be added.
- Needs to further explain how the
selected design will ensure the
attainment of the research
objectives.
- The design selected is somewhat
coherent with the research problem
and paradigmatic approach.

- The chosen research designed has

not been properly developed and/ or
at least one reliable reference must
be added.
- The selected design, as stated, does
not necessarily ensure the
attainment of the research
objectives.
- The design selected is not coherent
with the research problem and
paradigmatic approach.

Description of
the
Methodological
Procedure

- Clearly and accurately explains the

step-by step procedure by means of
which the study will be carried out.
- The procedure is completely
coherent with the perspective
chosen and the paradigmatic
approach selected.

- The step-by step procedure by

means of which the study will be
carried out is presented but further
precision is required.
- The procedure is somewhat
coherent with the perspective
chosen and the paradigmatic
approach selected.

- Lack of clarity and accuracy to

explain the step-by step procedure
by means of which the study will be
carried out.
- The procedure is not coherent with
the perspective chosen and the
paradigmatic approach selected.

SEMINARIO Y PRCTICA: ADULT EDUCATION RESEARCH SEMINAR

Prof. Negrn Rubio, I. & Pino Castillo, P.

2016

- The procedure described consists of

the necessary and sufficient steps for
the fulfilment of the objectives.

- The procedure described presents

some of the necessary and steps for
the fulfilment of the objectives.

- The procedure described does not

consist of the necessary and
sufficient steps for the fulfilment of
the objectives.

- Readdresses the main constructs in

the theoretical framework and
provides an operational definition for
each of them.
- Clearly and accurately explains the
data
collection
techniques,
instruments
and
materials,
supporting the decision with at least
one reliable reference.
- The operational definition of
constructs and the data collection
materials are completely coherent
with the paradigm and approach.
- Provides a relevant description of the
scenario which is completely
coherent (thick enough) with the
paradigm and approach.
- Provides a relevant description of the
population and sampling methods or
subjects and key informants or
subjects,
according
to
the
perspective.
- The description of the population and
sampling methods or subjects and
key informants is completely
coherent with the perspective,
design and procedure.

- Readdresses some of the constructs

in the theoretical framework and
provides an operational definition for
some of them.
- Explains the data collection
techniques,
instruments
and
materials, supporting the decision
with at least one reliable reference,
but further precision is required
- The operational definition of
constructs and the data collection
materials are somewhat coherent
with the paradigm and approach.

- Readdresses few of the constructs

in the theoretical framework and
provides an operational definition for
few of them.
- Does not explain the data collection
techniques,
instruments
and
materials with enough precision, and
/or does not support the decision
with at least one reliable reference.
- The operational definition of
constructs and the data collection
materials are not coherent with the
paradigm and approach.

- The description of the scenario is

mostly
coherent
with
the
paradigmatic approach.
- The description of the population and
sampling methods or subjects and
key informants or subjects is mostly
relevant,
according
to
the
perspective.
- The description of the population and
sampling methods or subjects and
key informants is mostly coherent
with the perspective, design and
procedure.

- The description of the scenario is not

very coherent with the paradigmatic
approach.
- The description of the population
and sampling methods or subjects
and key informants is not very
relevant,
according
to
the
perspective.
- The description of the population
and sampling methods or subjects
and key informants is not very
coherent with the perspective,
design and procedure.

Validity or
Considerations
of Scientific
Rigour

- Clearly explains how validity or

credibility is or will be ensured in the
research study.
- Clearly and accurately explains why
the instruments or procedures are
reliable or dependable.
- Clearly and accurately explains how
confirmability or objectivity of the
data was or will be ensured.
- Clearly and accurately explains
generalisability or transferability by
making explicit reference to the
dense description of the scenario or
sampling methods.

- The explanation of how validity or

credibility is or will be ensured in the
research study is mostly clear.
- The explanation of reliability or
dependability of methods is mostly
clear and accurate.
- The
explanation
of
how
confirmability or objectivity of the
data was or will be ensured is mostly
clear and accurate.
- The explanation of generalisability or
transferability is mostly clear and
accurate, with some references to
the dense description of the scenario
or sampling methods.

- The explanation of how validity or

credibility is or will be ensured in the
research study is not very clear.
- The explanation of reliability or
dependability of methods is not very
clear or accurate.
- The
explanation
of
how
confirmability or objectivity of the
data was or will be ensured is not
very clear or accurate.
- The explanation of generalisability
or transferability is not very clear or
accurate, or references to the dense
description of the scenario or
sampling methods are not very
clear.

Proposed Data
Analysis
Techniques

- Clearly and accurately explains the

data analysis procedure to be carried
out, which is supported by at least
one reliable reference.
- Clearly explains how the data
analysis procedure is coherent with
the research paradigm and design.
- Clearly explains how the data
analysis procedure will ensure the
fulfilment of the research objectives
or how it will corroborate hypotheses.

- The explanation of the data analysis

procedure to be carried out is mostly
clear and accurate. Further support
by reliable references is necessary.
- The explanation of how the data
analysis procedure is coherent with
the research paradigm and design is
mostly clear.
- The explanation of how the data
analysis procedure will ensure the
fulfilment of the research objectives
or how it will corroborate hypotheses
is mostly clear and accurate.

- The explanation of the data analysis

procedure to be carried out is not
very clear or accurate. Support by
reliable references is lacking.
- The explanation of how the data
analysis procedure is coherent with
the research paradigm and design is
not very clear.
- The explanation of how the data
analysis procedure will ensure the
fulfilment of the research objectives
or how it will corroborate hypotheses
is not very clear or accurate.

Operational
Definitions and
Data Collection
Materials

Description of
Sampling
Methods and
Scenario

SEMINARIO Y PRCTICA: ADULT EDUCATION RESEARCH SEMINAR

Prof. Negrn Rubio, I. & Pino Castillo, P.

Partial Online
or Physical
Reports

- Submits all the required partial

reports according to the partial
reports agenda.
- Every partial report contains all the
elements
requested
in
the
specifications.
- Every partial report complies with the
formal specifications requested by
the research advisor.

- Submits two of the required partial

reports according to the partial
reports agenda.
- Two partial reports contain all the
elements requested, or all of them
contain most elements.
- Two partial reports comply with the
formal specifications requested.

2016

- Submits one of the required partial

reports according to the partial
reports agenda.
- One partial report contains all the
elements requested, or all of them
contain few of the elements.
- One partial report complies with the
formal specifications requested.