u02d1 Scientific Merit and Internal Validity

For this discussion, use the research topic you will develop for the SMR Project. Compose your
discussion post as follows:

Describe statistical conclusion validity and internal validity as presented in the readings
for this unit. Include a description of how statistical conclusion validity and internal
validity are related. Describe these concepts as you understand them, and avoid quoting
from the source material.

Explain how you would apply statistical conclusion validity and internal validity to a
quantitative investigation of your research topic.

In what ways will a quantitative approach enhance statistical conclusions validity and
internal validity? How could you ensure that your research procedures will enhance
internal validity?

What are some threats to statistical conclusion and internal validity that are especially
relevant to your research topic? What are some things you could do to reduce these
threats?

Explain why internal validity is an important component of scientific merit.

Ensure that your post includes proper APA citations. Provide an APA References list at the end of
your post.
Response Guidelines
Read your peers' discussion posts and respond to at least two of them. Ask questions of
clarification or interest and suggest other possible threats to internal validity you foresee in their
research topics. In addition, include any other ideas you can suggest to help reduce the threats to
validity. Your responses are expected to be substantive in nature and should reference the
assigned readings, as well as other theoretical, empirical, or professional literature to support
your views.
1) Describe statistical conclusion validity and internal validity as presented in the readings for
this unit. Include a description of how statistical conclusion validity and internal validity are
related. Describe these concepts as you understand them, and avoid quoting from the source
material.
Statistical conclusion validity refers to the precise use of inferential statistics in quantitative
research to accurately interpret and assess the covariation of the independent and dependent
variables of the study. Statistical conclusion validity requires that a researcher accurately

interpret the magnitude of causal correlation between the treatment and outcome variables and
the extent to which these results may prove useful in the populations of interest. Unfortunately,
there are two types of errors that can occur when statistical significance testing is implemented to
make binary decisions about the null hypothesis (H0), thus violating statistical conclusion
validity. A researcher may decide to reject the null hypothesis when it is true (Type I Error) or
fail to reject the null hypothesis when it is actually false (Type II Error).
The presumed goal of any quantitative experimental research endeavor is to properly design the
experimental parameters and conditions to feasibly infer causality from the effect of a
manipulated treatment variable (X) on the outcome variable (Y). Internal validity refers to the
causal inferences regarding the causal relationship or covariation of X to Y within these
experimental conditions. A study that satisfies the conditions to accurately determine causal
inferences possesses internal validity. Internal validity is critically important in any quantitative
research design, but especially in experimental research which provides relatively stronger
evidence for causality.
Internal and statistical conclusion validity are related, as both validity types are concerned with
the relationship between the treatment and outcome variable (Shadish, Cook & Campbell, 2002).
Random assignment of participants to treatment groups is typically implemented in experimental
conditions to ensure equivalency in treatment groups and eliminate potential confounds.
However, regardless of a randomized selection strategy, confounds may be present in the
treatment condition, violating internal validity and thus leading to inaccurate conclusions of the
causal relationship of X and Y, a violation of statistical conclusion validity. Conversely, a
researcher may have a strong preference for stating a hypothesis believed to be correct and then
use discriminatory inferential statistical methods to deduce substantive evidence that confirms
their assumptions, consequently formulating erroneous statistical conclusions and violating
statistical conclusion validity. Therefore, internal validity is systemically related to statistical
conclusion validity.
2) Explain how you would apply statistical conclusion validity and internal validity to a
quantitative investigation of your research topic. What are some threats to statistical conclusion
and internal validity that are especially relevant to your research topic? What are some things
you could do to reduce these threats?
The central research question for the authors quantitative research study is: How well can stress
management be predicted from anxiety and pain in participants receiving Reiki energy healing
treatments? Furthermore, this study will examine how much variance in stress management
(SM) is uniquely explained by each of the two predictor variables X1 and X2. The dependent Y
variable in this study is stress management (SM) and the two predictor variables X1 and X2, are
anxiety and pain respectively. There are four primary conditions required for causal inference
that ensure internal validity of the study:
a) The X1 and X2 and Y variables that represent cause and effect are systematically associated in
the study.
b) The cause (X1 and X2) must precede the effect (Y) in time.

c) There must not be any confounding variable associated with the treatment variables (X1 and
X2)
d) There should be a reasonable theory that predicts or explains the covariation of X1 and X2 and
Y.
Statistical conclusion validity may be applied to the study by using adequate sample sizes and
controlling for covariate factors thus increasing statistical power and ensuring greater probability
for accurate conclusions based on the outcome data. Moreover, use of several inferential
statistical methodologies for broader and precise data analysis, extending the range and
variability of Reiki biotherapy treatments, and finally ensure all assumptions for testing
procedures are satisfied through statistical measures and visual examination of graphic data.
The three major threats that may influence internal and statistical conclusion validity are: 1)
inadequate sample size, thus decreasing statistical power to detect an effect and increasing the
probability of a Type I error, 2) biotherapy treatment applications may vary from one practitioner
to another, thus decreasing effect size and introducing the probability of a Type I error as well as
creating unreliability in measurements and outcome conclusions and 3) the presence of multiple
outliers can decrease effect size as well and skew the dataset leading to inaccurate results.
Reducing these threats entails engaging in the following precautions: 1) ensuring that the sample
sizes are of sufficient size to maintain .80 statistical power according to standardized statistical
tables, 2) engage in preliminary data screening to determine the presence of outliers and make
appropriate decisions to minimize effects on the outcome data, 3) explore efforts to maintain
consistency in treatment applications based upon measurements and analysis of treatment
components related to changes in outcomes (Shadish, Cook & Campbell, 2002), and 4)
implement the use of various psychometric instruments to increase the amount of supporting
evidence for causality between predictor and outcome variables.
3) In what ways will a quantitative approach enhance statistical conclusions validity and internal
validity? Explain why internal validity is an important component of scientific merit. How could
you ensure that your research procedures will enhance internal validity?
A quantitative research study enhances statistical conclusion validity and internal validity
through: 1) providing controlled conditions by which accurate conclusions on causal correlations
of variables can be assessed, 2) the appropriate use of standardized statistical instruments that
assist in ensuring accuracy in data analysis, 3) randomized selection of participants thus reducing
inherent selection bias and the influence of confounds upon the treatment group, and 4)
researcher control to ensure the cause precedes the effect.
Internal validity plays a significant role as a component of scientific merit by seeking to maintain
the integrity of the statistical and data analysis procedures that elicit causal inferences in
quantitative experimental research. When improper inferences are drawn from data that has not
satisfied conditions for internal validity, this can lead to faulty casual conclusions based upon the
outcome data for a specific population of interest. For example, the ramifications of such faulty

conclusions in the medical field if testing for drug use can be severely detrimental to health care
recipients.
Ensuring internal validity is maintained in this authors research study will require careful
attention to assigning accurate construct descriptions, accurately forming relationships between
predictor and outcome variables that may yield causality, and maintaining random assignment of
participants to eliminate selection bias, using unobtrusive measures of recording treatment
effects and a double blind experimental approach (Leedy & Ormrod, 2013).
Anthony Rhodes
General Psychology PhD.
References
Leedy, P. D., & Ormrod, J. E. (2013). Practical research: Planning and design (10th ed.). Upper
Saddle River, NJ: Pearson Education. ISBN: 9780132693240.
Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental
designs for generalized causal inference (2nd ed.). Belmont, CA: Wadsworth. ISBN:
9780395615560.