Beruflich Dokumente
Kultur Dokumente
edited by
Diane M. Bunce
Overview
2.17
4.00
2.04
4.10
3.86
2.10
2.00
1.81
4.00
1.95
3.45
2.66
3.65
3.42
3.57
2.41
2.59
2.55
Study Design
Students in CHM 115, 116, 124, and 126 in
Spring 1999 and CHM 115 in Fall 1999 at Purdue
were surveyed about their use of the Web-based materials. The survey included demographic, scaledresponse, and free-response questions. CHM 115
116 is the general chemistry sequence for aspiring
engineers. CHM 124 is the second semester of a
more rigorous general chemistry sequence for engineers. CHM 126 is the second-semester general
chemistry course for chemistry majors. Students in
CHM 115 were advised about the VSEPR page by
their instructor during the coverage of the topic. Students in CHM 124 were advised of the availability
of all the tutorial pages available. Students in CHM
116 were advised of the Coordination Compounds
Page by their instructor and the researcher. Students
in CHM 126 were given a homework assignment, prepared by the instructor, about coordination compounds. This assignment involved using the Coordination Compounds Page.
Volunteer students in CHM 126 were individually interviewed about their use of the Web site and
975
Statement
Female
Male
4.24
3.33
.024
4.25
3.60
.031
2.20
3.00
.005
2.22
3.00
.004
1.50
2.81
.004
1.50
3.08
.002
4.50
3.18
.007
2.47
2.94
.008
2.62
2.92
.039
3.56
3.14
.020
3.38
2.92
.042
2.71
2.97
.042
2.43
2.91
.011
2.20
2.56
.002
2.52
2.77
.014
2.40
2.69
.006
2.60
2.86
.025
their understanding of certain coordination chemistry concepts. This class was selected for interviews because the Web
site was part of an assignment and the probability of finding
students who had used the site was likely to be greater than
in other courses. During the interview, each student was also
asked to draw a concept map involving several specified coordination chemistry terms. The researcher closed the interview by allowing the student to ask questions about the research or give any additional thoughts.
Data Analysis and Results
Surveys
Scaled-Response Statements
Responses to the scaled-response survey questions were
frequency-counted and the mean student response was calculated. Responses were scaled from 1 (strongly agree) to 5
(strongly disagree). A sixth option, did not use, was also
offered so that we could distinguish students who genuinely felt
neutral about a statement from students who had no opinion
because they did not use the Web site. Responses indicating
this sixth option did not enter into the calculation of the means
for the scaled-response questions. The strongest responses to
the scaled-response survey questions are shown in Table 1.
976
Frequency
Illustrative Response
Free-Response Questions
Why did you choose to use the Visualization and Problem Solving Web Page? a
( N = 188 coded statements)
The free-response survey questions were coded by
Materials/Information
41.(22%)
Get more info on topics when I didnt
an open coding scheme in which codes were generated
have time to go to the TAs.
by examination and analysis of the data. New codI needed help/was confused
36.(19%)
I was having trouble with Chem. 115 so I
ing categories were opened as necessary. This condecided to try the Web page out.
trasts with a coding scheme in which all responses
To get better understanding
9.(5%)
Because I thought they would improve my
understanding of chemistry.
are coded against predetermined categories. In toHow did using the Visualization and Problem Solving Page affect your understanding
tal, 29 codes, some with subcategories, were opened.
of the material? Please give specific examples. ( N = 167)
Data from all courses surveyed were transcribed,
Representations/visualization/ 28.(17%)
Using the Web site better helped me to
coded, and tabulated. Table 3 presents the highest
animations
visualize these shaped in 3D rather
frequencies of coding categories for responses to
than trying to picture them in my head.
the free-response questions. For example, 188 reIt helped (nonspecific)
39.(23%)
It helped.
sponses to the question Why did you choose to use
Which parts of the Visualization and Problem Solving Page were most helpful to you,
and which were the least useful to you? Please explain your answer. ( N = 131)
the Visualization and Problem Solving Web Page?
VSEPR
24.(18%)
VSEPR, because it helped me understand
were assigned to coding categories (multiple codes
the material.
for one response were allowed if appropriate). Of
Coordination Compounds
15.(11%)
The coordination compounds page was
these 188 statements, 41 were coded in the Materithe most helpful because the lecture
als/Information category.
given on that topic werent clear.
Patterns arose in student responses to the freeAll parts were helpful
10.(8%)
Everything was pretty useful.
response survey questions. Students who used the Web
Why did you not use the Visualization and Problem Solving Page? ( N = 441)
page in general believed that they needed help with
278.(63%) At first I was not aware that this page
Didnt know about it/forgot
about it
was available, and then I forgot that it
the chemistry material or visited the site to gain acwas available.
cess to information. One students response to Why
Did not need to use it
91.(21%)
I felt like I knew the material well enough
did you choose to use the Web page? provides an
not to use the Web site.
excellent example of a statement that fits the
Access problems
18.(4%)
I dont have a computer in my room + the
Needed help coding category: I was having
lines are so long in the labs.
trouble with Chem. 115 so I decided to try the Web
No time/other things to do
15.(3%)
I didnt find that I had much time to view
the site.
page out. An example quote from the free-response
Can use book/prefer book
15.(3%)
Easier to open book/flip to index.
survey data is given with each coding category in
How do you think that using Web-based materials would have affected your
Table 3.
understanding of chemistry? ( N = 416)
Overall, the Web site users stated that they used
Might/would have helped
239.(57%) It would have helped me understand
the Web page to obtain help and chemistry informachemistry better.
tion. Some students believed that using the materials
Might/would have had no
94.(23%)
I dont think it would have had much
effect
effect.
on the Web site helped in visualization of chemical
Representations/visualization
20.(5%)
Easier to visualize 3-D models.
phenomena or provided examples, but others felt that
How do you feel about using the Web to learn chemistry in CHM 115116?
the Web page made no difference in their understand( N = 205); CHM 115 Fall 1999 only
ing. Web site users believed in general that the part of
Good idea
90.(44%)
I feel that it is a good idea and would be
the Web site pertaining directly to the chemistry covbeneficial for students.
ered in class was most useful (VSEPR for CHM 115;
Will use it in the future
19.(9%)
I will try to use it in chem 116.
Coordination Compounds for CHM 116 and 126).
Bad idea/not a good idea
14.(7%)
I do not feel the Web is a good way.
Most students who did not use the Web site stated
More exposure/different ways 14.(7%)
I feel it is helpful and gives an alternative
that they did not use it because they had forgotten
to learn
to learning rather than just reading the
about it or did not know about it at all. Some stated
material.
aBefore Fall 1999, the Web page was known as the Chemistry 115116 Help
that they did not use the Web site because they did
not need to use it. Generally, however, nonusers be- Page, and the questions referred to this name.
lieved that using the Web site might have helped their
understanding of chemistry concepts, through visualization
professor had assigned homework (not collected or graded) based
tools or reinforcement of lectures, or as a resource to study
on the Web site materials, which increased the likelihood of
from. Even nonusers had positive feelings about using the Web
finding students who had used the site. The population of CHM
to learn chemistry.
126 is fairly homogeneous owing to the students common
major and similar backgrounds: all students in the course had
Interviews
passed a math placement test and taken high school chemistry.
With the survey we were able to gain a broad underThe majority of them were second-semester freshmen.
standing of how students used the Web-based materials and
Both Web site users and nonusers were solicited and six
how they felt about using them. To gain deeper insight into
students were interviewed. This represents 12% of the class in
students Web site use and understanding of chemical conSpring 1999. The volunteers were guaranteed anonymity and
cepts, we solicited volunteers from CHM 126 in Spring 1999
were assigned pseudonyms for the transcription and data analyfor individual interviews. This course was chosen because the
sis. We did not attempt to control for differences in ability beJChemEd.chem.wisc.edu Vol. 78 No. 7 July 2001 Journal of Chemical Education
977
No. of Responses by
Response
Web Site
Usersa
Web Site
Nonusersa
Incorrect
Incorrect
Incomplete
Incomplete
21
25
Correct
Correct
Web Site
Users a
Web Site
Nonusers a
2 (5%)
0 (0%)
8 (21%)
0 (0%)
28 (74%)
26 (100%)
tween Web site users and nonusers because Web site use was
entirely voluntary. We were not attempting to compare equivalent groups of students; we were interested in how students who
had used or not used the materials on the Web site understood
chemistry and why students decided to use or not use the site.
This small group provided a great deal of data that suggest interesting trends; these will be investigated in phase 2 of our study,
which will involve more students.
In the interview, the interviewer discussed with the students the nature of their use of the Web site or the reasons
for their not using the site. Students were asked to discuss their
thoughts about using the Web in their specific course as well
as in chemistry courses in general. They were then asked some
directed questions about coordination chemistry and were
asked to draw a concept map of some coordination chemistry
terms. This topic was chosen because the course instructor
had given homework about coordination chemistry that involved using the Web site.
Chads discussion of the relationship between the representations of two square planar complexes (which cannot have
optical isomerism) represents an incorrect statement.
INTERVIEWER: I was wondering if you think that is a pair
of isomers.
CHAD: Theyd be optical isomers, because this guy is the
mirror image of this one, obviously, but then this one
isnt going to match up.
978
atta
che
s to
nt
ai n
with
different
co
Lewis acid
central atom
acts as a
donor atom(s)
s
te
na
do
isomers
has
of
ir
pa
coordination
complex
accepts
pair of
coordinate
covalent
bond
bidentate
is
con
tain
s
ligand
is
ac
ts
for
m
as
sa
monodentate
Lewis base
electrons
donates
pair of
electron, isomers, Lewis base, Lewis acid, central atom, monodentate, and bidentate. They were told that they could add
terms or not use a term as needed. They were instructed to
make the map as connected as they felt necessary, to write
linking words between concepts, and to show directionality
between concepts. An example of a concept map drawn by
Beth, a Web site user, is shown in Figure 1. Note that Beth
made a compound link in her map by drawing an arrow
through one concept to the next: Coordination complex has
isomers with different donor atoms. Beths concept map links
were all judged to be correct or complete.
Judging of the concept maps was similar to judging the
interview discussion of coordination chemistry. Each concept
link was judged as correct, incorrect, or incomplete. The interrater reliability was 0.94, which was deemed acceptable. Table
5 shows the totals of the concept links judged.
Students who did not use the Web site made no concept
map links that were judged incorrect or incomplete. Students
who did use the site had about the same number of correct links
as the nonusers, but they made more links overall and some of
these links were judged incorrect or incomplete. This suggests
that the students who used the Web site created more knowledge, but some of that knowledge was not correct.
To account for the different numbers of links made by
the students, the percentages of correct, incomplete, and incorrect links were calculated for each student. The higher percentage of correct links for Web site nonusers almost reaches
statistical significance at the 95% level ( p = .07). The percentage of incomplete links was significantly larger (p = .04)
for users than for nonusers. The percentage of incorrect links
did not differ significantly between groups. The larger number
of links attempted by Web site users may be related to the
motivation factor between the groups (see below).
Results from the chemistry discussion and concept map
portions of the interview suggest that the students who did
not use the Web site had a better understanding of coordination chemistry than the students who did use the site and
are consistent with the statements made by some students
on the free-response survey questions. Many students who
did not use the Web site felt that they did not need to use it
because they understood the material well enough already.
This is also consistent with our past research on Web site use
979
980