Beruflich Dokumente
Kultur Dokumente
4, NOVEMBER 1971
Abstract-The computer has been viewed primarily as a symbol- development of the computer, even that human func-
manipulating machine. Yet, it is capable of generating and displaying tion of decision making and control seems likely to be
N isual images showing abstract form, shape, and dynamic process.
Recent psychological research on perception suggests that pictures performed increasingly by the new artificial intelligent-
and symbols play important but very different roles in creative sia, mass produced with little pleasure or pain for the
thought. By providing enactive and iconic modes of communication greater economic advantage of manufacturer and em-
between man and machine, the computer can serve as a prosthetic ployer.
device to assist man in giving public expression to his private mental The use of the computer to replace some human
images. By so doing, it may be possible to equalize in some measure
the imbalance between man's great endowment for perceiving and functions is fraught with consequences of dubious mor-
very limited capability for producing visual images. By so doing, we ality. It is astonishing that many people find attractive
may enhance the human use of the computer as an intellectual com- the goal of building a machine capable of performing
panion rather than as an economic competitor. what has hitherto been a unique human function-and
incredible that the more unique the function to humans,
ICONIC COMMUNICATIONS the more attractive the goal! Contrast this, if you will,
The Human Use of Computers with the concern that has led man to set up wildlife
preserves where animals may live in their natural habi-
T HE computer has been called, with ample justi- tat, protected from the encroachments of civilization.
fication, a symbol-manipulating machine. As such, Instead, we deny such amenities to man and inflict
its potential for enormous impact upon man is change at a rate with which few can cope. Perhaps the
sharply revealed for hitherto, the production, manipu- time has come for us to recognize that certain functions
lation, and transformation of symbols has taken place must be reserved for man alone, even though these
exclusively in the human mind, communicated through might be done more cheaply or better by machine. Per-
natural language and mathematical expression. Sym- haps to protect man's birthright, legislation is needed
bols written on paper, or other media, are static and to forbid encroachment upon this human preserve by
dead. Not until perceived by the human mind have the machine.
they acquired meaning and interracted with each other If such legislation were passed, the problems facing
to yield new results. Now, the modern computer pro- engineering educators would be vastly simplified-we
vides a slate upon which we write our symbols so as to could all go back to teaching circuit theory and those
have the consequences of what we write unfold dy- other nice subjects that we have enjoyed for so many
namically before us. This is a truly revolutionary de- years. Of course, these subjects have been pleasant to
velopment. The invention of the printing press gave teach and fun to learn because they seemed useful1 and
man unlimited ability to record information in static because the subject matter is clearly described by neat
-form; the computer has for the first time given a dy- algorithms and procedures. But precisely these latter
namic character to this process. qualities make these procedures well suited for imple-
By bestowing upon the computer some portion of his mentation on a digital computer. If we accept the
unique ability to manipulate symbols, man has created maxim that this part of the design process should no
a surrogate capable of performing many of his tradi- longer be done by man, we are left with a residue that
tional functions. The familiar maxim-that a human is a nasty assortment of important but ill-defined issues,
being should not be called upon to perform tasks better likely of little academic interest, deficient in esthetic
done by machine-seems acceptable when those tasks beauty, often irrational and frustrating, and requiring
involve brute muscle power. The maxim is given au-
thority by the ancient belief that pure thought is the 1 A. W. Holt has observed that the possibility of finding satisfac-
noblest production of man, and that manual labor tion in doing laundry by hand is largely destroyed by the very exis-
should be avoided. Let the dumb animal or the engine tence of the washing machine! (Several reviewers, have objected to this
footnote and claimed that a housewife obviously gets more pleasure
provide muscle power so that man may be free to use from using a washing machine. This, however, does not negate the
his intellect to control the process. But now, with the fact that the possibility of finding pleasure in doing laundry by hand
has been destroyed by the availability of the washing machine-
rather, it explains why this is so. Why not then use the machine? I
say that technology is like drugs; people are titillated by it; it is habit
Manuscript received March 17, 1971; revised May 4, 1971. forming and may produce a desire to move on to harder stuff. Further-
The work leading to this paper has been supported in large part by more, pushers are strongly motivated for economic reasons to hook
the Office of Computing Activities, National Science Foundation more and more users. Of course, drugs in themselves are not evil and,
under Grant GJ-336. when administered wisely to enhance human resources, they may be
The author is with the Department of Electrical Engineering, The beneficial. But when administered primarily for the profit of the
Johns Hopkins University, Baltimore, Md. 21218. pusher and supplier, they are harmful.)
HUGGINS: ICONIC COMMUNICATIONS 159
for meaningful resolution an understanding and breadth The Picture and the Symbol
of experience possessed by few students.
Evidently, I hold a pessimistic view of the ultimate Television began its invasion of our society about two
consequences of using machines to perform man's func- decades ago and shortly thereafter, by a remarkable
tions. I do not find assurance in the fact that no com- coincidence, so also did the computer.
puter today can write Shakesperian verse; instead, I Because it utilized extant radio technology and could
believe we must consider what has already been done in exploit an existing market, television achieved imme-
less than one decade of modest effort and face squarely diate acceptance. Today, few homes are without at
the technological imperative: that if something is techno- least one TV set. Now, the computer invasion of the
logically feasible, it will be done on earth as it is in home is also about to begin, for the development of
heaven [1]. large-scale integrated circuitry will soon make it eco-
Why then am I contributing to this Special Issue on nomically feasible to put a computer into every home.
the Application of Computers to Electrical Engineering And, just as with television, the commercial market for
Education? Let me explain. Because the computer is a the home computer will be exploited without prelimi-
linguistic machine, it is capable of being instructed to nary investigation and research into the psychological
perform any human task which can be described com- and sociological effects of these devices upon the people
pletely and accurately by its teacher. If the instructions who use them. Yet, it is conceivable that both may
are sufficiently detailed and all inclusive, the human create potent alterations in man's most precious and
teacher may then be retired to a home for senior citi- unique gift-his mind. Will human thought be radically
zens while the automaton carries on. I try hard not to changed as a consequence? If so, what will be the nature
think about these prospects. of these changes?
But because the computer is a linguistic machine, it Many people agree that television has had a pro-
is also potentially capable of entering into the internal found effect upon children who have grown up watching
world of man's intellect, where it can extend his analyt- it. By the time they finish school, many will have spent
ical, associative, perceptive, and conceptual powers. 10 000 to 15 000 hours watching TV. The impact of TV
This, and only this, I regard as the truly human use of on our culture is hard to evaluate, but there is little
the computer-an intellectual companion rather than doubt it is enormous. For instance, D. R. Entwisle has
an economic competitor. This is the use that should be found [2 ] that disadvantaged first graders of the Balti-
uppermost in the education of human beings. Unfor- more inner-city schools have better developed abilities
tunately, this use offers little economic incentive in our to associate and use common words than the more
present society. Furthermore, this use raises funda- privileged children of corresponding age in surburban
mental problems, largely unrecognized and thus far schools. Furthermore, by the time children finish ele-
ignored. The task of providing the kinds of communica- mentary school, their verbal associative structures ap-
tion between man and the computer required for the pear to be much further developed than students of the
computer to be part of man's intellectual processes is same age who lived 50 years ago or than students who
an altogether different undertaking than that required today are members of cultural groups in which TV is
for a computer to control a guided missle or a chemical little used [3].
plant, or to optimize the design and layout of an inte- Except for a few isolated efforts to use the TV me-
grated circuit. dium in imaginative new ways for educational purposes
Communication between computer and machine can (Sesame Street being the most noteworthy example), it
be provided by well-established techniques of communi- is a moot question whether the gross effect of TV has
cation theory to encode information in many different been "good" or "bad." It has, for sure, reduced the
ways, any of which permit exact recovery by appropri- element of wonder and surprise which is so helpful in
ate transducers. But for man, simple display of symbols, motivating learning in the class room. Perhaps the
linquistic statements, or graphs may not be sufficient. decline of student interest in science and engineering is
For how does man think? Is the presentation of nu- in part a result of blase young people finding little
merical data or equations or graphs even beginning to novelty or excitement in the contemplation of RLC
scratch the surface of what might be required to really circuits when for years they have watched people walk
use the computer as part of ones intellectual processes? on the moon and fanciful dragons fly without fear of
Is it possible that the special inclinations and abilities falling.
that attract some people to computer science lead them Prior to television, fantasy could be encountered in
to ignore and minimize the requirements that most science fiction novels. But the novel conveys its story
people of other intellectual endowments find important? by symbolic language which acquires meaning only
Why is it that only recently are graphical displays ap- when decoded in the mind of the reader. This tags it as
pearing on computers, despite the fact that such dis- a mental construction and robs it of the immediate im-
plays were used on the early Whirlwind computer 20 pression of reality that is conveyed by the moving
years ago? In this paper I attempt to discuss some of image seen on the TV screen. The intellectual barrier
these questions. between the rational and irrational is in danger of being
160 IEEE TRANSACTIONS ON EDUCATION, NOVEMBER 1971
breached by commercial television.2 This may account in the mathematical order and harmony of the cosmos,
for the rapidly growing interest in shamanic thought located beyond the reach of the senses; whereas the
and distrust in the intellectual's motto: veritas vos liber- arts, and particularly painting were to be treated with
abit [4]. caution because they strengthened man's dependence
And so, soon, picture and symbol will simultaneously on illusory images." (One wonders what Plato would
saturate the mind with intensity never before experi- have thought of TV?)
enced. Computers are already being injected into the Arnheim continues: "Today, the prejudicial discrimi-
elementary schools, where kids respond avidly to them, nation between perception and thinking is still with
as might be expected from man's unique gift for play us.... Our entire educational system continues to be
with symbols. Is it not important, then, to inquire in based on the study of words and numbers. In kinder-
what ways TV and the home computer relate to each garten, to be sure, our youngsters learn by seeing and
other in their effects on the people who use them? Are handling handsome shapes, and invent their own shapes
they complementary, so that one compensates for the on paper or in clay by thinking through perceiving. But
weaknesses of the other? Or, are they antagonistic in with the first grade of elementary school, the senses
combination, and likely to create stresses and strains in begin to lose educational status. More and more the
the user? In what ways can TV and computers be com- arts are considered as . . . entertainment and mental
bined so as to be most useful and helpful in man's in- release.... By the time the competition for college
tellectual development? I suggest one way is in allowing placement becomes acute, it is a rare high school that
man to express himself by means of visual images with insists on providing for the arts the time needed to
a facility never before possible. Let me explain. make their practice at all fruitful.... This educational
If we could begin over, placing uppermost the full blackout persists in college, where the art student is
consideration of human needs for communication and considered as pursuing separate and intellectually in-
thought, rather than the historical peculiarities of a ferior skills. . . . The arts are neglected because they
particular technology, could the functions of TV and are based on perception, and perception is disdained
the computer be integrated into some new device so because it is not assumed to involve thought."
as to be most useful and helpful in man's intellectual Study of the relation between visual imagery and
development? One may envision a device which is like symbolic forms such as natural language is currently
a TV in that it is capable of generating visual images enjoying a revival among American psychologists who
of rich and wonderous variety as well as displaying at last seem to have overcome the classical prejudices
symbolic forms, while it is also like a computer in that which earlier in this century led them to separate per-
it invites active participation of the viewer by enabling ception from thought. (The inappropriateness of this
him to enter into the generation and control of the separation is clear to anyone who has studied L. G.
information being displayed. Then, for the first time, Roberts' important, but neglected, doctoral dissertation
man would have the ability to create visual images [6]. The mechanisms which Roberts describes provide
easily for communicating ideas that he hitherto had an elegant model of the process of perception. And since
little or no facility for expression. logical operations are explicit in this model, it is evident
The relation between visual imagery and symbolic that perception likewise involves thought (albeit at a
modes of thought has been examined by Arnheim [5]. subconscious level) in much the same way as that dis-
Arnheim begins his fascinating and timely study by cussed by Arnheim.) Of particular interest is the major,
examining the historical origins of the age-old prejudice recent work of Bugelski [7], who supports Arnheim's
that visual perception does not involve thought. He thesis that visual imagery plays a central role in think-
writes: "The Liberal Arts, so named because they were ing when he writes: "My current leaning is toward the
the only ones worthy of being practiced by a free man, belief that few of us, if any, actually think in abstract
dealt with language and mathematics. Specifically, terms when we are doing our everyday routine think-
Grammar, Dialectic and Rhetoric were the arts of words; ing. I rather suspect, with Mowrer [8] and Bower [9],
Arithmetic, Geometry, Astronomy, and Music were that we think with our gut and some rather individual
based on mathematics. Painting and Sculpture were imagery and that our idiosyncratic reactions are re-
among the Mechanical Arts, which required labor and sponsible for the considerable lack of communications in
craftsmanship. The high esteem of music and the dis- conversations that relate to serious social problems.
dain of the fine arts derived, of course, from Plato, who Words have a way of arousing images and, if the images
in his Republic had recommended music for the educa- are not the same, communication fails." He concludes
tion of heroes because it made human beings partake that: "all words are both abstract and concrete in that
they are first symbols to begin with, which makes them
all abstract as divorced from things and events. They
2 In the article "Question Is: Will the Tube Become Reality?," are all concrete in that they arouse a kind of activity
Judv Bachrach asks: "Will outer-tube events assume fictive dimen-
sions just as inner-tube events are assuming nonfiction dimensions to in our neural mechanisms that was active at some prior
ladies who write letters (to TV actors) .... Will all these realities time when we saw or heard something and words were
eventually blend into each other so that any occurrence, be it a
political campaign, an advertisement, a soap opera, or a war, will also used at the same time. The revival of these former
become grand theater on a miniature screen to be launched, played sensory-perceptual and emotional responses appears to
out and wrapped up in a living room while we sit back and watch?"
(Baltimore Sun, April 30, 1971). be the meaning of the words that arouse them. These
HUGGINS: ICONIC COMMUNICATIONS 161
a very ingenious interactive programming system to impossible to rely on a completely symbolic mode of
make computer-animated films using a small minicom- communication. Also, who knows what new implica-
puter. My single question to the candidate was: "Have tions and structures for problem solving might come
you produced a significant film using this system?" from an appropriate iconic translation?
Again, the answer was "No!" Perhaps the distinction between the symbolic and
From these observations I must conclude it is un- iconic modes of thought is not as sharp as we have been
fortunate that present development of computer- suggesting. Listen to P. R. Halmos, mathematician
graphic facilities for purposes of iconic communication who knows of what he writes when he states [14]: "Per-
(as distinct from mechanical drafting) rests largely in haps the closest analogy is between mathematics and
the hands of computer science specialists because I find painting. The origin of painting is physical reality and
that skills for visual expression seem to be curiously so is the origin of mathematics.... Talk to a painter
lacking among practitioners of that discipline. Although (I did) and talk to a mathematician, and you'll be
I support the development of a Computer Animation amazed at how similarly they react. Almost every as-
Resources Center (CARC) described elsewhere in this pect of the life and of the art of mathematics has its
issue by D. Weiner, I question whether it is the lack of counterpart in painting, and vice versa." Earlier in this
adequate facilities or our inability to express our ideas delightful paper, Halmos admits that: "Mathematics-
visually that accounts for the slow development of com- this may surprise you or shock you some-is never de-
puter animation for educational purposes. If the latter, ductive in its creation. The mathematician at work
what can be done? makes vague guesses, visualizes broad generalizations,
The basic issues here are crucial to education. Whereas and jumps to unwarranted conclusions. He arranges and
exposure to television has oriented students increasingly rearranges his ideas, and he becomes convinced of their
to iconic modes of communication, classroom instruc- truth long before he can write down a logical proof....
tion in many disciplines has become increasingly math- When a mathematician wants to prove a theorem about
ematical, symbolic, and abstract. Gone are laboratories an infinite-dimensional space, he examines its finite-
and demonstrations of the real thing. For students in dimensional analogue, he looks in detail at the 2- and
these disciplines, the subject matter may indeed appear 3-dimensional cases, he often tries out a particular
to be little other than strings of symbols obeying mys- numerical case, and he hopes that he will gain thereby
terious syntactical rules. Furthermore, some of the ex- an insight that pure definition-juggling has not yielded.
amples of computer-aided instruction that I have seen The deductive stage, writing the result down, and
make it appear even more so. As an exercise in learning writing down its rigorous proof are relatively trivial
the structure of formal systems, such developments once the real insight arrives; it is more like the draft-
may be ideal, but for developing intuitive understand- man's work, not the architect's." (Italics added.)
ing on which creativity so much depends, it may be Nature has endowed man with the ability to create
tragically deficient. Is it possible that the students' call speech and to listen, and the rate at which speech may
for "relevance" is really a cry for help in assigning some be produced is within the same order of magnitude as
meaning to the sea of undefined symbols that engulfs that at which it can be perceived. Now, contrast this
them? Is "relevance" not only to be interpreted in a with vision wherein our eyes can take in information at
social context but also cognitively? an enormously greater rate than we are able to produce
visual images naturally. Through gestures and facial
A Reconciliation? expressions we may ornament our own speech produc-
In the previous section, we suggested that some in- tion, but for the most part we are aware only of our own
nate drive forces man to symbolize and, once done, to voice and not of our visual gestures which remain
ignore the steps up the enactive and iconic ladder that largely unconscious [15]. It seems likely to me that it is
he himself had climbed in giving meaning to his own this inability to produce visual images on the one hand,
symbolic constructions. For the educator, these tenden- and the excess ability to acquire visual information on
cies pose a particularly serious hazard because having the other, that has led to all input and no output-and
learned and relearned his material, he may have com- hence, the notion that we think in terms of words. For
pletely suppressed modes of thought he used to achieve it is words that we hear ourselves speak when we com-
his present state of expertise. He may underestimate municate, as echos of what others have said to us. But
the necessity of providing sufficient enactive and iconic our mental imagery remains private, unseen, and un-
experience to permit the learner to function at the identified with the self [16].
learners happiest symbolic level. If the learner has a However, most children do like to draw and, if en-
well-defined symbolic system that matches that of the couraged, are able slowly to produce charming visual
teacher, it may be possible to bypass the first two communications of their thoughts and ideas. What is
stages and communicate purely at the symbolic level. needed is a facility to produce images as readily and as
But too often, the learner may not possess the imagery easily as one can babble. We have seen that television
to fall back upon when his symbolic transformations and the computer are complementary in that television
fail to solve the problem. For many persons, it may be puts the viewer in a passive role whereas the computer
HUGGINS: ICONIC COMMUNICATIONS 163