Sie sind auf Seite 1von 221

What is TAO

TAO is, simply stated, the future of online


assessment development.
Open Assessment Technologies (OAT) takes
pride in having developed TAO ("Computer-
Based Testing" or Testing Assist par Ordinateur
in French), one of the most advanced test
authoring tools on the market using the
Question and Test Interoperability (QTI)
standard for E-test development. The company,
OAT, and product, TAO, form together what is
soon to become one of the best remembered
palindromes among teachers and test authors.
TAO, after all, represents one of the first great
steps beyond the domination of expensive and
inflexible proprietary testing software.
Almost as easy as putting pen to paper, and
with results that are a lot more impressive, TAO
enables educators and other test-writers to
create E-tests on the fly, and easily administer
them to students - from classroom to
nationwide - in just minutes. Furthermore,
grades can be ready for review and evaluation
moments after the last test is submitted.

2
TAO is the first commercial-grade Open Source
assessment development software on the
market. It is QTI and LTI standards-based, and
operates under audit-proof transparency.
Developers can access the source code for
their own test-creating or administering
purposes, opening the user to a wide range of
potential customizations. Complete ownership
of test design has never been this easy;
without the restrictions and high costs of
proprietary testing, all assessments can easily
be displayed with the educational institution's
signature details. Furthermore, TAO is fully
compatible with just about all of your favorite
commercial add-ons.
TAO is certified as QTI compliant in four

3
categories
Authoring and editing systems
Delivery systems
Item and test bank systems
QTI content
What this means is that TAO test content is
entirely portable, secure, and ready for any
curricula that embraces technology-centric
education models. As of 2015, it has been
deployed to more than a million students in
over 70 countries.
OAT has defined as its mission to work for the
Common Good in Education, and we value your
feedback and suggestions in helping us meet
our commitment to this ideal.

4
Downloading TAO
Open Assessment Technologies (OAT) packages
its 100% web-based test-compiling software
"TAO" in two forms: (1) automatic, and (2)
manual. Both are available for download from
its website.
Automatic installation is available for Windows
users, while manual installation can be done on
any computer using any operating system.
While connected to the internet, click on the
corresponding button for your system on the
TAO download page. Alternatively, you can
access all of TAO's features by subscribing to
the TAO Cloud.
Curious to see how TAO works? Take our latest
version for a test drive, without downloading or
subscribing to the TAO Cloud, by logging in as
follows:
Login: demo
Password: testdrive
During your test drive, you can preview the look
and feel of TAO from a test-taking perspective,
and observe how easy it is create test items

5
and prepare assessments in executing
workflows. For more information, contact:
Phone: +352 26 10 23 76
E-mail: contact@taotesting.com
Hours: 9:00 to 17:00 Central European Time

6
Installing TAO
There are currently two TAO installation
packages available on the OAT server:
Automatic and Manual. Automatic installation
involves setting up a permanent connection to
TAO's own server. This affords greater ease of
operation, leaving all technical issues to OAT.
Manual installation involves setting up a web
server and installing TAO on it. This affords a
greater degree of flexibility and control.
1. On the OAT download page, click on the
package appropriate for the computer on which
you'll be using TAO.
Automatic Package: Downloads a clickable,
executable file.
Manual Package: Downloads a ZIP file.
By carrying out this step you will initiate the
download. Select the target system and/or
folder for the installation file, and click save.
2. When the selected extractable is
downloaded, double-click on it to begin the
extraction.
This may take a few minutes to complete.

7
For users installing the automatic or manual
package on Windows, the next step is to
activate the UniController executable installer.
This can be found in the TAO_2.3_with_server
folder. Applications such as Skype will need to
be closed during the installation, which begins
after clicking the Start All button. This will
create a TAO Back Office on your computer,
which can be accessed through your preferred
browser at http://localhost/tao (login:tao,
password: tao).
For users installing the manual package on
Linux, follow the additional steps below.
3. (Linux only) Install the latest versions of the
following applications: Apache 2 server, PHP
server configuration, MySQL server
configuration and PostgreSQL.
Note: The recommended versions are as follows:
Apache 2: version 2.4; PHP server configuration:
version 5.5 or later; MySQL server configuration:
version 5.0 or later; PostgreSQL: version 7.0 or
later.
These are used to create your own web server,
upon which TAO will be installed.
Once the Apache 2 server is installed, ensure

8
that the rewrite and PHP 5 modules are
enabled, "AllowOverride All" directive is set in
DOCUMENT_ROOT, and that www-data or
Apache user write permission is granted for the
following files and folders:
1. / (root directory, for the .cache directory
only)
2. generis/data/
3. generis/common/conf
4. filemanager/views/data
5. taoResults/views/genpics
Once the PHP server configuration is installed,
ensure that register_globals and
magic_quotes_gpc are both off, and
short_open_tag is on. The following extensions
will be required: mysql, mysqli, curl, json, gd,
zip, spl, dom, and mbstring.
4. Extract the source code from the
downloaded archive and install it directly.
This should go in your htdocs or www folder.
5. Run the TAO Installation Wizard online.
This can be found at the website:
http://YOURSERVER/tao/install/
6. When the installation is complete, you

9
should be redirected to http://YOURSERVER/
If you are not automatically redirected, type in
http://YOURSERVER/ in the address bar of
your browser.

10
Take a Tour
This section takes you on a short tour of TAO,
giving you an overview of how to prepare and
organize your assessments using TAO. There
are links to the relevant sections of the User
Guide which will give you more detailed
information on how to set up your own
assessments once you start working with TAO.
Why use TAO?
TAO helps you set up and organize all types of
assessments quickly and efficiently. TAO's
simple architecture allows for easy resource
navigation, enabling you to re-use existing
tests or parts of tests, and to add new
assessment material to previous assessments,
including those used by other teachers or with
other groups.
Putting an Assessment together
An assessment in TAO consists of several
different building blocks: Interactions, Items and
Tests.
An Interaction is the most basic unit in an
assessment, and takes the form of a question

11
(e.g. multiple choice), or other task type (e.g fill-
in-the-blank). An Item is a set of interactions to
be used together, along with any supporting
material, and a Test is a group of items,
together with information on how they are
ordered and presented to the test-taker.
Now, let's walk through the steps of create an
assessment and manage your assessment
resources.
1. Check what test items are already available
Test items prepared by other users may be
available to you, as well as items you have
prepared yourself for previous assessments.
In TAO's Assessment Builder Bar, select Items
and examine the test items that are already
available in the Library on the left.
If you do not have enough ready-to-go items,
then you will need to create new ones. TAO
offers a solution with intuitively designed
testing Item templates.
2. Create Items
TAO has plenty of easy-to-use Item templates
to work with. To create a new item, click the

12
Items icon in the Assessment Builder Bar.
This opens the Items page, which consists of
three parts. On the left is the Library, where you
can view the inventory of already existing
items. On the right is the Properties Panel,
which you will use to select component
settings for your items, interactions, and tests,
such as your chosen scoring method. In the
center is the Canvas, where Item authoring
takes place.
This three-part layout is a common feature of
the TAO system. See the Creating a new item
section for more details.
3. Add Interactions to your item
Your new Item will consist of interactions.
Authoring an item means adding interactions
to it. Interactions include the following types:
simple, text-based, graphic, and miscellaneous
(called Common Interactions, Inline Interactions,
Graphic Interactions, and Custom Interactions in
TAO). For further information on these types,
see the Interactions section.
For each type, the procedure to create
interactions will vary. See detailed descriptions
of these procedures in each Interaction

13
section.
4. Use your items in a Test
Once you have populated your item with
interactions, you will need to build it into a Test
before you can use it in an assessment. A test
can include one or more items.
To do this, go back to TAO's Assessment
Builder Bar, and select Tests. You can add
items to a Test by selecting them from the Test
Library. See the Creating a new test section for
more details.
5. Give your Test a trial run
This can be done by setting up a dummy test-
taker account, which you would do at the start
of the academic year. A trial helps ensure
everything will run as expected during the
actual student assessment. After checking the
Test with a trial run, the next step is to set up a
Delivery.
6. Register Your Test-Takers
Students need to be registered as Test-Takers
in TAO before the first assessment. In most
cases this is done by the instructor or course

14
administrator using student rosters.
To do this, select Test-Takers in the
Assessment Builder Bar. See the Creating test-
takers section for more details.
7. Assign test-takers to Groups
After entering or uploading the Test-taker
profiles of all your students in the TAO
assessment system, you will need to organize
them into groups, depending on which
students are taking which assessments. It may
be that an entire class of students is taking the
same assessments, or it may be that you need
to create smaller groups of test-takers for
certain types of assessment.
To do this, select Groups in the Assessment
Builder Bar. See the Creating a new group
section for more details.
8. Publish and Deliver Your Test
Before students can take the assessment you
have prepared, the test needs to be assembled
as a Delivery.
Assembled Deliveries only take a few moments
to put together, and govern when a test will be

15
taken, which selected individuals or groups will
take the test, and how long the test will last.
To do this, you will need to select Deliveries in
the Assessment Builder Bar. See the Creating a
new delivery section for more details.
9. View Your Results
After the assessment is over, you will want to
see how your test-takers did.
To do this, select Results in the Assessment
Builder Bar. See the Exporting results section
for more details.

16
What is an Item?
"An item is a set of interactions (possibly empty)
collected together with any supporting material
and an optional set of rules for converting the
candidate's response(s) into assessment
outcomes." - Question and Test Interoperability
standard, published by IMS Global

Term Item

Items are the basic building blocks for


assessments. They may contain a single
interaction (a simple item), or several closely-
related interactions, all the same type or of a
mixture of types (a composite item). Note that
items contain interactions, but are not
interactions themselves.

17
Beyond the interactions contained within them,
Items may include titles, images, and text,
which help the Test-taker understand the
expectations and context of the assessment
material presented within. Item complexity
ranges from simple items with a single
interaction to composite items with multiple
interactions.
Note: Items are 'locked' when other users are
working on them.

18
Creating a New Item
Together, questions and other types of
Interaction form Items, which comprise parts of
Tests. Items are created and populated with
Interactions, and can be combined to assess
Test-taker performance.
There are more than 17 types of interaction in
TAO. For information on the types of Interaction
available, see the Interactions section. Note that
an Item generally contains only one Interaction
type.
The videos below will demostrate how to easily
create some of the most popular items using
TAO.
How to create a Choice (multiple-choice) Item
using TAO:

19
How to create an Inline Item using TAO:

How to create an Associate Item using TAO:

20
Now, let's walk through the steps of creating an
Item.
1. Click on the Items icon in the Assessment
Builder Bar.
This will take you to the Items page. The Library
on the left-hand side will show existing Items.
The last Item to be edited (either by you or a
previous user) will be highlighted in the Library.
In this tour, however, you will create a new
Item.
2. Click on the New item icon in the button bank
under the library.
This will create a new item in the selected
folder.

21
Note: To create a new item in a different folder,
click on that folder in the Library, and then select
the New item icon in the button bank. To create a
new folder (in TAO these represent classes), click
on New class in the button bank. Select a location
within the Library, and the new folder (class) will
be created there.
3. Label and save your Item.
Creating a new Item will bring up a new dialog
box with the option to name (or label) your
item. After labeling your item, click Save. This
produces an empty item, which you can now
populate with interactions.
4. Click on the option Authoring in the Action
Bar.
This will take you to the empty Item you have
created. You can now start to fill this with your
interactions. In the Library on the left, you will
now see the Common Interactions catalog. You
will find the other types of interaction below
this catalog: Inline Interactions, Graphic
Interactions and Custom Interactions. You can
navigate these catalogs to choose the types of
interaction you want to use for your item. The
Interaction section will tell you about the

22
different types of interaction which you can
use in TAO.
Note: Items are 'locked' when you (or another
user) are working on them.

Optional Extras
Duplicating an already existing Item
You can make a copy of an already existing
item by clicking on the Duplicate icon in the
button bank under the library. A duplicate will
then be created in the folder of the item you
have duplicated, with the same name but with
"bis" on the end.

Translating your Item


You can translate an existing item by clicking
on the Translate icon in the Action Bar. This will
bring up a dialog box in which select the
translation information. Select a language from
the drop-down menu, and then label your
translated Item in the Translate Label box.

Granting user access


As an administrator, you can permit a user
certain access rights to specific folders
(classes), items or tests. To do this, select a

23
folder and then click on the Access Control icon
in the button bank under the library.
This will bring up a window with the following:
A search bar for users, with a list of users
with granted access
A search bar for roles, with a list of roles
with granted access
You can define the rights of every user or role
by checking the relevant boxes below:
Read - allows the user to view the
folder/item/test
Write - allows the user to edit the
folder/item/test, or to create new ones in
that folder
Grant - allows both of the above
Clicking the brown button Remove will delete
user/role from the list.
Note: Unchecking all the boxes for a specific
user/role will also remove them from the list.
When you have checked the correct boxes,
click the blue Save button to save your
changes.

Viewing the history of an Item

24
In TAO, it is possible to maintain different
versions of the same item, and this is done
using the History icon.
When you have finished editing an Item, and
want to save it as a new version (instead of
overwriting the original version), click on
History in the Action Bar. Before saving the new
version, you will need to enter a comment, such
as "modified after spring 2016 field test", in
order to distinguish it from other versions, and
then click Commit.
You will then be presented with the history of
that Item: the version ID, the date it was saved,
the user who authored it, and the comment.
Note: If any changes are later made to the Item,
you can return to the previous version by clicking
Restore. A new version of the file is then created,
and given a correspondingly numbered the default
name such as "restored version 1". The file name
can be changed.

25
Importing Items
If both computers have access to TAO, Items
and interactions can be imported from one
computer to another, using an operation called
Import.
1. Click on Items on the Assessment Builder Bar.
This will take you to the Item Library, which you
will see on the left.
2. Click on the Item class (folder) in the Library
in which you wish to import the new item.
3. Click on Import in the button bank below the
Library.
This opens a dialog box which asks you to
select the format of the Item to be imported.
The supported input formats are: QTI (Question
and Test Interoperability) packages or items,
APIP (Accessible Portable Item Protocol)
packages, RDF (Resource Description
Framework) or CSV (Character-Separated
Values) files. Be sure that the Item to be
imported is in this format, or the import won't
work.
4. Click the blue Browse button to find the file

26
intended for import (alternatively, the file may
be dragged and dropped into the box below the
button).
5. Once the Item is selected, click on the blue
Import button.
This will import the Item into the Item library,
after which it can be added to Tests, or
modified.

27
Exporting Items
Interactions can be put together into Items on
almost any computer that has access to TAO.
However, there will be situations in which
sharing Items will be useful. For instance, two
teachers who teach the same course may
collaborate and share the responsibility of
creating questions for an upcoming Test. This
can be done in a few easy steps.
1. Click on the Items icon in the Assessment
Builder Bar.
2. Click on either the Item folder (class) you
want to export in the Item Library on the left-
hand side, OR click on New class in the button
bank below the Library to create a new folder
for the items you would like to export.
Creating a new class (i.e. a new folder) allows
you to place Items in a distinct location in order
to be transferred from one computer to
another.
The Item class can be renamed in the "Edit item
class" dialog box in the field marked Label.
Clicking the blue Save button will create the
class.

28
Note: Individual Items can be exported without
creating a new class to transfer them to. It is
useful, however, to organize the transfer in a
single folder for a one-time export.
3. If you have created a new class for this
purpose, move the items to be transferred to
this new class in the Item Library.
This selects the Items that will be exported.
4. After clicking on the class, click Export in the
button bank below the Library.
The dialog box will ask you to choose an export
format from the list: QTI, APIP or RDF. If the
Item is to be exported as a Question and Test
Interoperability (.qti) formatted document, it
will save the file(s) as a compressed .zip file.
You also need to confirm that the folder or file
highlighted is the one that should be exported,
by checking the Items box.
5. Click the blue Export button in the dialog box
to continue with the export.
6. Select the location to which you want to
export your Item, and then click Save.
The Item can then be transferred either to a

29
data storage device or a computer network.
The next step in the transfer is to import the
item onto the desired computer.

30
Adding Images,
Videos or Sounds
In earlier versions of TAO, images, videos, and
sounds were inserted through a special feature.
This is no longer the case. For instructions on
how to add Media (videos or sound files), refer
to the Media interaction section. For still
images, this section will review the instructions
on adding these to a typical text block.
1. All text blocks in your interaction or item
(e.g. the choices in a choice interaction) have a
tab with an icon attached that governs changes
to text. The icon is a capital letter A. Click on
this icon.
This displays a menu bar with several icons.
The left-hand group changes the lettering of
the text block, allowing you to put the text in
bold or italics, underline it, or to insert a
subscript or superscript (useful for math
formulas). The middle and right-hand groups
both insert elements. The right-hand group
contains a chain icon, which inserts links to
web pages.

31
In the middle group there are three icons. The
first icon, which depicts an omega sign, inserts
special characters (also useful for
mathematical formulas). You can insert a
shared stimulus using the second icon. The
third icon, showing a picture, inserts still
images. This tutorial will center around this
picture icon.
2. Click on the picture icon.
This opens a window which provides access to
the Resource Manager, and consists of three
panels. As with the main window, the left panel
is a Library: the Resource Library. The middle
panel shows the list of pictures which are
available within the highlighted Class in the
Resource Library. The right panel provides a
preview and properties. If your picture is
already in the Resource Library, click on that
picture and skip to Step 4. If it is not, then carry
out Step 3.
3. To add a new picture from your desktop,
click the blue Add file(s) button. Then, click the
blue Browse... button.
You can now navigate your computer system to
select the still image you wish to upload into

32
your TAO system. Then click on the green
Upload button. When it has been uploaded, a
preview image of the graphic will appear. You
can select any .jpg, .gif, or .tif, graphic file to
upload and display.
Note: .png files must be converted to an
appropriate format before they can be displayed.
4. Click the green Select button.
This uploads your still image into the text
block. If you begin typing without hitting
Return, the text will center vertically. If your
text extends beyond the first line, however, it
will wrap underneath the image. If the image is
followed by a longer text, it is best to hit Return
on your keyboard at least once before starting
to type.

33
Item Scoring Rules
Test-takers who complete a Test will often ask,
"What score did I get?" Scores are generated
through performance in the various interactions
that make up the Items, which themselves
compose the Test. Interactions generate
individual scores, which count towards the
overall score of the Item, and all Item scores are
tallied to produce the final Test result. Knowing
how to set up scoring within an interaction is
therefore useful in determining the Test-Taker's
grade.
After you have created your Interaction, go to
the Response window and follow the steps
below to set up your chosen scoring method.
1. In the Response Properties panel on the
right, locate the Response Processing pull-down
choice box offering the two options: Match
Correct and Map Response.
Match Correct: With this processing option,
either the question is answered correctly or
incorrectly. There is no partial credit, so if part
of the response is incorrect, the whole answer
is marked as incorrect.

34
Map Response: With this processing option, it is
possible to give partial credit for a response.
This is useful for questions where the answer
is given in multiple parts. With the map
response option, some parts of the answer can
also be weighted more heavily than other parts
if you consider them to be of higher
importance.
2. Select the Response Processing type that is
appropriate for the question.
This is going to depend to a large extent on
preference, particularly with respect to partial
credit.
If you select Match Correct, stop here - the
scoring settings for this Interaction are
complete.
3. If you select Map Response, review the
responses in your Interaction, then determine
and assign corresponding weights to each
potential response.
Partial credit can be awarded here by assigning
values in the weight boxes in order of
importance in your Interaction canvas.
Note: For most interaction types, score boxes are

35
located to the right of the potential responses.
4. Set the values of the Score Range fields,
located in the Response Properties panel.
This is where you can specify the minimum and
maximum number of points awarded for this
interaction. Its use is optional.
The minimum score indicates the minimum
number of responses the Test-taker is required
to select for it to be a valid answer. If the
interaction involves selecting more than one
response, the maximum score should reflect
the total of the weights for all correct
responses, i.e. the maximum score possible for
your Interaction. If only one response is
expected, the maximum should equal that of
the highest weight. Adjust these values as
needed.
So if, for example, there are two correct
responses in the question, and you have
assigned a weight of 1 to one of them, and a
weight of 2 to the other, the Test-taker would
get a score of 3 if they are both correct
(providing the maximum is set to 3 or above).
Other values in the Score Range field include
Mapping Default, which contains the default

36
value given if no specific scores are assigned
to a response, and the check box used to Define
Correct Response. The latter should be checked
if there are specific correct responses, and left
unchecked if the correctness of the answer is
dependent on the sum of weights accumulated
by the Test-taker in answering the interaction.
Lastly, it should be noted that TAO assigns a
Response Identifier to each interaction
response. It is best not to change this.

37
Modal Feedback
Modal feedback can be defined as a message
presented to the Test-taker outside of the Item,
when the Test-taker selects an answer.
Feedback may be triggered by either a correct or
an incorrect answer, depending on the
conditions set by the test author. These are
optional, but sometimes useful when you want
to encourage the Test-taker, or give a hint
("Good job!" "Keep trying!" etc.).
After you have created your Interaction, go to
the Response window and follow the steps
below if you would like the test-takers to
receive modal feedback during this interaction.
1. Many of the Interaction types have the
option of giving Modal Feedback. If this is
available, click on the Add a Modal Feedback
button in the Response Properties panel on the
right.
This opens a modal feedback panel in which
you can insert the feedback and specify when it
should be given.
2. Insert your feedback and feedback
conditions.

38
If the feedback is to be given when the Test-
taker gets the correct answer, then ensure that
the if-statement is set to correct. You can also
set it to incorrect or any numeric comparative
relationship.
Then fill in the then-statement by first clicking
on the blue Feedback button, and then entering
the desired text in the pop-up window. When
complete, click the done button.
If alternative feedback for the opposite
condition is required, click the Feedback button
for the else-statement, and follow the same
procedure used to set up the initial feedback.
3. If additional modal feedback is required, then
click the Add a Modal Feedback button below
your first Modal Feedback and repeat the
above steps.
You can preview your modal feedback using
the steps given in the Preview instructions.

39
Preview
Completed Items or Interactions can be
previewed to determine if performance is as
expected. Performance testing is highly
recommended prior to the use of an Item in a
Test.
Previewing typically takes place after clicking
Done for the completed Interaction. This will
bring up the completed interaction on the
canvas. On the Action Bar above the canvas
there is a series of buttons, including Save,
Preview, and Print.
1. Click Preview.
Note: Clicking Save* before clicking Preview is
certainly good practice, but not necessary as
you can save your Interaction as part of the
Preview procedure.*
A pop-up window will appear with which you
can save your Interaction (the window will
appear whether the interaction has been saved
already or not, just to ensure that the latest
version of the Interaction is not lost during
testing).

40
2. Click the blue Save button in the pop-up
window.
This brings up the Interaction as it will appear
to the Test-taker.
Answer the question correctly or incorrectly to
see if the Interaction performs as expected.
Clicking Submit will bring up a black screen
below the demonstrated Interaction which
shows the score for the answer you have given.
Effective testing begins with reviewing the
performance of the Interaction when the Test-
taker answers the question both correctly and
incorrectly. If the Interaction uses Map
Response scoring, it is a good idea to try out
not only answers which are either completely
correct or completely incorrect, but also to test
the various ways in which partial credit may be
awarded.
3. Once testing is completed, click the Close
button at the top of the page.
This will take you back to the point where
further changes to the Interaction may be
made (click on the item to return to Authoring),
or where the Interaction can be dismissed until
the Test is assembled.

41
Style Editor
White, black, grey, and blue, all done up in a
sans-serif font, can get boring after a while. The
Style Editor can help you make your items look
more appealing. The Style Editor is found in the
TAO interface above the Properties Panel on the
right in an Item window. It should be noted that
this feature is meant only to adjust the
appearance of a small number of items.
1. To access the Style Editor, click on the Style
Editor button in the blue Action Bar above the
Properties Panel.
This will turn the Properties Panel into a Style
Editor panel. There are two parts to the editor,
the Style Sheet Manager at the top, and the Style
Editor below this.
2. If you have a style sheet ready for upload,
click on the Add Style Sheet button.
This will provide an interface similar to that of
adding a graphic into a Graphic Interaction. You
can use an existing style sheet by clicking the
Add file(s) button and uploading it.
In all other cases, if you wish to format the

42
style for this Item only, use the Style Editor
below to enter the settings you would like to
use for this Item. The Style Editor has three
parts: (1) Color, (2) Font, and (3) Item width.
3. Adjust the colors to your liking.
There are four color swatches that can be
changed in accordance with your preferences,
one for each of: Background color, Text color,
Border color, and Table headings.
Clicking on any of these (e.g. Background color)
opens a color editor panel which consists of a
square surrounded by a color wheel (a swatch),
and a text box below.
Select a color by moving the cross onto the
desired hue on the color wheel. In the square
you can then adjust the contrast (left and right)
and brightness (up and down). You can use the
text box to save a specific color setting when it
is found as portions of Red, Green, Blue (in RGB
hexidecimal-percent of primary color density).
The four swatches cover specific parts of any
Item and its Interactions. The Background color
provides the color backing of the entire item.
The text color is used for all text within the
Item and its related Interactions. The border

43
color governs that of the borders of
Interactions. Finally, the table heading color
swatch provides the color setting for
Interactions which use tables (such as Match).
4. Adjust the fonts to your liking.
Create the desired font by adjusting the font
family and font size.
Click on the Font Family box, and select a font
family besides Default.
There are three types of fonts available: San
Serif fonts - lacking extra strokes at the ends of
letters, Serif fonts - with the small, projecting
strokes at the ends of letter, and Monospace
fonts - resembling a typewriter, each letter
being of equal width.
Using fonts which are not on this list requires
setting up a style sheet.
To select a font size, click in the font size box
and type in a number. There is no limit to the
size of font that can be selected, but of course
if the font is set too large it won't be displayed
properly.
5. The Item width can be set in the Item width

44
box.
The default Item width is set to adapt to the
width of the user's screen. It is highly
recommended that you do not change this
setting.
Some institutions prefer students to take tests
only on specifically designated computers
which have a specific screen width. TAO ofers
the option to set the width for a given Item.
However, for most schools, setting a width
presents a significant disadvantage in that a
set width setting that doesn't adapt to screen
size means different-sized computer screens
may have problems displaying Items. If it is
unnecessary to specify the Item width, it is
best to use the default setting.
6. If you are not satisfied with any of the
settings you've selected, click on the eraser
icon on the right of any of the settings boxes,
and the Item will be restored to its default
setting.
This is particularly useful if the settings
selected for the Item render an indecipherable
result. Simply restore the default settings with
a click.

45
Media Manager
The Media Manager provides a space to store
media files (images, audio and video) and to
access them from any item. This is a universally
shared folder, which means you don't need to
keep uploading the same files for use in
different items. The Media class will always
appear as an option for choosing input when
you are populating items.
You will find the same buttons in the Media
Manager as in most other functions under the
library on the left (New class, Delete, Import,
Export). The New class, Delete, and Export
buttons work in a very similar way to most of
the other functions. For more information on
any of these, click on the following links: New
class, Delete, Export.
The Import button works in a slightly different
way in the Media Manager. Follow the steps
below to import a new media file.
1. Click on the Media icon in the Assessment
Builder Bar.
2. Click on the Import button in the button bank
under the library on the left. This will bring up a

46
dialog box in the center of the screen.
3. Choose the input format. You have two
choices - a file, or a shared stimulus
(information shared between multiple items).
A file can be in any picture, audio or video
format (.jpg or .mp3, etc.). A shared stimulus
needs to be in xml format.
4. When you have chosen the input format, you
can either select Browse to browse the files
your computer, or you can drag and drop the
file into the space.
5. When the file has uploaded, click on Import.
Once the file has been imported, you will see
the message Media imported successfully. The
new file will appear in the library on the left, in
the Media class.
Note: You can create your own folders (classes)
within the Media class, and then select the one
where you want to upload the new media file.
6. Click on Continue.
A dialog box labeled 'Edit instance' will appear,
with the details of the new media file. This
contains the following information:

47
Label (the name of your imported file)
Alternative Text (rename the media file here
if you wish)
Language (the default language is English,
but you can change the language of the
media if appropriate)
If you want to replace the file with another,
click on Upload new media. Click Save to save
the changes, including alternative text.
For information on how to use your media files
in new items, see Adding images, videos or
sounds.

48
What is an
Interaction?
"Interactions allow the candidate to interact with
the item. Through an interaction, the candidate
selects or constructs a response. The candidate's
responses are stored in the response variables.
Each interaction is associated with (at least) one
response variable." - Question and Test
Interoperability standard, published by IMS
Global

Term Interaction

Interactions serve as a basic unit of Test-Taker


response. Items may be made up of one
interaction, or several related interactions. As

49
such, the term Interaction should not be
considered interchangeable with the term Item.
There are four categories of Interactions:
simple, text-based, graphic, and miscellaneous.
There are more than 17 interactions recognized
by the QTI standard.
In TAO, interactions include the mechanisms
used to score themselves.
For simple Items, correct answers add, unlike
incorrect answers, to the Test score. Scoring a
composite item using standard response
templates (match correct, map response, or map
response point) is often a more complicated
sum.

50
Choice Interaction
Choice Interaction, most frequently referred to
as the multiple choice question (MCQ), presents
a test type that has been made popular by such
time-honored exams as the SAT, ACT,
PSAT/NMSQT, etc. Choice interactions are
preferable to free-response test interactions in
cases where a large quantity of test questions
need to be covered in a short exam period.
Where time is of the essence, this type of testing
interaction is particularly useful.

Once you have generated a new Item, and


clicked on Authoring in the Action Bar, follow
the steps below to create a new Choice

51
Interaction:
1. From the Common Interactions library on the
left, drag the Choice icon onto the blank Item
and drop it onto the canvas.
This provides the answer choices for your
Choice Interaction.
2. Enter the question in the question field at the
top of the interaction where it says 'define
prompt'.
Note: The A icon on the right allows you to bold or
italize text, and to insert a picture, shared
stimulus, math expression or link into your
question. These options are available whenever
you see this icon.
3. A Choice Interaction has three default
answer choices. Click on choice #1 to type the
first answer choice in this field. Repeat this
step with the other choices to populate the
other fields with your answer choices.
You can add more choices by clicking the blue
Add Choice field below the first three choices
(keep clicking until the desired number of
choices appear in the item), and you can delete
choices by clicking the trash can icon to the

52
right of the choice you wish to delete.
4. After defining all answer choices, set the
minimum and maximum number of answer
choices that the Test-Taker will be asked to
provide (before he can continue to the next
question).
This can be done in the Allowed Choices boxes
in the Interaction Properties Panel on the right.
Setting the minimum to "0" allows the Test-
Taker to skip the question.
By default, your Choice Interaction is made of
checkboxes. Leaving the maximum on "0"
allows Test-Takers to select an unlimited
number of choices.
To set up a radio button test interaction, select
a maximum of 1. This means that your Test-
Taker will not be allowed to select more than
one choice. You can see on your interaction
that radio buttons will be displayed.

Optional Extras when


Creating a Task
The following options are available in the
Interaction Properties panel on the right.

53
Presenting the answer choices in list
format
To present the choices as a list, select one of
the options in List style, which is located below
the Allowed Choices.

Shuffling the choices


Check the Shuffle choices box. This will
randomize the order in which answer choices
appear for each test-taker. In this manner,
guessing or copying strategies is rendered
useless. Where the order of items is
unimportant, this is recommended.
Note: Remember that if you use this option, avoid
choosing an ordinal list style, eg. A,B,C or 1,2,3.

Presenting the answer options


horizontally
Answer choices can be presented either
vertically or horizontally. This can be defined in
the Orientation option. The default is vertical.
5. Click Response on the right of the blue
interaction header to define the correct
answer(s).
This activates options for setting the correct

54
answer.
6. Select the correct answer by clicking the box
in front of it.
You can select more than one answer.

Optional Extras when


Processing a Response
The following options are available in the
Response Properties panel on the right.

Modifying the scoring method


By default, a test-taker receives one point per
completely correct interaction, so in the case
of Choice interactions, the test-taker has to
select all the correct choices in order for the
answer to be considered correct.
You may want to modify the scoring method if,
for example, you want the test-taker to receive
partial credit for selecting some, but not all, of
the correct choices. Or you may wish to give a
higher weight to some of the choices than to
others.
You can do this using the map response option
of Response processing, in the Response

55
Properties panel on the right. When you choose
this option, there are several settings you need
to enter.
First, assign a weight to each choice in each of
the corresponding Interaction boxes.
Click here for more details on how to use this
scoring method, and how to set the values of
the associated properties.

Inserting modal feedback


If you wish, you can insert Modal Feedback into
this Interaction. For more information on how
to do this, see the Modal Feedback section.
7. Click the blue Done button. Your Choice
Interaction is now complete.
After this step, you can preview your
Interaction using the steps given in the Preview
instructions.

56
Order Interaction
The Order interaction gives Test-Takers the
opportunity to demonstrate their knowledge of a
particular order of elements: chronological
orders, priority orders, alphabetical or numerical
orders, orders of size, etc.

Once you have generated a new Item, and


clicked on Authoring in the Action Bar, follow
the steps below to create a new Order
Interaction:
1. From the Common Interactions library on the
left, drag the Order icon onto the blank Item and
drop it onto the canvas.
This creates a new Order Interaction window.
There is a question field at the top, with two
boxes underneath.
2. Enter the question in the question field,
where it says 'define prompt'.

57
This will describe the task given to the test-
taker ("Place the following in chronological
order", etc.).
Note: The A icon on the right allows you to bold or
italize text, and to insert a picture, shared
stimulus, math expression or link into your
question.
3. Fill in the options for each question in box to
the left.
There are three default options, but you can
add more by clicking the blue Add choice field
at the bottom. You can delete options by
clicking the trash can icon to the right of the
option you wish to delete.

Optional Extras when


Creating a Task
The following options are available in the
Interaction Properties panel on the right.

Shuffling the choices


Check the Shuffle choices box. This means that
the order in which the answer options are
presented will be randomized (recommended if
the order of presentation is not important).

58
Specifying correct number of answers
Specify the minimum and maximum number of
answer options that the test-taker will be asked
to provide (before he can continue to the next
question) in the Allowed Choices boxes. By
default these are empty, which means the test-
taker can include as many (or as few) of the
answer options as he likes. (Setting the
minimum to 0 allows the test-taker to skip the
question.)

Presenting the answer options in list


format
The answer options can be presented as a list.
To choose a list style, select one of the options
in List style, located below the Allowed Choices
in the Interaction Properties panel.

Present the answer options


horizontally
Below the List style option is the Orientation
option. Answer options can be presented either
vertically or horizontally using this option. The
default is vertical.
4. Click Response on the right of blue
interaction header to define the correct
answer(s).

59
Then click on each option in the left-hand box
in the desired order. The options will be
transferred in this order to the right-hand box.
If you are not satisfied with the order you have
chosen, click in the right-hand box and then on
the option which is in the wrong place. You can
then click on the up or down arrow on the right
to move it up or down respectively.

Optional Extras when


Processing a Response
The following option is available in the
Response Properties panel on the right.

Inserting modal feedback


If you wish, you can insert Modal Feedback into
this Interaction. For more information on how
to do this, see the Modal Feedback section.
6. Click the blue Done button. Your Order
Interaction is now complete.
After this step, you can preview your
Interaction using the steps given in the Preview
instructions.

60
Associate Interaction
The Associate Interaction assesses the Test-
Taker's ability to match associated words or
phrases.
For a quick glimpse of how to create an
Associate Interaction in TAO, please watch the
following video.

Once you have generated a new Item, and


clicked on Authoring in the Action Bar, follow
the steps below to create a new Associate
Interaction:
1. From the Common Interactions library on the
left, drag the Associate icon onto the blank Item

61
and drop it onto the canvas.
This opens a new Associate Interaction
window. There is a question field at the top,
two answer tile options below this, and then an
example of linked boxes at the bottom.
2. Fill in the question field where it says 'define
prompt', describing the associations (matches)
being sought.
This could be in the form of a question ("Which
country goes with which capital city?") or
instructional ("Match the country with the
capital city.").
Note: The A icon on the right allows you to bold or
italize text, and to insert a picture, shared
stimulus, math expression or link into your
question.
3. Fill in the answer tiles for the question.
You will need more than two, so select Add
choice as many times as is needed to provide
all the options to be made available to the test-
taker.
Note: We recommend adding the appropriate
matches first (e.g. the correct countries and

62
capitals) in separate tiles first, and then adding
the incorrect (unmatched) options.

Optional Extras when


Creating a Task
The following options are available in the
Interaction Properties panel on the right.

Shuffling the choices


Check the Shuffle choices box. This will help
disguise the matched pairs you have entered
for the question. If this is not clicked, how
you've entered the tiles will be how they will
appear to the test-taker.

Limiting the use of a choice


If you want to limit the number of times a
particular element is used, click on it. It will
then appear in the Identifier box in the right-
hand panel, which gives you the option to set
the Allowed number of uses. Setting this to a
maximum of 1, for example, will mean that the
Test-taker can only use that element in one
association.

Specifying the correct number of


associations
63
You can specify the minimum and maximum
number of associations the test-taker will be
asked to provide (before he can continue to the
next question) in the Number of associations
boxes in the Interaction properties panel. By
default these are empty, which means the test-
taker can include as many (or as few)
associations as he likes. Setting the minimum
to 0 allows the test-taker to skip the question.
4. Click Response on the right of blue
interaction header to define the correct
answer(s).
This will provide all the answer tiles created in
the previous step, and a series of associate
pair boxes, which are to be filled in the next
step.
5. Click on the first element to be associated,
and then click on the first box. Click its match
(association), and then click on the second box.
This will provide the first set of correct
responses. Continue with this procedure until
all association pairs have been linked in the
association boxes, leaving the incorrect
associations unmatched.

64
Optional Extras when
Processing a Response
The following options are available in the
Response Properties panel on the right:

Modifying the scoring method


By default, a test-taker receives one point per
completely correct interaction, so in the case
of Associate interactions, the test-taker has to
select all the correct associations in order for
the answer to be considered correct.
You may want to modify the scoring method if,
for example, you want the test-taker to receive
partial credit for selecting some, but not all, of
the correct associations. Or you may wish to
give a higher weight to some of the
associations than to others.
You can do this using the map response option
of Response processing, in the Response
Properties panel on the right. When you choose
this option, there are several settings you need
to enter.
First, assign a weight for each association in
the boxes next to each one.

65
Click here for more details on how to use this
scoring method, and how to set the values of
the associated properties.

Inserting modal feedback


If you wish, you can insert Modal Feedback into
this Interaction. For more information on how
to do this, see the Modal Feedback section.
6. Click the blue Done button. Your Associate
Interaction is now complete.
After this step, you can preview your
Interaction using the steps given in the Preview
instructions.

66
Match Interaction
The Match interaction provides Test-Takers with
a matrix upon which they can demonstrate their
knowledge by accurately associating selections
from two different sets of elements. The
association is carried out by placing check
marks in squares where matching rows and
columns intersect.
Once you have generated a new Item, and
clicked on Authoring in the Action Bar, follow
the steps below to create a new Match
Interaction:

1. From the Common Interactions library on the


left, drag the Match icon onto the blank Item
and drop it onto the canvas.
This creates a new Match Interaction window.
There is a question field at the top, and a
default 2-row-by-2-column matrix beneath this.

67
2. Fill in the question field, where it says 'define
prompt'.
This should describe the match association
task expected of the test-taker.
Note: The A icon on the right allows you to bold or
italize text, and to insert a picture, shared
stimulus, math expression or link into your
question. These options are available whenever
you see this icon.
3. Insert in the rows the first set of elements,
and in the columns the second set of elements
that are to be associated with the first.
Using the Add new row and Add new column
buttons, add as many rows and columns as will
be needed to cover all the associations. If
desired, add some unassociated elements in
either the rows or the columns to provide an
additional challenge for the Test-taker.

Optional Extras when


Creating a Task
The following options are available in the
Interaction Properties panel on the right.

Shuffling the choices


68
Check the Shuffle choices box. The sequence of
the row and column options will then be
randomized. This is recommended if the order
of presentation of either set of elements is not
important.

Limiting the use of a choice


If you want to limit the number of times a
particular row or column is used, click on it. It
will then appear in the Identifier box in the right-
hand panel, which gives you the option to set
the Allowed number of uses. Setting this to a
maximum of 1, for example, will mean that the
Test-taker can only use that element in one
match.

Specifying the correct number of


associations
You can specify the minimum and maximum
number of associations the test-taker will be
asked to provide (before he can continue to the
next question) in the Number of associations
boxes in the Interaction properties panel. By
default these are empty, which means the test-
taker can include as many (or as few)
associations as he likes. Setting the minimum
to 0 allows the test-taker to skip the question.

69
4. Click Response on the right of blue
interaction header to define the correct
answer(s).

Optional Extras when


Processing a Response
The following options are available in the
Response Properties panel on the right.

Modifying the scoring method


By default, a test-taker receives one point per
completely correct interaction, so in the case
of Match interactions, the test-taker has to
select all the correct matches in order for the
answer to be considered correct.
You may want to modify the scoring method if,
for example, you want the test-taker to receive
partial credit for selecting some, but not all, of
the correct matches. Or you may wish to give a
higher weight to some of the matches than to
others.
You can do this using the map response option
of Response processing, in the Response
Properties panel on the right. When you choose
this option, there are several settings you need

70
to enter.
First, assign a weight for each match in the
boxes next to each one.
Click here for more details on how to use this
scoring method, and how to set the values of
the associated properties.

Inserting modal feedback


If you wish, you can insert Modal Feedback into
this Interaction. For more details on how to do
this, see the Modal Feedback section.
6. Click the blue Done button. Your Match
Interaction is now complete.
After this step, you can preview your
Interaction using the steps given in the Preview
instructions.

71
Hottext Interaction
The Hottext Interaction gives Test-Takers the
opportunity to demonstrate their knowledge by
showing, among several selections within a
body of text, a specific type of word or phrase
(e.g. a grammatically incorrect element,
misspelling, main character in a story, capital
city).
[Hottext Interaction][media_hottext-interaction]
Once you have generated a new Item, and
clicked on Authoring in the Action Bar, follow
the steps below to create a new Hottext
Interaction:
1. From the Common Interactions library on the
left, drag the Hottext icon onto the blank Item
and drop it onto the canvas.
This creates a new Hottext Interaction window.
There is a question field at the top, followed by
a space (containing a sample text) in which to
place the text containing the phrases to be
highlighted as Hottext elements.
2. Fill in the question field, where it says 'define
prompt'.

72
This will describe the task given to the test-
taker ("Find the mistakes", "Pick the capital
city", etc.).
Note: The A icon on the right allows you to bold or
italize text, and to insert a picture, shared
stimulus, math expression or link into your
question. These options are available whenever
you see this icon.
3. Copy and paste, or type in, the text within
which the Hottexts will be presented.
The test-taker will choose the best option
Hottext elements.
4. Select a word or phrase and highlight it.
When the magic wand button comes up, click it
to confirm selection of the word or phrase as
your Hottext Interaction.
This will create a Hottext element within the
text. Typically, there will be one word or phrase
that matches the type being sought, and
several additional words or phrases that might
be similar to the type being sought. There
might be cases where more than one option is
correct, or where none of the options are
correct. At the end of the text, you can add a
final Hottext element which allows the Test-

73
taker to state that there is no correct selection
(e.g. "No error.")

Optional Extras when


Creating a Task
The following option is available in the
Interaction Properties panel on the right.

Specifying the correct number of


answers
You can specify the minimum and maximum
number of Hottext choices the Test-taker will
be asked to provide (before he can continue to
the next question) in the Allowed Choices
boxes. By default these are empty, which
means the test-taker can include as many (or
as few) answer options as he likes. Setting the
minimum to 0 allows the test-taker to skip the
question.
5. Click Response on the right of blue
interaction header to define the correct
answer(s).
This will produce the same window as before,
but you now have the possibility of placing
checkmarks by the right answer(s). Check all
that apply.

74
Optional Extras when
Processing a Response
The following options are available in the
Response Properties panel on the right.

Modifying the scoring method


By default, a test-taker receives one point per
completely correct interaction, so in the case
of Hottext interactions, the test-taker has to
select all the correct Hottext elements in order
for the answer to be considered correct.
You may want to modify the scoring system if,
for example, you want the test-taker to receive
partial credit for selecting some, but not all, of
the correct Hottext elements. Or you may wish
to give a higher weight to some of the Hottext
elements than to others.
You can do this using the map response option
of Response processing, in the Response
Properties panel on the right. When you choose
this option, there are several settings you need
to enter.
First, assign a weight for each Hottext element
in the boxes next to each one.

75
Click here for more details on how to use this
scoring method, and how to set the values of
the associated properties.

Inserting modal feedback


If you wish, you can insert Modal Feedback into
this Interaction. For more information on how
to do this, see the Modal Feedback section.
6. Click the blue Done button. Your Hottext
Interaction is now complete.
After this step, you can preview your
Interaction using the steps given in the Preview
instructions.

76
Gap Match
Interaction
The Gap Match Interaction gives Test-Takers the
opportunity to demonstrate their knowledge in a
manner similar to Match Interactions. A Gap
Match, however, provides a set of match words,
some of which will fit into gaps within a
selected text passage. In essence, this is a
combination of a match interaction and a "fill
the gap" question.
[Gap Match Interaction][media_gap-match-
interaction]
Once you have generated a new Item, and
clicked on Authoring in the Action Bar, follow
the steps below to create a new Gap Match
Interaction:
1. From the Common Interactions library on the
left, drag the Gap Match icon onto the blank
Item and drop it onto the canvas.
This opens a new Gap Match Interaction
window. There is a question field at the top, a
middle field for the words which are to be
matched, and a lower field for the gapped text,

77
which contains a sample text.
2. Fill in the question field, where it says 'define
prompt'.
Typically this will be some variation of "Fill in
the gaps from the following word set."
Note: The A icon on the right allows you to bold or
italize text, and to insert a picture, shared
stimulus, math expression or link into your
question. These options are available whenever
you see this icon.
3. Insert the text which will contain the gaps
into the text field at the bottom.
The Gap Match elements will be extracted from
this text.
4. Select the words or phrases you want to
make into Gap Match elements within the text.
Click on the word or phrase in the text to
highlight it. This will create a magic wand
button.
Click on the magic wand to confirm your
selected location for a Gap Match element.
This creates a gap in the text, and places the
word/phrase into the match words field.

78
Repeat as many times as is needed to
adequately assess the test-taker's knowledge
of the passage.
5. If desired, add extra options into the match
words field by clicking the add choice button.
Placing additional words into the match word
field may prevent test-takers from successfully
using "process of elimination" as a strategy.

Optional Extras when


Creating a Task
The following options are available in the
Interaction Properties panel on the right.

Shuffling the choices


Check the Shuffle choices box. The sequence of
the match word options will then be
randomized. Ths is recommended if the order
of presentation of the match words is not
important.

Limiting the use of a choice


If you want to limit the number of times a
particular element is used, click on it. It will
then appear in the Identifier box in the right-

79
hand panel, which gives you the option to set
the Allowed number of uses. Setting this to a
maximum of 1, for example, will mean that the
test-taker can only use that element in one
match.

Obliging the test-taker to give an


answer
If you want to prevent test-takers from
continuing to the next question without
providing an answer, check the required box for
that gap match. This box appears after you
have inserted the gaps in the text.
7. Click Response on the right of blue
interaction header to define the correct
answer(s).
To define the correct answers, drag and drop
the correct match words from the match word
field onto the corresponding gaps in your text.

Optional Extras when


Processing a Response
The following options are available in the
Response Properties panel on the right.

80
Modifying the scoring method
By default, a test-taker receives one point per
completely correct interaction, so in the case
of Gap Match interactions, the test-taker has to
select all the correct matches in order for the
answer to be considered correct.
You may want to modify the scoring method if,
for example, you want the test-taker to receive
partial credit for selecting some, but not all, of
the correct matches. Or you may wish to give a
higher weight to some of the matches than to
others.
You can do this using the map response option
of Response processing, in the Response
Properties panel on the right. When you choose
this option, there are several settings you need
to enter.
First, assign a weight for each correct match in
the Pair Scoring box below the text. To do this,
click on an appropriate match word and then on
the space in which it should be placed. Now
click the Add button, and it will appear in the list
of matches at the bottom of the window. Check
the Correct box, and assign the desired weight
for matching this correctly in the Score box. Fill

81
all the gaps with their appropriate matches.
Click here for more details on how to use this
scoring method, and how to set the values of
the associated properties.

Inserting modal feedback


If you wish, you can insert Modal Feedback into
this Interaction. For more details on how to do
this, see the Modal Feedback section.
8. Click the blue Done button. Your Gap Match
Interaction is now complete.
After this step, you can preview your
Interaction using the steps given in the Preview
instructions.

82
Slider Interaction
The Slider item gives Test-Takers the
opportunity to demonstrate their knowledge of a
numerical type, such as a percentage, a total,
etc. The answer is conveyed by sliding an
indicator on a horizontal scale.

Once you have generated a new Item, and


clicked on Authoring in the Action Bar, follow
the steps below to create a new Slider
Interaction:
1. From the Common Interactions library on the
left, drag the Slider icon onto the blank Item and
drop it onto the canvas.
This creates a new Slider Interaction window.
There is a question field at the top, followed by
a graphical control element (a 'slider')
indicating the scale covered by the answers to
the question. Below the slider is the current
value depicted by the slider ("0").

83
2. Fill in the question field, where it says 'define
prompt'.
This will describe the task given to the Test-
taker, typically a question involving numbers or
a fraction, etc.
Note: The A icon on the right allows you to bold or
italize text, and to insert a picture, shared
stimulus, math expression or link into your
question.
3. Adjust the settings on the slider.
This can be done in the Interaction Properties
panel on the right.
First, set the upper and lower limits of the
slider using the Upper Bound and Lower Bound
boxes.
By default, the lower boundary is set to 0 and
the upper to 100. These default values
anticipate a percentage answer, but can be
adjusted as desired, so long as the lower
boundary is less than the upper."
Next, adjust the intervals on the slider in the
Step box. By default, the Step value is set to 1.
These values should be customized to fit the

84
question. (For example, in the question "What
was the population of the Icelandic city of
Reykjavik in 2014?", the interaction properties
for the answer, 120,000, might be set so that
the lower value is 100,000, the upper value is
200,000, and the step value is 10,000.)
4. Click Response on the right of blue
interaction header to define the correct
answer(s).
This provides access to the actual slider, so
that the answer can be set. You can do this by
moving the indicator to the correct value.

Optional Extras when


Processing a Response
The following option is available in the
Response Properties panel on the right.

Inserting modal feedback


If you wish, you can insert Modal Feedback into
this Interaction. For more information on how
to do this, see the Modal Feedback section.
5. Click the blue Done button. Your Slider
Interaction is now complete.
After this step, you can preview your

85
Interaction using the steps given in the Preview
instructions.

86
Extended Text
Interaction
The Extended Text Interaction provides the
means of examining the Test-Taker's ability to
reproduce a phrase, sentence, or text passage
exactly. The answer must not deviate from the
original in any way.

Once you have generated a new Item, and


clicked on Authoring in the Action Bar, follow
the steps below to create a new Extended Text
Interaction:
1. From the Common Interactions library on the
left, drag the Extended Text icon onto the blank
Item and drop it onto the canvas.
This opens a new Extended Text Interaction
window. There is a question field at the top,
with an extended text field below it.

87
2. Fill in the question field, where it says 'define
prompt'.
The test-taker will be expected to remember
the answer exactly, without any variation. Even
an extra space will result in the answer being
marked as incorrect.
Note: The A icon on the right allows you to bold or
italize text, and to insert a picture, shared
stimulus, math expression or link into your
question.

Optional Extras when


Creating a Task
The following options are available in the
Interaction Properties panel on the right.

Defining a certain format


Plain text format is the default which is
expected as input from the test-taker. If
desired, you can specify the type of text format
as either preformatted text or XHTML in the
Format box.

Placing constraints on the answer


You can limit the length of text the test-taker

88
enters in the answer field by setting a
maximum length or word count. Alternatively,
you can specify a certain pattern in Constraints.

Giving hints about the text length


You can provide hints for the test-taker about
the length of the text by filling in the
Recommendations fields. This provides the test-
taker with an expected length, in either
characters or number of lines. (This can also be
done after you have entered the answered
expected in Step 4.)
4. Click Response on the right of blue
interaction header to define the correct
answer(s).
Enter the expected answer in the answer field.
Again, the test-taker is expected to answer
exactly. Any variation(s) will result in the
answer being marked as incorrect.

Optional Extras when


Processing a Response
The following options are available in the
Response Properties panel on the right.

Inserting modal feedback

89
If you wish, you can insert Modal Feedback into
this Interaction. For more information on how
to do this, see the Modal Feedback section.
5. Click the blue Done button. Your Extended
Text Interaction is now complete.
After this step, you can preview your
Interaction using the steps given in the Preview
instructions.

90
File Upload
Interaction
The File Upload Interaction provides an interface
in which Test-Takers can upload a pre-written
essay, completed artwork, or other form of
submission.

Once you have generated a new Item, and


clicked on Authoring in the Action Bar, follow
the steps below to create a new File Upload
Interaction.
1. From the Common Interactions library on the
left, drag the File Upload icon onto the blank
Item and drop it onto the canvas.
This opens a new File Upload Interaction
window. There is a question/prompt field at the
top, and a Browse box with which to upload the
desired submission.

91
2. Fill in the question field, where it says 'define
prompt'.
Add an instruction for the test-taker to submit
work, such as Upload document.
Note: The A icon on the right allows you to bold or
italize text, and to insert a picture, shared
stimulus, math expression or link into your
question.
3. Select the file type expected.
This can be done in the Interaction Properties
panel on the right by setting the Multipurpose
Internet Mail Extension (MIME) type desired for
the submission, if applicable.
If a MIME type is selected, this will allow the
candidate to submit files of that particular type
(.pdf, .doc, .jpg, etc.)
4. Click the blue Done button. Your File Upload
Interaction is now complete.
After this step, you can preview your
Interaction using the steps given in the Preview
instructions.

92
Media Interaction
The Media Interaction allows the Test-Taker to
view a multimedia presentation (image slide
show, YouTube video, etc.), usually in
connection with another interaction.

Once you have generated a new Item, and


clicked on Authoring in the Action Bar, follow
the steps below to create a new Media
Interaction:
1. From the Common Interactions library on the
left, drag the Media icon onto the blank Item
and drop it onto the canvas.
2. From the Common Interactions menu in the
Library Panel, drag the Media icon onto the
blank Item and drop the resulting box in the
blue field that appears.
A Resource Manager window will appear with
which you can select a media file. You can re-

93
use a media file already in the resource
manager, or you can upload a new one (note
that size and file type restrictions apply). To
select one from the list of previously uploaded
media, highlight the appropriate one in the
resource manager list and click the green
Select button. To upload a new one, click on the
blue Add file(s) button to browse the files on
your computer, and then upload one to the
resource manager by clicking the green Upload
button.
Highlight the file you have chosen as your
background by clicking on it, and it will appear
on the right in the preview panel. Click Select in
the bottom right of the window to continue.
Note: Alternatively, exit this resource window and
enter the web address of an online video or audio
resource in the box entitled Media file path or
YouTube video address* in the Interaction
Properties panel. See here for supported media
formats.*
A new authoring window will appear with the
media shown in the center of the canvas.
Above the media file there is a question field.
3. Fill in the question field, where it says 'define

94
prompt'.
This will describe the task given to the test-
taker ("View the following film", "Listen to the
inflections in the following sound recording",
etc.).
Note: The A icon on the right allows you to bold or
italize text, and to insert a picture, shared
stimulus, math expression or link into your
question.
4. Set the playback method of the media
device.
These property options will affect how the test-
taker views/hears the media object while it is
playing.
You can do this in the Interaction Properties
panel on the right.
First, determine the size of the screen on which
the video or audio will play in the Width and
Height boxes.
Then check autostart if the media device should
begin playing when the interaction is opened.
Check loop if the media device should play over
and over again. If this is checked, enter the

95
number of times you wish the loop to be
repeated in the Max plays count box.
Check Pause if the test-taker is permitted to
pause and restart the media device during the
interaction.
5. If desired, add a further interaction to the
Media Interaction.
Usually, a Media interaction is used to present
a film or sound clip, to which a series of
questions may be added. Drag the appropriate
interaction type from the Common Interactions
menu on the left, and consult the relevant
chapter of the User Guide for help on how to
execute this interaction.
6. Click the blue Done button. Your Media
Interaction is now complete.
You can now preview your Interaction using the
steps given in the Preview instructions.

96
Inline Choice
Interaction
Inline Choice allows the Test-Taker to complete
a "Fill in the Blank" question with one choice
taken from a selected list of answers. This is
usually combined with other interactions (note
that there is no question line for either block
interaction).
This interaction is one of two Block-related
interactions, the other being Text Entry (covered
in its own section).
For a quick glimpse of how to create an Inline
Choice Interaction in TAO, please watch the
following video.

97
Once you have generated a new Item, and
clicked on Authoring in the Action Bar, follow
the steps below to create a new Inline Choice
Interaction:
1. From the Inline Interactions library below
Common Interactions on the left, drag the Block
interaction, represented by a letter A icon, onto
the blank Item and drop it onto the canvas.
This creates a field (containing a sample text)
in which a text may be entered from a favorite
source (a Word document or website, for
instance), or typed in.
To enter your text, click inside the text field.
Note: The A icon on the right allows you to bold or

98
italize text, and to insert a picture, shared
stimulus, math expression or link into your block
text.
2. Once you have entered the text, drag the
Inline Choice icon from the Inline Interactions
library to a space next to where the test-taker
will be expected to fill in the blank.
This brings up a pop-up window with three
default choices. Enter the test-taker's answer
options by highlighting the default entries
(choice #1, etc.) and typing in each answer
option. For fewer choices, click the trash can
next to each choice to delete it. To add another
choice, click the blue Add Choice field below the
other choices to generate another field.
Repeat the above for each place in the text
where you would like to the test-taker to fill in
the blank.
Note: Remember to remove the actual words from
the text that the Inline Choice blanks are designed
to replace.

Optional Extras when


Creating a Task

99
The following options are available in the
Interaction Properties panel on the right.

Shuffling the choices


Check the Shuffle choices box. This will
randomize the order in which answer choices
appear for each test-taker. In this manner,
guessing or copying strategies is rendered
useless.
Note: Remember that if you use this option, avoid
choosing an ordinal list style, e.g. A,B,C or 1,2,3.

Obliging the test-taker to give an


answer
If you want to prevent test-takers from
continuing to the next question without
providing an answer, check the required box.
3. To select the right answer, click on each
Inline Choice element, and in the header bar of
the resulting pop-up window, click Response.
This produces the same selection of options
that the Test-taker will see. Simply select the
correct response to set the right answer.

Optional Extras when

100
Processing a Response
The following options are available in the
Response Properties panel on the right.

Modifying the scoring method


By default, a test-taker receives one point per
completely correct interaction, so in the case
of Inline Choice interactions, the test-taker has
to select all the correct choices in order for the
answer to be considered correct.
You may want to modify the scoring method if,
for example, you want the test-taker to receive
partial credit for selecting some, but not all, of
the correct choices. Or you may wish to give a
higher weight to some of the choices than to
others.
You can do this using the map response option
of Response processing, in the Response
Properties panel on the right. When you choose
this option, there are several settings you need
to enter.
First, assign a weight for each choice in the
boxes next to each one.
Click here for more details on how to use this

101
scoring method, and how to set the values of
the other associated properties.

Inserting modal feedback


If you wish, you can insert Modal Feedback into
this Interaction. For more information on how
to do this, see the Modal Feedback section.

Limiting the duration of the test


Click anywhere outside of the Text Space. This
will give you the option of setting the
Interaction as Time dependent (to be completed
within a certain interval), by checking the check
box. This option is covered in greater detail in
Test Settings.
4. Click the blue Done button. Your Inline
Choice Interaction is now complete.
After this step, you can preview your
Interaction using the steps given in the Preview
instructions.

102
Text Entry Interaction
Text Entry allows the Test-Taker to complete a
"Fill in the Blank" question with an exact text
answer. This interaction is one of two Block-
related interactions, the other being Inline
Choice (covered in its own section).
Once you have generated a new Item, and
clicked on Authoring in the Action Bar, follow
the steps below to create a new Text Entry
Interaction:
1. From the Inline Interactions library below
Common Interactions on the left, drag the Block
interaction, represented by a letter A icon, onto
the blank Item and drop it onto the canvas.
This creates a field (containing a sample text)
in which a text may be entered from a favorite
source (a Word document or website, for
instance), or typed in.
To enter your text, click inside the text field.
Note: The A icon on the right allows you to bold or
italize text, and to insert a picture, shared
stimulus, math expression or link into your block
text.

103
2. Once you have entered the text, drag the Text
Entry icon from the Inline Interactions library to
the space next to where the Test-taker will be
expected to fill in the blank.
This creates a pop-up window containing the
blank, which is to be filled by the test-taker. No
changes can be made here: the window just
confirms that you have created the blank.
However, a correct answer will need to be
selected and this is done in the Response
mode.
Note: Remember to remove the actual words from
the text that the Text Entry blanks are designed to
replace.

Optional Extras when


Creating a Task
The following options are available in the
Interaction Properties panel on the right.

Inserting a 'placeholder' text in the


blanks
If you would like to put a text in the fields the
test-taker is supposed to fill in, such as "Write
your answer here", enter it in the Placeholder

104
Text field.

Placing constraints on the answer


You can specify a certain pattern which should
be used in the answer. This can be done in the
Pattern Mask box.

Giving hints about the text length


You can provide a hint for the test-taker about
the length of the text by filling in the Expected
Length field. This tells the test-taker the
number of words expected.

Changing the base of numerical


values
The Base feature is used to set the number
base for the interpretation of numerical values
entered by the test-taker. By default this is 10,
i.e. its interpretation is based on the decimal
system. If it uses a different system, change
this here.
3. Click Response in the pop-up window to
define the correct answer(s).
This opens the response entry window, in
which you can enter the correct answers.
Remember that you will need to produce an

105
answer that the test-taker will be expected to
match exactly, character-for-character,
including spaces.
Repeat steps 2 and 3 until all the desired Text
Entry blanks have been inserted into the text.

Optional Extras when


Processing a Response
The following options are available in the
Response Properties panel on the right.

Modifying the scoring method


By default, a test-taker receives one point per
completely correct interaction, so in the case
of Text Entry interactions, the test-taker has to
select all the correct answers in order for the
answer to be considered correct.
You may want to modify the scoring method if,
for example, you want the test-taker to receive
partial credit for selecting some, but not all, of
the correct answers. Or you may wish to give a
higher weight to some of the answers than to
others.
You can do this using the map response option
of Response processing, in the Response

106
Properties panel on the right. When you choose
this option, there are several settings you need
to enter.
First, assign a weight for each response in the
boxes next to each one.
Click here for more details on how to use this
scoring method, and how to set the values of
the other associated properties.

Inserting modal feedback


If you wish, you can insert modal feedback into
this Interaction. For more information on Modal
Feedback, see the Modal Feedback section.

Limiting the duration of the test


Click anywhere outside of the Text Space. This
will give you the option of setting the
Interaction as Time dependent (to be completed
within a certain interval), by checking the check
box. This option is covered in greater detail in
Test Settings.
4. Click the blue Done button. Your Text Entry
Interaction is now complete.
After this step, you can preview your
Interaction using the steps given in the Preview

107
instructions.

108
Hotspot Interaction
The Hotspot Interaction gives Test-Takers the
opportunity to demonstrate their knowledge by
selecting portions of an image (regions on a
map, people in a line-up, etc.).
This interaction is one of a series of Graphic
interactions (the others are covered in their own
sections). All graphic interactions can be found
in the Graphic Interactions menu in the Library.
Once you have generated a new Item, and
clicked on Authoring in the Action Bar, follow
the steps below to create a new Hotspot
Interaction:
1. From the Graphic Interactions library near
the bottom of the Interactions library on the left,
drag the Hotspot icon onto the blank Item and
drop it onto the canvas.
2. Choose the desired background graphic.
A Resource Manager window will appear with
which you can select a background graphic.
You can re-use a background already in the
resource manager, or you can upload a new
one. To select one from the list of previously
uploaded graphics, highlight the appropriate

109
background graphic in the resource manager
list and click the green Select button. To upload
a new one, click on the blue Add file(s) button to
browse the files on your computer, and then
upload one to the resource manager by clicking
the green Upload button.
Highlight the file you have chosen as your
background by clicking on it, and it will appear
on the right in the preview panel. Click Select in
the bottom right of the window to continue.
A new authoring window will appear with the
background graphic in the center of the
canvas. Above the graphic there is a question
field. On the left there is an Associable Hotspot
Panel for inserting selected shapes that will
represent Associable Hotspots into the
background graphic (these include four
different shapes: rectangle, circle, ellipse, and
polygon). Below the Hotspot Panel there is a
trash can icon, which allows you to delete a
poorly-placed or misshapen Hotspot.
3. Fill in the question field, where it says 'define
prompt'.
This should cover such important information
as what the background graphic represents,

110
and what the test-taker is supposed to do in
this interaction.
Note: The A icon on the right allows you to bold or
italize text, and to insert a picture, shared
stimulus, math expression or link into your
question.
4. Insert the Associable Hotspots onto the
background graphic.
To insert a rectangle, click on one corner and
drag it across the intended area the Hotspot is
supposed to cover. To insert a circle or ellipse,
select its center and drag outward or inward
until the Hotspot is the right size. To insert a
polygon, begin at one corner, then click on each
corner in succession until the Hotspot is
complete. You can make all the shapes bigger
or smaller (or in the case of polygons change
the shape), but if necessary, click on the
problem Hotspot, click the trash can to delete
it, and then try again.

Optional Extras when


Creating a Task
The following options are available in the
Interaction Properties panel on the right.

111
Specifying correct number of answers
Specify the minimum and maximum number of
Hotspot choices that the test-taker will be
asked to provide (before he can continue to the
next question) in the Allowed Choices boxes. By
default, these are empty, which means the test-
taker can include as many (or as few) of the
answer options as he likes. (Setting the
minimum to 0 allows the test-taker to skip the
question.)
5. Click Response on the right of the blue
interaction header to set the Hotspots in the
order required by the question.
This will bring up the same screen, but you can
now assign scores to the Hotspots.
By default, a test-taker receives one point per
completely correct interaction, so in the case
of Hotspot interactions, the test-taker has to
select all the correct Hotspots in order for the
answer to be considered correct.
See Optional Extras below for other scoring
methods.

Optional Extras when


Processing a Response
112
The following option is available in the
Response Properties panel on the right.

Modifying the scoring method


You may want to modify the scoring method if,
for example, you want the test-taker to receive
partial credit for selecting some, but not all, of
the correct Hotspots. Or you may wish to give a
higher weight to some of the Hotspots than to
others.
You can do this using the map response option
of Response processing, in the Response
Properties panel on the right. When you choose
this option, there are several settings you need
to enter.
First, assign a weight for each Hotspot in the
boxes next to each Hotspot element. Click on
each Hotspot, and in the pop-up window that
appears, set the weight to be awarded if the
test-taker selects it correctly.
Click here for more details on how to use this
scoring method, and how to set the values of
the other associated properties.

Inserting modal feedback


If you wish, you can insert Modal Feedback into

113
this Interaction. For more details on how to do
this, see the Modal Feedback section.
5. Click the blue Done button. Your Hotspot
Interaction is now complete.
You can now preview your Interaction using the
steps given in the Preview instructions.

114
Graphic Order
Interaction
The Graphic Order Interaction gives Test-Takers
the opportunity to demonstrate their knowledge
of chronological order, orders of importance, etc.
as seen on a graphic (map, photo, or other
image).
This interaction is one of a series of Graphic
interactions (the others are covered in their own
sections). All graphic interactions can be found
in the Graphic Interactions menu in the Library.
Once you have generated a new Item, and
clicked on Authoring in the Action Bar, follow
the steps below to create a new Graphic Order
Interaction:
1. From the Graphic Interactions library near
the bottom of the Interactions library on the left,
drag the Order icon onto the blank Item and
drop it onto the canvas.
2. Choose the desired background graphic.
A Resource Manager window will appear with
which you can select a background graphic.
You can re-use a background already in the

115
resource manager, or you can upload a new
one. To select one from the list of previously
uploaded graphics, highlight the appropriate
background graphic in the resource manager
list and click the green Select button. To upload
a new one, click on the blue Add file(s) button to
browse the files on your computer, and then
upload one to the resource manager by clicking
the green Upload button.
Highlight the file you have chosen as your
background by clicking on it, and it will appear
on the right in the preview panel. Click Select in
the bottom right of the window to continue.
A new authoring window will appear with the
background graphic in the center of the
canvas. Above the graphic there is a question
field. On the left there is an Associable Hotspot
Panel for inserting selected shapes that will
represent Associable Hotspots into the
background graphic (these include four
different shapes: rectangle, circle, ellipse, and
polygon). Below the Hotspot Panel there is a
trash can icon, which allows you to delete a
poorly-placed or misshapen Hotspot.
3. Fill in the question field, where it says 'define
prompt'.

116
This should cover such important information
as what the background graphic represents,
and what the test-taker is supposed to do in
this interaction.
Note: The A icon on the right allows you to bold or
italize text, and to insert a picture, shared
stimulus, math expression or link into your
question.
4. Insert the Associable Hotspots onto the
background graphic.
To insert a rectangle, click on one corner and
drag it across the intended area the Hotspot is
supposed to cover. To insert a circle or ellipse,
select its center and drag outward or inward
until the Hotspot is the right size. To insert a
polygon, begin at one corner, then click on each
corner in succession until the Hotspot is
complete. You can make all the shapes bigger
or smaller (or in the case of polygons change
the shape), but if necessary, click on the
problem Hotspot, then click the trash can to
delete it, and then try again.

Optional Extras when


Creating a Task

117
The following options are available in the
Interaction Properties panel on the right.

Specifying correct number of answers


You can specify the minimum and maximum
number of Hotspot choices that the test-taker
will be asked to provide (before he can
continue to the next question) in the Allowed
Choices boxes. By default, these are empty,
which means the test-taker can include as
many (or as few) of the answer options as he
likes. (Setting the minimum to 0 allows the
test-taker to skip the question.)
5. Click Response on the right of the blue
interaction header to set the Hotspots in the
order required by the question.
This will bring up the same screen, but you can
now numerically categorize the selected
Hotspots. To do this, click on the number, then
the Hotspot. Repeat until all numbers are
assigned to Hotspots.

Optional Extras when


Processing a Response
The following option is available in the
Response Properties panel on the right.

118
Inserting modal feedback
If you wish, you can insert Modal Feedback into
this Interaction. For more details on how to do
this, see the Modal Feedback section.
6. Click the blue Done button. Your Graphic
Order Interaction is now complete.
You can now preview your Interaction using the
steps given in the Preview instructions.

119
Graphic Associate
Interaction
The Graphic Associate Interaction gives Test-
Takers the opportunity to demonstrate their
knowledge by depicting routes on a map or
graphic in a prescribed way. This can be used
for drawing out historical military marches,
route-planning exercises, connecting the dots to
form a missing piece of an image, etc.
This interaction is one of a series of Graphic
interactions (the others are covered in their own
sections). All graphic interactions can be found
in the Graphic Interactions menu in the Library.

Once you have generated a new Item, and


clicked on Authoring in the Action Bar, follow
the steps below to create a new Graphic
Associate Interaction:
1. From the Graphic Interactions library near

120
the bottom of the Interactions library on the left,
drag the Associate icon onto the blank Item and
drop it onto the canvas.
2. Choose the desired background graphic.
A Resource Manager window will appear with
which you can select a background graphic.
You can re-use a background already in the
resource manager, or you can upload a new
one. To select one from the list of previously
uploaded graphics, highlight the appropriate
background graphic in the resource manager
list and click the green Select button. To upload
a new one, click on the blue Add file(s) button to
browse the files on your computer, and then
upload one to the resource manager by clicking
the green Upload button.
Highlight the file you have chosen as your
background by clicking on it, and it will appear
on the right in the preview panel. Click Select in
the bottom right of the window to continue.
A new authoring window will appear with the
background graphic in the center of the
canvas. Above the graphic there is a question
field. On the left there is an Associable Hotspot
Panel for inserting selected shapes that will

121
represent Associable Hotspots into the
background graphic (these include four
different shapes: rectangle, circle, ellipse, and
polygon). Below the Hotspot Panel there is a
trash can icon, which allows you to delete a
poorly-placed or misshapen Hotspot. Below the
background graphic is a gap match field for
entering the answers (in the form of graphic
elements).
3. Fill in the question field, where it says 'define
prompt'.
This should cover such important information
as what the background graphic represents,
and what the Test-taker is supposed to do in
this interaction.
Note: The A icon on the right allows you to bold or
italize text, and to insert a picture, shared
stimulus, math expression or link into your
question.
4. Insert the Associable Hotspots onto the
background graphic.
To insert a rectangle, click on one corner and
drag it across the intended area the Hotspot is
supposed to cover. To insert a circle or ellipse,
select its center and drag outward or inward

122
until the Hotspot is the right size. To insert a
polygon, begin at one corner, then click on each
corner in succession until the Hotspot is
complete. You can make all the shapes bigger
or smaller (or in the case of polygons change
the shape), but if necessary, click on the
problem Hotspot, then click the trash can to
delete it, and then try again.
After the Hotspots are inserted, set the number
of Hotspot matches that the test-taker will be
asked to provide (before he can continue to the
next question), giving the minimum and the
maximum. This can be done in the Allowed
number of matches boxes in the Interaction
Properties Panel on the right.

Optional Extras when


Creating a Task
The following options are available in the
Interaction Properties panel on the right.

Limiting the use of a choice


You can limit the number of times a particular
element is used by clicking on it. When it
appears in the Identifier box in the right-hand
panel, set the Allowed number of matches.

123
Specifying the correct number of
associations
You can specify the minimum and maximum
number of associations that the test-taker will
be asked to provide (before he can continue to
the next question) in the Number of
Associations boxes in the Interaction Properties
Panel. By default, these are empty, which
means the test-taker can include as many (or
as few) associations as he likes. (Setting the
minimum to 0 allows the test-taker to skip the
question.)
5. Click Response on the right of the blue
interaction header to select the associations
between Hotspots (the answers).
By default, a test-taker receives one point per
completely correct interaction, so in the case
of Graphic Associate interactions, the test-
taker has to select all the correct Hotspot pairs
in order for the answer to be considered
correct. Select the Hotspot pairs by clicking
first on one Hotspot and then the associated
Hotspot, until the pairs are all correctly
connected by lines.
See Optional Extras below for other scoring

124
methods.

Optional Extras when


Processing a Response
The following options are available in the
Response Properties panel on the right.

Modifying the scoring method


You may want to modify the scoring method if,
for example, you want the test-taker to receive
partial credit for selecting some, but not all, of
the correct Hotspot pairs. Or you may wish to
give a higher weight to some of the Hotspot
pairs than to others.
You can do this using the map response option
of Response processing, in the Response
Properties panel on the right. When you choose
this option, there are several settings you need
to enter.
First, assign a weight for each Hotspot pair. In
the Pair Scoring panel below the background
graphic in your Interaction, select pairs of
Associable Hotspots by clicking on Add new
pairs, and then clicking on the blue Add button.
Then assign a weight according to the value of

125
the answer.
Click here for more details on how to use this
scoring method, and how to set the values of
the other associated properties.

Inserting modal feedback


If you wish, you can insert Modal Feedback into
this Interaction. For more details on how to do
this, see the Modal Feedback section.
6. Click the blue Done button. Your Graphic
Associate Interaction is now complete.
You can now preview your Interaction using the
steps given in the Preview instructions.

126
Graphic Gap
Interaction
The Graphic Gap Interaction gives Test-Takers
the opportunity to demonstrate their knowledge
about geographical regions, identify facts about
portions of images (people in a group photo,
etc.), or show other similar capabilities in
picture matching.
This interaction is one of a series of Graphic
interactions (the others are covered in their own
sections). All graphic interactions can be found
in the Graphic Interactions menu in the Library.

Once you have generated a new Item, and


clicked on Authoring in the Action Bar, follow
the steps below to create a new Graphic Gap
Interaction:
1. From the Graphic Interactions library near
the bottom of the Interactions library on the left,

127
drag the Gap Match icon onto the blank Item
and drop it onto the canvas.
2. Choose the desired background graphic.
A Resource Manager window will appear with
which you can select a background graphic.
You can re-use a background already in the
resource manager, or you can upload a new
one. To select one from the list of previously
uploaded graphics, highlight the appropriate
background graphic in the resource manager
list and click the green Select button. To upload
a new one, click on the blue Add file(s) button to
browse the files on your computer, and then
upload one to the resource manager by clicking
the green Upload button.
Highlight the file you have chosen as your
background by clicking on it, and it will appear
on the right in the preview panel. Click Select in
the bottom right of the window to continue.
A new authoring window will appear with the
background graphic in the center of the
canvas. Above the graphic there is a question
field. On the left there is an Associable Hotspot
Panel for inserting selected shapes that will
represent Associable Hotspots into the

128
background graphic (these include four
different shapes: rectangle, circle, ellipse, and
polygon). Below the Hotspot Panel there is a
trash can icon, which allows you to delete a
poorly-placed or misshapen Hotspot. Below the
graphic is a gap match field where the answers
should be entered (in the form of graphic
elements).
3. Fill in the question field, where it says 'define
prompt'.
This should cover such important information
as what the graphic represents, and what the
test-taker is supposed to do in this interaction.
Note: The A icon on the right allows you to bold or
italize text, and to insert a picture, shared
stimulus, math expression or link into your
question.
4. Insert the Associable Hotspots onto the
graphic.
To insert a rectangle, click on one corner and
drag it across the intended area the Hotspot is
supposed to cover. To insert a circle or ellipse,
select its center and drag outward or inward
until the Hotspot is the right size. To insert a
polygon, begin at one corner, then click on each

129
corner in succession until the Hotspot is
complete. You can make all the shapes bigger
or smaller (or in the case of polygons change
the shape), but if necessary, click on the
problem Hotspot, then click the trash can to
delete it, and then try again.
After inserting the Hotspots, enter the answer
graphics will in the gap match field below the
background graphic.
5. Click the plus sign (+) within the gap match
field as many times as is needed to create the
correct number of gap match slots.
Clicking the plus sign will bring up the resource
manager window. As during placement of the
background graphic, the immediate choices will
include all recently uploaded images. Simply
select one graphic for each slot, or upload the
necessary graphics.
Before uploading, resize the graphics: all
graphics should be roughly the same size -
ideally, a width that is one-sixth the width of
the background graphic. If the selected
graphics are not this size, they should be
resized before uploading.
Once all the images are the correct size, click

130
on the blue Add file(s) button at the top of the
list of available graphics to locate and upload
all the desired image files by clicking the green
Upload button below the list.
After uploading the images, select the first
answer graphic for the first slot, and repeat for
all subsequent slots.

Optional Extras when


Creating a Task
The following options are available in the
Interaction Properties panel on the right.

Limiting the use of a choice


If you want to limit the number of times a
particular answer graphic is used, click on it. It
will then appear in the Identifier box in the right-
hand panel, which gives you the option to set
the Max number of matches.
6. Click Response on the right of blue
interaction header to define the correct
answer(s).
You can now select the correct associations
between the answer graphics and the Hotspots
on the graphic. To do this, drag and drop each

131
answer graphic onto its corresponding
Hotspot.

Optional Extras when


Processing a Response
The following options are available in the
Response Properties panel on the right.

Modifying the scoring method


By default, a test-taker receives one point per
completely correct interaction, so in the case
of Graphic Gap interactions, the test-taker has
to select all the correct matches in order for
the answer to be considered correct.
You may want to modify the scoring method if,
for example, you want the test-taker to receive
partial credit for selecting some, but not all, of
the correct matches. Or you may wish to give a
higher weight to some of the matches than to
others.
You can do this using the map response option
of Response processing, in the Response
Properties panel on the right. When you choose
this option, there are several settings you need
to enter.

132
First, assign a weight for each correct match in
the Pair Scoring box below the graphic in the
boxes next to each match.
Click here for more details on how to use this
scoring method, and how to set the values of
the other associated properties.

Inserting modal feedback


If you wish, you can insert Modal Feedback into
this Interaction. For more details on how to do
this, see the Modal Feedback section.
6. Click the blue Done button. Your Graphic Gap
Interaction is now complete.
You can now preview your Interaction using the
steps given in the Preview instructions.

133
Select Point
Interaction
The Select Point Interaction gives Test-Takers
the opportunity to demonstrate their knowledge
by selecting an invisibly-defined portion of an
image (region on a map, person in a line-up,
etc.).
This interaction is one of a series of Graphic
interactions (the others are covered in their own
sections). All graphic interactions can be found
in the Graphic Interactions menu in the Library.

Once you have generated a new Item, and


clicked on Authoring in the Action Bar, follow
the steps below to create a new Select Point
Interaction:
1. From the Graphic Interactions library near
the bottom of the Interactions library on the left,
drag the Select Point icon onto the blank Item

134
and drop it onto the canvas.
2. Choose the desired background graphic.
A Resource Manager window will appear with
which you can select a background graphic.
You can re-use a background already in the
resource manager, or you can upload a new
one. To select one from the list of previously
uploaded graphics, highlight the appropriate
background graphic in the resource manager
list and click the green Select button. To upload
a new one, click on the blue Add file(s) button to
browse the files on your computer, and then
upload one to the resource manager by clicking
the green Upload button.
Highlight the file you have chosen as your
background by clicking on it, and it will appear
on the right in the preview panel. Click Select in
the bottom right of the window to continue.
A new authoring window will appear with the
background graphic in the center of the
canvas. Above the graphic there is a question
field.
3. Fill in the question field, where it says 'define
prompt'.

135
This should cover such important information
as what the background graphic represents,
and what the test-taker is expected to select in
this interaction.
Note: The A icon on the right allows you to bold or
italize text, and to insert a picture, shared
stimulus, math expression or link into your
question.

Optional Extras when


Creating a Task
The following option is available in the
Interaction Properties panel on the right.

Specifying correct number of answers


You can specify the number minimum and
maximum of points that the test-taker will be
asked to select (before he can continue to the
next question) in the Allowed Choices boxes. By
default, these are empty, which means the test-
taker can include as many (or as few) of the
answer options as he likes. (Setting the
minimum to 0 allows the Test-taker to skip the
question.)
4. Click Response on the right of blue
interaction header to define the correct

136
answer(s).
This opens the graphic with an Associable
Hotspot Panel on the left, used for inserting
selected shapes that will represent Associable
Hotspots into the graphic (these include four
different shapes: rectangle, circle, ellipse, and
polygon). Below the Hotspot Panel is a trash
can icon, which allows the user to delete
poorly-placed or misshapen Hotspots.
To insert a rectangle, click on one corner and
drag it across the intended area the Hotspot is
supposed to cover. To insert a circle or ellipse,
select its center and drag outward or inward
until the Hotspot is the right size. To insert a
polygon, begin at one corner, then click on each
corner in succession until the Hotspot is
complete. You can make all the shapes bigger
or smaller (or in the case of polygons change
the shape), but if necessary, click on the
problem Hotspot, click the trash can to delete
it, and then try again.
5. Insert the Associable Hotspots onto the
background graphic.
Test-takers will not see these Hotspots on the
background graphic, but selecting a point

137
within the Hotspot will register it as a correct
answer.
6. Set the weights to be awarded for each
Hotspot.
In the scoring method normally used as a
default, a Test-taker receives one point per
completely correct interaction (so the test-
taker has to select all the correct responses in
order for the answer to be considered correct).
In this type of interaction, however, each
Hotspot is evaluated individually, and thus Map
Response is used as the Response
processing{#response-processing] method (see
Response Properties panel on the right).
By clicking on each Hotspot, a pop-up window
appears next to it, which allows you to set the
weight to be awarded if the test-taker selects it
correctly.
Click here for more details on how to use this
scoring method, and how to set the values of
the other associated properties.

Optional Extras for Processing


the Response
138
The following options are available in the
Response Properties panel on the right.

Inserting modal feedback


If you wish, you can insert Modal Feedback into
this Interaction. For more information on how
to do this, see the Modal Feedback section.

Limiting the duration of the test


Click anywhere outside of the Text Space. This
will give you the option of setting the
Interaction as Time dependent (to be completed
within a certain interval), by checking the check
box. This option is covered in greater detail in
Test Settings.
7. Click the blue Done button. Your Select Point
Interaction is now complete.
You can now preview your Interaction using the
steps given in the Preview instructions.

139
What is a Test?
"A test is a group of Items with an associated set
of rules that determine which of the items the
candidate sees, in what order, and in what way
the candidate interacts with them. The rules
describe the valid paths (order of questions)
through the test, when responses are submitted
for response processing (grading), and when (if at
all) feedback is to be given." - Question and Test
Interoperability standard, published by IMS
Global

Term Test

Tests, or assessments, define the continuity


between Items, how they are ordered, and how
they are presented to the Test-taker. They also

140
define the constraints and settings, including
those related to time and navigation policies.
Tests may be built from building blocks called
Item Sections that logically sort Items into
groups, making configuring a Test easier.
In TAO, assessments are assembled from
individual Items that are later delivered to Test-
takers through an automated delivery system.
If there are enough Items within a Test, they
can be sorted and grouped into Item Sections
according to any logical set of criteria.
Tests should be named with an appropriate
title that helps Test-takers accurately identify
the assessment if it appears in a list of other
assessments that the Test-taker must also
take at the same time.
Test designers must consider issues such as
whether the Test-taker will need to follow a
linear path (a specific question order with no
option to revisit questions later) or if they can
instead use a non-linear route (where questions
can be answered in any order and revisited if
desired). Time limitations and feedback are
also important elements in successful Test
design.

141
Creating a New Test
TAO defines a Test as a collection of Items
designed to assess the academic progress of a
Test-taker. This approach allows for the rapid
assembly of Tests administered across
computer networks. If all you have is 30 minutes
to create a 10-question quiz for your 8th grade
class, TAO can help.
Now, let's walk through the steps of creating a
Test.
1. Click on the Tests icon in the Assessment
Builder Bar.
This will take you to the Tests page, and will
show the last Test which you, or the user
before you, created. On the left-hand side of
your screen you will see the Test Library of
existing tests. The last test which was created
will be highlighted in the Library. In this tour,
however, you will create a new Test.
2. Click on the New test icon in the button bank
under the library.
This will create a new test in the highlighted
folder.

142
Note: To create a new test in a different folder,
select the desired folder in the Library, and then
click on the New test icon in the button bank. To
create a new folder (in TAO these represent new
classes), click on New class in the button bank,
and then give it a label. Highlight where to put the
new folder relating to the new class.
3. Label and save your Test.
Once you have created a new test, this will
bring up a new dialog box which gives you the
option of naming, or labeling your Test.
After labeling your Test, click on Save. This
produces an empty test, which you can now
populate with items.
Note: It is always a good idea to save Test
assembly work every ten minutes or so, to prevent
losing your completed work.
4. Click Authoring in the Action Bar to insert
Items into your Test.
This will take you to the empty Test you have
created. You can now start populate the
canvas area in the middle (the Test assembly)
with items.

143
The Library on the left contains available Items
which can be used in your Test.
Tests can be divided into a hierarchy of two
levels: Test parts, and sections. A Test part is the
first tier division of a Test, while a section is the
second tier division. Test divisions, however,
are optional, and they are added in reverse
order. For instance, if a test has no divisions,
all items will simply be added to Part 1 Section
1. If only one level of division will be needed,
adding sections will allow a test to be divided
into two. If both levels are required, you need to
add new test parts. To add new sections, click
on the blue New section button below the
existing sections in the test. To add new test
parts, click on the blue New test part button
below the existing test parts.
At the start of any section, a Rubric Block, or
explanatory text, can be entered prior to the
insertion of items. To do this, click on the icon
with the letter "A" on it, and then click on the
blue New Rubric Block button that appears. Add
your text in the space provided.
Adding new Items is similar. In the Test Library,
select the Item you wish to add, and then click
on the blue button that reads Add selected

144
item(s) here.
Note: It is easiest to add Items in the order in
which they are to appear in the delivered test. If
an Item is added out of order, however, this can be
corrected by clicking the upward or downward
arrow buttons which appear after the properties
icon on the right of the Item. Delete unwanted
Items by clicking on the trash can icon.
See the Test Settings section for information
on adjusting assessment settings such as the
time/attempts to be allowed.

Optional Extras
Duplicating an already existing Test
You can duplicate an already existing test by
clicking on the Duplicate icon in the button bank
under the library. A copy will then be created in
the folder of the test you have duplicated, with
the same name but with "bis" on the end.

Finding an already existing Test


You can use the Search Test button on the right
of the Action Bar to look for already existing
tests. A list of tests with that name will appear.
Click on Open if you want to open one of them.

145
Granting user access
As an administrator, you can permit a user
certain access rights to specific folders
(classes), items or tests. To do this, select a
folder and then click on the Access Control icon
in the button bank under the library.
This will bring up a window with the following:
A search bar for users, with a list of users
with granted access
A search bar for roles, with a list of roles
with granted access
You can define the rights of every user or role
by checking the relevant boxes below:
Read - allows the user to view the
folder/item/test
Write - allows the user to edit the
folder/item/test, or to create new ones in
that folder
Grant - allows both of the above
Clicking the brown button Remove will delete a
user or role from the list.
Note: Unchecking all the boxes for a specific
user/role will also remove them from the list.
When you have checked the correct boxes,

146
click the blue Save button to save your
changes.

Viewing the history of a Test


In TAO, it is possible to maintain different
versions of the same test, and this is done
using the History icon.
When you wish to save an edited Test as a new
version (instead of overwriting the original),
click History in the Action Bar. Before saving
the new version, you need to enter a comment
(such as "modified after spring 2016 field
test"), in order to distinguish it from other
versions. Then click Commit.
You will then be presented with the history of
that Test: the version ID, the date it was saved,
the user who authored it, and the comment.
Note: If later changes are made to the Test, you
can click Restore to revert to the previous version.
A new version of the file is then created, and given
the default name "restored version 1" (whatever
the corresponding number may be). The name can
be changed.

147
Importing a Test
Prepared Tests can be taken from any computer
and imported onto any other computer that also
has access to TAO. This is done using an
operation called Import.
1. Click on Tests on the Assessment Builder Bar.
This will take you to the Test Library, which you
will see on the left.
2. Click on the Test class (folder) in the Library
in which you wish to import the new test.
3. Click on Import in the button bank below the
Library.
This opens a dialog box which asks you to
select the format of the Test to be imported.
The supported input formats are: QTI (Question
and Test Interoperability), RDF (Resource
Description Framework) or CSV (Character-
Separated Values).
4. Click the blue Browse button to find the file
intended for import (alternatively, the file may
be dragged and dropped into the box below the
button).

148
5. Once the Test is selected, click on the blue
Import button.
This will import the Test into the Test library,
for later use in Deliveries.

149
Exporting Tests
Tests may be assembled on almost any
computer that has access to TAO. However, the
capability to share Tests will be useful in certain
situations. For instance, a department may have
standard performance expectations for its most
basic courses, and these may be determined by
a single Test distributed to all the teachers of
the department. Tests can be shared in a few
easy steps.
1. Click on the Tests icon in the Assessment
Builder Bar.
2. Select the class (Test folder) you want to
export in the Test Library on the left-hand side,
OR click on New class in the button bank below
the Library. This will create a new folder for the
tests you would like to export.
Creating a new class (i.e. a new folder) allows
you to place tests in a distinct location in order
to be transferred from one computer to
another. When doing this, the test class can be
renamed in the Edit test class dialog box in the
field marked Label. Clicking the blue Save
button will create the class.

150
Note: Individual Tests can be exported without
creating a new class to transfer to. It may be
helpful, however, to organize the entire export
from a single folder.
3. If you have created a new class for this
purpose, move the tests you want to transfer to
this new class in the Test Library.
This selects the Tests which are to be
exported.
4. After clicking on the class, click Export in the
button bank below the Library.
The dialog box will ask you to choose an export
format: either QTI or RDF. If the Test is to be
exported as a Question and Test
Interoperability (.qti) formatted document, it
will save the files as a compressed .zip file.
Otherwise, the export will be in Resource
Description Framework (.rdf) format.
5. Click the blue Export button in the dialog box
to continue with the export.
6. Select the location to which you want to
export your Test, and then click Save.
The Test can then be transferred either to a

151
data storage device or a computer network.
The next step in the transfer is to import the
test onto the desired computer.

152
Test Settings
After creating a new Test, it will be necessary in
most cases to set various properties for the
assessment and its individual parts. There are
four levels in which properties may be assigned:
the Test level, the Test part level, the Section
level, and the Item level. These properties will
appear in the Properties panel on the right when
you click on the appropriate properties icon
(depicted as three interacting gears).
The Test level properties icon can be found in
the Test bar at the top of the canvas. Test part
level properties icons can be found in each grey
Test part bar, while section level properties
icons will be found on the same line as the
section label. Item level properties icons will be
found next to the item's label.
1. Click on the Test level properties icon.
This brings up two panels on the right: one
governing Identifier and Title, and the other
governing Time Limits. The Identifier box
should, in general, be left as it is, though it is
editable. However, the Test Title can be
renamed to make it easier for the Test-Taker to
identify.

153
You can set a time limit for Tests at either the
Item level, or the Test level. To limit the amount
of time that the test-taker has to complete the
Test, open the Time Limits panel, and enter the
maximum duration (in hours, minutes, and
seconds). If late submissions are to be
accepted, check the Late submission allowed
box. If the duration is to be strictly enforced
(i.e. no late submissions are allowed), leave
this unchecked.
2. Click on the Test part level properties icon.
This brings up three panels on the right: a
general properties panel, an Item Session
Control panel, and a Time Limits panel. In the
general properties panel, the Identifier box
should be renamed as appropriate. The
Navigation box, or how the test-taker is allowed
to answer questions, should be selected as
either linear (first question first, second
question second, etc.) or non-linear (can be
answered in any order). Lastly, the Submission
mode needs to be selected as either individual
(submitted response by response) or
simultaneous (submitted on completion of the
test part).
In the Item Session Control panel, set these

154
four properties: Max Attempts is the number of
attempts the test-taker may have (the default
setting 0 permits an unlimited number of
attempts). Check the Show Feedback box if the
test-taker should see the modal feedback after
completing the Test Part. Check the Allow
Comment box if the test-taker may provide
explanations for responses, or leave feedback
for the test. Check the Allow Skipping box to
allow the test-taker to pass on answering
questions within the test part.
The time limits section is similar in nature to
the time limits section for the test level
properties, except that the answers apply to
the test part.
3. Click on the Section level properties icon.
This brings up five panels on the right: general
properties, Selection properties, Ordering, Item
Session Control, and Time Limits. The last two
panels are the same as the last two in the test
part properties, while the first three panels
differ from previous levels. The general
properties include an identifier and title: the
default name in the Identifier box should
generally be maintained, while the Title can be
changed to suit the Test. In general, the Visible

155
box should be checked (or else the test-taker is
unable to see the section), and the Keep
Together box should also be checked if it is
important that the entire section be completed
before moving onto the next section. Categories
act as tag references, which may be displayed
to the Test-taker.
The Selection panel asks if the delivered test
section should include only some of the Items
assigned it (Enable selection), and if so, how
many (Select). If With Replacement is checked
while the selection mode is enabled, then
questions may be repeated. Normally, they are
only allowed to be used once in a Test sitting.
Ordering contains only one property setting,
which is Shuffle. This setting randomizes the
question order.
4. Click on the Item level properties icon.
This brings up three panels: general properties,
Item Session Control, and Time Limits. The last
two panels are the same as the last two in both
the test part and section level properties. The
general properties include entries for: Identifier,
Reference, and Categories. It also includes
check boxes to indicate the item is Required

156
and if it is Fixed.
The Identifier and References boxes generally do
not require modification. Categories act as tag
references which may be displayed to the test-
taker. If the Required box is checked, the Item
will appear on the Test, even if less than the
total number of Items appears on a given Test
(in a section where selection is enabled). If the
Fixed box is checked, the Item will appear in a
particular order, even if the section ordering
calls for shuffling.

157
Creating a Test-Taker
Test-Takers are individuals who will take
assessments assembled by TAO. These are
typically registered students in a given class,
but Test-Takers can be placeholder profiles for
an instructor or test administrator to trial a Test.
Now, let's walk through the steps of creating a
Test-Taker.
1. Click on the Test-Takers icon in the
Assessment Builder Bar.
This will take you to the Test-Takers page, and
will show the last Test-Taker profile which you,
or the user before you, created. On the left-
hand side of your screen you will see the Test-
taker Library of existing test-takers. The last
test-taker which was created will be highlighted
in the Library. In this tour, however, you will
create a new Test-Taker.
2. Click on the New test-taker icon in the button
bank under the library to create a new Test-
Taker profile.
This brings up a dialog box entitled Edit Test-
taker. Enter the personal details of the new

158
Test-Taker, give them a login (which must be
unique) and a password, and select an Interface
language from the pull-down menu.
Enter a profile name for the Test-Taker in the
Label field. This can be any form of useful
identifier (it can, but does not have to be, the
Test-Taker's name). An address may be entered
in the Mail field, for communication with the
Test-Taker.
When you have filled these fields, click the blue
Save button.
Note: To create a new test-taker profile in a
different folder, select the desired folder in the
Library, and then click on the New Test-Taker icon
in the button bank. To create a new folder (in TAO
these represent new classes), click on New class
in the button bank, and then give it a label.
Highlight where to put the new folder relating to
the new class.
3. Place the Test-Taker in a Group
This can also be done from within the Groups
section, but for convenience, it is possible to
select an existing group in the Add to group
pane on the right, and associate the Test-Taker
with that group by checking the box next to the

159
desired group. Click the blue Save button at the
bottom of the pane to complete the procedure.

160
Importing Test-Takers
Test-Taker metadata files can be taken from any
computer and imported onto any other computer
which also has access to TAO. This is done
using an operation called Import.
1. Click on Test-takers on the Assessment
Builder Bar.
This will take you to the Test-taker Library,
which you will see on the left.
2. Click on the Test-Taker class (folder) in the
Library in which you wish to import the new
Test-Taker profile.
3. Click on Import in the button bank below the
Library.
This opens a dialog box which asks you to
select the format of the incoming Test-Taker
metadata. The supported formats are RDF
(Resource Description Framework) or CSV
(Character-Separated Values).
4. Click the blue Browse button to find the file
intended for import (alternatively, the file may
be dragged and dropped into the box below the
button).

161
5. Once the file is selected, click on the blue
Import button.
This will import the Test-Taker's profile into the
Test-Taker library, after which he can receive
Tests.

162
Exporting Test-Takers
Test-taker profiles may be assembled on almost
any computer that has access to TAO. However,
there may be situations in which sharing Test-
Taker profiles is useful. For instance, a Test-
Taker who has successfully passed a
prerequisite course may now enroll in a more
advanced study with a different teacher. Test-
Taker profiles can be shared in a few easy
steps.
1. Click on the Test-taker icon in the
Assessment Builder Bar.
2. Click on either the Test-Taker folder (class)
you want to export in the Test-taker Library on
the left-hand side, OR click on New class in the
button bank below the Library to create a new
folder for the test-takers you would like to
export.
Creating a new class (i.e. a new folder) allows
you to place Test-Takers in a distinct location
in order to be transferred from one computer to
another (for organized groups of students,
review how to export groups). When doing this,
the Test-Taker class can be renamed in the Edit
class test-taker dialog box in the field marked

163
Label. Clicking the blue Save button will create
the class.
Note: An individual Test-Taker can be exported
without creating a new class to transfer it to. It
may be helpful, however, to organize the entire
export from a single folder.
3. If you have created a new class for this
purpose, move the test-takers which you want
to transfer to this new class in the Test-Taker
Library.
This selects the Test-Takers which are to be
exported.
4. Select the class, then click Export in the
button bank below the Library.
The folder or Test-Taker metadata file which is
to be exported should be formatted as a
Resource Description Framework (RDF) file.
5. Click the blue Export button in the dialog box
to continue with the export.
6. Select the location to which you want to
export your Test-taker file, and then click Save.
The Test-Taker metadata can then be
transferred either to a data storage device or a

164
computer network. The next step in the
transfer is to import the Test-takers onto the
desired computer.

165
Creating a New
Group
Groups are organized collections of Test-Takers
who take the same assessments throughout the
duration of a course of study. Examples of a
group include Laboratory Sections, Discussion
Groups, or any cohort or subdivision of students
assessed using the same examinations, test
administrators, and grading criteria as others
within their group. Since a group is made up of
individual Test-Takers, it is necessary to enter
the meta-data for each Test-Taker prior to
assigning Test-takers to Groups.
Now, let's walk through the steps of creating a
Group.
1. Click on the Groups icon in the Assessment
Builder Bar.
This will take you to the Groups page, and will
show the last Group which you, or the user
before you, created. On the left-hand side of
your screen you will see the Group Library of
existing groups. The last group which was
created will be highlighted in the Library. In this

166
tour, however, you will create a new Group.
2. Click on the New Group icon in the button
bank under the library to create a new group.
This brings up dialog box entitled Edit group for
the newly created Group. If desired, rename the
Group through the Label field, and then click
the blue Save button.
Note: To create a new group in a different folder,
select the desired folder in the Library, and then
click on the New Group icon in the button bank.
To create a new folder (in TAO these represent
new classes), click on New class in the button
bank, and then give it a label. Highlight where to
put the new folder relating to the new class. (Do
not confuse Class with Group - 'Class' in this
instance means a folder, while a 'Group' means a
class, section, or any other cohort of students).
3. Populate the Group
To the right of the Edit group pane are two other
panes: the Select group test takers pane on the
left, and the Deliveries pane on the right. To
select test-takers for your Group, check the
boxes by the relevant names in the left pane,
and then click the blue Save button for that
pane. If a delivery has already been assembled

167
for this Group, it will appear in list of deliveries
in the right pane. It should be selected before
clicking the blue Save button for that pane.

168
Importing Groups
Group metadata files can be taken from any
computer and imported onto any other computer
that also has access to TAO. This is done using
an operation called Import.
1. Click on Groups on the Assessment Builder
Bar.
This will take you to the Group Library, which
you will see on the left.
2. Click on the Group class (folder) in the
Library in which you wish to import the new
group.
3. Click on Import in the button bank below the
Library.
This opens a dialog box which asks you to
select the format of the incoming Group
metadata. The supported formats are RDF
(Resource Description Framework) or CSV
(Character-Separated Values).
4. Click the blue Browse button to find the file
intended for import (alternatively, the file may
be dragged and dropped into the box below the
button).

169
5. Once the file is selected, click on the blue
Import button.
This will import the Test-taker Group into the
Group library, after which its members can
receive Tests.

170
Exporting Groups
Formal groups of Test-Takers, such as
laboratory or lecture groups, may be assembled
on almost any computer that has access to
TAO. However, there will be situations in which
sharing the metadata of formal Test-taker
Groups will be useful. For instance, an instructor
may need to transfer metadata for an entire
class to a substitute or replacement teacher
during an absence. Test-taker Groups can be
shared in a few easy steps.
1. Click on the Groups icon in the Assessment
Builder Bar.
2. Click on either the Group folder (class) you
want to export in the Group Library on the left-
hand side, OR click on New class in the button
bank below the Library to create a new folder
for the test-taker Group you would like to
export.
Creating a new class (i.e. a new folder) allows
you to place Groups in a distinct location in
order to be transferred from one computer to
another. When doing this, the Group class can
be renamed in the Edit class group dialog box in
the field marked Label. Clicking the blue Save

171
button will create the class.
Note: An individual Group can be exported without
creating a new class to transfer it to. It may be
helpful, however, to organize the entire export
from a single folder.
3. If you have created a new class for this
purpose, move the group which you want to
transfer to this new class in the Group Library.
This selects the Group which is to be exported.
4. After clicking on the class, click Export in the
button bank below the Library.
In the dialog box, confirm that the folder or
Group metadata file highlighted is the one that
should be exported as a Resource Description
Framework (RDF) file.
5. Click the blue Export button in the dialog box
to continue with the export.
6. Select the location to which you want to
export your Group file, and then click Save.
The Group metadata can then be transferred
either to a data storage device or a computer
network. The next step in the transfer is to
import the Group file onto the desired

172
computer.

173
What is a Delivery?
"A delivery is the process that coordinates the
rendering and delivery of tests and the evaluation
of responses to interactions to produce scores
and feedback." - Based on the Question and
Test Interoperability standard, published by
IMS Global

Term Delivery

A delivery is the assembly of all information


required to assign and send out Tests to
selected Test-Takers. This includes such
information as the exact Test to be delivered,
the exact group of Test-Takers to receive the
Test, and the circumstances (in particular the
time frame) in which the Test may be taken.

174
Deliveries effectively define the life cycle of an
item session (i.e. the time between Test-takers
starting an item and finishing it). This cycle
begins when the Test-taker becomes eligible
for a Test Delivery, a condition that is set
during the actual authoring of the Delivery. In
simple terms, the cycle continues through the
Test-taker's completing of the Tests selected,
and ends when Test Results for all interactions
are determined. In some instances, more than
one attempt to interact may be allowed, and the
Delivery life cycle continues until no remaining
attempts are permitted. The cycle finishes
when the results are recorded; these may or
may not be displayed to the Test-Taker, but
they are made available to at least the test
administrator after the life cycle is complete.

175
Create a New Delivery
Assembled deliveries provide the means of
publishing and administering tests. These
govern when a Test is taken by selected
individual or groups of Test-takers and how long
Tests will be. A delivery can only be assembled
after the creation of interactions, the assembly
of the Test, the creation of Test-taker profiles,
and the gathering of Test-takers into formal
Groups.
Now, let's walk through the steps of creating a
Delivery.
1. Click on the Deliveries icon in the
Assessment Builder Bar.
This will take you to the Deliveries page, and
will show the last Delivery which you, or the
user before you, created. On the left-hand side
of your screen you will see the Delivery Library
of existing deliveries. The last delivery which
was created will be highlighted in the Library. In
this tour, however, you will create a new
Delivery.
2. Click on the New delivery icon in the button
bank under the library.

176
This brings up a dialog box entitled Create a
New Delivery, which asks for a Test selection.
From the pull-down menu, select the Test that
is to be sent to Test-takers in this delivery.
Once selected, click Publish.
A properties panel will come up.
Note: To create a new delivery in a different folder,
select the desired folder in the Library, and then
click on the New delivery icon in the button bank.
To create a new folder (in TAO these represent
new classes), click on New class in the button
bank, and then give it a label. Highlight where to
put the new folder relating to the new class.
3. Set the delivery properties.
Label: The default name of the delivery is
'Delivery of Test Name'. This can be changed as
needed.
Maximum number of executions: if left empty,
test-takers may take the delivered test an
unlimited number of times. Setting this number
to any non-zero integer will limit the test-takers
to that number of attempts at the Test.
Start Date and End Date: this establishes the
earliest date and time and latest date and time

177
that the test can be taken. Clicking on either
date field provides a graphical interface which
allows you to set the date and time (using a
calendar, and slider controls for hours and
minutes). However, it is also possible to
provide the date and time by manually typing
them in in the following order: year, month, day,
and 24-hour clock (YYYY-MM-DD HH:MM)
The Result Server allows you to choose where
the results should be stored (the default is RDS
ResultStorage).
The Display Order allows you to specify the
order in which the deliveries are presented.
As a test-taker you are presented with a list of
all the deliveries which are assigned to you.
These are normally unordered unless you set
display order to a numeric value. This numeric
value defines the position of delivery in the
Available list.
Access: If the Guest Access box is checked,
people who are not registered as test-takers
can view the delivery.
4. Assign the test to a group of test-takers in
the panes on the right of the Properties panel.

178
The Assigned to pane contains all available
groups of Test-takers. Select a Group, and click
the blue Save button below. If there are Test-
takers in the Group who, for whatever reason,
should not take this exam (due to absence,
remedial assignments, etc.), click the blue
Excluded Test-takers button at the bottom of
the Test-takers pane.
The Assigned to pane contains all available
groups of test-takers. Select a Group, and click
the blue Save button below. If there are test-
takers in the Group who, for whatever reason,
should not be taking this exam (because of
absence, remedial assignments, etc.), click the
blue Excluded Test-takers button at the bottom
of the test-taker's pane. To move a person from
assigned status to excluded status, simply
click on that person's name in the assigned
column. Click save to close the pop-up window.

179
Exporting Results
Results Tables may be set up on almost any
computer that has access to TAO. However,
there will be situations in which posting Results
on another system will be useful. Transmitting
Results Tables takes only a few easy steps.
1. Click on the Results icon in the Assessment
Builder Bar.
This will show the last results table which you,
or the user before you, opened. On the left-
hand side of your screen you will see the
Library of existing results deliveries.
2. Click on the desired Delivery in the library.
This will bring up the test results (the Results
Table) associated with the given Delivery.
Typically, this should be done only after the
submission deadline has passed, so that all the
Results can be compiled in one table.
Note: You can view the results by clicking on the
blue View button to the right of a particular Test-
Taker.
3. Click on the blue button marked Export Table
on the Action Bar* at the top of the Results

180
Table.
This brings up the names of all the test-takers
who are associated with the Results Table.
Above the names are three buttons which you
can toggle between, depending on the
information you wish to include in the file to be
exported.
Add Names/Anonymise: This controls the
display of names associated with the Results
Table (Anonymise appears here in red, as the
names are added by default; by clicking on
Anonymise the names will be taken out).
Add All Grades/Remove All Grades: This controls
the display of scores associated with the
Results Table (This is blue, so by default the
scores are not included; by clicking on Add All
Grades they will be added).
Add All Responses/Remove All Responses: This
controls the display of responses associated
with the Results Table (This is blue, so by
default the responses are not included; by
clicking on Add All Responses they will be
added).
A filter control sits between these buttons and

181
the table, and can be used to display the
results based on the order in which the
settings above (i.e. the variables relating to
test-takers' names, scores and responses)
were received. For example, you may wish to
display all the variables on your screen, and
then select a subset of the data to be exported
using the filter.
4. Click the Export CSV File button below the
Results Table.
This creates a character separated value file
formatted for Microsoft Excel which can be
translated into score information. Once the
button is clicked, a window comes up to ask
where you would like to save the file.
5. Select the location to which to export your
Results, and then Save.
The Results Table, easily opened in Excel, can
then be transferred either to a data storage
device or a computer network.

182
Metadata
As an institution's collection of Items grows,
most test authors will find it increasingly
unwieldy to locate the right set of interactions
for a given Test. TAO's Metadata offers a way to
easily sort out relevant Items for your Tests,
even if there are hundreds or thousands of Items
from which to choose. Metadata, defined using
Properties, provides certain descriptive flags
that can be filtered through the search box,
located above the Library in the blue Action Bar,
and can be added to any Item.
Properties define the Metadata entered for
your items. Metadata is useful as it can help
identify Items used in a specific course, for a
specific instructor, within a specific Test, etc.
Searches identify these specific Items so that
they can be readily accessed. The importance
of these three elements will be highlighted in
each of the sections that follow.
It is worth noting that although this User Guide
entry covers Metadata that apply to Items,
nearly the same procedures apply also for
applying Metadata to Tests, Test-takers, Groups,
and Deliveries.

183
Inserting or editing Properties
1. Click on an Item class to add or edit
properties.
This brings up to view the class's Properties
window. Properties define the Metadata which
apply to a given Item. The Properties window
for the class you are reviewing allows the TAO
user to modify the label of the class and shows
the Properties that comprise the Metadata set
for all the Items in that class. For items, the
first four Properties listed cannot be edited:
Item Content, Original Filename, Item Model, and
Lock. Other Properties in the list of class
Metadata can be both edited and, if necessary,
deleted.
2. To add a new Property in the class
Properties window, click on the blue Add
Property button below the Property list.
This adds a new Property at the end of the list.
To add functionality, you will need to edit the
Property.
3. To edit a Property in the Properties window
for the class, click on the Edit icon located to
the right. This is the button that looks like a

184
pencil in a square.
When in Simple Mode (default), the Edit icon
brings up a small box in which the Item's
Properties can be edited. The first field allows
the Property Label (name) to be changed from
Property_X. The second field asks if the
Property is language dependent; this indicates
whenever or not the value of this field can be
translated (the default is false). The third field
asks that the Form Field Order be defined; this
is the position in the list that the Property you
are working with will appear. The fourth field
asks the field type being defined here. This
field is important as it defines how the Property
is defined and modified. A drop-down menu
provides five basic choices:
Text (three options: short-field, long-box, and
long-HTML editor)
List (three options: Single choice radio
button, single choice drop down menu, and
multiple choice check box)
Calendar
Password
File
When in Advanced Mode (which can be selected
once the Edit icon has been clicked), the small

185
box is different. The first two fields are the
same (Label and Is Language Dependent), but
the Form Field Order and Type are replaced
with Widget range, which provides a drop-down
menu for selecting a Property Type (many more
options are presented here), and a Resource
Window, through which a Property resource
type can be selected.
Once you've selected the values that apply to
this Property, click on the blue Save button:
This will save and reload the window.
Remember that you can delete the Properties
you add by clicking the trash can icon.
4. To edit a List used with an existing property,
find and click the List button in the button bar
below the Library.
This brings up a window showing all the
available Lists that can be used with the
Properties in your TAO Library. At the top of the
window, the user can click on a button to
create a new list. In this view, you will find all
the lists that might apply to any Item set
created in your TAO set-up. These can be
edited or deleted here.

Selecting Metadata of an
186
Item for use in a Search
1. Select within the Library the Item that
contains Properties you would like to edit.
This will bring up in the canvas a list of the
Properties that can be used to describe the
item and that may be used to filter and find
flagged Items. Flagging, in the sense it is used
here, is the act of setting identifiers into
Property fields within specific Items to help
separate them from all the other Items quickly
and efficiently. These can be set for any
Property already described.
2. Select the Property that you want to use to
filter through your Items, and then enter the
information you will use to flag this given Item
for future use.
Depending on the Type of the Property selected
this can either be an input field, a select box,
radio-buttons or even an upload-button. Once
the data is entered, you will be able to filter this
Item using the Search function.

Using Search to find an Item


1. Once your Metadata is selected, click on the
Search button in the blue Action Bar.

187
This brings up a gray search window above the
Item library, with various options to search for
specific Items. These include the ability to filter
through the Label field (if Items are named for
easy retrieval), Language field, Item Model type,
or any Properties that you defined for Items in
your current Class.
Note: If you are only searching through the Label
field, select Filter to sort through the names of
your Items.
2. Once you've selected the filter criteria for
your search, click on the blue Search button.
This will bring up a list of Items which meet
your filter criteria. In this window, you can
select any Item you wish to open. This could be
to preview, or to author, or simply to identify
where the Item is located for use in building
your Test.

188
User Management
TAO concentrates its User Management
functions all under the Users icon (depicted with
two heads), located on the right side of the
Assessment Builder Bar. User-related functions,
accessible to Global Managers, are organized in
five functional tabs: Manage Users, Add A User,
Edit A User, Manage Roles, and Manage Access
Rights. Managing roles is of such importance
that it will be covered under its own section,
Role Management. But the remainder of the tabs
will be reviewed here.
Manage Users: This tab provides an overview
of all the users registered in your TAO system.
Included are managers, Test-takers, and other
roles assigned to the accounts of individuals
whom you have granted access. From this
page, edits can be carried out and reviewed in
an easily read table.
Add a User: This tab allows the creation of new
User accounts on your TAO system. These can
include any manager or any Test-taker.
Manage Access Rights: This tab provides the
means for changing the access rights of roles
within your TAO system. Access to modules

189
can be changed in this tab, either adding or
removing them from a specific role.
The following are typical mini-procedures that
involve User Management:
Adding a user: Click on the Add a user tab.
Within the panel that appears in the canvas
area, fill in the following fields: Label (full name
or easy-to-remember nickname), Data
Language (language used by administrators),
Interface Language (language used by the
user), Login (must be unique, cannot be
changed once set), Roles (as desired),
Password and Repeat Password (to be given to
the user). Optionally, fill in the First Name, Last
Name, and Mail (E-mail) fields.
Managing users: Click on the Manage Users tab.
Find the profile that you wish to edit. Review
the information available in the table, and then
click the Edit button. Change any of the data
within the resulting panel (note, you won't be
able to change the login - if you need to find a
solution to a login conflict, you will have to
resolve this without editing this field). This is
the procedure used for such actions as
changing passwords, e-mail contact
information, etc. Alternatively, this is also the

190
tab to use to remove profiles, done by clicking
on the appropriate button on the right side of
the canvas.
Customizing or editing access rights for different
roles: Click on the Manage Access Rights tab. In
the resulting menu within the first column in
the canvas area, select the role in which you
wish to adjust. Review the Modules list in the
second column. Check the appropriate boxes
for those modules you want the role to access
(or de-check those boxes you don't want the
role to access any longer).

191
Role Management
TAO interacts with users based on their role
within the educational institution. These have
been divided into three classes of roles:
Management, Worker, and Abstract.
Management Roles: The most important of
these is the Global Manager. This individual
assigns all roles within TAO, with the exception
of a few selected administrative tasks. In
addition, this person assigns all extension-
specific roles. Also important are System
Administrators. This role handles such
administrative tasks as installing new
extensions. Individuals assigned to this role
should have a stronger technical background
as mishandling its duties can render the
platform unstable. It should be noted that the
person who installs TAO is given the privileges
associated with Global Manager and System
Administrator simultaneously. Other
managerial roles include technical roles that
are geared toward optimizing the use of
specific extensions and their associated
functionalities.
Worker Roles: These are basic roles, such as

192
those assigned to the front office. The most
typical of these roles is that of the Test-taker.
This is the role that all students should be
assigned, and which Item or Test authors
should select for their dummy accounts (for
testing the performance of Items and Tests
prior to use). They are given such system
privileges associated with receiving Test
Deliveries, allowing them to take and submit
tests for grading. These are generally assigned
when setting up Test-taker accounts.
Abstract Roles: These are functions that are
either assigned automatically by TAO, such as
anonymous, base user, or generis, or which are
included in other roles, like service, back office,
or front office. These should not be assigned to
users by Global Managers, as they are
generally default values.
Other roles are specific to a particular function
(such as LTI) or customized.
The following steps are applicable to the
assignment of managerial roles required by the
back office.
1. Within the Assessment Builder Bar, hover
over the icon for Users settings (two heads side-

193
by-side). Select, or click, among the options
that appear Manage Roles.
Within the canvas, there will be two panels
sitting side-by-side. The left panel shows a list
of roles appropriate for your system settings.
The right panel shows a list of users that are
entered in your system, including Test-takers.
2. In the left panel, select either a single role, or
a combination of roles intended to be grouped
together. In the latter case, create a label
(name) for this combination that is easy to
remember. Ensure that this single role, or
combination, as desired, is selected.
This chooses the role to be assigned to the
individual(s) who will be selected in the next
step. If creating a combination role, click Save
at the bottom to continue.
3. In the right panel, select users who will be
assigned to this selected role. When all the
desired users are selected, click Save.
This completes the task of assigning roles
using TAO's Role Management.

A list of the some of the roles that might be

194
encountered in the Role Manager:
Generis
Anonymous
Back Office
Front Office
Service
Base User
Item Authors Type 2
Item Authors Type 1
Global Manager
TAO Manager
Function ACL Manager
Items Manager
QTI Manager
QTI PCI Manager
Open Web Items Manager
Tests Manager
taoQtiTest Manager
Workflows Manager
Test Takers Manager
Groups Manager
Result Server Manager
taoOutcomeRds Manager
taoWfTest Manager
Delivery Manager
QTI PIC Manager
taoOutcomeUi Manager

195
taoSimpleDelivery Manager
taoCe Manager
System Administrator
taoDacSimple Manager
taoTestLinear Manager
taoDeliveryTemplate Manager
taoLti Manager
ltiDeliveryProvider Manager
ltiTestConsumer Manager
Test Taker
LTI Base Role
LTI Learner
LTI Instructor
LTI Institution Student
LTI Administrator
LTI Learner
LTI Instructor
LTI Administrator

196
Add an Extension
Extensions add functionality to TAO, providing
various TAO customizations. For the purpose
of interfacing with existing test-taking or test-
scoring software, or enhancing test elements
as required by an institution, extensions
improve upon the basic TAO program.
1. Find the Extensions manager by hovering over
the Settings icon. Click to open.
The Extensions manager will be nested among
other Settings options (File Sources, Result
Server Manager, and LTI Consumers). When it
is open, the screen will show a Settings canvas
with the Extensions manager as the active tab in
the row of tabs above that canvas. If another
settings screen shows instead, click on the tab
that reads Extensions Manager to get to that
particular canvas.
2. Review the Installed Extensions list and the
Available Extensions list.
Installed Extensions are those extensions which
are active and ready for your use. Available
Extensions are extensions on your server which
are currently inactive.

197
3. If an Available Extension is desired, click on
the check box at the end of that extension's
line. When all such extensions are selected,
click Install.
A confirmation message follows. Once
confirmed, this action loads up the extensions
selected. Once installed, the page will need to
reload, but then the new extension will be ready
for use.
Although each extension adds functionality,
they can affect the speed of processing. It is
therefore advantageous to add only those
extensions that you really will need to do your
tasks on TAO. Also, it should be noted that
there isn't an easy way to remove an extension,
once installed, so extension installation should
be planned with appropriate caution.

198
Setting up a TAO-
Moodle delivery as an
LTI Administrator
Through the Learning Tool Interaction (LTI)
standard set forth by IMS Global Learning
Consortium, Moodle users can make use of TAO-
designed tests and deliver them to students
through the Moodle platform. Setting up the
interface between TAO and Moodle takes only a
couple steps to complete, but requires
administrator privileges on both TAO and
Moodle.
1. Ensure TAO is configured for LTI.
To do this, you will need to install the required
extensions through the Extensions Manager.
To use this, review the Extensions Manager
section in this guide. Select and install
extensions ltiDeliveryProvider and ltiProvider,
then reload the TAO page.
Go back to settings, and click on the new LTI
Consumers tab. Select the LTI Consumer class
(folder), and click on Add Consumer. Name the

199
new consumer, and fill in an easy to remember
Consumer key and Shared secret (this is used
within the integration). The callback URL can
be left blank. Finally, click on Create. If the
consumer does not immediately appear, reload
the page and it should come up. Record the
URL of the page - this is your Tool Base URL.
2. Ensure Moodle is correctly configured.
Go to Site Administration in the Moodle
platform and open under Advanced Features
the pull-down menu for Plugins. Pull to Activity
modules and then go to Manage activities.
Next, open Settings within External Tools and
click on Add external tool configuration. Add an
appropriate name to the new configuration and
then enter the Consumer key and Shared secret
set in TAO. When prompted, enter the Tool
Base URL. Finally, click on Save Changes.

200
Executing a TAO
delivery in Moodle as
an LTI Teacher
Learning Tool Interaction (LTI) standard is
supported by TAO. As a result, Moodle users can
make use of TAO-designed tests, delivering
them to students through that platform. This
allows test-creators to take advantage of the
ease of using TAO and test administrators the
familiarity of delivering through the popular
Moodle platform. You must have Teacher
privileges in Moodle and Test Delivery privileges
in TAO, and TAO-Moodle interconnectivity must
be set up prior to executing the delivery.
1. Complete creating a new delivery within TAO.
Follow the steps used in Create a New Delivery.
This should create an action without an icon
called an LTI export. Copy the URL that this
action generates.
2. Deliver the test in Moodle.
First, open the course in edit mode. Then click
on Add an activity or resource and select

201
External Tool. Click Add. Give the activity an
appropriate name and then paste the URL
taken from TAO in the previous step into the
Launch URL field. This should produce a green
check mark to the right of the URL, if it was
correctly copied. Finally, click Save and then
return to the course. Your delivery in Moodle
should be completed.
3. Test out the Delivery in Moodle.
Log in using a test account (a Test-taker profile
set up for use in ensuring that the delivery
works as planned). Select the course and then
click on the activity. If everything works as
desired, no further action will be required. If
not, then you will need to troubleshoot the
delivery in TAO, ensuring that it is fully
functional.

202
Glossary
The following are specialized terms which users
of TAO may frequently run into while using the
program to author tests, administrate them, or
generate assessment reports.

Action Bar
The menu, in the form of a blue bar, situated
under the black Assessment Builder Bar, which
appears across the top of all TAO web pages.

Adaptive Item
An Item which changes either its Interaction,
its scoring, or both, following unsatisfactory
attempts by the Test-taker to provide a correct
response. Adaptivity is usually used to adapt
assessment questions to learning experiences
for the candidate, guiding him or her through
the Item while scoring performance. Advanced.

Adaptive Test
A Test which changes the presentation of
Items based on Test-taker response. Generally
achieved through the use of pre-conditions and
branching. Advanced.

203
Assessment Builder Bar
The menu, in the form of a black bar, across the
top of all TAO web pages.

Assessment Variable
Technical term for the final score assigned to a
Test-taker's performance in an Item Session or
a Test Session.

Associable Hotspot Panel


The panel on the left of the Hotspot Interaction
which is being edited, from which the shapes
needed for the hotspots can be chosen.

Attempt
A single candidate interaction with an Item that
possibly assigns values to or updates an
associated Response Variable.

Authoring System
A system used by authors to create and edit
Items and Tests. TAO is an example of an
authoring system.

Base-type
204
A predefined data type used to define a value
set from which Item Variables are drawn.

Basic Item
An Item which contains one and only one
Interaction.

Candidate Session
The time during which the Candidate or Test-
taker is interacting with an Assessment Item as
part of an Attempt. An Attempt may extend
across more than one Candidate Session (such
as when a Test-taker terminates one Candidate
Session in order to answer another question
first, and then starts another Candidate
Session to return to the original question).

Canvas
The main area in the middle of the screen for
the user to define the contents of Items, Tests,
etc.

Class
A group of related Items, Tests, etc. Folders in
the Library represent Classes.

205
Cloning Engine
A system for creating multiple similar items (or
Item Clones) from an Item Template. TAO uses
a Cloning Engine to assist users in authoring
Items.

Common Interactions
An Interaction type which covers many of the
simple interactions that are commonly used in
testing.

Common Interactions Library


The first section of the Interactions Library
which appears on the left when editing an item.
It contains the Common Interactions used in
TAO.

Composite Item
An Item which contains more than one
Interaction.

Container
An aggregate data type that can contain
multiple values of unmodified Base-types, or
even be empty.

206
Custom Interactions
An Interaction type which provides library
space for miscellaneous Interactions
developed by the user.

Delivery Library
The Library of existing Deliveries, situated in
the panel on the left.

Delivery Library Panel


The panel on the left, where existing Deliveries
are shown.

Delivery System
A system which administers and delivers
assessments to Test-takers through the use of
a delivery engine, or a process that coordinates
both Item Delivery and response evaluation
(scoring) and Feedback.

Feedback
Any material presented to the candidate as a
result of an outcome variable meeting or
exceeding particular conditions. This can
include integrated, modal, and Test Feedback.

207
Graphic
A picture or other image upon which Graphic
Interactions are based. They often form the
background on which the Interaction is then
placed.

Graphic Interactions
An Interaction type which covers the Graphical
Interactions commonly used in testing.

Graphic Interactions Library


The third section of the Interactions Library
which appears on the left when editing an Item.
It contains the Graphic Interactions used in
TAO.

Inline Interactions
An Interaction type which covers the text-
based interactions commonly used in testing.

Inline Interactions Library


The second section of the Interactions Library
which appears on the left when editing an item.
It contains the Inline Interactions used in TAO.

208
Interaction
The part of an Item which allows the candidate
to interact with an assessment, selecting or
constructing a response.

Interaction Properties Panel


The panel which appears on the right when an
Interaction is being edited, where it is possible
to define certain properties pertaining to this
Interaction.

Integrated Feedback
Feedback which is integrated into an Item.
Unlike with Modal Feedback, Test-takers may
update their responses while viewing
Integrated Feedback.

Item
The smallest exchangeable object in an
assessment. An Item is more than a 'Question'
in that it also contains the contextual
instructions, the processing to be applied to
the Test-taker's response(s), and any Feedback
(including hints and solutions). May also be
called Assessment Item.

209
Item Clone
An Item which is similar to others created by an
Item Template. These are identical except for
designated variables called Template Variables.

Item Fragment
Part of an Item managed independently from
other parts. If it introduces all Items in a set,
such a fragment is often referred to as a set
leader.

Item Scoring Rules See


Response Processing.
Item Session
The accumulation of all Test-taker Attempts at
a particular Item.

Item Set
A group of Items which share common
characteristics.

Item Template
A template used for producing large numbers
of similar Items, often called Cloned Items.

210
These will have one or more designated
Template Variables, and will be governed by a
set of Template processing rules which are
assigned these values. These may be produced
by a special purpose Cloning Engine, such as
TAO.

Item Variable
A variable which records Test-taker responses
and any outcomes assigned during response
processing during an Item Session. As a
special kind of Assessment Variable, Item
Variables are also used to define Item
Templates.

Library
The panel on the left represents the various
Libraries. There are Libraries for existing Items,
Tests, Deliveries, etc, as well as for possible
Interaction types.

Library Panel
The panel on the left, where existing Items,
Tests, Deliveries, etc, as well as possible
Interaction types, are shown.

211
List Style
The possible answers will be presented to the
Test-taker in the form of a list.

Material
All static text, image, or media objects which
are intended for the Test-taker rather than for
being interpreted by a processing system.
Interactions are not considered to be material.

Math Expression
Math expressions can be entered using
MathML or Latex Math.

Media Formats
For maximum compatibility across browsers,
mp4 or mpeg formats should be used for video
(AAC codec for audio + H264 for video codec),
and mp3 or ogg should be used for audio.

Modal Feedback
Feedback which is not integrated into an Item's
body during presentation to the Test-taker.

Multiple Response
212
A Response Variable that serves as a container
for multiple values taken from a value set
defined by a base-type. These are processed as
an unordered list, and may be empty.

Non-adaptive Item
An Item which does not change following
attempts made by a Test-taker.

Object Bank
A collection of objects used during an
assessment, including Items, Item Fragments,
or Test parts.

Ordered Response
A Response Variable which is a Container for
multiple values taken from a value set defined
by a Base-type. These are processed as an
ordered list (sequence) of values, but may be
empty.

Outcome
The result of an Assessment Test or Item.
These are represented by one or more Outcome
Variables.

213
Outcome Processing
The process which adds up the values of Item
Outcomes (or Responses) in order to produce
Test Outcomes.

Outcome Variable
Variables taken from outcome declarations.
Values are set either from a default given
within the declaration or by a response rule
encountered during Response Processing (for
Item outcomes) or Outcome Processing (for
Test Outcomes).

Pattern
Patterns can be set using regular expressions
in the QTI creator. If the Test-taker's Response
does not match the Pattern, an error is shown.
The Response cannot be submitted until the
input is corrected in line with the pattern.

Pool
A special type of Object Bank which includes
related Items transported together with
metadata which describes the group as a
whole.

214
Pre-formatted Text
Indicates that the text to be entered by the
Test-taker is pre-formatted and should be
rendered in a way consistent with the definition
of pre in XHTML.

Properties Panel
The panel in which it is possible to define
certain properties pertaining to the Interaction,
Item, Test, Delivery etc, which is being edited.
Usually this is on the right.

Radio Button
A test type whereby the Test-taker is only
permitted to select one answer. If an additional
answer is clicked, the selection will move to
this choice, leaving the first one unselected.

Resource Manager
A method by which to manage and select
media files for use in Interactions.

Response
Data provided by the Test-taker through
interaction with an Item or Item Part.

215
Associated values are represented as
Response Variables.

Response Processing
The process by which Response Variable
values are scored and Item Outcome values are
assigned.

Response Properties Panel


The panel on the right of the Interaction being
edited, where it is possible to define the
properties pertaining to the Response to this
Interaction.

Response Variable
Variables taken from Response declarations
and bound to Interactions in the Item body,
they record the candidate's Responses.

Scoring Engine
The part of the assessment system that
processes Test-taker Responses and scores
them based on Response Processing rules.

Single Response

216
A Response Variable which takes a single value
from the value set defined by a Base-type.

Shared Stimulus
A stimulus is a piece of information which sets
the context for a question or a series of
questions. A Shared Stimulus is one that is
shared between multiple Items.

Test Feedback
Feedback presented to a Test-taker, based on
final score values.

Template Processing
Rules used to set values for Template
Variables. These are typically set by a random
process which selects a specific clone to be
used for an Item Session.

Template Variable
Variables taken from template declarations
which record values which render an Item
Template unique. These values determine the
clone within a set defined by an Item Template
which will be used for a given Item Session.

217
Test (or Assessment)
An organized collection of Items which are
used to measure performance of a Candidate
with respect to that person's level of mastery
of a given subject. Assessments contain all
instructions required for navigation through a
sequence of Items. They also calculate the
final score earned by the Test-taker.

Test Library
The Library of existing Tests, situated in the
panel on the left.

Test Library Panel


The panel on the left, where existing Tests are
shown.

Test Fragment
Part of a Test managed independently.

Test Report
A report describing a Test Session.

Test Session
The Interaction of a Candidate with a Test and

218
the Items it contains.

Test-taker (or Candidate)


A person who participates in a Test,
assessment or exam by answering questions.

Time Dependent Item


An Item which records the accumulated
elapsed time for a Candidate Session in a
Response Variable, used during Response
Processing.

Time Independent Item


An Item which does not use the accumulated
elapsed time during Response Processing.

219
Table of Contents
Introduction 2
What is TAO 2
Downloading TAO 5
Installing TAO 7
Take a tour 11
Items 17
What is an item? 17
Creating a new item 19
Importing items 26
Exporting items 28
Adding images, videos or sounds 31
Item scoring rules 34
Modal feedback 38
Preview 40
Style Editor 42
Media Manager 46
Interactions 49
What is an interaction? 49
Choice Interaction 51
Order Interaction 57
Associate Interaction 61
Match Interaction 67
Hottext Interaction 72
Gap Match Interaction 77
Slider Interaction 83
Extended Text Interaction 87
File Upload Interaction 91
Media Interaction 93
Inline Choice Interaction 97
Text Entry Interaction 103
Hotspot Interaction 109

220
Graphic Order Interaction 115
Graphic Associate Interaction 120
Graphic Gap Interaction 127
Select Point Interaction 134
Tests 140
What is a test? 140
Creating a new test 142
Importing a test 148
Exporting tests 150
Tests settings 153
Test-takers 158
Creating test-taker 158
Importing test-takers 161
Exporting test-takers 163
Groups 166
Creating a new group 166
Importing groups 169
Exporting groups 171
Deliveries 174
What is a delivery? 174
Create a new delivery 176
Results 180
Exporting Results 180
Advanced features 183
Metadata 183
User Management 189
Role Management 192
Add an extension 197
LTI admin 199
LTI teacher 201
Appendix 203
Glossary 203

221

Das könnte Ihnen auch gefallen