CSTE Vocabulary Matching [1-10] Name:__________________

Match the words in the first column to the best available answer in the second column.

1) Comparing your company’s products services or processes against best practices or

_____ Affinity Diagram competitive practices to help define superior performance of a product service or support
process.

_____ Application 2) A single software product that may or may not fully support a business function.

_____ Audit 3) A quantitative measure of the current level of performance.

4) A test technique that focuses on testing the functionality of the program component or
_____ Backlog application against its specifications without knowledge of how the system is constructed;
usually data or business process driven.

5) A test method that requires that each possible branch on each decision point be executed at
_____ Baseline
least once.

6) This is an inspection/assessment activity that verifies compliance with plans policies and
_____ Benchmarking
procedures and ensures that resources are conserved.

7) Work waiting to be done; for IT this includes new systems to be developed and
_____ Benefits Realization Test enhancements to existing systems. To be included in the development backlog the work must
have been cost-justified and approved for development.

8) A test or analysis conducted after an application is moved into production to determine

_____ Black-box Testing
whether it is likely to meet the originating business case.

9) A data selection technique in which test data is chosen from the “boundaries” of the input
or output domain classes data structures and procedure parameters. Choices often include the
_____ Boundary Value Analysis
actual minimum and maximum boundary values the maximum value plus or minus one and
the minimum value plus or minus one.

10) A group process that takes large amounts of language data such as a list developed by
_____ Branch Testing
brainstorming and divides it into categories.

Answer Key:
10 - Affinity Diagram
2 - Application
6 - Audit
7 - Backlog
3 - Baseline
1 - Benchmarking
8 - Benefits Realization Test
4 - Black-box Testing
9 - Boundary Value Analysis
5 - Branch Testing

Match the words in the first column to the best available answer in the second column.
1) The most traditional means for analyzing a system or a program. Desk checking
is conducted by the developer of a system or program. The process involves
Control Flow
_____ reviewing the complete product to ensure that it is structurally sound and that the
Analysis
standards and requirements have been met. This tool can also be used on artifacts
created during analysis and design.
 Coverage- 2) The input domain of a system is partitioned into classes of representative values
_____ Based so that the number of test cases can be limited to one-per-class which represents the
Analysis minimum number of test cases that must be executed.

3) A metric used to show the logic covered during a test session providing insight to
the extent of testing. The simplest metric for coverage would be the number of
computer statements executed during the test compared to the total number of
statements in the program. To completely test the program structure the test data
Data chosen should cause the execution of all paths. Since this is not generally possible
_____
Dictionary outside of unit test general metrics have been developed which give a measure of
the quality of test data based on the proximity to this ideal coverage. The metrics
should take into consideration the existence of infeasible paths which are those
paths in the program that have been designed so that no data will cause the
execution of those paths.

4) Tools for documenting defects as they are found during testing and for tracking
_____ Decision Table
their status through to resolution.

5) Provides the capability to create test data to test validation for the defined data
Defect elements. The test data generated is based upon the attributes defined for each data
_____
Tracking Tools element. The test data will check both the normal variables for each data element as
well as abnormal or error conditions for each data element.

Desk 6) Useful in identifying regression errors. A snapshot of the correct expected results
_____
Checking must be saved so it can be used for later comparison.

7) Pictorial representations of data flow and computer logic It is frequently easier to

understand and assess the structure and logic of an application system by
Equivalence
_____ developing a flow chart than to attempt to understand narrative descriptions or
Partitioning
verbal explanations. The flowcharts for systems are normally developed manually
while flowcharts of programs can be produced.

8) Based upon graphical representation of the program process. In control flow

analysis the program graph has nodes which represent a statement or segment
Error possibly ending in an unresolved branch. The graph illustrates the flow of program
_____
Guessing control from one segment to another as illustrated through branches. The objective
of control flow analysis is to determine potential problems in logic branches that
might result in a loop condition or improper processing.

File 9) A tool for documenting the unique combinations of conditions and associated
_____
Comparison results in order to derive unique test cases for validation testing.

10) Some people have a natural intuition for test data or test case generation. While
this ability cannot be completely described nor formalized people’s ability to create
_____ Flowchart
test data that has a high probability to catch errors should not be overlooked.
Guessing carries no guarantee for success but neither does it carry any penalty.
Answer Key:
 8 - Control Flow Analysis
3 - Coverage-Based Analysis
5 - Data Dictionary
9 - Decision Table
4 - Defect Tracking Tools
1 - Desk Checking
2 - Equivalence Partitioning
10 - Error Guessing
6 - File Comparison
7 - Flowchart

Match the words in the first column to the best available answer in the second column.
1) Incorporates testing into the operational environment. A repository for
test information must be pre-established so that the test data can be
_____ Inspection separated from production data. Once established the integrated test
facility permits test transactions to be entered with the same ease as
required to enter normal production transactions.

2) Model balancing relies on the complementary relationships between

Integrated Test the various models used in structured analysis (1)event 2)process 3)data)
_____
Facility to ensure that modeling rules/standards have been followed; this ensures
that these complementary views are consistent and complete.

3) Shows the controls within application systems used to reduce the

identified risk and in what segment of the application those risks exist.
One dimension of the matrix is the risk the second dimension is the
segment of the application system and within the matrix at the
_____ Mapping
intersections are the controls. For example - if a risk is “incorrect input”
and the systems segment is “data entry ” then the intersection within the
matrix would show the controls designed to reduce the risk of incorrect
input during the data entry segment of the application system.

_____ Model Animation 4) A tool to measure system performance.

5) Provides a picture of the use of instructions during the execution of a

program. Specifically it provides a frequency listing of source code
statements showing both the number of times an instruction was
executed and which instructions were not executed. Mapping can be
_____ Model Balancing
used to optimize source code by identifying the frequently used
instructions. It cart also be used to determine unused code which can
demonstrate code which has not been tested code that is infrequently
used or code that is non-entrant.

6) Formalized reviews that use people other than the producer to

evaluate the correctness of a single product/deliverable. The product is
checked against predetermined entrance criteria or the specifications that
_____ Network Analyzers
were used to build the product. The process requires advanced review of
the input specification and the product by competent peers who have
been assembled to form an inspection team.

_____ Performance/Timing 7) A tool used to assist in detecting and diagnosing network problems.
 Analyzer

8) Analyzes production data to identify (independent from the

specifications) the types and frequency of data that the system will have
_____ Population Analysis
to process/produce. This verifies that the specs can handle types and
frequency of actual data and can be used to create validation tests.

9) Model animation verifies that early models can handle the various
types of events found in production data. This is verified by “running”
_____ Risk Matrix
actual production transactions through the models as if they were
operational systems.

10) A method of symbolically defining data that forces program paths to

be executed. Instead of executing the program with actual data values
the variable names that hold the input values are used. Thus all variable
_____ Symbolic Execution
manipulations and decisions are made symbolically. This process is used
to verify the completeness of the structure as opposed to assessing the
functional requirements of the program.

Answer Key:
6 - Inspection
1 - Integrated Test Facility
5 - Mapping
9 - Model Animation
2 - Model Balancing
7 - Network Analyzers
4 - Performance/Timing Analyzer
8 - Population Analysis
3 - Risk Matrix
10 - Symbolic Execution

Match the words in the first column to the best available answer in the second column.
1) A tool that specifies an order of actions that should be performed during a test
Test Data session. The script also contains expected results. Test scripts may be manually
_____
Generator prepared using paper forms or may be automated using capture/playback tools or
other kinds of automated scripting tools.

_____ Test Harness 2) A collection of test drivers and test stubs that

3) A process that follows the flow of computer logic at execution time. Tracing
demonstrates the sequence of instructions or a path followed in accomplishing a
_____ Test Scripts given task. The two main types of trace are tracing instructions in computer
programs as they are executed or tracing the path through a database to locate
predetermined pieces of information.

4) During a walkthrough the producer of a product “walks through” or

paraphrases the products content while a team of other individuals follow along.
_____ Test Stubs
The team’s job is to ask questions and raise issues about the product that may lead
to defect identification. [Perry 36 pg. 292]

_____ Test Suite 5) A software package that creates test transactions for testing application systems
 and programs. The type of transactions that can be generated is dependent upon
the options available in the test data generator. With many current generators the
Manager
prime advantage is the ability to create a large number of transactions to volume
test application-systems.

6) A test data selection technique in which values are chosen to lie along data
extremes. Boundary values include maximum minimum just inside/outside
_____ Tracing boundaries typical values and error values. The hope is that if a systems works
correctly for these special values then it will work correctly for all values in
between. [FOLDC]

_____ Walkthroughs 7) A tool that allows testers to organize test scripts by function or other grouping.

8) Simulates a called routine so that the calling routine’s functions can be tested.
Boundary-Value A test harness (or driver) simulates a calling component or external environment
_____
Analysis providing input to the called routine initiating the routine and evaluating or
displaying output returned.
Answer Key:
5 - Test Data Generator
2 - Test Harness
1 - Test Scripts
8 - Test Stubs
7 - Test Suite Manager
3 - Tracing
4 - Walkthroughs
6 - Boundary-Value Analysis

Match the words in the first column to the best available answer in the second column.
1) Testing of an application on all supported hardware and software platforms.
_____ Brainstorming
This may include various combinations of hardware types

_____ Bug 2) A form used to record data as it is gathered.

3) Acceptance of software by an authorized agent after the software has been

_____ Certification
validated by the agent or after its validity has been demonstrated to the agent.

4) A white-box testing technique that measures the number of - or percentage - of

decision outcomes covered by the test cases designed. 100% Condition coverage
_____ Checksheet
would indicate that every possible outcome of each decision had been executed at
least once during testing. [5-50]

5) The property that all necessary parts of an entity are included. Often a product
_____ Checkpoint
is said to be complete if it has met all requirements.

6) The customer that pays for the product received and receives the benefit from
_____ Client
the use of the product.

_____ Coaching 7) A catchall term for all software defects or errors.

Condition
_____ 8) A group process for generating creative and diverse ideas.
Coverage
 Configuration 9) Providing advice and encouragement to an individual or individuals to promote
_____
Testing a desired behavior.

10) A formal review of key project deliverables. One checkpoint is defined for
_____ Completeness each key project deliverable and verification and validation must be done for each
of these deliverables that is produced.

Answer Key:
8 - Brainstorming
7 - Bug
3 - Certification
2 - Checksheet
10 - Checkpoint
6 - Client
9 - Coaching
4 - Condition Coverage
1 - Configuration Testing
5 - Completeness

Match the words in the first column to the best available answer in the second column.
1) The extent to which software is free from design and coding defects (i.e. fault-
Complete Test
_____ free). It is also the extent to which software meets its specified requirements and
Set
user objectives.

2) A test set containing data that causes each element of pre-specified set of Boolean
_____ Consistency conditions to be true. In addition each element of the test set causes at least one
condition to be true.

Consistent 3) The individual or organization internal or external to the producing organization

_____
Condition Set that receives the —product.

_____ Correctness 4) The number of decision statements plus one.

Cost of Quality 5) Validates the effectiveness of data conversion processes including field-to-field
_____
(COQ) mapping and data translation. [5-82]

Conversion 6) A set of Boolean conditions such that complete test sets for the conditions
_____
Testing uncover the same errors.

7) Money spent above and beyond expected production costs (labor materials
equipment) to ensure that the product the customer receives is a quality (defect free)
_____ Customer
product. The Cost of Quality includes prevention appraisal and correction or repair
costs. See also Production Costs[A-5] [2-4][4-2][5-40]

Cyclomatic 8) The process of analyzing and correcting syntactic logic and other errors identified
_____
Complexity during testing.

DD (decision-to- 9) The property of logical coherence among constituent parts. Consistency can also
_____
decision) path be expressed as adherence to a given set of rules.
 10) A path of logical code sequence that begins at a decision statement or an entry
_____ Debugging
and ends at a decision statement or an exit.
Answer Key:
2 - Complete Test Set
9 - Consistency
6 - Consistent Condition Set
1 - Correctness
7 - Cost of Quality (COQ)
5 - Conversion Testing
3 - Customer
4 - Cyclomatic Complexity
10 - DD (decision-to-decision) path
8 - Debugging

Match the words in the first column to the best available answer in the second column.
 1) 1) From the producers viewpoint - a product requirement that has not been
met or a product attribute possessed by a product or a function performed by
_____ Decision Coverage a product that is not in the statement of requirements that define the product;
or 2) From the customers viewpoint - anything that causes customer
dissatisfaction whether in the statement of requirements or not. [4-7][5-95]

Decision/Condition 2) A white-box testing technique that executes possible combinations of

_____
Coverage condition outcomes in each decision. [5-50]

3) Giving people the knowledge skills and authority to act within their area of
_____ Defect
expertise to do the work and also improve the process.

4) A dynamic analysis technique that inserts into the program code assertions
_____ Design Level about the relationship between program variables. The truth of the assertions
is determined as the program executes.

5) Analysis performed by executing the program code. This executes or

_____ Desk Check simulates a development phase product and it detects errors by analyzing the
response of a product to sets of input data.

6) A white-box testing technique that measures the number of - or percentage

- of decision directions executed by the test case designed. 100% would
DoD Development indicate that all decision directions had been executed at least once during
_____
Reviews testing. Alternatively each logical path through the program can be tested.
Often paths through the program are grouped into a finite set of classes and
one path from each class is tested. [5-50]

7) The design decomposition of the software item (e.g. system subsystem

_____ Driver
program or module).

8) A series of reviews required by Department of Defense directives. Reviews

for systems requirements systems design preliminary design critical design
_____ Dynamic Analysis
functional configuration physical configuration and formal qualification
constitute the set of required life cycle reviews.

9) A verification technique conducted by the author of the artifact to verify

_____ Dynamic Assertion the completeness of their own work. This technique does not involve anyone
else.

_____ Empowerment 10) Code that sets up an environment and calls a module for test. [5-51]

Answer Key:
 6 - Decision Coverage
2 - Decision/Condition Coverage
1 - Defect
7 - Design Level
9 - Desk Check
8 - DoD Development Reviews
10 - Driver
5 - Dynamic Analysis
4 - Dynamic Assertion
3 - Empowerment

Match the words in the first column to the best available answer in the second column.
1) 1. A discrepancy between a computed observed or measured value or condition
and the true specified or theoretically correct value or condition. 2. Human action
Entrance
_____ that results in software containing a fault (e.g. omission or misinterpretation of user
Criteria
requirements in a software specification incorrect translation or omission of a
requirement in the design specification). [IEEE]

Equivalence
_____ 2) A diagram that shows the sequential steps of a process or workflow.
Partitioning

3) Standards for work product quality which block the promotion of incomplete or
Error or
_____ defective work products to subsequent stages of the software development process.
Defect
[5-73]

4) A black-box test technique that utilizes a subset of data that is representative of a

larger class. This is done in place of undertaking exhaustive testing of each value of
Error the larger class of data. For example a business rule that indicates that a program
_____
Guessing should edit salaries within a given range ($10000 - $15000) might have 3
equivalence classes to test:Less than $10000 (invalid) Between $10000 and $15000
(valid) Greater than $15000 (invalid) [5-50]

Exhaustive 5) Required conditions and standards for work product quality that must be present
_____
Testing or met for entry into the next stage of the software development process. [5-73]

6) Executing the program through all possible combinations of values for program
_____ Exit Criteria
variables.

7) Test data selection technique for picking values that seem likely to cause defects.
_____ Flowchart This technique is based upon the theory that test cases and test data can be
developed based on the intuition and experience of the tester. [5-51]

Force Field 8) Technique that uses rigorous mathematical techniques to analyze the algorithms
_____
Analysis of a solution for numerical properties efficiency and correctness.

Formal 9) Application of test data derived from the specified functional requirements
_____
Analysis without regard to the final program structure. [5-50]

Functional 10) A group technique used to identify both driving and restraining forces that
_____
Testing influence a current situation.
Answer Key:
 5 - Entrance Criteria
4 - Equivalence Partitioning
1 - Error or Defect
7 - Error Guessing
6 - Exhaustive Testing
3 - Exit Criteria
2 - Flowchart
10 - Force Field Analysis
8 - Formal Analysis
9 - Functional Testing

Match the words in the first column to the best available answer in the second column.
1) A team or individuals who manage(s) resources at any level of the
_____ Histogram
organization.

_____ Inputs 2) A sequence of program statements that can never be executed.

3) A formal assessment of a work product conducted by one or more

qualified independent reviewers to detect defects violations of development
standards and other problems. Inspections involve authors only when specific
_____ Infeasible Path
questions concerning deliverables exist. An inspection identifies defects but
does not attempt to correct them. Authors take corrective actions and arrange
follow-up reviews as needed. [5-102]

4) The ability to lead including inspiring others in a shared vision of what can
_____ Inspection be taking risks serving as a role model reinforcing and rewarding the
accomplishments of others and helping others to act.

5) A graphical description of individual measured values in a data set that is

organized according to the frequency or relative frequency of occurrence. A
_____ Instrumentation
histogram illustrates the shape of the distribution of individual values in a
data set along with information regarding the average and variation.

6) The insertion of additional code into a program to collect information

_____ Integration Testing
about program behavior during program execution.

7) This test begins after two or more programs or application components

have been successfully unit tested. It is conducted by the development team
Invalid Input (test
to validate the technical quality or design of application It is the first level of
_____ data for invalid input
testing which formally integrates a set of programs that communicate among
domain)
themselves via messages or files (a client and its server(s) a string of batch
programs or a set of on-line modules within a dialog or conversation.) [5-92]

8) The process of verifying the consistency completeness and correctness of

_____ Leadership
software at each stage of the development lifecycle.

9) Materials services or information needed from suppliers to make a process

_____ Life Cycle Testing
work or build a product.

10) Test data that lies outside the domain of the function the program
_____ Management
represents.
Answer Key:
5 - Histogram
9 - Inputs
2 - Infeasible Path
3 - Inspection
6 - Instrumentation
7 - Integration Testing
10 - Invalid Input (test data for invalid input
domain)
4 - Leadership
8 - Life Cycle Testing
1 - Management

Match the words in the first column to the best available answer in the second column.
1) The process of generating test sets for structural testing based on use of
_____ Mean
complexity or coverage metrics.

2) A method of control put in place within each stage of the development

Metric-Based
process to promote error identification and resolution so that defects are not
_____ Test Data
propagated downstream to subsequent stages of the development process. The
Generation
verification validation and testing of work within the stage that it is created.

3) A sequence of edges from the program graph that represents a path through
_____ Mission
the program.

4) A test method satisfying the coverage criteria that each logical path through
Mutation
_____ the program be tested. Often paths through the program are grouped into a finite
Analysis
set of classes and one path from each class is tested.

5) Decision rules used to determine whether a software item or feature passes or

_____ Outputs
fails a test.

_____ Pass/Fail Criteria 6) A customer-oriented statement of purpose for a unit or a team.

7) Validates that both the on-line response time and batch run times meet the
_____ Path Expressions
defined performance requirements. [5-50][5-83]

8) A method to determine test set thoroughness by measuring the extent to

_____ Path Testing which a test set can discriminate the program from slight variants (i.e. mutants)
of it.

_____ Performance Test 9) Products services or information supplied to meet customer needs.

Phase (or Stage) 10) A value derived by adding several quantities and dividing the sum by the
_____
Containment number of these quantities.
Answer Key:
 10 - Mean
1 - Metric-Based Test Data Generation
6 - Mission
8 - Mutation Analysis
9 - Outputs
5 - Pass/Fail Criteria
3 - Path Expressions
4 - Path Testing
7 - Performance Test
2 - Phase (or Stage) Containment

Match the words in the first column to the best available answer in the second column.
1) The use of mathematical logic techniques to show that a relationship between
_____ Policy program variables assumed true at program entry implies that another relationship
between program variables holds at program exit.

2) A product is a quality product if it is defect free. To the producer - a product is a

quality product if it meets or conforms to the statement of requirements that defines
_____ Procedure
the product. This statement is usually shortened to: quality means meets
requirements. From a customer’s perspective - quality means “fit for use.”

_____ Process 3) The step-by-step method followed to ensure that standards are met.

4) The output of a process - the work product. There are three useful classes of
products 1)Manufactured Products (standard and custom)
Process 2)Administrative/Information Products (invoices letters etc.) and 3)Service
_____
Improvement Products (physical intellectual physiological and psychological). Products are
defined by a statement of requirements; they are produced by one or more people
working in a process.

5) To change the statement of requirements that defines a product to make the

product more satisfying and attractive to the customer (more competitive). Such
_____ Product changes may add to or delete from the list of attributes and/or the list of functions
defining a product. Such changes frequently require the process to be changed.
NOTE -This process could result in a totally new product.

6) The cost of producing a product. Production costs as currently reported consist

Product of (at least) two parts; actual production or right-the-first time costs (RFT) plus the
_____
Improvement Cost of Quality (COQ). RFT costs include labor materials and equipment needed to
provide the product correctly the first time. See also Cost of Quality [A-2]

Production 7) Managerial desires and intents concerning either process (intended objectives) or
_____
Costs products (desired attributes).

8) (1) The work effort that produces a product. This includes efforts of people and
equipment guided by policies standards and procedures. (2) The process or set of
processes used by an organization or project to plan. manage execute monitor
_____ Productivity
control and improve its software related activities. A set of activities and tasks
[ISO/IEC12207-1]. A statement of purpose and an essential set of practices
(activities) that address that purpose.

_____ Proof of 9) To change a process to make the process produce a given product faster more
 economically or of higher quality. Such changes may require the product to be
Correctness
changed. The defect rate must be maintained or reduced.

10) The ratio of the output of a process to the input usually measured in the same
units. Ills frequently useful to compare the value added to a product by a process to
_____ Quality
the value of the input resources required (using fair market values for both input
and output).
Answer Key:
7 - Policy
3 - Procedure
8 - Process
9 - Process Improvement
4 - Product
5 - Product Improvement
6 - Production Costs
10 - Productivity
1 - Proof of Correctness
2 - Quality

Match the words in the first column to the best available answer in the second column.
1) A systematic matrix method used to translate customer wants or needs into
Quality
_____ product or service characteristics that will have a significant positive impact on
Assurance (QA)
meeting customer demands.

2) A graph of data points in chronological order used to illustrate trends or

Quality Control
_____ cycles of the characteristic being measured to suggest an assignable cause rather
(QC)
than random variation.

Quality Function 3) Code that makes an explicit attempt to determine its own correctness and to
_____
Deployment proceed accordingly.

4) Testing of a previously verified program or application following program

Quality
_____ modification for extension or correction to insure no new defects have been
Improvement
introduced. [5-95]

5) To change a production process so that the rate at which defective products

_____ Recovery Test (defects) are produced is reduced. Some process changes may require the
product to be changed.

6) The set of support activities (including facilitation training measurement and

Regression analysis) needed to provide adequate confidence that processes are established
_____
Testing and continuously improved to produce products that meet specifications and are
fit for use. [5-41]

7) A graph designed to show whether there is a relationship between two

_____ Requirement
changing variables.

_____ Run Chart 8) A formal statement of

_____ Scatter Plot 9) The process by which product quality is compared with applicable standards
(correlation and the action taken when nonconformance is detected. Its focus is defect
 detection and removal. This is a line function; that is the performance of these
diagram)
tasks is the responsibility of the people working within the process. [5-41]

10) Evaluates the contingency features built into the application for handling
Self-validating
_____ interruptions and for returning to specific points in the application processing
Code
cycle including

Answer Key:
6 - Quality Assurance (QA)
9 - Quality Control (QC)
1 - Quality Function Deployment
5 - Quality Improvement
10 - Recovery Test
4 - Regression Testing
8 - Requirement
2 - Run Chart
7 - Scatter Plot (correlation diagram)
3 - Self-validating Code

Match the words in the first column to the best available answer in the second column.
1) The measure used to evaluate products and identify nonconformance. The basis
_____ Services
upon which adherence to policies is measured.

2) Test data based on input values that are likely to require special handling by the
_____ Simulation
program.

Software 3) A test method that executes each statement in a program at least once during
_____
Feature program testing. [5-50]

4) The output of a process - the work product. There are three useful classes of
products – 1)Manufactured Products (standard and custom)
2)Administrative/Information Products (invoices letters etc.) and 3)Service
_____ Software Item
Products (physical intellectual physiological and psychological). Products are
defined by a statement of requirements; they are produced by one or more people
working in a process. See Product.

Special Test 5) A distinguishing characteristic of a software item (e.g. performance portability

_____
Data or functionality).

6) Analysis of a program that is performed without executing the program. It may

_____ Standards
be applied to the requirements design or code.

_____ Standardize 7) Source code object code job control code control data or a collection of these.

8) Use of an executable model to represent the behavior of an object. During

Statement of
_____ testing the computational hardware the external environment and even code
Requirements
segments may be simulated.

Statement 9) Procedures that are implemented to ensure that the output of a process is
_____
Testing maintained at a desired level.
 10) The exhaustive list of requirements that define a product. NOTE - The
statement of requirements should document requirements proposed and rejected
_____ Static Analysis
(including the reason for the rejection) during the requirement determination
process.
Answer Key:
4 - Services
8 - Simulation
5 - Software Feature
7 - Software Item
2 - Special Test Data
1 - Standards
9 - Standardize
10 - Statement of Requirements
3 - Statement Testing
6 - Static Analysis

Match the words in the first column to the best available answer in the second column.
Statistical
1) An individual or organization that supplies inputs needed to generate a product
_____ Process
service or information to a customer.
Control

2) This test subjects a system or components of a system to varying environmental

_____ Stress Testing
conditions that defy normal expectations. For example

3) Special code segments that when invoked by a code segment under testing
Structural
_____ simulate the behavior of designed and specified modules not yet constructed. [5-
Testing
51]

4) A testing method in which the test data are derived solely from the program
_____ Stub
structure. [5-50]

5) During this event the entire system is tested to verify that all functional
information structural and quality requirements have been met. A predetermined
combination of tests is designed that when executed successfully satisfy
management that the system meets specifications. System testing verifies the
functional quality of the system in addition to all external interfaces manual
_____ Supplier
procedures restart and recovery and human-computer interfaces. It also verifies
that interfaces between the application and the open environment work correctly
that JCL functions correctly and that the application functions appropriately with
the Database Management System Operations environment and any
communications systems. [5-93]

Symbolic 6) A static analysis technique that derives a symbolic expression for each program
_____
Execution path.

7) An individual test condition executed as part of a larger test that contributes to

the test’s objectives. Test cases document the input expected results and execution
_____ System
conditions of a given test item. Test cases are broken down into one or more
detailed test scripts and test data conditions for execution. [5-85]

8) The use of statistical techniques and tools to measure an ongoing process for
_____ System Test
change or stability.
_____ Test 9) One or more software applications that together support a business function.

Test Case 10) 1) A Set of one or more test cases. 2) A set of one or more test cases and
_____
Specification procedures.
Answer Key:
8 - Statistical Process Control
2 - Stress Testing
4 - Structural Testing
3 - Stub
1 - Supplier
6 - Symbolic Execution
9 - System
5 - System Test
10 - Test
7 - Test Case Specification

Match the words in the first column to the best available answer in the second column.
1) A document that specifies the details of the test approach for a software feature
_____ Test Cycle
or a combination of features and identifies the associated tests. [5-85]

_____ Test Data Set 2) A document specifying a sequence of actions for the execution of a test. [5-85]

Test Design
_____ 3) A software item that is an object of testing.
Specification

_____ Test Driver 4) A chronological record of relevant details about the execution of tests. [2-13]

5) A program that directs the execution of another program against a collection of

_____ Test Harness test data sets. Usually the test driver also records and organizes the output
generated as the tests are run. [5-51] See test driver.

Test Incident 6) A document describing any event during the testing process that requires
_____
Report investigation.

7) A document describing the intended scope approach resources and schedule of

testing activities. It identifies 1)test items 2)the features to be tested 3)the testing
_____ Test Item
tasks 4)the personnel performing each task 5)and any risks requiring contingency
planning. [5-85][6-13]

Test Item
8) A document that identifies test items and includes current status and location
_____ Transmittal
information.
Report

9) Test cases are grouped into manageable (and schedulable) units called test
cycles. Grouping is according to the relation of objectives to one another timing
_____ Test Log
requirements and on the best way to expedite defect detection during the testing
event. Often test cycles are linked with execution of a batch process.

_____ Test Plan 10) Set of input elements used in the testing process.
 11) A program that directs the execution of another program against a collection
Test Procedure
_____ of test data sets. Usually the test driver also records and organizes the output
Specification
generated as the tests are run. [5-51]

Answer Key:
9 - Test Cycle
10 - Test Data Set
1 - Test Design Specification
11 - Test Driver
5 - Test Harness
6 - Test Incident Report
3 - Test Item
8 - Test Item Transmittal Report
4 - Test Log
7 - Test Plan
2 - Test Procedure Specification

Match the words in the first column to the best available answer in the second column.
1) The ideals customs instructions etc. of a society toward which the people
Test Summary have an affective regard. These values may be positive as cleanliness freedom or
_____
Report education or negative as cruelty crime or blasphemy. Any object or quality
desired as a means or as an end in itself.

2) The purpose of this event is to review the application user interface and other
human factors of the application with the people who will be using the
application. This is to ensure that the design (layout and sequence etc.) enables
the business functions to be executed as easily and intuitively as possible. This
_____ Testing review includes assuring that the user interface adheres to documented User
Interface standards and should be conducted early in the design stage of
development. Ideally an application prototype is used to walk the client group
through various business scenarios although paper copies of screens windows
menus and reports can be used. [5-82]

3) Testing individual programs modules or components to demonstrate that the

work package executes per specification and validate the design and technical
quality of the application. The focus is on ensuring that the detailed logic within
_____ Unit Test
the component is accurate and reliable according to pre-determined
specifications. Testing stubs or drivers may be used to simulate behavior of
interfacing modules.

4) Examination by manual or automated means of the behavior of a program by

_____ Usability Test executing the program on sample data sets to verify that it satisfies specified
requirements or to verify differences between expected and actual results.

5) Determination of the correctness of the final program or software produced

User Acceptance from a development project with respect to the user needs and requirements.
_____
Test Validation is usually accomplished by verifying each stage of the software
development life cycle. [2-14]

_____ User 6) The customer that actually uses the product received.

_____ Valid Input (test 7) 1) The process of determining whether the products of a given phase of the
 software development cycle fulfill the requirements established during the
data for a valid previous phase. 2) The act of reviewing inspecting testing checking auditing or
input domain) otherwise establishing and documenting whether items processes services or
documents conform to specified requirements. [2-7][2-14]

8) User Acceptance Testing (UAT) is conducted to ensure that the system meets
the needs of the organization and the end user/customer. It validates that the
_____ Validation system will work as intended by the user in the real world and is based on real
world business scenarios not system requirements. Essentially this test validates
that the RIGHT system was built.

Values 9) A document that describes testing activities and results and evaluates the
_____
(Sociology) corresponding test items.

10) Test data that lie within the domain of the function represented by the
_____ Verification
program.
Answer Key:
9 - Test Summary Report
4 - Testing
3 - Unit Test
2 - Usability Test
8 - User Acceptance Test
6 - User
10 - Valid Input (test data for a valid input domain)
5 - Validation
1 - Values (Sociology)
7 - Verification

Match the words in the first column to the best available answer in the second column.
_____ Vision 1) Specific tests that will be conducted during the each test event. [5-102]

_____ Walkthrough 2) A statement that describes the desired future state of a unit.

3) A function whose inputs are software data and whose output is a single
White-box
_____ numerical value that can be interpreted as the degree to which software possesses a
Testing
given attribute that affects its quality. [IEEE Std 1061-1992] [5-98]

Defect 4) A quantitative measure of the degree to which a system component or process

_____
counting possesses a given attribute. [IEEE Std 610.12-1 990][5-98]

5) A testing technique that assumes that the path of the logic in a program unit or
component is known. White-box testing usually consists of testing paths branch by
_____ Metric
branch to produce predictable results. This technique is usually used during tests
executed by the development team such as Unit or Component testing [5-50]

6) A metric used to measure characteristics of the methods techniques and tools

_____ Process metric employed in developing implementing and maintaining the software system.
[IEEE Std 1061-1992][5-98]

_____ Product metric 7) The frequency of the recorded items are counted. [5-43]
 8) A manual analysis technique in which the module author describes the module’s
Software structure and logic to an audience of colleagues. Techniques focus on error
_____
quality metric detection not correction. Will usually use a formal set of standards or criteria as the
basis of the review. [Perry 36 pg. 292]

Test
_____ 9) A verification of process deliverables against deliverable specifications. [5-102]
cases/events

10) A metric used to measure the characteristics of the documentation and code.
_____ Inspections
[IEEE Std 1061-1992] [5-98]

11) A verification that the process deliverables/phases are meeting the users true
_____ Reviews
needs. [5-102]
Answer Key:
2 - Vision
8 - Walkthrough
5 - White-box Testing
7 - Defect counting
4 - Metric
6 - Process metric
10 - Product metric
3 - Software quality metric
1 - Test cases/events
9 - Inspections
11 - Reviews

Match the words in the first column to the best available answer in the second column.
1) A useful tool to visualize clarify link identify and classify possible causes of a
problem. This technique is sometimes referred to as a “fishbone diagram” or a
_____ Pareto Analysis
“Ishikawa diagram.” The champion of this diagram was the late Kaoru Ishikawa a
quality expert from Japan.

2) A form used to gather and record data in an organized manner to help determine
Cause-and-
_____ the occurrence of an event/cause. Often referred to as a “checklist” or “tally sheet”
Effect Diagram
of events.

3) A technique used to analyze/divide a universe of data into homogeneous groups.

_____ Check Sheet Often data collected about a problem/event represents multiple sources that need
to be treated separately.

4) Shows the relationship that might exist between two variables/factors. It can
test for possible cause-and-effect relationships. This technique is used for problem
_____ Control Charts
solving and understanding of cause and effect. Often referred to as “correlation”
diagrams.

5) A statistical technique to used assess monitor and maintain the stability of a

process. The objective is to monitor a continuous repeatable process and the
_____ Run Chart
process variation from specifications/limits. Two types of variation are being
observed 1) common or random and 2) special or assignable cause.
 6) A frequency distribution chart is a bar graph of measured values (data sets)
utilized to display the frequency of occurrences of the measure data. This
_____ Histograms
technique provides a way to measure and analyze data collected about a process or
problem.

7) In problem-solving especially problem identification this quality tool should be

a common place to seek out the vital few causes/characteristics known to
Scatter contribute to most any problem. This practice is essential for identifying major
_____
Diagram/Plot problems with any operation process(es). All levels of management and teams
need to practice and master this technique/tool. Sometimes referred to as “20/80
Rule” or “Vital Few.” [5-43]

8) A graph of data (observation) in chronological (time) order displaying

_____ Stratification
shifts/trends in the central tendency (average).
Answer Key:
7 - Pareto Analysis
1 - Cause-and-Effect Diagram
2 - Check Sheet
5 - Control Charts
8 - Run Chart
6 - Histograms
4 - Scatter Diagram/Plot
3 – Stratification