ISTQB Advanced Test Analyst Certificate in Software Testing

Sample Paper A - 3 Hour Examination This is not a complete exam paper

Record your surname/last/family name and initials on the Answer Sheet, writing in block capitals at the top and marking the relevant letter in each column. Attempt all 65 multiple-choice questions. There are no trick questions. Pass Mark is 65/100. Your answers should be indicated inside the box representing your chosen answer to the right of the question number. Do NOT turn over this page until instructed by the invigilator. Copying of this paper is expressly forbidden without the direct approval of UKTB.

Candidate Name:

..

ATA Sample Exam Paper A Page 1 of 14 Version 1.0 October 2011 UK Testing Board, 114-116 Curtain Road, London. EC2A 3AH UK Testing Board is the trading name of UKTB Ltd, Company Registration No. 6505485

1 A B C D

How does test analysis and design contribute to test process improvement? Select one option. The process of test analysis and design will result in defects being discovered in requirements and other supporting documentation. Test analysis and design will enable identification of test conditions for use during the test implementation and execution process. The test analysis and design process enables risk reviews to be undertaken. Test process improvement is performed in phases of which test analysis and design is but one. K2 (1mark)

SCENARIO 1 The following Scenario applies for Questions 2 and 3. New game application Gametech is constructing a new game from reused components, open source components, and a small number of new build components. The reused components have been used on 1 or more earlier products and a total of 14 defects related to these components have been reported and corrected in the last 12 months. The open source components have not yet been tested by Gametech. The new build components were tested by the developers during the initial build phase using an Agile approach. The project has now reached the integration phase, for which the following exit criteria have been set: 1. All game Scenarios must be exercised by one or more test cases (A game Scenario consists of a table of interactions driven by the game. For each interaction the game responds according to the valid player actions or reports an invalid action); 2. All integration paths must be exercised by one or more test cases; 3. Total defects outstanding after integration testing must not exceed 0 severity 1 defects, 2 severity 2 defects, 3 severity 3 defects, and 10 defects overall. Defects are classified as follows: Severity 1 Serious functional or non-functional defect requiring urgent attention and necessitating a halt to testing; Severity 2 Functional or non-functional defect requiring urgent attention but not necessitating a halt to testing; Severity 3 Defects for which a work around is available to continue testing, but which must be corrected before release of the product; Severity 4 Defects for which a work around is available and which do not need to be corrected before release of the product.

ATA Sample Exam Paper A Page 2 of 14 Version 1.0 October 2011 UK Testing Board, 114-116 Curtain Road, London. EC2A 3AH

Referring to Scenario 1 - After all integration test cases have been exercised the following data has been collated: 1. All game Scenarios except the exit Scenario have been exercised. 2. All identified integration paths have been exercised (though there is no coverage data to support this assertion). 3. A total of 2 functional defects and 1 non-functional defect were found but testing was not interrupted. An additional 8 minor discrepancies were encountered but all of these were resolved by minor changes to the user manual. Does this set of measures satisfy exit criterion 3? Select one option.

A B C D

Yes, because there are no severity 1 defects. No, because the number of severity 2 defects is too high and the total number of defects is too high. Yes, because there are only 2 functional defects and all the minor discrepancies have work-arounds. No, because changes to the user manual have not corrected the defects. K3 (2 marks)

Referring to Scenario 1 - State transition testing has been selected to test the sequencing of game Scenarios. What coverage measure would be appropriate for this test? Select one option. Chows 0-switch coverage to ensure all individual interactions are covered. Chows 1-switch coverage to ensure that individual pairs of interactions are covered. Chows n-switch coverage, where n is 1 less than the number of interactions in each sequence. Chows n-switch coverage where n is 1 more than the number of interactions in the longest sequence. K2 (1 mark)

A B C D

--End of Scenario 1--

ATA Sample Exam Paper A Page 3 of 14 Version 1.0 October 2011 UK Testing Board, 114-116 Curtain Road, London. EC2A 3AH

4 A B C D

Why is it important for a test environment to be verified prior to test execution commencing? Select one option. To prove that the test environment will not crash during test execution. Test environments should always match those of the production environment. The test environment should allow defects to be captured against the system under test when test execution is underway. Environments require specific hardware configurations to be able to operate as test environments. K2 (1 mark)

5 A B C D

Which of the following statements correctly characterises management reviews and audits? Select one option. Management reviews are conducted to determine the effectiveness of a management system; audits are conducted solely to decide whether budgets have been correctly apportioned. Management reviews are carried out by or for managers or key stakeholders; audits are led by a moderator. Management reviews deliver detailed lists of problem areas with root causes; audits identify compliance with regulations and do not advise corrective actions. Management reviews check deviance from plans but do not assess project risks; audits interview staff and check documents. K2 (1 mark)

Which two of the following characteristics are MOST important in communicating defect information to a development team? a. b. c. d. e. Clarity in describing defect symptoms. Precision in defining what the problem is. Accuracy in assigning responsibility for a defect. Detail in explaining how the defect arose. Brevity in explaining how the defect should be corrected.

A B C D

a and c. b and e. a and d. c and d. K2 (1 mark)

ATA Sample Exam Paper A Page 4 of 14 Version 1.0 October 2011 UK Testing Board, 114-116 Curtain Road, London. EC2A 3AH

SCENARIO 2 The following Scenario applies for Questions 7, 8 and 9. New photography website An on-line photography company is launching a new website which will allow their customers to search for cameras using the following fields and their drop-down values: Field Name Camera type Brand Megapixels Zoom range Price range Hard Disk capacity The following limitations apply: SLR body only - Zoom range does not apply The lowest megapixel rating for an SLR camera is 12 Camcorders - megapixels does not apply Snapex do not manufacture either type of Camcorder Hard Disk capacity only applies for Camcorders The cheapest SLR camera (with or without a lens) is 250 The cheapest Camcorder camera (with or without HD) is 200 Drop-down values (select one value only) SLR with lens, SLR body only, Compact, Camcorder SD, Camcorder HD Clickon, Snapex, Supafilm, Shootax Under 6, 6 to 9.9, 10 to 14.9, 15 + 0 to 4.9, 5 to 9.9, 10+ Under 100, 100 to under 200, 200 to under 300, 300 to under 400, 400+ 8GB, 16 GB, 32GB, above 32GB

ATA Sample Exam Paper A Page 5 of 14 Version 1.0 October 2011 UK Testing Board, 114-116 Curtain Road, London. EC2A 3AH

Referring to Scenario 2 Following launch of the web-site and analysis of user feedback, further enhancements have been applied to the search criteria as follows: The user may now specify any combination of Camera types. The user may now specify any combination of Brands. The user has the option to specify a maximum price when the 400+ value is selected. Valid Price ranges will only be displayed after the user has selected the type(s) of Camera.

The following test design technique based tests have been proposed, but only three can be used due to the constraints of the testing schedule. Which one SHOULD be dropped? A B C D Use boundary value analysis to test maximum price entries. Use classification tree class combination testing to ensure adequate coverage of the new drop-down values introduced. Use pairwise to ensure adequate coverage of the new drop-down values introduced. Use decision table testing to ensure that valid price values are displayed for selected Camera types. K4 (2 marks) Referring to Scenario 2 - Using classification trees as a test case design technique, how many test cases would be needed to achieve class coverage for SLR cameras (with lens and body only)? 2. 3. 4. 5. K3 (2 marks) 9 Referring to Scenario 2 - Using pairwise as a test case design technique, how many test cases would be required to test the following fields and their values? A B C D 3. 6. 8. 12. K3 (2 marks) --End of Scenario 2-ATA Sample Exam Paper A Page 6 of 14 Version 1.0 October 2011 UK Testing Board, 114-116 Curtain Road, London. EC2A 3AH

A B C D

Camcorder (all types), Brands (all associated types) Hard Disk capacity (8GB and 16GB only)

10 A B C D

What type of defects would be expected to be found during technical security testing? Select one option. All possible defects can be expected to be discovered during all types of test execution. The ability to access unauthorised data and/or areas of a system under test. A user being able to enter an invalid username and password. A user being unable to perform an expected action within the system under test. K2 (1 mark)

11 A B C D

There are commercial test tools readily available, so why would it be sometimes necessary for a company to develop their own test tool? Select one option. It is more expensive to design your own test tool. The application under test contains elements of commercially available components, and there would be sufficient benefit to developing a bespoke tool for this purpose. It is beneficial to have a bespoke test tool as they are often developed by individuals for their own needs and are unsuitable for use by other testers or test teams. The hardware on which the system under test is deployed is not commercially available. K2 (1 mark)

12 A B C D

In a risk-based test plan, which of the following sets of activities would address all three PRIMARY stages in the risk-based testing approach? Select one option. Expert interviews, classification of risks by probability of arising, construct a test strategy to address all the risks. FMEA workshop, classification of risks by impact, transfer the risks to a third party by insurance. Brainstorm session, quantitative classification of risks by impact, put in place preventive measures to ensure the risks cannot arise. Use of checklists, classification of risks by probability of arising and impact, decide to accept all the risks. K2 (1 mark)

ATA Sample Exam Paper A Page 7 of 14 Version 1.0 October 2011 UK Testing Board, 114-116 Curtain Road, London. EC2A 3AH

This page is intentionally blank.

ATA Sample Exam Paper A Page 8 of 14 Version 1.0 October 2011 UK Testing Board, 114-116 Curtain Road, London. EC2A 3AH

SCENARIO 3 The following Scenario applies for questions 13 to 16 inclusive. Mobile phone software tool A mobile phone company, H2O, has a special business tariff for bulk text messages using a special short code (5 digit address for text messages). After paying a one-off set up fee of 500 for the short code, businesses can send up to 10,000 text messages free each month. From the 10,001st message the cost is 1.5p per message up to 50,000 messages, then 2p up to 100,000 messages. Above 100,000 messages the cost is 2.5p per message up to 500,000 messages, then 3p per message up to 1 million messages per month. Above 1 million messages there is a flat fee of 5p per message. TextMark is a small marketing company that uses H2Os business tariff as the basis of a business to sell marketing campaigns to other small businesses from their own (TextMarks) servers. TextMark charges its customers for setting up their campaigns but its messaging tariff is simpler than H2Os, and hides the H2O setup fee by charging 1p per message for the first 10,000 messages, then 2p for the next 90,000, 3p for the next 900,000 and 6p thereafter. TextMark has created a software tool to monitor outgoing text messages, calculate the cost of sending the texts, apply the agreed mark-up, and generate bills for their customers. This application needs to be tested, and the Test Manager has decided to construct and maintain a suite of test cases so that future pricing changes can be easily accommodated.

ATA Sample Exam Paper A Page 9 of 14 Version 1.0 October 2011 UK Testing Board, 114-116 Curtain Road, London. EC2A 3AH

13

Referring to Scenario 3 - TextMark has now been approached by a large marketing company that wants to license MarkMon for a series of their own marketing campaigns. They will want the new features when they are available, but they need the existing version to be ready for use at the earliest possible date. TextMark have decided to complete testing of the existing version in parallel with the new development and aim for the earliest launch date they can achieve for the original version. Under these circumstances, which of the following would be the MOST effective approach to testing the original version? Select one option. Use a fault attack based on the experience gained by the original develop. Use error guessing based on publicly available defect taxonomies. Construct a test plan as originally intended but limit testing to that which can be completed in the limited time available. Recruit experienced testers on contract to carry out exploratory testing based on a charter prepared by the original developer. K4 (2 marks)

A B C D

14 A B C D

Referring to Scenario 3 - applying Equivalence Partitioning, what are the key input partitions for TextMarks application? 0 - 10000, 10001 100000, 100001 999999, 1000000. 10000 100000, 100000 1000000, 1000001+. 0 10000, 10001 99999, 100000 1000000, 1000001+. 0 10000, 10001 100000, 100001 1000000, 1000001+. K3 (2 marks)

15 A B C D

Referring to Scenario 3 - Which of the following show Boundary Analysis Values covering each input partition for the H20 Business tariff? Select one option. 0, 10001, 50001, 100001, 1000000, 1000001. 0, 10000, 100000, 1000000. 0, 10000, 100000, 500000, 1000000, 1000001. 10000, 10001, 50000, 500000, 500001, 1000001. K3 (2 marks)

ATA Sample Exam Paper A Page 10 of 14 Version 1.0 October 2011 UK Testing Board, 114-116 Curtain Road, London. EC2A 3AH

16

Referring to Scenario 3 The following entries appear in the system design specification, covering business tariff registrations through the H2O web-site: 1. Payment screen Once valid account number, sort-code and amount entered and OK selected (thus neither Exit application nor Go Back buttons selected), call process payment module, otherwise return to previous page. 2. Display on Text Tariff page Annual cost for a business which sends 5000 text messages per month is only 500!. 3. The web-site design must cater for all combinations of selected web browsers, pc specifications, server builds and operating systems. 4. Current H2O clients will be granted appropriate access to the Text Tariff page.

The following are review checklist items: a) b) c) d) e) Ambiguous Not testable Incomplete/Insufficient Deviates from requirements Contradictory

Which option below correctly matches each requirement statement with the appropriate review checklist item? A B C D 1-e, 2-d, 3-b and 4-c. 1-c, 2-d, 3-b and 4-a. 1-b, 2-a, 3-d and 4-c. 1-c, 2-b, 3-e and 4-a. K3 (2 marks) --End of Scenario 3--

ATA Sample Exam Paper A Page 11 of 14 Version 1.0 October 2011 UK Testing Board, 114-116 Curtain Road, London. EC2A 3AH

17

The following state table shows both valid and invalid transitions: Input A S2 S3 Input B S4 S2 Input C S3 S1 Input D S3 Input E S4 -

S1 S2 S3 S4

What is the MINIMUM number of tests required to achieve 100% Chows zero switch coverage? A B C D 1. 3. 4. 8. K3 (2 marks)

18

Which three of the following system requirements would necessitate the use of efficiency, reliability and technical security testing? a. b. c. d. e. f. Must have no impact to the performance of other systems sharing the same infrastructure Must maintain full availability during hardware failures Each system function should only be accessed by specified user roles The system design must cope with future projected user volumes User access must be maintained during malicious overload attempts Must be accessible to the visually impaired and blind

A B C D

a, b and d. a, c and e. c, d and f. b, d and e. K2 (1 mark)

ATA Sample Exam Paper A Page 12 of 14 Version 1.0 October 2011 UK Testing Board, 114-116 Curtain Road, London. EC2A 3AH

19

The application under test is currently used in production, and enables the business to display and amend client account information (i.e. not available directly to the general public). The system is undergoing UAT, where the recent delivery is to give new reporting capabilities, adjust the industry premium rate for the start of the next financial year (in 3 weeks time) and correct the well-documented Double Monday problem. The severity of problems reported in the defect management system is critical, high, medium, low and cosmetic. Four business users have been involved in the test activity, the results of which can be summarised as follows: Reporting - new reports are produced in the correct circumstances, and can be produced to a file or to the printer as determined by the operator but for any of the 4 report types, there are no page breaks making the reports difficult to read; Industry Premium Rate is applied at run-date rather than the transaction effective date; Behaviour around the Double Monday problem is unchanged.

Which one of the following (A, B, C or D) BEST represents the information to be passed back to the development team on any new or existing defect reports? A Reporting: update the existing defect report to severity critical, detailing the tests undertaken, and giving examples of the reports produced Industry Premium Rate: raise a new defect giving examples of when the rate is correct and when it is incorrect. Severity high. Double Monday: close the existing defect and raise a new one, to reflect that the problem still occurs on release 1.0.3.12 B Reporting: update the existing defect report to severity low, detailing the tests undertaken, and giving examples of the reports produced Industry Premium Rate: raise a new defect detailing that the rate seems to be applied at run date rather than at the transaction effective date. Severity critical Double Monday: update the existing defect report to indicate that the software has been retested on the new (1.0.3.12) release and shows the same problem. Update the severity to critical as the defect has not been fixed when reported as such. C Reporting: update the existing defect report to severity cosmetic, detailing the tests undertaken, and giving examples of the reports produced Industry Premium Rate: raise a new defect with severity high Double Monday: update the existing problem to status retest failed D Reporting: update the existing defect report to severity medium, detailing the tests undertaken, and giving examples of the reports produced Industry Premium Rate: raise a new defect with severity critical Double Monday: update the existing defect report to indicate that the software has been retested on the new (1.0.3.12) release and shows the same problem. Manually enquire as to whether the item was included in the build. K4 (2 marks)

ATA Sample Exam Paper A Page 13 of 14 Version 1.0 October 2011 UK Testing Board, 114-116 Curtain Road, London. EC2A 3AH

20

Leisure Jet is a holiday company offering cheap flights to holiday destinations. Cheap travel insurance is also offered to passengers aged 18 or over and under 85. Children under 18 may travel only if accompanied by an adult and, in such cases a single family insurance policy is granted which applies a 10% discount to the premium for each family member. Passengers travelling to take part in any winter sports are charged a 10% surcharge on insurance premiums; the surcharge increases to 15% for passengers over 40 and to 20% for passengers under 25. A software package to implement the insurance system is to be tested using Decision Table testing. Which combination of the following test cases (A to F) would give 100% test coverage? Select three test cases. Test Case A Passenger a b c a b c C a b c a b c a b c a b c Age 25 87 16 18 14 17 37 63 24 40 23 17 44 18 17 44 24 46 Travel Plans (travelling to) Luzern for a skiing holiday Zurich to visit family Bern, travelling alone, for a family visit Paris with a group of friends for a shopping trip Brussels with his mother Luzern for a skiing holiday with his father Lanzarote Berlin for a stag party with a group of friends Zurich for a hen party Luzern for a skiing holiday the same skiing holiday as A Home to the UK, travelling alone Gran Canaria for a holiday Luzern for a skiing holiday Paris for a weekend break with her 17 year old brother Luzern for a skiing holiday Luzern for a skiing holiday Paris for a hen party K3 (3marks)

--End of Exam--

ATA Sample Exam Paper A Page 14 of 14 Version 1.0 October 2011 UK Testing Board, 114-116 Curtain Road, London. EC2A 3AH