Beruflich Dokumente
Kultur Dokumente
Aristocrat Technologies
About : Aristocrat Technologies
Aristocrat Technologies is an ASXIOO listed company and one of the world’s leading
providers of gaming solutions. We're licensed in 240 gaming jurisdictions and operate in
90 countries around the world, with a team of over 5000 employees who deliver
outstanding results by pushing the boundaries of innovation, creativity and technology.
Since our humble beginnings in 1953, we've been driven by a desire to create the world's
greatest gaming experience, every day. We offer a diverse range of products and services,
including electronic gaming machines, social gaming and casino management systems. But
despite our global presence and exponential growth, we remain an ideas company at
heart, committed to entertaining the world one game at a time.
WHO ?
TEAM CHARTER
> Greater Customer Satisfaction > Player Feedback, Customer
Surveys, Customer Connects
• Define Organizational Quality > Minimize Field Defects > Field Service Reports
Strategy
• Sponsor Quality Initiatives > Benchmark | Standardize > Quality Summits, SME Workshops,
• Provide Strategic Direction our Software Practices External Surveys (CEB)
• Govern Project Selection
• Define Minimum Adherence > Robust Audit Framework > Quality Summits, SME Workshops,
External Surveys (CEB)
Standards
• Create Open Channels of > Traceability & Enhance Field > Quality Performance Indicators
Issue Management Workflow
Communication
Section # 1.01 Organizational Approach to Project Planning
✓ Each planning cycle essentially goes through a 5 step strategic planning process ( depicted below )
✓ Outcomes of key initiatives, their performance indicators ( positive / negative ) fed into this process to yield :
➢ Strategic objectives, goals, communication plan, budgets and execution mechanism aligned to current
planning cycle in coherence to the organizational product strategy
Source: CEB
• Measure and evaluate outcomes, adoption rates & key performance indicators
• Record the results > results undergo external audit process > Published as/when approved
• Results then analyzed for Expected vs. Actual outcomes
Section # 1.02 Project Identification Process (General)
Section # 1.03: Project Selection Process (General)
Share
Gather
Workshops Brainstorm Learnings /
Momentum
Results
1.02 : Gaps Identified Implications Goals
IMPLICATIONS
MAJOR GAPS GOALS
• Millions of dollars spent on reworks
• Percentage of Issues Identified Late into • Loss of customer & player trust • Reduce Rework to Approval Ratio by
Development Cycles • Complicated issue resolution workflows 25% Year on Year till 2020
• High Rework to Approval Ratio • Un-auditable product development • Introduce AW4-SW-ST-Audit
• Low Customer Satisfaction Score practices • Formalize Field Issue Mgmt. Workflow
• High Cost of Quality • No benchmarking possible • Form Dedicated Quality Org.
• Development Studios Operating in Silos • Lack of Structure to flow of information • Build Intrinsic Culture of Quality
• Lack of Process Standardization & and best practices. • Reward Quality Goals Achievements
Maturity • Improve Customer Trust
Section # 1.04 Project Selection (Specific)
Customer Ease of
Project/Gap Description Strategic Impact
Impact
Product Impact
Implementation OVERALL
Software Quality Issues / Field Issues H H H L H
High Cost of Defect Correction H L M M M
Lack of Common Quality Strategy on Org. Level H H H M H
No Standardization of Practices H H H L H
No Audit Framework M L M M M
Weak Field Issue Management System H H H H H
Weak Culture of Quality H M M M M
Priorities Identified :
1. Fix High Occurrences of Software Quality Issues and Field Issues
2. Lack of a dedicated central quality strategy at org. level ( Intrinsic Cleansing Governance Model )
3. No Benchmarking, Standardization of Software Practices ( Functional Silos )
4. Weak Field Issue Management System – Introduce enhanced workflow
Section # 1.04 Project Selection (Specific)
High Rework
Overheads
• Root Cause
Deep Dive Analysis
Action • Strategic
Planning Initiatives
Continuous Improvement of
Enhance Quality Awareness by
Software Practices by
Publishing & Tracking External
Mandating RCA’s via Quality
Failure Cost
Action Requests (QAR)
Benchmarking and
Integrate Quality with
Standardization of Software
Delivery via Q-Plan/Q-Cert
Practices via Aristocrat
Phase Gate Reviews
Specific Frameworks
GOALS / BENEFITS
Section # 1.06: Success Measures/Criteria Identified
BENCHMARKED
REDUCED FIELD ISSUES PRACTICES PUSH LIMITS – PHASE 3
After continuously meeting the rework
It was analyzed that these actions will Adoption of standardized practices across
reduction targets for an extended period
have a direct effect on reduction in Field all software groups in Aristocrat.
of time, it was again time to stretch the
Issues which is critical for the organization
goals, so target to reduce the rework
to be a differentiator in this business area.
count by further 25% starting Q2-2018
SECTION - 2
[ Project Framework ]
Project objective is to reduce the "Critical & High Severity Field Issues" and overall
rework count by 25% year over year
Development and implementation of Frameworks (Product Quality, Development, Testing) which help bake quality in
the products are planned. Their impact should result in the reduction of critical field defect count across different
Development Teams in Aristocrat Technologies. These processes will be used as a basis, guide, and/or benchmark for
product development teams and facilitate their continuous and/or transformational change efforts.
Section 2.02 : Project Type
Project uses a typical multi-iterative PDCA methodology : Plan-Do-Check-Act
Section # 2.03 Project Scope, Project Assumptions
Framework
Framework will continue
Implementation
Generic Framework to evolve based on
Ownership: Development
feedback
Teams
Development Teams
Digital Business out of
Executive Buy-in from Quality measured via
Immediate Framework
Development Teams “Reworks to Approval
Implementation Scope
Ratio”
Travel &
Engagement
LITTLE TO NO EFFECT ON EVENT EFFECTS ARE FELT, BUT NOT SERIOUS IMPACT TO THE COURSE OF COULD RESULT IN DISASTER
CRITICAL TO OUTCOME ACTION AND OUTCOME
** This assessment matrix is revisited monthly to detect/brainstorm around any probable risk that may likely be introduced.
LACK OF ADHERENCE
02 •
•
Regular assessment and audits by Central Quality Group
Embed teams with Quality Evangelist
• Implementation of Hub & Spoke Governance Model
04
PRODUCT’S TIME TO MARKET
Introduction of all these new practices/frameworks could lead to slow adoption and
hence increased time to market for the product ( in product lifecycle ) – Mitigation
strategy put in place to address the risk via C-Level buy-ins, trainings and resource
additions/alignment.
SECTION - 3
[ Project Stakeholders and the Project Team ]
Sales Marketing Team Sales/Marketing Teams • Interface between Customers and teams
External Stakeholders
Accredited Test Facility QA & Approval Vendors Testing (QA and Compliance)
Impact: H High
SECTION # 3.01 - Stakeholder and How Identified?
Support
Type of Impact
Group S P C Power Rank Key Rep. Strategy (Communication)
Stakeholder Degree
Have Need
Bi-weekly update through
C - Level Y High 1 Internal High CPO 5 5 metrics/dashboards; Monthly CEO
Report
Spoke in each Monthly hub and spoke meetings;
Functional Quality Spoke Y Y Y High 2 Internal High 4 5
function Skype calls; emails
Quality team
Central Quality team Y Y Y High 2 Internal High 5 5 Weekly staff/standup meetings
members
Bi-weekly update through
Heads of
Head of Development Y Y Y High 2 Internal High 3 5 metrics/dashboard; Regular
Functions
feedback on audit results
Development Program
Y Y Moderate 3 Internal
Managers
Sales/Marketing Team Y Moderate 3 Internal
Development Team Y Y Y Moderate 3 Internal
Accredited Test Facility Y None 4 External
Customers Y High 2 External High Casino Managers 5 5 Monthly meetings with sales team
SECTION # 3.01 - Stakeholder and How Identified?
Head of Development
Development
Program Managers
Sales/Marketing &
Dev Team
Accredited
Test
Facility
SECTION # 3.02 – Project Champions
Retrospect and
Project Team
review
Members
periodically
Gaps
Project Team Group Stakeholder Group Required Skills Level of Knowledge
Identified
• Influence and leadership
Sponsor C-Level • Strategic Vision Adequate None
• Negotiation
• Decision Making
• Process Knowledge
Sr. VP Adequate None
• Strategic vision
• Influence and leadership
Champion • Quality Tools
• Process Knowledge There were areas where gaps
CQT team • Project Management were identified and addressed Yes
• Effective Communication in 3.04 section
• Product & System Knowledge
• Quality Tools
• Product & System Knowledge There were areas where gaps
Quality Mentors/SME Quality SPOKE • Effective Communication were identified and addressed Yes
• Innovative thinking in 3.04 section
• Project Management
SECTION # 3.03 – Project Team Selection – Hub/Spoke Organization
Dev
Team A
Fulfillment
Dev
Team B
Sales/M Dev
arketing Team Z
CQT Advantages of the model
• Customer Focus
• Knowledge of internal processes
Tech • Consultant support for quick
Systems
Services
kickoff
• Supported and prioritized by
leadership
Manufac Platform,
turing Digital
HW
Supplier Engineer
ing
3.04.1 - Before the project started, what was done to prepare team to work together as a single unit?
Virtual
weekly
Storming: Team voice their opinions, Hub and
work with each other and learn about
individual styles. Disagreements and Spoke
clashes are resolved. meetings
Leadership is important to manage
conflicts and assign tasks.
One Team
Phone Hub and
calls and Spoke
instant group on
messaging confluence
3.04.2 - Before the project started, what specific trainings was done?
Structural Participants
Organization Core Responsibilities
Class II
Organization
Dev A
Dev B • Decentralized hybrid
QAR/RCA/CAPA structure
Dev C AW4SW/T • Monthly Hub & Spoke
connect sessions
Dev Z Quality Framework
• Share lessons learned &
Systems Q-Plan/Cert collaboration
Best Practices • Defined Roles and
Tech, Platform, Digital Responsibilities
In-house Initiatives
HW Engineering
Process adherence
Supplier
Manufacturing
Tech Services Actions
Commercial • Monthly Reviews & Key
issues
Fulfillment • Resource discussion(s)
• Generate KPO(s)
Hub and Spoke Discussion • Quality Initiatives/In-
house/CQT
SECTION # 3.05 – Communication Matrix / Team Routine
Tracking on
Hub and Spoke movement of Hub and Spoke Skype calls; Two-way
Monthly
Review initiatives and team emails; video cons
adherence
External Stakeholders
SLA review
In-person
Quality
Quarterly 3rd Party Testing meetings; video Two-way
improvements Quarterly
Business Review and CQT conference;
Continuous emails
improvement
1 C 2 C 3 A P 4 D 5 D
Identify Evaluate Establish
the Internal Communicate Establish
Stage Lessons Strategic to Business Budget and
from Last and External Goals and
Environment Partners Structure
Year Objectives
Activities ■ Review results ■ Evaluate ■ Work with key ■ Develop key ■ Set org structure
to date. industry stakeholders to messages and allocate
trends. develop linking strategic resources.
■ Identify critical goals and priorities and
successes, ■ Assess current ■ Communicate
objectives. business goals.
failures, and Quality priorities to
root causes. capabilities. ■ Evaluate risks ■ Communicate teams.
and opportunities priorities
■ Revisit functional ■ Collect
of potential goals to business
mission and company and/or and objectives. partners.
vision. business goals.
Source : CEB
WIP
comprehensive and wholesome trends in all quality
dimensions.
• Improved Interoperability Strategy Rollout
• Decrease R2A Ratio Further – Push existing
boundaries in pursuit of excellence and measure
•
sustenance ( further down by 25% )
Maintain / Grow Culture of Quality – Sustain and ( Work in Progress )
further grow our culture of quality initiative via
quality influencers program being run across the
globe, TED talks on quality, trainings, focussed
workshops, certifications, L&OD initiatives.
Section 4.03 : Solutions Explained
Need for a tool - With the initiation of QAR process, there was a need of a tool to collate & manage QARs.
Nextgen QAR tool is currently being developed and used to capture all the QARs. Its a cloud-based system to manage Quality Action
Requests (QAR). The legacy tool was built on SharePoint & could be accessed only via Aristocrat network, more details below.
1 2 3
Today Soft Launch Global Launch
Soft launch with Systems Collect feedback and make Global launch and training
teams and 15 users. improvements. rollout by SQ18.
Section 4.03 : Solutions Explained
Q-Plan
– Meant to communicate quality goals to all stakeholders
– Produced/updated for each Major/Minor/New Release
– Owned and created by product stakeholders
– Reviewed formally and signed off by the Champions
Q-Cert
– Validates and proves how Q-Plan objectives were met
– Reported at key phases throughout development lifecycle
– Artifacts are stored and available for review and audit
– Supports go/no go decision
Next Steps
Rollout next generation of cloud based solution of Q-Plan & Q-Cert
Section 4.03 - Q-Plan Dimensions (Examples)
SAMPLE MEASURES
DIMENSION COMPONENT
• Business case
Product Management • IP/Patent check
• Marketing requirement document
• EV/DV + T
Engineering • Process Failure Mode Effects Analysis
• New, Unique, Difficult, Different (NUDD)
• NUDD
Global Supply Chain • Supplier Quality
• First article inspection
• Functionality
Measured ? Games • Design/Math
• Art
• Test plan review
User Experience (UX) • Persona assessment
• Usability
• Aristocrat
Compliance
• ATF
• CAD review
Tech Service • EV/EVT review
• Cabinet review
Section 4.03 - Q-Cert Assessment Methodology
XXX* 73%
XXX* 68%
XXX* 65%
XXX* 62%
XXX* 58%
Section 4.03 : Solutions Explained
Quality Performance Index – Dashboard (QPi) - A single metric that the business can use to measure
and report our progress on Quality
Section 4.03 : Solutions Explained
Implementation Approach
▪ Implementation will be a two-phase approach for both AW4SW & AW4ST
▪ Phase I objective is to achieve & validate AW4SW/T Level 1 & 2 maturity
▪ Phase II planning will start in 2019
▪ If Development teams want, they could start their journey towards achieving higher maturity at their own pace
▪ Teams do not have to wait until 2019 for higher level maturity implementation planning
SME Workshops
Survey Kiosks
Influencers
Section 4.05 – Dealing with Project Risk
Source : PMI
Stakeholder Category Resistance Expected ?
Management Stakeholders
Resistance
Stakeholder Anticipated ? Resistance Detected ? How we addressed it ! Evidence of success
YES – means more - Teams involved at each given solution planning cycle Each studio adopted the processes with much
Game Development
( All Included )
work/processes for YES - Buy-in’s documented & sought after ease, thanks to all the trainings, pilot projects,
them to adhere to. - Captured their concerns and ideas to resolve resistance workshops, work done by Quality Influencers.
YES – means more - Teams involved at each given solution planning cycle Each team adopted the processes with much
Systems work/processes for YES - Buy-in’s documented & sought after ease, thanks to all the trainings, pilot projects,
them to adhere to. - Captured their concerns and ideas to resolve resistance workshops, work done by Quality Influencers.
Hardware
Engineering
NO NO NA NA
YES – means more - Teams involved at each given solution planning cycle Each team adopted the processes with much
Technology,
Platform, Digital
processes & tedious YES - Buy-in’s documented & sought after ease, thanks to all the trainings, pilot projects,
review / audit process - Captured their concerns and ideas to resolve resistance workshops, work done by Quality Influencers.
YES - This was an unexpected resistance, Received ample amounts of positive feedback from
This was addressed by involving key stakeholders from commercial team customers and commercial sales to showcase the positive
Commercial Sales NO team was concerned about the increase in in few pilot projects with optimized PM plans in place to address their impact being brought in by the new processes
time to market and possible delays concerns regarding time to market. introduced. Backed by reduced field issues
Customer / Player NO NO NA NA
SAMPLE
Section 4.07 : Stakeholder Involvement in the Project
- Acted as a team member in solution generation workshops during yearly - All technical leads and engineers participated actively in the
- Technical Leads Quality Summits
implementation workshops
Systems - Directors - SME workshops, Trainings, Email engagements, Quality Newsletter
- Saw very healthy participation and early positive feedback
Updates.
- Workstream Heads - Involved with multiple Pilot Projects / Audit Rollouts / Loop Backs coming in during pilot projects, Audits, timely QAR’s
- Acted as a team member in solution generation workshops during yearly - Saw active support to studios for all pilot projects and accelerated help
- Directors Quality Summits extended during later stages of product development
Hardware Engineering - Process Leaders - Measure feedback and impact of hardware planning deliverables and - Conducted trainings related to hardware engineering subject for studio /
related timelines on product quality / software ( intrinsic or extrinsic ) software technology teams to help them understand the underlying
- D&D Engineers - Establish open channel of communication with studios & others. hardware support better
- Acted as a team member in solution generation workshops during yearly - All technical leads and engineers participated actively in the
- Technical Leads Quality Summits
implementation workshops
Technology, Platform, Digital - Directors - SME workshops, Trainings, Email engagements, Quality Newsletter
- Saw very healthy participation and early positive feedback
Updates.
- Workstream Heads - Involved with multiple Pilot Projects / Audit Rollouts / Loop Backs coming in during pilot projects, Audits, timely QAR’s
- Acted as a team member in solution generation workshops during yearly - ATF’s were involved with better test-delivery planning
3rd Party / Accredited Test - Key Account Managers ( Technical ) Quality Summits
- They acted as parallels while implementing new strategies and
- SME workshops, Trainings, Email engagements, Quality Newsletter
Facilities ( ATF’s ) - Technical Leads Updates implemented their own versions of similar initiatives
- Knowledge sharing platforms created for timely information passing - Continuous engagement model rolled out to ATF’s
- Acted as a team member in solution generation workshops during yearly - New communication channels created and saw more
- Business Unit Heads Quality Summits
streamlined communication
Order Fulfillment - Involved with conducting and attending workshops to understand,
- Middle Management convey role of order fulfillment verticals in overall delivery of the - Timely updates between stakeholders
product to the customer and it’s impact. - Delivery Triages
- Technical Leads - Acted as a team member in solution generation workshops during yearly - Regular Workshops conducted to train / get trained with new
Quality Summits
Tech Services - Lead Field Service Rep’s - Involved with 2 way workshops and brainstorming sessions to improve
resources, product releases
- Business Unit Heads quality of services and internal support upstream. - Introduction of enhanced interoperability testing charter
- Acted as a team member in solution generation workshops during yearly - Rolled out better engagement models for direct
- Regional Sales Heads Quality Summits
communication
Commercial Sales - Involved with 2 way workshops and brainstorming sessions to improve
- Key Account Manager(s) channel of communications with all required stakeholders and better - Regular trainings, SME workshops, travel opportunities,
insights into the technology side of challenges and processes. stakeholder meetings, etc.
Implications on Results :
• Fewer Field Issues = Lesser Reworks
• Lesser Reworks = Optimized Cost of
Quality
• Lesser Reworks = Better Rework to
Approval (R2A) Ratios
• Happier Customers
• Portraits strengthened Culture of
Quality
ATI
23% Improvement
YTD
SECTION # 5.03 : Solution Justification | Validation
50% Improvement
SECTION # 5.04 : Additional Benefits Realized in the Process
CONTINUOUS ENGAGEMENT
Description Frequency