ISTQB Certified Tester: Advanced Level Test Automation Engineering

Module 1: defining test automation objectives

• The purpose, benefits, business effectiveness and limitations of automation in IT projects.
• Aligning automation with different software lifecycle models: sequential, iterative and Agile.
• The direct impact of system under test (SUT) architecture on the relevance and technical feasibility of script suites.

Practical work

• Assess the suitability and define the scope of an automation strategy for a target application infrastructure.

Module 2: preparing infrastructure and selecting tools

• Configuration and infrastructure requirements for initiating and sustaining tool implementation.
• Deploying and operating test tools in separate virtualised or physical execution environments.
• The evaluation process and selection criteria for appropriate automation tools and strategies.

Practical work

• Analyse technical architecture constraints to select the most viable tooling solution.

Module 3: designing the test automation architecture

• Analysing the major capabilities and layers of the generic test automation architecture (GTAA).
• Logical structure of a modern framework: definition, generation, adaptation and execution layers.
• Comparing automation approaches: linear, structured, data-driven and keyword-driven scripting.
• Applying fundamental software design principles and design patterns to streamline testware.

Practical work

• Model the hierarchy and multilayer architecture of a scalable, modular automation framework.

Module 4: implementing and managing the automation project

• Strategic planning and operational implementation of a test automation pilot.
• Detailed analysis of solution development risks and definition of mitigation plans.
• Organisational and technical factors that support or hinder future solution maintainability.

Practical work

• Develop a roadmap and risk management plan for launching a pilot project.

Module 5: deploying continuous integration strategies (CI/CD)

• Mechanisms for integrating and orchestrating automated test suites in CI/CD continuous delivery pipelines.
• Configuration management and version control for all testware components.
• Specific automation requirements for APIs, contracts, command-line interfaces and user interfaces.

Practical work

• Integrate and automate the triggering of a valid test suite within a continuous integration pipeline.

Module 6: analysing execution reports and collecting metrics

• Identifying sources of raw data about the system under test (SUT) and test solution.
• Classifying and analysing metrics to measure operational effectiveness and strategy quality.
• Using execution reports and configuring visual dashboards to inform stakeholders.

Practical work

• Structure a decision-support dashboard and interpret coverage metrics from a test campaign.

Module 7: verifying and validating the automation solution

• Verifying test environment conformity and the configuration of associated tools.
• Checking the behavioural correctness and results of a test script or complete execution suite.
• Detecting unexpected behaviour, isolating false positives and conducting root cause analysis (RCA).
• Using static code analysis to assess and safeguard the intrinsic quality of automation code.

Practical work

• Diagnose a complex test failure, isolate the anomaly in logs and apply static analysis.

Module 8: driving continuous improvement and optimising testware

• Identifying opportunities to consolidate, refactor and streamline existing test architectures.
• Implementing processes to evolve and upgrade an automation solution and its components.
• Using generative AI to assist script rewriting, documentation and optimisation.
• Comprehensive review of key v2.0 syllabus concepts and practice with mock examination questions.

Practical work

• Optimise an ageing test suite with AI tools and complete a full timed mock examination.