Analytics QA Manager

What Youll Be Doing (position summary):

The role works with minimal direction, applying deep knowledge in their field of expertise to manage the execution of analytics QA tasks, best practices and processes including functional testing, release testing, automation testing and support activities. The Analytics QA Manager Digital Platforms & Operations uses significant review tactics in testing requirements, determining testing objectives and leads documentation efforts to organize test results and defects, while establishing and maintaining senior management, and Squad/Product Owner relationships. In addition, the role provides status updates and progress reports to Squad/Product Owners to manage expectations related to scope and timeline constraints.

How Youll Succeed (responsibilities):

Analytics QA Delivery and Test Management:

• Partner with Squad/Product Owners to gather and clarify complex business requirements and support solution design discussions to ensure testing aligns with project objectives.
• Develop and validate test case documentation, including scope clarification, solution requirements, and quality assurance outcomes, to support high-quality delivery.
• Execute test cases across web and mobile applications, including Android and iOS platforms, to identify defects, gaps, and implementation issues through manual and automated testing.
• Review testing requirements and determine testing objectives to ensure analytics implementations meet business, functional, and quality expectations.
• Leverage deep knowledge of Adobe Analytics, AEP rule testing, and AJO requirements, implementation, and testing to ensure analytics solutions are accurate and complete.

Defect, Release and Production Support:

• Manage and prioritize a backlog of defects to ensure issues are resolved efficiently and communicated clearly to stakeholders through to closure.
• Use HP ALM and JIRA to document, track, organize, and monitor defects and test outcomes for effective issue management and reporting.
• Support release testing activities to validate readiness and ensure analytics implementations perform as intended before and after deployment.
• Conduct investigations and coordinate resolution of production issues, with developer support where required, to minimize business disruption and maintain platform integrity.
• Automation, Monitoring and Data Quality Assurance
• Leverage ObservePoint to create and monitor online and mobile banking journeys in production to validate analytics requirements.
• Analyze ObservePoint results to ensure the accuracy, completeness, and compliance of client data across digital platforms.
• Apply strong attention to detail and critical thinking to identify issues that may impact data quality, recognizing the role as a key control point in analytics validation.
• Recommend enhancements to QA processes, automation approaches, and testing practices to improve operational efficiency and effectiveness.

Stakeholder and Chapter Collaboration:

• Build strong, trusted relationships with Squad/Product Owners, Chapter members, business stakeholders, and technology partners to support successful project delivery.
• Provide clear and proactive status updates and progress reports to stakeholders to manage expectations related to scope, timelines, and risks.
• Collaborate with the Chapter Lead to provide visibility into team status, capacity, priorities, and blockers, and support timely issue resolution.
• Help internal partners make informed decisions regarding program, product, and service development by providing quality assurance insight and practical recommendations.
• Negotiate deliverables and milestones, where necessary, to support effective execution and alignment across teams.

Financial and Operational Support:

• Collect and consolidate monthly team financial information, including estimates, actual charges, and burndown data across digital and partner projects, to support tracking and reporting.
• Support team capacity management against Squad needs to ensure resources are aligned to delivery priorities.
• Lead daily standups and serve as the first point of contact for team escalations to ensure timely communication and coordination of work.

People Management:

• Set appropriate context when assigning work to ensure that individuals roles support the achievement of the business units priorities and CIBCs overall goals.
• Build team and individual capabilities by providing development opportunities such as job shadowing, special projects, and training.
• Manage performance by providing fair and accurate formal and informal feedback, identifying and removing obstacles to performance and by explaining how performance expectations align with business priorities.
• Ensure compliance with policies, standards, guidelines and controls by applying the policies and controls fairly and consistently so employees understand what to expect.

CROSS-FUNCTIONAL RELATIONSHIPS:

• Develop trusted working relationships with business stakeholders and technology partners, including the assigned Squad and Chapter, as well as other Squads, Chapters, and Crews.
• Collaborate with Squad/Product Owners to gather requirements, clarify scope, and align QA activities to business needs.
• Work closely with developers and technology partners to investigate issues, resolve defects, and support production incidents.
• Partner with the Chapter Lead, Digital Platforms & Operations to support team effectiveness, employee development, and delivery execution.
• Interact with internal partners to provide insight that supports decision-making related to programs, products, and services.

COMPLIANCE REQUIREMENTS/RESPONSIBILITIES:

• As an employee of CIBC, the incumbent must comply with all applicable CIBC and Line of Business policies, standards, guidelines and controls.
• As a manager of people, this job must ensure all employees within the business unit comply with all applicable CIBC and Line of Business policies, standards, guidelines and controls.

AUTHORITIES/DECISION RIGHTS:

• As a key contributor to the business unit, this job has the authority to recommend changes to business processes in order to enhance operational efficiency and effectiveness.
• As a manager of people, this job has the authority to assign tasks to employees within their span of control, select individuals for hire, assess individual performance, make employee compensation decisions and take disciplinary measures up to and including termination.

JOB DIMENSIONS:

• Direct people management responsibility for the Analytics QA team.
• Accountability for analytics QA activities supporting digital platform initiatives across web and mobile channels.
• Responsible for coordinating testing delivery, defect management, and production support across multiple projects and stakeholder groups.
• Supports monthly consolidation of team financials, including estimates, actuals, and burndown tracking across digital and partner initiatives.
• Scope includes collaboration across Squads, Chapters, Crews, business stakeholders, and technology partners.

Who You Are (skills/qualifications):

• Strong knowledge of analytics QA practices, methodologies, and controls across digital platforms.
• Deep understanding of Adobe Analytics, AEP rule testing, and AJO requirements, implementation, and testing.
• Knowledge of functional testing, release testing, automation testing, defect management, and production support processes. Good understanding of Agile delivery methodologies and project team execution models.
• Knowledge of web and mobile application testing, including Android and iOS environments.
• Familiarity with financial services environments and controls is preferred.

Must Have Skills:

• 6+ years of relevant experience in analytics QA, digital testing, or a related quality assurance discipline.
• 35 years of people management experience leading teams, ideally in financial services and in a QA management environment.
• Strong leadership and coaching skills, with the ability to support employee performance, development, and career growth.
• Excellent verbal and written communication skills, with the ability to convey factual and conceptual information requiring explanation and interpretation.
• Strong stakeholder management and relationship-building skills across business and technology teams.
• Proven ability to lead daily standups, coordinate team activities, and provide clear, proactive status reporting.
• Strong analytical and critical thinking skills, with exceptional attention to detail and a focus on data quality.
• Demonstrated ability to work proactively, resolve issues independently where possible, and escalate appropriately when needed. Strong collaboration and negotiation skills to align teams on deliverables, priorities, and milestones.
• Project delivery experience working within Agile teams.
• Experience using JIRA, Confluence, SharePoint, HP ALM, and ObservePoint.

Good to Have:

• 5+ years of management experience leading teams in a QA environment. Broader experience in financial services digital analytics and quality assurance leadership.