Back
Senior Data Scientist
Full-time
The CommSec Data and Insights Centre of Excellence is a central Data and Analytics function delivering data, advanced analytics and data science across the CommSec business. You'll join the Insights and Decision Science Chapter, at the forefront of data, AI and customer insight innovation including GenAI and agentic AI.
In This Role
As a Senior Data Scientist within the Customer Care – Hey CommSec & GenAI Squad, you will help shape and improve CommSec's customer-facing GenAI and agentic AI capabilities. You will evaluate chatbot performance, generate insights and identify opportunities to improve experiences that retrieve digital content and provide customers with relevant portfolio insights. You'll work closely with Software Engineers, Product Owners, SMEs, Legal and Risk partners to turn analysis into practical improvements across agent design, prompting, retrieval quality and customer experience.
Responsibilities
Design and maintain evaluation metrics, test datasets and frameworks for GenAI and agentic AI solutions.
Analyse chatbot interactions, model behaviour and evaluation results to understand performance, quality and customer impact.
Use Python to develop repeatable analysis, testing and reporting workflows.
Provide clear, actionable recommendations to improve AI performance, usefulness and customer outcomes.
Support scalable monitoring and quality assurance practices for AI-powered customer experiences.
Communicate findings clearly to technical and non-technical stakeholders.
What We're Looking For
Experience applying data science, advanced analytics or machine learning to solve complex business or customer problems.
Strong Python skills, with experience analysing data and developing repeatable analytical workflows.
Practical experience or strong interest in GenAI, LLMs, RAG, Agentic AI, prompting and model evaluation.
