Principal Data Engineer (AWS)
You are passionate about solving complex problem with the latest tech
We're the largest and most advanced Data Engineering teams in the country.
Together we build tomorrow’s bank with world class engineering
Do work that matters
The Capital Provisioning Modelling Crew builds and runs the platforms that support how credit risk models are developed, validated, implemented, and monitored aligning to the Model Development Lifecycle Methodology (MDLC), processes, and procedures. The outcomes produced by these models are used in managing the Group Risk Management functions including front line business processes as well as for regulatory reporting including loss provisioning, portfolio analysis, and reporting.
These are critical, model-driven systems operating under regulatory scrutiny, where accuracy, control and reliability are essential.
As a Principal Engineer, you will shape the engineering direction for platforms that enable data consumption, model execution and deployment at scale, while meeting strong governance and control requirements.
See yourself in the team
You’ll be part of the Capital Provisioning Modelling Crew, working across credit risk modelling, data and platform engineering.
The crew focuses on:
Consuming trusted data from enterprise data marketplace
Enabling model execution and orchestration at scale
Supporting SageMaker-based model deployment and ML workloads
Driving modernisation and decommissioning of legacy and sandpit environments
Delivering efficiencies into the framework and tools that can help deliver the models in a safe, sound, and secure way
Embedding controls, lineage and auditability by design
As a Principal Engineer, you will
Define and drive platform strategy for capital provisioning modelling
Architect and build cloud-native platforms (AWS) supporting model and data workloads
Provide thought leadership and contributes to the design of technical solutions and consumption patterns, including data security and data management.
Design solutions that consume and operationalise enterprise data marketplace assets
Lead engineering patterns for model and ML deployment, orchestration and monitoring
Drive migration from legacy platforms to strategic, governed environments
Ensure alignment with Model Risk Management, regulatory and audit requirements, including:
Data lineage and traceability
Reproducibility of model outputs
Strong controls and validation
Partner with modelling teams to productionise models and improve reliability and performance
Influence architecture and engineering decisions across crews and domains
Set and uplift engineering standards and practices
Mentor engineers and contribute to a high-performing engineering culture
We’re interested in hearing from people who
Have strong experience building cloud-native data and model platforms at scale
Have experience productionising models or ML workloads
Have experience in building frameworks and tools that can significantly improve engineering productivity
Understand data integrity, reconciliation, and accuracy in financial systems
Can influence across teams and align stakeholders on technical direction
Have a natural drive to educate, communicate, and coordinate with different internal stakeholders and consultants.
Are comfortable balancing technical debt with long-term platform strategy
Technical experience
We use a broad range of tools, languages, and frameworks. We do not expect you to know them all but experience or exposure with some of these, or a willing to learn these skillsets (or equivalents) will set you up for success in this team!
AWS (S3, EMR, Glue, Lambda, Redshift, SageMaker or similar)
Snowflake or enterprise data platforms / data marketplace patterns
Python, PySpark and distributed data processing
Batch and streaming data pipelines (e.g. Airflow, Spark, Glue)
CI/CD, automated testing and infrastructure-as-code
Observability, monitoring and reliability practices
Strong SQL and relational database experience
Working with us
Our people bring their diverse backgrounds and unique perspectives to build a respectful, inclusive, and flexible workplace with flexible work locations. One where we’re driven by our values, and supported to share ideas, initiatives, and energy. One where making a positive impact for customers, communities and each other is part of our every day.
Here, you’ll thrive. You’ll be supported when faced with challenges and empowered to tackle new opportunities. We’re hiring engineers from across all of Australia and have opened technology hubs in Melbourne and Perth. We really love working here, and we think you will too.
We support our people with the flexibility to balance where work is done with at least half their time each month connecting in office. We also have many other flexible working options available including changing start and finish times, part-time arrangements and job share to name a few. Talk to us about how these arrangements might work in the role you’re interested in.
If this sounds like the role for you then we would love to hear from you. Apply today!
If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.
We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.