Connecting...

Senior Data Engineer

Job Title: Senior Data Engineer
Contract Type: Contract
Location: Melbourne
Industry:
Salary: Competitive
Start Date: 2020-08-18
Reference: JO-2008-541772
Contact Name: Melissa Haddah
Contact Email: melissa.haddad@talentinternational.com
Job Published: August 18, 2020 08:52

Job Description

  • 6 month initial contract +
  • WFH
  • Attractive daily rate

About the role

Develop, maintain and improve data solutions to support customer-focussed digital platform whilst always improving data management capabilities.

 In this role, you'll:
  • Develop software to solve business problems with data
  • Build in quality via TDD and pair /mob programming
  • Help keep solutions as simple and clean as possible
  • Conduct experiments in spikes to help guide design
  • Collaborate with other engineers to integrate between systems
  • Contribute to sensible defaults, engineering patterns and principles etc.
The tech stack
AWS, Snowflake, Kafka, Apache Airflow, Uber Cadence, Python, Scala, DBT,
The architecture is based on a Gated Data Lake pattern, with clearly segregated Data Ops for operational processes and Data Enrichment for analytical processes including reporting, machine learning and deep learning. At a high level, Data Enrichment platform is composed of infinitely scalable analytic projections that are entirely built with code based pipelines, while our DataOps platform is stateless and containerised for moving data around in real-time based on events or on a schedule.

Ideally, we're looking for
  • Advanced skills in Python
  • Docker (All our deployments and development infrastructure is Docker)
  • All things AWS
  • Extensive expertise in the development, design and integration of data solutions
  • Thorough understanding of Big Data concepts and Event based architectures
  • Develop high-quality code via TDD and pair programming
  • Hands on experience with Git, preferably GitHub flavoured and workflows like Gitflow
  • Provide systems analysis, solution design and R&D activities
  • Demonstrated experience working in an agile delivery team
  • Design of scalable systems in cloud (AWS is desirable)

Apply today!
For more information contact Aman Singh at aman.singh@talentinternational.com