Job Search / Engineers

Data Engineer

Job Details

Job Type
Melissa Haddah
3 months ago
  • 3 month contract +
  • WFH
  • Large organisation

The role of Data Engineer involves leading complex business reengineering development projects and to solve organizational problems through IT solutions using Big Data concepts, Platform tools and software engineering languages as required.

Key Responsibilities include:
* Designing, developing and implementing solutions to customers organisational problems;
* Providing high quality service delivery on engagements;
* Designing and developing data reconciliation & metadata driven data processing frameworks;

Key Skills & Experience required:
*Minimum 2 years previous experience as a Data Engineer;
*2+ years of AWS hands on technical experience;
*2+ years experience in programming eg. Core Java/Python/Scala programming;
*2+ years experience in Hadoop Stack eg. Hive, Spark (Core and Streaming), Kafka, Flink, NIFI;
* Experience working on stream transform using Spark Streaming or Flink;
* Experience working on change data capture in a big data ecosystem;
* Experience in building real time or batch ingestion and transformation pipelines;
* Experience supporting a production service in a DevOps friendly environment;
* Experience working in Agile/Scrum teams;

Advantageous skills:
* Hands on experience in API and cloud-native architecture;
* Experience with Github and Jenkins;
* Experience with 'container' technology (e.g. Docker, Kubernetes);
* Experience wrangling data using library such as Pandas, Scikit-learn or Numpy;
* Experience using notebook such as Jupyter or Polyglot;
* Experience with test-driven development, test automation & continuous delivery;
* Experience in Java build automation technologies such as Gradle, Maven, Integration with Sonarqube etc.
* Understanding of Financial Services Industry could be advantageous;

Apply today!

For more information contact Melissa Haddad on 92367732 or email

Expired job