Connecting...

Big Data Engineer

Job Title: Big Data Engineer
Contract Type: Contract
Location: Sydney
Industry:
Salary: $590 / day
Start Date: 2020-03-30
Reference: JO-2003-539198
Contact Name: Petrina Hudson
Contact Email: petrina.hudson@talentinternational.com
Job Published: March 30, 2020 15:05

Job Description

  • Big Data Engineer
  • Global Consultancy Firm
  • $590 / day

Technical Qualifications 
  • Spark Streaming essential!! 
  • Solid experience on design patterns to implement strategic, tactical and operational products spanning across all disciplines of BI and Analytics including data ingestion, integration, modeling, performance acceleration, visualisation etc
  • Solid functional understanding of the Open-Source Big Data Technologies including major Hadoop projects, Kafka, NiFi, NoSQL Databases.
  • Experience working on Spark Streaming
  • Preferable work experience with Hortonworks distribution and Azure cloud platform
  • Proficient with HDFS, Hive, HBase, NiFi, Kafka, Spark and SQL
  • Experience in Azure cloud platform is desirable
  • Expertise in various connectors and pipelines for batch and real-time data collection/delivery
  • Database design and modelling - logical and physical
  • Performance tuning - table partitioning and indexing, process threading
  • Support multiple Agile Scrum teams with planning, scoping and creation of technical solutions for the new product capabilities, through to continuous delivery to production.
  • Detail oriented with strong analytical and problem-solving skills
  • Knowl1edge of API protocols and development methodologies
APPLY NOW!

Get similar jobs like these by email

By submitting your details you agree to our T&C's