Big Data Engineer

Brook Street
300.00 - 450.00 GBP Daily
15 Mar 2019
27 Mar 2019
Contract Type

Big Data Engineer

6 month contract

Day rate - up to GBP450 a day

Role Description

Our clients BI team is expanding! We are looking for an experienced Business Intelligence Engineer to join our crew. Do you have strong Big Data/Hadoop skills? Are you experienced with data services within Azure? Are you ready to tackle a variety of challenges around data structuring and transformation? Please get in touch to find out more.

Key Responsibilities

  • Design, implementation and test for a range of data pipelines, applying structure to unstructured data and carrying out various transformations.
  • Configuration and set up of specific data services within Azure, to ensure suitability and alignment with the rest of the stack.
  • Documentation of architecture and data flows, ensuring a clear, maintainable stack going forward.
  • Responsibility for compliance with organizational policies and privacy requirements.

Candidate Requirements

  • Deep knowledge of SQL and Hive.

  • Relevant experience with Azure, specifically ADF, HDInsights, and Databricks.
  • Demonstrated experience with data infrastructure design