We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems.
For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for efficiency by aligning data systems with business goals.
To succeed in this data engineering position, you should have strong analytical skills and the ability to combine data from different sources.
Data engineer skills also include familiarity with several programming languages.
If you are detail-oriented, with excellent organizational skills and experience in this field, we’d like to hear from you.
Big data processing / ETL pipelines
Cleansing, parsing and standardising global datasets
Entity extraction / resolution
Pre-packaged code for processing and utilising third party data sources
Efficiency / performance improvements through big data testing
Requirements and skills
We’re looking for individuals who have proven big data experience, either from a software deployment / implementation or a data science perspective
Knowledge of at least one big data technology such as Spark, Hadoop or Elasticsearch
A strong coding background in either Java, Python or Scala
The desire to learn and code in Spark / Scala
Experience working in an Agile environment
Experience of building data processing pipelines for use in production batch systems, including either traditional ETL pipelines and / or analytics pipelines
Experience in manipulating data through cleansing, parsing, standardising etc, especially in relation to improving data quality / integrity