Data Engineer - Big Data
We are working on a superb new Data Engineer opening for a rapidly expanding big data and data analytics software company in the heart of Sydney.
You will be working on creating and extending data pipelines consuming significant amounts of unstructured data - converting and loading into their data lake for the Data Science team to make sense of.
Strong SQL experience is critical and you will be used to scripting, ideally with Python but any OO language, Java, Scala etc. is fine.
Due to the data volumes, any previous experience with distributed systems or databases would be beneficial; similarly, any Cloud understanding - Azure, AWS, Google Cloud is a big bonus.
You will use Pyspark and Pandas for data manipulation so any knowledge across these tools is ideal. They are using Google Big Query and AWS Athena for data analysis.
The role offers freedom, autonomy and serious input into what is an absolutely critical area of the business.
Do you eat, breathe and sleep with data? Do you know the difference between an Engineer and a Scientist, and between reporting and an analyst? Do you get excited when you hear about forecasts, dashboards, performances and reporting? Of course, this isn’t enough to be a Data professional. We would like to see terms like SQL, Python, R, HTML, SAS, Tableau, Informatica, Hadoop, Data Analyst, Data Engineer or Data Scientist in your resume.
This is a great career opportunity, after starting in Sydney only 6 years ago and now operating in over 7 different countries this is a real opportunity to part of a growing business who pride themselves on being the best at what they do. On offer are a great package, ongoing training and support and the real opportunity to move into a senior role and work with the latest tech.