Data Engineer (Data Quality) Location: UK Category: Data Management & Engineering Type: Permanent Job Reference: 1214 Apply Sorry, this advert is now closed. Click here to view our live vacancies. Data Engineer (Data Quality) - Media/Marketing - London - £50,000 to £60,000 Join one of the leading Digital Media Analytics agencies and become part of a team of technical innovators as they expand on their incredibly impressive data capabilities. Drawing from dozens of sources across varying media platforms, they are now looking to deploy advanced big data solutions to further expand on the client offering and top tier data outputs. This person will take ownership of the data pipelines, working with tens of thousands of events per day and making sure that all of the data is in the right place for analytics and insights teams across the business. Collaborate with stakeholders to ensure that the data is in the right place and right condition to allow for data science and machine learning to take place. Manage efficiency, cost tracking, and implement monitoring systems to get this done. The teams works predominantly in Pyspark, so experience with Python / Spark / Scala would be great. All of the pipelines are based on AWS, so you'll need experience working on that platform, Azure or GCP and any Big Data and ETL expertise would be fantastic. The pipelines are orchestrated in Airflow so if you've used this tool before, or are looking to expand your skills in this space, apply! Role: Data Quality Engineer Location: London Salary: £50,000 to £55,000 Qualifications and Experience AWS, GCP or Azure SQL, Python, Spark / Pyspark Airflow would be beneficial Big Data and ETL For further information please contact: Connor Perry Consultant - Blue Pelican Data & Analytics Connor@bluepelican.com You can view all our vacancies on our web site www.bluepelican.com, or call and ask for the Data Team.