Data Engineer Location: UK Category: Developer/Engineer Type: Permanent Job Reference: 2083 Consultant: stuart.daniel@bluepelican.com Apply Sorry, this advert is now closed. Click here to view our live vacancies. Data Engineer Big Data, AWS, Python, Hadoop, SQL, NoSQL £60,000 - £80,000 + package This Insurtech company have developed modern technology solutions for the automotive insurance sector. We now have an exciting opportunity for a skilled Data Engineer to join the expanding Analytics team! You'll need to be comfortable developing a data pipeline that can adapt to the needs of the organisation, especially with experience of building and optimising ‘big data’ data pipelines, architectures and data sets. You'll also need: ● Experience performing root cause analysis ● Experience working with unstructured datasets and the ability to build processes supporting data transformation, data structures, metadata, dependency and workload management. ● A successful history of extracting value from large disconnected datasets. ● Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores. Software / Tools: ○ Deep understanding of AWS services like S3, Redshift, EMR, Kinesis, and Glue, used for data storage and processing. ○ ETL Processes: Particularly in an AWS environment using AWS Glue or Data Pipeline. ○ Big Data Technologies: Hadoop and Spark, and how they integrate with AWS services like EMR. ○ Programming Languages: Python, Java, or Scala. ○ SQL and NoSQL Databases: SQL for querying relational databases like Amazon RDS and NoSQL databases like DynamoDB. ○ Data Modelling: In data warehousing solutions like Amazon Redshift. ○ Streaming Data: Experience with real-time data processing using AWS services like Kinesis or managed Kafka. ○ Data Security: Understanding of data encryption, IAM roles within AWS. ○ DevOps: Including CI/CD, and tools like Terraform, Cloudformation, AWS CodeBuild, CodeDeploy, and CodePipeline. ○ APIs: Knowledge of RESTful API interactions, especially within the AWS ecosystem. Experience: You'll need approx. 5+ years of experience in a Data Engineer role. Experience working within the insurance industry would be perfect but not essential. Experience working with cross functional teams, great communication skills able to convey technical concepts clearly. Hybrid working. 2-3 days working from home, the rest in the office which is based in Moorgate, London. Please send your CV for immediate consideration. To learn more about this role, please apply or contact Stuart directly on stuart.daniel@bluepelican.com How to apply If this position is of interest please send us your CV here, or you can call Stuart Daniel direct on to discuss this and other vacancies that may suit. Stuart Daniel Email: stuart.daniel@bluepelican.com