DATA ENGINEERING MANAGER (Python, SPARK, AWS)
LONDON
BETWEEN £90,000 - £105,000
This vacancy is an excellent opportunity to join a highly complex data environment. The current Data Engineering team are processing petabyte scale data from a variety of internal and external sources. The current tech stack in production involves Python, Spark, AWS (Lambda, S3, Kinesis, Terraform) and Kafka. The client is a leading retailer.
COMPANY:
The company has a number of squads associated to the various product streams that generate profit. Whilst each separate product stream operates with a certain degree of autonomy, they have an enterprise wide data lake upon which you will be working. For example they operate high street retail stores in addition to holding a credible banking presence. The scale of data at the companies disposal make it a fascinating data engineering environment to be working in.
ROLE:
- Managing a team of 10 Data Engineers to deliver projects
- Data pipeline creation using PySpark
- Streaming projects utilising Kinesis & Kafka
- Influencing best coding practices such as Test Driven Development
SKILLS & EXPERIENCES:
- Commercial exposure to PySpark and AWS
- Strong communication skills to interact with the wider team
- Adherence to best coding practices
- Previous line management experience
HOW TO APPLY:
Please register your interest by sending you CV to William Wrigley via the apply link on this page