Senior Data Engineer

The Senior Data Engineer is responsible for transforming the Analytics into deployed applications to help deliver the organisations product led vision and shape the business of the future. Collaborating with the Head of Data Science, Head of Research, Product team and other parts of the business to create industry-leading products, developing and testing architectures that enable data extraction & transformation at scale ensuring the successful growth of our technology leading portfolio.

Responsibilities

• Leading the building of fully automated reusable data pipelines and operationalising them
• Optimise code to ensure processes are robust, efficient, and scalable
• Lead work on database management
• Improve existing processes when new data or techniques are available
• Provide insight on the feasibility of ideas to ensure that the best quality products are created
• Provide advice to the rest of the company on data engineering topics

Experience & Knowledge

• Proven track record of working as Data Engineer in a commercial setting, contributing to a high performance culture within the wider data engineering team
• Experience in building and maintaining reliable and scalable ETL on big data platforms
• Understanding and application of database design best practices
• Experience working with varied forms of data infrastructure inclusive of relational databases such as SQL, Hadoop, Spark and column-oriented databases such as Redshift, MySQL, and Vertica
• Proven, hands-on advanced Python programming experience required (experience of other languages such as 'R' preferred
• Experience with Git-based version control systems
• An understanding of standard design patterns and where they are best used
• Experience with common software containerization tools (e.g., Docker, Kubernetes)
• Experience developing data pipelines with workflow orchestrations tools
• Experience with CI/CD tools
• Experience of working in a fast moving, high growth business would be advantageous
• Demonstrates a natural product mindset - offering scalable customer solutions
• A relentless learner who continually demonstrates a growth mindset
• Positively questions the status quo in order to achieve a better outcome
• A creative thinker with the ability to work in an agile environment
• Works well under pressure, able to make good judgements and decisions
• Keeps on top of industry developments and trends and shares knowledge with wider teams
• Can influence at all levels and builds credible external networks
• Resilient and tenacious, able to work at pace and adapt to change

Vibe Recruit is acting as an Employment Agency in relation to this vacancy.