Data Engineer

An excellent opportunity exists to join an award winning, high growth organisation.

The Data Engineer is responsible for taking initial ideas, concepts or manual processes and developing these into fully automated products. Reporting into the Lead Engineer and working collaboratively as part of a cross-functional team and the wider organisation, supporting the business in delivering the product led vision and shaping the business for the future.

Responsibilities

• Producing data pipelines that follow coding standards, ensuring that they are robust, well documented and thoroughly tested
• Designating data storage and management solutions that will scale with the future growth of the business, demonstrating a clear understanding of the needs of the business and ensuring that the work completed is aligning with the organisation's overall goals
• Working with the Product teams to translate product requirements into technical specifications, leading on larger development projects and delivering these with autonomy
• Engaging with the Agile approach to work
• Participating in code review to ensure quality of work delivered by the team is high.
• Proactively keep up to date with development trends and researching new and innovative approaches, ensuring that any suggestions for change are presented and clearly articulated to ensure that the business is set up for success for the future

Skills, Knowledge and Experience

• Experience with Python in a professional environment.
• Experience with SQL queries and database design
• Understanding of the fundamentals of processing raster and vector data
• Excellent attention to detail and a high level of organisational ability, able to manage a varied
• workload and meet deadlines and react to changing priorities
• A natural product mindset - developing and delivering robust and scalable customer solutions
• Some experience working with workflow orchestration tools such as Prefect or Apache Airflow
• Some experience working with parallel processing frameworks such as Dask or Apache Spark
• Experience with DevOps tools like Docker or Kubernetes
• Experience with version control tools such as Git or Bitbucket
• Experience of Agile and Kanban working practices and some exposure to working in a fast moving, high growth SaaS business

Vibe Recruit is acting as an Employment Agency in relation to this vacancy.