Senior Data Engineer

Introduction

Product Group is responsible for the design, development, and delivery of the BBC’s portfolio of digital products.

Including iPlayer, Sounds, Bitesize, and the BBC News and BBC Sport apps and website, our portfolio is diverse and contains some of the largest and highest-profile properties on the UK internet. We’re a huge streaming media destination, a news source trusted across the world, a provider of educational and entertaining content to children of all ages, and a sports results, analysis, and commentary service, and much more besides. It's an unparalleled portfolio of products, and our strength is our range and breadth. Working with the BBC’s content divisions, our focus now is on driving engagement across our portfolio so that the BBC online becomes a valued daily habit for all audiences just as television and radio have been over the last century.

Data is fundamental to our future: both in helping us prioritise and shape our work and in creating richer, more personalised experiences for our audiences. And our portfolio means that we’ve got one of the widest, most diverse, and most exciting datasets to work within the UK.

Role Responsibilities

The Senior Data Engineer is a new role that will support the newly created Product Data Domain teams. You will help to build ETL pipelines to ingest and transform data to develop the data products that will power key value use cases across the BBC. You will work in an agile multi-disciplinary team alongside product analytics developers, product data managers, data modelers and data operations managers, ensuring that all work delivers maximum value to the BBC.

Role and responsibilities will comprise of:

Working with leads and architects on developing robust · Working with Leads and Architects on developing robust and scalable data pipelines to ingest, transform, and analyse large volumes of structured and unstructured data from diverse data sources. Pipelines must be optimised for performance, reliability, and scalability in line with the BBC’s scale. · Contributes to initiatives to enhance data quality, governance and security across the organisation, ensuring compliance with BBC guidelines and industry best practices. · Breaking down stakeholders requirements into smaller tasks and identify the best solution. · Builds innovative solutions to acquiring and enriching data from a variety of data sources. · Works on one or more projects guiding other team members on designing and developing, testing, and building automation workflows. · Conducts insightful and physical database design, designs key and indexing schemes and designs partitioning. · Participates in building and testing business continuity & disaster recovery procedures per requirements. · Evaluates and provides feedback on future technologies and new releases/upgrades based on their market knowledge of the domain when asked to do so.

Are you the right candidate

When it comes to data engineering at the BBC we look for these skills.

Technical Skills

• Experience (3+ years) in a data engineering or analytics engineering role, preferably in digital products. • Strong knowledge of Data Warehouse technologies • Extensive use of cloud technologies such as AWS and GCP. • Excellent SQL and python skills. • Experience in deploying and scheduling code bases in a data development environment. • Comfortable working alongside cross-functional teams interacting with Product Managers, Infrastructure Engineers, Data Scientists, and Data Analysts.

Teamwork and stakeholder management

• Ability to listen to others’ ideas and build on them
• Ability to clearly communicate to both technical and non-technical audiences. • Ability to collaborate effectively, working alongside other team members towards the team’s goals, and enabling others to succeed, where possible. • Ability to prioritise. A structured approach and ability to bring other on the journey.
• Strong attention to detail