Senior Data Engineer

On site

London, United Kingdom

Full Time

17-03-2025

Share this job:

Score my CV Apply

Job Specifications

Full-time
Contract Type: Permanent
Location: Remote - UK
Division: Technology & Product
Salary Currency: GBP Sterling
Department: Data & Analytics

Company Description

We are looking to hire a Senior Data Engineer who will play a key role in supporting the existing HiveAlpha article MI product, and delivering Trenflow (a green field product that will ultimately replace HiveAlpha and support further key use cases).

Key responsibilities will include creating new data ingestion processes, monitoring existing processes and building out the ingestion frameworks to exceptional quality standards.

HiveAlpha and Trenflow are built using AWS services including OpenSearch, DynamoDB, Lambdas, Kinesis, ECS, AppSync.

The Senior Data Engineer reports to the HiveAlpha / Trenflow Tech Lead, manages ZERO people and works closely with a Tech Lead, a Product Manager, a Business Analyst, and Frontend Engineers.

Role Location

The role is fully remote, and so we are therefore open to candidates across the UK.

So, who are we?

We are Reach Plc, you might not have heard of us but we have probably met without you even realising it. We are home to the UK and Ireland’s most iconic digital platforms, magazines and newspapers. From the Mirror, Daily Express and OK!, to our regional titles such as the Liverpool Echo, BirminghamLive and the Manchester Evening News (plus lots more), our brands and the stories we cover are as varied as our people. We help all kinds of people share experiences through our stories because we believe this is what makes us human.

Oh, and we should probably also mention that with a monthly readership of 47 million people, Reach is the largest commercial publisher in the UK. At Reach, not only will you feel better understood, you will also feel you understand other people better too.

Job Description

In this role, you will develop and manage data ingestion processes using Python and NodeJS, requiring you to adapt to various programming environments and technologies.

Your key responsibilities include sourcing data from systems like APIs, S3 buckets, Databases, and Streams, ensuring seamless integration into the data infrastructure.

You will utilise Infrastructure-as-Code (IAC) tools for AWS provisioning, which is essential for efficient cloud resource management and automation to enhance scalability and reliability.

Monitoring the data platform is crucial for you to maintain system integrity, with a focus on implementing observability mechanisms for quick issue resolution.

Collaborating with business analysts, product managers, and stakeholders will ensure that you achieve accurate data ingestion aligned with organisational goals.

Documenting processes and design decisions is vital for maintaining clarity and consistency, aiding in future developments.

Upholding Reach's diversity and inclusion policy is paramount in your role, ensuring all content reflects non-discrimination values and promotes an inclusive work environment.

Qualifications

Ideal candidate will have the following skills;

Advanced knowledge of Python
Strong knowledge of AWS core and data services, particularly OpenSearch, S3, Glue, Lambda, ECS, and DynamoDB
Excellent knowledge of SQL, including DML and DDL
Excellent understanding of unit testing for data processes
Passionate about data and its potential opportunities
Articulate communicator who enjoys fostering collaboration within an organisation and between teams
Able to work independently as well as part of a team
Experience with end-to-end solutions, including web applications, APIs, backend, and frontend technologies, is highly desirable

Additional Information

We are offering a competitive salary and benefits including;

Help saving for your retirement - join our pension scheme and we’ll match contributions up to 6%
25 days’ holiday per year when you join. After three, five and ten years’ service with Reach, you’ll accrue one additional day of annual leave. We also have a Holiday Purchase Scheme
Giving back day - an additional day’s leave each year to support a cause close to your heart
Enhanced family leave - including maternity, paternity and adoption - and you’ll be eligible after just six months’ employment
Private Healthcare Cash Plan - free health cash plan so you can claim back cash for a range of medical expenses
As one of the UK’s top 50 Inclusive Employers everyone’s invited to join our events, programmes and networks to celebrate diversity and build an environment where all our people can thrive
Wellbeing support - including a 24/7 employee assistance programme (EAP) for you and your nearest and dearest
Awesome career opportunities - you’ll have support from your line manager and a range of learning & development programmes
We are also a member of the 30% Club, a global campaign aimed at increasing gender diversity at board and senior management levels

We reserve the right to close this vacancy early if we receive sufficient applications for the role. Therefore, if you are interested please apply early to avoid disappointment.

Reach plc believes diversity brings benefits for our customers, our business and our people. This is why we are committed to being an inclusive employer and encourage applications from all suitable applicants irrespective of background, circumstances, age, disability, gender identity, ethnicity, religion or belief and sexual orientation.

I'm interested

I'm interested

Privacy Policy

About the Company

Hull Live is the leading news, information and sport platform serving Hull and East Yorkshire and one of the largest regional news sites in the country. With over 2.8 million monthly visitors to hulldailymail.co.uk and over 60,000 people reading our daily print title the Hull Daily Mail each week, we have the largest audience for businesses to market their local product or service. Over the past few years media and consumer habits have evolved and the search and purchase process has become more complex. At Hull Live and the ... Know more

Related Jobs

Company Name: Untap Health
Job Title: Data Engineer
Job Description: Untap Health is completely changing how we live alongside viral and bacterial infections. We have developed novel, remote-monitoring technology that detects illnesses in communities before symptoms emerge, allowing the first ever proactive approach to community infection prevention. By testing the collective wastewater of a building, we can monitor the health of the whole community; detecting illnesses from the early stages of infection and preventing infectious disease outbreak. We are looking for a skilled Data Engineer to join our team and help us build, maintain, and scale our data infrastructure. You will be responsible for designing and implementing data pipelines, optimizing database performance, and ensuring data integrity for critical healthcare applications. Your work will directly contribute to improving patient care and healthcare analytics. Our customer dashboard represents the key point of contact with our technology so user experience and ease of access to insightful trends are paramount. Responsibilities · Design, build, and maintain scalable data dashboards for communication of community health data. · Develop and optimize data warehouse architectures to support analytics and reporting. · Collaborate with scientists and engineers to integrate and manage data from multiple sources. · Ensure data quality, consistency, and security, following best practices and compliance standards (e.g., HIPAA, GDPR). · Implement monitoring and alerting systems for data integrity and pipeline performance. · Optimize database performance and query efficiency. · Work with cloud platforms (initially AWS, but potentially others) for data storage and processing. · Document data engineering processes and workflows. The Ideal Candidate · Bachelor's or Master’s degree in Computer Science, Data Engineering, or a related field. · 3+ years of experience in data engineering, data architecture, or software development. · Proficiency in SQL and experience with relational databases. · Strong programming skills in Python, Scala, or Java. · Experience with big data technologies. · Familiarity with cloud platforms and services (AWS, GCP, Azure) related to data storage, processing, and security. · Understanding of data privacy and security regulations in healthcare (e.g., HIPAA, GDPR). · Excellent problem-solving skills and ability to work in a fast-paced startup environment. Benefits · Competitive base salary based on experience. · Rewarding work, helping keep our communities safe from disease transmission. · Equity options. · Optional one day per week work-from-home. Untap is an equal opportunities employer. We encourage equality, diversity and inclusion across our team, following the guidelines of the Equality Act, for each employee to feel respected and able to give their best. Our company is committed to equal employment opportunities regardless of age, sexual orientation, gender, pregnancy, religion, nationality, ethnic origin, disability, medical history, skin colour, marital status, genetic information or parental status. We base all our employment decisions on merit, job requirements and business needs.

London, United Kingdom

On site

Full Time

18-03-2025

Company Name: CluePoints
Job Title: Senior Data Engineer (UK)
Job Description: CluePoints provides best-in-class AI-driven SaaS solutions to enable the Life Sciences industry to focus on what matters most. Our products enable both risk planning and operational risk monitoring, and utilize advanced statistical algorithms to determine the quality of clinical trial data both during and post study execution. If you're an ambitious and driven professional looking to take your career to the next level, this is the perfect opportunity to join a dynamic and fast-growing company in the exciting e-clinical space. Apply now and help us revolutionize the clinical research industry! The Senior Data Engineer will play a crucial role within the Data & Analytics team, driving the development and implementation of a centralised Data Warehouse infrastructure. This position involves architecting, designing, and delivering scalable data solutions to streamline and optimise data storage, integration, and management processes. Leveraging expertise in the Kimball Methodology and Azure Data Factory, the Senior Data Engineer will ensure seamless integration of data from diverse sources, maintaining consistency, accuracy, and reliability. In addition to these responsibilities, the Senior Data Engineer will design and develop robust KPI dashboards to meet the needs of various stakeholders. They will work closely with Senior Data Analysts to provide well-aggregated and curated datasets, ensuring readiness for reporting and analytics purposes. This collaborative approach is essential to deliver high-quality insights and support data-driven decision-making across the organisation. Extensive Data Warehouse Experience: At least 7 years of hands-on experience designing, building, and managing data warehouses using the Kimball methodology. Proficiency in Azure Tools: Demonstrated expertise in Azure Data Factory (ETL processes), Azure SQL Server, Azure DevOps, Key Vaults, and Logic Apps. Strong Data Modeling Skills: Proven ability to design efficient and scalable data warehouse architectures, including the creation of robust staging and production layers. Performance Optimization: Experience in optimizing data loads to ensure reliability, scalability, and high performance, with a focus on reducing processing times and improving efficiency. Forward-Thinking Vision: A solid understanding of advanced data technologies and practices, with the ability to scale the data warehouse to support future growth and evolving business needs. Integration Expertise: Experience integrating data from diverse sources, ensuring data accuracy and consistency throughout the ETL process. Problem-Solving Abilities: Adept at troubleshooting and resolving complex data pipeline and infrastructure issues. Collaboration Skills: Ability to work closely with data analysts, stakeholders, and cross-functional teams to align data solutions with business objectives. Agile and DevOps Practices: Familiarity with CI/CD pipelines and agile workflows to streamline data warehouse development and deployment. A passionate technologist with an inherent love for data, eager to drive insights and innovation Demonstrated mastery of SQL is essential, including proficiency in creating tables, views, stored procedures, and crafting succinct queries to populate our Power BI models effectively. Minimum of 5 years of hands-on experience in analyzing and extracting data from diverse sources, showcasing a deep understanding of data extraction (including REST APIs) methodologies and best practices. Nice to have's: Previous SaaS experience - working with Software as a Service (SaaS) companies Familiriality with Microsoft Power BI to support data visualization and advanced analytics needs. Understanding of cloud cost management strategies to ensure efficient use of Azure resources. Proficiency in scripting languages like Python, PowerShell, or Bash for automation and orchestration tasks. Hands-on experience with tools and practices to monitor and improve data quality in the pipeline. SSIS experience: Proficiency in SQL Server Integration Services (SSIS) is advantageous, as it demonstrates the ability to design, implement, and manage robust data integration solutions within Microsoft SQL Server environments, complementing our data engineering initiatives. Experience with Alteryx analytics platform is a plus, indicating expertise in data blending, advanced analytics, and workflow automation, which can enhance our data processing capabilities and accelerate insights generation. Lead the design and implementation of robust and scalable data architecture solutions on the Azure platform, ensuring optimal performance and efficiency. Drive the implementation of data integration processes to seamlessly ingest data from diverse sources into Azure SQL Server, leveraging Azure Data Factory to design and develop ETL processes efficiently. Champion the maintenance of data quality, reliability, and integrity within Azure-stored datasets by enforcing data governance policies, conducting QA checks, and establishing effective monitoring mechanisms to uphold data quality standards. Utilize analytical skills to thoroughly review API documentation and analyze raw data and source system data models, ensuring comprehensive understanding and preparation before loading data into the staging area. Take ownership of maintaining documentation such as data dictionaries and data models, and actively share knowledge and expertise with team members to cultivate a culture of continuous learning and improvement. Collaborate with Senior Data Analysts to assist with complex SQL queries and ensure seamless reporting in Power BI. Act as a backup during their absence to maintain reporting continuity and meet requirements. Demonstrate adaptability and effectiveness in working under a hybrid working model, delivering high-quality work across global teams with efficiency and professionalism. Strong communication and presentation skills to convey technical concepts to non-technical stakeholders and build collaboration across teams. REASONS TO JOIN US Flexibility is part of our DNA Many activities are organized during the year such as team lunches, happy hours, team buildings, holiday parties and many other celebrations! At CluePoints, learning, training and personal growth are part of the game: you’ll have access to online training materials, certifications sponsored by the company, personal growth plans, and career paths to explore new opportunities. You’ll work with a fast-growing, multi-disciplinary and international team representing over 20 different nationalities, in an English-speaking working environment. You’ll have a challenging and rewarding job in an ambitious and fast-paced technology scale-up that has received many national and international awards including “Scale-Up of the year 2019”! Competitive salary & benefits

Company Name: Jobs via eFinancialCareers
Job Title: Data Engineer - Davies Consulting
Job Description: Data Engineer (Team Blossom) Department: IT Employment Type: Permanent - Full Time Location: Home United Kingdom Reporting To: Steven Smith Description SSRS, SSIS, SQL and Power BI experience is essential Do you want to work for a forward-thinking, award winning in-house software development team? As a Data Engineer you will be involved in the design, development and delivery of full data solutions, in particular data reporting, using the Microsoft BI stack. You will have strong T-SQL skills and Performance Dashboard development. In particular you will have strong skills in creating SSRS reports and in data visualisation tools such as Power BI, and will also hold experience of developing and maintaining Data Warehouses. You must have strong experience of developing in Visual Studio database solutions and releasing changes via Azure DevOps automated deployments, with experience of creating and running unit tests and be able to mentor and guide other members of the team towards an automated test-driven approach. You will work with members of the business to capture requirements and help shape the development of the reports and dashboards. You will be part of a great team who love new technologies. We have a fast-growing working environment, where we empower and trust our team to work independently whilst also pulling together to achieve our objectives. Key Responsibilities Responsible for the design and development of data solutions across the company. Deliver and maintain performance dashboards to operational teams and external customers to ensure business access to essential data. Deliver and maintain SSRS reports to ensure business and customer access to essential MI/BI. Contribute to the design and development of new solutions using Power BI. Define, update and adhere to software development patterns and standards. Provide technical assistance, support and development skills across the company. You must have experience in developing in Visual Studio and Azure DevOps pipelines in Test Driven Development, we are looking for someone who can help us introduce and instil that mind-set in the rest of the team. Liaise with third party software providers throughout the lifecycle - including design, development, support and maintenance, ensuring best practise. Skills, Knowledge & Expertise We are looking for someone who has gained experience in a variety of different tools and implementations who is capable of making informed choices. You will have extensive experience of working within a team. Performance Competencies: Highly numerate with previous experience in delivering BI reporting solutions. Good T-SQL skills are essential. Good understanding of data warehousing, ETL and database concepts. Good experience of Microsoft BI technologies. Experience in delivering complex reporting solutions. Technologies: Essentials: Microsoft stack SQL Server 2008/12/16 SSIS SSRS Power BI SQL Server Unit Tests Azure DevOps Visual Studio Desirable: CI/CD Pipelines Azure SQL Azure Data Factory Job Benefits Davies Incentive Plan 25 days holiday per year which increases with level of service (opportunity to buy & sell 3 days) Family Cover Private Medical Insurance (Bupa) - will automatically be at single cover level but can opt into family option within first month of joining Simply Health Care Cash Plan WeCare - 24/7 online GP, mental health support and virtual wellbeing covering a whole host of topics to do with health, mental health, wellbeing & healthy living and financial & legal wellbeing Death in Service Critical Illness Cover PHI/Income Protection (Private health insurance) Pension Contribution based 5% Employee / 3% Employer Cycle to Work Scheme* Tech Scheme* Season Ticket Loan* Gym Flex* Access to Online Discount Sites Discounted Gourmet Society Membership Discounted Tickets for Merlin Attractions nationwide Discounts at local retail outlets * after successfully completing probation

London, United Kingdom

Remote

Full Time

18-03-2025

Company Name: Immersive
Job Title: Data Engineer - Bristol (Hybrid Working)
Job Description: Get on board with the fastest-growing cybersecurity company in the UK. Drive a fast-growing team and help us deliver up-to-the moment content to our customers Immersive is the leader in people-centric cyber resilience. We help organizations continuously assess, build, and prove their cyber workforce resilience for teams across the entire organization, from front-line cybersecurity and development teams to Board-level executives. We provide realistic simulations and hands-on cybersecurity labs to evaluate individual and team capabilities and decision-making against the latest threats. https://www.immersivelabs.com/why-immersive-labs Where we are now Immersive was founded in 2017, from a cargo container in Bristol, UK we’ve grown to over 300 employees globally, announced funding of more than £150 million and been voted a Best place to work for the last 3 years running! We are trusted by the world’s largest organizations including KPMG, Sophos and the NHS to measure, map to risk, and optimize the human cyber abilities of their entire workforce. https://www.immersivelabs.com/company/our-story We encourage people of all different backgrounds and identities to apply. We are committed to maintaining an inclusive, supportive place for you to be you and do your very best work. Data Engineer - Bristol, UK Due to growth within our Product org, we seek a Data Engineer to join our Engineering team. This role would suit someone with some experience in Data Engineering that is looking to step up into a more involved role. As one of our Data Engineers, you’ll be responsible for collaborating with Data Analysts and Analytics Engineers to develop, maintain and refactor customer facing analytical reporting. In this role, you will be working as part of a product team and utilise strong technical and communication skills to work cross-functionally to deliver valuable insights to our customers. We are not just seeking a skillset though - we are looking for someone who will also become an important and vital part of our team, so we seek a driven, curious and collaborative person to become our next colleague This is an exciting opportunity to be responsible for developing a truly ground breaking SaaS product. If you want to have a large impact and contribute more than just your time, this could be the role for you - at Immersive Labs, we value determination, ingenuity, collaboration and an understanding that unique products require unique technical solutions. You'll get to work in a friendly multi-disciplinary agile team and also work on innovative ideas regularly during our Hack Weeks, where collaboration between different teams is encouraged to find unique solutions. Your Main Responsibilities As a Data Engineer within our team, you will play a key role in delivering a critical part of our product. Typical responsibilities could involve; Design, build and maintain high quality python applications for customer facing reporting Maintain and develop data pipelines to ensure data quality and consistency Collaborate closely with analytics engineers to implement data model changes Apply domain knowledge to enable the rest of the business to access the data they need to make informed business decisions Requirements Success in this role will depend most on your approach, underlying skills and potential for growth, even if some of the above would be new to you. You should apply if you have (we know it’s tough, but please try to avoid the confidence gap . You don’t have to match all the listed requirements exactly to be considered for this role): You are proficient in python programming with experience using Plotly graphing libraries and application development, experience with Flask and SQLAlchemy is a plus You have experience following software engineering best practices like version control and continuous integration You have strong proficiency using SQL in cloud data warehouses (e.g. BigQuery, Redshift, Snowflake) and are comfortable with performance optimization, data partitioning, and window functions It would be advantageous - but not essential - if you had the following experience: Experience with dbt for data transformation layer Experience with IaC tooling such as Terraform or CloudFormation Experience with BI tooling such as Power BI or Looker Experience with AWS, Azure or GCP Role Immersive’s growth has been fuelled by our values that underpin everything we do, here's how they relate to this role: Driven - We push the boundaries of innovation, acting swiftly to achieve ambitious outcomes. Our drive embodies a culture of ambition, where challenges are stepping stones to excellence. Inclusive - Our strength lies in diversity, fostering a culture where every individual contributes to our collective strength. We champion open dialogue and empathy, ensuring a collaborative, inclusive workplace. Customer Centric - We seek to develop deep relationships with our customers to help them achieve their business outcomes. We exceed our customers and partners expectations by crafting products, services and experience that surprise, delight and ensuring they feel valued and supported every day. One Team - We are a talented global team working together to achieve our vision. Central to our ethos, resilience means adapting and thriving in adversity. It guides our innovation, ensuring we and our clients are prepared for the future. If you would like to read more about what you can expect from our recruitment process, you can visit our dedicated interview process page. Benefits As well as an inclusive, supportive place for you to be you. We offer an extensive range of benefits so you can do your very best work: Time off, flexible and remote working so you can work when is best for you, includes 25 days annual leave + 2 volunteering days and your birthday off The longer you are with Immersive, the more holiday days you get, up to a maximum of 30 days after five years of service Look after your family and yourself with enhanced parental leave, mindfulness groups, critical illness cover, 7% matched pension, private healthcare plan and more Career and learning development through the platform and our ‘Learn Anything’ fund Recognition & Rewards for doing great work and living our values and behaviours Informal or formal flexible working options, e.g. flexible start and finish times, reduced hours, job share, remote working We’re a sociable, tight-knit team with monthly socials, and sports clubs. Our socials have included everything from pottery painting and paper mask making, to movie nights and escape rooms When you do visit the UK hub, getting there is easy: we’re based in the centre of Bristol, just a 10 minute walk from the train station. We also offer railcard loan and cycle scheme to buy a new bike Find out more at https://www.immersivelabs.com/company/careers Cyber threats wait for no one and neither should you. Apply now!

Bristol, United Kingdom

On site

Full Time

17-03-2025