Senior Data Engineer
On site
London, United Kingdom
Full Time
17-03-2025
Job Specifications
Full-time
Contract Type: Permanent
Location: Remote - UK
Division: Technology & Product
Salary Currency: GBP Sterling
Department: Data & Analytics
Company Description
We are looking to hire a Senior Data Engineer who will play a key role in supporting the existing HiveAlpha article MI product, and delivering Trenflow (a green field product that will ultimately replace HiveAlpha and support further key use cases).
Key responsibilities will include creating new data ingestion processes, monitoring existing processes and building out the ingestion frameworks to exceptional quality standards.
HiveAlpha and Trenflow are built using AWS services including OpenSearch, DynamoDB, Lambdas, Kinesis, ECS, AppSync.
The Senior Data Engineer reports to the HiveAlpha / Trenflow Tech Lead, manages ZERO people and works closely with a Tech Lead, a Product Manager, a Business Analyst, and Frontend Engineers.
Role Location
The role is fully remote, and so we are therefore open to candidates across the UK.
So, who are we?
We are Reach Plc, you might not have heard of us but we have probably met without you even realising it. We are home to the UK and Ireland’s most iconic digital platforms, magazines and newspapers. From the Mirror, Daily Express and OK!, to our regional titles such as the Liverpool Echo, BirminghamLive and the Manchester Evening News (plus lots more), our brands and the stories we cover are as varied as our people. We help all kinds of people share experiences through our stories because we believe this is what makes us human.
Oh, and we should probably also mention that with a monthly readership of 47 million people, Reach is the largest commercial publisher in the UK. At Reach, not only will you feel better understood, you will also feel you understand other people better too.
Job Description
In this role, you will develop and manage data ingestion processes using Python and NodeJS, requiring you to adapt to various programming environments and technologies.
Your key responsibilities include sourcing data from systems like APIs, S3 buckets, Databases, and Streams, ensuring seamless integration into the data infrastructure.
You will utilise Infrastructure-as-Code (IAC) tools for AWS provisioning, which is essential for efficient cloud resource management and automation to enhance scalability and reliability.
Monitoring the data platform is crucial for you to maintain system integrity, with a focus on implementing observability mechanisms for quick issue resolution.
Collaborating with business analysts, product managers, and stakeholders will ensure that you achieve accurate data ingestion aligned with organisational goals.
Documenting processes and design decisions is vital for maintaining clarity and consistency, aiding in future developments.
Upholding Reach's diversity and inclusion policy is paramount in your role, ensuring all content reflects non-discrimination values and promotes an inclusive work environment.
Qualifications
Ideal candidate will have the following skills;
Advanced knowledge of Python
Strong knowledge of AWS core and data services, particularly OpenSearch, S3, Glue, Lambda, ECS, and DynamoDB
Excellent knowledge of SQL, including DML and DDL
Excellent understanding of unit testing for data processes
Passionate about data and its potential opportunities
Articulate communicator who enjoys fostering collaboration within an organisation and between teams
Able to work independently as well as part of a team
Experience with end-to-end solutions, including web applications, APIs, backend, and frontend technologies, is highly desirable
Additional Information
We are offering a competitive salary and benefits including;
Help saving for your retirement - join our pension scheme and we’ll match contributions up to 6%
25 days’ holiday per year when you join. After three, five and ten years’ service with Reach, you’ll accrue one additional day of annual leave. We also have a Holiday Purchase Scheme
Giving back day - an additional day’s leave each year to support a cause close to your heart
Enhanced family leave - including maternity, paternity and adoption - and you’ll be eligible after just six months’ employment
Private Healthcare Cash Plan - free health cash plan so you can claim back cash for a range of medical expenses
As one of the UK’s top 50 Inclusive Employers everyone’s invited to join our events, programmes and networks to celebrate diversity and build an environment where all our people can thrive
Wellbeing support - including a 24/7 employee assistance programme (EAP) for you and your nearest and dearest
Awesome career opportunities - you’ll have support from your line manager and a range of learning & development programmes
We are also a member of the 30% Club, a global campaign aimed at increasing gender diversity at board and senior management levels
We reserve the right to close this vacancy early if we receive sufficient applications for the role. Therefore, if you are interested please apply early to avoid disappointment.
Reach plc believes diversity brings benefits for our customers, our business and our people. This is why we are committed to being an inclusive employer and encourage applications from all suitable applicants irrespective of background, circumstances, age, disability, gender identity, ethnicity, religion or belief and sexual orientation.
I'm interested
I'm interested
Privacy Policy
About the Company
Hull Live is the leading news, information and sport platform serving Hull and East Yorkshire and one of the largest regional news sites in the country. With over 2.8 million monthly visitors to hulldailymail.co.uk and over 60,000 people reading our daily print title the Hull Daily Mail each week, we have the largest audience for businesses to market their local product or service. Over the past few years media and consumer habits have evolved and the search and purchase process has become more complex. At Hull Live and the ... Know more
Related Jobs
- Company Name
- Proximity Recruitment
- Job Title
- CRM Data Executive
- Job Description
- Proximity Recruitment are searching for a talented, analytical CRM Data Executive to join an innovative B2C brand in Hertfordshire. The role is 4 days a week in the office, 1 day a week from home. This fun, ambitious environment will see the successful candidate join a dynamic team in an exciting time for the business & their brands. Responsibilities include: • Working with the brand and campaigns team to create fresh, engaging and effective email creative for campaigns whilst having a focus on the technical elements such as triggers/automation. • Deliver insightful creative briefs to external agencies. • Ensure all emails are aligned with the brand guidelines and the retail calendar. • Co-ordinate the email approval process to ensure emails are signed off in a timely manner by relevant stakeholders and that all emails and associated discount codes are tested. • Set up and broadcast email campaigns to deadlines, using the CDP (customer data platform). • Co-ordinate support for tactical local emails. • Set up and implement the annual email calendar in line with the national retail calendar. • Support the delivery and maintenance of campaign, weekly and monthly reporting including ongoing recommendations to improve email performance. • Support the data-driven strategies for acquisition and retention. • Support campaign efficiency using available automation and AI tools, transitioning towards personalised campaigns where appropriate. With a real opportunity to add great value to the businesses strategy whilst growing & developing in the CRM department this role would suit a candidate with email marketing experience and the desire to do more. Please don’t hesitate to apply for more details.
- Company Name
- Untap Health
- Job Title
- Data Engineer
- Job Description
- Untap Health is completely changing how we live alongside viral and bacterial infections. We have developed novel, remote-monitoring technology that detects illnesses in communities before symptoms emerge, allowing the first ever proactive approach to community infection prevention. By testing the collective wastewater of a building, we can monitor the health of the whole community; detecting illnesses from the early stages of infection and preventing infectious disease outbreak. We are looking for a skilled Data Engineer to join our team and help us build, maintain, and scale our data infrastructure. You will be responsible for designing and implementing data pipelines, optimizing database performance, and ensuring data integrity for critical healthcare applications. Your work will directly contribute to improving patient care and healthcare analytics. Our customer dashboard represents the key point of contact with our technology so user experience and ease of access to insightful trends are paramount. Responsibilities · Design, build, and maintain scalable data dashboards for communication of community health data. · Develop and optimize data warehouse architectures to support analytics and reporting. · Collaborate with scientists and engineers to integrate and manage data from multiple sources. · Ensure data quality, consistency, and security, following best practices and compliance standards (e.g., HIPAA, GDPR). · Implement monitoring and alerting systems for data integrity and pipeline performance. · Optimize database performance and query efficiency. · Work with cloud platforms (initially AWS, but potentially others) for data storage and processing. · Document data engineering processes and workflows. The Ideal Candidate · Bachelor's or Master’s degree in Computer Science, Data Engineering, or a related field. · 3+ years of experience in data engineering, data architecture, or software development. · Proficiency in SQL and experience with relational databases. · Strong programming skills in Python, Scala, or Java. · Experience with big data technologies. · Familiarity with cloud platforms and services (AWS, GCP, Azure) related to data storage, processing, and security. · Understanding of data privacy and security regulations in healthcare (e.g., HIPAA, GDPR). · Excellent problem-solving skills and ability to work in a fast-paced startup environment. Benefits · Competitive base salary based on experience. · Rewarding work, helping keep our communities safe from disease transmission. · Equity options. · Optional one day per week work-from-home. Untap is an equal opportunities employer. We encourage equality, diversity and inclusion across our team, following the guidelines of the Equality Act, for each employee to feel respected and able to give their best. Our company is committed to equal employment opportunities regardless of age, sexual orientation, gender, pregnancy, religion, nationality, ethnic origin, disability, medical history, skin colour, marital status, genetic information or parental status. We base all our employment decisions on merit, job requirements and business needs.
- Company Name
- CluePoints
- Job Title
- Senior Data Engineer (UK)
- Job Description
- CluePoints provides best-in-class AI-driven SaaS solutions to enable the Life Sciences industry to focus on what matters most. Our products enable both risk planning and operational risk monitoring, and utilize advanced statistical algorithms to determine the quality of clinical trial data both during and post study execution. If you're an ambitious and driven professional looking to take your career to the next level, this is the perfect opportunity to join a dynamic and fast-growing company in the exciting e-clinical space. Apply now and help us revolutionize the clinical research industry! The Senior Data Engineer will play a crucial role within the Data & Analytics team, driving the development and implementation of a centralised Data Warehouse infrastructure. This position involves architecting, designing, and delivering scalable data solutions to streamline and optimise data storage, integration, and management processes. Leveraging expertise in the Kimball Methodology and Azure Data Factory, the Senior Data Engineer will ensure seamless integration of data from diverse sources, maintaining consistency, accuracy, and reliability. In addition to these responsibilities, the Senior Data Engineer will design and develop robust KPI dashboards to meet the needs of various stakeholders. They will work closely with Senior Data Analysts to provide well-aggregated and curated datasets, ensuring readiness for reporting and analytics purposes. This collaborative approach is essential to deliver high-quality insights and support data-driven decision-making across the organisation. Extensive Data Warehouse Experience: At least 7 years of hands-on experience designing, building, and managing data warehouses using the Kimball methodology. Proficiency in Azure Tools: Demonstrated expertise in Azure Data Factory (ETL processes), Azure SQL Server, Azure DevOps, Key Vaults, and Logic Apps. Strong Data Modeling Skills: Proven ability to design efficient and scalable data warehouse architectures, including the creation of robust staging and production layers. Performance Optimization: Experience in optimizing data loads to ensure reliability, scalability, and high performance, with a focus on reducing processing times and improving efficiency. Forward-Thinking Vision: A solid understanding of advanced data technologies and practices, with the ability to scale the data warehouse to support future growth and evolving business needs. Integration Expertise: Experience integrating data from diverse sources, ensuring data accuracy and consistency throughout the ETL process. Problem-Solving Abilities: Adept at troubleshooting and resolving complex data pipeline and infrastructure issues. Collaboration Skills: Ability to work closely with data analysts, stakeholders, and cross-functional teams to align data solutions with business objectives. Agile and DevOps Practices: Familiarity with CI/CD pipelines and agile workflows to streamline data warehouse development and deployment. A passionate technologist with an inherent love for data, eager to drive insights and innovation Demonstrated mastery of SQL is essential, including proficiency in creating tables, views, stored procedures, and crafting succinct queries to populate our Power BI models effectively. Minimum of 5 years of hands-on experience in analyzing and extracting data from diverse sources, showcasing a deep understanding of data extraction (including REST APIs) methodologies and best practices. Nice to have's: Previous SaaS experience - working with Software as a Service (SaaS) companies Familiriality with Microsoft Power BI to support data visualization and advanced analytics needs. Understanding of cloud cost management strategies to ensure efficient use of Azure resources. Proficiency in scripting languages like Python, PowerShell, or Bash for automation and orchestration tasks. Hands-on experience with tools and practices to monitor and improve data quality in the pipeline. SSIS experience: Proficiency in SQL Server Integration Services (SSIS) is advantageous, as it demonstrates the ability to design, implement, and manage robust data integration solutions within Microsoft SQL Server environments, complementing our data engineering initiatives. Experience with Alteryx analytics platform is a plus, indicating expertise in data blending, advanced analytics, and workflow automation, which can enhance our data processing capabilities and accelerate insights generation. Lead the design and implementation of robust and scalable data architecture solutions on the Azure platform, ensuring optimal performance and efficiency. Drive the implementation of data integration processes to seamlessly ingest data from diverse sources into Azure SQL Server, leveraging Azure Data Factory to design and develop ETL processes efficiently. Champion the maintenance of data quality, reliability, and integrity within Azure-stored datasets by enforcing data governance policies, conducting QA checks, and establishing effective monitoring mechanisms to uphold data quality standards. Utilize analytical skills to thoroughly review API documentation and analyze raw data and source system data models, ensuring comprehensive understanding and preparation before loading data into the staging area. Take ownership of maintaining documentation such as data dictionaries and data models, and actively share knowledge and expertise with team members to cultivate a culture of continuous learning and improvement. Collaborate with Senior Data Analysts to assist with complex SQL queries and ensure seamless reporting in Power BI. Act as a backup during their absence to maintain reporting continuity and meet requirements. Demonstrate adaptability and effectiveness in working under a hybrid working model, delivering high-quality work across global teams with efficiency and professionalism. Strong communication and presentation skills to convey technical concepts to non-technical stakeholders and build collaboration across teams. REASONS TO JOIN US Flexibility is part of our DNA Many activities are organized during the year such as team lunches, happy hours, team buildings, holiday parties and many other celebrations! At CluePoints, learning, training and personal growth are part of the game: you’ll have access to online training materials, certifications sponsored by the company, personal growth plans, and career paths to explore new opportunities. You’ll work with a fast-growing, multi-disciplinary and international team representing over 20 different nationalities, in an English-speaking working environment. You’ll have a challenging and rewarding job in an ambitious and fast-paced technology scale-up that has received many national and international awards including “Scale-Up of the year 2019”! Competitive salary & benefits
- Company Name
- Jobs via eFinancialCareers
- Job Title
- Data Engineer - Davies Consulting
- Job Description
- Data Engineer (Team Blossom) Department: IT Employment Type: Permanent - Full Time Location: Home United Kingdom Reporting To: Steven Smith Description SSRS, SSIS, SQL and Power BI experience is essential Do you want to work for a forward-thinking, award winning in-house software development team? As a Data Engineer you will be involved in the design, development and delivery of full data solutions, in particular data reporting, using the Microsoft BI stack. You will have strong T-SQL skills and Performance Dashboard development. In particular you will have strong skills in creating SSRS reports and in data visualisation tools such as Power BI, and will also hold experience of developing and maintaining Data Warehouses. You must have strong experience of developing in Visual Studio database solutions and releasing changes via Azure DevOps automated deployments, with experience of creating and running unit tests and be able to mentor and guide other members of the team towards an automated test-driven approach. You will work with members of the business to capture requirements and help shape the development of the reports and dashboards. You will be part of a great team who love new technologies. We have a fast-growing working environment, where we empower and trust our team to work independently whilst also pulling together to achieve our objectives. Key Responsibilities Responsible for the design and development of data solutions across the company. Deliver and maintain performance dashboards to operational teams and external customers to ensure business access to essential data. Deliver and maintain SSRS reports to ensure business and customer access to essential MI/BI. Contribute to the design and development of new solutions using Power BI. Define, update and adhere to software development patterns and standards. Provide technical assistance, support and development skills across the company. You must have experience in developing in Visual Studio and Azure DevOps pipelines in Test Driven Development, we are looking for someone who can help us introduce and instil that mind-set in the rest of the team. Liaise with third party software providers throughout the lifecycle - including design, development, support and maintenance, ensuring best practise. Skills, Knowledge & Expertise We are looking for someone who has gained experience in a variety of different tools and implementations who is capable of making informed choices. You will have extensive experience of working within a team. Performance Competencies: Highly numerate with previous experience in delivering BI reporting solutions. Good T-SQL skills are essential. Good understanding of data warehousing, ETL and database concepts. Good experience of Microsoft BI technologies. Experience in delivering complex reporting solutions. Technologies: Essentials: Microsoft stack SQL Server 2008/12/16 SSIS SSRS Power BI SQL Server Unit Tests Azure DevOps Visual Studio Desirable: CI/CD Pipelines Azure SQL Azure Data Factory Job Benefits Davies Incentive Plan 25 days holiday per year which increases with level of service (opportunity to buy & sell 3 days) Family Cover Private Medical Insurance (Bupa) - will automatically be at single cover level but can opt into family option within first month of joining Simply Health Care Cash Plan WeCare - 24/7 online GP, mental health support and virtual wellbeing covering a whole host of topics to do with health, mental health, wellbeing & healthy living and financial & legal wellbeing Death in Service Critical Illness Cover PHI/Income Protection (Private health insurance) Pension Contribution based 5% Employee / 3% Employer Cycle to Work Scheme* Tech Scheme* Season Ticket Loan* Gym Flex* Access to Online Discount Sites Discounted Gourmet Society Membership Discounted Tickets for Merlin Attractions nationwide Discounts at local retail outlets * after successfully completing probation