Senior Data Engineer
On site
London, United Kingdom
Full Time
17-03-2025
Job Specifications
Full-time
Contract Type: Permanent
Location: Remote - UK
Division: Technology & Product
Salary Currency: GBP Sterling
Department: Data & Analytics
Company Description
We are looking to hire a Senior Data Engineer who will play a key role in supporting the existing HiveAlpha article MI product, and delivering Trenflow (a green field product that will ultimately replace HiveAlpha and support further key use cases).
Key responsibilities will include creating new data ingestion processes, monitoring existing processes and building out the ingestion frameworks to exceptional quality standards.
HiveAlpha and Trenflow are built using AWS services including OpenSearch, DynamoDB, Lambdas, Kinesis, ECS, AppSync.
The Senior Data Engineer reports to the HiveAlpha / Trenflow Tech Lead, manages ZERO people and works closely with a Tech Lead, a Product Manager, a Business Analyst, and Frontend Engineers.
Role Location
The role is fully remote, and so we are therefore open to candidates across the UK.
So, who are we?
We are Reach Plc, you might not have heard of us but we have probably met without you even realising it. We are home to the UK and Ireland’s most iconic digital platforms, magazines and newspapers. From the Mirror, Daily Express and OK!, to our regional titles such as the Liverpool Echo, BirminghamLive and the Manchester Evening News (plus lots more), our brands and the stories we cover are as varied as our people. We help all kinds of people share experiences through our stories because we believe this is what makes us human.
Oh, and we should probably also mention that with a monthly readership of 47 million people, Reach is the largest commercial publisher in the UK. At Reach, not only will you feel better understood, you will also feel you understand other people better too.
Job Description
In this role, you will develop and manage data ingestion processes using Python and NodeJS, requiring you to adapt to various programming environments and technologies.
Your key responsibilities include sourcing data from systems like APIs, S3 buckets, Databases, and Streams, ensuring seamless integration into the data infrastructure.
You will utilise Infrastructure-as-Code (IAC) tools for AWS provisioning, which is essential for efficient cloud resource management and automation to enhance scalability and reliability.
Monitoring the data platform is crucial for you to maintain system integrity, with a focus on implementing observability mechanisms for quick issue resolution.
Collaborating with business analysts, product managers, and stakeholders will ensure that you achieve accurate data ingestion aligned with organisational goals.
Documenting processes and design decisions is vital for maintaining clarity and consistency, aiding in future developments.
Upholding Reach's diversity and inclusion policy is paramount in your role, ensuring all content reflects non-discrimination values and promotes an inclusive work environment.
Qualifications
Ideal candidate will have the following skills;
Advanced knowledge of Python
Strong knowledge of AWS core and data services, particularly OpenSearch, S3, Glue, Lambda, ECS, and DynamoDB
Excellent knowledge of SQL, including DML and DDL
Excellent understanding of unit testing for data processes
Passionate about data and its potential opportunities
Articulate communicator who enjoys fostering collaboration within an organisation and between teams
Able to work independently as well as part of a team
Experience with end-to-end solutions, including web applications, APIs, backend, and frontend technologies, is highly desirable
Additional Information
We are offering a competitive salary and benefits including;
Help saving for your retirement - join our pension scheme and we’ll match contributions up to 6%
25 days’ holiday per year when you join. After three, five and ten years’ service with Reach, you’ll accrue one additional day of annual leave. We also have a Holiday Purchase Scheme
Giving back day - an additional day’s leave each year to support a cause close to your heart
Enhanced family leave - including maternity, paternity and adoption - and you’ll be eligible after just six months’ employment
Private Healthcare Cash Plan - free health cash plan so you can claim back cash for a range of medical expenses
As one of the UK’s top 50 Inclusive Employers everyone’s invited to join our events, programmes and networks to celebrate diversity and build an environment where all our people can thrive
Wellbeing support - including a 24/7 employee assistance programme (EAP) for you and your nearest and dearest
Awesome career opportunities - you’ll have support from your line manager and a range of learning & development programmes
We are also a member of the 30% Club, a global campaign aimed at increasing gender diversity at board and senior management levels
We reserve the right to close this vacancy early if we receive sufficient applications for the role. Therefore, if you are interested please apply early to avoid disappointment.
Reach plc believes diversity brings benefits for our customers, our business and our people. This is why we are committed to being an inclusive employer and encourage applications from all suitable applicants irrespective of background, circumstances, age, disability, gender identity, ethnicity, religion or belief and sexual orientation.
I'm interested
I'm interested
Privacy Policy
About the Company
Hull Live is the leading news, information and sport platform serving Hull and East Yorkshire and one of the largest regional news sites in the country. With over 2.8 million monthly visitors to hulldailymail.co.uk and over 60,000 people reading our daily print title the Hull Daily Mail each week, we have the largest audience for businesses to market their local product or service. Over the past few years media and consumer habits have evolved and the search and purchase process has become more complex. At Hull Live and the ... Know more
Related Jobs
- Company Name
- Valsoft Corporation
- Job Title
- Senior Software Engineer - AI Focused (UK) -
- Job Description
- Job Title: Senior Software Engineer - AI Focused (UK) Company: Valsoft Location: United Kingdom - Remote with occasional face-to-face meetings Type: Full-Time Reporting to: Chief Technology Officer About Valsoft Valsoft specialises in acquiring and growing vertical market software companies. Our mission is to provide a permanent home for software businesses, preserving the legacy of their founders while investing in the long-term growth and success of the companies we acquire. We operate and manage a global portfolio of wholly owned software companies, delivering mission-critical solutions across multiple verticals. By implementing industry best practices, Valsoft ensures a time-sensitive integration process and operates a decentralised model, fostering rapid growth through reinvestment in its portfolio. Our motto is "Be Humble, Stay Hungry" About The Role We are seeking an Senior Software Engineer - AI Focused who will be responsible for the full lifecycle of software solution delivery, from working closely with product managers and customers on requirements, to leveraging AI productivity tools for rapid development and deployment. You will be hands-on across the entire stack—front-end, back-end, and database—and have a strong grasp of DevOps practices to deliver secure, cost-effective solutions in the Cloud. You will have the opportunity to work with the CTO and other AI Developers across multiple businesses within the group, bringing your enthusiasm and technical ability to numerous software products across a wide variety of vertical markets. Key Responsibilities Requirements Definition & Stakeholder Collaboration Engage with product managers, customers, and cross-functional teams to understand business needs. Translate stakeholder requirements into actionable technical tasks and product milestones. AI-Driven Development Use AI-based productivity tools (e.g., code generation, automated testing frameworks) to accelerate solution delivery. Stay updated on the latest AI techniques and tools, integrating them into workflows to optimize speed, quality, and innovation. Full-Stack Implementation You will be required to develop and maintain effective front-end interfaces and back-end services, ensuring responsiveness and scalability. As Such, You Should Have Demonstrable Experience In The Design And Build Of High-quality Software Solutions Using At Least One Of The Following Tech Stacks .NET (Core/Maui) JavaScript/TypeScript (e.g., React, Node.js, Vue.js, Nuxt.js) Java Database Expertise Work with at least one of the following database technologies: Microsoft SQL Server, Oracle, PostgreSQL, or MariaDB (Preference for open-source databases) Optimize data storage and retrieval, ensuring performance, availability, and data integrity. A good understanding of Stored Procedures, SQL Functions and Views DevOps & Cloud Deployment Implement DevOps best practices (CI/CD pipelines, IaC, monitoring) to streamline the path to production. Deploy software in a cost-effective and secure manner, leveraging the most suitable Cloud services. Technical Leadership & Continuous Improvement Serve as a subject matter expert on AI-driven development for internal teams and customers. Contribute to a culture of innovation by researching emerging tools, tech, and practices to improve efficiency and product quality. About You Demonstrable Experience in developing and delivery of software products, whether from an software engineering, financial and sales or business background. Ideally, you will have worked in a variety of capacities during your career. Full-Stack Development: Proficient in at least one of the named technologies (.NET, JavaScript/TypeScript frameworks, or Java). AI/ML Tools Familiarity: Demonstrable experience using AI-driven tools (e.g., code auto-generation, advanced testing frameworks) to expedite software development cycles. Database Management: Skilled in designing schemas, writing complex queries, and tuning performance in at least one major relational database. Cloud & DevOps Knowledge: Understanding of modern cloud platforms (AWS, Azure, GCP) and ability to manage CI/CD workflows, containerization (Docker, Kubernetes), and security best practices. Customer-Facing Experience: Comfortable discussing technical and business requirements with non-technical stakeholders, gathering detailed specifications, and presenting solutions. Problem-Solving Mindset: You value action over procrastination, and can tackle ambiguous challenges, produce rapid prototypes, and iterate based on user feedback. Preferred Qualifications Education: Preference towards those holding a university degree in software engineering, business or finance, but we also welcome anyone who is self-taught. Open-Source Advocacy: Preference towards open-source technologies, with a track record of selecting the best tool for the job. End-to-End Ownership: Experience taking a product feature from concept to launch, including gathering feedback, making improvements, and final deployment. Automation & Testing: Familiarity with automated testing frameworks and continuous testing approaches to ensure code quality. Cross-Functional Collaboration: Experience collaborating with product managers, UX designers, or data scientists to deliver holistic solutions. For more information about Valsoft, please visit our website at www.valsoftcorp.com. We thank all applicants for their interest; however, only those candidates selected for an interview will be contacted. #ValsoftG1
- Company Name
- Valsoft Corporation
- Job Title
- Senior Software Engineer - AI Focused (UK)
- Job Description
- Job Title: Senior Software Engineer - AI Focused (UK) Company: Valsoft Location: United Kingdom - Remote with occasional face-to-face meetings Type: Full-Time Reporting to: Chief Technology Officer About Valsoft Valsoft specialises in acquiring and growing vertical market software companies. Our mission is to provide a permanent home for software businesses, preserving the legacy of their founders while investing in the long-term growth and success of the companies we acquire. We operate and manage a global portfolio of wholly owned software companies, delivering mission-critical solutions across multiple verticals. By implementing industry best practices, Valsoft ensures a time-sensitive integration process and operates a decentralised model, fostering rapid growth through reinvestment in its portfolio. Our motto is "Be Humble, Stay Hungry" About The Role We are seeking an Senior Software Engineer - AI Focused who will be responsible for the full lifecycle of software solution delivery, from working closely with product managers and customers on requirements, to leveraging AI productivity tools for rapid development and deployment. You will be hands-on across the entire stack—front-end, back-end, and database—and have a strong grasp of DevOps practices to deliver secure, cost-effective solutions in the Cloud. You will have the opportunity to work with the CTO and other AI Developers across multiple businesses within the group, bringing your enthusiasm and technical ability to numerous software products across a wide variety of vertical markets. Key Responsibilities Requirements Definition & Stakeholder Collaboration Engage with product managers, customers, and cross-functional teams to understand business needs. Translate stakeholder requirements into actionable technical tasks and product milestones. AI-Driven Development Use AI-based productivity tools (e.g., code generation, automated testing frameworks) to accelerate solution delivery. Stay updated on the latest AI techniques and tools, integrating them into workflows to optimize speed, quality, and innovation. Full-Stack Implementation You will be required to develop and maintain effective front-end interfaces and back-end services, ensuring responsiveness and scalability. As Such, You Should Have Demonstrable Experience In The Design And Build Of High-quality Software Solutions Using At Least One Of The Following Tech Stacks .NET (Core/Maui) JavaScript/TypeScript (e.g., React, Node.js, Vue.js, Nuxt.js) Java Database Expertise Work with at least one of the following database technologies: Microsoft SQL Server, Oracle, PostgreSQL, or MariaDB (Preference for open-source databases) Optimize data storage and retrieval, ensuring performance, availability, and data integrity. A good understanding of Stored Procedures, SQL Functions and Views DevOps & Cloud Deployment Implement DevOps best practices (CI/CD pipelines, IaC, monitoring) to streamline the path to production. Deploy software in a cost-effective and secure manner, leveraging the most suitable Cloud services. Technical Leadership & Continuous Improvement Serve as a subject matter expert on AI-driven development for internal teams and customers. Contribute to a culture of innovation by researching emerging tools, tech, and practices to improve efficiency and product quality. About You Demonstrable Experience in developing and delivery of software products, whether from an software engineering, financial and sales or business background. Ideally, you will have worked in a variety of capacities during your career. Full-Stack Development: Proficient in at least one of the named technologies (.NET, JavaScript/TypeScript frameworks, or Java). AI/ML Tools Familiarity: Demonstrable experience using AI-driven tools (e.g., code auto-generation, advanced testing frameworks) to expedite software development cycles. Database Management: Skilled in designing schemas, writing complex queries, and tuning performance in at least one major relational database. Cloud & DevOps Knowledge: Understanding of modern cloud platforms (AWS, Azure, GCP) and ability to manage CI/CD workflows, containerization (Docker, Kubernetes), and security best practices. Customer-Facing Experience: Comfortable discussing technical and business requirements with non-technical stakeholders, gathering detailed specifications, and presenting solutions. Problem-Solving Mindset: You value action over procrastination, and can tackle ambiguous challenges, produce rapid prototypes, and iterate based on user feedback. Preferred Qualifications Education: Preference towards those holding a university degree in software engineering, business or finance, but we also welcome anyone who is self-taught. Open-Source Advocacy: Preference towards open-source technologies, with a track record of selecting the best tool for the job. End-to-End Ownership: Experience taking a product feature from concept to launch, including gathering feedback, making improvements, and final deployment. Automation & Testing: Familiarity with automated testing frameworks and continuous testing approaches to ensure code quality. Cross-Functional Collaboration: Experience collaborating with product managers, UX designers, or data scientists to deliver holistic solutions. For more information about Valsoft, please visit our website at www.valsoftcorp.com. We thank all applicants for their interest; however, only those candidates selected for an interview will be contacted. #ValsoftG1
- Company Name
- AKKODIS
- Job Title
- Database Development Team Leader | SQL & PostgreSQL | £75k
- Job Description
- Senior Database Developer - Move into Management - Remote (travel once/quarter) - To £75k Are you a strong developer with a knack for database design, optimisation, and data migration? Do you want to move into a role which will involve coaching a team while driving high standards for performance, security, and availability? If so, this role could be your next big move! Our client, a dynamic and forward-thinking organisation, is looking for an exceptional Database Developer to join them and look to take charge of their SQL and Postgres environments. This hybrid role offers a mix of remote flexibility and in-office collaboration. *Our client want to see a solid permanent working history, with good tenure in roles* What You'll Be Doing: As the Database Team Lead, you'll play a pivotal role in ensuring our client's database systems meet the high standards their customers expect. You'll: Lead, coach, and develop a team of skilled database administrators, supporting their growth and professional development. Oversee the design, maintenance, and optimisation of SQL and Postgres database systems for maximum performance, availability, and security. Establish and implement best practices for data integrity and confidentiality, ensuring compliance with ISO9001 standards. Collaborate with development teams to fine-tune database queries and schema designs, driving innovation and efficiency. Monitor and troubleshoot database performance, addressing issues to ensure reliability. Stay ahead of the curve by evaluating emerging database technologies and recommending improvements. Lead database migration and version upgrade projects with confidence and precision. Deliver insightful reports on database performance, trends, and enhancements. What Makes This Role Stand Out? This isn't just about maintaining systems - it's about shaping them. You'll have the opportunity to lead, innovate, and make a lasting impact in an organisation committed to excellence and progress. What You'll Bring We're looking for someone with: Significant experience in Postgres and SQL database administration, including installation, configuration, and troubleshooting. Proven success in database migrations and upgrades. Mentoring experience - you will have acted as a mentor or lead before. Familiarity with both Linux and Microsoft operating systems. A solid understanding of database performance tuning, query optimisation, and indexing. Agile and Prince 2 experience (essential). Certifications in Microsoft SQL or PostgreSQL (a plus). A problem-solving mindset and the ability to thrive under pressure. What's on Offer? Competitive salary (to £75k, with plans to increase this as you progress and develop) and benefits package. Remote working (once/quarter in the office) A collaborative, forward-thinking environment where your ideas are valued. If you're passionate about leading a team and driving excellence in database management, then please send your CV in for immediate consideration. Our client will move quickly for the right person. Modis International Ltd acts as an employment agency for permanent recruitment and an employment business for the supply of temporary workers in the UK. Modis Europe Ltd provide a variety of international solutions that connect clients to the best talent in the world. For all positions based in Switzerland, Modis Europe Ltd works with its licensed Swiss partner Accurity GmbH to ensure that candidate applications are handled in accordance with Swiss law. Both Modis International Ltd and Modis Europe Ltd are Equal Opportunities Employers. By applying for this role your details will be submitted to Modis International Ltd and/or Modis Europe Ltd. Our Candidate Privacy Information Statement which explains how we will use your information is available on the Modis website.
- Company Name
- ISR Recruitment Ltd
- Job Title
- Senior Data Engineer (AWS)
- Job Description
- AWS Data Engineer Old Trafford/Trafford Park, Manchester (Hybrid-Working) c£80,000 per year Plus excellent company benefits and rewards package The Opportunity: Are you passionate about data and problem-solving? We're looking for a skilled Data Engineer to join our client's growing team? You'll play a key role in developing, maintaining, and improving our end-to-end data pipeline, working with cutting-edge technologies and large-scale datasets in Real Time. Skills and Experience: Strong problem-solving skills Knowledge of AWS or similar cloud platforms Experience with serverless technologies and frameworks Proficiency with AWS CloudFormation or Terraform for automation Experience with Scala or an OO language (Java, C#) SQL and Python development experience Commitment to high-quality coding and testing Experience debugging business-critical systems Role and Responsibilities: Write high-quality application code and tests Develop infrastructure automation and scheduling scripts for reliable data processing Continuously improve platform performance with cutting-edge technologies Provide support for production systems Review code and give helpful feedback Developing scalable Back End and cloud solutions Handling Real Time data processing and ETL jobs Applying AI and data analytics to large datasets Working with big data tools like Apache Spark and AWS technologies such as Elastic MapReduce, Athena and Lambda Please contact Edward Laing here at ISR Recruitment to learn moreabout our client and how they are leading the way in developing the next-generation of technical solutions through innovation and transformational technology?