Senior Data / DevOps Engineer - AWS/Python - Manchester
Hybrid
Manchester, United Kingdom
£ 80,000 / year
Full Time
28-02-2025
Job Specifications
We are looking for Senior Data / DevOps Engineer to join our team and play a crucial role in Data Engineer Team, ensuring the main function is developing, maintaining and improving the end-to-end data pipeline.
You will be working in the Data Engineering team whose main function is developing, maintaining and improving the end-to-end data pipeline that includes real-time data processing; extract, transform, load jobs; artificial intelligence; and data analytics on a complex and large dataset.
Your role will primarily be to perform DevOps, backend and cloud development on the data infrastructure to develop innovative solutions to effectively scale and maintain the data platform. You will be working on complex data problems in a challenging and fun environment, using some of the latest Big Data open-source technologies like Apache Spark, as well as Amazon Web Service technologies including Elastic MapReduce, Athena and Lambda to develop scalable data solutions.
Key Responsibilities:
Adhering to Company Policies and Procedures with respect to Security, Quality and Health & Safety.
Writing application code and tests that conform to standards.
Developing infrastructure automation and scheduling scripts for reliable data processing.
Continually evaluating and contribute towards using cutting-edge tools and technologies to improve the design, architecture and performance of the data platform.
Supporting the production systems running the deployed data software.
Regularly reviewing colleagues’ work and providing helpful feedback.
Working with stakeholders to fully understand requirements.
Be the subject matter expert for the data platform and supporting processes and be able to present to others to knowledge share.
Here’s what we’re looking for:
The ability to problem solve.
Knowledge of AWS or equivalent cloud technologies.
Knowledge of Serverless technologies, frameworks and best practices.
Experience using AWS CloudFormation or Terraform for infrastructure automation.
Knowledge of Scala or OO language such as Java or C#.
SQL or Python development experience.
High-quality coding and testing practices.
Willingness to learn new technologies and methodologies.
Knowledge of agile software development practices including continuous integration, automated testing and working with software engineering requirements and specifications.
Good interpersonal skills, positive attitude, willing to help other members of the team.
Experience debugging and dealing with failures on business-critical systems.
Preferred:
Exposure to Apache Spark, Apache Trino, or another big data processing system.
Knowledge of streaming data principles and best practices.
Understanding of database technologies and standards.
Experience working on large and complex datasets.
Exposure to Data Engineering practices used in Machine Learning training and inference.
Experience using Git, Jenkins and other CI/CD tools.
Mayflower is acting as an Employment Agency in relation to this vacancy
About the Company
MAYFLOWER RECRUITMENT LIMITED is a staffing and recruiting company based out of 89-90 Basingstoke Rd, Reading, BERKSHIRE, United Kingdom. Know more
Related Jobs
- Company Name
- eflow Global
- Job Title
- Senior Software Engineer
- Job Description
- About the Company: eflow global is a leading provider of Regtech cloud solutions. Following a successful funding round and a strategic pivot to a fully SaaS model, we are expanding rapidly. About the Role: We are seeking a motivated and experienced Software Engineer to join our dynamic team. This role involves designing, developing, and maintaining cutting-edge software solutions in a collaborative and innovative environment.You will have the opportunity to work on both front-end and back-end development, using modern technologies to deliver high-quality applications. Key Responsibilities:Software DevelopmentDevelop and maintain robust, scalable software solutions using modern programming languages such as Java, C++, or equivalent.Create and optimize user-facing applications with HTML, CSS, JavaScript, and front-end frameworks/libraries.Design and implement RESTful APIs and integrate with third-party services.Work with databases like MySQL, PostgreSQL, or MongoDB to build and manage data-driven applications.System Architecture & Integration:Contribute to system design, ensuring performance, scalability, and security.Optimize existing systems for performance and reliability.Collaborate on the integration of cloud services (AWS, Azure, or Google Cloud).Collaboration & Communication:Partner with product managers, designers, and other developers to deliver innovative solutions.Participate in code reviews, share insights, and mentor junior team members.Troubleshoot and debug complex technical issues.Continuous Learning & Innovation:Stay updated on emerging trends in software engineering and apply them to projects.Take initiative in proposing technical improvements and adopting best practices.Qualifications:Education & Experience:A Bachelor’s degree in Computer Science, Software Engineering, or related field (or equivalent practical experience).At least 5 years of professional experience in software engineering or related roles.Technical Skills:Proficiency in one or more programming languages: Java, C++, Python, or similar.Strong front-end development skills using HTML, CSS, JavaScript, and familiarity with frameworks like React or Angular.Solid understanding of database systems and experience with SQL or NoSQL databases.Knowledge of RESTful API design principles and microservices architecture.Familiarity with version control systems like Git.Preferred Skills:Exposure to Agile methodologies and tools (e.g., Jira, Scrum).Familiarity with CI/CD pipelines and modern development workflows.Knowledge of cloud platforms such as AWS, Azure, or Google Cloud.Soft Skills:Strong analytical and problem-solving abilities.Excellent communication and collaboration skills.Eagerness to learn and adapt to new technologies.Benefits:Competitive salary and performance-based bonuses.Comprehensive health insurance coverage.Opportunities for professional development and career growth.Flexible hybrid work environment with a focus on work-life balance.Application Process:Initial 15-minute screening call.A 30-minute video interview via Teams.Final in-person interview at our Reading office.Career Progression:Our organization is dedicated to fostering internal growth by providing clear, structured career progression opportunities. Each role builds on prior experience, enabling team members to develop their skills and advance their careers within the company Equal Opportunity Statement: Include a statement on commitment to diversity and inclusivity.
- Company Name
- Harnham
- Job Title
- Senior Software Engineer
- Job Description
- SENIOR BACKEND ENGINEER UP TO 90K + BONUS FULLY REMOTE Java, Spring, Kotlin, Kafka, Scala, TDD, AWS, Docker, Kubernetes A tech scale up is hiring a Senior Software Engineer to join their rapidly growing team to work across a variety of complex projects. They are working with the latest technology and constantly pushing software best practises. You will get to experiment with new technologies and really make an impact on the company. This team is in a massive expansion phase, and this is the ideal time to join the business! THE ROLE: As a Senior Software Engineer, you will have an expansive range of responsibilities, including: Design, development and upkeep of required software using Java, Spring & TDD Building complex solutions to complex problems, and scalable products Designing architecture Establishing and promoting the use of best practices in the software engineering life cycle YOUR SKILLS & EXPERIENCE: Essential: Java Spring TDD Kotlin Kafka Docker Nice to have: AWS Kubernetes THE SALARY & BENEFITS Salary is a maximum of 90k 10% Bonus 25 days annual leave + the option to buy / sell days Private healthcare + dental Pension 3% / 6% (matched if increased, up to 10%) Work abroad up to 30 days INTERVIEW PROCESS (3 STAGES) 1 hour (Paired programming in react/typescript) 1 hour (Systems design and architecture) 1 hour (Culture fit and competency questions) HOW TO APPLY: Please register your interest by sending your CV to Cormac Fagan via the Apply link on this page
- Company Name
- TotalEnergies
- Job Title
- Commercial Data & Reporting Analyst
- Job Description
- We have an exciting opportunity for an experienced data analyst to join the Commercial Data & MI team. The role is responsible for developing and managing reporting / analysis through the entirety of the data analytics lifecycle, working closely with IT and stakeholders across the business to gather requirements, handle data prep, modelling, and report creation for these requirements. Stakeholders must be engaged throughout the process to manage expectations and utilise their business expertise. The Commercial Data & Reporting Analyst will report to the Commercial Data & MI Manager, this role actively act and contribute as a member of the Commercial & Transformation team, taking driving role in projects that will inform and improve TGP portfolio market knowledge and performance Role Details: Salary: Up to £45,000pa Bonus: 20% of base salary Location: Kingswood - KT20 6RP Contract type: Permanent Working Pattern: Hybrid working 3 days in the office and 2 at home Agile working after 3 months We are looking for a well-rounded individual with an expert level of technical proficiency that can also think strategically. They should possess the ability to understand, develop, and educate others as we transform our capability. Your core purpose will be to create robust, reliable and relevant MI and analysis that enables our business to make better and data-led decisions and drive actionable outcomes; this will involve bringing multiple sets of complex data to life to create a complete view of our customer portfolio. The successful candidate will be responsible for: Maintain, manage and develop our view and understanding of the TGP customer portfolio (+ automated reporting of it) Produce, review & improve BAU commercial MI ensuring both reliability and efficiency in executing regular reporting Conducting ad-hoc analysis to understand our business performance, customer behaviour and segmentation of our portfolio, as well as the reasons behind any trends. Collaborate with subject matter experts across the business to deliver high quality insight with a practical application. Support the Commercial Data & MI Manger in timely and high-quality delivery of the reporting roadmap. Requirements and Skills: Expert understanding of data warehouse / data lake tools (e.q. SQL / Python),with a willingness to embrace and adapt to different tools as the architecture evolves. Ability to plan and execute a range of sequential projects and deliverables Track record of developing descriptive, predictive and prescriptive analytics using recognised data engineering/analysis tools and techniques. al Ability to manage relationships and conflicting priorities across a broad spectrum of stakeholders, whilst maintaining an exceptional level of service to them Nice to have skills Experience in data visualison tools such as Power BI degree or masters in Computer science We continually strive to bring together our vision and values: To be the UK’s most trusted energy supplier – we deliver what we promise About the company: TotalEnergies Gas & Power Ltd is one of the leading energy suppliers to industrial, commercial, and business customers within the UK. TotalEnergies is committed to net zero and aims to become one of the world’s largest renewable energy companies by the end of this decade. TotalEnergies Gas & Power is the largest gas supplier and third largest electricity supplier in the B2B market. As a company with a long history in gas and power, supplying more than 200,000 sites and more recently in renewable energy technologies, we have learned to be at the forefront of a changing marketplace, where we remain responsive and flexible and ensure that our core values and objectives are embedded within our organisation. We are committed to helping our customers become carbon net-zero by 2050 The Office Based at the Kingswood Field office KT20 6RP (Tadworth), a 28-acre office campus site set in the Surrey countryside with Trail walks. You will enjoy a modern vibrant and friendly working environment. We have an onsite restaurant and café with a wide range of options available, and coffee shop. There is a state-of-the-art on-site onsite gym run by Nuffield, with classes on set days in the mornings, at lunch and after work hours. We have a staff car park which includes electric charging points, an undercover and secure bike rack (useful if you’ve made the most of the Cycle-to-Work scheme), or if you will use public transport we have a private shuttle bus service that regularly runs between train station and the office at peak times. Diversity and Inclusion One of our values is respect for each other. Creating an inclusive environment in which everyone can express and develop their potential, from the moment they are hired and throughout their career, means ensuring that all our employees have the same opportunity to succeed, regardless of origin, gender, age, disability, sexual orientation, gender identity or affiliation with a political, religious, union, organization or minority group. This is our vision of diversity, which is an asset for our Group as well as for the individuals who embody it. Preserving and promoting this asset is another part of being a responsible employer
- Company Name
- Shaw Daniels Solutions
- Job Title
- Full Stack Engineer
- Job Description
- Role Overview Our client is seeking an experienced Full Stack Developer to enhance and maintain their web platforms, working across business functions and third-party providers. You’ll play a key role in developing scalable solutions, ensuring robust performance, and supporting IT transformation. Key Responsibilities Develop and maintain cross-browser, cross-platform web applications. Work with technical and product stakeholders to scope and estimate development work. Write high-quality, well-documented code and platform documentation. Debug and resolve technical issues, providing support as needed. Stay up to date with industry best practices, security, and performance optimization. Collaborate with cross-functional teams to deliver user-centric experiences. Essential Skills & Experience Languages: Strong experience with JavaScript (TypeScript preferred) and C#. Frameworks: Experience with full-stack meta frameworks (Next.js, Remix, Astro). APIs & Cloud: REST/GraphQL, Azure cloud, SaaS/PaaS integration. DevOps & Testing: CI/CD pipelines, Azure DevOps, Unit & E2E testing (Jest, Playwright). UX & SEO: Understanding of responsive design, user journeys, and SEO optimization. E-commerce: Experience with Google Shopping Feeds, ranking strategies, and third-party integrations. Soft Skills: Strong communication, problem-solving mindset, and adaptability.