Software Engineer (SC Cleared)- Azure Data & DevOps
Hybrid
London, United Kingdom
£ 50,000 / year
Full Time
12-03-2025
Job Specifications
About the Role
Scrumconnect Consulting is looking for a Software Engineer to work on a Strategic Data Platform with expertise in Azure Data Factory (ADF), Python, PySpark, Java, Terraform, and Azure DevOps . The ideal candidate will have experience in cloud-based data engineering, automation, and infrastructure provisioning while working in an Azure environment .
You will be responsible for developing scalable data pipelines, integrating cloud services, automating deployments, and supporting DevOps workflows .
Key Responsibilities:
1. Software Engineer
Develop, test, and deploy scalable data pipelines using Azure Data Factory (ADF), Python, PySpark, and Java .
Implement data transformation, ETL/ELT workflows, and data integration solutions .
Optimize data flow and performance for cloud-based data processing.
2. Cloud & Infrastructure Automation
Use Terraform to provision and manage Azure resources .
Implement infrastructure as code (IaC) best practices for automated cloud deployments.
Ensure efficient resource scaling and cost optimization .
3. DevOps & CI/CD Automation
Collaborate with DevOps teams to build automated CI/CD pipelines in Azure DevOps .
Deploy and manage containerized applications using Docker & Kubernetes .
Monitor and troubleshoot build, deployment, and infrastructure issues .
4. Performance Optimisation & Security
Optimise data pipeline performance in Azure.
Implement cloud security best practices and ensure compliance with data governance policies.
Troubleshoot data and infrastructure-related performance issues .
5. Collaboration & Documentation
Work closely with data engineers, cloud architects, and DevOps teams to design solutions.
Participate in agile ceremonies, sprint planning, and technical discussions .
Maintain technical documentation and best practices .
Required Skills & Experience:
? Software Development & Data Engineering
Strong experience in: Python, PySpark, Java, Azure Data Factory (ADF) .
Data Processing & Pipelines: ETL/ELT development, big data frameworks.
Cloud Services: Hands-on experience with Azure Data Lake, Synapse, and Azure Functions .
? Infrastructure as Code (IaC) & Automation
Terraform expertise for Azure resource provisioning.
Experience in cloud infrastructure automation and DevOps workflows .
? DevOps & CI/CD
Experience with Azure DevOps, Git, YAML pipelines .
Ability to work with Docker, Kubernetes, and containerized applications.
? Other Skills
Strong problem-solving and debugging skills.
Experience working in Agile/Scrum environments .
Excellent communication and collaboration skills.
Nice to Have:
Experience with Databricks, Apache Spark, or ML workloads .
Knowledge of security best practices in cloud environments .
Azure, Terraform, or DevOps-related certifications .
About the Company
Scrumconnect, an acclaimed consultancy firm, sets the gold standard in crafting sophisticated, user-centric software solutions underpinned by data-driven insights. Our robust software solutions have cast a global footprint, influencing over 50M individuals via 64 robust digital offerings. As trusted allies in public sector transformation, we've partnered with 20% of the top 75 Govt Services, yielding savings exceeding PS24 million for UK taxpayers. Our mission is simple: transform public services into exceptional digital e... Know more
Related Jobs
- Company Name
- Viator
- Job Title
- Software Engineering Intern (Viator)
- Job Description
- Viator, a Tripadvisor company, is the leading marketplace for travel experiences. We believe that making memories is what travel is all about. And with 300,000+ travel experiences to explore—everything from simple tours to extreme adventures (and all the niche, interesting stuff in between)—making memories that will last a lifetime has never been easier. With industry-leading flexibility and last-minute availability, it's never too late to make any day extraordinary. Viator. One app, 300,000+ travel experiences you’ll remember. This year, the London and Lisbon engineering teams have opened up a number of internship roles to join them for summer 2025. A Tripadvisor internship provides real world experience as part of a world-class engineering team, along with an excellent salary and other perks. Several of our former interns have gone on to become full-time members of the Engineering team. We have a fun and friendly environment where the key objective is getting things done. Our engineers input during every stage whilst delivering technical solutions, from design, to programming, testing, and deployment. Across Tripadvisor, we’ve worked hard to create an atmosphere of “Speed Wins” – streamlining processes, shipping products quickly, and avoiding big company paralysis. Tripavisor prides itself on being a bottom-up organisation. Engineers are given the freedom to investigate, implement, and own the solutions they formulate within their team. Do you want to build features end to end? Do you want to work with a large number of technologies? Do you want to work in an environment where things move quickly, features are released daily and you’re working with other smart and talented engineers? If this sounds like you, we would love to talk to you. What You’ll Do Code! Most of our engineers release code to production every few days. The majority of our services are continuously released with the others following a daily release cycle. Real work! From day one, Tripadvisor interns work on the same tasks as our main Engineering team. Learn! You’ll be assigned a dedicated mentor and work alongside skilled engineers with a wide range of backgrounds and experiences. Collaborate! We have engineering groups located around the world. We’re working with teams in the US, Portugal and Australia, as well as with third parties. Operate across our evolving technology stack - Currently this includes Java, React, JavaScript, TypeScript, AWS, MySQL, GraphQL and more. Take responsibility for all aspects of software engineering, from design to implementation, QA, and maintenance. Touch code at every level – from the UI, through backend microservices, and down to the database. Collaborate closely with Product and Design teams to define feature specifications and develop high quality deliverables for our customers. What We’re Looking For Students in their second year or later, working towards a degree in Computer Science or a similar discipline. You do need to be confident writing code in at least one object-oriented language. Willingness and ability to take on new technologies. You do not need to have experience with all the technologies listed above, but you do need the drive to learn them. Ability to break down complex problems into simple solutions. Strong analytical skills and desire to write clean, correct, and efficient code. High quality verbal and written communication skills. A sense of ownership, urgency, and pride in your work. People who can dedicate at least ten weeks between June and September 2025. Our Values We aspire to lead; We’re relentlessly curious;... want to know more? Read up on our values: We aspire to lead. Tap into your talent, ambition, and knowledge to bring us – and you – to new heights. We’re relentlessly curious. We push beyond the usual, the known, the “that’s just how it’s done.” We’re better together. We learn from, accept, respect, support, and value one another– and are creating something remarkable in the process. We serve our customers, always. We listen, question, respond, and strive for wow moments. We strive for better, not perfect. We won’t get it right the first time – or every time. We’ll provide a safe environment in which to make mistakes, iterate, improve, and grow. Our workplace is for everyone, as is our people powered platform. At Tripadvisor, we want you to bring your unique identities, abilities, and experiences, so we can collectively revolutionize travel and together find the good out there. #Viator
- Company Name
- Platformed
- Job Title
- Senior Software Engineer (FE Focus)
- Job Description
- We have an exciting opportunity for a frontend-focused full stack engineer to join our team early in our company journey, reporting to the CTO and working alongside the founders. Role You'll build a SaaS application using modern technologies (TypeScript, React and Rust). While you'll work across the stack, you'll have a particular focus on our ChakraUI-based application frontend and user experience. You'll be a champion for great UX and product experience within engineering, working closely with our CS team and founders to understand customer needs and product vision. You’ll build prototype solutions, as well as complete features from end-to-end. You'll influence what we build together, not just how we build it - you'll decide where we should focus our efforts to deliver the most value for our customers, and lay a solid foundation for the product and the business in the future. You'll work alongside engineers with previous experience building and scaling a B2B SaaS product from zero to exit, helping to create a product that's not just functional, but delightful to use. We’re looking for someone who… is passionate about creating exceptional user experiences, iterating quickly in response to research and feedback. is primarily focused on frontend development but fully capable of building end-to-end features - you should be comfortable taking a feature from UI design through to API implementation. has 5+ years of experience in Software Engineering, building customer-facing applications where you spoke directly to users. has deep expertise with modern frontend technologies (TypeScript, React). has working knowledge of backend development with a typed programming language, and a willingness to learn Rust. has experience with rapid prototyping and user testing, and can demonstrate instances where you've turned user feedback into product improvements. is able to spend at least 2 days (Monday + Tuesday) per week at our office in Central London. Company Benefits Every role comes with generous equity options. 33 days of annual leave per year. This includes public holidays (you are free to take them on public holidays or not). The first Friday of every month is a company-wide day off, which doesn’t eat up your leave allowance. Just promise to post your bungee-jumping selfies on #random. Interview Process 30-minute initial call. Take-home task. Half-day on-site final interviews.
- Company Name
- Venture Up
- Job Title
- Python Developer
- Job Description
- Python Software Developer – London *Please note this role cannot sponsor. Please do not apply if you are seeking sponsorship* A number of Python Software Developers are required for an exciting and innovative Software sports betting company based in London. The successful candidates will be working closely with the quantitative researchers and alongside other extremely talented and driven engineers to build and support systematic trading models. An interest in functional programming and its application in the real world would be useful. The roles would suit candidates with 5+ years experience and significant part of childhood spent hacking away in 8-bit assembly language. You will be joining a tight-knit team of research mathematicians, computer scientists and trading analysts at the top of their chosen fields. Essential Skills ·5+ years commercial experience in python programming Ability to program in an object oriented, functional or dynamic language, exhibited by personal projects, open source contributions, or commercial experience. ·Knowledge of algorithms and data structures. ·Knowledge of relational databases and SQL. ·An interest in new technologies, theoretical computer science, and/or mathematics. Benefits: Working alongside other extremely talented and driven engineers Extremely lucrative salary, bonus and benefits Greenfield Python/Golang work, both challenging and rewarding Join an exciting company with many opportunities to progress your Python and functional programming career. Send your CV for immediately review and further details.
- Company Name
- SkillRecruit
- Job Title
- Linux Infrastructure System and DevOps Engineer
- Job Description
- Job Opportunity: Linux Infrastructure System and DevOps Engineer Are you a skilled Linux Infrastructure System and DevOps Engineer seeking a permanent role? An exciting opportunity awaits in Solihull (Hybrid) for individuals eligible or cleared for SC. Join a prestigious public sector project focused on enhancing HDE tooling to facilitate desktop and server provisioning for the Birmingham site. Embrace a dynamic setting where adaptability is key. Key Technologies: - Proficiency in Puppet Framework - Expertise in Ubuntu Operating System 19.0+ - Strong background in Shell Scripting & Python - Familiarity with JIRA and Confluence - Knowledge of Ubuntu Package Management - Experience with VMWare If you are passionate about Linux infrastructure, DevOps, and cutting-edge technologies, this role offers a stimulating environment with room for growth and innovation. Elevate your career by contributing to a transformative project in the public sector. #LinuxEngineer #DevOps #PublicSector #TechnologyOpportunity