cover image
Matchtech

Data Engineer

Hybrid

Cheltenham, United Kingdom

Freelance

03-04-2025

Share this job:

Score my CV

Job Specifications

Our client, a prominent agency in the Defence and Security sector, is currently seeking a skilled Data Engineer / Back End Developer for a contract position. This role is ideal for someone who excels in both data engineering and IT backend development, particularly within the defence and security context.
Key Responsibilities:
Providing direction within the scrum team
Liaising with the engineering lead
Helping the scrum team decompose user requests and key results into epics and stories
Writing clean, secure code following a test-driven approach
Creating code that is open by default and easily reusable
Translating logical designs into physical designs and producing detailed designs
Effectively documenting all work using required standards, methods, and tools
Working with both well-established and emerging technologies to identify appropriate patterns
Integrating API/UI components with existing data stores and APIs
Maintaining and developing existing architectural components, including Data Ingest, Data Stores, and REST APIs
Participating in sprint ceremonies with the agile team, attending daily stand-ups, epic decomposition, demos, and planning sessions
Assisting the wider team to understand upcoming API features and their impact
Collaborating with user researchers and representing users internally
Explaining the difference between user needs and the desires of the user

Job Requirements:
Experience in data engineering and backend development within the defence and security sector
Technical proficiency in:
Spring Boot
Java Enterprise development
React / VueJS / AngularJS
Apache Nifi
Flink
Desired technical skills (at least 3 of the following):
Ansible
Docker
Kubernetes
Grafana / Prometheus
Linux Sys Admin for deployed Clusters (10's of servers)
Gitlab Pipeline development
Integration / debugging
Understanding complex system architectures
Technologically curious / Willing / Able to tactically upskill new technologies
Network Analysis, or network domain knowledge

If you are a proficient Data Engineer / Back End Developer with a keen understanding of the defence and security sector, we would like to hear from you. Apply now to join our client's dedicated team and contribute to critical projects.

About the Company

We are a leading global STEM recruitment specialist, with nearly 40 years’ experience in successfully matching job-seekers with hiring employers within the engineering industry. Our 300-strong team of dedicated recruitment consultants work with business clients and candidates alike to find high-quality, long-lasting pairings that help fulfil the ambitions of all involved. We provide recruitment services across sectors that require STEM talent, including Infrastructure, Energy, Mobility, Defence, Technology, Media & Teleco... Know more

Related Jobs

Company background Company brand
Company Name
Lucid Support Services Ltd
Job Title
Data Analyst
Job Description
Data Analyst (SC Cleared) Location: Remote-working – Occasional visits to London office Rate: £400.00pd (Inside IR35) Security Clearance: SC Cleared (or eligibility to obtain SC clearance) Join an exciting new Automation and Innovation project within central Government as a Data Analyst. This role offers a unique opportunity to contribute to groundbreaking initiatives, leveraging data insights to transform public services and policy-making processes. As a Data Analyst in this innovative project, you'll have the chance to apply your analytical skills to complex challenges, working on cutting-edge solutions that have the potential to revolutionize government operations. Key Responsibilities: Conduct in-depth data analysis to uncover insights and inform decision-making processes. Develop and maintain reports, dashboards, and visualizations to communicate findings to both technical and non-technical stakeholders. Collaborate with cross-functional teams to identify opportunities for data-driven automation and process improvement. Assist in the design and implementation of data quality checks and data validation processes. Support the development of data governance frameworks and best practices. Stay abreast of emerging trends in data analysis and propose innovative applications within the government context. Required Skills: Strong background in data analysis, with a degree in a relevant field such as Statistics, Mathematics, or Computer Science. Proficiency in data analysis tools such as Excel, SQL, and data visualization software (e.g., Tableau, Power BI). Experience with statistical modeling and data mining techniques. Familiarity with data quality principles and data governance best practices. Strong problem-solving skills and ability to translate complex data insights into actionable recommendations. Excellent communication skills to collaborate with both technical and non-technical stakeholders. Experience working with large datasets and a track record of delivering impactful data analysis projects. If you are available and interested in this opportunity, please apply for further information. Please note due to high volumes of applications we are unable to contact every application. If you do not hear back from us within 7 days of sending your application, please assume that you have not been successful on this occasion. At Lucid, we celebrate difference and value diverse perspectives, underpinned by our values ‘Honesty, Integrity and Pragmatism’. We are proud to provide equal opportunities in line with our Diversity and Inclusion policy and welcome applications from all suitably qualified or experienced people, regardless of personal characteristics. If you have a disability or health condition and seek support throughout the recruitment process, please do not hesitate to contact us via the details below.
London, United Kingdom
Remote
Freelance
04-04-2025
Company background Company brand
Company Name
hackajob
Job Title
Senior Azure Data Warehouse Developer
Job Description
hackajob is collaborating with Jisc to connect them with exceptional tech professionals for this role. Job Description Jisc Job description template V1.0 Job title: Senior Azure Data Warehouse Developer (Security Specialist) Grade: TDA3 Directorate: Data Collection & Statistics Department & Location: Data Management (Data Infrastructure & Statistics) Reports to: People Manager (Data Infrastructure & Statistics) Working style: Hybrid (see description below) Contract: 2 years Hybrid: A blend of working from your hub office and home working. Days in the office are not mandated, and the frequency of time worked in the office is agreed with your manager. Meeting in person is something we value so you may need to travel on occasion to our hub offices. About the team: The role sits within the Data Collection and Statistics Directorate and will be part of the smaller but versatile data warehouse team involving many aspects of data life cycle and interactions with the business unit but with a specific emphasis on data security management. The team also develops transactional, relational, object oriented and star schema databases, for the business community. About The Role And Project The HESA Security Architecture project, also known as Project Vulcan, aims to review the current architecture and security controls to ensure the implementation of appropriate security measures to protect, detect, and respond to any security incidents affecting any part of the architecture, web services and including database security and integrity. This is a role that requires experience in both data warehousing, Azure environments and data security and will be linked to a specific project. You will be working with other data warehouse developers, and you will be responsible for reviewing and implementing solutions in light of any key decisions made from Project (Vulcan) and its deliverables. You will be liaising with the Jisc business security team to ensure their needs are met. Key responsibilities and deliverables Review of overarching Azure architecture using zero trust architecture in database and security first methodologies. Review access permissions applied to logical database servers in Azure which host critical Azure SQL Server instances and data sets. To review and recommend perimeter and database security controls to protect, detect and respond to security and database issues. To review and recommend database security controls to protect data, including least privilege principle and need to know. Identify all data sets within Azure infrastructure which contain Personal Data (PD). Review the business need and ensure appropriate granular separation is in place with firewall rules to limit access. To review and make recommendations on non-production environments. Assess where data content should be deleted or moved into a higher security archive location with strong protection assigned to these. To review authentication and authorisations methodologies across the service and databases. To review backup processes in accordance with the business and regularity requirements to ensure integrity and confidentiality is applied, including whether to adopt customer managed encryption keys. Work with internal teams to test any security controls implemented to protect the services. To review azure architecture in accordance with best practices defined by the vendor. Work with the Jisc Business Continuity Team to ensure that their Business Continuity, Disaster Recovery, and Incident Response processes are in place and tested accordingly to protect the business and the data. Ensuring that Recovery Time Objective (RTO) and Recovery Point Objective (RPO) have been agreed. Experience Need to have Extensive and demonstrable experience of data security & protocols. Comprehensive understanding of data warehouse analysis and design experience, with knowledge of data warehouse methodologies and data modelling. Strong understanding of relational database structures, theories, principles, and practices. Experience of data warehouse architecture review activity Understanding of fundamentals of Business Continuity and disaster recovery in line with database platforms Experience of working with Azure, Cloud and Data Warehouse factory Understanding of Microsoft Active Directory Optimisation of performance within a secure environment Skills & personal qualities Need to have Ability to analyse project requirements into technical solutions according to specifications. Ability to work in a team-oriented, collaborative environment. Good oral communication, presentation and interpersonal skills. Good analytical, conceptual, and problem-solving abilities. Self-motivated and able to prioritise and execute tasks. Undertake a methodical approach to work, especially when working under pressure Organise own time in order to meet deadlines and work commitments Work accurately and paying scrupulous attention to detail Qualifications & Training (if Applicable) Need to have Microsoft DBA fundamentals - example Azure Data fundamentals Or SQL applied qualification - certification M365 certification DBS required or enhanced background screening: This position requires the successful candidate to undergo enhanced background screening checks, which include but is not limited to Basic / Enhanced UK criminal record check Credit check International fraud and sanctions. We are constantly changing and evolving at Jisc, so this job description just gives a flavour of what the role involves. It will change as our operations develop.
United Kingdom
Remote
Freelance
04-04-2025
Company background Company brand
Company Name
Hyper Recruitment Solutions
Job Title
Biomedical Data Enablement Lead
Job Description
We are currently looking for a Biomedical Data Enablement Lead to join a Pharmaceutical company based in Berkshire. As the Biomedical Data Enablement Lead, you will be responsible for driving a number of data initiatives across the department to support maximizing the value extracted from data. This role is a hybrid role offering 3 days remote and 2 days on site. Key Duties And Responsibilities Your duties as the Biomedical Data Enablement Lead will be varied; however, the key duties and responsibilities are as follows: As the Biomedical Data Enablement Lead, you develop and roll out guidelines for the proper handling, storage, protection, and dissemination of data, including Knowledge Management guidelines for project teams. As the Biomedical Data Enablement Lead, you lead the implementation of data management standards across the department. As the Biomedical Data Enablement Lead, you design and deploy a cultural transformation journey to upskill the workforce on the proper management and usage of data as part of the Digital Education efforts. As the Biomedical Data Enablement Lead, you actively engage in the Data and Technology Enablement Group, overseeing data acquisition efforts and acting as the department community manager for the global data catalogue. Role Requirements To be successful in your application to this exciting role as the Biomedical Data Enablement Lead, we are looking to identify the following on your profile and past history: Relevant degree in a scientific or data-related field. Proven industry experience in data management and governance. A working knowledge and practical experience with data cataloguing tools such as Collibra. Key Words: Biomedical Data Enablement Lead / Data Management / Data Governance / Patient Solutions / Knowledge Management / Data Literacy / Data Maturity / Digital Education / Data Policies / Data Acquisition / Collibra Hyper Recruitment Solutions Ltd (HRS) is an Equal Opportunities employer. We welcome applications from anyone who meets the role requirements. HRS exclusively supports the Life Science sectors, combining recruitment expertise with scientific knowledge to help you advance your career.
England, United Kingdom
On site
Freelance
03-04-2025
Company background Company brand
Company Name
allpay Limited
Job Title
Azure Data Engineer (Fixed term contract)
Job Description
About The Role An exciting opportunity has arisen for an Azure Data Engineer on a fixed term contract to join our Data team at allpay limited. As an Azure Data Engineer some of your key duties will be to: Deliver data solutions in accordance with agreed organisational standards that ensure services are resilient, scalable and future-proof. Ensure data is secured across different clients and in line with legislation. Ensure that test data is masked appropriately in development and test systems. Triage data pipeline problems and data-related issues and coordinate between teams to ensure successful resolution. Liaise with all allpay departments and involvement in projects for future customer requirements and implementations. Will need to work very closely with all IT departments to meet with and exceed client expectations. Design, build, test, and maintain data pipelines to connect operational systems, data for analytics and BI systems Deliver services that are automated, reliable and secure About You You’ll demonstrate to us that you have: Degree or qualification/experience obtained in the field of Computer Science, IT, engineering, Maths, Physics or equivalent Microsoft Certified Azure Data Engineer Associate desirable. Designing, building, and optimising data ingestion/ETL pipelines suitable for on-prem and Cloud-based architectures. Azure technologies: Data Factory, Databricks, Data Lake, Cosmos, Azure Data Explorer, Logic apps, and KQL-Kusto. Data warehousing, Kimball’s methodology, in particular. Detailed understanding structured database systems, including MS SQL Server (essential) and MySQL (desirable) Advanced knowledge of SQL queries, stored procedures and triggers. Ability to tune and optimise query performance, recommend indexes. About Us allpay Limited are one of the fastest growing Fintech companies in the UK and are experts in the payment and financial services arena. We have also successfully diversified into a number of other sectors. People are at the heart of allpay and we reward our employee with a competitive benefits package which includes, a defined contribution group pension scheme, income protection, life assurance, an array of health and wellbeing options including private healthcare cover and an onsite gym. This is coupled with our excellent Learning and Development offering. We work with some great recruitment agencies. We don’t choose to partner with everyone. Explicit consent or confirmation must be received from our HR department before we accept CV’s. Contractual terms and specific campaigns must have been signed and agreed before you are considered a partner. We never accept unsolicited CV’s, EVER! Even from our trusted partners. We consider it “spoiling,” which does not endear you to us. By sending us unsolicited CV’s we deem these a free gift. If we choose to engage these candidates directly we will not pay you any fees. You will be deemed to have accepted this zero fee by providing unsolicited or spoiled candidates. We are a company committed to Equal Opportunities. All roles at allpay Limited are subject to successful background checks including a DBS and Credit Check. Apply Share Share Vacancy on Facebook Share Vacancy on X Share Vacancy on LinkedIn Send Vacancy to a friend
Hereford, United Kingdom
On site
Freelance
04-04-2025