Data Engineer
Hybrid
England, United Kingdom
Freelance
18-03-2025
Job Specifications
Data Engineer (Security Cleared)
Location – Northern Ireland (Belfast) If based in the UK candidates must be willing to frequently travel to Northern Ireland.
Contract – 6 Months
Day rate – Flexible (Inside IR35)
Your responsibilities in the role
Design and implement efficient data ingestion pipelines to and from databases and file storage services.
Transform data from source to target to ensure data quality and consistency, based in agreed specifications.
Build, maintain and optimise data pipelines to automate data flows and enable real time data processing.
Monitor data quality and implement measures to ensure data accuracy and completeness.
Manage and maintain databases to ensure optimal performance and security.
Deploy and manage data infrastructure on cloud platforms – primarily AWS
Work closely with data analysts, data scientists, and other stakeholders to understand their data needs and deliver high-quality data solutions.
Skills and Experience
AWS focused, Ideally a AWS Certified Data Engineer.
SQL, Python, and Spark and experience with metadata-driven ETL/ELT.
AWS Glue, Databrew, S3, AWS Lambda, PostgreSQL, Quicksight.
Version Control (Gitlab), CI/CD and IaC.
Familiar with security and networking principles, especially in AWS deployment.
Experience and understanding of handling both structured and unstructured data.
Complex data migrations.
Strong problem-solving analytical skills.
Excellent communication and collaboration skills.
Understanding of GIS data models.
Further information required upon application
About the Company
Our ambition is to work with IT solutions businesses and end clients to deliver outstanding IT resource. We are passionate about being the first choice for exceptional contractors and candidates seeking new opportunities. We also attract the most talented people seeking a personally rewarding career in IT recruitment. Our teams are passionate about what they do and this shows in their work. Our consultants are dedicated to building relationships with both clients and contractors. ECS has gone from strength to strength by co... Know more
Related Jobs
- Company Name
- Shareforce Ltd
- Job Title
- Azure Data Engineer - Outside IR35
- Job Description
- Azure Data Engineer to play a key role in the data-led Microsoft Cloud transformation of a leading sustainability and environmental services provider. Rate offered: £525-575 per day IR35 Status: Outside Location: Remote with occasional travel onsite in Newcastle This is an exciting contract opportunity for an experienced Azure Data Engineer to play a key role in the data-led Microsoft Cloud transformation of a leading sustainability and environmental services provider. The successful candidate will use their knowledge of cutting-edge MS data platforms and technologies to lead the build of a robust integration platform that synchronises on-premises MCS CRM with Dynamics 365 in real-time, while also enhancing data analytics capabilities through Databricks and PowerBI. Responsibilities: Design and implement scalable data pipelines and ETL processes using Azure and Databricks technologies including Delta Live Tables. Lead technical discussions with clients and stakeholders to gather requirements and propose solutions. Help clients realise the potential of data science, machine learning, and scaled data processing within Azure / Databricks ecosystem. Lead the design and development of the on-premise Microsoft Customer Service (MCS) CRM real-time integration with Microsoft Dynamics 365. Mentor junior team members and support their personal development . Take ownership for the delivery of core solution components. Support with planning, requirements refinement and work estimation. Skills and Experiences: Design and develop end-to-end data solutions leveraging Azure services for real-time integration (including data ingestion, cleansing and modelling). Strong background of enterprise data platform development, concepts and methods such as data warehouses and data lakehouse, with the ability to adapt and tailor based on requirements. Knowledge on Microsoft Dynamics 365 and CRM systems. Proficient in Azure Databricks, Delta Live Tables and Azure Data Factory. Expert Python, SQL and developer tooling such Visual Studio Code, Azure DevOps. Good understanding of data governance and data architecture design principles. Excellent communication skills. Desirable certification in Azure Data Engineering and Databricks Engineering. Additional Information: Rate offered: £525-575 per day IR35 Status: Outside Location: Remote with occasional travel onsite in Newcastle Start date: April Duration: 3 months initial sign up with significant opportunity for extension
- Company Name
- Hays
- Job Title
- Geospatial Data Engineer
- Job Description
- Job Description: The Geospatial Data Engineer will play a key role in advancing the accuracy and precision of mobile network data (MND) products. Responsibilities include developing methodologies to improve user location inference, designing a proof of concept for a localized population density product, implementing scalable solutions, and collaborating with cross-functional teams to ensure robust data pipelines and production-ready models. Key Responsibilities: Enhance location inference models using MND data. Design and validate a localized population density product. Develop and optimize data pipelines for efficiency and scalability. Drive continuous improvement in data processing and modeling practices. Ensure outputs align with business needs, providing actionable insights. Respond to technical challenges, ensuring data integrity and consistency. Qualifications: Experience with large-scale data processing and geospatial data analysis. Strong experience in writing, deploying, and optimizing code (Python, SQL, or equivalent). Deep understanding of databases and efficient analytical queries. Proficiency with Git for version control. Strong statistical and mathematical background. Excellent problem-solving, organizational, and time management skills. Strong business awareness and communication skills. This is a Initial 6 month contract opportunity paying £500 per day Inside IR35 and it is a Hybrid opportunity with the expectation of 2 days in the London Office.
- Company Name
- Incite-Insight.co.uk
- Job Title
- Head of Data Management
- Job Description
- Head of Data and Applications Contract Role: £600-800 p/d Outside IR35 Your core purpose will be to lead the organisation on its journey to become an evidence–led, data-driven organisation that uses actionable insight and great products to deliver on it’s vision You will develop, champion and lead the data and application development vision, strategies, architectures and roadmaps You will lead a team of talented and committed data and application development colleagues to deliver maximum value at pace You will lead and represent on all things data at various governance forums You will champion and lead the continued adoption and refinement of new ways of working (empowered teams), processes, tools and frameworks (agile - scrum, kanban, DevOps, product management etc.) You will collaborate with a range of stakeholders across the organisation to identify and prioritise the data and application development backlogs and will be accountable for delivery against these backlogs You will lead and define all things data governance, quality, stewardship, ownership, literacy and standards and work with alongside the CISO on data security and privacy You will be accountable for building great products that delight colleagues and help them be more productive in their roles and deliver value to the organisation What you will bring The ability to articulate a compelling vision to a diverse range of stakeholders The ability to balance strategic needs against tactical demands The ability to translate tech and data complexity to a non-technical stakeholder audience The ability to coach, motivate and empower teams to deliver a vision The ability to drive change and implement governance processes Your desire to deliver excellent solutions to delighted customers Integrity and professionalism Highly effective communication and collaboration skills Your experience Significant experience in a data related role Experience in an application development (low-code) related role Good knowledge and experience of all elements of data management (architecture, operations, master/reference/meta data mng, data warehousing/date lakes, BI, visualisation, data quality, governance, security and privacy) Evidence of driving insight from data Thorough understanding of full data and software development lifecycles Developing and delivering data and application strategies Utilising modern data platforms (preferably MS Azure Data Platform) to deliver outstanding BI solutions Good experience of data and software architecture and patterns Strong experience of implementing and maturing multiple delivery methodologies – agile, scrum, Kanban, DevOps Experience within Accounting, Law or Professional Services sectors is highly desirable
- Company Name
- Burns Sheehan
- Job Title
- Contract Head of Data Engineering
- Job Description
- Contract Head of Data Engineering / Hands on / Azure Stack / £750-950 per day (outside IR35) Role title: Contract Head of Data Engineering Tech Requirements: Hands on / Azure stack / Fabric ideally but not essential Location: London Office Requirements: 2-3 times per week Determination: Outside IR35 Interview Process - 2-3 stages Sector: Finance One of our clients is in the market for a Contract Head of Data Engineering to kickstart their migration to Azure technologies and build out a modern data platform. As a Contract Head of Data Engineering, you will be responsible for architecting and implementing the platform with the support of the Microsoft Consultants before hiring out the relevant people to contribute to this. You will need to be hands on as a Contract Head of Data Engineering but you will also need to be confident with speaking to stakeholders and collaborating with the AI Product teams and the Data Science functions in the org. If this role sounds of interest, don't hesitate & apply now for immediate consideration. Contract Head of Data Engineering / Hands on / Azure Stack / £750-950 per day (outside IR35)