Data Engineer
Hybrid
England, United Kingdom
Freelance
18-03-2025
Job Specifications
Data Engineer (Security Cleared)
Location – Northern Ireland (Belfast) If based in the UK candidates must be willing to frequently travel to Northern Ireland.
Contract – 6 Months
Day rate – Flexible (Inside IR35)
Your responsibilities in the role
Design and implement efficient data ingestion pipelines to and from databases and file storage services.
Transform data from source to target to ensure data quality and consistency, based in agreed specifications.
Build, maintain and optimise data pipelines to automate data flows and enable real time data processing.
Monitor data quality and implement measures to ensure data accuracy and completeness.
Manage and maintain databases to ensure optimal performance and security.
Deploy and manage data infrastructure on cloud platforms – primarily AWS
Work closely with data analysts, data scientists, and other stakeholders to understand their data needs and deliver high-quality data solutions.
Skills and Experience
AWS focused, Ideally a AWS Certified Data Engineer.
SQL, Python, and Spark and experience with metadata-driven ETL/ELT.
AWS Glue, Databrew, S3, AWS Lambda, PostgreSQL, Quicksight.
Version Control (Gitlab), CI/CD and IaC.
Familiar with security and networking principles, especially in AWS deployment.
Experience and understanding of handling both structured and unstructured data.
Complex data migrations.
Strong problem-solving analytical skills.
Excellent communication and collaboration skills.
Understanding of GIS data models.
Further information required upon application
About the Company
Our ambition is to work with IT solutions businesses and end clients to deliver outstanding IT resource. We are passionate about being the first choice for exceptional contractors and candidates seeking new opportunities. We also attract the most talented people seeking a personally rewarding career in IT recruitment. Our teams are passionate about what they do and this shows in their work. Our consultants are dedicated to building relationships with both clients and contractors. ECS has gone from strength to strength by co... Know more
Related Jobs
- Company Name
- Hays
- Job Title
- Geospatial Data Engineer
- Job Description
- Job Description: The Geospatial Data Engineer will play a key role in advancing the accuracy and precision of mobile network data (MND) products. Responsibilities include developing methodologies to improve user location inference, designing a proof of concept for a localized population density product, implementing scalable solutions, and collaborating with cross-functional teams to ensure robust data pipelines and production-ready models. Key Responsibilities: Enhance location inference models using MND data. Design and validate a localized population density product. Develop and optimize data pipelines for efficiency and scalability. Drive continuous improvement in data processing and modeling practices. Ensure outputs align with business needs, providing actionable insights. Respond to technical challenges, ensuring data integrity and consistency. Qualifications: Experience with large-scale data processing and geospatial data analysis. Strong experience in writing, deploying, and optimizing code (Python, SQL, or equivalent). Deep understanding of databases and efficient analytical queries. Proficiency with Git for version control. Strong statistical and mathematical background. Excellent problem-solving, organizational, and time management skills. Strong business awareness and communication skills. This is a Initial 6 month contract opportunity paying £500 per day Inside IR35 and it is a Hybrid opportunity with the expectation of 2 days in the London Office.
- Company Name
- Incite-Insight.co.uk
- Job Title
- Head of Data Management
- Job Description
- Head of Data and Applications Contract Role: £600-800 p/d Outside IR35 Your core purpose will be to lead the organisation on its journey to become an evidence–led, data-driven organisation that uses actionable insight and great products to deliver on it’s vision You will develop, champion and lead the data and application development vision, strategies, architectures and roadmaps You will lead a team of talented and committed data and application development colleagues to deliver maximum value at pace You will lead and represent on all things data at various governance forums You will champion and lead the continued adoption and refinement of new ways of working (empowered teams), processes, tools and frameworks (agile - scrum, kanban, DevOps, product management etc.) You will collaborate with a range of stakeholders across the organisation to identify and prioritise the data and application development backlogs and will be accountable for delivery against these backlogs You will lead and define all things data governance, quality, stewardship, ownership, literacy and standards and work with alongside the CISO on data security and privacy You will be accountable for building great products that delight colleagues and help them be more productive in their roles and deliver value to the organisation What you will bring The ability to articulate a compelling vision to a diverse range of stakeholders The ability to balance strategic needs against tactical demands The ability to translate tech and data complexity to a non-technical stakeholder audience The ability to coach, motivate and empower teams to deliver a vision The ability to drive change and implement governance processes Your desire to deliver excellent solutions to delighted customers Integrity and professionalism Highly effective communication and collaboration skills Your experience Significant experience in a data related role Experience in an application development (low-code) related role Good knowledge and experience of all elements of data management (architecture, operations, master/reference/meta data mng, data warehousing/date lakes, BI, visualisation, data quality, governance, security and privacy) Evidence of driving insight from data Thorough understanding of full data and software development lifecycles Developing and delivering data and application strategies Utilising modern data platforms (preferably MS Azure Data Platform) to deliver outstanding BI solutions Good experience of data and software architecture and patterns Strong experience of implementing and maturing multiple delivery methodologies – agile, scrum, Kanban, DevOps Experience within Accounting, Law or Professional Services sectors is highly desirable
- Company Name
- Burns Sheehan
- Job Title
- Contract Head of Data Engineering
- Job Description
- Contract Head of Data Engineering / Hands on / Azure Stack / £750-950 per day (outside IR35) Role title: Contract Head of Data Engineering Tech Requirements: Hands on / Azure stack / Fabric ideally but not essential Location: London Office Requirements: 2-3 times per week Determination: Outside IR35 Interview Process - 2-3 stages Sector: Finance One of our clients is in the market for a Contract Head of Data Engineering to kickstart their migration to Azure technologies and build out a modern data platform. As a Contract Head of Data Engineering, you will be responsible for architecting and implementing the platform with the support of the Microsoft Consultants before hiring out the relevant people to contribute to this. You will need to be hands on as a Contract Head of Data Engineering but you will also need to be confident with speaking to stakeholders and collaborating with the AI Product teams and the Data Science functions in the org. If this role sounds of interest, don't hesitate & apply now for immediate consideration. Contract Head of Data Engineering / Hands on / Azure Stack / £750-950 per day (outside IR35)
- Company Name
- Practicus
- Job Title
- Analytics Engineer
- Job Description
- Analytics Engineer | 6-7 Month Contract | Hybrid | London | Circa £700 - £750/day Inside IR35 We are currently partnering with a long-standing Telecoms client, looking to find them a highly skilled and proactive Analytics Engineer to join their dynamic team on a 6-month contract (with potential for extension) starting March 2025. They are looking for a real self-starter, someone who can constantly look for improvements and better ways of working off their own initiative. If you don't have the drive to go above and beyond, this role isn't for you! Key Responsibilities: Productionise existing models and infrastructure Improve bug prevention and overall data quality Develop new products and models for cross-business unit initiatives Prototype new commercial initiatives rapidly Build scalable business logic models Required Skills and Experience: High-level proficiency in GCP, DBT, SQL and Python Strong focus on data quality and testing methodologies Proven track record of proactive problem-solving and process improvement Ability to provide consultative advice on best practices Experience in analytics engineering, preferably in a fast-paced environment Logistics: 6-7 month contract £700-£750 per day inside IR35 Hybrid working policy based in Central London