Data Engineer
Hybrid
England, United Kingdom
Freelance
18-03-2025
Job Specifications
Data Engineer (Security Cleared)
Location – Northern Ireland (Belfast) If based in the UK candidates must be willing to frequently travel to Northern Ireland.
Contract – 6 Months
Day rate – Flexible (Inside IR35)
Your responsibilities in the role
Design and implement efficient data ingestion pipelines to and from databases and file storage services.
Transform data from source to target to ensure data quality and consistency, based in agreed specifications.
Build, maintain and optimise data pipelines to automate data flows and enable real time data processing.
Monitor data quality and implement measures to ensure data accuracy and completeness.
Manage and maintain databases to ensure optimal performance and security.
Deploy and manage data infrastructure on cloud platforms – primarily AWS
Work closely with data analysts, data scientists, and other stakeholders to understand their data needs and deliver high-quality data solutions.
Skills and Experience
AWS focused, Ideally a AWS Certified Data Engineer.
SQL, Python, and Spark and experience with metadata-driven ETL/ELT.
AWS Glue, Databrew, S3, AWS Lambda, PostgreSQL, Quicksight.
Version Control (Gitlab), CI/CD and IaC.
Familiar with security and networking principles, especially in AWS deployment.
Experience and understanding of handling both structured and unstructured data.
Complex data migrations.
Strong problem-solving analytical skills.
Excellent communication and collaboration skills.
Understanding of GIS data models.
Further information required upon application
About the Company
Our ambition is to work with IT solutions businesses and end clients to deliver outstanding IT resource. We are passionate about being the first choice for exceptional contractors and candidates seeking new opportunities. We also attract the most talented people seeking a personally rewarding career in IT recruitment. Our teams are passionate about what they do and this shows in their work. Our consultants are dedicated to building relationships with both clients and contractors. ECS has gone from strength to strength by co... Know more
Related Jobs
- Company Name
- Burns Sheehan
- Job Title
- Contract Head of Data Engineering
- Job Description
- Contract Head of Data Engineering / Hands on / Azure Stack / £750-950 per day (outside IR35) Role title: Contract Head of Data Engineering Tech Requirements: Hands on / Azure stack / Fabric ideally but not essential Location: London Office Requirements: 2-3 times per week Determination: Outside IR35 Interview Process - 2-3 stages Sector: Finance One of our clients is in the market for a Contract Head of Data Engineering to kickstart their migration to Azure technologies and build out a modern data platform. As a Contract Head of Data Engineering, you will be responsible for architecting and implementing the platform with the support of the Microsoft Consultants before hiring out the relevant people to contribute to this. You will need to be hands on as a Contract Head of Data Engineering but you will also need to be confident with speaking to stakeholders and collaborating with the AI Product teams and the Data Science functions in the org. If this role sounds of interest, don't hesitate & apply now for immediate consideration. Contract Head of Data Engineering / Hands on / Azure Stack / £750-950 per day (outside IR35)
- Company Name
- Practicus
- Job Title
- Analytics Engineer
- Job Description
- Analytics Engineer | 6-7 Month Contract | Hybrid | London | Circa £700 - £750/day Inside IR35 We are currently partnering with a long-standing Telecoms client, looking to find them a highly skilled and proactive Analytics Engineer to join their dynamic team on a 6-month contract (with potential for extension) starting March 2025. They are looking for a real self-starter, someone who can constantly look for improvements and better ways of working off their own initiative. If you don't have the drive to go above and beyond, this role isn't for you! Key Responsibilities: Productionise existing models and infrastructure Improve bug prevention and overall data quality Develop new products and models for cross-business unit initiatives Prototype new commercial initiatives rapidly Build scalable business logic models Required Skills and Experience: High-level proficiency in GCP, DBT, SQL and Python Strong focus on data quality and testing methodologies Proven track record of proactive problem-solving and process improvement Ability to provide consultative advice on best practices Experience in analytics engineering, preferably in a fast-paced environment Logistics: 6-7 month contract £700-£750 per day inside IR35 Hybrid working policy based in Central London
- Company Name
- Ubique Systems
- Job Title
- Data Warehouse Engineer
- Job Description
- The ideal candidate with a minimum of 5 +years of experience having strong experience working with Snowflake, DBT, Python, and AWS to deliver ETL/ELT Pipelines using different resources. • Proficiency in Snowflake data warehouse architecture Design, build, and optimize ETL/ELT pipelines using DBT (Data Build Tool) and Snowflake. • Experience with DBT (Data Build Tool) for data transformation and modelling. Implement data transformation workflows using DBT (core/cloud). • Strong Python programming skills for automation and data processing. Leverage Python to create automation scripts and optimize data processing tasks. • Proficiency in SQL performance tuning, and query optimization techniques using snowflake. • Troubleshoot and optimize DBT models, and Snowflake performance. • Knowledge of CI/CD, version control (Git) tools. Experience with orchestration tools such as Airflow, • Strong analytical and problem-solving skills with an ability to work in agile development environment independently. • Ensure data quality, reliability, and consistency across different environments. • Collaborate with other data engineers, data analysts, and business stakeholders to understand data needs and translate them into engineering solutions.
- Company Name
- Lorien
- Job Title
- IT Support Engineer - Data Centre Exp
- Job Description
- Hardware Engineer - Data Centre Exp Macmerry, East Lothian - Onsite 5 days a week 6 month contract Inside of IR35 £24.66 per hour Rota of early/late shift Requirement for oncall cover out of hours including weekends ( 1 in 4) Duties to Include Providing full IMAC service (install/Decom/Moves) across both the clients DC’s leveraging the customer and manufactures tools, such as Part surfer, Intelligent provisioning, CMDB, ServiceNow. Also providing a smart hands service to the clients IT Security team, across all of their Datacentre located kit, from initial troubleshooting up to replacing the entire unit through a RMA process, then installing and providing base configuration for the replacement device to allow IT Security to obtain remote access Providing Tape Management (Ejects/loads) for the Remote Backup team. Key Skills & Experience Previous experience in Datacentres essential Good customer service skills Flexible attitude Enjoys working as part of a team and also ability to use own initiative If you are available and interested please apply today!