Data Engineer
Hybrid
London, United Kingdom
Freelance
13-03-2025
Job Specifications
Job Title: Data Engineer
Location: UK (Remote)
Duration: Full-time contract, 6 Months
Summary:
• We are looking for a Data Engineer with expertise in Python development, who is passionate about cloud- based data engineering using AWS services and loves to build data solutions as part of multi-disciplinary team.
• You would be working closely with digital product professionals, data scientists, cloud engineers and others.
• You’ll be a member of a global team working on GenAI initiative, based in one of our European offices. Our Client’s Tech Ecosystem function is responsible for developing and delivering all technology solutions for the firm’s internal use.
• You will work in a team of data engineers to develop data ingestion pipelines, create and mature data processing capabilities that ingest data into a data system used by GenAI applications.
• Your work would include but won't be limited to creation of the python code, tests, creation and modification of GitHub Action CICD pipelines, working with AWS-based infrastructure and docker containers.
Responsibilities:
• You will work in a team of data engineers to develop data ingestion pipelines, create and mature data processing capabilities that ingest data into a data system used by GenAI applications. Work includes but not limited to creation of the python code, tests, creation and modification of GitHub Action CICD pipelines, working with AWS-based infrastructure and docker containers
Skills:
• 3+ years of professional experience as a data engineer, with a strong focus on cloud- based data engineering using AWS services
• Expertise with Python development
• Practicing high coding standards with clean code, modularity, error handling, testing automation and more
• Strong experience with relational databases
• Very driven, superstrong on execution and output orientation, likes to get job done attitude and ability to figure things out independently. Able to work in complex and very fast paced environment
• Hands-on experience with Docker
• Solid and demonstrable background in data pipeline performance and diagnostics
• Interest in Generative AI and other ML topics
• Kedro framework experience as a plus
• Holds their ground, opinionated, not afraid to speak up at any level
• Familiarity with agile principles and product development
• Excellent problem-solving skills and the ability to analyze and resolve complex data engineering challenges
• Strong communication and collaboration skills, with the ability to work effectively in a cross-functional team environment
About the Company
eTeam was formed in 1999 with the goal of becoming the supplier of choice for clients, employees and contingent workers. Today, we're one of the fastest-growing companies in New Jersey and ranked as one of the best companies to work for by Staffing Industry Analysts and New Jersey Business. We're also an honored member of Deloitte's Technology Fast 50. eTeam provides high-volume staffing, SOW and pay rolling services to structured contingent workforce programs and projects across the U.S., Canada and India. We also offer ... Know more
Related Jobs
- Company Name
- Revolution Technology Ltd
- Job Title
- Technical Data Engineer (London Market Insurance)
- Job Description
- Our client are a global consultancy, working on a project in the London Market Insurance space. They are on the lookout for a Data Engineer to come in on a contract basis. Key Skills/Requirements: R, Python & SQL experience Excel, Tableau & Power BI experience for Data Visualisation Experience designing and implementing API integrations Ideally experience in the London Market Insurance space Contract is running for 3 months initially with likely extensions, paying up to £425p/day (Inside IR35 via Umbrella) and will be 2 days per week in Central London.
- Company Name
- Robert Walters
- Job Title
- AWS Data Engineer
- Job Description
- AWS Data Engineer Location: Merseyside (Hybrid, office 2-3 times a week) Outside IR35 Duration: 6mths Rate: £400-500 per day AWS Data Engineer required for 6 months to drive the strategic data landscape, design complex data pipelines & collaborate with business functions to ensure value-driven data solutions. AWS Data Engineer Responsibilities Design and maintain scalable data pipelines for processing and transforming large data sets. Oversee data integration, ETL processes, and ensure data consistency across multiple sources Implement data quality standards and governance policies, addressing any data issues. Collaborate with various stakeholders and 3rd party providers, and mentor junior engineers, providing technical expertise. Lead data projects, ensuring efficient execution and alignment with business goals. The Ideal Candidate Will Have Extensive experience in data engineering, with a strong track record of designing and building complex data pipelines. Strong expertise in databases (SQL and NoSQL), data processing (dbt) and data warehousing solutions (e.g., Amazon Redshift, Google BigQuery, Snowflake). Familiarity with cloud platforms AWS and their data services. Strong problem-solving skills and attention to detail. Excellent communication and leadership skills to collaborate effectively with team members and stakeholders. If interested in this AWS Data Engineer please apply with your latest CV for immediate consideration - applicants who live a commutable distance to Merseyside are preferred. Robert Walters Operations Limited is an employment business and employment agency and welcomes applications from all candidates
- Company Name
- Access Computer Consulting Plc
- Job Title
- Data Architect Lead
- Job Description
- I am recruiting for a Data Architect Lead to be based in London 3 days per week, 2 days remote. The role falls inside IR35 so you will be required to work through an umbrella company. You will be responsible creating a data strategy across Front and Back Office. The expectation will be to document and understand the current data architecture, create a future state design and road map to get there, considering data governance, categorisation, tooling and data platforms. You must have substantial experience of working as a Data Architect. Experience of migrating and building enterprise data platforms in AWS is essential. You must have a background in data development or engineering. SQL expertise is required for this role. You will have knowledge of the full trade lifecycle. Any experience of the following is advantageous - Spring, SpringBoot, JPA, Hibernate, Maven and Jenkins. Please apply ASAP to find out more! Desired Skills and Experience Data Architect SQL AWS
- Company Name
- X-INFRA LTD
- Job Title
- Data centre tecnician
- Job Description
- Company Description X-INFRA LTD specializes in comprehensive infrastructure solutions, offering logistics, project management, 24/7 network operations, and installation optimization services. With expertise in fibre optics, data centers, and wireless technologies, X-INFRA provides global support for infrastructure needs. The company excels in cutting-edge data center designs, flawless installations, and efficient power and data cable containment. Role Description This is a full-time on-site role for a Data Centre Technician at X-INFRA LTD located in Greater London and European countries. The Data Centre Technician will be responsible for day-to-day tasks related to maintaining data center operations, ensuring optimal performance, troubleshooting issues, and coordinating with other technical teams to support infrastructure needs. Qualifications Experience in data center operations, maintenance, and troubleshooting Knowledge of fibre optics, data center technologies, and wireless solutions Skills in network operations and installation optimization Ability to work well in a team and communicate effectively Attention to detail and problem-solving abilities Certifications in data center operations or related field are a plus