- Company Name
- Wiraa
- Job Title
- Data Engineer
- Job Description
-
About the Company
eTeam is a leading staffing and consulting firm that provides high-quality talent solutions for global enterprises. With a strong focus on technology, engineering, and digital transformation, eTeam has built a reputation for connecting top professionals with organizations that drive innovation.
Our commitment to excellence, diversity, and collaboration makes eTeam a trusted partner for companies and job seekers alike. We specialize in contract, contract-to-hire, and direct placement opportunities, enabling professionals to work on cutting-edge projects across multiple industries.
Who You'll Work With
You’ll be part of a global team working on a GenAI initiative. Our client’s Tech Ecosystem function is responsible for developing and delivering cloud-first technology solutions for internal use.
We are seeking an experienced data engineer to help accelerate the development of a target state data platform supporting GenAI use cases. You will work as part of a multi-disciplinary team, collaborating with digital product professionals, data scientists, cloud engineers, and others.
Location: UK (Remote)
Duration: 6 Months (likely extension to 12 months)
As a Principal Data Engineer, you will:
Lead multiple workstreams related to data infrastructure, data engineering frameworks, developer productivity, data processing capabilities, and GenAI enablement.
Shape technical design decisions and mentor data engineers to ensure best practices and high coding standards.
Optimize the team structure to maximize delivery and impact.
Ensure all code is reliable, scalable, and high-performing.
Key Responsibilities
Design and implement enterprise-grade data solutions at scale.
Develop cloud-based data engineering solutions using AWS services.
Create and maintain data ingestion pipelines and processing capabilities for GenAI applications.
Work with relational databases, vector stores, and containerization technologies (AWS ECS, Docker).
Maintain high coding standards including clean code, modularity, error handling, and automated testing.
Collaborate with cross-functional teams to define product requirements and drive successful delivery.
Optimize GitHub Action CI/CD pipelines and ensure smooth deployments.
Required Skills
8+ years of experience in data engineering (cloud-based).
Expertise in Python development.
Strong knowledge of AWS services and containerization (Docker, AWS ECS).
Experience leading teams and delivering large-scale enterprise solutions.
Proficiency in data architecture, engineering patterns, and relational databases.
Ability to work in a fast-paced, complex environment with minimal supervision.
Interest in Generative AI and Machine Learning.
Experience with Kedro framework (preferred).
Strong problem-solving, communication, and collaboration skills.
Who You'll Work With
You will be a key member of a global team developing GenAI-powered solutions. Our client’s Tech Ecosystem function is responsible for building cloud-first data platforms and analytical applications.
As a Data Engineer, you will focus on cloud-based data engineering using AWS services. You will work closely with product professionals, data scientists, and cloud engineers to build data solutions that enable GenAI applications.
Key Responsibilities
Develop data ingestion pipelines and processing capabilities for GenAI applications.
Write and optimize Python code for data solutions.
Manage CI/CD pipelines using GitHub Actions.
Work with AWS-based infrastructure and Docker containers.
Ensure high coding standards with clean, modular, and well-tested code.
Diagnose and improve data pipeline performance.
Required Skills
3+ years of experience in cloud-based data engineering using AWS.
Expertise in Python development.
Strong knowledge of relational databases and data pipeline optimization.
Hands-on experience with Docker.
Ability to work independently in a fast-paced environment.
Interest in Generative AI and Machine Learning.
Familiarity with Kedro framework (preferred).
Strong problem-solving, communication, and collaboration skills.
Equal Opportunity Employer
eTeam is an Equal Opportunity Employer and provides employment opportunities without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status.
