Data Engineer
Remote
United Kingdom
Freelance
27-02-2025
Job Specifications
About the Company
eTeam is a leading staffing and consulting firm that provides high-quality talent solutions for global enterprises. With a strong focus on technology, engineering, and digital transformation, eTeam has built a reputation for connecting top professionals with organizations that drive innovation.
Our commitment to excellence, diversity, and collaboration makes eTeam a trusted partner for companies and job seekers alike. We specialize in contract, contract-to-hire, and direct placement opportunities, enabling professionals to work on cutting-edge projects across multiple industries.
Who You'll Work With
You’ll be part of a global team working on a GenAI initiative. Our client’s Tech Ecosystem function is responsible for developing and delivering cloud-first technology solutions for internal use.
We are seeking an experienced data engineer to help accelerate the development of a target state data platform supporting GenAI use cases. You will work as part of a multi-disciplinary team, collaborating with digital product professionals, data scientists, cloud engineers, and others.
Location: UK (Remote)
Duration: 6 Months (likely extension to 12 months)
As a Principal Data Engineer, you will:
Lead multiple workstreams related to data infrastructure, data engineering frameworks, developer productivity, data processing capabilities, and GenAI enablement.
Shape technical design decisions and mentor data engineers to ensure best practices and high coding standards.
Optimize the team structure to maximize delivery and impact.
Ensure all code is reliable, scalable, and high-performing.
Key Responsibilities
Design and implement enterprise-grade data solutions at scale.
Develop cloud-based data engineering solutions using AWS services.
Create and maintain data ingestion pipelines and processing capabilities for GenAI applications.
Work with relational databases, vector stores, and containerization technologies (AWS ECS, Docker).
Maintain high coding standards including clean code, modularity, error handling, and automated testing.
Collaborate with cross-functional teams to define product requirements and drive successful delivery.
Optimize GitHub Action CI/CD pipelines and ensure smooth deployments.
Required Skills
8+ years of experience in data engineering (cloud-based).
Expertise in Python development.
Strong knowledge of AWS services and containerization (Docker, AWS ECS).
Experience leading teams and delivering large-scale enterprise solutions.
Proficiency in data architecture, engineering patterns, and relational databases.
Ability to work in a fast-paced, complex environment with minimal supervision.
Interest in Generative AI and Machine Learning.
Experience with Kedro framework (preferred).
Strong problem-solving, communication, and collaboration skills.
Who You'll Work With
You will be a key member of a global team developing GenAI-powered solutions. Our client’s Tech Ecosystem function is responsible for building cloud-first data platforms and analytical applications.
As a Data Engineer, you will focus on cloud-based data engineering using AWS services. You will work closely with product professionals, data scientists, and cloud engineers to build data solutions that enable GenAI applications.
Key Responsibilities
Develop data ingestion pipelines and processing capabilities for GenAI applications.
Write and optimize Python code for data solutions.
Manage CI/CD pipelines using GitHub Actions.
Work with AWS-based infrastructure and Docker containers.
Ensure high coding standards with clean, modular, and well-tested code.
Diagnose and improve data pipeline performance.
Required Skills
3+ years of experience in cloud-based data engineering using AWS.
Expertise in Python development.
Strong knowledge of relational databases and data pipeline optimization.
Hands-on experience with Docker.
Ability to work independently in a fast-paced environment.
Interest in Generative AI and Machine Learning.
Familiarity with Kedro framework (preferred).
Strong problem-solving, communication, and collaboration skills.
Equal Opportunity Employer
eTeam is an Equal Opportunity Employer and provides employment opportunities without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status.
About the Company
Wiraa is a global freelancing platform that connects skilled professionals with businesses seeking top-tier talent. Wiraa is designed to facilitate seamless collaboration between freelancers and clients worldwide. Know more
Related Jobs
- Company Name
- James Adams
- Job Title
- Lead Data Engineer - AWS
- Job Description
- ***This role falls outside IR35*** James Adams is currently looking for an experienced Lead Data Engineer. This is a 3 month initial contract working hybrid remotely in London. About the Role: We are seeking a highly skilled Senior Data Engineer to join our team. This role is ideal for a data engineering expert with a deep understanding of Snowflake, AWS data tooling, data warehousing, and best practices in cloud-based data platforms. You will be instrumental in building and optimizing our data pipelines, ensuring scalability, efficiency, and reliability. Key Responsibilities: Design, develop, and maintain robust data ingestion pipelines using AWS services (S3, Lambda, ECR, ECS, DynamoDB). Develop and optimize data transformation pipelines using a combination of SQL and Python. Work with Snowflake as a data platform, ensuring efficient and scalable structures and patterns. Implement best practices for data engineering, including performance tuning, security, and data governance. Collaborate with data analysts, scientists, and other stakeholders to deliver high-quality data solutions. Monitor, troubleshoot, and optimize data pipelines for performance and reliability. Ensure data quality, consistency, and integrity across multiple data sources. Required Skills & Experience: Proven experience as a Data Engineer with a strong background in data warehousing concepts. Expert-level proficiency in SQL and Python, with a focus on simplicity and maintainability. Hands-on experience with AWS services, specifically S3, Lambda, ECR, ECS, and DynamoDB. Deep understanding of data modeling, including dimensional modeling and best practices for cloud-based data platforms. Strong problem-solving skills with the ability to optimize queries and improve data performance. Experience in handling large-scale datasets and implementing scalable data solutions. Nice to Have: Experience in document processing. Experience with utilising AI in the data engineering space. Experience with Terraform for infrastructure as code. Knowledge of CI/CD practices for automating deployment processes. Familiarity with Data Vault modeling for data warehousing. Experience in building ETL/ELT pipelines using modern data stack tools. If of interest, please send your CV now to apply!
- Company Name
- Statkraft
- Job Title
- Data Engineer (FTC - 12 Months)
- Job Description
- Statkraft is Europe's largest generator of renewable energy from hydro, wind and solar power. We have 6000 employees in 20 countries. We have been making clean energy possible for over 125 years, with unrivalled expertise in supplying the world with what it needs most. We envision a world that runs entirely on renewable energy. Because in the fight against climate change, we do not see renewable energy as part of the solution – we believe it must be the solution. This role can be based in any one of our offices in Europe and the deadline for all applications is Friday 14th March 2025. Job Description Design, develop, and maintain scalable data management systems and integration solutions, ensuring uninterrupted data flow and high availability. Implement InfluxDB upgrade and links to SK Azure environment Implement and optimise ETL processes using Python and other relevant tools to handle large volumes of data from various sources. Manage and improve database structures, including MySQL and time-series databases, for efficient storage and fast querying. Develop and maintain APIs for timeseries data retrieval from online platforms, automating data preparation and delivery processes. Ensure data quality control measures are in place and meet the Solar Performance Analysis team's reporting requirements (Solar and BESS) Collaborate with IT teams to maintain system security, including firewall management, SSL certificate renewals, and implementation of cybersecurity best practices. Create and maintain clear documentation for all data processes and infrastructure. Continuously assess and implement state-of-the-art methodologies and technologies to improve efficiency and performance. Qualifications Bachelor's degree in computer science or equivalent IT degree Strong experience in Azure, InfluxDB, SQL and Python database principles Strong knowledge of SCADA monitoring platforms and 'big data' infrastructure Proficiency with code hosting services (e.g., GitLab) and data visualisation platforms (e.g., Grafana) Self-starter with excellent troubleshooting skills and ability to work in a fast-paced, technical environment Outstanding communication skills, both written and oral Experience with MySQL, timeseries databases, and energy generation data structures (preferred) Basic electrical knowledge and understanding of common communication protocols (preferred) Awareness of cybersecurity best practices and commitment to renewable energy Additional Information A career with Statkraft is a career filled with purpose – meaning that every employee is not just making a living, they are making a real difference to the planet, our communities, and the future. With us, you’ll shape a career that is truly forward-facing with many amazing opportunities and offerings to match. This includes: An opportunity to work with renewable energy and contribute to a low emission society Professional and personal development in an exciting global company A working environment characterised by competence, responsibility, innovation and a strong commercial culture A diverse workplace with regards to gender, age and cultural background Competitive terms of employment and benefit schemes Career and learning opportunities at various levels of the organisation The chance to grow your career alongside a truly global network of experts, leaders, specialists and graduates from different countries and background Hybrid working Statkraft manages critical infrastructure and services in several countries. The applicant must be eligible for security clearance and authorisation. Statkraft's vision is to renew the way the world is powered. To navigate the complex journey ahead, we need every voice at the table. We therefore work actively to be a diverse and inclusive workplace and welcome all applicants regardless of background, gender, age, sexual orientation, religious belief, ethnicity, nationality or disability.
- Company Name
- HCLTech
- Job Title
- Database Security Specialist
- Job Description
- We are a $13+ billion global technology company, home to more than 224,000 people across 60 countries, delivering industry-leading capabilities centered around digital, engineering, cloud, and AI, powered by a broad portfolio of technology services and products. HCLTech is a globally recognized leader in the Tech and IT industry, but we’ve never forgotten the startup mindset that got us here. We’ve always approached our work with an idea-first attitude because every one of our accomplishments —no matter how big or small —can be traced back to an idea’s single spark. It’s that spark —that inner drive —that sets our people apart from our competitors. It enables us not just to pull off game-changing feat after game-changing feat but to better our world in the process. We want you to find your spark. Because that’s what drives you to be better, be more and ultimately, be more fulfilled. Location: UK (London Information Security Senior Specialist (Database) Information Security is responsible for preventing IT-based crime, hacking, intentional or inadvertent modification, disclosure, or destruction to the organization's information systems and IT assets and intellectual property. The focus of the role is to ensure highly professional and productive procedures, policies and processes/controls are in place, and aligned and agreed and implemented with relevant stakeholders. Overview/Key Responsibilities: The Information Security Senior Specialist (Database) will work with Database Engineering, Database Operations, CISO and audit to ensure that security controls are defined, implemented and operating effectively. Roles within Information Security may cover one or more areas of specialty: Identity & Access Management (which may include, for example, authentication; access management & control; recertification etc.) Information Security (“IS”) Operations (which may for example include, cyber threat operations; protection against data leakage etc.) IS Technology (which may include IS architecture, IS engineering, cryptographic services etc.). Work includes: Identifying and evaluating potential areas of Information Security threat by assessing the probability and impact, and implementing associated mitigations Monitoring and contributing to the implementation of the Information Security strategy Evaluating the adequacy and effectiveness of internal controls relating to Information Security risks Ensuring appropriate procedures, policies and processes are in place, and aligned and agreed with relevant stakeholders Configuration/security baselines Developing appropriate, pragmatic strategies to deliver effective controls and Information Security management objectives and implementation across the bank Managing client relationships and ensuring management focus on the Information Security agenda Work includes: Assessing security/configuration baselines Reviewing/designing security controls to ensure it meets audit and CSO requirements Evidencing (documentation) of control compliance, Building security and resiliency into solutions with appropriate testing and reviewing throughout the delivery lifecycle Ensuring maintainability and reusability of engineering solutions Support PM, Migration Manager and application teams with implementation and Migration activities and tasks to support project delivery Database Expertise: Knowledge of relational databases, security configuration management, security monitoring and tooling. Migration Process Development: Work closely with the project/migration leads to develop robust migration processes (provide security input as required). Ensure seamless integration of migration strategies with minimal disruption to ongoing operations. Collaboration with Application Teams: Support migration and project leads and application teams Plan and coordinate migrations, considering security dependencies and minimizing potential disruptions. You will have: (Skills/Experience) Experience: Minimum of 8+ years of relevant experience in information security roles. Proven experience as a Technical Lead with a focus on Oracle and database management Knowledge of IT Infrastructure Environments/ITIL would be advantageous. Working knowledge of requirements management through to delivery, both Agile and Waterfall. Experience within a tier1 banking experience ideally Deutsche Bank infrastructure environments Excellent self-starter, able to work in virtual global teams in a matrix organization. Extensive analytical skills, flexibility regarding problem solving. Open minded, able to share information, transfer knowledge and expertise to team members. Able to work in fast paced environment. Self confidence You will be: (Skills/Competencies) Qualifications: CISA/CISM or equivalent security certification Demonstrated success in audit remediation initiatives. Excellent communication and collaboration skills. Education: Bachelor’s degree in Computer Science, Information Technology, or related field. Top 5 attributes/competencies/skillset/qualities of the ideal candidate: Self-starter evidenced through assertive and pro-active behaviors. Ability to lead in fast paced, constantly changing environment. Strong stakeholder management skills Strong conflict management skills Strong communication skills
- Company Name
- NHS Counter Fraud Authority
- Job Title
- Data Analyst
- Job Description
- Job Summary The NHS Counter Fraud Authority is the national body responsible for all matters relating to the prevention, detection and investigation of economic crime across the NHS. Further information about our work and annual plan for delivering this is available on our website. Our new team are embarking on a piece of work to monitor data to identify and respond to patterns indicative of potential fraud. This will support our current work that reduces the likelihood of fraud occurring. We will bring in data science capabilities to be deployed in counter fraud activity and work closely with partners across health and government to further maximise the preventative impact of proactive counter fraud analysis. We will combine this with our range of counter fraud and domain expertise to maximise our impact using your knowledge, experience, and passion for your chosen field. This role offers a unique opportunity to use data analysis to detect and prevent fraud within the NHS, directly impacting patient care and public funds. You'll work with advanced analytics tools like Python, R, SQL, and Alteryx to uncover hidden patterns and anomalies. Join a collaborative team where your insights drive real-world action against financial crime. Potential applicants can contact Santosh Kumar at santosh.kumar@nhscfa.gov.uk for an informal chat if you have any questions regarding the role. Interviews will be held on 10th March 2025 Main duties of the job The role of the data analyst plays a key role within the programme of work, providing a comprehensive data and information expertise to the team in support the work undertaken together within the data science and respond team. The successful candidate will liaise with internal and external stakeholders to examine anomalies and patterns within data which could be indicative of fraud, being responsible for delivery of their workstream, including collating data, defining, and developing methodologies and producing actionable insight across several areas of concern. The post holder will be required to have a NPPV2. About Us We have offices based in Coventry, Newcastle and London and offer flexible, hybrid, office and home-based working. In addition to the advertised salary working in the London area will attract High-Cost Area Supplement where appropriate. The NHSCFA values and respects the diversity of its employees and aims to recruit a workforce which reflects our diverse communities. We welcome applications irrespective of people's age, disability, gender, race or ethnicity, religion or belief, sexual orientation, or other personal circumstances. We have policies and procedures in place to ensure that all applicants are treated fairly and consistently at every stage of the recruitment process, including an invitation to the first stage of the selection process and consideration of reasonable adjustments for people who have a disability. If you are applying to undertake this role on a secondment basis you should have agreement to being released from your current role in principle, prior to submitting an application form. When you apply for this role, you will be redirected to our recruitment system TRAC. The NHSCFA does not hold a sponsor licence in respect of skilled worker visas and so is unable to employ candidates requiring sponsorship. We reserve the right to close this vacancy before the advertised closing date should we receive a significant number of applications. Date posted 20 February 2025 Pay scheme Agenda for change Band Band 5 Salary £29,970 to £36,483 a year Contract Fixed term Duration 12 months Working pattern Full-time, Home or remote working Reference number 076-ATH-CFA031 Job locations 7th Floor, HM Government Hub 10 South Colonnade, Canary Wharf London E14 4PU Job Description Job responsibilities To work as part of the programme of work and provide support in delivering NHS CFAs objectives. Providing an analytical service to all parts of the organisation by analysing data, interpreting, and reporting on the results. Undertaking complex statistical analyses requiring accuracy, attention to detail and frequent, prolonged periods of concentration. Communicating analytical and statistical matters to non-analytical/statistical professionals, offering advice and persuasion on statistical techniques. Dealing with statistical and analytical queries, assessing whether analyses are robust e.g., investigating data anomalies identified during analyses. Establishing deadlines and provide on-going communication of progress to keep projects on track and on time. Responsibilities Job description Job responsibilities Please see full Job Description and Person Specification To work as part of the programme of work and provide support in delivering NHS CFAs objectives. Providing an analytical service to all parts of the organisation by analysing data, interpreting, and reporting on the results. Undertaking complex statistical analyses requiring accuracy, attention to detail and frequent, prolonged periods of concentration. Communicating analytical and statistical matters to non-analytical/statistical professionals, offering advice and persuasion on statistical techniques. Dealing with statistical and analytical queries, assessing whether analyses are robust e.g., investigating data anomalies identified during analyses. Establishing deadlines and provide on-going communication of progress to keep projects on track and on time. Please See Full Job Description And Person Specification Person Specification Knowledge And Experience Essential Significant experience of using a range of statistical, numerical, and analytical techniques to analyse data and ability to work with: oNHS Specific Data. oStructured and unstructured data. oDynamic ETL processes and scripts. oRaw data to transform into useful formats specific to a business problem. oKey transactional organisation data sets to produce products that support Performance Management Reporting and statistical insights at all levels. oKey transactional organisation data sets to produce external benchmarking products. oAppropriate mediums to visualise data to show compelling actionable products for internal and external stakeholders. oDemonstrable experience in managing deadlines and prioritising workloads. Desirable Significant experience of using a range of statistical, numerical, and analytical techniques to analyse data and ability to work with: oNHS Specific Data. oStructured and unstructured data. oDynamic ETL processes and scripts. oRaw data to transform into useful formats specific to a business problem. oKey transactional organisation data sets to produce products that support Performance Management Reporting and statistical insights at all levels. oKey transactional organisation data sets to produce external benchmarking products. oAppropriate mediums to visualise data to show compelling actionable products for internal and e...