Lead Data Engineer
On site
London, United Kingdom
£ 95 / hour
Freelance
20-03-2025
Job Specifications
Lead Data Engineer | Defence Consultancy | DV Clearance Required | 12 Month Contract (Inside IR35) | Up to £800 per day | London
MERITUS are working with a tech focused Defence Consultancy in London looking for a Lead Data Engineer to join on a 12 month contract working with MOD customers in the London area.
If successful you will be responsible for designing, building and maintaining scalable data pipelines and integration solutions. You will work closely with business & customer stakeholders in the wider data team to ensure efficient flow of data across systems.
The role is based in London & requires active DV security clearance.
Main Responsibilities:
Design, implement, and maintain scalable data architectures, pipelines, and ETL processes.
Lead and mentor data engineers, ensuring best practices in coding, data modelling, and pipeline optimisation.
Establish and enforce data quality, compliance, and security standards across data platforms.
Work closely with data scientists, analysts, and business teams to understand requirements and optimise data solutions.
Skills Required:
Expertise in tools like Hadoop, Spark, Kafka, and cloud data services (AWS, GCP, or Azure).
Strong knowledge of relational (PostgreSQL, MySQL) and NoSQL (MongoDB, Cassandra) databases.
Proficiency in Python, Java, or Scala for data processing and automation.
Experience with Apache Airflow, dbt, or other orchestration tools for efficient ETL/ELT processes.
Got your attention?
If you believe that you have the skills and experience for the role – then please get in touch. We also offer a referral scheme for any candidates whose details are passed to us that we successfully place. If you have any further questions then please contact Ryan Harris at MERITUS Talent.
About the Company
Leading the charge across Aerospace, Defence, and Space. MERITUS connects worldwide industry talent with pioneering organisations through our multitude of bespoke talent attraction and retention methods, designed with you in mind. We are the fastest growing Aerospace, Defence and Space brand in the UK, specialising in innovative talent resource solutions within the security cleared space. We work in partnership with our clients on projects undisclosed to the general public, supporting the curation of their resource supply ... Know more
Related Jobs
- Company Name
- VirtueTech Recruitment Group
- Job Title
- Senior Data Engineer | Energy Trading | London | Up to £750 per day | Inside IR35 | Hybrid
- Job Description
- Senior Data Engineer | Energy Trading | London | Up to £750 per day | Inside IR35 | Hybrid A Senior Data Engineer is needed for an Energy Trading client who are active within energy & commodities. As a Senior Data Engineer, you will collaborate closely with the Front Office traders to build ETL pipelines from scratch, develop an internal Data Warehouse, and leverage cloud services for data processing and infrastructure. The Technology that is key for this data engineer role includes: Experience with Python, SQL, Databricks, Snowflake, Airflow, S3 buckets, Redshift, and AWS Lambda. Due to scope of work, as a Senior Data Engineer, it is vital that you have experience working in a similar environment within the Energy Trading sector, having knowledge of the financial data and trading systems is advantageous, and showing commercial experience in cloud services is key too. This Senior Data Engineer role is a 6-month rolling contract. Rate on this Senior Data Engineer Role, is paying up to £750 per day, Inside IR35 Hybrid working: 2 to 3 days a week from the Central London office. Python, SQL, Databricks, Snowflake, Airflow, S3 buckets, Redshift, and AWS Lambdas. If you are interested, please reply back with your latest CV ASAP, and let's get a Teams meeting in to discuss! Senior Data Engineer | Energy Trading | London | Up to £750 per day | Inside IR35 | Hybrid
- Company Name
- TEKsystems
- Job Title
- Data Science Consultant
- Job Description
- Job Title: Data Science Consultant Job Description We are seeking a passionate and skilled Data Science Consultant who thrives on working with innovative technologies and driving customer transformations. This role requires excellent communication skills, the ability to travel domestically, and the capability to work with diverse cultures and customers. The ideal candidate will demonstrate a balance of business and technical acumen, possess strong leadership qualities, and effectively adapt to change. Responsibilities Travel domestically to meet and collaborate with clients from various cultures. Communicate effectively with a wide range of audiences and deliver compelling presentations. Lead and motivate technical communities. Adapt to and manage changes efficiently. Deliver presentations and discuss complementary products at a solutions level. Handle customer-critical issues and navigate difficult situations. Evaluate end-user business requirements and translate them into technical specifications. Develop and implement appropriate technical solutions based on customer needs. Communicate effectively in both written and verbal forms with technical and non-technical audiences. Essential Skills Proficiency in Data Science (probabilistic modelling, machine learning, time series, optimization algorithms). Experience in Machine Learning Engineering. Knowledge of Generative AI. Expertise in Azure Cloud Services (AzureML, AI Foundry, AI Services, AI Search, Azure Databricks). Proficiency in programming languages and tools such as Python, Pandas, Scikit-learn, PySpark, GPT, etc. Fluent in English, both oral and written communication. Active SC Clearance. Additional Skills & Qualifications Experience with business evaluation. Location London, UK Trading as TEKsystems. Allegis Group Limited, Bracknell, RG12 1RT, United Kingdom. No. 2876353. Allegis Group Limited operates as an Employment Business and Employment Agency as set out in the Conduct of Employment Agencies and Employment Businesses Regulations 2003. TEKsystems is a company within the Allegis Group network of companies (collectively referred to as "Allegis Group"). Aerotek, Aston Carter, EASi, Talentis Solutions, TEKsystems, Stamford Consultants and The Stamford Group are Allegis Group brands. If you apply, your personal data will be processed as described in the Allegis Group Online Privacy Notice available at our website. To access our Online Privacy Notice, which explains what information we may collect, use, share, and store about you, and describes your rights and choices about this, please go our website. We are part of a global network of companies and as a result, the personal data you provide will be shared within Allegis Group and transferred and processed outside the UK, Switzerland and European Economic Area subject to the protections described in the Allegis Group Online Privacy Notice. We store personal data in the UK, EEA, Switzerland and the USA. If you would like to exercise your privacy rights, please visit the "Contacting Us" section of our Online Privacy Notice on our website for details on how to contact us. To protect your privacy and security, we may take steps to verify your identity, such as a password and user ID if there is an account associated with your request, or identifying information such as your address or date of birth, before proceeding with your request. commitments under the UK Data Protection Act, EU-U.S. Privacy Shield or the Swiss-U.S. Privacy Shield.
- Company Name
- Avance Consulting
- Job Title
- Data Lead Project Manager
- Job Description
- Job Summary: We're looking for an experienced Data Lead Project Manager with 15+ years of experience in data project management. The ideal candidate will have a strong background in data management, data governance, and data quality. The Data Lead Project Manager will be responsible for leading and managing large-scale data projects, ensuring alignment with business requirements and industry standards. Key Responsibilities: 1. Project Management: Lead and manage large-scale data projects, including project planning, execution, and delivery. 2. Data Management: Oversee data management, including data governance, data quality, and data security. 3. Team Management: Manage and lead cross-functional teams, including data analysts, data scientists, and data engineers. 4. Stakeholder Management: Communicate with stakeholders, including business leaders, customers, and vendors, to ensure effective delivery of data projects. 5. Risk Management: Identify and mitigate risks, including technical, financial, and operational risks. 6. Data Quality: Ensure data quality, including data validation, data cleansing, and data transformation. Requirements: 1. Experience: 15+ years of experience in data project management. 2. Data Management Knowledge: Strong understanding of data management, including data governance, data quality, and data security. 3. Project Management Knowledge: Strong understanding of project management, including project planning, execution, and delivery. 4. Leadership Skills: Proven leadership skills, with experience leading cross-functional teams. 5. Communication Skills: Excellent communication skills, with the ability to communicate technical concepts to non-technical stakeholders. Nice to Have: 1. Certifications: Certifications in data management, such as Certified Data Manager (CDM) or Certified Information Manager (CIM). 2. Cloud Experience: Experience with cloud-based data solutions, including AWS or Azure. 3. DevOps: Experience with DevOps practices, such as continuous integration and continuous deployment. 4. Agile Methodologies: Experience with Agile methodologies, such as Scrum or Kanban.
- Company Name
- Morgan McKinley
- Job Title
- Senior Data Scientist
- Job Description
- Data Scientist Duration - 11 months (potential to extend) Year of experience - 10+ years We're looking for a senior Data Scientist to support the delivery of a number of key strategic projects. The role reports directly into the Data Science lead for App & Gaming. Job Responsibilities: • Conduct deep, thorough analysis to uncover patterns, insights, and opportunities to support the continued growth of our App & Gaming business • Generate and test hypotheses and analyse and interpret the results of product experiments • Work directly with engineers, product managers, and other functions to translate insights into product direction • Provide business intelligence (BI) and data visualisation support to help leads understand the health of our business • Apply knowledge of statistics, machine learning, programming, data modelling, and simulation to support the above Required Skills: • Strong understanding of querying relationship databases with SQL, including experience working with very large datasets • Experienced using programming languages such as Python and/or R • Ability to communicate effectively in writing, including conveying complex information and promoting in-depth engagement on course topics • Ability to drive alignment across a diverse set of stakeholders Preferred Background: • Experience working in Ads / Ad Tech • Experience in the App or Gaming industry