Lead Data Engineer (SC Cleared)
Hybrid
Telford, United Kingdom
Freelance
03-03-2025
Job Specifications
Job Title: Lead Data Engineer (SC Cleared)
Location: Telford, UK
Job Type: Contract
Develop, exploit, and maintain data products. Data Engineering teams are responsible for the delivery and operational stability of the data products built and provide ongoing support for those products. Data Engineers work within, and contribute to, the overall data development lifecycle process as part of multi-functional Agile delivery teams focused on one or more products. Data Engineers should have the following essential skills:
Ability to shape solutions in a fit for purpose way, following the agreed principles and contribute to the overall Data Engineer development lifecycle.
Ability to support the day-to-day testing and produce robust test plans to ensure quality solutions and the live running of data products and services.
Ability to perform data profiling and quality measurements, ensure data quality/accuracy, knowledge of structured and unstructured data concepts, developing automated data ingest routines, workflows/mappings and data exploitation patterns and data analysis.
Own the stability of products designed, including the on-going robustness, resilience, and stability of these products.
Ability to identify, manage, and resolve issues/problems preventing the delivery or continuous development of products, using analytical skills to develop query solutions from specification to conclusion and implementation.
Ability to support the growth of the team, by keeping abreast of market and industry trends, and sharing knowledge and experience with the rest of the team. Take responsibility for their own learning and development continuously improving knowledge and skills.
Typical Data Engineering Experience required:
Knowledge and experience of Azure/AWS Cloud data solution provision.
Proficient in SQL.
Ability to develop and deliver complex visualisation, reporting and dashboard solutions using tools like Power BI.
Enterprise-scale experience with ETL tools.
Experience of data modelling and transforming raw data into datasets and extracts.
Experience of working in a large project /scale complex organisation and knowledge of migrating legacy capabilities.
Experience in Agile.
Ability to analyse and collect information and evidence, identify problems and opportunities, and ensure recommendations fit with strategic business objectives.
Experience of building team capability through role modelling, mentoring, and coaching.
Ability to manage relationships with non-technical colleagues and can work in a collaborative, inclusive way.
Typically Data Engineer Skills required includes:
Azure: Azure Data Factory, Data bricks, ADLS Gen2, Synapse, Purview (Desirable)
AWS: AWS Lambda, S3, Step Functions, CloudWatch, Redshift, Glue, Event Bridge
Languages: Python, PySpark, Scala, SQL
Code Repository: Git / BitBucket
For more info, please contact mahanthi@Lsarecruit.co.uk
About the Company
I am writing to introduce you to LSA Recruit, a professional recruitment & technology solutions provider that specializes in IT and cloud technologies, including AWS, Azure, GCP, and project management and many more. With significant business and technology recruitment experience, our consultants are relentlessly driven by results and take pride in our customer-centric engagement models. We blend our clients' needs with proven delivery models and highly talented execution teams to deliver an exceptional customer experience. ... Know more
Related Jobs
- Company Name
- Peppy
- Job Title
- Senior Backend Engineer (Data) - 6 month contract
- Job Description
- *Contract details for our Senior Backend Engineer (Data) contractor hire* Day rate of up to £600/day, dependent on experience Outside IR35 Contractor Agreement 6 month contract length initially Hey! Thanks for taking the time to read through one of our open roles. We’re looking for an exceptional Senior Backend Engineer (Data) to join our Research & Development team and we hope this could be a match made in heaven. Who is Peppy? Our mission is to fix healthcare & wellbeing. We do this by supporting the employees of our global clients, including JP Morgan, Disney, Meta, Nvidia, Microsoft, Sony, Clifford Chance, Wells Fargo, Bloomberg, and over 200 others. Having already revolutionised the employee benefits sector with our innovative clinical products – such as the world’s first menopause benefit – we are now building the world’s most advanced benefits management platform. Think of us as a “Deel for Benefits” – a rocket-ship opportunity with a mission that truly matters. The global benefits sector encompasses employer-funded pensions, critical illness insurance, private healthcare insurance, and many other categories. This is a trillion-dollar TAM with weak, incumbent competition and almost no AI-first startups stepping up to the challenge. We are a Series B company with $56m in funding to date, operationally cashflow positive, and with secure access to additional capital for accelerated growth. Join us for the ride of your life. What will a day in the life of our Senior Backend Engineer (Data) look like? Play a critical role in shaping, architecting, and implementing our next generation benefits platform, leveraging your experience in data engineering to help set up ETL pipelines, data models, and our analytics infrastructure for a business that truly makes a difference in people’s lives Apply your expertise in Python and other modern languages to deliver world-class applications as a leader, contributor, and mentor on an agile, cross-functional team Act as a resource and champion for data across our application Contribute effectively across our tech stack (primarily backend, data, ML) to routinely deliver user and business impact, with an appetite to expanding skills into frontend Write clean, performant, and tested code, documented for the benefit of your peers and beyond Participate in peer review and ensure high quality of deliverables via version control and CI/CD Collaborate closely with product and design to define new features, functionality, and requirements by channelling your user empathy and personal experience to help craft a shared vision Embody a growth mindset, working to advance and acquire skills with support from peers and leaders Identify and act on opportunities to improve user happiness, impact the business, and simplify our technical surface area Understand and support business functions beyond engineering, spanning our clinical, service delivery, sales, and marketing teams Our dream Senior Backend Engineer (Data) will have: Experience influencing and building impactful products from scratch, ideally for an early stage startup A history of thriving in the ambiguity and uncertainty of nascent projects, and relishes the opportunity to shape the future 5+ years of professional experience building and architecting customer-facing Web Applications with a combination of Python and other backend languages like Java or Scala Plenty of experience crunching data at scale, with expertise in data processing, data pipelines and data flows Experience with Google Cloud (preferred) or AWS, plus Kubernetes and Kafka ideally Familiarity with RESTful APIs (we use FastAPI), machine learning, and AI methods Excellent communicator who can simplify complexity to share your work with the whole team and the wider company First-hand knowledge what scale and quality look like in a larger technology company Proven ability to learn, investigate, experiment, prototype, and iterate A deep understanding of coding best practices and a dedication to creating efficient, scalable, and maintainable code An insatiable desire to quickly release and iterate – you are happiest when the things you build go out in the wild You may not check all of these boxes, and that’s totally fine! We strongly encourage excited candidates of all backgrounds to apply. Still looking for more intel? Here’s some other really cool things about Peppy which might be helpful: We raised a $45mil Series B fundraise January 2023, led by Albion VC We’re one of Europe’s fastest growing HealthTech scale-ups We are remote-first, headquartered in the UK with 100+ employees across the UK, USA and Europe We're proudly B-corp certified and mission-led We are rated one of the Top Startups to work for by LinkedIn, Sifted, Tempo and Flexa Equality & Diversity: Peppy's mission is to help people in life's most challenging journeys. We pride ourselves on being an equal opportunity employer, committed to equality and diversity amongst both our employees and prospective applicants. We ensure that all applicants are treated equally and fairly throughout our recruitment process.
- Company Name
- Intec Select
- Job Title
- Data Scientist
- Job Description
- Data Scientist – 10 Month Contract – £560 Per Day PAYE / Inside IR35 – Remote Overview: A fantastic opportunity has emerged for a Data Scientist to join our client, a globally renowned social media company. We are seeking a highly skilled Data Scientist within Analytics to focus on ensuring platform integrity, protecting users, and improving the quality of interactions across digital services. This team is responsible for ensuring a safe and trustworthy experience across digital platforms. By leveraging data science and analytics, the team develops solutions to detect and mitigate risks, enforce integrity policies, and enhance user trust. If you are passionate about data-driven problem-solving and making a meaningful impact, we’d love to hear from you. Role & Responsibilities: Collect, analyse, and interpret complex data to inform decision-making and product development. Apply expertise in quantitative analysis and data mining to understand user behaviour and detect trends. Partner with Product and Engineering teams to develop data-driven solutions that enhance platform integrity. Communicate analytical findings to stakeholders and influence product strategies. Work on a variety of projects, including exploratory analysis, product influence, and data infrastructure. Develop success metrics for product features and initiatives. Utilize advanced statistical techniques, A/B testing, and machine learning models to optimize integrity-related processes. Skills & Experience: Strong experience in data analytics, statistical modelling, and data-driven decision-making. Proficiency in SQL, Python, R, or similar languages. Experience working with large-scale data processing infrastructures. Expertise in statistical techniques such as clustering, regression, and A/B testing. Familiarity with ETL processes and relational databases. Ability to translate complex data insights into strategic recommendations. Contract Details: Rate – Circa £510 - £560 per day Contract length - 10 months Payroll: Inside IR35 / PAYE Holiday pay Location – Remote in the UK Data Scientist – 10 Month Contract – £560 Per Day PAYE / Inside IR35 – Remote
- Company Name
- DataAnnotation
- Job Title
- Data Analyst - AI Trainer
- Job Description
- We are looking for a data analyst to join our team to train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each model. Find out more about the daily tasks, overall responsibilities, and required experience for this opportunity by scrolling down now. In this role you will need to hold an expert level of mathematical reasoning- a completed or in progress Masters/PhD is preferred but not required. Other related fields include, but are not limited to: Data Science, Applied Math and/or Computer Science. Benefits This is a full-time or part-time REMOTE position You’ll be able to choose which projects you want to work on You can work on your own schedule Projects are paid hourly starting at $40+ USD per hour, with bonuses on high-quality and high-volume work Responsibilities Give AI chatbots diverse and complex mathematics problems and evaluate their outputs Evaluate the quality produced by AI models for correctness and performance Qualifications Fluency in English (native or bilingual level) Detail-oriented Proficient in data science, arithmetic, algebra, geometry, calculus, probability, statistics, and inductive/ deductive reasoning A current, in progress, or completed Masters and/or PhD is preferred but not required Note: Payment is made via PayPal. We will never ask for any money from you. PayPal will handle any currency conversions from USD. This job is only available to those in the US, UK, Canada, Australia, or New Zealand. Those located outside of these countries will not see work or assessments available on our site at this time. #INDUKMA Job Types: Full-time, Part-time Pay: From £31.64 per hour Work Location: Remote
- Company Name
- TEKsystems
- Job Title
- Database Administrator (DBA)
- Job Description
- Job Title: Database Administrator Job Description Job Title: Database Administrator (DBA) Location: Edinburgh (Hybrid Working) Contract Duration: 6 months (Initial) Daily Rate: Competitive Job Description: We are seeking a skilled and experienced Database Administrator (DBA) to join our team on an initial 6-month contract. The successful candidate will be responsible for managing and maintaining our database systems, ensuring their performance, availability, and security. This role requires expertise in Oracle, PL/SQL, and SQL Server. Key Skills and Experience: Proven experience as a Database Administrator. Strong expertise in Oracle, PL/SQL, and SQL Server. Experience with database performance tuning and optimization. Knowledge of database security, backup, and recovery procedures. Excellent problem-solving and analytical skills. Strong communication and collaboration skills. Ability to work independently and as part of a team. Experience with hybrid working environments. Working Conditions: Hybrid working model with a combination of remote and on-site work in Edinburgh. Flexible working hours may be required to meet project deadlines. Responsibilities Manage and maintain Microsoft SQL Server databases, ensuring optimal performance, security, and availability. Experience with managing and supporting database infrastructure on high-availability multi-site virtualised environments. Demonstrable familiarity with cloud-based Microsoft SQL environments, such as Azure SQL Database, Azure SQL Managed Instance, and SQL Server on Azure Virtual Machines. Demonstrable familiarity with core Oracle RDBMS and Cloud environments. Monitor system health, resolve performance issues, and implement preventive measures. Perform regular database maintenance tasks, including database backups, restores, index optimisation, and updates. Manage database security in line with regulatory and organisational requirements. Effectively manage documentation to support system changes and new environments. Location Edinburgh, UK Trading as TEKsystems. Allegis Group Limited, Bracknell, RG12 1RT, United Kingdom. No. 2876353. Allegis Group Limited operates as an Employment Business and Employment Agency as set out in the Conduct of Employment Agencies and Employment Businesses Regulations 2003. TEKsystems is a company within the Allegis Group network of companies (collectively referred to as "Allegis Group"). Aerotek, Aston Carter, EASi, Talentis Solutions, TEKsystems, Stamford Consultants and The Stamford Group are Allegis Group brands. If you apply, your personal data will be processed as described in the Allegis Group Online Privacy Notice available at our website. To access our Online Privacy Notice, which explains what information we may collect, use, share, and store about you, and describes your rights and choices about this, please go our website. We are part of a global network of companies and as a result, the personal data you provide will be shared within Allegis Group and transferred and processed outside the UK, Switzerland and European Economic Area subject to the protections described in the Allegis Group Online Privacy Notice. We store personal data in the UK, EEA, Switzerland and the USA. If you would like to exercise your privacy rights, please visit the "Contacting Us" section of our Online Privacy Notice on our website for details on how to contact us. To protect your privacy and security, we may take steps to verify your identity, such as a password and user ID if there is an account associated with your request, or identifying information such as your address or date of birth, before proceeding with your request. commitments under the UK Data Protection Act, EU-U.S. Privacy Shield or the Swiss-U.S. Privacy Shield.