Senior Data Engineer

On site

London, United Kingdom

£ 560 / day

Freelance

18-02-2025

Share this job:

Score my CV

Job Specifications

Senior Data Engineer – OUTSIDE IR35

Start date: ASAP
Duration: 3 months (with a view to extend)
Location: 1 day every month in the London office
Rate: £500 - £560 per day Outside IR35

Responsibilities:

Collaborate with our clients to design and build modern data platforms using a variety of technologies
Help lead the design and implementation of complex, cloud-based data ingestion and transformation pipelines Implement scalable and secure Data Lakes/Warehouses
Help drive effective development patterns and delivery practices
Continually improve with our internal development program, including mentoring and paid training/ certifications

Skills:

Python
Snowflake, SnowSQL
SQL
Airflow
DBT
ETL, Spark

About the Company

Community-led, diverse in behaviour, for the digital tech brave. We are Trust in SODA, the digital tech recruitment specialists. We empower and build diverse communities that represent the digital tech world we live in. We are proud to be officially B Corp certified, joining a global network of organisations dedicated to using their platform as a force for positive change. Our consultants focus on delivering talent solutions across Software Engineering, DevOps, Data, Cloud & Infrastructure and Creative. Our SODA Squad op... Know more

Related Jobs

Company Name: Infinity Quest
Job Title: Data Analyst
Job Description: Technical & Functional Experience: BS in a technical/quantitative field, including business, data and analytics, engineering, etc. Hands-on experience (typically 3-5 years) carrying out data analysis, data mining and insight generation in complex, fast-paced environments. Strong business acumen. Applied knowledge of data analytics tools (e.g. business intelligence applications) and approaches across all data lifecycle stages. Experience in Microsoft Power BI, Tableau, or other data visualisation softwares. Customer-centric and pragmatic mindset. Focus on value delivery and swift execution, while maintaining attention to detail. Strong communication and stakeholder management skills. Knowledge in SQL, python or other languages is preferred Thank you very much!

Sunbury-On-Thames, United Kingdom

Remote

Freelance

21-02-2025

Company Name: The Planet Group
Job Title: Data Scientist
Job Description: The Planet Group have recently been engaged by a market leading Audio streaming service who are seeking a product-focused Data Scientist to join the team on an initial 6-month contract. What You’ll Do: Perform analyses on large datasets to extract practical insights on the user experience that will help drive business decisions, with a special focus on the IAM products. Define success metrics and propose an effective measurement strategy to capture the impact of product features and mission progress. Coordinate and execute A/B experiments across multiple different surfaces, effectively driving robust decision-making and understanding the impact of our work on users. Communicate quantitative insights and recommendations to key collaborators across all levels of seniority. Work closely with cross-functional teams of software engineers, product managers, designers, and others across the company who are passionate about clients success. Be an active member of the clients data science community. Who You Are: You have 5+ years of experience in a similar role as a Data Scientist and are proficient in analysing complex data using SQL (Google BigQuery), Python, or R. You have a track record of collaborating with engineers in the product development process, helping them shape projects and translate open-ended questions into concrete analysis plans. You possess strong foundational knowledge with practical experience in designing and analysing A/B tests. You are well-versed in various analysis techniques, such as linear and logistic regression, significance testing, and statistical modelling You are proficient in creating insightful dashboards using Tableau or Looker Studio. Previous experience in the IAM domain is a strong plus but not a must. The role offers a dynamic and rewarding work environment. If you're interested, we encourage you to apply! Diversity Statement: Diversity drives innovation, inclusion drives success. We believe a multitude of approaches and ideas enable us to deliver the best results for our workforce, workplace, and customers. We believe a multitude of approaches and ideas enable us to deliver the best results for our workforce, workplace, and customers. We are committed to fostering a culture where all employees can share their passions and ideas so we can tackle the toughest challenges in our industry and pave new paths to limitless possibilities.

London, United Kingdom

Hybrid

Freelance

21-02-2025

Company Name: SystemsAccountants
Job Title: SAP Data Scientist
Job Description: SAP Data Scientist £500 inside IR35 12-month contract SystemsAccountants are currently working with a client implementing SAP S/4HANA Public Cloud and SAP Analytics Cloud, seeking a Data Scientist to join the team, collaborating with key stakeholders to create impactful reports and dashboards to enable key business intelligence decisions. The successful candidate will work closely with the database administrator to ensure data is clean and available, allow meaningful reports to be made available efficiently, and ensure single source of truth behind all data decisions. Role Responsibilities Data Warehousing: Collaborate with senior developers to design, develop, and maintain reports, dashboards, and visualizations that effectively communicate complex data insights Data Analysis: Work closely with business stakeholders to understand their reporting requirements and translate them into effective data models and visualizations Data Integration: Assist in integrating data from various sources into DW using appropriate Extract, Transfer and Load (ETL) processes, ensuring data quality and integrity Transfer current Data Warehouse reports into SAP Analytics Cloud (SAC) Report Optimization: Optimize existing reports and dashboards for improved performance, usability, and user experience Testing and Troubleshooting: Conduct thorough testing of reporting solutions (SAC) to identify and resolve any issues or bugs, ensuring accuracy and reliability of the data Documentation: Document data models, report specifications, and development processes to ensure clear communication and knowledge sharing within the team Collaboration: Collaborate with cross-functional teams, including business analysts, data engineers, and stakeholders, to gather requirements and ensure successful project outcome Continuous Learning: Stay up to date with the latest trends and best practices in DW development and business intelligence to enhance technical skills and contribute to ongoing process improvements Role Requirements Degree in Computing subject or equivalent Certification in Data Warehousing and related technologies is a plus Must be able to attain and hold National Security Vetting to a minimum SC level Experience in data analysis, modelling, and management Prior experience in developing analytical data models and ETL (Extract, Transform, Load) processes. Adept at designing, implementing, and optimizing data models to drive insightful analytics and support decision-making. Skills in building and managing ETL workflows to ensure the efficient and accurate movement of data across systems. Experience in SAP Data Tools – particularly SAP Analytics Cloud and SAP DataSphere. Proficiency in leveraging these tools to develop, manage, and optimize data models, analytics, and reporting solutions. Expertise in integrating data from various sources, performing advanced data analysis, and generating actionable insights to support business decision-making. Experience in managing priorities and stakeholders, with skills in balancing multiple tasks and projects simultaneously, ensuring that critical deadlines are met. The ideal candidate should have prior experience working with protected and sensitive data, such as ITAR (International Traffic in Arms Regulations) data. Knowledgeable about the handling, storage, and transfer of sensitive information, ensuring compliance with relevant regulations and security protocols. Experience working with MRP (Material Requirements Planning) and/or ERP (Enterprise Resource Planning) generated data, with skills in analysing and interpreting complex datasets from these systems to provide actionable insights and support decision-making processes. Ability to communicate complex data insights to non-technical stakeholders and collaborate with cross-functional teams. The ideal candidate should have a solid understanding of project management principles, including the ability to plan, execute, and oversee data science & BI projects effectively. Stay up to date with the latest trends and best practices in Data Warehouse development and business intelligence to enhance technical skills and contribute to ongoing process improvement. Strong working knowledge of SQL and DAX. An ideal candidate will also be familiar with VBA, PowerShell, and Python. Strong understanding & proficiency in data modelling, statistical analysis, and predictive modelling using tools such as SSAS, Power BI, SAP Analytic Cloud, and SAP DataSphere. An understanding of data privacy laws and regulations such as GDPR is essential. As well as knowledge of data protection principles and practices to ensure compliance. Knowledge of industry-standard security protocols and frameworks, such as ISO 27001. Experience in implementing and maintaining security measures to protect data integrity and confidentiality. Proficiency in generating regulatory reports and documentation as required by relevant authorities. Understanding of reporting timelines and formats. The ideal candidate would have experience in using monitoring tools such as SPLUNK, Datadog, or New Relic to analyse and troubleshoot system performance and / or logs. Understanding of business intelligence concepts and the ability to translate business needs into data-driven insights.

Surrey, United Kingdom

Hybrid

Freelance

21-02-2025

Company Name: Cornwallis Elt
Job Title: AWS Data Engineer
Job Description: AWS Data Engineer – Python, AWS, CloudFormation, Terraform, Containerisation, Financial Services, Contract - London/Remote - £550 - £650 p.d. Inside IR35 A hands-on Senior AWS Data Engineer is currently being sought after by a leading financial institution based in London for a contract running till the end of year with intent to extend/go permanent after. In this role, you will have the opportunity to drive the architecture, development, and optimization of cutting-edge AWS-based data solutions in the financial services domain. You’ll work with Agile delivery methods, developing serverless solutions, improving existing platforms, and collaborating with a skilled team to deliver top-tier results. To be successful in this role, you would need the following: Strong experience in Python development for data engineering tasks. Familiarity with AWS services including IAM, Step Functions, Glue, Lambda, RDS (e.g. DynamoDB, Aurora Postgres), SQS, API Gateway, Athena, is highly beneficial. Familiarity with container technologies (e.g., Docker, Kubernetes) is a plus. Experience implementing infrastructure as code (IaC) using tools like CloudFormation or Terraform. Experience with NoSQL and relational databases, including their integration within AWS environments, is highly beneficial Experience working in the Financial Services domain is essential. Bachelor’s Degree in MIS, Computer Science, or IT-related field or equivalent IT-related experience. This is an exciting opportunity to work in a collaborative environment, solve complex challenges, and contribute to the growth of cutting-edge data platforms.

London, United Kingdom

On site

Freelance

21-02-2025