Data Engineer NEMSJP00175297
On site
London, United Kingdom
£ 600 / day
Freelance
30-10-2024
Job Specifications
What You'll Be Doing
This role has a hands-on technical aspect, architecting and building solutions that will be leveraged by developers. You will demonstrate sound engineering principles and a good understanding of modern CI/CD toolsets.
Utilize cutting edge technology including GenAI to deliver efficiencies and business outcome in and around the tooling you are creating.
Ensure that you deliver great solutions that users love by maintaining a culture of quality and engineering excellence.
Who You Are
You have 10+ Years of relevant experience
You are a senior software architect with a passion for designing and building modern, cloud-native, fully observable data engineering solutions. You strive to build solutions that are valued by developers and have an experience-based understanding of what that means.
You have solid experience in an agile development environment with modern programming languages and technologies such as Java/Spring Boot, Scala, Python etc.
You have experience designing and implementing cloud-native applications using open and closed source standards and solutions such as Docker, Kubernetes, RedHat OpenShift, Cloud Foundry.
You have a good working knowledge of microservices architectures, Rest APIs, streaming and message queueing systems (Kafka etc.) and how to instrument them.
You love working together on scalable systems, embracing new technologies, and pushing the boundaries of "the art of the possible".
Expertise in data governance or data control is a plus.
Experience with LLMs and GenAI is a plus
About the Company
Perfect placements. Speedy staffing. Tenacious testing. Who's Adecco, we hear you ask? Only the top provider of first-class HR solutions. Our consultants work with some of the best, and most exciting, companies all over the world. We equip our clients with priceless industry insight and put everything we've got into training and mentoring our candidates. We're here to match talented people with the job opportunities and employers they're looking for. On any given day we connect over 700,000 people with fulfilling opportuni... Know more
Related Jobs
- Company Name
- Lorien
- Job Title
- Market Data Business Analyst
- Job Description
- Market Data Business Analyst Hybrid Working - London - 1 day a week on site. Financial Services Lorien's leading banking client is looking for a Market Data Business Analyst to join the existing team on a brand-new project. This role is based in London. This role will be Via Umbrella. Working in a Hybrid Model of 1-2 days a week on site. What you'll do: Your daily responsibilities will see you maximizing the value of supplier relationships and driving cost efficiencies in collaboration with key stakeholders. To do this, you'll interact with differing levels of management across a variety of franchises and functions. We'll need you to manage data licensing to make sure all our franchises and functions remain compliant, whilst maximizing cost reduction opportunities from the evaluation of alternate providers. You'll also deliver financial reporting, data analysis and Credit Reference Agency service recommendations You'll also be responsible for: Leading contract negotiations in partnership with key stakeholders to make sure the most appropriate market data products are delivered at the best possible price Managing contract-related risks and issues, supplier audits and cost transparency to demonstrate contractual compliance to protect our business Providing analysis on and insights into market data costs to allow business managers and finance business partners to set and track market data budgets and realise cost savings Working with business franchises and functions to accurately define business requirements whilst acting as a subject matter expert and a point of contact for Credit Reference Agencies Managing third-party market data audits whilst remediating any data exposures where possible, including challenging audit findings to minimise any penalties Key Skills and Experience Lead contract negotiations in partnership with key stakeholders ensuring the most appropriate market data products are delivered to the group at the best possible price Manage contract related risks and issues, supplier audits, and cost transparency to demonstrate contractual compliance to protect the business Provide analysis on and insights into market data costs to allow business managers and finance business partners to set and track market data budgets and realise cost savings Work with business franchises and functions to accurately define precise business requirements, providing an ongoing subject matter expert point of contact for Credit Reference Agencies IND_PC3 Carbon60, Lorien & SRG - The Impellam Group STEM Portfolio are acting as an Employment Business in relation to this vacancy.
- Company Name
- Glocomms
- Job Title
- Data Engineer
- Job Description
- ***DV/Developed Vetting Clearance is Required for this project*** ***Please do not apply if you do the have the relevant security clearance*** Job Title: Data Engineer (Government Sector) Location: London, Westminster, 5 days in the office (Flexibility around this can be offered) Employment Type: 6-month long-term rolling contract inside IR35 Job Overview: We are seeking a proactive and detail-oriented Data Engineer to join a team for a government sector project in London. The ideal candidate will have a solid background in Python and experience transforming structured data, with an emphasis on engineering best practices. Familiarity with the Palantir platform and AWS will be beneficial however is not mandatory. This role requires a self-starter who can understand complex problems, work collaboratively, and deliver high-quality solutions. Key Responsibilities: Develop, maintain, and optimize data pipelines and ETL processes using Python. Transform and clean structured data to support analytical needs and reporting. Collaborate with stakeholders to gather requirements and understand data needs. Troubleshoot and resolve data-related issues in a timely manner. Document processes and maintain clear specifications for data workflows. Continuously seek to improve data quality and engineering practices. Qualifications: 5-8 years of experience in data engineering or related roles. Proficiency in Python for data manipulation and transformation. Experience with structured data and familiarity with ETL processes. Strong analytical and problem-solving skills. Ability to work independently and take initiative. Excellent communication and collaboration skills. Desired Attributes: Interest in data science and analytical methodologies, although the focus is on engineering. Familiarity with AWS services would be a bonus Knowledge of the Palantir platform is a plus. A proactive approach to understanding and addressing project challenges. Strong attention to detail and commitment to delivering high-quality results. Please reach out to Joel.wren@glocomms.com
- Company Name
- Bright Purple
- Job Title
- Head Of Data Management
- Job Description
- Head of Data Management - Remote - Contract 6 months initial contract Inside IR35 Up to £1650 day rate Remote UK working (occasional travel) I have an initial 6 month contract available with remote working (occasional travel) within the UK for a talented Head of Data Management (tools and platform) to join a leading financial services client. You will be responsible for a team of between 25 - 35 people and will work closely with the Architecture team and data/solutions. What we are looking for: Experience of working in a multi-disciplined environment Technical leadership BCBS 239 Centric Strong knowledge of implementation of BCBS Strong knowledge of tooling (preferably Calibre) APPLY NOW via the link below or email Claire directly. Bright Purple is an equal opportunities employer: we are proud to work with clients who share our values of diversity and inclusion in our industry.
- Company Name
- Empiric
- Job Title
- DV Cleared Data Engineer
- Job Description
- We are looking for several skilled DV Cleared Data Engineers for a long term outside ir35 contract with a Defence customer of mine. Skillset; Python Apache Spark, Apache Airflow, Apache nifi Git/GitHub Object storage Servers (ie MinIO) Details: Active DV clearance (used within last 12 months) Sole British National Based Hybrid in Central London (3 days onsite) Outside Ir35