Data Engineer

On site

Newcastle Upon Tyne, United Kingdom

Full Time

17-03-2025

Share this job:

Score my CV

Job Specifications

My client is looking for Data Engineers to join their team in Newcastle. Multiple roles are available at various levels, with competitive salaries. This on-site role is based in Newcastle City Centre.

You’ll be responsible for developing, testing, and maintaining the data platform, ensuring data availability and integrity, and working closely with front office and technology teams. You’ll also have the opportunity to work with diverse data types and tackle real-world challenges.

Key Requirements:
Experience in data-related roles, with strong SQL, Python, and Apache Spark skills
Experience with Databricks and Microsoft Azure is a plus
Financial services experience is a bonus, not essential
Strong communication skills (written and verbal)
A 2:1 degree or higher in Computer Science (or related field)

Responsibilities:
Manage and enhance the data platform using both in-house and third-party data tools
Analyse and implement data automation tasks and workflows
Build data pipelines to integrate data from various sources into the firm's data platform
Curate and manage internal and external datasets to support the front office's data requirements
Design and implement effective, best-practice data architectures
Develop and enforce data standards and quality control measures

This opportunity will be based in Newcastle upon Tyne- Full time
** We are unable to sponsor visas for this role, you must be based in the UK with the right to work in the UK in place already

About the Company

We are on a mission to make people happier at work. We help companies attract the right tech talent for their business. And we help technology professionals to find the right new opportunities for their career objectives. By focusing exclusively within the Software Engineering and Data Science markets, we support businesses that use AI to make the world a better place. In short, we find people that help machines help people. How does a recruitment company originate that genuinely disrupts the status quo? By building a '... Know more

Related Jobs

Company Name: Ministry of Justice UK
Job Title: Data Warden, Prison Data Assurance Team, Ministry of Justice (Ref: 4032)
Job Description: East Midlands (England), East of England, London (region), North East England, North West England, Scotland, South East England, South West England, Wales, West Midlands (England), Yorkshire and the Humber Job Summary This position is based Nationally Job Description Do you have the passion, values, and ability to help us solve the biggest problems of the justice system? Data Warden, Prison Data Assurance Team, Ministry of Justice Overview We have 1 role in the Prison Data Assurance team, within the Analysis Directorate. Roles Are Open To: Existing Civil Servants at HEO (or equivalent) and to other eligible Civil Service staff on promotion. Additionally, individuals outside of the Civil Service may apply as external candidates. Minimum Requirements To Apply: Candidates must be able to show the relevant experience and skills and must meet the criteria for entry. We welcome applications from candidates based across the UK. Candidates will have the option of being based in the Leeds or London HQ offices (with flexible working arrangements available) or your nearest Justice Collaboration Centre or Justice Satellite Office: see this map for more details. Alternative locations may be available and will be discussed and agreed on the completion of background checks. Interviews are likely to take place in May 2024 and will be held via MS Teams. We will keep a merit list for a year for those who successfully pass the interview board but who are not offered a post. About the Analysis Directorate We are passionate about improving justice outcomes through innovative research, data and analysis. In the Analysis Directorate, we provide high quality data and analysis helping to ensure strategic, policy, finance, corporate and operational decisions are based on robust evidence. We create a culture in which people are empowered with the data and information to make excellent decisions; using cutting edge tools, techniques and collaboration; putting evidence at the heart of the justice system. We are a multi-disciplinary team of around 650 staff that sits at the heart of the Ministry of Justice providing analytical support across a diverse and exciting agenda. We work in a dynamic and fast-paced context and our skills are in heavy demand across the Ministry of Justice. Our collaborations beyond government are seen as ground-breaking. The Analysis community is made up of analysts and specialists including: Social Researchers, Economists, Operational Researchers, Statisticians, Data Engineers, Data Scientists and other data specialists (such as data strategists, data dissemination, generalists and assurance experts). Why work in the Analysis Directorate? In the Analysis Directorate, we want all our people to feel valued for who they are and for the work they do. We provide a warm, inclusive place to work and offer a wide range of flexibilities and benefits as part of our people offer to reward our staff. What We Offer What you’ll do As a Data Warden within Prison Data Assurance (PDA) you will be responsible for supporting assurance activity of prison data to enable better outcomes to the business. Our team’s assurance activities support the wider MoJ and HMPPS in making key decisions based on the best available data. We support improvement to data presented in multiple platforms including HMPPS Performance Hub. Our work contributes to key publications by ensuring data is as accurate as possible. We support new data requests, engaging with policy stakeholders and digital developers to ensure we are capturing the data for the right reasons and that this is presented appropriately and in an easy-to-understand format. You Will Be Responsible For The Following Key Activities: Main Activities/Responsibilities The job holder will be required to undertake the following duties and responsibilities: Who you are The Following Experience And Skills Will Be required: The following experience and skills are desirable: How to apply You’ll need to submit a Statement of Suitability and evidence against the Civil Service Success Profile Behaviour: Managing a Quality Service (Lead Behaviour). Please refer to the CS Behaviours framework for more details at the relevant Grades: Success Profiles: Civil Service behaviours - GOV.UK The Statement of Suitability should be no more than 750 words and should give us examples of how your skills and experience match those needed for this role. Consider giving examples that cover all the requirements in the ‘Who you are’ section and use work you have completed to demonstrate how you meet each one. Should a large number of applications be received, a pre-sift may be undertaken using the Civil Service behaviour, Managing a Quality Service (max 500 words). Candidates who pass the pre-sift may be progressed to a full sift or progressed straight to assessment/interview. 5a. Selection Process There will be an initial sift of applicants through comparing submitted evidence against the ‘Who you are’ bullets. This usually takes two weeks, depending on the number of applications. Those who make it through the initial sift will be invited to a Civil Service Success Profile interview. In the Civil Service we use Success Profiles to help us find the right person for the job. We will be using a mixture of methods to assess your abilities, strengths, experience, technical skills, and behaviours. We highly recommend learning about Success Profiles and using the Situation, Task, Action, Result and Reflection (STARR) framework when structuring your answers. The highest scoring candidates that pass the interview will be offered the roles. The whole process can take up to a month. Behaviours You will be assessed against the Civil service success profiles framework at interview stage: Managing a Quality Service Making Effective Decisions Changing and Improving Please also refer to the CS Behaviours framework for more details at this grade. Success Profiles: Civil Service behaviours - GOV.UK Applicants invited for Interview You will be required to give a 5-minute presentation on a piece of data assurance activity you have conducted. Details of this will be sent to those candidates who are invited for interview. Further Information If you require any additional information about the role, please contact: Cheryl.Wright1@justice.gov.uk or Guillaume.Foxton@Justice.gov.uk Do you have the passion, values, and ability to help us solve the biggest problems of the justice system? Data Warden, Prison Data Assurance Team, Ministry of Justice Overview We have 1 role in the Prison Data Assurance team, within the Analysis Directorate. Grades: Success Profiles: Civil Service behaviours - GOV.UK The Statement of Suitability should be no more than 750 words and should give us examples of how your skills and experience match those needed for this role. Consider giving examples that cover all the requirements in the ‘Who you are’ section and use wor...

London, United Kingdom

On site

Full Time

18-03-2025

Company Name: Hull Live | Hull Daily Mail
Job Title: Senior Data Engineer
Job Description: Full-time Contract Type: Permanent Location: Remote - UK Division: Technology & Product Salary Currency: GBP Sterling Department: Data & Analytics Company Description We are looking to hire a Senior Data Engineer who will play a key role in supporting the existing HiveAlpha article MI product, and delivering Trenflow (a green field product that will ultimately replace HiveAlpha and support further key use cases). Key responsibilities will include creating new data ingestion processes, monitoring existing processes and building out the ingestion frameworks to exceptional quality standards. HiveAlpha and Trenflow are built using AWS services including OpenSearch, DynamoDB, Lambdas, Kinesis, ECS, AppSync. The Senior Data Engineer reports to the HiveAlpha / Trenflow Tech Lead, manages ZERO people and works closely with a Tech Lead, a Product Manager, a Business Analyst, and Frontend Engineers. Role Location The role is fully remote, and so we are therefore open to candidates across the UK. So, who are we? We are Reach Plc, you might not have heard of us but we have probably met without you even realising it. We are home to the UK and Ireland’s most iconic digital platforms, magazines and newspapers. From the Mirror, Daily Express and OK!, to our regional titles such as the Liverpool Echo, BirminghamLive and the Manchester Evening News (plus lots more), our brands and the stories we cover are as varied as our people. We help all kinds of people share experiences through our stories because we believe this is what makes us human. Oh, and we should probably also mention that with a monthly readership of 47 million people, Reach is the largest commercial publisher in the UK. At Reach, not only will you feel better understood, you will also feel you understand other people better too. Job Description In this role, you will develop and manage data ingestion processes using Python and NodeJS, requiring you to adapt to various programming environments and technologies. Your key responsibilities include sourcing data from systems like APIs, S3 buckets, Databases, and Streams, ensuring seamless integration into the data infrastructure. You will utilise Infrastructure-as-Code (IAC) tools for AWS provisioning, which is essential for efficient cloud resource management and automation to enhance scalability and reliability. Monitoring the data platform is crucial for you to maintain system integrity, with a focus on implementing observability mechanisms for quick issue resolution. Collaborating with business analysts, product managers, and stakeholders will ensure that you achieve accurate data ingestion aligned with organisational goals. Documenting processes and design decisions is vital for maintaining clarity and consistency, aiding in future developments. Upholding Reach's diversity and inclusion policy is paramount in your role, ensuring all content reflects non-discrimination values and promotes an inclusive work environment. Qualifications Ideal candidate will have the following skills; Advanced knowledge of Python Strong knowledge of AWS core and data services, particularly OpenSearch, S3, Glue, Lambda, ECS, and DynamoDB Excellent knowledge of SQL, including DML and DDL Excellent understanding of unit testing for data processes Passionate about data and its potential opportunities Articulate communicator who enjoys fostering collaboration within an organisation and between teams Able to work independently as well as part of a team Experience with end-to-end solutions, including web applications, APIs, backend, and frontend technologies, is highly desirable Additional Information We are offering a competitive salary and benefits including; Help saving for your retirement - join our pension scheme and we’ll match contributions up to 6% 25 days’ holiday per year when you join. After three, five and ten years’ service with Reach, you’ll accrue one additional day of annual leave. We also have a Holiday Purchase Scheme Giving back day - an additional day’s leave each year to support a cause close to your heart Enhanced family leave - including maternity, paternity and adoption - and you’ll be eligible after just six months’ employment Private Healthcare Cash Plan - free health cash plan so you can claim back cash for a range of medical expenses As one of the UK’s top 50 Inclusive Employers everyone’s invited to join our events, programmes and networks to celebrate diversity and build an environment where all our people can thrive Wellbeing support - including a 24/7 employee assistance programme (EAP) for you and your nearest and dearest Awesome career opportunities - you’ll have support from your line manager and a range of learning & development programmes We are also a member of the 30% Club, a global campaign aimed at increasing gender diversity at board and senior management levels We reserve the right to close this vacancy early if we receive sufficient applications for the role. Therefore, if you are interested please apply early to avoid disappointment. Reach plc believes diversity brings benefits for our customers, our business and our people. This is why we are committed to being an inclusive employer and encourage applications from all suitable applicants irrespective of background, circumstances, age, disability, gender identity, ethnicity, religion or belief and sexual orientation. I'm interested I'm interested Privacy Policy

London, United Kingdom

On site

Full Time

17-03-2025

Company Name: Green Cat Renewables Ltd
Job Title: AI Software Engineer
Job Description: Green Cat Renewables Job Advertisement – Renewables AI Software Engineer Location: Edinburgh, Glasgow or Biggar The Company Green Cat Renewables (GCR) is a dynamic, innovative company that provides the complete range of technical services required to deliver renewable energy projects. The team of over 90 Engineers and Environmental Consultants deliver projects on behalf of clients from four offices in Edinburgh, Glasgow, Livingston and Biggar. GCR also works closely with its three sister companies Green Cat Contracting and Green Cat Hydrogen based in the UK and Green Cat Renewables Canada based in Calgary and Halifax. The company has four main departments - Engineering, Environmental & Planning, Geotechnical Services and Technical & Asset Management Services. Underpinning these are the main administrative functions of the business, including a growing Artificial Intelligence (AI) team. Projects are typically based on wind, solar, and hydro power, with an increasing requirement for grid management, battery storage, and alternative technologies. To enhance its services and bolster technological and data analytic capabilities, GCR is seeking an Artificial Intelligence (AI) Software Engineer with a strong background in software engineering to help deliver improvement projects using state-of-the-art AI techniques. The successful candidate will work closely with the Lead AI Engineer and other key collaborators to identify opportunities and implement AI solutions to drive productivity and advance engineering processes. *Please note that Green Cat Renewables do not offer any form of visa sponsorship* The Role The role will initially be focused on improving the useability of AI in several key projects: Ensuring the usability of our custom LLM Application: collaborate with internal end user stakeholders to evolve our LLM Application such that they appreciate its added value in their workflows. Engineering our ANN energy models to be accessible: work with internal stakeholders of varying technical expertise to have the model accessible at levels they are comfortable with. Enhancing our Reporting Speed and Quality: evaluate the current workflows and identify and implement incremental improvements which together will make a major positive development. As time progresses, we expect your contributions to extend across the broader business: Assessment and Analysis: continuously evaluate GCR’s business processes, data infrastructure, and technological capabilities; identify opportunities for AI integration and optimisation; analyse GCR’s needs, objectives, and constraints to develop tailored AI strategies that align with business goals and priorities. Establishing and Leading Engineering Practices: Define and implement best practices for integrating AI into engineering workflows. Lead the development of standards, processes, and tools that enhance collaboration and ensure high-quality engineering outcomes. Research and Development: conduct research and evaluate industry best practices; specify innovative AI solutions that drive value and competitive advantage; seek to improve existing AI solutions. AI Data and Model Management: working with the internal IT team, manage cloud services and hardware used for deploying AI models, particularly with respect to ongoing data size and cost efficiencies. The Candidate The Candidate would ideally have the following: A degree in computer science, data science, artificial intelligence, engineering or a related field. Strong foundation in engineering principles and the ability to integrate AI solutions into engineering processes. Proficiency in developing end-to-end software solutions. Expertise in at least one relevant programming language (e.g., Python, Java, or C++) Familiarity with at least one AI framework (e.g., TensorFlow, PyTorch, or Scikit-learn). Knowledge of AI algorithms, machine learning techniques, and data analytics methodologies, with an emphasis on engineering applications. Understanding of data preprocessing, feature engineering, and statistical analysis. Familiarity with at least one cloud service for deploying AI models (e.g., AWS, Google Cloud, or MS Azure). Ability to transfer knowledge and skills effectively (with AI assistance or otherwise). A desire to learn and to keep abreast of the latest developments in AI. Strong analytical and problem-solving skills. Excellent communication and collaboration abilities. Business acumen. High self-motivation and ethical standards. Interest in or knowledge of renewable energy systems. Benefits Competitive salary 25 Days annual leave and 8 flexible bank holidays Private Medical Healthcare Cycle to work scheme Professional development opportunities and support Professional fees paid for by the company Company social events and team building days On-site parking with EV charging points available to staff (Edinburgh Office only). Closing Date is 1st April 2025 To apply please send a full CV and covering letter to jobs@greencatrenewables.co.uk .

Scotland, United Kingdom

On site

Full Time

18-03-2025

Company Name: Goodman Masson
Job Title: Static Data Analyst
Job Description: I am working with a leading Investment Bank on a new Static Data Analyst, covering their London and European offices. You will be responsible for maintaining high-quality reference data across systems, ensuring accurate client registration, settlement instructions, and regulatory data management, all while working closely with internal teams to drive process improvements. Key Responsibilities: Maintain high-quality reference data, ensuring compliance with AML/KYC client documentation Register new customers and update product, settlement, and regulatory attributes across all relevant systems Process reference data instructions from incoming workflows within agreed SLAs Manage and approve Standard Settlement Instructions (SSI) for FX/MM derivative products Update internal trading limits and base/fixing rates across branches Collaborate with internal teams to improve existing processes and system efficiencies Support data administration, cash management teams, and ad-hoc projects within Shared Services What We’re Looking For: Degree-qualified or equivalent experience Excellent static or reference data skills, gained within banking Excellent communication skills and the ability to build relationships across teams Strong numerical and analytical capabilities A customer-centric mindset with a keen eye for process improvements High computer literacy, particularly in data manipulation and presentation

London, United Kingdom

On site

Full Time

18-03-2025