Senior Data Engineer
On site
Reading, United Kingdom
£ 750 / day
Full Time
11-04-2025
Job Specifications
I am on the look out for a Technical Lead to join my client on a contract basis. This will be a 6 month contract with a high likelihood of extension.
As the Technical Lead, you will be responsible for leading a talented team of data engineers and architects in designing, building, and optimising their datalakehouse infrastructure. This role requires a deep understanding of Databricks and a passion for data-driven solutions.
Key Responsibilities:
Lead the design and implementation of a scalable datalakehouse architecture using Databricks.
Collaborate with cross-functional teams to gather requirements and define technical specifications.
Mentor and guide team members, fostering a culture of continuous learning and improvement.
Ensure best practices in data management, security, and governance are followed.
Troubleshoot and resolve technical issues, ensuring high availability and performance.
Stay up-to-date with the latest industry trends and technologies to drive innovation.
Qualifications:
Proven experience as a Technical Lead or similar role, with a focus on Databricks.
Strong expertise in data engineering, ETL processes, and data warehousing.
Proficiency in programming languages such as Python, Scala, or SQL.
Experience with cloud platforms (e.g., AWS, Azure, GCP) and big data technologies.
Excellent leadership, communication, and problem-solving skills.
Ability to work independently in a fully remote environment.
If this sounds like the right fit for you. Please send across your most recent CV and I will be in contact if I feel you are a good fit for the role.
About the Company
Specialising in recruitment across the tech, digital, engineering, and government and defence sectors, iO Associates have extensive experience in securing the best talent to create the products and infrastructure of the future. Our dedicated team of highly experienced and knowledgeable consultants provide bespoke solutions, working with businesses to find the perfect fit across contract, interim, search, and permanent appointments. We offer end-to-end support, from Statements of Work and IR35 determination processes to full... Know more
Related Jobs
- Company Name
- Guardian Jobs
- Job Title
- University Director of AI Innovation, Bluetownonline
- Job Description
- Job Title: University Director of AI Innovation Location: Oxford Road, Manchester Salary: Competitive - Circa £100,000 - £120,000 per annum Job type: Fixed Term (60 months) - 35 hours per week/ 1.0 FTE Closing date: 30/05/2025 Are you ready to lead transformative AI innovation in one of the most forward-thinking universities? At This University, we are on the cutting edge of Artificial Intelligence (AI) to revolutionise teaching, learning, research, and operations. As we continue to shape the future of higher education, we're seeking a dynamic, strategic, and visionary Director of AI Innovation to spearhead groundbreaking AI-driven projects across our institution. In this exciting role accountable to the University Executive (UE), you will lead our Skunkworks team-an elite group of AI specialists committed to accelerating high-impact AI projects. You'll collaborate with key stakeholders, develop sustainable AI initiatives, and drive AI adoption to enhance the University's performance and global standing. What You'll Be Doing: Lead and Inspire a High-Performing Team: Manage and inspire a talented, agile Skunkworks team to innovate and deliver transformative AI solutions. Engage with Key Stakeholders: Work closely with internal partners to identify challenges and co-design AI projects that drive real-world impact across teaching, learning, research, and operations. Scale AI Solutions: Create compelling business cases, track ROI, and oversee the growth of AI initiatives with measurable outcomes. Drive AI Strategy: Monitor emerging AI trends, evaluate their potential for higher education, and ensure our University remains at the forefront of innovation. Champion Ethical AI: Lead responsible AI adoption, ensuring compliance with ethical, legal, and regulatory standards. What We're Looking For: Expertise in AI Technologies: Deep understanding of AI technologies and their transformative potential for higher education. Proven Leadership: Experience in leading innovative teams, driving complex AI projects, and delivering measurable institutional impact. Strategic Vision: Ability to craft and execute long-term AI strategies, building partnerships across disciplines to achieve common goals. Stakeholder Engagement: Strong communication skills to engage, influence, and partner with a diverse range of stakeholders across the institution. Ethical and Risk Management: A solid grasp of the ethical, regulatory, and risk considerations of AI, ensuring responsible deployment. Why Join Us? Shape the Future: Lead AI projects that will transform the University and higher education at large. Collaborative Environment: Work alongside experts and leaders across multiple disciplines to push the boundaries of innovation. Commitment to Excellence: A university culture focused on sustainability, social responsibility, inclusion, and people leadership. Cutting-Edge Resources: Access to a substantial software licensing budget and support for sandbox projects. Essential Requirements: A higher degree in AI, computer science, or a related field (or equivalent industry experience). Demonstrable experience in delivering AI projects with substantial institutional impact. Exceptional communication, analytical, and project management skills. Ability to foster an inclusive and collaborative team culture. If you're a visionary AI leader ready to make an extraordinary impact in higher education, we want to hear from you! Apply now and be part of our journey to innovate, inspire, and lead AI transformation. As an equal opportunities employer we support an inclusive working environment and welcome applicants from all sections of the community regardless of age, disability, ethnicity, gender, gender expression, religion or belief, sex, sexual orientation and transgender status. All appointments are made on merit. Enquiries about the vacancy, shortlisting and interviews: Name: Michael Platt, Talent Partner Please note, we anticipate that interviews will be held on the 17th June 2025, though this date is subject to change. This vacancy will close for applications at midnight on the closing date. We reserve the right to close this vacancy ahead of the published closing date. Please click APPLY to be redirected to our website to complete an application form. Candidates with experience or relevant job titles of; Director of AI Innovation, AI Innovation Director, AI Director, University Director, Education Director, Director of Education, Director of University, may also be considered for this role.
Manchester, United Kingdom
On site
Full Time
10-05-2025
- Company Name
- TieTalent
- Job Title
- Data Mapping Engineer
- Job Description
- About Fantastic opportunity . Our client based in Bristol at the junction of the M5/M4 at Aztec West are a busy Global FinTech software provider to the world's top banks. They are looking for an additional Data Mapping Engineer to join their team , 3 days a week in office 2 work from home . You could come from a Mathematics or Computing background as common sense and an attention for detail are key requirements and training will be provided on the job within the team. The clients business solutions process high volumes of business data that is defined in industry standard formatted messages. These messages may be published in SWIFT international banking standard (ISO15022 and ISO20022) or as documents typically in XML or JSON. Their solutions uses utility software tools to load and process these incoming messages. The tools require the message format, message syntax and data fields to be mapped from the incoming message to the internal format that can be processed by their business solutions. Essential Skills Data entry skills Ability to understand and analyse data message specifications and formats Ability to use Excel and able to build spreadsheets with rules and formulae Understand how to test data is correct Numeracy A keen interest in software development business Flexible and adaptable with an attention to detail An independent problem solver with excellent communication skills Time management. Enthusiasm and desire to learn Resourcefulness and troubleshooting aptitude Fluent in English Desirable Skills Understanding of how software components make up a solution and how applications work Ability to build rules to manipulate data: group, sort, filter, calculate a result Ability to break down a task into smaller actions Using software to record activities Understanding how to test data or a result is correct Familiarity with writing unit tests Description And Responsibilities The Data Mapping team has responsibility for the mapping of the different messages used by all the clients solutions. This team will map the data in the messages and build the rules needed to accurately load the messages to their business solutions. The team will create the data mappings and undertake necessary testing to ensure accuracy. The team will audit and approve the mappings and investigate and resolve unmatched or missing source data. The team will work independently but in support of all the companies solution teams who are located in their different development centres across the globe. This is not a software development role but can to lead to a more technical role for a keen and interested candidate. Key duties and accountabilities of the role will include; Using a software tool to map data fields from an incoming file to an internal file Writing scripts or rules to manipulate data fields such as truncating or concatenating data fields to create a new data field value Reading and understanding specifications of different message types such as SWIFT messages used in the international banking arena Setting test acceptance criteria and the tests needed to prove the accuracy of the data mapping Using JIRA to set out the work programme and report progress Work with developers in different solutions teams Experience, Training And Qualification BTEC Level 3 Information Technology BSc (Honours) Computer Science or similar degree with a significant computing bias. A degree is not a mandatory entry requirement. Hours: Full time Permanent 37.5 hours Benefits Supportive holiday package - Includes 25 days annual leave rising to 28 (with length of service) Plus ability to carry over up to 10 days into the next holiday year Company pension scheme matching up to 5% of salary - Additionally, you can choose to make your contributions via Salary Sacrifice Group Life Assurance - Up to 9 times your annual basic salary Group Income Protection - Up to 75% of salary Private Medical Insurance - Which can include family cover Free onsite parking data map mapping engineer mathematics geo bristol json excel , test mathematical tester financial accounting accounts bank banking bristol bath weston portishead swindon chippenham aztec west data map mapping engineer mathematics geo bristol json excel , test mathematical tester financial accounting accounts bank banking bristol bath weston portishead swindon chippenham aztec westdata map mapping engineer mathematics geo bristol json excel , test mathematical tester financial accounting accounts bank banking bristol bath weston portishead swindon chippenham aztec westdata map mapping engineer mathematics geo bristol json excel , test mathematical tester financial accounting accounts bank banking bristol bath weston portishead swindon chippenham aztec west Nice-to-have skills Data Entry Data Analysis Software Testing Software Development JIRA Swift XML JSON Almondsbury, England Work experience Data Engineer Data Analyst Languages English
Almondsbury, United Kingdom
Hybrid
Full Time
10-05-2025
- Company Name
- hackajob
- Job Title
- Data Engineer
- Job Description
- hackajob is collaborating with The AA to connect them with exceptional tech professionals for this role. Location: Basingstoke (hybrid working 3 office days per week) Employment Type: Permanent, full time Additional Benefits: Annual Bonus Join Our Data & Analytics Team: Transforming Data into Our Superpower! Are you passionate about data and eager to make a significant impact? The AA is a well-loved brand with a range of driver services much wider than most people realise. We have an enviable set of data assets from breakdown, service, repair, insurance, telematics, digital interactions, car dealers and driving school! If that’s not enough, we’re focused on making Data our new Superpower as one of only 4 strategic priorities for the Group. Our growing team is modernising our data infrastructure to a cutting-edge cloud platform and enabling machine learning and GenAI. Join us at an exciting time and be part of a team that is driving meaningful change for our customers, colleagues and shareholders. At AA, our purpose is to create confidence for drivers now and for the future. Our data team is pivotal in achieving this by harnessing the power of our extensive motoring and insurance data. We are currently seeking a talented Data Engineer to join our team and help us unlock the full potential of our data. As a Data Engineer, you’ll be crucial in developing and maintaining our data pipelines and data lake house architecture. You’ll be central to the success of our data team's efforts to maximise our data capabilities. This is an exciting time for our data engineering team, and you’ll have the opportunity to define our data engineering approach and best practices, implementing a modern data ecosystem that supports our mission. Writing high-quality, readable and maintainable code. Designing, building and maintaining resilient data pipelines Identifying and automating manual or repetitive data processes. Establishing the data lake house as a single source of insight for the business. Developing analytical datasets to support insights into customer behaviour, operational efficiency and key performance metrics. Triaging and resolving data-related incidents, supporting users with timely responses and root cause analysis. Following agreed architectural standards and contributing to their continuous improvement. Proficiency in Azure and its data related services. Strong SQL and PySpark skills, with a focus on writing efficient, readable, modular code. Experience of development on modern cloud data platforms (e.g. Databricks, Snowflake, RedShift). Familiarity of Data Lakehouse principles, standards and best practices. Understanding of event-driven architecture and data streaming technologies. Familiarity with Agile delivery methodologies, Azure DevOps and CI/CD pipelines. Strong collaboration skills with the ability to communicate clearly across different teams. A focus on delivering scalable technical solutions aligned to business strategy, with a continuous improvement mindset. Benefits We’re always looking to recognise and reward our employees for the work they do. As a valued member of The AA team, you’ll have access to a range of benefits including: 25 days annual leave plus bank holidays + holiday buying scheme Worksave pension scheme with up to 7% employer contribution Free AA breakdown membership from Day 1 plus 50% discount for family and friends Discounts on AA products including car and home insurance Employee discount scheme that gives you access to a car salary sacrifice scheme plus great discounts on healthcare, shopping, holidays and more Company funded life assurance Diverse learning and development opportunities to support you to progress in your career Dedicated Employee Assistance Programme and a 24/7 remote GP service for you and your family Plus, so much more! We’re an equal opportunities employer and welcome applications from everyone. The AA values diversity and the difference this brings to our culture and our customers. We actively seek people from diverse backgrounds to join us and become part of an inclusive company where you can be yourself, be empowered to be your best and feel like you truly belong. We have five communities to bring together people with shared characteristics and backgrounds and drive positive change.
Basingstoke, United Kingdom
Hybrid
Full Time
10-05-2025
- Company Name
- hedgehog lab
- Job Title
- AWS Data Engineer (Glue, Redshift, Athena, OpenSight)
- Job Description
- hedgehog lab is a human-centred global tech consultancy. What sets us apart? Our unwavering commitment to going above and beyond, meeting every challenge with passion and curiosity. We take immense pride in our role as trusted partners for businesses worldwide, where we harness cutting-edge technologies to sculpt digital products that not only meet but exceed expectations, leaving a lasting impact on our clients and their industries. Our culture thrives on turning constraints into catalysts for innovation, empowering our team to unleash their full potential and deliver unparalleled value to our clients. Beyond our award-winning work, we’re also known for our Flexa-certified company culture. We’re looking for a passionate AWS DATA ENGINEER who’s committed to delivering products that cut through the complexities of digital transformation and bring valuable business visions to life. The Opportunity Our Mission: Become the most respected technology consultancy in the world, leading the industry in innovation and client satisfaction Your Mission: Build data products using AWS on large-scale data implementations About You Proven experience working as a Data Engineer in AWS Proven experience of Glue, Redshift, Athena and QuickSight Strong background in ETL and large-scale date warehouses Experienced across different AWS services (S3, EC2 etc) BI/Data-Visualisation and dashboard experience Note: Research shows that women and individuals from underrepresented backgrounds often refrain from applying to positions unless they meet all the specified criteria. If you believe you possess the necessary qualities for this role but do not fulfil every requirement, don't hesitate to apply. We actively encourage you to showcase your skills and what you can contribute. Our Interview Process Stage 1⃣ - Intro Call with a member of the Talent team (30 minutes Google Meet) Stage 2⃣ - First stage interview with the hiring manager (30 minutes Google Meet) Stage 3⃣ - Take home tech test (no deadline, simply return when you’re happy) Stage 4⃣ -Final stage interview with at least 2 member of the hiring team (60 minutes Google Meet) Why hedgehog lab? Rated #1 in the UK on Clutch for mobile development. Our People are our greatest asset, and we are so proud to have been certified as a Great Place to Work, as rated by 93% of our business. We’re a fully Flexified Employer, certified by Flexa. We know a one size fits all approach doesn’t work for everyone, we work with our employees to establish a model that benefits both parties. We received the Advanced Award in the North of Tyne Combined Authority Good Work Pledge. Check out our Glassdoor reviews! Inclusive environment. We never discriminate based on race, colour, religion, gender, gender identity, sexual orientation, nationality, genetics, disability or age. From menopausal support to neurodiversity adjustments, we’ll continue to foster an inclusive culture at the lab where everyone can let their authentic selves shine. What We Offer 36 days paid holidays (UK), including bank holidays. 30 days paid holidays (Bulgaria), including public holidays and special leave days Flexible working environment. We understand that not one approach fits everyone. Whether they are working from the office or home, we fully support our team in whichever way they prefer to work. Enhanced parental policies. A transparent and open company culture where politics are shunned, and everyone works as a team. Annual learning & development budget (Global) plus 4 days L&D leave, which renews every year Annual wellbeing budget (Global) plus 2 paid wellbeing days to use as you feel fit Free therapy sessions with Spill (Global). Mental health is paramount to us. Our partner, Spill, is a Slack-integrated therapy app available to all our staff at no extra cost Bippit financial wellbeing service (UK) gives everyone access to a professionally-qualified financial coach, tools and resources to alleviate money stresses. Bupa health plan (UK). This cash plan enables UK employees to claim back cash back for a selection of routine health expenses 1 volunteering day a year. Volunteer and contribute to a cause of your choice (Global) Monthly payday socials and annual Summer and Christmas parties. We also like to celebrate important cultural milestones. Cycle-to-Work scheme (UK) Multisport card (Bulgaria). Access to over 1000 facilities and 500 activities nationwide Diversity & inclusion statement We strongly believe that having diversity within our team is integral to doing our best work and creating the most innovative products for our customers. We encourage people from underrepresented backgrounds to apply to our roles. We’re a family-friendly employer with a culture based on trust, autonomy and flexibility. With a current 85% FlexScore®, we’re learning as we go. By listening to our team and always asking for feedback, we can continue to improve and offer a working environment worthy of attracting the most creative and dedicated people in technology. If you require any adjustments to submit an application for a vacancy, or if you require any reasonable adjustment should you be invited to interview, please let us know. For any questions about this role or future opportunities, please contact Holly Orange, Talent Acquisition Adviser, at holly.orange@hedgehoglab.com or talent@hedgehoglab.com
Newcastle Upon Tyne, United Kingdom
Hybrid
Full Time
11-05-2025