Senior Azure Databricks Specialist - Milton Keynes
On site
Milton Keynes, United Kingdom
£ 540 / day
Freelance
25-10-2024
Job Specifications
Job Title: Senior Azure Databricks Specialist - Milton Keynes
Location: Milton Keynes - 3 days onsite
Salary/Rate: £540/day Inside Ir35
Start Date: 30/10/2024
Job Type: Contract
My client is the biggest Rail organisations in the UK. We are seeking a Senior Azure Databricks Specialist to join our dynamic data engineering team. The ideal candidate will bring expertise in Azure Databricks, ADF, Data Lake, SQL, and Python/PySpark, with a proven ability to build and deploy high-quality, scalable data solutions within the Microsoft Azure ecosystem. You will work alongside Product Owners, Architects, and engineering leadership to create impactful data lake solutions, robust data pipelines, and reusable libraries and tools.
Job Responsibilities/Objectives
Develop and implement scalable data lake solutions using Azure components, including Azure Data Factory (ADF) for ingestion, Data Lake Gen 2 and Azure SQL Server for storage, and Azure Analysis Services for data transformations.
Design and develop robust data pipelines leveraging Azure BI services for Big Data platforms.
Collaborate closely with Product Owners and Architects to ensure best practices in Azure Data Platform development.
Drive standards for software engineering within the team, ensuring high-quality, production-ready code.
Refactor code to build reusable libraries, APIs, and tools, contributing to a sustainable, scalable data infrastructure.
Required Skills/Experience
The ideal candidate will have the following:
Mandatory: Strong in Azure Databricks, ADF, Data Lake, Strong SQL, Pyspark/Python
Hands-on-experience in developing data lake solutions using Azure (Azure data factory for ingestion, Data lake gen 2 and Azure SQL server for storage, Azure analysis service for transformations, Azure data bricks)
Implement a robust data pipeline using Microsoft Stack.
Create reusable and scalable data pipelines.
Development and deployment of new data platforms.
Leverage Azure BI services for development of Big Data Platforms.
Work closely with the Product Owners and Architects to develop Azure Data Platforms.
Work with the leadership to set the standards for software engineering practices within the team and support across other disciplines.
Produce high-quality code that allows us to put solutions into production.
Refactor code into reusable libraries, APIs, and tools.
If you are interested in this opportunity, please apply now with your updated CV in Microsoft Word/PDF format.
Disclaimer
Notwithstanding any guidelines given to level of experience sought, we will consider candidates from outside this range if they can demonstrate the necessary competencies.
Square One is acting as both an employment agency and an employment business, and is an equal opportunities recruitment business. Square One embraces diversity and will treat everyone equally. Please see our website for our full diversity statement.
About the Company
With over 25 years in the technology recruitment sector, Square One is an award-winning specialist recruitment agency. Based in London, we manage recruitment on an international scale with clients ranging from start-ups to global corporations. Our goal is to offer a comprehensive recruitment service for our clients, building long-term relationships with them to ensure candidates receive the best career opportunities possible. Our consultants continually upskill, ensuring that they're at the forefront of industry, market an... Know more
Related Jobs
- Company Name
- Revolution Technology Ltd
- Job Title
- ServiceNow Developer
- Job Description
- Our client are a global consultancy, working on a project in the defence space. They are on the lookout for a ServiceNow Developer to come in on a contract basis. Key Skills/Requirements: Must have strong ServiceNow experience Must have strong hands-on experience of developing and configuring the platform Must be able to design and roadmap complex technical solutions aligned to the latest ServiceNow best practice Must be a British Citizen (BPSS to pass on offer) Contract is running 6-12 months initially, paying up to £550p/day (Inside IR35 so engaged via Umbrella) and will be fully remote within the UK.
- Company Name
- bluewaveSELECT
- Job Title
- ServiceNow Developer, 6-12 months, Inside IR35, REMOTE, £525 a day
- Job Description
- ServiceNow Developer, 6-12 months, Inside IR35, REMOTE, £525 a day ServiceNow Developer Job Type: Contract, Inside IR35, REMOTE, £525 day Key Responsibilities: Excellent experience as a ServiceNow Developer, with architecture and complex solutions understanding Develop and customise ServiceNow applications and services. Collaborate with stakeholders to gather requirements and deliver solutions. Integrate ServiceNow with other enterprise systems. Maintain and optimize existing ServiceNow implementations. Qualifications: Proven experience as a ServiceNow Developer. Strong knowledge of JavaScript and ServiceNow Scripting. Familiarity with ITIL processes. Excellent problem-solving and communication skills. How to Apply: HIT apply now for a quick response! bluewaveSELECT is a global recruitment business that is exclusively focused on SAP. Involved in placing over 4,000 SAP professionals, our team has helped deliver some of the highest-profile SAP programmes for some of the most recognisable brands all over of the world. We are on a mission is to become the world's most trusted SAP recruitment business, delivering our unique wow factor by consistently exceeding expectations for both our customers and our network of SAP professionals. We are an official SAP partner, you will find us on the Ariba Network and we have a 5-Star approval rating on TrustPilot from fellow SAP enthusiasts. Whether this will be your first experience with us, or you are a bluewaveSELECT regular, we look forward to working with you! Disclaimer; We try and contact all applicants to every advert however due to volumes of responses with some adverts we may not be able to get back to you in some cases. If this is the case and you do not hear from us within 5 working days please take it that your application has been unsuccessful. Please note, your profile will be rejected if you do not meet language/legislation criteria. Thank you.
- Company Name
- Bangura Solutions
- Job Title
- Technical Project Manager - Infrastructure, Database Migration, Oracle on prem, SC Cleared. £665
- Job Description
- Our client within the public sector requires a proven Technical Project Manager. Preferably coming from an infrastructure background. To help deliver a major transformation programme from its Legacy technology estate. You MUSThold active SC Clearance to be eligible for this role. Key requirements: Supplier management - working with multiple suppliers Good planner, problem solving, good assurance, good around governance 10+ years Project management experience (infrastructure PM ideally) Data base migrations/Oracle on premise Essential skills and experience: Proven ability to undertake detailed analysis of technical designs and provide the business with assurance of supplier designs and proposals. Capable of leading VFM challenges of technical proposals and manage technical interdependencies within a project/programme. Bridge the gap between the technical and non-technical by speaking on behalf of technical teams and facilitate relationships with indirect stakeholders. Experience across physical and cloud-based architectures. An understanding of operating systems and oracle products preferable. Understand how governance works and what governance is required by taking responsibility for the assurance of parts of a service and know what risks need to be managed. Good project management skills including planning and change management. Make decisions characterised by managed levels of risk and complexity and recommend decisions as risk and complexity increase. Resolve technical disputes between peers and indirect stakeholders, taking into account all views and opinions. Apply strategy, using patterns, standards, policies, roadmaps and vision statements, challenging them and providing guidance. Understand trends and practices outside your team and how these will impact your work. See how your work fits into the broader strategy and historical context and consider the patterns and interactions on a larger scale. Minorities, women, LGBTQ+ candidates, and individuals with disabilities are encouraged to apply. Interviews will take place next week, so please apply immediately to be considered for this exciting contract role or call Bangura Solutions to discuss this role further.
- Company Name
- Scope AT Limited
- Job Title
- Data Centre Engineer - Server, Dell, HP, IBM, Support
- Job Description
- Looking for a Data Centre Engineer on a Contract basis. Must have own transport and be able to travel to Camberley. Break fix server engineer working on HP, Dell and IBM Servers, Server provisioning, Rack, stack and configure Servers. London/Hybrid CONTRACT By applying to this job you are sending us your CV, which may contain personal information. Please refer to our Privacy Notice to understand how we process this information. In short, in order to supply you with work finding services, we will hold and process your personal data, and only with your express permission we will share this personal data with a client (or a third party working on behalf of the client) by email or by upload to the Client/third parties vendor management system. By giving us permission to send your CV to a client, this constitutes permission to share the personal data that would be necessary to consider your application, interview you (Phone/video/face to face) and if successful hire you. Scope AT acts as an employment agency for Permanent Recruitment and an employment business for the supply of temporary workers. By applying for this job you accept the Terms and Conditions, Data Protection Policy, Privacy Notice and Disclaimers which can be found at our website.