Senior Azure Databricks Specialist - Milton Keynes
On site
Milton Keynes, United Kingdom
£ 540 / day
Freelance
25-10-2024
Job Specifications
Job Title: Senior Azure Databricks Specialist - Milton Keynes
Location: Milton Keynes - 3 days onsite
Salary/Rate: £540/day Inside Ir35
Start Date: 30/10/2024
Job Type: Contract
My client is the biggest Rail organisations in the UK. We are seeking a Senior Azure Databricks Specialist to join our dynamic data engineering team. The ideal candidate will bring expertise in Azure Databricks, ADF, Data Lake, SQL, and Python/PySpark, with a proven ability to build and deploy high-quality, scalable data solutions within the Microsoft Azure ecosystem. You will work alongside Product Owners, Architects, and engineering leadership to create impactful data lake solutions, robust data pipelines, and reusable libraries and tools.
Job Responsibilities/Objectives
Develop and implement scalable data lake solutions using Azure components, including Azure Data Factory (ADF) for ingestion, Data Lake Gen 2 and Azure SQL Server for storage, and Azure Analysis Services for data transformations.
Design and develop robust data pipelines leveraging Azure BI services for Big Data platforms.
Collaborate closely with Product Owners and Architects to ensure best practices in Azure Data Platform development.
Drive standards for software engineering within the team, ensuring high-quality, production-ready code.
Refactor code to build reusable libraries, APIs, and tools, contributing to a sustainable, scalable data infrastructure.
Required Skills/Experience
The ideal candidate will have the following:
Mandatory: Strong in Azure Databricks, ADF, Data Lake, Strong SQL, Pyspark/Python
Hands-on-experience in developing data lake solutions using Azure (Azure data factory for ingestion, Data lake gen 2 and Azure SQL server for storage, Azure analysis service for transformations, Azure data bricks)
Implement a robust data pipeline using Microsoft Stack.
Create reusable and scalable data pipelines.
Development and deployment of new data platforms.
Leverage Azure BI services for development of Big Data Platforms.
Work closely with the Product Owners and Architects to develop Azure Data Platforms.
Work with the leadership to set the standards for software engineering practices within the team and support across other disciplines.
Produce high-quality code that allows us to put solutions into production.
Refactor code into reusable libraries, APIs, and tools.
If you are interested in this opportunity, please apply now with your updated CV in Microsoft Word/PDF format.
Disclaimer
Notwithstanding any guidelines given to level of experience sought, we will consider candidates from outside this range if they can demonstrate the necessary competencies.
Square One is acting as both an employment agency and an employment business, and is an equal opportunities recruitment business. Square One embraces diversity and will treat everyone equally. Please see our website for our full diversity statement.
About the Company
With over 25 years in the technology recruitment sector, Square One is an award-winning specialist recruitment agency. Based in London, we manage recruitment on an international scale with clients ranging from start-ups to global corporations. Our goal is to offer a comprehensive recruitment service for our clients, building long-term relationships with them to ensure candidates receive the best career opportunities possible. Our consultants continually upskill, ensuring that they're at the forefront of industry, market an... Know more
Related Jobs
- Company Name
- Lorien
- Job Title
- Market Data Business Analyst
- Job Description
- Market Data Business Analyst Hybrid Working - London - 1 day a week on site. Financial Services Lorien's leading banking client is looking for a Market Data Business Analyst to join the existing team on a brand-new project. This role is based in London. This role will be Via Umbrella. Working in a Hybrid Model of 1-2 days a week on site. What you'll do: Your daily responsibilities will see you maximizing the value of supplier relationships and driving cost efficiencies in collaboration with key stakeholders. To do this, you'll interact with differing levels of management across a variety of franchises and functions. We'll need you to manage data licensing to make sure all our franchises and functions remain compliant, whilst maximizing cost reduction opportunities from the evaluation of alternate providers. You'll also deliver financial reporting, data analysis and Credit Reference Agency service recommendations You'll also be responsible for: Leading contract negotiations in partnership with key stakeholders to make sure the most appropriate market data products are delivered at the best possible price Managing contract-related risks and issues, supplier audits and cost transparency to demonstrate contractual compliance to protect our business Providing analysis on and insights into market data costs to allow business managers and finance business partners to set and track market data budgets and realise cost savings Working with business franchises and functions to accurately define business requirements whilst acting as a subject matter expert and a point of contact for Credit Reference Agencies Managing third-party market data audits whilst remediating any data exposures where possible, including challenging audit findings to minimise any penalties Key Skills and Experience Lead contract negotiations in partnership with key stakeholders ensuring the most appropriate market data products are delivered to the group at the best possible price Manage contract related risks and issues, supplier audits, and cost transparency to demonstrate contractual compliance to protect the business Provide analysis on and insights into market data costs to allow business managers and finance business partners to set and track market data budgets and realise cost savings Work with business franchises and functions to accurately define precise business requirements, providing an ongoing subject matter expert point of contact for Credit Reference Agencies IND_PC3 Carbon60, Lorien & SRG - The Impellam Group STEM Portfolio are acting as an Employment Business in relation to this vacancy.
- Company Name
- Precise Placements Ltd
- Job Title
- IT Support Engineer - O365, Exchange, Azure Active Directory, Intune
- Job Description
- IT Support Engineer - O365, Exchange, Azure Active Directory, Intune Our leading law firm client are looking to recruit an IT Support Engineer (O365, Exchange, Azure Active Directory, Intune) on a 6 months Fixed Term Contract basis to provide 1st line support for the firm, as part of the Service Support Team. The team currently comprises 5 engineers and a trainer based across two sites. This is a great opportunity for someone at the start of their IT career, looking to get a foot in the door of an interesting and niche industry. You will work closely with the 2nd line support in the office, and there will be a good support network around you in the department to help with learning and development. There will be a lot of engagement with senior members of staff throughout the firm so good communication skills are essential. The main responsibilities include, but will not be limited to: You will be the first point of contact for any users reporting problems to the Service Desk, with a keen focus on customer service and prompt response times. Log, update and close all calls received in the call logging system, whether received via telephone, email or in person. Ensure the Service Desk phone is answered at all times within core support hours. Carry out meeting room set ups, using AV equipment in offices. Promote and nurture a customer focused and performance driven culture within the IT Department. Suggest areas for improvement and take ownership of initiatives based on colleague and user feedback. Maintain at all times a professional, friendly and customer service based approach in interactions with customers and internal colleagues. Keep and maintain a safe and tidy working environment. Escalate to the Service Desk Manager any major or ongoing problems that might affect business operations. Maintain a daily awareness of the status of open faults awaiting resolution, and to provide feedback on such faults to the call originator, at periods suggested by them. Manage all incidents, requests and problems to a high level of customer service ensuring the needs of the business are given the highest priority in-line with IT policy and procedure. Carry out project work as required whilst adhering to deadlines and priority levels. If in doubt over competing priorities seek guidance from project management or line management immediately. Manage Service Support Team work queue as per call handling guidelines. Ensure all desktop related IT assets as specified by the Configuration Management Policy are entered into the CMDB and track as per the policy. To be considered for this IT Support Engineer (O365, Exchange, Azure Active Directory, Intune) you must meet this criteria: Previous experience working in a customer care environment and handling email and telephone queries. Service Desk/Support Analyst experience within a Service Desk/Support Team is desirable. Experience of working in a professional services or financial services environment supporting all levels of users is desirable, but not essential. Experience working in an ISO27001 environment would be useful, but not essential. A good working knowledge of: Windows 10 and 11 Office 365 Exchange Online Azure Active Directory Microsoft Intune Network technology Microsoft Teams (and Telephony within Teams) Microsoft Surface hardware AV setups
- Company Name
- Glocomms
- Job Title
- Data Engineer
- Job Description
- ***DV/Developed Vetting Clearance is Required for this project*** ***Please do not apply if you do the have the relevant security clearance*** Job Title: Data Engineer (Government Sector) Location: London, Westminster, 5 days in the office (Flexibility around this can be offered) Employment Type: 6-month long-term rolling contract inside IR35 Job Overview: We are seeking a proactive and detail-oriented Data Engineer to join a team for a government sector project in London. The ideal candidate will have a solid background in Python and experience transforming structured data, with an emphasis on engineering best practices. Familiarity with the Palantir platform and AWS will be beneficial however is not mandatory. This role requires a self-starter who can understand complex problems, work collaboratively, and deliver high-quality solutions. Key Responsibilities: Develop, maintain, and optimize data pipelines and ETL processes using Python. Transform and clean structured data to support analytical needs and reporting. Collaborate with stakeholders to gather requirements and understand data needs. Troubleshoot and resolve data-related issues in a timely manner. Document processes and maintain clear specifications for data workflows. Continuously seek to improve data quality and engineering practices. Qualifications: 5-8 years of experience in data engineering or related roles. Proficiency in Python for data manipulation and transformation. Experience with structured data and familiarity with ETL processes. Strong analytical and problem-solving skills. Ability to work independently and take initiative. Excellent communication and collaboration skills. Desired Attributes: Interest in data science and analytical methodologies, although the focus is on engineering. Familiarity with AWS services would be a bonus Knowledge of the Palantir platform is a plus. A proactive approach to understanding and addressing project challenges. Strong attention to detail and commitment to delivering high-quality results. Please reach out to Joel.wren@glocomms.com
- Company Name
- Searchability
- Job Title
- Azure DevOps Engineer
- Job Description
- Azure DevOps Engineer Outside IR35 contract 6 month contract Day rate £400 - £450 per day Initially 2 days a week onsite for the first month, then predominantly remote, bar in office meetings Urgent requirement for an Azure DevOps Engineer for a leading client of mine, who have a project that requires a further engineer. What you will be doing; You will be tasked with working with the software development team to establish processes and works as intended, create practical proposals for solutions and deliver these to other members of staff, mentor other engineers within the team, complete R&D to ensure they stay current with their technical stack, perform code reviews and identify ways of streamlining execution to minimise errors. We need you to have as essentials Azure DevOps experience ideally within the Finance sector Analytics - Logic Monitor/Dynatrace Package Management - Jfrog/Artifactory/NuGet/Docker Configuration Management - Puppet/Chef/Ansible Scripting - Powershell Deployment - Azure DevOps/Terraform Security - SonarQube - or similar tool Serverless/PaaS experience - Azure Functions or similar Testing - Jmeter/Selenium Roll non-negotiables Must currently live within commutable distance of Leeds, candidates living currently outside of a 90 minute trip won't be considered unfortunately Be a UK Citizen, willing to do financial background checks due to the project Start ASAP, its an urgent project, with the essential requirements above needed To be considered .. Please either apply by clicking online or emailing me directly to (see below) . For further information please call me on 01244 567 925/07880 358 143. I can make myself available outside of normal working hours to suit from 7am until 10pm. If unavailable please leave a message and either myself or one of my colleagues will respond. By applying for this role you give express consent for us to process & submit (subject to required skills) your application to our client in conjunction with this vacancy only.