Databricks Data Engineer - Capital Markets
Hybrid
London, United Kingdom
Freelance
21-03-2025
Job Specifications
Looking for an exciting contract opportunity as a Databricks Data Engineer? Work on impactful projects in a dynamic environment, utilizing your skills in data modeling and Capital Markets or Banking experience. Ready for your next challenge?
Key Expertise And Experience We’re Looking For
Data Engineering in Databricks –
Spark programming with Scala, Python, SQL
Ideally experience with Delta Lake
Databricks workflows, jobs, etc.
Familiarity with Azure Data Lake: experience with data ingestion and ETL/ELT frameworks
Data Governance experience – Metadata, Data Quality, Lineage, Data Access Models
Good understanding of Data Modelling concepts, Data Products and Data Domains
Unity Catalog experience is a key differentiator – if not then experience with a similar Catalog/Data Governance Management component
MS Purview (Metadata and Data Quality tool) experience is a bonus – experience in similar tools is valuable (Collibra, Informatica Data Quality/MDM/Axon etc.)
Ideally Capital Markets, or at least Banking experience
Data Architecture experience is a bonus
Type: Contract
Rate: £700-750 - LTD Company
IR35: OUTSIDE
Duration: 6-12 months initially
Location: London
Hybrid: Yes
Robert Walters Operations Limited is an employment business and employment agency and welcomes applications from all candidates
About the Company
Robert Walters is the world’s most trusted talent solutions business. Across the globe, we deliver recruitment, recruitment process outsourcing and advisory services to organisations of all shapes and sizes, opening doors for people with diverse skills, ambitions, and backgrounds. The businesses we partner with want to make things happen. And they need people to do it. They have goals. They have challenges. They want answers. We deliver the talent solutions they need to reach their goals. That might mean recruiting ... Know more
Related Jobs
- Company Name
- Sanderson
- Job Title
- Head of Data Integration
- Job Description
- Head of Data Integration 12 month contract £900-1000/day overall assignment rate to umbrella Location agnostic - hybrid-working Working with a leading financial services client, who following a recent acquisition, are looking for a Head of Data Integration to build out the road-map and outline the strategy for the integration of customer data. Head of Data Integration, key skills: Previous experience working on a large-scale integration of data MUST have worked with customer data Technical background in data & analytics and a platform product mindset are of essence Proven experience in defining data operation models and have the ability to articulate the value of data Proven-track record of working with stakeholders to understand business requirements and translate into suitable strategy and road-map Head of Data Integration, customer data
London, United Kingdom
On site
Freelance
27-03-2025
- Company Name
- Sanderson
- Job Title
- Head of Customer Data - Strategy, Integration, Product
- Job Description
- Head of Customer Data/Chief Product Officer - Data/Head of Data Platforms/Director of Data/Head of Technology - Data £900 - £1100 - Umbrella engagement 12 month contract 2 days a week on site in London Overview: Our client are in the process of integrating a recently acquired companies customer data in to the core Data ecosystem. Where this role is to articulate the vision in a long-term roadmap that can be executed and delivered through incremental transitions that unlock value from the integration of two clients customer data through value prioritised business adoption. At the heart of the role is the ability to work cross functionally with both businesses technology and data product teams to set a firm direction to achieve the desired outcomes while maintaining flexibility in how they are delivered You are the key person to build the strategy and road map for this integration and delivering change. However this is not a project or programme role. Responsibilities: The role set the vision and defines the transition stages of the clients Customer Data & Analytics integration focusing on Customer Data Domain Complex problem solving to mediate between short terms vs long term value delivery that account for the customer, conduct/regulatory, and commercial impact of the data migration in the main organisations Customer Data ecosystem. Robust analytical decision making and issue resolution will be required. Effective prioritisation decisions to enable delivery of targeted synergy benefits for Digital Experience and Marketing workstream, through efficiency (tech and marketing spend) and by delivering data solutions to enable business growth Work at the intersection of Data Product Owners, BU stakeholders, Architecture and Data teams to drive the integration plan and ensure business readiness for MI, Digital Martech, Customer Science underpinning customer growth and MPH plans and digital customer experience enablement Define and manage the implementation standards, requirements and solutions for customer master data management, customer analytics data warehousing, data quality, security, access, retention and risks Lead and manage all aspects of the customer data integration delivery and business change across digital, marketing, and BUs Demonstrate value delivery by setting clear objectives and measurements and constantly communicating to senior stakeholders and forums Skills and experience: Proven experience leading multiple large scale data projects - technical background in data & analytics and a platform product mindset are of essence Proven experience in defining data operating models and the ability to articulate the value of data to the enterprise Expert in the development and leadership of teams to deliver world class technology solutions, and in stakeholder engagement in a complex organizational structure Please reach out for more information about this opportunity
London, United Kingdom
On site
Freelance
27-03-2025
- Company Name
- Square One Resources
- Job Title
- Data Scientist - SQL - GIT - Hybrid/London
- Job Description
- Job Title: Data Scientist - Hybrid/London Location: London - twice a week (every Wednesday and Thursday) Salary/Rate: Up to £408 a day Inside IR35 Start Date: April Job Type: 12 Month Contract Company Introduction We are looking for a Data Scientist with excellent SQL Coding and GIT experience to join our client in the Telecommunication industry. The successful candidate for this role will be able to work on site in Paddington two days a week (every Wednesday and Thursday). The Data Scientist for this role will develop and operate big data products. You will build, maintain, optimise and automate data processes through pipelines, scripts and script control to maintain and improve data products, used to deliver insights to a wide range of clients. Working within an agile product development team, the role is jointly accountable for the quality, development and operation of the data products. Required Skills/Experience Experience in writing and deploying production ready code Aptitude for problem solving Strong understanding of databases and experience in writing analytical queries and data processes in SQL and or Python Able to comprehend, define, and implement changes independently Strong track record of defining and implementing data process changes independently Self-motivated with good organisational and time management skills Experienced in effective use of Git or similar for change control Business awareness and aptitude for building and developing data products Experienced in developing complex methodology, analysing data and visualising complex ideas to customers Job Responsibilities/Objectives Developing software or scripts required to deliver data products, including visualisation tools, databases and data processing systems Developing new or improving existing methodologies, processes and products, and driving improvements in quality Continuous improvement of the ability to deliver changes to products in a regular, reliable, and predictable manner through improving feedback loops throughout the product delivery process Developing a thorough understanding of Mobile Network Data and its processing to be able to take full advantage of the data assets Respond to technical issues in a professional and timely manner Desirable Skills/Experience Experienced in using CI/CD pipelines Experienced in working with data used in transport modelling Experienced in working in continuous delivery environment Experience in analysing geospatial data and or GIS experience Experience with processing large volumes of data Tableau or similar data visualisation experience If you are interested in this opportunity, please apply now with your updated CV in Microsoft Word/PDF format. Disclaimer Notwithstanding any guidelines given to level of experience sought, we will consider candidates from outside this range if they can demonstrate the necessary competencies. Square One is acting as both an employment agency and an employment business, and is an equal opportunities recruitment business. Square One embraces diversity and will treat everyone equally. Please see our website for our full diversity statement.
London, United Kingdom
On site
Freelance
27-03-2025
- Company Name
- Innova Solutions
- Job Title
- Manufacturing data Analyst
- Job Description
- Manufacturing Data Analyst 12 Months Shrewsbury, UK Role Definition Performs implementation, regular problem solving, maintenance and support for a agile software development. Responsibilities Designing, modifying, developing, writing and implementing software programming applications for target system using agile methods. Acquiring client requirements; resolving workflow problems through automation optimization. Writing source codes for new applications, and/or generating and enhancing code samples for existing applications. Utilizing automated testing tools to perform the testing and maintenance. Skill Descriptors Decision Making and Critical Thinking: Knowledge of the decision-making process and associated tools and techniques; ability to accurately analyze situations and reach productive decisions based on informed judgment. Level Working Knowledge: Applies an assigned technique for critical thinking in a decision-making process. Identifies, obtains, and organizes relevant data and ideas. Participate in documenting data, ideas, players, stakeholders, and processes. Recognizes, clarifies, and prioritizes concerns. Assists in assessing risks, benefits and consideration of alternatives. Effective Communications: Understanding of effective communication concepts, tools and techniques; ability to effectively transmit, receive, and accurately interpret ideas, information, and needs through the application of appropriate communication behaviors. Level Working Knowledge: Delivers helpful feedback that focuses on behaviors without offending the recipient. Listens to feedback without defensiveness and uses it for own communication effectiveness. Makes oral presentations and writes reports needed for own work. Avoids technical jargon when inappropriate. Looks for and considers non-verbal cues from individuals and groups. Software Development: Knowledge of software development tools and activities; ability to produce software products or systems in line with product requirements. Level Working Knowledge: Describes common tools for component-based, object-oriented development. Describes the objectives, activities and results of unit testing. Has developed programs in a specific language and for a specific platform. Interprets functional and technical blueprints; participates in structuring technical components. Participates in technical and code reviews. Software Development Life Cycle: Knowledge of software development life cycle; ability to use a structured methodology for delivering and managing new or enhanced software products to the marketplace. Level Basic Understanding: Summarizes the overall process for developing new software for the company product line. Differentiates respective roles and responsibilities of software engineering and other functions. Identifies common issues and considerations for bringing a new product to marketplace. Describes major phases, checkpoints and deliverables. Software Integration Engineering: Knowledge of software integration processes and functions; ability to design, develop and maintain interfaces and linkage to alternative platforms and software packages. Level Working Knowledge: Has experience with designing data exchange interfaces to and from software product. Describes tools and techniques for extraction, transformation and loading of electronic data. Cites examples of common linkage requirements for software products and vendors. Works with integrating software into the customer or partner framework and infrastructure. Participates in the development of technology interfaces and bridges. Software Product Design/Architecture: Knowledge of software product design; ability to convert market requirements into the software product design. Level Basic Understanding: Identifies basic design methods and design tools. Identifies major components of functional and technical design. Cites examples of good and bad designs. Describes tasks, activities, deliverables and key concerns of technical design. Software Product Technical Knowledge: Knowledge of technical aspects of a software products; ability to design, configure and integrate technical aspects of software products. Level Working Knowledge: Maintains and utilizes data related to install base configurations and environments. Solicits customer feedback; reports and monitors bugs and implementation issues. Participates in defining and conducting technical acceptance tests. Participates in creating technical requirements for software development and deployment. Explains basic environment and product configuration options. Software Product Testing: Knowledge of software product testing; ability to design, plan, and execute testing strategies and tactics to ensure software product quality and adherence to stated requirements. Level Working Knowledge: Participate in test readiness reviews, functional, volume, and load testing. Describes key features and aspects of a specific testing discipline or methodology. Tests software components for compliance with functional requirements and design specifications. Explains procedures for documenting test activities and results (e.g. errors, non-conformance, etc.) Conducts functional and performance testing on aspects of assigned products.
Shrewsbury, United Kingdom
Hybrid
Freelance
26-03-2025