Data Engineer
Hybrid
Birmingham, United Kingdom
£ 575 / day
Freelance
16-03-2025
Job Specifications
Job Advert: Azure Data Engineer
Location: Dartford or Birmingham (1-2 days in the office)
Rates: £575/day (Inside IR35)
Contract Duration: Competitive terms
We are seeking a skilled Azure Data Engineer to join our client's growing team, contributing to the development of innovative data platform services. We want to hear from you if you have strong Databricks experience and expertise in building data pipelines.
Key Responsibilities:
Collaborate with the data architect and team to develop robust data platform services.
Build and maintain data pipelines, ensuring efficient data ingestion, transformation, and storage.
Work extensively with Databricks to enhance data platform capabilities.
Support data integration and migration efforts.
Essential Skills & Experience:
Strong knowledge of Databricks and experience in developing data pipelines.
Proficiency in Azure Data Platform tools like Azure Data Factory, Azure Synapse, and Azure Data Lake.
Solid understanding of ETL processes and data modelling.
Strong problem-solving skills with the ability to work independently and in a team.
About the Company
Silicon Logic was set up in 2012 to cater to the emerging high volume growth in various sectors of technology. At the heart of Silicon Logic lies a desire to offer our clients and partners, service, and experience that is second to none; where integrity, passion, and our can-do attitude are always at the heart of everything we do. Silicon Logic is a specialist IT recruitment consultancy dedicated to providing the most comprehensive IT recruitment solutions to all industry sectors throughout the UK. We have introduced both pe... Know more
Related Jobs
- Company Name
- Intellias
- Job Title
- Senior Data Engineer
- Job Description
- Senior Data Engineer Our client is a leading multi-brand provider of information technology solutions to business, government, education and healthcare customers in the United States, the United Kingdom and Canada. A Fortune 500 company and member of the S&P 500 Index, the company was founded in 1984 and employs approximately 14,900 coworkers. Client has a mission to become the leading B2B integrated technology solutions provider in the markets that we serve. A major programme of transformation in underway to redefine & optimise our operating models and modernising our business systems. Client’s Business Transformation is responsible for driving and accelerating change and transformation across people, process, and systems. Its role is to: • Provide portfolio management for all change initiatives ensuring they are assessed, prioritised, sequenced, and governed to maximise benefit to Client’s customers and co-workers, supported by robust Change Management. • Support change initiatives • Own business-wide initiatives including the implementation of Salesforce, to support initially the delivery of CRM capability across the UK Business. • Therefore, we are looking for a Data Engineer to join a growing team to support Data Migration activity, ensuring seamless integration and data flow between new and legacy systems. Requirements: Must Have (3 + years of expirience) Strong experience with data integration and migration, particularly with Salesforce. Experience with programming languages such as Python, C#, or PowerShell. Strong experience in writing text cleansing routines in Databricks Python/SQL and the ability to measure data quality/execute data validation tests, ideally in Databricks. Proficiency in Azure data services, including Azure Data Factory, Azure Data Lake Storage, and Azure Databricks. Proficiency in building pipelines and utilising python/SQL within Databricks Experience with DevOps practices, including CI/CD, unit testing, and version control. Excellent written and verbal communication skills. A minimum of 2 years of experience in a data engineering role. Nice To Have Experience with Power BI and data visualisation tools. Certified SCRUM Developer (CSD) or similar certifications. Personal Attributes Self-driven and organised. Comfortable in fast-paced environments with shifting requirements. Passionate about technology and its impact on business. Excellent communicator and team player. Detail-oriented and quality-focused. Responsibilities: Data Integration and Migration: Ingest, cleanse, and model data from various sources, including on-premise SQL databases, REST APIs, and Salesforce, ensuring data quality and consistency. Salesforce Integration: Define and implement data integration solutions to support Salesforce, ensuring data is accurately migrated and integrated into Salesforce from legacy systems. Data Quality Assurance: Define and apply cleansing rules to the data to ensure it meets quality expectations. Monitor data pipelines to ensure business-critical data is processed within time constraints and quality standards. DevOps Practices: Utilise DevOps approaches to software development and support, including creating high-quality code, implementing CI/CD pipelines, and conducting peer reviews. Collaboration and Documentation: Work closely with the data migration team to translate user requirements into technical specifications. Document datasets, solution designs, and integration processes in data catalogues and wikis. Stakeholder Engagement: Build strong relationships with stakeholders to gather requirements, prioritise activities, and support change management efforts related to the Salesforce Integration project. Ad-hoc Analysis: Perform ad-hoc analysis of structured and unstructured data to inform solution design and support decision-making processes. Why this client? It is a big TOP 200 US company that provides multiple Enterprise solutions across different business domains: retail, healthcare, education. It is opportunity to work on the platform similar to how Amazon operates. Looking for engineers to start development of new platform. Why this team? There are about 100+ engineers already on the account. Most of them are Senior ones with 10+ years of commercial experience. Why this technology? There are many different technologies as the client's product paltforms are being evolved at the moment as a part of global modernization strategy.
- Company Name
- Mitra AI
- Job Title
- Data Product Owner
- Job Description
- Job Specific Duties & Responsibilities: Own and manage the product backlog, defining priorities based on business value and technical feasibility Translate business needs into functional and technical user stories for development teams Define and manage ETL processes, data mapping, and transformations across various data platforms Establish and document data contracts & API definitions, ensuring consistency and integration efficiency Drive data governance, quality, and compliance initiatives, ensuring accuracy and reliability Collaborate with banking stakeholders, aligning data solutions with financial regulations and industry standards Work closely with development teams, providing clarity on requirements and resolving roadblocks Lead Agile Scrum ceremonies (Sprint Planning, Reviews, Retrospectives, and Daily Stand-ups) Ensure proper Master Data Management (MDM) practices, improving data consistency and usability Continuously optimize data platforms, databases, and workflows to enhance performance and usability Required Skills, Experience and Qualifications: 10+ years of experience in Data Product Ownership or related roles Strong expertise in product backlog management, requirements gathering, and Agile methodologies Hands-on experience in ETL processes, data mapping, and data modeling Deep understanding of data and API contracts, schema definitions, and integrations Solid knowledge of SQL, data platforms, and databases (RDBMS, NoSQL, MDM, Data Lakes, Data Warehousing) Experience with data quality frameworks, governance policies, and compliance regulations Proven experience in the banking sector, with an understanding of financial data, risk, and compliance Strong stakeholder management, communication, and leadership skills
- Company Name
- DataAnnotation
- Job Title
- Postdoctoral Math Associate - AI Trainer
- Job Description
- We are looking for a math expert to join our team to train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each model. Please ensure you read the below overview and requirements for this employment opportunity completely. In this role you will need to hold an expert level of mathematical reasoning- a completed or in progress Masters/PhD is preferred but not required. Other related fields include, but are not limited to: Applied Math and/or Computer Science. Benefits This is a full-time or part-time REMOTE position You’ll be able to choose which projects you want to work on You can work on your own schedule Projects are paid hourly starting at $40+ USD per hour, with bonuses on high-quality and high-volume work Responsibilities Give AI chatbots diverse and complex mathematics problems and evaluate their outputs Evaluate the quality produced by AI models for correctness and performance Qualifications Fluency in English (native or bilingual level) Detail-oriented Proficient in mathematics, arithmetic, algebra, geometry, calculus, probability, statistics, and inductive/ deductive reasoning A current, in progress, or completed Masters and/or PhD is preferred but not required Note: Payment is made via PayPal. We will never ask for any money from you. PayPal will handle any currency conversions from USD. #INDUKMA Job Types: Full-time, Part-time Pay: From £31.64 per hour Expected hours: 1 – 40 per week Work Location: Remote
- Company Name
- RED Global
- Job Title
- Exasol Database Engineer
- Job Description
- *** RED – Exasol Database Engineer – Hybrid *** RED Global now has an exciting opportunity for an Exasol Database Engineer to join one of our international Clients. Here are some details: Project Details: - Role: Exasol Database Engineer Start: ASAP Duration: 6 Months + possible extension Capacity: Full-time Type: Hybrid (2 days onsite, 3 days remote each week) Location: Near Sevenoaks, Kent Skills: Exasol, MicroStrategy (now Strategy ) Client interviews can be arranged on short notice, with quick decision-making to follow. If this is something that might interest you and would like to know more about this role, then please reply with your updated CV and the best way to contact you to Rgohil@redglobal.com