Data Engineer
On site
London, United Kingdom
Freelance
06-02-2025
Job Specifications
Role: Senior Data Engineer
Location: London, Bristol, Edinburgh
Job Description:
Mandatory exp in Azure Data factory
Primary and Secondary key skills: ADF Dataflow, Azure ci/d debugging, Azure service monitor, Advanced SQL, data modelling.
Expertise in data engineering experience leveraging technologies such as Snowflake, Azure Data Factory, ADLS, Databricks etc.
Expertise in writing SQL queries against any RDBMS with query optimization.
Experience structuring Data Lake for reliability security and performance.
Experience implementing ETL for Data Warehouse and Business intelligence solutions.
Ability to write effective modular dynamic and robust code, establish code standards as well.
Strong analytical problem-solving and troubleshooting abilities.
Good understanding of unit testing software change management and software release management.
Knowledge of DevOps processes including CI/CD and Infrastructure as Code fundamentals
Experience performing root cause analysis on data & processes and identify opportunities for improvement.
Familiar with Agile software development methodologies.
Proactive communication and stakeholder management.
About the Company
KBC Technologies is a 'ISO Certified' Global IT Solutions, Services and Outsourcing Company with it's major focus in IT Secondment and Managed Services domain to support our clients in expanding their business operations on global basis. KBC has it's registered offices in UAE, Qatar, Oman, KSA, Egypt UK, Poland, Australia and India with operations spread across 14 plus countries across globe. We primarily focus on providing IT Solutions, IT Consulting & Outsourcing across different verticals like BFSI, Telecom, Government, ... Know more
Related Jobs
- Company Name
- Rullion
- Job Title
- Senior Data Analyst
- Job Description
- Job Opportunity: Senior Data Analyst (Outside IR35) Location: Nottingham (1 day per week onsite) Contract: 6 months initially (with strong potential for extension) Day Rate: Competitive (Outside IR35) Are you a strong Commercial Analyst with sharp business modelling skills? Do you thrive on solving complex problems and delivering actionable insights that drive business decisions? If so, we have an exciting opportunity for you! Key Skills & Experience: Advanced proficiency in PySpark, Python, SQL, and Databricks Strong business modelling expertise Analytical and problem-solving skills Experience working in fast-paced, data-driven environments Excellent communication skills, with the ability to present insights to stakeholders What You’ll Be Doing: Partnering with stakeholders to understand business needs and provide robust data-driven solutions Developing and optimising business models to support key decision-making Delivering powerful insights through data visualisation and storytelling Working on complex analytics projects with a focus on driving measurable value If you're passionate about delivering meaningful business insights and want to work in a dynamic environment where your skills are highly valued, we'd love to hear from you.
- Company Name
- Senovo IT Ltd
- Job Title
- CloudOps Engineer with AI Specialization in AWS
- Job Description
- ***Freelance CloudOps Engineer with AI Specialization (Glasgow – Hybrid)*** Are you an experienced CloudOps Engineer with a passion for AI and AWS? We are looking for a freelance specialist based in Glasgow to help design, automate, and optimize cutting-edge AI solutions in the cloud. This is a hybrid role (2 days on-site) with an immediate start and an initial 6-month contract (extendable). What You’ll Do: Manage and optimize AWS cloud infrastructure, including EC2, Lambda, S3, RDS, DynamoDB, and more. Deploy and orchestrate AI models in containerized environments using Kubernetes (EKS). Implement serverless architectures using AWS Lambda for AI inference. Automate infrastructure with Terraform and AWS SDK (Boto3 in Python). Develop CI/CD pipelines for AI model deployment using AWS CodePipeline, GitHub Actions, or Jenkins. Monitor system health with Amazon CloudWatch, Prometheus, and Grafana. Manage log analysis using AWS CloudTrail, OpenSearch, and ELK Stack. Design and optimize MLOps pipelines with Amazon SageMaker. Integrate generative AI models into applications using Amazon Bedrock. Secure AI environments with AWS IAM, KMS, WAF, and Shield. Ensure compliance with ISO 27001, SOC 2, GDPR, and HIPAA. What You Bring: 5+ years of CloudOps/DevOps experience on AWS. 2+ years of experience working with AI/Machine Learning projects in the cloud. Expertise in serverless architectures, microservices, and containerization. Hands-on experience with Python, Bash, TensorFlow, and PyTorch. Strong problem-solving skills and the ability to work in cross-functional teams. Excellent communication skills to bridge AI, Cloud, and DevOps requirements. Recommended Certifications: AWS Certified Solutions Architect – Professional AWS Certified DevOps Engineer – Professional AWS Certified Machine Learning – Specialty Certified Kubernetes Administrator (CKA) Why Join Us? Work on cutting-edge AI and CloudOps projects. Hybrid flexibility – 2 days on-site in Glasgow. Exciting and fast-paced environment. 6-month contract with the possibility of extension. Start ASAP and make an immediate impact. If you’re a CloudOps expert with AI specialization and thrive in AWS environments, we’d love to hear from you!
- Company Name
- Ventula Consulting
- Job Title
- P & MM Data Specialist - £550 (Outside IR35) – Hybrid (Macclesfield)
- Job Description
- Global pharmaceutical client now requires a P&MM data specialist to support the definition of data requirements throughout the S/4 Hana design process, ensuring data is fit for purpose throughout the supply chain process. This role will work within P&MM and collaborate with the wider business ensuring s/4 data design meets business requirements, aligns to SAP standards and can be used with confidence throughout future processes. Key requirements: Strong experience and expertise in Procurement and Materials Management (P&MM) Solid understanding of business data requirements and the ability to break down complex data concepts to business data users. Excellent communicator with the ability to influence others and manage an array of stakeholders. Previous experience of business/IT partnering regarding the implementation of Data Governance related solutions. Proven experience designing and implementing Data standards for a global enterprise business. Strong understanding of SAP – Reporting and data integration. Desirable: S/4 HANA implementation programme experience. This is an initial 6-month contract role which provides a daily rate of £550 (Outside IR35). In terms of working structure, this is hybrid with 3 days per week in our clients Macclesfield office and the rest remote.
- Company Name
- Advanced Resource Managers
- Job Title
- Data Analyst
- Job Description
- Data Analyst 6 Month contract – Inside IR35 – Up to £350 a day Slough based – Hybrid Working – 2/3 days office based Telecoms industry About the Role: This role sits in the central Analytics & Insight Chapter and supports our campaign to understand our customers and provide insights and actionable recommendations that help to achieve our business objectives The position will require a solid understanding of SQL and technical skills, so that you are able to mine internal data and provide highly actionable insight to the business. Cleansing and maintenance of a set of analytics data views for onward use in insights, BI reporting and campaign performance measurement will be integral to the role. You will work very closely with your squad's Value Lead and other stakeholders to understand their needs and objectives and then implement appropriate solutions. The role also requires close collaboration with fellow data analysts and a strong understanding of our business fundamentals. You will be strong at relationship building and communication to ensure that briefs are stress tested to provide maximum value to customers. Presenting findings expertly and influencing stakeholders will also be a key focus. Key Responsibilities: As a Data Analyst you will: Receive and develop briefs from your Value Lead and work collaboratively to ensure work of the highest quality Maintain analytics data views for accurate reporting and insights capability - Maintain and update stored procedures Combine internal data with other data sources to provide a holistic view Participate in all squad ceremonies and events, raising impediments as soon as identified to facilitate delivery Inspect and adapt your way of working for continuous improvement Embody an Agile mindset and culture to contribute to the growth in agile maturity of our business Provide accurate, insightful and timely analysis to the business to help them make better decisions and enable the client to serve its customers a little better every day Ability to simplify the complex and generate precise insights then communicate them clearly. Continually look to improve processes through efficiencies and by applying best practice Challenge the stakeholders and the business backlogs to focus work around the areas that really matter Actively add to the Squads backlog with work that would benefit customers Steer the agenda and be a trusted partner for work Ability to contribute to an analytics roadmap for continuous insight delivery improvement Skills & Experience Required: Strong interpersonal skills so that you can work closely with the squads you support Skilled at adapting communication for both technical and non-technical audiences Able to learn data sources and methodologies quickly and apply technical skills to curate accurate analytics data views Familiarity with GitHub and quality assurance checking of SQL scripts Experience in obtaining insight from large data sets and sharing actionable learnings with the wider business 2 years+ experience in coding complex SQL queries against a large relational customer database, identifying relevant data sources and summarising to provide the insight as identified Experience in updating SQL stored procedures Ability to resolve data-related problems Proficiency in Python and / or R a bonus