Junior Data Engineer
Hybrid
London, United Kingdom
Full Time
17-03-2025
Job Specifications
Job Title: Junior Data Engineer
Company: Krystal Clarity
Location: London/Remote
Job Type: Full-Time
About Us:
Krystal Clarity is a rapidly emerging data engineering consultancy that helps businesses leverage data to achieve their strategic objectives. As a lean, fast-paced, and dynamic company, we are looking for a Junior Data Engineer who is passionate about data and eager to learn and grow in an entrepreneurial environment.
Position Overview:
We are seeking a dedicated and motivated Junior Data Engineer with some experience or qualifications in Azure or Databricks. The successful candidate will have the opportunity to work on diverse and exciting data-centric projects, collaborating closely with senior engineers and making meaningful contributions. This role provides an excellent platform to further develop your skills and gain valuable experience in a vibrant entrepreneurial environment.
Responsibilities:
Assist in the design, building, and management of Azure-based data pipelines, including Databricks integration, to cater to the analysis and reporting needs of our clients.
Contribute to the development, testing, and optimisation of Databricks data pipelines, workflows, dashboards and reports.
Work closely with the senior engineering team to understand project requirements and play a hands-on role in their realisation.
Utilise Azure data services (including Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and others) to extract, transform, and load (ETL) data from various sources.
Assist in data governance and quality control tasks, ensuring the integrity and security of client data within the Azure platform.
Monitor, evaluate, and optimise performance within Azure cloud services, including Databricks workflows.
Identify and implement ways to enhance system performance and efficiency within the Azure and Databricks ecosystem, including optimisations.
Gain experience with Databricks, including Unity Catalog, Medallion architecture, and building data platform products as part of a small team of developers.
Requirements:
Bachelor's Degree in Computer Science, Data Science, or a related field.
Some work experience in data engineering or relevant internships/projects.
Azure or Databricks certifications are a plus.
Familiarity with SQL and Azure SQL databases.
Good knowledge of Python or another relevant programming language.
Exposure to the Azure Data Platform Stack and Databricks is beneficial.
Strong problem-solving skills and attention to detail.
Good communication skills and the ability to work effectively in a team.
Willingness to learn and adapt in a dynamic environment.
Proactive mindset and enthusiasm for taking on new challenges.
What We Offer:
A chance to be part of a pioneering data consultancy during its formative phase and directly contribute to its growth and success.
Mentorship from experienced data engineers and a rich, hands-on experience across a spectrum of innovative projects.
Competitive compensation and benefits package.
The flexibility and convenience of remote work.
To apply, please forward your CV along with a cover letter expressing your enthusiasm for the role to recruitment@krystalclarity.com.
About the Company
At Krystal Clarity, we specialise in providing customised data engineering solutions to help our clients make the most of their data. Our expertise spans four main pillars: Data Strategy and Planning, Data Integration and Engineering, Data Visualisation and Business Intelligence, and Data Management and Governance. Know more
Related Jobs
- Company Name
- Tenth Revolution Group
- Job Title
- AI Developer - Remote - £50k
- Job Description
- AI Developer - Remote - £50k My client are looking for a mid-level AI Developer to join their expanding Central IT Team. You will provide new and enhanced AI and ML capabilities to my client with your experience in data science and AI background. Salary and Benefits Competitive salary of up to £50k (DOE) Remote working arrangement Flexible working hours 25 days annual leave Private medical insurance Company Contributory Pension SchemeRole And Responsibilities Assist in the delivery of large solutions under the direction and guidance of the team lead. Deliver defined enhancements or areas of the solution which are clearly defined and understood. Assist in the testing of the solution liaising with non-IT staff to complete the delivery. Liaise with non-IT stakeholders to help them perform their acceptance testing. Perform support of the application estate resolving Jira support tickets under the direction of the Team Lead. This will involve liaising with the relevant non-IT stakeholders to understand the issue, identifying the root cause and delivering a solution for the issue. The rectification of the issue may result in activities to resolve any data related issues caused by the support ticket. Deliver standalone small solutions to the relevant non-IT stakeholders.What do I need to apply for the role Strong Python LLM's Azure Cognitive Services Tensorflow/Pytorch Exposure to .NET, SQL, C# Extensive development experience in relevant technologies to deliver API services. Database design and implementation skills. Strong written and verbal communication skills with both IT and non-IT staff. My client have very limited interview slots and they are looking to fill this vacancy within the next 2 weeks. I have limited slots for 1st stage interviews next week so if you're interest, get in touch ASAP with a copy of your most up to date CV and email me at or call me on (phone number removed). Please Note: This is a permanent role for UK residents only. This role does not offer Sponsorship. You must have the right to work in the UK with no restrictions. Some of our roles may be subject to successful background checks including a DBS and Credit Check. Nigel Frank are the go-to recruiter for Power BI and Azure Data Platform roles in the UK, offering more opportunities across the country than any other. We're the proud sponsor and supporter of SQLBits, Power Platform World Tour, the London Power BI User Group, Newcastle Power BI User Group and Newcastle Data Platform and Cloud User Group. To find out more and speak confidentially about your job search or hiring needs, please contact me directly at
- Company Name
- Tenth Revolution Group
- Job Title
- AI Developer - Remote - £50k
- Job Description
- My client are looking for a mid-level AI Developer to join their expanding Central IT Team. You will provide new and enhanced AI and ML capabilities to my client with your experience in data science and AI background. Salary And Benefits Competitive salary of up to £50k (DOE) Remote working arrangement Flexible working hours 25 days annual leave Private medical insurance Company contributory pension scheme Role And Responsibilities Assist in the delivery of large solutions under the direction and guidance of the team lead. Deliver defined enhancements or areas of the solution which are clearly defined and understood. Assist in the testing of the solution liaising with non-IT staff to complete the delivery. Liaise with non-IT stakeholders to help them perform their acceptance testing. Perform support of the application estate resolving Jira support tickets under the direction of the Team Lead. This will involve liaising with the relevant non-IT stakeholders to understand the issue, identifying the root cause and delivering a solution for the issue. The rectification of the issue may result in activities to resolve any data related issues caused by the support ticket. Deliver standalone small solutions to the relevant non-IT stakeholders. What Do I Need To Apply For The Role Strong Python LLM's Azure Cognitive Services Tensorflow/Pytorch Exposure to .NET, SQL, C# Extensive development experience in relevant technologies to deliver API services. Database design and implementation skills. Strong written and verbal communication skills with both IT and non-IT staff. My client have very limited interview slots and they are looking to fill this vacancy within the next 2 weeks. I have limited slots for 1st stage interviews next week so if you're interest, get in touch ASAP with a copy of your most up to date CV and email me at or call me on . Please Note: This is a permanent role for UK residents only. This role does not offer Sponsorship. You must have the right to work in the UK with no restrictions. Some of our roles may be subject to successful background checks including a DBS and Credit Check. Nigel Frank are the go-to recruiter for Power BI and Azure Data Platform roles in the UK, offering more opportunities across the country than any other. We're the proud sponsor and supporter of SQLBits, Power Platform World Tour, the London Power BI User Group, Newcastle Power BI User Group and Newcastle Data Platform and Cloud User Group. To find out more and speak confidentially about your job search or hiring needs, please contact me directly at
- Company Name
- Allwyn UK
- Job Title
- AI Scientist
- Job Description
- Description Join our journey to create a new experience for the National Lottery and help us to power change for the greater good. About Us We are Allwyn UK, part of the Allwyn Entertainment Group – a multi-national lottery operator with a market-leading presence in Austria, the Czech Republic, Greece, Cyprus and Italy. We are the operator of the Fourth Licence (10 year licence) for the National Lottery since February 2024. We’ve developed ground-breaking technologies, built player protection frameworks, and have a proven track record of making lotteries better. Our aim is to create one of the UK’s most inclusive organisations – where people can bring the best of themselves, to do their best work, every day, for the benefit of good causes. While the main contribution of the National Lottery to society is through the funds to good causes, at Allwyn we put our purpose and values at the heart of everything we do. Join us as we embark on a once-in-a-lifetime, largescale transformation journey to build a bigger, better, and safer National Lottery that delivers more money to good causes. Role Purpose As an AI Scientist, you will be at the forefront of using GenAI tools to build our AI capabilities, contributing to revenue generating and efficiency gain initiatives. Role Responsibilities Use latest tools, algorithms and concepts in GenAI to deliver working solutions to generate revenue and for efficiency gain Collaborating with cross-functional teams, sharing findings, and contributing to the development of innovative AI solutions Implementing advanced AI techniques, machine learning models, and mathematical frameworks to enhance system capabilities Integrating research outcomes with existing AI systems and databases to advance technological capabilities Continuously optimising, troubleshooting, and debugging AI algorithms based on research outcomes and evolving business needs Staying ahead emerging technologies in AI research to propose innovative solutions Key Measures Of Success Utilising GenAI tools to deliver use-cases into production Driving innovations in AI Optimising algorithmic performance Implementing advanced AI monitoring techniques Key Skills And Experience In the key role of an AI Scientist, you will be instrumental in driving our AI initiatives forward. Your role will contribute to constant improvements in AI algorithms, methodologies, and overall technological innovation. A degree in Computer Science, Artificial Intelligence, or a related field Proficiency in programming languages and tools for AI development such as Python, TensorFlow, PyTorch, or similar In-depth knowledge of machine learning, deep learning, and statistical modeling At least 2 years of experience in GenAI, preferably within regulated industry Familiarity with mathematical frameworks relevant to AI research Ability to work in a collaborative, cross-functional team Excellent communication skills Strong problem-solving and analytical thinking Adaptability to evolving research methodologies and industry trends Time management and organisational abilities Our goal is to create one of the UK’s most inclusive organisations – where people can bring the best of themselves, to do their best work, every day, for the benefit of good causes. Allwyn is an Equal Opportunity Employer which prides itself in being diverse and inclusive. We do not tolerate discrimination, harassment, or victimisation in the workplace. All employment decisions at Allwyn are based on the business needs, the job requirements, and the individual qualifications. Allwyn encourages applications from individuals regardless of age, disability (visible or hidden), sex, gender reassignment, sexual orientation, pregnancy and maternity, race, religion or belief and marriage and civil partnerships. Benefits 26 days paid leave (plus bank holidays) Annual bonus scheme 2 x Life Days 4 x Salary of Life Insurance Pension: we’ll match your contribution up to 8.5% Single Private Health Cover £500 Wellness Allowance Income Protection Enhanced parental leave (maternity and paternity) Eye Care, Dental and Cycle To Work schemes
- Company Name
- Qogita
- Job Title
- Data Scientist (Mid/Jr)
- Job Description
- About Qogita Qogita [Pronounced ko-GI-ta] is transforming the world of B2B eCommerce: a one-stop-shop for all packaged products at great prices. Qogita is based on an innovative order allocation algorithm that not just enhances how B2B commerce is done, but changes it altogether. The outcome: 10-20% in potential savings for any player across the packaged goods value chain. Who You Are You are based in the UK or NL. You are a passionate Data Scientist, who is able to extract impactful insights out of real-world datasets from different sources. You have a strong background in Python and relevant libraries (numpy, scipy, pandas, scikit-learn) as well as experience working with SQL and NoSQL databases. You have hands-on experience with traditional ML and LLM models for text and image data modelling and know how to set up experiments and evaluation metrics. You build reproducible analyses and services with git, Python virtual environments, and Docker containers. On the spectrum of DS Analyst, DS Statistician and DS/ML Engineer, you are or want to develop as a DS/ML Engineer. You have a “get things done” attitude, and are able to push through obstacles by picking up the required skills from backend engineering, analytics, data engineering. You like collaborating with commercial and product stakeholders and are able to suggest projects that solve real business problems. You attempt problems with the simplest possible solution first before diving into more complex approaches. Experience with Django, AWS, mongoDB, Kafka, or integrating LLM APIs are a plus. What You'll Be Working On As a Data Scientist, you will be part of our product data and pricing squad. You will play a critical role in building Qogita’s product data catalog. This will involve generating product data from several sources, as well as validating, categorizing, pricing, and enriching it. Our data platform is build on airflow, dbt, snowflake, AWS S3, mongoDB, and Kafka. Who You’ll Be Working With We are a small, close-knit team of Data engineers, Data scientists and Software engineers. We are an open, honest, highly respectful group of people that work in an environment of mutual trust and psychological safety. Package, Perks & Benefits 26 days annual leave + 3 personal days per year Bi-yearly performance-based bonus Pension contribution Annual Learning & Development Allowance Onboarding home-office package Office socials and annual whole company offsite event