Junior Data Engineer
Hybrid
London, United Kingdom
Full Time
17-03-2025
Job Specifications
Job Title: Junior Data Engineer
Company: Krystal Clarity
Location: London/Remote
Job Type: Full-Time
About Us:
Krystal Clarity is a rapidly emerging data engineering consultancy that helps businesses leverage data to achieve their strategic objectives. As a lean, fast-paced, and dynamic company, we are looking for a Junior Data Engineer who is passionate about data and eager to learn and grow in an entrepreneurial environment.
Position Overview:
We are seeking a dedicated and motivated Junior Data Engineer with some experience or qualifications in Azure or Databricks. The successful candidate will have the opportunity to work on diverse and exciting data-centric projects, collaborating closely with senior engineers and making meaningful contributions. This role provides an excellent platform to further develop your skills and gain valuable experience in a vibrant entrepreneurial environment.
Responsibilities:
Assist in the design, building, and management of Azure-based data pipelines, including Databricks integration, to cater to the analysis and reporting needs of our clients.
Contribute to the development, testing, and optimisation of Databricks data pipelines, workflows, dashboards and reports.
Work closely with the senior engineering team to understand project requirements and play a hands-on role in their realisation.
Utilise Azure data services (including Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and others) to extract, transform, and load (ETL) data from various sources.
Assist in data governance and quality control tasks, ensuring the integrity and security of client data within the Azure platform.
Monitor, evaluate, and optimise performance within Azure cloud services, including Databricks workflows.
Identify and implement ways to enhance system performance and efficiency within the Azure and Databricks ecosystem, including optimisations.
Gain experience with Databricks, including Unity Catalog, Medallion architecture, and building data platform products as part of a small team of developers.
Requirements:
Bachelor's Degree in Computer Science, Data Science, or a related field.
Some work experience in data engineering or relevant internships/projects.
Azure or Databricks certifications are a plus.
Familiarity with SQL and Azure SQL databases.
Good knowledge of Python or another relevant programming language.
Exposure to the Azure Data Platform Stack and Databricks is beneficial.
Strong problem-solving skills and attention to detail.
Good communication skills and the ability to work effectively in a team.
Willingness to learn and adapt in a dynamic environment.
Proactive mindset and enthusiasm for taking on new challenges.
What We Offer:
A chance to be part of a pioneering data consultancy during its formative phase and directly contribute to its growth and success.
Mentorship from experienced data engineers and a rich, hands-on experience across a spectrum of innovative projects.
Competitive compensation and benefits package.
The flexibility and convenience of remote work.
To apply, please forward your CV along with a cover letter expressing your enthusiasm for the role to recruitment@krystalclarity.com.
About the Company
At Krystal Clarity, we specialise in providing customised data engineering solutions to help our clients make the most of their data. Our expertise spans four main pillars: Data Strategy and Planning, Data Integration and Engineering, Data Visualisation and Business Intelligence, and Data Management and Governance. Know more
Related Jobs
- Company Name
- Allwyn UK
- Job Title
- AI Scientist
- Job Description
- Description Join our journey to create a new experience for the National Lottery and help us to power change for the greater good. About Us We are Allwyn UK, part of the Allwyn Entertainment Group – a multi-national lottery operator with a market-leading presence in Austria, the Czech Republic, Greece, Cyprus and Italy. We are the operator of the Fourth Licence (10 year licence) for the National Lottery since February 2024. We’ve developed ground-breaking technologies, built player protection frameworks, and have a proven track record of making lotteries better. Our aim is to create one of the UK’s most inclusive organisations – where people can bring the best of themselves, to do their best work, every day, for the benefit of good causes. While the main contribution of the National Lottery to society is through the funds to good causes, at Allwyn we put our purpose and values at the heart of everything we do. Join us as we embark on a once-in-a-lifetime, largescale transformation journey to build a bigger, better, and safer National Lottery that delivers more money to good causes. Role Purpose As an AI Scientist, you will be at the forefront of using GenAI tools to build our AI capabilities, contributing to revenue generating and efficiency gain initiatives. Role Responsibilities Use latest tools, algorithms and concepts in GenAI to deliver working solutions to generate revenue and for efficiency gain Collaborating with cross-functional teams, sharing findings, and contributing to the development of innovative AI solutions Implementing advanced AI techniques, machine learning models, and mathematical frameworks to enhance system capabilities Integrating research outcomes with existing AI systems and databases to advance technological capabilities Continuously optimising, troubleshooting, and debugging AI algorithms based on research outcomes and evolving business needs Staying ahead emerging technologies in AI research to propose innovative solutions Key Measures Of Success Utilising GenAI tools to deliver use-cases into production Driving innovations in AI Optimising algorithmic performance Implementing advanced AI monitoring techniques Key Skills And Experience In the key role of an AI Scientist, you will be instrumental in driving our AI initiatives forward. Your role will contribute to constant improvements in AI algorithms, methodologies, and overall technological innovation. A degree in Computer Science, Artificial Intelligence, or a related field Proficiency in programming languages and tools for AI development such as Python, TensorFlow, PyTorch, or similar In-depth knowledge of machine learning, deep learning, and statistical modeling At least 2 years of experience in GenAI, preferably within regulated industry Familiarity with mathematical frameworks relevant to AI research Ability to work in a collaborative, cross-functional team Excellent communication skills Strong problem-solving and analytical thinking Adaptability to evolving research methodologies and industry trends Time management and organisational abilities Our goal is to create one of the UK’s most inclusive organisations – where people can bring the best of themselves, to do their best work, every day, for the benefit of good causes. Allwyn is an Equal Opportunity Employer which prides itself in being diverse and inclusive. We do not tolerate discrimination, harassment, or victimisation in the workplace. All employment decisions at Allwyn are based on the business needs, the job requirements, and the individual qualifications. Allwyn encourages applications from individuals regardless of age, disability (visible or hidden), sex, gender reassignment, sexual orientation, pregnancy and maternity, race, religion or belief and marriage and civil partnerships. Benefits 26 days paid leave (plus bank holidays) Annual bonus scheme 2 x Life Days 4 x Salary of Life Insurance Pension: we’ll match your contribution up to 8.5% Single Private Health Cover £500 Wellness Allowance Income Protection Enhanced parental leave (maternity and paternity) Eye Care, Dental and Cycle To Work schemes
- Company Name
- Qogita
- Job Title
- Data Scientist (Mid/Jr)
- Job Description
- About Qogita Qogita [Pronounced ko-GI-ta] is transforming the world of B2B eCommerce: a one-stop-shop for all packaged products at great prices. Qogita is based on an innovative order allocation algorithm that not just enhances how B2B commerce is done, but changes it altogether. The outcome: 10-20% in potential savings for any player across the packaged goods value chain. Who You Are You are based in the UK or NL. You are a passionate Data Scientist, who is able to extract impactful insights out of real-world datasets from different sources. You have a strong background in Python and relevant libraries (numpy, scipy, pandas, scikit-learn) as well as experience working with SQL and NoSQL databases. You have hands-on experience with traditional ML and LLM models for text and image data modelling and know how to set up experiments and evaluation metrics. You build reproducible analyses and services with git, Python virtual environments, and Docker containers. On the spectrum of DS Analyst, DS Statistician and DS/ML Engineer, you are or want to develop as a DS/ML Engineer. You have a “get things done” attitude, and are able to push through obstacles by picking up the required skills from backend engineering, analytics, data engineering. You like collaborating with commercial and product stakeholders and are able to suggest projects that solve real business problems. You attempt problems with the simplest possible solution first before diving into more complex approaches. Experience with Django, AWS, mongoDB, Kafka, or integrating LLM APIs are a plus. What You'll Be Working On As a Data Scientist, you will be part of our product data and pricing squad. You will play a critical role in building Qogita’s product data catalog. This will involve generating product data from several sources, as well as validating, categorizing, pricing, and enriching it. Our data platform is build on airflow, dbt, snowflake, AWS S3, mongoDB, and Kafka. Who You’ll Be Working With We are a small, close-knit team of Data engineers, Data scientists and Software engineers. We are an open, honest, highly respectful group of people that work in an environment of mutual trust and psychological safety. Package, Perks & Benefits 26 days annual leave + 3 personal days per year Bi-yearly performance-based bonus Pension contribution Annual Learning & Development Allowance Onboarding home-office package Office socials and annual whole company offsite event
- Company Name
- Williams Racing
- Job Title
- AI Engineer
- Job Description
- Company Description For almost 50 years, Williams Racing has been at the forefront of one of the fastest sports on the planet, being one of the top three most successful teams in history competing in the FIA Formula 1 World Championship. With an almost unrivalled heritage of engineering and racing F1 cars and unforgettable eras that demonstrate it is a force to be reckoned with, the British squad boasts 16 F1 World Championship titles to its name. Since its foundation in 1977 by the eminent, late Sir Frank Williams and engineering pioneer Sir Patrick Head, the team has won nine Constructors’ Championships, in association with Cosworth, Honda and Renault. Its roll call of drivers is legendary, with its seven Drivers’ Championship trophies being lifted by true icons of the sport: Alan Jones, Keke Rosberg, Nelson Piquet, Nigel Mansell, Alain Prost, Damon Hill and Jacques Villeneuve. The team has made history before and is out to make it again with a long-term mission to evolve and return to the front of the grid. Job Description The AI Engineer is part of a newly-created team dedicated to leveraging data and artificial intelligence to enhance decision-making, performance, and operational efficiency. You'll contribute to the development and execution of the data and AI strategy, ensuring that all available data is transformed into actionable insights through advanced machine learning models and optimisation algorithms. You'll develop and deploy advanced machine learning models, ensuring they deliver real-world competitive advantages. What You'll Do Develop, refine, and deploy cutting-edge AI models and pipelines for real-time and offline applications. Apply machine learning to optimize performance across the business - this includes leveraging machine learning for real-time simulations, anomaly detection, and data-driven optimization of vehicle dynamics! Stay ahead with emerging AI and data technologies. Work cross-functionally to turn complex insights into clear, actionable decisions. Ensure understanding of cost cap requirements and identify opportunities to improve optimisation. Skills, Knowledge And Experience Strong knowledge of AI and data technologies including Python (TensorFlow, PyTorch, Scikit-learn, etc.), and experience in C++ is a plus. Strong communication skills to bridge tech and business teams Experience with LLMs and model interpretability libraries, bringing simplicity to complex models. The ability to present complex data and AI insights in a concise, clear manner, making data understandable and actionable to non-technical stakeholders. Involvement across multiple projects simultaneously, with the ability to prioritise effectively and deliver results in a fast-paced environment. Additional Information Atlassian Williams Racing is an equal opportunity employer that values diversity and inclusion. We are happy to discuss reasonable job adjustments.
- Company Name
- Braintrust
- Job Title
- Coders - AI Training [Remote]
- Job Description
- Requirements Swift, Python, Java, Go, Verilog, Javascript, C++, or C# coding experience required This is a great opportunity to supplement your income while looking for longer or more full-time work, all while contributing to the development of new AI models using your domain expertise! Our client has hired over 1,000 Braintrust talent and intends to hire hundreds more! Many Braintrust coders earn over $12,000 per month! You’ll have the flexibility to work as much or as little as you choose - 20hrs/week is suggested, but not a limit. Start working in as little as 48 hours. Your final hourly rate will be chosen by Outlier AI and determined by your location. What to expect: If qualified, you’ll be invited to complete a brief questionnaire that takes 3-5 minutes. If you successfully pass the questionnaire, you’ll be approved and able to begin work ASAP. Required qualifications: Proficiency working one of the following languages: Swift, Python, Java, Go, Verilog, Javascript, C++, or C# Complete fluency in the English language is required. You should be able to describe code and abstract information in a clear way. Preferred qualifications: Bachelor's and/or Master's degree in Computer Science or equivalent. Students are welcome. Note: Outlier AI is partnering with Remotasks for this opportunity What You’ll Be Working On Our client has partnered with organizations to train AI large language models, helping cutting-edge generative AI models write better code. Example projects might include: Evaluating the quality of AI-generated code, including human-readable summaries of your rationale Solve coding problems, writing functional and efficient code Optimize code to run at maximum efficiency Writing robust test cases to confirm code works efficiently and effectively Writing human-readable summaries of coding problems Writing explanations of how code can solve problems and evaluate various solution approaches No previous experience with AI necessary! You will receive detailed instructions on what is expected of you after you complete the application and verification process.