cover image
Spotify

Data Engineer - Experience

On site

London, United Kingdom

Full Time

23-04-2025

Job Specifications

Delivering the best Spotify experience possible. To as many people as possible. In as many moments as possible. That’s what the Experience team is all about. We use our deep understanding of consumer expectations to enrich the lives of millions of our users all over the world, bringing the music and audio they love to the devices, apps and platforms they use every day. Know what our users want? Join us and help Spotify give it to them.

We are looking for an engaged and enthusiastic data engineer to join one of our Experience Mission teams. Our teams within the Experience Mission are responsible for all of Spotify consumer experiences across our mobile apps as well as platforms like web, TVs, speakers, cars, wearables, and partner application integrations to make Spotify available wherever our users are.

We are hiring data engineers who are passionate about building structured, high-quality data solutions. These solutions will be used to evolve our products, bringing better experiences to Spotify users and the global artist community alike. We process petabytes of data using GCP suite such as BigQuery, Dataflow and Pub/sub. We are also known to write our own open source software to cater for our needs, such as Scio, a Scala API wrapper for Apache Beam.

What You´ll Do

Build large-scale batch and streaming data processing systems with Scala, and cloud platform tools.
Collaborate with other software engineers, data scientists, and decision makers to build data powered products.
Evolving our data pipelines towards technical excellence by improving data quality through testing, tooling and continuously evaluating performance at scale.
Perform root cause analysis on data and processes in order to answer business questions and find opportunities for improvement.
Continuously improve our code bases by working with innovative data processing frameworks, technologies, and platforms.
Work in multi-functional teams with end-to-end responsibility for product development and delivery within the mission.

Who You Are

You are knowledgeable and driven about software engineering. We use languages such as Python, Java, Scala and SQL combined with various cloud solutions. Although you might not have a background in our field, bringing knowledge and experience from other fields is merited.
You have experience working with high volume heterogeneous data, preferably with data processing frameworks like Apache Beam, Apache Spark, Apache Flink.
You have strong analytical skills and love to visualize your data findings in a clear and easy to understand way and to collect corner cases of implementations.
You care deeply about agile software processes, reliability, and responsible experimentation as well as being a strong advocate for engineering best practices such as continuous integration and delivery.
You have a proven understanding of data modeling, data access, and data storage, caching, replication, and optimization techniques.
You understand the value of collaboration within teams. You are comfortable with asynchronous communication, being able to work independently while always sharing
Having familiarity with and interest in backend development is a plus.

Where You´ll Be

This role is based in Stockholm or London.
We offer you the flexibility to work where you work best! There will be some in person meetings, but still allows for flexibility to work from home

Today, we are the world’s most popular audio streaming subscription service.

About the Company

Our mission is to unlock the potential of human creativity—by giving a million creative artists the opportunity to live off their art and billions of fans the opportunity to enjoy and be inspired by it. Spotify transformed music listening forever when it launched in Sweden in 2008. Discover, manage and share over 70m tracks for free, or upgrade to Spotify Premium to access exclusive features including offline mode, improved sound quality, and an ad-free music listening experience. Today, Spotify is the most popular globa... Know more

Related Jobs

Company background Company brand
Company Name
University College London Hospitals NHS Foundation Trust
Job Title
Data Manager
Job Description
We are seeking an enthusiastic and bright individual to work in a busy, multi-disciplinary team to support the haemostasis and thrombosis team in the running of both commercial and non-commercial studies. This is a 12-month fixed term post based at UCLH. The post holder’s responsibilities will include the creation and maintenance of files for clinical trials, collection of trial data and completion of case report forms and the creation and maintenance of a database of trial activity. The post holder will provide information on clinical trials for the haemostasis team as and when required and will be expected to develop skills and knowledge relating to the conduct of clinical trials, the therapies and disease site. You will work closely with clinical teams building strong and engaging relationships across a number of different clinical professions and pathways. For an informal discussion about this post, please contact Professor Marie Scully (m.scully@nhs.net) The post holder’s responsibilities will include the creation and maintenance of files for clinical trials, collection of trial data and completion of case report forms and the creation and maintenance of a database of trial activity. The post holder will provide information on clinical trials for the haemostasis team as and when required and will be expected to develop skills and knowledge relating to the conduct of clinical trials, the therapies and disease site. University College London Hospitals NHS Foundation Trust (UCLH) is one of the most complex NHS trusts in the UK, serving a large and diverse population. We provide academically led acute and specialist services, to people from the local area, from throughout the United Kingdom and overseas. Our vision is to deliver top-quality patient care, excellent education, and world-class research. We provide first-class acute and specialist services across eight sites: University College Hospital (incorporating the Elizabeth Garrett Anderson Wing) National Hospital for Neurology and Neurosurgery Royal National ENT and Eastman Dental Hospitals University College Hospital Grafton Way Building Royal London Hospital for Integrated Medicine University College Hospital Macmillan Cancer Centre The Hospital for Tropical Diseases University College Hospital at Westmoreland Street We are dedicated to the diagnosis and treatment of many complex illnesses. UCLH specialises in women’s health and the treatment of cancer, infection, neurological, gastrointestinal and oral disease. It has world class support services including critical care, imaging, nuclear medicine and pathology. We are committed to sustainability and have pledged to become a carbon net zero health service, embedding sustainable practice throughout UCLH. We have set an ambitious target of net zero for our direct emissions by 2031 and indirect emissions by 2040. For further details / informal visits contact: Name: Professor Marie Scully Job title: Haematology consultant Email address: m.scully@nhs.net
London, United Kingdom
On site
Full Time
02-05-2025
Company background Company brand
Company Name
SoftServe
Job Title
Senior Big Data Engineer (Databricks) - RELOCATION TO ABU DHABI
Job Description
Please note: this position requires relocation to Abu Dhabi for a minimum period of 12 months. Project duration: 36 months+. Softserve will support relocation of selected candidates. WE ARE SoftServe is a global digital solutions company with headquarters in Austin, Texas, founded in 1993. Our associates are currently working on 2,000+ projects with clients across North America, EMEA, APAC, and LATAM. We are about people who create bold things, who make a difference, who have fun, and who love their work. Big Data & Analytics Center of Excellence, data consulting and data engineering branch at SoftServe. Starting as a group of three enthusiasts back in 2013, hundreds of Data Engineers and Architects nowadays build Data & Analytics end-to-end solutions from strategy through technical design and PoC to full-scale implementation. We have customers in Healthcare, Finance, Manufacturing, Retail, and Energy domains. We hold top-level partnership statuses with all the major cloud providers and collaborate with many technology partners like AWS, GCP, Microsoft, Databricks, Snowflake, Confluent, and others. IF YOU ARE Experienced with Python/PySpark Proficient working with Databricks Lakehouse architecture and principles Having 2+ years of designing data models, building ETL pipelines, and wrangling data to solve business problems Experienced with Azure cloud technologies Modern Data Estate such as Azure Data Factory, Azure DevOps, Azure Synapse, Azure Data Lake Services Skilled with advanced SQL working with relational databases Knowledgeable of database and data warehouse design best practices Experienced designing, building, and scaling streaming and batch data pipelines Able to suggest the best solution among different options and conduct trade-off analysis, solve the problems Engaging in communication with stakeholders in written and verbal form (Upper-Intermediate English level) YOU WANT TO Be part of a team of data-focused Engineers dedicated to continuous learning, improvement, and knowledge sharing every day. Work with a cutting-edge technology stack, including pioneering services from major cloud providers that are at the forefront of innovation. Engage with customers of diverse backgrounds, ranging from large global corporations to emerging start-ups preparing to launch their first product. Be involved in the entire project lifecycle, from initial design and proof of concept (PoC) to minimum viable product (MVP) development and full-scale implementation. TOGETHER WE WILL Address different business and technology challenges, engage in impactful projects, use top-notch technologies, and drive multiple initiatives as a part of the Center of Excellence. Support your technical and personal growth—we have a dedicated career plan for all roles in our company. Investigate new technologies, build internal prototypes, and share knowledge with SoftServe Data Community. Upskill with full access to Udemy learning courses. Pass professional certifications, encouraged and covered by the company. Adopt best practices from experts while working in a team of top-notch Engineers and Architects. Collaborate with world-leading companies and attend professional events All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, national origin, disability, sexual orientation, gender identity/expression, or protected veteran status. SoftServe is an Equal Opportunity Employer.
United Kingdom
Remote
Full Time
02-05-2025
Company background Company brand
Company Name
bet365
Job Title
Cloud Platform Engineer, Data Engineering
Job Description
Who we are looking for A Cloud Platform Engineer, who will be embedded within the teams responsible for the delivery and operation of cloud services within Data Engineering. The next stage of our initiative is to expand our public cloud capability and establish a seamless operating model. The aim is to leverage the speed of delivery and flexibility of the self-serve model, whilst maintaining a strong relationship with the core platform team. We are embedding Cloud Platform Engineers within the Data Engineering team to help build, operate and support critical cloud products. We’re looking for someone who has a passion for working on innovative initiatives and will make an immediate impact to the Business by bringing their own experience to a challenging but vibrant environment. You will be given the support and training to allow you to grow and progress within this position. This role suits those with a development background transitioning to cloud technologies or cloud engineers who want to work closely with development teams. This role is eligible for inclusion in the Company’s hybrid working from home policy. Preferred Skills, Qualifications and Experience Prior public cloud experience, preferably with Google Cloud. Strong core platform knowledge in Projects and Folders, IAM and Billing. Proficiency operating with Infrastructure as Code (IaC) using industry standard tooling, preferably Terraform and methodologies. Knowledge of GitOps and preferably experience of use. Proficiency of source code management; namely Git. Confident in utilising custom automation and scripting using tools such as G-Cloud, CLI, Bash, Python and Golang. Experience of modern platform stacks such as Kubernetes or GKE, as well as affiliated technologies and workflows including service mesh/ingress, CI/CD, monitoring stacks and security instruments. Experience of using and managing Docker images. Awareness of networking in Public Cloud environments. Awareness of key security considerations when operating in the public cloud. Main Responsibilities Working as an embedded Cloud Platform Engineer within a software function to deploy, operate and support related cloud resources. Taking accountability for the end-to-end delivery of cloud resources as part of software product initiatives. Working with and influencing others to advocate and guide technical aspects of cloud adoption. Working with the central Cloud Platform Team to embed key principles and standards in the operational running of responsible technologies. Supporting and consulting with stakeholders. Driving engineering excellence across your team by fostering modern engineering practices and processes. Working with the central Cloud Platform Team to help steer the next iteration of self-serve automation technologies. By applying to us you are agreeing to share your Personal Data in accordance with our Recruitment Privacy Policy - https://www.bet365careers.com/en/privacy-policy.
Manchester, United Kingdom
Hybrid
Full Time
02-05-2025
Company background Company brand
Company Name
Mars
Job Title
Machine Learning and AI Engineering Lead
Job Description
Machine Learning and AI Engineering Lead - London Mars is a family-owned business with more than $35 billion in global sales. We produce some of the world’s best-loved brands: M&M’s®, SNICKERS®, TWIX®, MILKY WAY®, DOVE®, PEDIGREE®, ROYAL CANIN®, WHISKAS®, EXTRA®, ORBIT®, 5™, SKITTLES®, BEN’S ORIGINAL®, and COCOAVIA®. Alongside our consumer brands, we proudly take care of half of the world’s pets through our nutrition, health and services businesses such as Banfield Pet Hospitals™, BluePearl®, Linnaeus, AniCura, VCA™ and Pet Partners™. Headquartered in McLean, VA, Mars operates in more than 80 countries. The Mars Five Principles – Quality, Responsibility, Mutuality, Efficiency and Freedom – inspire our 130,000 Diverse Associates to act daily towards creating the world we want tomorrow. Job Description: Royal Canin is undergoing a significant Digital Transformation journey. Our ability to solve the most critical problems across Mars in a User Centric way through Data & Analytics is fundamental to our growth ambition and transformation. Significant early success in this journey, and the introduction of many critical foundational capabilities, means that we are looking to accelerate our ability to solve problems and ultimately drive value for Mars Inc. The opportunities are significant for Mars, and the opportunities for those working in this space are both hugely exciting and rewarding. Connecting and deriving break-through insight from our Royal Canin and Petcare data ecosystems, leveraging the rapidly growing world of external data to get closer to our customers and consumers than ever before, and unlocking efficiencies and automation across our End-To-End Value Chain. Building on this momentum, we are recruiting a Machine Learning and AI Engineering Lead to join our Royal Canin Global Data & Analytics Team who will accelerate the shaping and delivery of our Data & Analytics Agenda. The Machine Learning and AI Engineering Lead will oversee ML and AI solution development and deployment as a capability served across the end-to-end Data & Analytics solution portfolio. The role integral to the organization's mission of leveraging advanced technologies to drive innovation and efficiency across the organisation. The role will work closely with the Data Science Led to develop and execute an AI and ML roadmap aligned with business goals and requirements. What will be your key responsibilities? Serve as the technical lead for Generative AI and machine learning model deployment within RC D&A. Collaborate with the Data Science team to design, prototype and build next generation ML and AI products and accelerators. Design, architect and review technical architecture for data science, machine learning and AI solutions and provide feedback for optimal implementation. Develop and oversee the implementation of an MLOps and LLMOps strategy. Align and contribute towards the wider Petcare MLOps strategy. Review code developed by the data science team to ensure solution can be deployed. Identify opportunities to optimize methodologies. Contribute to a high performing data science function through coaching data scientists and providing training on writing scalable code and good software engineering practices. Create repeatable, interpretable, dynamic and scalable model training pipelines that are incorporated into analytic data products through cloud web applications and APIs. Define key performance indicators (KPIs) and implement monitoring systems for deployed products to ensure continuous operational performance. Define strategy to handle incident management. Engage with RC D&A Platform Lead and Platform Product Owner to scope, plan and implement accelerators. Stay updated with the latest advancements in MLOps. Apply relevant techniques into projects. Educate D&A on technological advancements in this area. Documentation: Maintain comprehensive documentation for model training pipelines, deployment processes, and code. Partner with the Product Management squad model and provide advice on how inflight projects can utilise ML and AI to generate additional value. What are we looking for? 5-7 years of experience working in a quantitative role preferably in the CPG, or retail industry. Proven track record of delivering value through AI/ML/Data Science products in a fast-paced, agile environment using a scalable and reusable codebase and models to address business problems effectively. Partner with business leadership across functions and data science teams to identify business challenges and opportunities and translate them unto actionable, integrated, data-driven solutions. Eagerness to learn, flexibility to pivot when needed, savviness to navigate and thrive in a dynamic environment, and a growth mindset needed to build a successful team A strong customer centric mindset especially within an internal customer base with the purpose of driving value creation, adoption and use Strategic thinking, problem solving and innovation, with the ability to anticipate and navigate challenges and opportunities. Ensure compliance with analytics standards, including tailoring methodologies to specific use case needs such as ML, AI, and descriptive analytics. Ability to translate business needs into analytical frameworks & superior verbal and written communication skills Working understanding of ML Ops and DevOps frameworks Familiarity with Microsoft Azure tech stack, including but not limited to AzureML, Azure AI Foundry, Databricks What can you expect from Mars? Work with diverse and talented Associates, all guided by the Five Principles. Join a purpose-driven company where we’re striving to build the world we want tomorrow, today. Best-in-class learning and development support from day one, including access to our in-house Mars University. An industry-competitive salary and benefits package, including company bonus. Disclaimer: Mars is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, colour, religion, sex, sexual orientation, gender identity, national origin, disability status, protected veteran status, or any other characteristic protected by law. If you need assistance or an accommodation during the application process because of a disability, it is available upon request. The company is pleased to provide such assistance, and no applicant will be penalized as a result of such a request.
London, United Kingdom
Hybrid
Full Time
02-05-2025