Senior Data Engineer
Hybrid
London, United Kingdom
Full Time
26-02-2025
Job Specifications
Senior Data Engineer
London/hybrid
Salary up to £75,000 per annum
An exciting opportunity has arisen to join a well known organisation within the media/entertainment space. This company are recognised for their exciting work, superb culture and work/life balance.
They are looking for a new Data Engineer (or Senior Data Engineer) with strong experience with AWS, who can hit the ground running.
Key responsibilities:
Design, build, and optimize ETL/ELT pipelines, to manage large volumes of data efficiently.
Develop and maintain high-quality SQL scripts for data transformation, integration, and querying across diverse sources.
Collaborate with data analysts, data scientists, and business stakeholders to gather requirements and deliver data solutions that support strategic decision-making.
Create interactive and visually appealing dashboards and reports that provide actionable insights.
Monitor data workflows to ensure reliability, accuracy, and performance, resolving any issues proactively.
Key skills required:
Strong Data Engineering experience, preferably within the media or entertainment industry.
Strong expertise in AWS & Redshift, including performance tuning, data modelling, and schema design.
Hands-on experience with Matillion (or similar) ETL/ELT processes.
Proficiency in SQL & Python
Proven ability to design and deliver Power BI dashboards and reports.
Familiarity with cloud architecture and services, particularly within AWS (eg, S3, Lambda, CloudWatch).
Excellent problem-solving skills and attention to detail.
Strong communication and stakeholder management skills
This is a great opportunity for a Data Engineer who is at least 2 years into their career and would like to embark on some cutting edge projects in an amazing industry/space.
If you are interested, please apply for full details.
About the Company
Eden Smith is a specialist data & sustainability consultancy based in the UK but operating across Europe and the USA. We work with private and public organisations across the UK as the one-stop solutions partner. We work with our customers holistically to create a relevant strategy, build enablement and embed adoption across staffing, education & consulting. Our values of collaboration, humility, openness and flexibility drive how we work with our customers and colleagues. Know more
Related Jobs
- Company Name
- SR2 | Socially Responsible Recruitment | Certified B Corporation™
- Job Title
- Data Scientist
- Job Description
- Data Scientist (Start-Up Team Lead) | London | 1 to 2 days a Week in Office AI is transforming the way we work and enhancing productivity. I’m supporting a start up with a mission to help open new avenues for human productivity. They focus on creating advanced AI agents and implementing them in collaborative systems to enhance human potential within organisations. They tend to focus on supporting fellow start-ups to increase efficiency in order to support growth. These systems go beyond simple tools; they are designed to work seamlessly with human intelligence and creativity in the workplace. Headquartered in London, the company is searching for a skilled data professional to join their dynamic team. The aim of the role is to drive forward their development initiatives and mentor the existing junior team members. You will be a team lead within a dynamic start up environment, delivering fast paced projects whilst using some of the latest tech. Key Responsibilities: Software Development: Design, develop, and maintain scalable software solutions, primarily using Python. Engage with various data analysis libraries, AI APIs, and LLM-based technologies to deliver high-quality software products. LLM Expertise: Lead the development of applications and services utilizing modern LLMs, including implementing Retrieval-Augmented Generation (RAG) and other relevant AI models for intelligent and context-aware solutions. Technical Leadership: Mentor and support junior developers, fostering a collaborative learning environment and helping them grow their skills. Agile Process Management: Lead agile development practices, including sprint planning, task estimation, and continuous integration/continuous delivery (CI/CD) workflows. Code Quality: Enhance code quality through code reviews, test-driven development (TDD), and the implementation of best practices in software engineering. Innovation: Contribute to the architectural decisions of projects involving vector databases, graph databases, and AI integration, with a particular emphasis on LLM-driven solutions. Collaboration: Work closely with cross-functional teams, including data scientists, product managers, and designers, to define, design, and implement new features. Qualifications: Experience: Minimum of 5 years of professional software development experience, with a strong command of Python. LLM & AI Skills: Demonstrated experience in developing and deploying solutions based on modern LLMs, including RAG and other AI architectures. Familiarity with transformers, tokenization, and model fine-tuning is a strong plus. Technical Skills: Proven experience with data analysis libraries (e.g., Pandas, NumPy) and AI APIs. Familiarity with vector and graph databases is highly desirable. Agile Methodologies: Solid experience working within agile frameworks, including Scrum or Kanban, and a deep understanding of CI/CD processes. Leadership: Demonstrated ability to mentor junior developers and lead by example within a development team. Problem-Solving: Strong analytical and problem-solving skills, with the ability to tackle complex technical challenges. Personal Qualities: A passionate technologist who keeps up-to-date with the latest industry trends. A proactive leader who enjoys mentoring and developing junior talent. Strong communication skills with the ability to collaborate effectively across teams. Opportunities for Growth: Leadership Development: Opportunity to take on greater leadership roles within the company as the team expands. Professional Development: Access to advanced learning resources, including online courses, certifications, and conference attendance. Innovation Projects: Regular opportunities to lead and innovate in in-house hackathons and experimental projects. Technology Stack: Primary: Python (Expert level) Libraries: Advanced Data Analysis Libraries (e.g., Pandas, NumPy) Databases: Vector Databases, Graph Databases LLM Frameworks: Transformer architectures, Retrieval-Augmented Generation (RAG), Hugging Face, OpenAI API, etc. APIs: Various AI APIs Methodologies: Agile (Scrum/Kanban), CI/CD pipelines Benefits: Flexible tech budget for hardware and software. Flexible, remote-friendly work environment. Tech-specific perks such as conference tickets, e-learning subscriptions, and more.
- Company Name
- Meddon Talent
- Job Title
- Data Engineer - Startup
- Job Description
- Overview Join a rapidly growing AI SaaS startup Work with top technical talent from Meta and Google Contribute to developing cutting-edge software solutions Well-funded company that has raised $4m+ Key Responsibilities: Design and implement robust data migration strategies Develop and maintain ETL (Extract, Transform, Load) processes Create and manage data pipelines using modern cloud technologies Ensure data quality, integrity, and performance Collaborate with cross-functional teams to support data-driven decision-making Troubleshoot and resolve complex data integration challenges Essential Requirements: Minimum 3 years' experience in data engineering Proven track record of successful data migration projects Proficiency in: SQL and NoSQL databases Python or Scala Cloud platforms (AWS, Azure, or Google Cloud) Apache Spark Data warehousing technologies
- Company Name
- Premier Group Recruitment
- Job Title
- Data Engineer
- Job Description
- Data Engineer Hybrid – Reading Company Size: Over 200 employees Salary: up to £50,000 As a skilled Data Engineer, this role will be work within a small team who are in regular contact with Software Development and Infrastructure teams. This is working for an exciting company who are based in Reading, however the role will be hybrid working with the expectation of coming into the office twice a week. Why them? This role is permanent, offering a competitive salary of up to £50,000 This role is Hybrid working, on site twice a week Private medical insurance Life insurance Pension matched contribution Flexible Work environment Opportunities for professional development and career progression. About them This role reports into the Head of Data working closely with support and development functions. What you will ideally have experience of? Excellent communication skills (verbal & written) Programming skills Hands-on experience with Foundry Develop custom web applications Creating user-friendly interfaces for data access and analysis Design and implement data-driven solutions Working with massive-scale data, ensuring its quality and usability *You will need to be eligible for SC clearance. What’s next? If this sounds like it could be worth a conversation, then apply today and we’ll aim to be in touch shortly.
- Company Name
- Opus Recruitment Solutions
- Job Title
- Senior Software Engineer (Backend focused + AI) - Node/ TypeScript/ LLM/ OpenAI - REMOTE
- Job Description
- This is a fantastic chance to join a company at the forefront of AI innovation. They are a team of passionate innovators dedicated to pushing the boundaries of what's possible with AI, including LLM, OpenAI, Chatbots, and using Heygen avatars. Their culture thrives on creativity, collaboration, and the relentless pursuit of excellence - They are now looking for an experienced & self motivated Senior Engineer to come on board and help spearhead the development of their core AI product. As a Senior Backend Engineer, you'll play a pivotal role in shaping and building their core AI product (used to improve peoples language skills). You'll be responsible for designing and building robust backend systems that can scale to meet the demands of ambitious projects. Working with a senior team, you'll have the autonomy to bring your ideas to life and drive innovation from the ground up. Your expertise will be crucial in ensuring systems are not only powerful but also reliable and efficient. They are ideally looking for someone who hands-on experience working with Large Language Models (LLMs) and a passion for innovation/ AI. They are constantly exploring new ways to harness the power of LLMs to create transformative solutions and are offering an ambitious engineer the place to get stuck into these technologies. They are looking for individuals who are not only skilled in AI technologies but also share their excitement for pushing the boundaries of what's possible. You'll have the opportunity to work on groundbreaking projects that leverage the latest advancements in LLMs & really play a key role in the direction of the product. Tech Stack: Node.js TypeScript AWS Microservices NoSQL Requirements: Proven experience in backend architecture and scaling products Deep interest or experience in AI, demonstrated through professional work or personal projects Knowledge of LLM, OpenAI, Chatbots, Heygen avatars Ability to work independently and proactively contribute ideas Start-up experience, particularly in small, agile teams What They Offer: Fully Remote Work Environment: Enjoy the flexibility of working from anywhere while being part of a dynamic and supportive team. Competitive Salary: Earn £120k while working on groundbreaking AI projects. Innovative Culture: Be part of a team that values creativity, collaboration, and the pursuit of excellence. Cutting-Edge Technology: Work with the latest AI technologies and be at the forefront of industry advancements. Impactful Work: Your contributions will directly influence the development of revolutionary AI solutions.