Senior Data Engineer
On site
Manchester, United Kingdom
£ 80,000 / year
Full Time
14-02-2025
Job Specifications
Job Title: AWS Senior Data Engineer
Location: Manchester (Trafford) – 2 days a week
Salary: £60,000 - £80,000 DOE
The client is a technology provider to the market research industry. They use cutting edge technology to help our clients gain a deeper insight into the digital lives of consumers.
We are looking for Data Engineer to join the team and play a crucial role in Data Engineer Team, ensuring the main function is developing, maintaining and improving the end-to-end data pipeline.
The Role
You will be working in the Data Engineering team whose main function is developing, maintaining and improving the end-to-end data pipeline that includes real-time data processing; extract, transform, load jobs; artificial intelligence; and data analytics on a complex and large dataset.
Your role will primarily be to perform DevOps, backend and cloud development on the data infrastructure to develop innovative solutions to effectively scale and maintain the data platform. You will be working on complex data problems in a challenging and fun environment, using some of the latest Big Data open-source technologies like Apache Spark, as well as Amazon Web Service technologies including Elastic MapReduce, Athena and Lambda to develop scalable data solutions.
Key Responsibilities:
Adhering to Company Policies and Procedures with respect to Security, Quality and Health & Safety.
Writing application code and tests that conform to standards.
Developing infrastructure automation and scheduling scripts for reliable data processing.
Continually evaluating and contribute towards using cutting-edge tools and technologies to improve the design, architecture and performance of the data platform.
Supporting the production systems running the deployed data software.
Regularly reviewing colleagues’ work and providing helpful feedback.
Working with stakeholders to fully understand requirements.
Be the subject matter expert for the data platform and supporting processes and be able to present to others to knowledge share.
Here’s what we’re looking for:
The ability to problem solve.
Knowledge of AWS or equivalent cloud technologies.
Knowledge of Serverless technologies, frameworks and best practices.
Experience using AWS CloudFormation or Terraform for infrastructure automation.
Knowledge of Scala or OO language such as Java or C#.
SQL or Python development experience.
High-quality coding and testing practices.
Willingness to learn new technologies and methodologies.
Knowledge of agile software development practices including continuous integration, automated testing and working with software engineering requirements and specifications.
Good interpersonal skills, positive attitude, willing to help other members of the team.
Experience debugging and dealing with failures on business-critical systems.
Preferred:
Exposure to Apache Spark, Apache Trino, or another big data processing system.
Knowledge of streaming data principles and best practices.
Understanding of database technologies and standards.
Experience working on large and complex datasets.
Exposure to Data Engineering practices used in Machine Learning training and inference.
Experience using Git, Jenkins and other CI/CD tools.
Benets
Work in a market leading technology company that helps research and marketing professionals achieve unique insights into the mobile and digital lives of consumers.
The client do everything they can to support our people so that they can be themselves and realise their potential. We love people who are hungry for learning and achievement!
25 days paid holiday plus bank holidays
Purchase/sale of up to 5 leave days pa – after 2 years’ service
Life insurance
Workplace pension with employer contribution
Performance based bonus scheme
Informal dress code
Cycle to work scheme
Branded company merchandise
About the Company
Based in the heart of Manchester, In Technology Group are recognised for delivering exceptional recruitment services to the technology, IT & digital sectors across the UK, Europe & US. Possessing in-depth knowledge and critical industry insights, we have access to the best active talent on the market as well as an extensive pipeline of passive candidates. Our team around us is what makes us special. We're all industry professionals, each of us driven to delivering the best possible experience. We invest in our own talent eve... Know more
Related Jobs
- Company Name
- ZEISS Group
- Job Title
- Data Analytics Business Partner
- Job Description
- Job Title: Business Analytics Specialist Location: Birmingham City Centre - 3 days per week on site Contract: Permanent, Full-Time (37.5hrs per week) COMPANY OVERVIEW We’re ZEISS Vision Care UK, based in Birmingham; an exciting place to work, where individuals make a real difference every day. As part of the ZEISS group, we are an international leader in the field of optics, with over 34,000 employees across 50 countries around the globe. We are proud of our heritage and have been at the forefront of scientific discovery and innovation since our creation in 1846. We are a foundation; this means we reinvest 12% of our revenue to fund research and education, supporting progress within the optical industry and across the community. We are more successful today than we have ever been, having celebrated double digit growth for the past ten years. We‘re not stopping here because we are focused on accelerating our growth even further, aiming to double our revenue by 2025. If you want to be part of making this difference, then ZEISS Vision Care UK is the right place for you! OUR BENEFITS Salary benchmarked against the 400 biggest companies in the UK 10% Employer pension contribution (providing a 4 % employee contribution) Bonus Scheme Private Healthcare Free ZEISS lenses for you and discounted ZEISS lenses for your friends and family Job Summary: We are looking for a skilled Data Analyst to transform complex data into actionable insights that will drive strategic business decisions. This role involves the professionalization of data access, creating interactive dashboards, and providing in-depth statistical analysis using advanced techniques and machine learning algorithms. You will collaborate closely with business functions to develop analytical solutions, present findings to senior stakeholders, and help identify opportunities for growth and efficiency. Key Responsibilities: Develop and deliver interactive dashboards, reports, and presentations to communicate complex data insights. Use advanced statistical techniques (e.g., regression analysis, time series analysis, decision trees) and machine learning algorithms to analyze data and support business initiatives. Design and analyze predictive models to forecast trends and behaviors. Identify actionable insights to inform strategic decision-making and uncover risks and opportunities. Partner with business teams to understand their data needs and provide tailored reporting solutions. Translate business objectives into data-driven insights and recommendations. Regularly mine data to identify trends, and proactively offer actionable insights for business units and senior leadership. Monitor and report on the impact of data-driven initiatives to ensure value creation. Continuously review data processes to improve best practices and enhance efficiency. Key Requirements: Proven academics: Degree qualified or equivalent in Computer Science/Data Science/Information Science or related field At least 3 years relevant experience (descriptive analytics, statistical analysis, modelling segmentation, financial analytics, and data mining using large databases) Experience in data modelling and data storage systems, as well as knowledge of modern data warehouse technologies and approaches Experience of statistical methods and techniques such as predictive modelling, segmentation, and regression High proficiency in data visualization and analytical tools (Power BI, Tableau or equivalent) High proficiency in data science and analytics tools/platforms such as SQL, R, Excel, JavaScript, or Python High proficiency in developing analysis and reporting from SAP data/Business Warehouse/Business Objects Ability to synthesize and clearly communicate large volumes of complex information to senior management of various technical understandings to effectively add value to an organization Ability to identify patterns, correlations, and trends from data that can provide insights into business operations, customer behavior, or market dynamics Proven leadership of business intelligence and analytic initiatives in a fast-paced, multiple-project environment Self-motivated and able to work autonomously whilst at the same time understanding the importance and contribution to the wider team. Structured, analytical with a problem-solving approach and high attention to detail Ability to collaborate and excel in complex, cross-functional teams Apply now to take the next step in joining team ZEISS, where you can push technological boundaries, shape markets, and contribute to the advancement of society. _______________________________________________________________________________ Diversity is a part of ZEISS. We look forward to receiving your application regardless of gender, nationality, ethnic and social origin, religion, ideology, disability, age or sexual orientation and identity.
- Company Name
- PHMG
- Job Title
- Commercial Data Analyst
- Job Description
- Role: Commercial Data Analyst Location: Manchester based office – Hybrid working Package: £41,300 OTE Commercial Data Analyst PHMG is embarking on an exciting new phase in its journey, focusing on modernising our data capability and enhancing the way we work. This evolution presents numerous opportunities to leverage data more effectively, allowing us to better serve our customers and colleagues. As part of this growth, we are expanding our team to maximise the value from the wealth of data stored within the organisation. To support this vision, we are seeking a Commercial Data Analyst. In this this role, you will be responsible for overseeing the management and utilisation of commercial data to drive business growth and efficiency. This opportunity is ideal for a data analyst eager to advance their career. You will leverage your analytical skills to uncover fresh opportunities for our sales, client services and marketing teams. Come join us on this extraordinary journey as we usher in a new era of data-driven innovation at PHMG. The Role: What you will do Lead Generation: Develop and implement strategies to ensure a consistent supply of high-quality leads to the sales team. Data Management: Deliver high-quality leads through effective data collection and management practices. Data Optimisation: Enhance efficiency and accuracy by optimising data acquisition, enrichment, and automation processes. Process Design: Create and maintain streamlined data flow processes to support sales pipelines and workflows effectively. Customer Segmentation: Develop and apply segmentation models to enable personalised customer profiling and outreach. Campaign Execution: Execute data-driven campaigns and analyse their performance to optimise results. Performance Metrics: Monitor KPIs to evaluate sales performance and identify areas for improvement. Alignment with Revenue Goals: Ensure data activities align with overall revenue strategies, incorporating stakeholder feedback to refine processes. Stakeholder Collaboration: Work closely with Sales and Client Servies stakeholders to align data initiatives with broader revenue strategies. Insight Presentation: Present actionable insights and strategic recommendations to key decision-makers. Cross-Team Collaboration: Partner with BI and Data Engineering teams to leverage data insights and infrastructure. This is an exciting role for a Data Analyst who has: Strong analytical and problem-solving abilities. A can-do attitude and is a self-starter. Experience in delivering qualified leads to sales team to enable growth. Understanding of a B2B sales process. Strong organisational skills and implementing methodical processes. Understanding of Salesforce Leads, Opportunities and Accounts objects – or similar CRM. Ideally a working knowledge of SQL/Python – ideally working with Snowflake. Why PHMG Tech? The IT, Data & Engineering functions within PHMG has been going through a digital transformation, changing how we deliver value to our business. A big part of this change is fostering a culture of being open and honest, collaborating, having fun and enabling psychological safety. We want to create a place for teams to do their best work, and you will have the opportunity to influence our decisions, help define standards across the teams and contribute to a healthy and happy working environment. About PHMG: Established in 1998, PHMG has grown from a renowned Manchester-based business to the world’s leading audio branding agency – working with 36,000 clients in 54 countries across the globe. This expansive client list includes household names of the calibre of Samsung, Audi and Adidas, as well as SMEs in every sector of the global market. We give each of them a stellar production that combines creative copy, world-class voice artistry and an exclusive Brand-Sound-Track™ – strengthening their business identity in the most memorable, emotive way.
- Company Name
- Roku
- Job Title
- Data Analytics Manager
- Job Description
- Teamwork makes the stream work. Roku Is Changing How The World Watches TV Roku is the #1 TV streaming platform in the US and Mexico, and we've set our sights on powering every television in the world. Roku pioneered streaming to the TV. Our mission is to be the TV streaming platform that connects the entire TV ecosystem. We connect consumers to the content they love, enable content publishers to build and monetize large audiences, and provide advertisers unique capabilities to engage consumers. From your first day at Roku, you'll make a valuable - and valued - contribution. We're a fast-growing public company where no one is a bystander. We offer you the opportunity to delight millions of TV streamers around the world while gaining meaningful experience across a variety of disciplines. About The Team When you join our Core Analytics Team, you become part of a centralized hub of analytics excellence. This team provides the unique opportunity to work alongside a world-class peer group, leveraging centrally maintained tools and resources to drive impactful results. We emphasize continuous learning and development, ensuring team members are always growing their skills and expertise. Collaborating closely with Engineering, Product, and Business teams, we deliver data-driven insights and innovative capabilities that guide our stakeholders, shape our strategies, and enhance the experiences of Roku’s users globally. About The Role We are seeking a Manager, Analytics to lead a team of Analysts and Data Scientists, delivering insights that drive product and marketing strategies. This role is pivotal in shaping how we understand user behavior and optimize experiences. As a Manager, Analytics, you will: Work cross-functionally with product, marketing, and engineering teams to address key business questions. Drive impactful decision-making through robust analyses and insights. Guide and develop your team to grow their influence and effectiveness within the business. What You'll Be Doing Partner with analytics, product, and marketing leaders to: Understand business goals and requirements. Develop roadmaps and project plans. Deliver meaningful, actionable analyses to guide strategies. Hire, mentor, and develop a high-performing team of Analysts and Data Scientists. Utilize advanced analytical methods, including causal inference and experimentation, to derive insights. Create data-driven narratives and perspectives to influence strategic decisions. Collaborate with Business Intelligence and Data Engineering teams to ensure evolving data needs are met. Monitor key metrics and processes to: Identify trends and opportunities. Diagnose and address root causes driving business impact. Coordinate efforts across Core Analytics teams in Europe to align strategies and initiatives. We're excited you have have: Extensive experience in analytics, with proven expertise in delivering actionable insights. Demonstrable experience of building and leading analytics teams, including supervisory duties. Fluency in SQL and Python/R. Proficiency in causal impact frameworks and experimentation techniques. Familiarity with tools like Looker and/or Tableau. Strong statistical knowledge and application. Excellent communication and storytelling abilities, translating data into actionable insights. The ability to work autonomously and across multiple time zones. An ownership mindset, taking accountability for driving results. This role can be based in either Cambridge, or Manchester. You are required to work in the office for 3 days per week, this is the core requirement of the role. Benefits Roku is committed to offering a diverse range of benefits as part of our compensation package to support our employees and their families. Our comprehensive benefits include global access to mental health and financial wellness support and resources. Local benefits include statutory and voluntary benefits which may include healthcare (medical, dental, and vision), life, accident, disability, commuter, and retirement options (401(k)/pension). Our employees can take time off work for vacation and other personal reasons to balance their evolving work and life needs. It's important to note that not every benefit is available in all locations or for every role. For details specific to your location, please consult with your recruiter. The Roku Culture Roku is a great place for people who want to work in a fast-paced environment where everyone is focused on the company's success rather than their own. We try to surround ourselves with people who are great at their jobs, who are easy to work with, and who keep their egos in check. We appreciate a sense of humor. We believe a fewer number of very talented folks can do more for less cost than a larger number of less talented teams. We're independent thinkers with big ideas who act boldly, move fast and accomplish extraordinary things through collaboration and trust. In short, at Roku you'll be part of a company that's changing how the world watches TV. We have a unique culture that we are proud of. We think of ourselves primarily as problem-solvers, which itself is a two-part idea. We come up with the solution, but the solution isn't real until it is built and delivered to the customer. That penchant for action gives us a pragmatic approach to innovation, one that has served us well since 2002. To learn more about Roku, our global footprint, and how we've grown, visit https://www.weareroku.com/factsheet. By providing your information, you acknowledge that you have read our Applicant Privacy Notice and authorize Roku to process your data subject to those terms.
- Company Name
- Vallum Associates
- Job Title
- Data Engineer- Energy Sector
- Job Description
- Job Title: Data Engineer (Data Flows) Location: London- 2days/week Duration: Permanent Energy Sector Client Experience Required Job Description We are seeking a Data Engineer with a strong emphasis on energy industry expertise to join our dynamic team. This role is ideal for candidates who possess deep knowledge of energy sector operations, data flows, and business processes, while being adept at applying this industry insight to support data-driven decision-making. The successful candidate will bridge the gap between technical data management and energy sector strategy, enabling the organization to leverage data as a critical asset. As a Data Engineer , you’ll be part of an Agile and skilled team of other engineers and analysts working on delivering best in class data solutions for our customers. Working with powerful data processing technologies, you will combine the power of your industry knowledge and industry data flows with the full capabilities of AWS, creating the ultimate data services platform. Responsibilities • Work as part of a cross-functional team to design, develop and deploy complex data solutions. • Provide expert technical advice and recommend solutions to the development resources in the planning, strategizing, and the execution of high profile and complex data processing initiatives. • Consistently develop with performance in mind to optimize end user experience. • Work with architects and senior team members to identify new tools and technologies where applicable to expand customer offerings. • Research and take advantage of new technology to improve and expand solutions. • Participate in peer code reviews, troubleshoot and correct software defects. • Work with the internal testing team to ensure appropriate testing is built into the development and ongoing delivery. • Develop efficient queries to retrieve appropriate datasets from relational databases • Design, implement and maintain performance of reliable data pipelines and integrations that feed various applications, using both structured and unstructured data • Create, implement, and maintain data transformation processes Skills & Knowledge you will need: • Proven experience in the energy sector with a focus on data-driven projects • Strong understanding of energy industry concepts, terminology, and key performance indicators. • Energy Industry Knowledge, specifically around D-Flows their purpose and content. • Familiarity with data analysis tools and visualization platforms (e.g., Power BI, Tableau) is a plus, but core technical programming skills are secondary to industry knowledge. • SQL coding skills. • Ability to translate complex energy data sets into actionable insights for non-technical stakeholders. • Excellent communication and collaboration skills, with the ability to work effectively across multidisciplinary teams. • Experience with cloud computing such as Azure or AWS Nice to have: • Experience in data modelling. • Experience of working with large datasets. • Experience with cloud computing such as Azure or AWS • SDLC or Product Development experience • Pentaho Experience • Knowledge of BI tools such as Tableau • Python in Data Engineering Experience • Vertica Experience • Experience with developing REST APIs and microservices • Experienced in relational database design Priyanka Sharma Senior Delivery Consultant Office: 02033759240 Email: psharma@vallumassociates.com