Data Engineer
Hybrid
Bristol, United Kingdom
Full Time
11-04-2025
Job Specifications
Methods Analytics (MA) is recruiting for a Data Engineer to join our team on a permanent basis.
This role will be mainly remote but require flexibility to travel to client sites, and our offices based in London, Sheffield, and Bristol.
What You'll Be Doing as a Data Engineer:
Work closely with cross-functional teams, translating complex technical concepts into clear, accessible language for non-technical audiences
Collaborate with a dynamic delivery team on innovative projects, transforming raw data into powerful insights
Design and implement efficient ETL and ELT pipelines using modern tools such as Python, SQL, and Apache Airflow
Build scalable data solutions leveraging cloud platforms and technologies
Develop and maintain sophisticated data models, employing dimensional modelling techniques to support comprehensive data analysis and reporting
Implement best practices in data governance, security, and compliance to maintain data integrity
Ensure data quality through rigorous QA processes, continuously refining and optimising data queries
Develop intuitive dashboards that provide actionable insights to stakeholders
Monitor and tune solution performance to enhance reliability, speed, and functionality of data systems
Stay ahead of industry trends, continuously enhancing your skills with the latest data engineering tools and methodologies
Contribute to the development of the Methods Analytics Engineering Practice by participating in our internal community of practice
Your Impact:
Enable business leaders to make informed decisions with confidence through timely, accurate data insights
Drive adoption of modern data architectures and platforms
Deliver seamless data solutions that enhance user experience
Help cultivate a data-driven culture within the organisation
Requirements
You Will Demonstrate:
Strong proficiency in SQL and Python for handling complex data problems
Experience building and optimising ETL/ELT pipelines
Hands-on experience with Apache Spark (PySpark or Spark SQL)
Experience with the Azure data stack
Knowledge of workflow orchestration tools like Apache Airflow
Experience with containerisation technologies (Docker)
Ability to craft efficient and performant queries
Proficiency in dimensional modelling techniques
Experience with CI/CD pipelines for data solutions
Familiarity with test-driven development principles applied to data pipeline construction and validation
Strong communication skills for translating technical concepts to non-technical audiences
Business requirements analysis and translation into technical specifications
You may also have some of the desirable skills and experience:
Experience with data visualisation tools like Power BI or Apache Superset
Experience with other cloud data platforms like AWS, GCP or Oracle
Experience with modern unified data platforms like Databricks or Microsoft Fabric
Familiarity with modern data lakehouse architectures
Knowledge of legacy ETL tools like SSIS
Experience with Kubernetes for container orchestration
Understanding of streaming technologies (Apache Kafka, event-based architectures)
Software engineering background with SOLID principles understanding
Experience with data governance tools
Experience with high-performance, large-scale data systems
Familiarity with Agile development methodologies
Knowledge of recent innovations in AI/ML and GenAI
Defence or Public Sector experience
Consultant experience
Security Clearance:
UKSV (United Kingdom Security Vetting) clearance is required for this role, with Security Check (SC) as the minimum standard, either already held or with a willingness to undergo the process. Some roles/projects may require Developed Vetting (DV) clearance; while not mandatory, a willingness to obtain DV clearance would be beneficial. As part of the onboarding process candidates will be asked to complete a Baseline Personnel Security Standard (BPSS); details of the evidence required to apply may be found on the government website GOV.UK - Government baseline personnel security standard. If you are unable to meet this and any associated criteria, then your employment may be delayed, or rejected. Details of this will be discussed with you at interview.
Our Hiring Process
At Methods Analytics, we believe in a transparent hiring process. Here's what you can expect:
Internal Application Review
Initial Phone Screen
Technical Interview
Collaborative Pair Programming Exercise
Final Interview
Offer
Benefits
Methods Analytics (MA) exists to improve society by helping people make better decisions with data. Combining passionate people, sector-specific insight, and technical excellence to provide our customers an end-to-end data service.
We use a collaborative, creative and user centric approach to data to do good and solve difficult problems. Ensuring that our outputs are transparent, robust, and transformative. We value discussion and debate as part of our approach. We will question assumptions, ambition, and process - but do so with respect and humility.
We relish difficult problems, and overcome them with innovation, creativity, and technical freedom to help us design optimum solutions. Ethics, privacy, and quality are at the heart of our work, and we will not sacrifice these for outcomes.
We treat data with respect and use it only for the right purpose. Our people are positive, dedicated, and relentless. Data is a vast topic, but we strive for interactions that are engaging, informative and fun in equal measure. But maintain a steely focus on outcomes and delivering quality products for our customers.
We are passionate about our people; we want out colleagues to develop the things they are good at and enjoy.
By joining us you can expect
Autonomy to develop and grow your skills and experience
Be part of exciting project work that is making a difference in society
Strong, inspiring, and thought-provoking leadership
A supportive and collaborative environment
As well as this, we offer:
Development access to Pluralsight and LinkedIn Learning
Wellness 24/7 Confidential employee assistance programme
Social - office parties, pizza Friday and commitment to charitable causes
Time off - 25 days of annual leave a year, plus bank holidays, with the option to buy 5 extra days each year
Volunteering - 2 paid days per year to volunteer in our local communities or within a charity organisation
Pension Salary Exchange Scheme with 4% employer contribution and 5% employee contribution
Discretionary Company Bonus based on company and individual performance
Life Assurance of 4 times base salary
Private Medical Insurance which is non-contributory (spouse and dependants included)
Worldwide Travel Insurance which is non-contributory (spouse and dependants included)
About the Company
Methods is the leading digital transformation partner for the UK public sector. We care deeply about making our public services better and have been doing this for 28 years. Methods partners with a range of central government departments and agencies to transform the way public sector operates in the UK. Our mission is to help safeguard public-facing services and apply digital thinking to make sure the future of our public services is centred around citizens. Committed to having social impact, we enjoy an enviable track r... Know more
Related Jobs
- Company Name
- TieTalent
- Job Title
- Azure Databricks Data Engineer - OUTSIDE IR35
- Job Description
- About Databricks Data Engineer - Contract Day Rate: £450 - £550 P/ day Location: Hybrid (Remote / 2 Days a week in London) Start: Immediate Start Note: Capital Markets, or at least Banking experience is a MUST! Key Expertise And Experience We're Looking For Data Engineering in Databricks - Spark programming with Scala, Python, SQL Ideally experience with Delta Lake Databricks workflows, jobs, etc. Familiarity with Azure Data Lake: experience with data ingestion and ETL/ELT frameworks Data Governance experience - Metadata, Data Quality, Lineage, Data Access Models Good understanding of Data Modelling concepts, Data Products and Data Domains Unity Catalog experience is a key differentiator - if not then experience with a similar Catalog/Data Governance Management component MS Purview (Metadata and Data Quality tool) experience is a bonus - experience in similar tools is valuable (Collibra, Informatica Data Quality/MDM/Axon etc.) Data Architecture experience is a bonus Python, Scala, Databricks Spark and Pyspark with Data Engineering skills Ownership and ability to drive implementation / solution design Nice-to-have skills Spark Scala Python SQL ETL Data Quality Collibra PySpark Data Modeling City of London, England Work experience Data Engineer Data Infrastructure Languages English
- Company Name
- VirtueTech Recruitment Group
- Job Title
- Business Analyst, Data Platform – Energy Trading | Pre-Trade System | Up to £110,000 + bonuses + benefits | Hybrid - 2 to 3 days | London
- Job Description
- Business Analyst, Data Platform – Energy Trading | Pre-Trade System | Up to £110,000 + bonuses + benefits | Hybrid - 2 to 3 days | London Business Analyst, with strong experience working on data-centric platforms is required for an Energy Trading company working on an in-house Pre-Trade system leveraging Data Warehouse, Snowflake, and MongoDB. This Pre-Trade system is designed to ingest, store, and process data from various sources, including Bloomberg and similar providers, which as a result will help non-technical traders in making informed decisions before executing trades. As a Data Business Analyst, you will oversee the ingestion of data from external providers into the Pre-Trade system, ensure accurateness, and collaborate with Data providers and Junior members of the team. For this Data Business Analyst role, you will implement Data Governance practices for integrity and security within this domain capacity, manage the ingested data within the Data warehouse using Snowflake and MongoDB. From a stakeholder management perspective, as a Data Business Analyst, you will showcase the functionality of the Pre-Trade system to stakeholders which demonstrates how this data is used for Pre-Trade analysis which will ultimately help with decision making prior to trade execution. As a result, as the Data Business Analyst, you will be working closely with non-technical traders to understand their data needs and process requirements. This role is crucial for bridging the gap between technical data management and non-technical trading decision-making, ultimately contributing to the success of the trading operations. Therefore, as a Data Business Analyst, you will need to generate reports and dashboards within PowerBI to provide insights into the data and systems performance, analyse the data trends and patterns, then present to the stakeholders. As a Business Analyst, you’ll be working on a Pre-Trading system within Energy Trading. This Business Analyst role, is paying up to £110,000 + bonuses + benefits. Hybrid working: 2 to 3 days a week from the London-based office – Close to Kings Cross. Experience needed for this Data Business Analyst Role: Commercial experience in Date Warehouse, Snowflake, MongoDB , and PowerBI. Understanding of Energy Trading markets and concepts – working in a Front Office environment. Experience of setting up new products and understanding requirements from stakeholders. Implementing Data Governance practises and the importance of doing so. If you are interested in this Data Business Analyst role, please reply to this ad with your updated CV or send it directly to ross@virtuetech.io Business Analyst, Data Platform – Energy Trading | Pre-Trade System | Up to £110,000 + bonuses + benefits | Hybrid - 2 to 3 days | London
- Company Name
- hackajob
- Job Title
- Data Analyst
- Job Description
- hackajob is collaborating with BBC to connect them with exceptional tech professionals for this role. Job Title: Data Analyst Package Description Job Reference: 21063 Band:C Salary: If a range is being advertised: £27,600 - £35,050 depending on relevant skills, knowledge and experience. The expected salary range for this role reflects internal benchmarking and external market insights. Contract type: Continuing/Permanent Location: London - Broadcasting House - This is a hybrid role, and the successful candidate will balance office working with home working Excellent career progression - the BBC offers great opportunities for employees to seek new challenges and work in different areas of the organisation. Unrivalled training and development opportunities - our in-house Academy hosts a wide range of internal and external courses and certification. Benefits - We offer a negotiable salary package, a flexible 35-hour working week for work-life balance and 25 days annual leave with the option to buy an extra 5 days, a defined pension scheme and discounted dental, health care, gym and much more. Job Introduction We are currently recruiting for a Data Analyst to join our Business Information Team within the content division Reporting into to the Lead Data Analyst and working closely with a team of Data Analysts, the successful candidate will be responsible for providing accurate information and insight to the business. Whilst also managing and coordinating a range of processes to support BBC reporting requirements. Main Responsibilities Extracting and analysing data from BBC systems to prepare monthly reports Producing ad-hoc report and data visualisation requests Providing technical expertise and acting as a first point of contact for analytics queries from non-data-oriented colleagues, whilst also providing guidance on where analysis can help them with their day-to-day roles Undertaking data quality checks on business data from various sources within the BBC, to ensure the timeliness, accuracy and quality of data within our reporting systems. Develop an understanding of BBC Content’s current systems and workflows. Making suggestions on the constant need for process improvement; based on day-to-day observations and participation in structured projects as required. Are you the right candidate? Passion for and demonstrable work experience in data analysis High attention to detail and practical experience of analysing complex and confidential information Ability to use and experience of data visualisation tools to create charts and dashboards (e.g. Tableau, Power BI, etc.) Advanced Microsoft Excel skills - including Pivot Tables, Graphing, Complex Formulae Good written and verbal communication skills Understanding of one or more data scripting language such as Python, SQL, VBA About The BBC The BBC is committed to redeploying employees seeking suitable alternative employment within the BBC for different reasons and they will be given priority consideration ahead of other applicants. Priority consideration means for those employees seeking redeployment their application will be considered alongside anyone else at risk of redundancy, prior to any individuals being considered who are not at risk. We don’t focus simply on what we do - we also care how we do it. Our values and the way we behave are important to us. Please make sure you’ve read about our values and behaviours here. Diversity matters at the BBC. We have a working environment where we value and respect every individual's unique contribution, enabling all of our employees to thrive and achieve their full potential. We want to attract the broadest range of talented people to be part of the BBC - whether that’s to contribute to our programming or our wide range of non-production roles. The more diverse our workforce, the better able we are to respond to and reflect our audiences in all their diversity. We are committed to equality of opportunity and welcome applications from individuals, regardless of age, gender, ethnicity, disability, sexual orientation, gender identity, socio-economic background, religion and/or belief. We will consider flexible working requests for all roles, unless operational requirements prevent otherwise. To find out more about Diversity and Inclusion at the BBC, please click here.
- Company Name
- Guardian Jobs
- Job Title
- University Director of AI Innovation, Bluetownonline
- Job Description
- Job Title: University Director of AI Innovation Location: Oxford Road, Manchester Salary: Competitive - Circa £100,000 - £120,000 per annum Job type: Fixed Term (60 months) - 35 hours per week/ 1.0 FTE Closing date: 30/05/2025 Are you ready to lead transformative AI innovation in one of the most forward-thinking universities? At This University, we are on the cutting edge of Artificial Intelligence (AI) to revolutionise teaching, learning, research, and operations. As we continue to shape the future of higher education, we're seeking a dynamic, strategic, and visionary Director of AI Innovation to spearhead groundbreaking AI-driven projects across our institution. In this exciting role accountable to the University Executive (UE), you will lead our Skunkworks team-an elite group of AI specialists committed to accelerating high-impact AI projects. You'll collaborate with key stakeholders, develop sustainable AI initiatives, and drive AI adoption to enhance the University's performance and global standing. What You'll Be Doing: Lead and Inspire a High-Performing Team: Manage and inspire a talented, agile Skunkworks team to innovate and deliver transformative AI solutions. Engage with Key Stakeholders: Work closely with internal partners to identify challenges and co-design AI projects that drive real-world impact across teaching, learning, research, and operations. Scale AI Solutions: Create compelling business cases, track ROI, and oversee the growth of AI initiatives with measurable outcomes. Drive AI Strategy: Monitor emerging AI trends, evaluate their potential for higher education, and ensure our University remains at the forefront of innovation. Champion Ethical AI: Lead responsible AI adoption, ensuring compliance with ethical, legal, and regulatory standards. What We're Looking For: Expertise in AI Technologies: Deep understanding of AI technologies and their transformative potential for higher education. Proven Leadership: Experience in leading innovative teams, driving complex AI projects, and delivering measurable institutional impact. Strategic Vision: Ability to craft and execute long-term AI strategies, building partnerships across disciplines to achieve common goals. Stakeholder Engagement: Strong communication skills to engage, influence, and partner with a diverse range of stakeholders across the institution. Ethical and Risk Management: A solid grasp of the ethical, regulatory, and risk considerations of AI, ensuring responsible deployment. Why Join Us? Shape the Future: Lead AI projects that will transform the University and higher education at large. Collaborative Environment: Work alongside experts and leaders across multiple disciplines to push the boundaries of innovation. Commitment to Excellence: A university culture focused on sustainability, social responsibility, inclusion, and people leadership. Cutting-Edge Resources: Access to a substantial software licensing budget and support for sandbox projects. Essential Requirements: A higher degree in AI, computer science, or a related field (or equivalent industry experience). Demonstrable experience in delivering AI projects with substantial institutional impact. Exceptional communication, analytical, and project management skills. Ability to foster an inclusive and collaborative team culture. If you're a visionary AI leader ready to make an extraordinary impact in higher education, we want to hear from you! Apply now and be part of our journey to innovate, inspire, and lead AI transformation. As an equal opportunities employer we support an inclusive working environment and welcome applicants from all sections of the community regardless of age, disability, ethnicity, gender, gender expression, religion or belief, sex, sexual orientation and transgender status. All appointments are made on merit. Enquiries about the vacancy, shortlisting and interviews: Name: Michael Platt, Talent Partner Please note, we anticipate that interviews will be held on the 17th June 2025, though this date is subject to change. This vacancy will close for applications at midnight on the closing date. We reserve the right to close this vacancy ahead of the published closing date. Please click APPLY to be redirected to our website to complete an application form. Candidates with experience or relevant job titles of; Director of AI Innovation, AI Innovation Director, AI Director, University Director, Education Director, Director of Education, Director of University, may also be considered for this role.