BI Engineer (Azure, Python, SQL)
Hybrid
Birmingham, United Kingdom
£ 48,000 / year
Full Time
28-10-2024
Job Specifications
BI Engineer (Azure, Python, SQL)
Location: Birmingham (4 days a week on-site)
Salary: £45k - £48k
Opportunity
A fantastic opportunity has come up to work for a genuine market leader in an exciting and innovative industry. They plan to build a newly created BI and Data Engineering division to work alongside other Data and Analytics teams across the group.
For this role, they need someone to serve as a central resource from within their Strategy and Analytics department, also working with, but not exclusive to, the Commercial, Finance, and Operational business functions, to help advance the group’s data infrastructure and support in transforming data into actionable insights and triggered events for Business Intelligence (BI) and Customer Relationship Management (CRM) system purposes.
This role will be instrumental in leveraging data to ensure a fully integrated approach to data-driven decision-making and also business strategy.
Day-to-day tasks
Work across the group and with the devisions data partners to leverage all available data, building out the groups database, reporting and insights capabilities to enable data-led decision making.
Design, develop and maintain scalable, user-friendly and automated systems, data solutions and reporting that will support our analytical and business needs.
Support the insight team with visualisations, reporting and stakeholder engagement through monthly/quarterly/annual departmental reviews
Use data science/statistical modelling tools in collaboration with the analyst team and departmental stakeholders to develop Artificial Intelligence (AI) and Machine Learning (ML) functions and analytics.
Create and manage a knowledge-base, including documentation of your designs (e.g., system design, functional design, data flow design) ensuring there is version control and contingency processes for all aspects.
Required skills and experience for the role
Demonstrable experience or certification(s) within the field of data engineering, data science, and/or business analysis.
Practical experience of database design and data transformation, supported by ETL processing.
Managing data pipelines & orchestration that enable the transfer and processing of data. (Databricks, Microsoft Fabric, Alteryx. Snowflake, Apache)
Coding and programming, capable of working through complex problems with others from the team, adapting quickly to changing market trends and business needs. (SQL, Python or R)
Utilising cloud-based services and corresponding toolsets. (Microsoft Azure, GCP, AWS or similar).
Comfortable handling structured and unstructured data, from 1st, 2nd, and 3rd party data sources, combining multiple data sets, to produce a cohesive picture of performance and derive insights and recommendations.
Experience working directly with business stakeholders ensuring complex information is articulated in a meaningful way.
Applying for the opportunity
If you feel you have the required skills and experience and want to be considered for this opportunity, please forward an up-to-date version of your CV. If we feel your profile is a suitable match, someone will contact you within 48 hours.
About the Company
Founded in 2018, Digital Waffle is a leading tech & digital recruitment agency. We are dedicated to finding and matching the best digital talent with growing businesses across the UK, EU, and USA. As a trusted tech recruitment agency, we focus on roles in marketing, technology, IT, data, and operations. Digital Waffle takes pride in making the recruitment process smooth and efficient, ensuring the perfect fit for both employers and candidates. Tech and digital recruitment is not just our business; it's our passion. With an... Know more
Related Jobs
- Company Name
- scrumconnect ltd
- Job Title
- Data Engineer
- Job Description
- Scrumconnect Consulting is seeking a highly skilled Data Engineer to join our innovative team. In this role, you will be responsible for building and optimizing our data pipelines and supporting the data needs of our Business Intelligence and analytics teams. If you have a passion for data and a knack for solving complex challenges, we invite you to apply. Key Responsibilities: - Implement data flows to connect operational systems with data for analytics and Business Intelligence (BI) systems. - Document source-to-target mappings and re-engineer manual data flows to enable scalability and repeatable use. - Support the build of data streaming systems to handle large volumes of data in real time. - Write ETL (Extract, Transform, Load) scripts and code to ensure optimal performance of the ETL processes. - Develop reusable Business Intelligence reports and build accessible data for analysis. - Collaborate with Data Scientists to build analytics tools that utilize the data pipeline to provide actionable insights for management, operational efficiency, and other key business performance metrics. Essential Skills and Experience: - Hands-on coding experience in R or Python, with a solid understanding of programming paradigms and concepts needed in Data Engineering. - Expertise in working with numpy, scipy, pandas, and data visualization tools in Python or equivalent packages in R. - Strong knowledge of SQL, with experience in working with both traditional RDBMS and distributed datasets. - Deep understanding of SQL, cloud-based data pipelines, architectures, and data sets. - Experience in writing complex queries against relational and non-relational data stores. - Good understanding of Data Warehousing and Data Lakehouse concepts. - Proven experience working with large data sets, data pipelines, and cloud services. - Experience in building reliable, efficient data applications, systems, services, and platforms. - Familiarity with big data tools such as Hadoop and Spark. - Background in programming using Open Source technologies, along with Python, Java, or C++/.Net. - Good written and verbal communication skills with a strong desire to work in cross-functional teams. - Awareness of data security best practices and GDPR compliance toward personal data. - Experience working in an agile environment or organizations with an agile culture. Desirable Skills: - Knowledge of Machine Learning and traditional Data Science concepts is beneficial but not mandatory. - Understanding of design choices for data storage and data processing, particularly with a focus on cloud data services. - Familiarity with technologies such as Apache Spark or Airflow. - Experience using parallel computing to process large datasets and optimize computationally intensive tasks is advantageous but not mandatory. Qualifications: - Degree or equivalent in a relevant subject, such as Computer Science, Information Systems, or a related technical discipline. Why Join Us: - Competitive salary and benefits package. - Opportunity to work with cutting-edge technologies in a dynamic environment. - Collaborative and inclusive culture that values professional growth and continuous learning. - Work-life balance with flexible working arrangements. - Skilled worker visa can be processed for candidates outside of the United Kingdom.
- Company Name
- i3 Resourcing
- Job Title
- Senior Business Systems Analyst - Data
- Job Description
- Senior Business System Analyst London £90,000 Data Warehouse, Snowflake 3 days a week in office My client are going through an exciting transformational change, rethinking data and analytics from the ground up form part of a high performing agile squad gather requirements for a new Snowflake data platform data subject matter expert Work with business stakeholders ensure effective and innovative technical solution design. Work with QA colleagues Plan and facilitate workshops and 1-to-1 interviews. Conduct system prototype demonstrations Assist the digital product manager WE NEED SOMEONE WITH: Solid understanding of business analysis concepts, methods and practices in an information technology environment. General and London Market Insurance domain experience. Experience in defining data lineage from source systems to an Enterprise Data Warehouse. Solid understanding of agile delivery methodologies. Greenfield Data Warehouse build experience highly desirable. Some experience using JIRA or similar agile tools. Solid understanding of SQL and ability to use SQL tools to query a database to retrieve data. Senior Business System Analyst London £90,000 Data Warehouse, Snowflake
- Company Name
- Lorien
- Job Title
- Dynamics 365 and Power Platform Developer
- Job Description
- You will join a global consulting, transformation and digital services business who are driving innovative solutions daily. They partner with clients to provide insight and to deliver cutting-edge technologies. Due to company growth, the team are looking for a Senior Software Developer with strong Dynamics 365, Power Platform and Azure experience to join their software team to design, test and implement new and updated software programmes. Roles and responsibilities include: Writing codes and debugging Configuration management - code hygiene Produce software builds from software source code Performing Unit test, documenting changes and refactoring less complexed programs/scripts Producing integration test specifications Benefits: Homebased Salary up to £80,000 Extensive training and progression opportunities 23 days' holiday (rising to 27) with the opportunity to buy extra leave 15 weeks fully paid maternity, adoption and shared parental leave Life assurance Company matched pension Requirements: Eligible for SC clearance Extensive experience as a software developer Strong experience with Dynamics 365, Power Platform and Azure Mentoring or experience supporting junior colleagues (desirable) For more information and immediate review, please apply now! Carbon60, Lorien & SRG - The Impellam Group STEM Portfolio are acting as an Employment Business in relation to this vacancy.
- Company Name
- Crimson Limited
- Job Title
- Lead Data Engineer (x2) - London - Permanent - Hybrid
- Job Description
- Lead Data Engineer (x2) - London - Permanent - Hybrid This role requires hybrid working based in Moorgate, London The salary for this role ranges between £65,000 - £74,000 Lead Data Engineer required for a leading client based in Moorgate, London. Our customer is seeking a well experienced Lead Data Engineer to come on board to spearhead agile data engineering initiatives, delivering data and insights products. This role involves understanding the business and IT strategy to align technical solutions with desired outcomes, developing APIs and integrations for data transfer between systems, and providing aggregated data solutions. Key Responsibilities: Ability to lead complex data engineering projects Design, code, test, and document data applications Develop and manage scalable APIs, machine learning endpoints, data integration pipelines, and data storage solutions. Shape the information strategy and platform architecture Introduce new data engineering tools, frameworks, standards, and processes Ensure the application of agreed standards and tools Ensure technical solutions support the accessibility, retrievability, security, quality, retention, and ethical handling of data. Experience with strategies and design approaches for APIs and data pipelines. Experience in designing and implementing data-driven tools and solutions. Proficiency in developing scalable APIs in Python using frameworks like FastAPI or Flask. Proficiency in developing scalable data pipelines in Spark/Python using tools such as Airflow. Experience with SQL, Python, and other Scripting/programming languages Experience with diverse data infrastructure and systems, such as PostgreSQL, SQL Server, Azure Data Lakes, Databricks, and Kubernetes. Strong stakeholder management and communication skills at varying levels Interested? Please submit your updated CV to (see below) for immediate consideration. Not interested? Do you know someone who might be a perfect fit for this role? Refer a friend and earn £250 worth of vouchers! Crimson is acting as an employment agency regarding this vacancy