Senior Data Engineer - Insurance - Hybrid
On site
London, United Kingdom
£ 85,000 / year
Full Time
17-10-2024
Job Specifications
Senior Data Engineer - Insurance - Hybrid
Senior Data Engineer
Snowflake & DBT, SQL and Azure DevOps
City, London/Hybrid (2 days per week in the office)
Permanent
Up to PS85,000 per annum + 15 % bonus + benefits
A fantastic opportunity has arisen for a Senior Data Engineer with solid skills in Snowflake, SQL and Azure DevOps to join their existing team and support the definition and delivery of an enterprise data platform with engineering best practices. Specifically, this role will help the divisional data team (DDT) to understand, manage, and prioritise data engineering and transformation activities.
The role is reporting to the AVP Data engineering, who is responsible for prioritising, planning, and driving forward the data engineering and transformation tasks required.
This is an exciting opportunity to join this new team. The Senior Data engineer would fill a critical role within the organisation tasked with analysis, design, implementation, testing, maintenance, and support for data-intensive pipelines.
Also, you will play an integral role in enhancing system quality, identifying issues, and transforming applications through innovation.
This role will suit a tech-savvy individual with a strong drive for creativity, excellence, and ambition!
Duties
Manage and lead the junior data engineers (1 direct report) who will assist with the delivery of data engineering activities.
Prepare technical design specifications based on functional requirements and analysis documents.
Implement, test, maintain, and support software, as outlined in technical design specifications.
Enhance system quality through identification of issues, common patterns, and formulation of standard operating procedures.
Qualifications & Experience
Proven experience in the market as an experienced Data engineer.
Extensive experience with SQL cloud databases like Snowflake, and MS SQLServer. Experience with NoSQL databases like AWS DynamoDB and Azure Cosmos is a plus.
Solid experience and clear understanding of one ETL tool (For eg: Matillion, SNP Glue, Fivetran, Informatica) and DBT.
Experience working with AWS and/or Azure DevOps and extensive debugging experience.
Clear understanding of data modeling, data curation, and orchestration
Experience with Business Intelligence tools like PowerBI is a plus.
Sound understanding of unit testing, test-driven development, functional testing, and performance aspects.
Knowledge of at least one Shell Scripting language.
Senior Data Engineer
Snowflake & DBT, SQL and Azure DevOps
City, London/Hybrid (2 days per week in the office)
Permanent
Up to PS85,000 per annum + 15 % bonus + benefits
About the Company
i3 Resourcing provides bespoke IT & Change Recruitment Solutions to the London & International Insurance Markets. We employ state of the art candidate identification and tracking techniques to offer our insurance client base unrivalled access to the best talent working in the market today. Know more
Related Jobs
- Company Name
- i3 Resourcing
- Job Title
- Senior Business Systems Analyst - Data
- Job Description
- Senior Business System Analyst London £90,000 Data Warehouse, Snowflake 3 days a week in office My client are going through an exciting transformational change, rethinking data and analytics from the ground up form part of a high performing agile squad gather requirements for a new Snowflake data platform data subject matter expert Work with business stakeholders ensure effective and innovative technical solution design. Work with QA colleagues Plan and facilitate workshops and 1-to-1 interviews. Conduct system prototype demonstrations Assist the digital product manager WE NEED SOMEONE WITH: Solid understanding of business analysis concepts, methods and practices in an information technology environment. General and London Market Insurance domain experience. Experience in defining data lineage from source systems to an Enterprise Data Warehouse. Solid understanding of agile delivery methodologies. Greenfield Data Warehouse build experience highly desirable. Some experience using JIRA or similar agile tools. Solid understanding of SQL and ability to use SQL tools to query a database to retrieve data. Senior Business System Analyst London £90,000 Data Warehouse, Snowflake
- Company Name
- Crimson Limited
- Job Title
- Lead Data Engineer (x2) - London - Permanent - Hybrid
- Job Description
- Lead Data Engineer (x2) - London - Permanent - Hybrid This role requires hybrid working based in Moorgate, London The salary for this role ranges between £65,000 - £74,000 Lead Data Engineer required for a leading client based in Moorgate, London. Our customer is seeking a well experienced Lead Data Engineer to come on board to spearhead agile data engineering initiatives, delivering data and insights products. This role involves understanding the business and IT strategy to align technical solutions with desired outcomes, developing APIs and integrations for data transfer between systems, and providing aggregated data solutions. Key Responsibilities: Ability to lead complex data engineering projects Design, code, test, and document data applications Develop and manage scalable APIs, machine learning endpoints, data integration pipelines, and data storage solutions. Shape the information strategy and platform architecture Introduce new data engineering tools, frameworks, standards, and processes Ensure the application of agreed standards and tools Ensure technical solutions support the accessibility, retrievability, security, quality, retention, and ethical handling of data. Experience with strategies and design approaches for APIs and data pipelines. Experience in designing and implementing data-driven tools and solutions. Proficiency in developing scalable APIs in Python using frameworks like FastAPI or Flask. Proficiency in developing scalable data pipelines in Spark/Python using tools such as Airflow. Experience with SQL, Python, and other Scripting/programming languages Experience with diverse data infrastructure and systems, such as PostgreSQL, SQL Server, Azure Data Lakes, Databricks, and Kubernetes. Strong stakeholder management and communication skills at varying levels Interested? Please submit your updated CV to (see below) for immediate consideration. Not interested? Do you know someone who might be a perfect fit for this role? Refer a friend and earn £250 worth of vouchers! Crimson is acting as an employment agency regarding this vacancy
- Company Name
- Sphere Digital Recruitment | Best Small Company 2022
- Job Title
- Data Analyst - UK Leading Publisher
- Job Description
- Data Analyst - Leading UK Publisher - £35,000 - £40,000 The Company One of the leading media businesses in the UK and Ireland. Their world-famous brands provide news, analysis, opinion and entertainment to almost 40 million people each month. Spanning print and pixel, audio and video, events and experiences, their multi-format brands are home to a plurality of opinion, representing the diverse communities they serve. Exciting bits: -Join a multi-national media powerhouse with 16 sites across the UK and Ireland -Work on one of their leading brands who boast an audience of 30m+ monthly readers -Join a growing data & analytics team and a company who has been investing heavily to boost their data infrastructure and capability over the past few years The Job Work with diverse stakeholders/teams which include Newsrooms, Product, Marketing, User experience and Technology Utilise SQL and Google Big Query to manipulate large data sets and build stakeholder friendly dashboards in Looker Work with data stakeholders to understands KPIs, data strategic and generate useful insights/recommendations for the business Conduct and deliver analysis on customer acquisition, audience measurement, digital and subscription analytics A/B testing to understand performance of campaigns, user journey and subscription acquisition Develop an excellent understanding of the media landscape You 2/3+ years experience in Data & Analytics Degree level educated Proficiency with SQL, Google Big query and any dashboarding tools (ideally Looker) Ideally some experience in Media but also open to other industries Apply Now You can apply for this role now by sending us your CV or by calling us now! Don't forget to look at vacancies on our website and register as a candidate. Jordan Matthews Executive Consultant Sphere Digital Recruitment currently have a variety of job opportunities across digital so feel free to get in touch with us to find out how we can help you. Sphere Digital Recruitment currently have a variety of job opportunities across digital so feel free to get in touch with us to find out how we can help you. Please take a look at our website. Sphere is an equal opportunities employer. We encourage applications regardless of ethnic origin, race, religious beliefs, age, disability, gender or sexual orientation, and any other protected status as required by applicable law. If you require any adjustments or additional support during the recruitment process for any reason whatsoever, please let us know.
- Company Name
- Fruition IT
- Job Title
- Senior Data Engineer
- Job Description
- Job Title: Senior Data Engineer Location: Leeds, on-site 2x per week Salary: £65,000 Why Apply? Our client is looking for a talented Data Engineer to play a key role in their ongoing digital transformation. This full-time, permanent position offers the chance to develop the initial data strategy, design scalable pipelines, and create a data lake that will be central to their reporting initiatives. If you are experienced in managing cloud-based data infrastructures and eager to drive innovative solutions, this role is perfect for you. Data Engineer Responsibilities Design and maintain scalable, automated data pipelines to ingest, process, and deliver quality data across internal systems. Lead the setup of a centralised data lake to unify data from various sources, supporting BI and analytics needs across the business. Partner with teams across the business, including Product, Analytics, and IT, to ensure data requirements are met and that systems align with business goals. Continuously improve data workflows by identifying optimisation and automation opportunities to enhance system performance. Guide junior engineers by providing mentorship and fostering best practices within the data team. Stay current with data engineering technologies and innovations, ensuring the infrastructure remains scalable and future-ready. Data Engineer Requirements Demonstrated experience as a Data Engineer, with a proven track record of designing and managing scalable data pipelines. Experience in a similar capacity, with a focus on designing and implementing robust data pipelines and infrastructure. Thorough knowledge of ETL processes, with the ability to optimize data extraction, transformation, and loading. Extensive commercial expertise with AWS, including services like Glue, Data Catalog, R and large-scale data storage solutions such as data lakes. Excellent analytical and problem-solving skills, with the ability to enhance and streamline complex data processes. Strong communication skills, with experience working alongside technical and non-technical teams. What's in it for me? Influence the data strategy and define data architecture from the outset, a unique opportunity to set the direction without any pre-existing frameworks! Flexible working arrangements, including remote work options. A collaborative, forward-thinking work environment where innovation is encouraged. Opportunities for continuous professional growth and development within a fast-growing, tech-driven company. We are an equal opportunities employer and welcome applications from all suitably qualified persons regardless of their race, sex, disability, religion/belief, sexual orientation or age.