Data Engineer
Hybrid
Luton, United Kingdom
Freelance
03-04-2025
Job Specifications
Role: Senior Data Engineer
Work location: Luton (Hybrid)
Hiring type- Contract role
Mandatory: Snowflake, DBT, Python Mandatory
Job Description:
The ideal candidate with a minimum of 5 +years of experience having strong experience working with Snowflake, DBT, Python, and AWS to deliver ETL/ELT Pipelines using different resources.
• Proficiency in Snowflake data warehouse architecture Design, build, and optimize ETL/ELT pipelines using DBT (Data Build Tool) and Snowflake.
• Experience with DBT (Data Build Tool) for data transformation and modelling. Implement data transformation workflows using DBT (core/cloud).
• Strong Python programming skills for automation and data processing. Leverage Python to create automation scripts and optimize data processing tasks.
• Proficiency in SQL performance tuning, and query optimization techniques using snowflake.
• Troubleshoot and optimize DBT models, and Snowflake performance.
• Knowledge of CI/CD, version control (Git) tools. Experience with orchestration tools such as Airflow,
• Strong analytical and problem-solving skills with an ability to work in agile development environment independently.
• Ensure data quality, reliability, and consistency across different environments.
• Collaborate with other data engineers, data analysts, and business stakeholders to understand data needs and translate them into engineering solutions.
• Certification in AWS, Snowflake, or DBT is a plus.
About the Company
We provide Software Development, Maintenance and Other Related IT Services, across spectrum, depending on individual client’s needs and dependability on us. Being a young and vibrant software solution company, we believe in harnessing the talent and experience of each member of our team to provide a unique flavor to our offerings within practical considerations and as per need and flexibility as expressed by our clients. We believe in working as a true partner and demonstrate transparency in all our dealings and conduct wi... Know more
Related Jobs
- Company Name
- Gama Aviation
- Job Title
- BI Developer
- Job Description
- / Position: BI Developer / Location: Farnborough HQ (Hybrid working can be agreed) / Working Hours: Full-Time, 40 Hours per week / Contract: 6 Months, Fixed Term Contract Gama Aviation is looking to add a talented BI Developer to the business operations team on fixed-term contract of 6 months, based at our HQ in Farnborough. This role will be supporting the extension and professionalisation of business intelligence reporting across the business using Microsoft Power BI. As the Business Intelligence Developer, you must develop a strong understanding of Gama Aviation’s operational structure and systems in order to facilitate meaningful analysis of our operational data, through summary KPI reports and drill through to operational detail. You will support the specification, lead the development and ongoing administration of a suite of logical and well managed reports that will enable critical business decisions in a timely manner. You will ensure the reporting extends and scales with the business as it grows. Working for the Group Business Operations function, you’ll help transform the business intelligence reporting both centrally and across the group companies. With a passion for extracting actionable intelligence from business data, you’ll bring energy, enthusiasm and drive to a highly rewarding role within a small but agile team in an exciting, growing global business. This is an excellent opportunity working with diverse datasets from various sources, driving the BI roadmap by developing new functionality and tools to support business decisions, and ultimately commercial success. You will have a great deal of responsibility with endless opportunity for impact and freedom for initiatives. / About us: Gama Aviation is a hugely diverse business that offers much more than perhaps its name would suggest. Yes, we fly but we also save lives, provide mission critical intelligence, and build systems that deliver decisive advantage. With operations in the UK, Jersey, Europe and the Middle East, a career with us can offer travel, personal growth opportunities and the ability for long-term progression in a fast paced and dynamic service industry. / Responsibilities: Integration of Power BI into Gama Aviation’s Business Units; understanding the business requirements and translating them into Power BI reports, drawing on all available data sources: Develop understanding of Gama Aviation’s business structure in order to support the specification of new reports, eliciting requirements from stakeholders from across the business Integration of many complex data sources, both on premise and cloud hosted, including configuring APIs and ODBC type connections Data modelling across multiple operational systems; mapping relationships between disparate datasets, identifying blockers and resolving Develop reports and dashboards that draw together data from the multiple sources Performance tuning; ensuring data is ingested in a way that minimises computational burden Implementing an access control structure and framework for managing it Developing How2 type guidance and training end users Administration of existing reports including modifying to accommodate business changes / Skills, Qualifications and Experience required: Sound experience within business intelligence development including extensive experience extracting and interpreting management information (MI) from ERP systems Experience using Power BI dataflows to manage data from multiple sources A background of working in corporate environments with complex, segmented business structures, including multiple business units and support functions Understanding of database management systems and ETL frameworks Knowledge of SQL, M Query and DAX, ideally with some capability in R scripting Proven ability to develop meaningful dashboards and visualisations of MI derived from ERP systems Ideally some experience in a professional services sector, providing analysis of labour metrics and capacity management Skilled in business analysis, translating business requirements into technical specifications Excellent problem-solving capabilities, proactive in working with stakeholders to overcome issues Comfortable working with a range of stakeholders of varying levels of seniority and job role Willingness and aptitude to learn and understand the operational structure and business mechanisms in order to generate meaningful reports You will not shy away from a challenge or delivering excellence and will always display willingness to learn and develop in the role / In addition to a Competitive Salary, we will offer you: Great Work-Life Balance with our Hybrid Working Policy – 3 days in the office, 2 days from home Competitive Group Pension Scheme Comprehensive Life Assurance * Comprehensive Income Protection * Comprehensive Travel Insurance * Comprehensive Private Healthcare (after successful passing of probation) * · Free Car Parking · 2 Paid Volunteering Days each calendar year (subject to line manager approval) · Investment in Training, Qualifications and Professional Development *(Subject to insurance underwriting) Due to the volume of applications received, only candidates selected for interview will be contacted. If you do not hear from us within 20 working days then your application has been unsuccessful on this occasion.
Farnborough, United Kingdom
Hybrid
Freelance
07-04-2025
- Company Name
- G MASS Consulting
- Job Title
- Bordereaux Insurance/Reinsurance Data Test Analyst
- Job Description
- G MASS Consulting is looking to connect with an experienced Bordereaux Insurance / Reinsurance Data Test Analyst to support a prestigious client in the insurance and reinsurance sector, based in London. This is initially a 6-month contract with the expectation of extension. This exciting opportunity is ideal for a technically adept professional with a passion for data and reinsurance systems, offering a key role in testing and integrating cutting-edge platforms developed by an in-house IT team. Working at the intersection of data, project management, and IT, this position provides the chance to make a tangible impact within a dynamic organisation operating in the Lloyd's market. Reporting directly to the Head of Data, the successful candidate will ensure the reliability and performance of reinsurance platforms, with a particular focus on bordereaux data processes. If you have a strong understanding of Lloyd's, syndicate, or MGA environments and a background in reinsurance, this role provides an excellent platform to apply your expertise in a collaborative and innovative setting. Responsibilities: Conduct thorough testing of reinsurance platforms, ensuring bordereaux data accuracy, integrity, and system performance. Collaborate with in-house IT teams to validate platform integrations and ensure seamless functionality. Work alongside data, project management, and IT teams to identify, troubleshoot, and resolve issues in reinsurance systems. Analyse and interpret complex datasets to support testing processes and platform enhancements. Provide insights and feedback to improve system efficiency, data workflows, and user experience. Act as a key liaison between technical teams and business stakeholders to ensure alignment on project goals and deliverables. Contribute to the continuous improvement of testing methodologies and data management practices. Requirements 2-3 years+ experience in a data testing, analyst, or similar role within the insurance or reinsurance industry. In-depth knowledge of Lloyd's market, syndicate operations, or Managing General Agent (MGA) environments. Strong expertise in reinsurance, particularly outwards reinsurance processes and bordereaux management. Familiarity with SQL and/or coding skills (preferred) to query, manipulate, and analyse data effectively. Ability to work confidently at the intersection of data, IT, and project management, with excellent problem-solving skills. Exceptional attention to detail and a proactive approach to identifying and resolving technical challenges. Strong communication skills, with the ability to collaborate effectively across technical and non-technical teams. A team player who thrives in a hybrid working environment (3 days per week in our client's London office). Benefits Paying up to £50,000 per annum 6 months contract with expectation of extension Hybrid work (3 days in the office)
London, United Kingdom
Hybrid
Freelance
07-04-2025
- Company Name
- Vivid Rock
- Job Title
- Data & Insights Manager
- Job Description
- Vivid Rock are proud to be partnering with a wonderful, forward thinking charity who know that gleaning data and insights from the key components of what they do, will inevitably help them to achieve their goals in a faster and more efficient way. They have already done great work in this area and are looking to continue the development of their cloud native data systems to provide the business with more solutions to grow income and increase their impact. As such, an exciting opportunity has arisen for an experienced interim Data & Insights manager who can excel in both hands-on and team management elements of the following: Key Responsibilities: Provide operational management of the team to develop, implement and evolve data-led insights capability, and encourage adoption of advanced data analytics and data science best-practice across the organisation. Lead technical change management planning for MS Dynamics and other data related products. Resolve day to day issues regarding systems, data quality and processes. Oversight of data integrations (ETL) and data warehousing operations. Co-develop data solutions fit for business initiatives such as new fundraising products or service delivery mechanisms. Ability to communicate effectively across organisational and technical boundaries, managing stakeholders’ priorities and expectations. Develop capabilities which allow maximising the value of data & encourage the adoption of data centric decision making Oversight of business intelligence reporting and insights discovery Oversee the day to day running of data integrations and data warehousing Key Skills Required: Track record of working with MS Dynamics and within Azure environments Extensive knowledge of ETL concepts (data modelling, Data processing, Scheduling, error handling) Extensive experience as a leader, manager of people - ideally within a data context Experience of using/working with ADF, Fabric, Synapse, Power BI Strong SQL coding capability and experience designing Data Solutions Good understanding of Fundraising systems and processes within a charity setting Strong analytical, and problem-solving skills Excellent verbal, written communication, and interpersonal skills Daily Rate: - £480 per day IR35 Status: - Inside IR35 Contract Length: - 5 - 6 months Hybrid working: Minimum 1 day per week in the office
London, United Kingdom
Hybrid
Freelance
07-04-2025
- Company Name
- Test Yantra
- Job Title
- AI ML Developer
- Job Description
- The ideal candidate must have more than 5 years of experience. This is a hybrid mode of working in client office. Should have experience of AI/ML algorithms and techniques, including LLMs, GenAI, and automated AI systems. Proven Experience with machine learning frameworks (e.g., TensorFlow, PyTorch). Must have proficiency in Python, R, or other relevant programming languages. Good proficiency in working with large datasets, data wrangling, and data preprocessing. Ability to work independently and lead projects from inception to deployment. Good Experience with big data technologies (e.g., Hadoop, Spark) and cloud platforms (e.g., AWS, GCP, Azure).
Stevenage, United Kingdom
Hybrid
Freelance
07-04-2025