Data Engineer - £100k + Shares / Remote
Hybrid
United Kingdom
Full Time
10-12-2024
Job Specifications
Job Role: Senior Data Engineer
Salary: up to £100,000.00 + Shares
Remote UK Based, Occasional travel to London required
An exciting opportunity has arisen to join the technology and product team, with the expectation of function growing substantially, the end client is a Fintech payments-based provider.
You must have experience building complex data frameworks in early-stage businesses.
I have listed some key requirements below for you to be applicable for the role,
Design, build, and maintain scalable data pipelines and architectures to handle large volumes of data.
Develop, enhance, and optimize ELT processes for ingesting, processing, and distributing data across multiple platforms.
Build and manage data warehouses.
The technology stack is listed below,
AWS
Airflow
Databricks
GitHub
Great Expectations
PyTest
Kafka
Mosaic AI
Terraform
Tableau
About the Company
At Mentmore we understand that hiring exceptional people is important for our clients but that it is only one part of their job. We aim to make that process as enjoyable, efficient and effective as possible. We provide high quality candidates for both permanent and contract IT positions and are specialists within our five Core Practice areas: *Information Security *Change & Project Management *Infrastructure & Service Management *Architecture *Executive IT Leadership Our knowledge extends across a variety of sectors inclu... Know more
Related Jobs
- Company Name
- Salt
- Job Title
- Customer Data Analyst
- Job Description
- Customer Data Analyst Travel | Loyalty £55,000 - £62,000 South London - 2 days in the office The Company: I'm currently working with a global loyalty and rewards program to hire an Analyst for their growing team. This is a brand new role which will look to tie two parts of the business together and create a holistic view of the customers and how they interact with the business. You will be supporting the global digital and offline program with data and insights across all channels. As Customer Data Analyst you will: Create and manage dashboards and reports to track key metrics, enabling the business to evaluate and improve the program, marketing, and product activity. Collaborate with the team to execute analytical projects focusing on loyalty, customer value, lifecycle stages, cross-group activities, and omnichannel engagement. Perform data quality checks to ensure data accuracy and consistency throughout the datasets. Evaluate the performance of campaigns and programs by analysing key indicators, including Incremental and Assisted revenue. Act as a subject matter expert, proactively addressing business queries and providing insights through both strategic briefs and ad hoc requests to drive customer growth, engagement, and retention. Requirements: 3 + years of experience working with large volumes customer data Has experience working on loyalty programs Experience with visualisation tools such as Tableau or Power BI Experienced in SQL - Python is desired If you're interested in this Customer Data Analystopportunity please apply below... *Rates depend on experience and client requirements
- Company Name
- Thrive IT Systems
- Job Title
- Data Engineer Iceberg/Banking
- Job Description
- Position: Data Engineer IcebergLocation: Milton Keynes, UK Duration: Permanent Job Description: As a Data Engineer with Iceberg experience, you will play a crucial role in the design, development, and maintenance of our data infrastructure. Your work will empower data-driven decision-making and contribute to the success of our data-driven initiatives. Key Responsibilities: Data Integration: Develop and maintain data pipelines to extract, transform, and load (ETL) data from various sources into AWS data stores for both batch and streaming data ingestion. AWS Expertise: Utilize your expertise in AWS services such as Amazon EMR, S3, AWS Glue, Amazon Redshift, AWS Lambda, and more to build and optimize data solutions. Data Modeling: Design and implement data models to support analytical and reporting needs, ensuring data accuracy and performance. Data Quality: Implement data quality and data governance best practices to maintain data integrity. Performance Optimization: Identify and resolve performance bottlenecks in data pipelines and storage solutions to ensure optimal performance. Documentation: Create and maintain comprehensive documentation for data pipelines, architecture, and best practices. Collaboration: Collaborate with cross-functional teams, including data scientists and analysts, to understand data requirements and deliver high-quality data solutions. Automation: Implement automation processes and best practices to streamline data workflows and reduce manual interventions. Experience working with bigdata ACID file formats to build delta lake, particularly with Iceberg file formats and loading methods of Iceberg. Good knowledge on Iceberg functionalities to use the delta features to identify the changed records, optimization and housekeeping on Iceberg tables in the data lake. Must have: AWS, ETL, EMR, GLUE, Spark/Scala, Java, Python, Good to have: Cloudera - Spark, Hive, Impala, HDFS, Informatica PowerCenter, Informatica DQ/DG, Snowflake Erwin Qualifications: Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field. 5 to 8 years of experience in data engineering, including working with AWS services. Proficiency in AWS services like S3, Glue, Redshift, Lambda, and EMR. Knowledge on Cloudera based hadoop is a plus. Strong ETL development skills and experience with data integration tools. Knowledge of data modelling, data warehousing, and data transformation techniques. Familiarity with data quality and data governance principles. Strong problem-solving and troubleshooting skills. Excellent communication and teamwork skills, with the ability to collaborate with technical and non-technical stakeholders. Knowledge of best practices in data engineering, scalability, and performance optimization. Experience with version control systems and DevOps practices is a plus.
- Company Name
- Claremont Consulting
- Job Title
- BI Analyst
- Job Description
- My client who are market leaders within the data technology space are looking for 2 Business Intelligences Analysts to join them on a permanent basis in London. * This will be hybrid working with 10 days in the office per month.* Some of the great things you'll be doing: Collaborate effectively across teams to understand requirements and scope of reporting requests Build and maintain data sets and reports to meet business requirements, using GA4, SQL and BI tools Ensure data is visualised for maximum impact Use your inquisitive mindset to gain an understanding of our data, performance metrics and reporting capabilities. Perform data analysis, developing and optimising queries and reports Share knowledge and provide guidance to business users on BI tools, GA4 and business reports Proactively identify opportunities for business to self-serve Ensure any data quality issues are logged and escalated where appropriate Actively contribute within team meetings and identify improvements to ways of working Demonstrate and promote the value of data Develop and champion agile, data driven approaches (eg. test and learn) What we'd like to see from you: An inquisitive mindset with a natural curiosity to solve problems, explore data and get to the right answer. Strong team player with a passion for collaboration and knowledge sharing. Experience with Google Analytics (GA4). Solid SQL Knowledge. Experience of Power BI (Power Query, DAX, Modelling, Data Visualisation for impactful insights, Flows, Apps) or other BI tooling (Tableau, Looker etc). Ability to communicate effectively with both technical and non-technical stakeholders. Apply now for immediate consideration!
- Company Name
- Lorien
- Job Title
- Credit Risk Analytics Manager - SAS
- Job Description
- Credit Risk Analytics Manager - SAS - BANKING - PERM Permanent. This role can be based out of the Swindon or Bournemouth office with a hybrid working culture in place. £60,000-£65,000 + bonus and benefits A well-known banking firm is looking to hire a Credit Risk Analytics Manager - SAS to join their Credit Risk team. Your job will include leading, coaching and developing a team of SAS analysts who analyse credit risk data, providing stakeholders with valuable insight into the changing credit risks within the Owner Occupied mortgage portfolio. As a minimum requirement, you'll have experience of: Leading or coaching Analysts in a Credit Risk function Using statistical and analytical tools (ideally SAS) and working with large datasets Innovating to find solutions to problems and/or efficiency improvements Producing insightful analytics and using this to design effective and robust credit strategies Carbon60, Lorien & SRG - The Impellam Group STEM Portfolio are acting as an Employment Business in relation to this vacancy.