Senior Big Data Engineer
Hybrid
Newcastle Upon Tyne, United Kingdom
Full Time
13-04-2025
Job Specifications
As part of the Big Data Team, you will be using cutting edge technologies to work on collating data across different sources within GiG. Sources are all in real time, and you will be supporting an event driven micro service lambda architecture.
Your focus is to work with the current agile team and contribute to the platform's objectives and continue being an enabler to many other data technology stakeholders such as the Business Intelligence, Data Science and Quality Assurance teams. You will be up for a challenge, to continue maintaining and adding new features to a platform that ingests up to 5000 messages per second across multiple products such as Lottery, Sports and Casino.
Reporting to the Lead Big Data Engineer and supported by the Big Data Architect to follow best practices, you'll be guided into delivering world class product increments that support our Tier 1 Platform.
You're really awesome at:
Object oriented programming (Java)
Data modelling using any database technologies
ETL processes (ETLs are oldschool, we transfer in memory now) and experience with Apache Spark or Apache NiFi
Applied understanding of CI\CD in change management
Dockerised applications
Used distributed version control systems
Excellent team player
Meticulous and passionate about your work
You're also good at:
Functional oriented programming (experience with Python, Scala)
Analytical mindset
Low latency databases such as ClickHouse
Hold a Bachelor's Degree in Computer Science or equivalent
Can collaborate in scoping exercises
Mentoring skills
Have worked with both Linux and Windows environments
Unix/Linux
What will you get in this role?
You'll give us your ideas and knowledge, and if we're a good match we'll back you up with a salary you can be proud of and amazing industry perks like daily lunch. On top of the perks, you'll even get to work with the best talent the industry has to offer.
Benefits:
Great career development opportunities
100% remote or hybrid working model
International Health Insurance
Health and Wellbeing Package (350 EUR per year)
Birthday Day Off
Me Time - 1 day off per year
Lunches in the office for free
Benefits
Great career development opportunities
Hybrid or remote working model
International Health Insurance
Health and Wellbeing Package (350 EUR per year)
Birthday Day Off
Me Time - 1 day off per year
About the Company
We are an award-winning iGaming platform and sportsbook provider supplying industry-leading solutions to our partners and their players. We specialise in helping online and land-based operators expand their iGaming and sports betting business on a global scale, focusing on innovation and customisation to power localised customer experiences and intimate user journeys. As a regulated markets specialist, we offer compliant entry into 36+ complex regulated markets around the world. Our powerful iGaming platform is built to be ... Know more
Related Jobs
- Company Name
- RedRock Resourcing
- Job Title
- Graduate Data Engineer x 3 (STEM) - Graduate Scheme - Training & Development - Bristol - New (REFBJ17)
- Job Description
- Graduate Data Engineer x 3 (STEM) - Graduate Scheme - Training & Development - Bristol - New (REFBJ17) Starting salary of £28k (Rising to £45k) - Graduate Scheme + Excellent Benefits/Training/Development Due to continued growth, a leading consultancy in the Bristol area requires a number of Graduates to join its award-winningm team. Working under the guidance of Project Leads, you will progress through the Graduate Scheme developing skills and gaining knowledge and experience relating to the role. There will be ample opportunities to use creativity and initiative towards problem solving and to contribute towards shared goals. During the scheme, there will be opportunities for industry recognised training and certification. What you can expect to get out of the opportunity: An excellent opportunity to build subject matter expertise Hands-on experience of SIEM and the Information Security sector Client engagement experience and development of consulting skills Variety of experiences to help you shape your future career Industry recognised training and certification Supportive working culture and team ethos Suitable candidates will have the following: Qualified to degree level (2:1 or above in a STEM subject) Excellent interpersonal skills - this is a client-facing role Experience with MS Office Able to achieve SC level UK security clearance Coupled with: Enthusiasm – eagerness and motivation Organisation – prioritise time and workload Communication – clear and concise Professionalism – interaction with customers and partners Creativity – initiate new and innovative solutions and processes Please send CV for full job description and an informal chat.. Excellent opportunity to kick start your career!
- Company Name
- Vertus Partners
- Job Title
- Python Developer - Greenfield - Analytics Platform - Cross Asset
- Job Description
- Python Developer - Greenfield - Analytics Platform - Cross Asset A leading Investment Bank are looking to buildout their new Analytics platform, which operates across all asset classes. They are looking for a Python Developer who can work on building out the core platform, including the backends for the UIs, focusing on build high performance architectures. You'll be taking requirements directly from the Sales team, with the bulk of your work seeing you code in Python, with a small portion also dedicated to Frontend development in React. This role sits directly in the business rather than in IT, meaning you'll have direct interaction with the Front Office. They can pay a base salary of up to £160k in this role, with a TC of around £230k. Please apply through this advert to hear more.
- Company Name
- Saragossa
- Job Title
- Data Engineer - Hedge Fund
- Job Description
- This hedge fund is known for its incredible use of technology, work life, and collaboration. You'll be someone who comes from a strong development background, working on ETLs and passionate about all things data related. You should come from an outstanding academic background and excellent data engineering skills, but haven't quite ventured into the hedge fund space. Why not make that move now? Join a firm that values your mind over your experience. Preferably, you're an expert with SQL and Python. If this sounds like you - get in touch. No up-to-date CV required.
- Company Name
- HCRG Care Group
- Job Title
- BI Developer
- Job Description
- Job Introduction With all the exciting changes happening due to business growth, we’re on the lookout for a talented and experienced BI Developer working remotely to build and maintain ETL (Extract, Transform and Load) processes on SQL Server using T-SQL and SQL Server Integration Services (SSIS) to achieve project goals, with the ultimate aim of providing better care for our patients! This is role is home based with the requirement to travel to the Runcorn Head office when needed. Main Responsibility Your main responsibilities will include: Building and maintaining ETL processes on SQL Server using T-SQL and SSIS to achieve project goals Designing and creating facts and dimensions in the Data Warehouse Interpreting complex business requirements and converting into robust data solutions Assisting with BAU tasks such as contractual Data Submissions to NHS England and NHS Digital Design and creation of relational databases and dimensional models Understand Health and Social Care data and the respective reporting requirements in order to perform collection, analysis, and submission of data. Understand the configuration and use of clinical and non-clinical systems used within the organisation. Provide input to projects and programs to ensure alignment with the data management principles, data models and procedures. Please see attached job description for full list of responsibilities. The Ideal Candidate Ideally we are looking for a passionate self-starter with demonstrable experience of the following: Essential: Degree in a relevant field or equivalent work experience. 5+ years of experience with SQL Server including advanced use of T-SQL 5+ years of experience developing solutions using SQL Server Integration Services (SSIS) Experience of using APIs to pull data Strong knowledge of data warehousing using facts and dimensions Experience with using reporting tools such as SSRS or Tableau Demonstrable ability to understand business requirements, data definitions and produce data management solutions that meet the needs of the business Self-motivated, enthusiastic, ability to work under pressure and prioritise workload in order to meet deadlines Desirable: Experience of working with NHS data Experience of using Azure DevOps Experience of using Redgate, Devart or similar tools Package Description As a BI Developer at HCRG Care Group you will be appreciated for your efforts and have access to exclusive rewards and benefits, including: Salary of between £45,000.00 to £50,000.00 with group pension Free tea and coffee at your base location Membership of My Reward Hub, giving you access to discounts on every day purchases like grocery shopping as well as cashback and voucher offers for treats for you and those special to you Access to your wages as you earn them to help cover life’s emergencies and avoid overdraft fees or high interest rates Online and face to face help with your mental and physical wellbeing – from healthy recipes and activity challenges through to post trauma support, legal, debt and life management help, as well career coaching and counselling Access to eLearning, bespoke career pathways and opportunities for continuing professional development through our ‘Outstanding’ learning and development team, The Learning Enterprise An open, just culture where you’re encouraged to have and implement ideas which can help us deliver our purpose: changing lives through transforming health and care – backed up by at least £100,000 of ringfenced innovation funding each year The pride of working for an organisation committed to the highest clinical and quality standards: with a majority of our rated services holding “good” or “outstanding” ratings from the Care Quality Commission About The Company We change lives by transforming health and care. Established in 2006, we are one of the UK's leading independent providers of community health and care services, working with health and care commissioners and communities to transform services with a focus on experience, efficiency and improved outcomes. We deliver and transform adult and children community health services, primary care services including urgent care, sexual health, dermatology and MSK services as well as adult social care and wellbeing services. Across England, we support communities of many millions and directly help more than half a million people each year - guided by our simple values: we care, we think, we do. We're committed to equal opportunities and welcome applications from a broad, diverse range of people who want to join our team. We’re a Disability Confident Committed company, so we work to provide facilities, work environment adjustments and technical solutions to be as inclusive of everyone. While it doesn’t happen often, sometimes a role is very popular, and we’ll need to close it earlier than the date we’ve shown here. If you’re keen to join our team, we’d love to hear from you so please apply as soon as you can. As you’d expect, safeguarding and protecting the children, young people and vulnerable adults that we work with is of the utmost importance so we have policies and procedures in place to promote safeguarding and safer working practices and everyone who joins the team is subject to a safer recruitment process, including the disclosure of criminal records and vetting checks. Finally, we need to let you know that the company you’ll work for is part of HCRG Care Group Holdings Limited and by applying for this job we’ll need to process and hold information about you. If you would like to know a little more about how we use your information, please see our website's privacy policy. Attached documents