Lead Data Engineer
On site
Newcastle Upon Tyne, United Kingdom
Freelance
21-11-2024
Job Specifications
Job Title: Lead Data Engineer Job Description
We are looking to build a greenfield team to create a new data platform. Currently, we are in a proof of concept/prototype phase, testing various tools to understand their capabilities. The goal is to ensure efficient connection to different data sources, effective monitoring, and alerting. This will improve efficiency and enable better integration with third parties using similar tools. We need a Lead Data Engineer to guide the team and set standards for frameworks, best practices, and documentation. Responsibilities
Lead the development team by example and upskill others.
Set standards for development frameworks, best practices, and documentation.
Collaborate with ETL Developers, Architects, and Infrastructure teams.
Ensure effective documentation and understanding of development patterns.
Consult and work closely with the team to ensure a suitable development environment.
Understand and guide monitoring and logging practices, although hands-on Terraform work will be handled by the infrastructure team. Essential Skills
Experience with AWS (Step Functions, Glue, Lambdas, EventBridge)
Proficiency in Python
Strong background in SDLC and Data Platform experience Additional Skills & Qualifications
Experience with New Relic and Sumo Logic
Familiarity with CI/CD tools (Terraform, Github)
Experience with Snowflake
Agile working practices, particularly Kanban (they work in 2-week sprints) Why Work Here?
Our company offers a fully remote role with the potential for occasional travel to the Newcastle office, providing opportunities for collaboration and upskilling the team. We offer agile working practices in a large tech company environment. Work Environment
This role is fully remote, with the potential for occasional travel to the Newcastle office. The initial contract is for 3 months, with scope to extend beyond. The team works in 2-week sprints using Agile and Kanban practices. Job Type & Location
This is a Contract position based out of Newcastle Upon Tyne, United Kingdom. Location
Newcastle upon Tyne, UK
Trading as TEKsystems. Allegis Group Limited, Bracknell, RG12 1RT, United Kingdom. No. 2876353. Allegis Group Limited operates as an Employment Business and Employment Agency as set out in the Conduct of Employment Agencies and Employment Businesses Regulations 2003. TEKsystems is a company within the Allegis Group network of companies (collectively referred to as "Allegis Group"). Aerotek, Aston Carter, EASi, Talentis Solutions, TEKsystems, Stamford Consultants and The Stamford Group are Allegis Group brands. If you apply, your personal data will be processed as described in the Allegis Group Online Privacy Notice available at our website.
To access our Online Privacy Notice, which explains what information we may collect, use, share, and store about you, and describes your rights and choices about this, please go our website.
We are part of a global network of companies and as a result, the personal data you provide will be shared within Allegis Group and transferred and processed outside the UK, Switzerland and European Economic Area subject to the protections described in the Allegis Group Online Privacy Notice. We store personal data in the UK, EEA, Switzerland and the USA. If you would like to exercise your privacy rights, please visit the "Contacting Us" section of our Online Privacy Notice on our website for details on how to contact us. To protect your privacy and security, we may take steps to verify your identity, such as a password and user ID if there is an account associated with your request, or identifying information such as your address or date of birth, before proceeding with your request. commitments under the UK Data Protection Act, EU-U.S. Privacy Shield or the Swiss-U.S. Privacy Shield.
About the Company
We’re TEKsystems. We accelerate business transformation by solving complex technology, business and talent challenges—across the globe. We partner with 80% of the Fortune 500 to create solutions that enable them to capitalize on change. TEKsystems is an Allegis Group company. Know more
Related Jobs
- Company Name
- Bangura Solutions
- Job Title
- Technical Project Manager - Infrastructure, Database Migration, Oracle on prem, SC Cleared. £665
- Job Description
- Our client within the public sector requires a proven Technical Project Manager. Preferably coming from an infrastructure background. To help deliver a major transformation programme from its Legacy technology estate. You MUSThold active SC Clearance to be eligible for this role. Key requirements: Supplier management - working with multiple suppliers Good planner, problem solving, good assurance, good around governance 10+ years Project management experience (infrastructure PM ideally) Data base migrations/Oracle on premise Essential skills and experience: Proven ability to undertake detailed analysis of technical designs and provide the business with assurance of supplier designs and proposals. Capable of leading VFM challenges of technical proposals and manage technical interdependencies within a project/programme. Bridge the gap between the technical and non-technical by speaking on behalf of technical teams and facilitate relationships with indirect stakeholders. Experience across physical and cloud-based architectures. An understanding of operating systems and oracle products preferable. Understand how governance works and what governance is required by taking responsibility for the assurance of parts of a service and know what risks need to be managed. Good project management skills including planning and change management. Make decisions characterised by managed levels of risk and complexity and recommend decisions as risk and complexity increase. Resolve technical disputes between peers and indirect stakeholders, taking into account all views and opinions. Apply strategy, using patterns, standards, policies, roadmaps and vision statements, challenging them and providing guidance. Understand trends and practices outside your team and how these will impact your work. See how your work fits into the broader strategy and historical context and consider the patterns and interactions on a larger scale. Minorities, women, LGBTQ+ candidates, and individuals with disabilities are encouraged to apply. Interviews will take place next week, so please apply immediately to be considered for this exciting contract role or call Bangura Solutions to discuss this role further.
- Company Name
- Scope AT Limited
- Job Title
- Data Centre Engineer - Server, Dell, HP, IBM, Support
- Job Description
- Looking for a Data Centre Engineer on a Contract basis. Must have own transport and be able to travel to Camberley. Break fix server engineer working on HP, Dell and IBM Servers, Server provisioning, Rack, stack and configure Servers. London/Hybrid CONTRACT By applying to this job you are sending us your CV, which may contain personal information. Please refer to our Privacy Notice to understand how we process this information. In short, in order to supply you with work finding services, we will hold and process your personal data, and only with your express permission we will share this personal data with a client (or a third party working on behalf of the client) by email or by upload to the Client/third parties vendor management system. By giving us permission to send your CV to a client, this constitutes permission to share the personal data that would be necessary to consider your application, interview you (Phone/video/face to face) and if successful hire you. Scope AT acts as an employment agency for Permanent Recruitment and an employment business for the supply of temporary workers. By applying for this job you accept the Terms and Conditions, Data Protection Policy, Privacy Notice and Disclaimers which can be found at our website.
- Company Name
- Lorien
- Job Title
- MS Access Database Expert
- Job Description
- MS Access Database Expert We are currently hiring for a Database developer with MS Access experience to join one of our Insurance clients on a 4-week contract. Inside IR35 First week is Ipswich based Responsibilities: The role will require strong MS Access skills with a proven track record of building and maintaining MS Access databases in a business, public service or academic environment. Review existing databases and implement a general overhaul (eg identifying and deleting unused tables/forms/queries) Clone the database to perform a similar function for a difference business unit Work alongside colleagues using the database to drive reporting deliverables enabling them to identify and implement opportunities to deliver these services more effectively Experience: Strong technical skills; A pro-active approach and ability to plan their own work and sub-goals; MS Excel skills would complement their MS Access knowledge Insurance sector- desirable If this role is of interest to you or you would like to learn more, please apply now! Carbon60, Lorien & SRG - The Impellam Group STEM Portfolio are acting as an Employment Business in relation to this vacancy.
- Company Name
- Insight International (UK) Ltd.
- Job Title
- Business analyst - Customer Data programme
- Job Description
- Short Description of the Job Lead Business analyst in Customer Data programme, working with several stakeholders across the bank to deliver the prioritised outcomes Capture, validate and document business and system requirements and make sure that they are in line with key strategic principles and translated from business operations, business objectives or from external requirements Interrogate and interpret large volumes of data Conduct and support feasibility and solution options and impact analysis Translate user stories developed by Customer Journey Developers into technical requirements Support the organisation to achieve customer advocacy by eliciting and understanding the internal and external technology customer needs and analysing, refining, synthesising, translating, and ensuring they are documented in a form that can be readily understood by all stakeholders. Key Responsibilities Accountable for producing business requirements to inform future state design, supporting teams in understanding the requirements and their linkages to the overall domain strategy Accountable for writing business requirements and user stories and epics as required Responsible for understanding, challenging & developing our business, customers, strategic goals and how the teams operate to support the realisation of desired outcome by the team Work in continuous close collaboration with the business and the feature team ensuring transparency of vision and requirements Experience of coaching, mentoring, and managing junior colleagues Articulate and quantify business impacts in a tangible manner which allows stakeholders to make informed decisions and recommendations of priority for technical solution Manage the analysis of complex domain, cross franchise and pan group requirements for technology solutions Must have: Number of years of BA experience: 10+ Must have: Working in Banking industry Must have: Thorough analysis and good experience in data centralisation and creating single view of customer Nice to have: Across multiple processes and systems or franchises Nice to have: Understood and worked on Customer data previously