Data Engineer - (Active SC Needed!)
Remote
United Kingdom
Freelance
26-11-2024
Job Specifications
Our client are a top tier consultancy looking for a Data Engineer with Active SC on a 6 months contract.
Job Description:
3-5 years experience
Listen to the needs of technical and business stakeholders, and interpret them
effectively manage stakeholder expectations
manage active and reactive communication
support or host difficult discussions within the team or with diverse senior stakeholders
understand and help teams to apply a range of techniques for data profiling
source system analysis from a complex single source
bring multiple data sources together in a conformed model for analysis
establish enterprise-scale data integration procedures across the data development life cycle, and ensure that teams adhere to them
manage resources to ensure that data services work effectively at an enterprise level
identify areas of innovation in data tools and techniques, and recognise appropriate timing for adoption
establish standards, keep them up to date and ensure adherence to them
keep abreast of best practice in industry and across government
understand the concepts and principles of data modelling and can produce relevant data models
work across government and industry, recognising opportunities for the reuse and alignment of data models in different organisations
design the method to categorise data models within an organisation
design an appropriate metadata repository and present changes to existing metadata repositories
understand a range of tools for storing and working with metadata
provide oversight and advice to more inexperienced members of the team
ensure that the most appropriate actions are taken to resolve problems as they occur
co-ordinate teams to resolve problems and to implement solutions and preventative measures
use agreed standards and tools to design, code, test, correct and document moderate-to-complex programs and scripts from agreed specifications and subsequent iterations
collaborate with others to review specifications where appropriate
show a thorough understanding of the technical concepts required for the role, and can explain how these fit into the wider technical landscape
review requirements and specifications, and define test conditions
identify issues and risks associated with work
analyse and report test activities and results
Key Technical Skills AWS: S3, Lambda, EMR, SMS, SQS, and additional services related to data infrastructure Terraform Databricks Kafka Data Lake, Warehouse, Lakehouse architecture and design Python/Pyspark Data platforms and notebooks: Jupyter, Databricks, Azure Gitlab: repository and CI/CD Java (Spring Boot) experience is a plus
About the Company
We are a Digital, Data and Cloud technology consultancy, specialising in delivering solutions to clients across financial services, government, management consulting/outsourcing, media and broadcasting. Our extensive experience allows us to provide a specialised, individually tailored service backed by consultants that have industry specific knowledge to better understand your needs. Our expertise are complemented by the use of leading-edge technologies. We work with some of the UK's leading companies, as well as being reta... Know more
Related Jobs
- Company Name
- McGregor Boyall
- Job Title
- Data Governance & Analytics Lead
- Job Description
- Major Investment bank seeks Data Governance & Analytics Lead to design and implement data quality procedures, governance models, and analytics strategies. £575 per day Inside IR35 Intial contract runs until 01/12/2025 Canary Wharf office attendance 3 days a week Responsibilities Lead the creation of a data governance framework for Markets Operations. Ensure data accuracy, consistency, and remediation of critical data elements. Drive delivery of complex, multi-geography data programs. Collaborate with global stakeholders across Operations, Technology, and Markets teams. Required Qualifications Proven experience in large-scale transformation projects as a Business Analyst or Project Manager. Deep understanding of Global Markets products (Fixed Income, Equities, FX, Derivatives). Expertise in data governance, analytics, and modern technologies. Strong leadership, communication, and organizational skills. McGregor Boyall is an equal opportunity employer and do not discriminate on any grounds.
- Company Name
- McGregor Boyall
- Job Title
- Data Engineer
- Job Description
- One of our public sector clients is looking for an experienced Data Engineer to join their team to assist with the development of Data Warehouse products. Essential experience: Python, PostgreSQL, REST APIs, Modern DevOps and CI/CD practices and tooling including Docker, GitLab CI, AWS Code Pipeline, AWS CDK and AWS CloudFormation Expertise in SQL, data transformation and analysis Delivering high quality software collaboratively in high-performing, cross-functional development teams. Experience implementing data ETLs, data streaming systems and data integration solutions Experience working in the Agile delivery models - such as Scrum and/or Kanban frameworks. Additional desirable experience: Data warehousing Hybrid on-premises/cloud solutions AWS Glue, Step Functions, Lambda functions, S3, RDS, Data Migration Service Using testing tools for unit testing, including system test automation frameworks OpenShift Post GIS for PostgreSQL Designing and implementing solutions using service and event-based architectures Monitoring, alerting, intelligence tools and processes, including Grafana Human-centered, research-driven, inclusive design practices TDD This is a 6-month contract with possible extensions. Remote contract, with the rare visit to Edinburgh/Glasgow office. Paying a day rate circa £420 (outside ir35) If interested, please apply via the ad. McGregor Boyall is an equal opportunity employer and do not discriminate on any grounds.
- Company Name
- EXPERIS IT SERVICES US, LLC
- Job Title
- IAM Data Analyst
- Job Description
- Role Title:IAM Data Analyst Duration:contract to run until 30/04/2025 Location:Knutsford, hybrid 2-3 days in the office Rate:up to £496.13 p/d Umbrella Role purpose/summary We are seeking a detail-oriented and analytical IAM Data Analyst to join CSO Identity and Access Management (IAM) team. The IAM Data Analyst will be responsible for analysing, interpreting, and managing access data to ensure secure, compliant, and efficient access controls are in place. You will collaborate with internal CSO stakeholders, including CSO IAM teams, CCO, and BIA, to enhance access management processes and contribute to the overall security posture of the organization Key Skills/requirements Key Responsibilities Analyze IAM data to identify patterns, trends, and anomalies. Develop and generate regular and ad-hoc reports for compliance, audit, and risk management purposes. Establish and maintain data quality standards related to IAM. Ensure accurate and consistent data entry, storage, and retrieval in IAM systems. Identify opportunities for automating IAM processes and workflows to enhance efficiency and reduce the risk of errors. Monitor and analyze user access rights, ensuring that the appropriate level of access is maintained across various platforms, applications, and systems. Support the management of user identities across the entire life cycle, including provisioning, de-provisioning, and role-based access controls (RBAC). 3-5 years of experience in IAM, data analytics, or information security, preferably within a financial institution or regulated industry. Technical Skills: Proficiency in SQL, Excel, and data visualization tools (eg, Power BI, Tableau). Familiarity with IAM tools (eg, SailPoint, Ping Identity) and process. Experience in analysing large set of IAM Data. Knowledge of cybersecurity best practices and regulatory frameworks. Analytical Skills: Strong problem-solving and analytical thinking abilities with a focus on data accuracy and interpretation. Communication: Strong verbal and written communication skills, with the ability to explain technical concepts to non-technical stakeholders. All profiles will be reviewed against the required skills and experience. Due to the high number of applications we will only be able to respond to successful applicants in the first instance. We thank you for your interest and the time taken to apply!
- Company Name
- EXPERIS IT SERVICES US, LLC
- Job Title
- SC Data Engineer - CGEMJP00276586
- Job Description
- Role Title:Data Engineer Duration:contract to run until 31/03/2025 Location:Remote but potentially one day a month in Newcastle Upon Tyne Rate:up to £623.70 p/d Umbrella inside IR35 Clearance required:Active SC Job Description: 3-5 years experience Listen to the needs of technical and business stakeholders, and interpret them Effectively manage stakeholder expectations Manage active and reactive communication Support or host difficult discussions within the team or with diverse senior stakeholders Understand and help teams to apply a range of techniques for data profiling Source system analysis from a complex single source Bring multiple data sources together in a conformed model for analysis Establish enterprise-scale data integration procedures across the data development life cycle, and ensure that teams adhere to them Manage resources to ensure that data services work effectively at an enterprise level Identify areas of innovation in data tools and techniques, and recognise appropriate timing for adoption Establish standards, keep them up to date and ensure adherence to them Keep abreast of best practice in industry and across government Understand the concepts and principles of data modelling and can produce relevant data models Work across government and industry, recognising opportunities for the reuse and alignment of data models in different organisations Design the method to categorise data models within an organisation Design an appropriate metadata repository and present changes to existing metadata repositories Understand a range of tools for storing and working with metadata Provide oversight and advice to more inexperienced members of the team Ensure that the most appropriate actions are taken to resolve problems as they occur Co-ordinate teams to resolve problems and to implement solutions and preventative measures Use agreed standards and tools to design, code, test, correct and document moderate-to-complex programs and scripts from agreed specifications and subsequent iterations Collaborate with others to review specifications where appropriate Show a thorough understanding of the technical concepts required for the role, and can explain how these fit into the wider technical landscape Review requirements and specifications, and define test conditions Identify issues and risks associated with work Analyse and report test activities and results Key Technical Skills * AWS: S3, Lambda, EMR, SMS, SQS, and additional services related to data infrastructure. Terraform. Databricks. Kafka. Data Lake, Warehouse, Lakehouse architecture and design. Python/Pyspark. Data platforms and notebooks: Jupyter, Databricks, Azure. Gitlab: repository and CI/CD. Java (Spring Boot) experience is a plus All profiles will be reviewed against the required skills and experience. Due to the high number of applications we will only be able to respond to successful applicants in the first instance. We thank you for your interest and the time taken to apply!