Scala Data Engineer
On site
Northampton, United Kingdom
Freelance
26-03-2025
Job Specifications
Job Description
Job Title: Scala Data Engineer
Location: Northampton
Salary: Up to £120,000 (12 Month Fixed-Term Contract)
About The Role
An exciting opportunity has arisen for an experienced Scala Data Engineer to join a leading data-driven organisation. This role focuses on big data engineering, cloud migration, and pipeline development, supporting large-scale data initiatives.
Key Responsibilities
Develop and maintain data pipelines using Scala, ensuring efficient data processing and transformation.
Lead the migration of Hadoop-based systems to cloud environments.
Work with big data technologies to optimise storage, processing, and retrieval.
Collaborate with cross-functional teams to ensure seamless data integration and performance.
Support the development of scalable and reliable ETL solutions within a cloud-first infrastructure.
Required Skills & Experience
Strong expertise in Scala within a data engineering context.
Hands-on experience with Apache Spark and Spark-Scala.
Proven track record of migrating data from Hadoop to cloud environments.
Proficiency in Big Data technologies, including AWS (S3, EMR, Glue ETL).
Strong understanding of ETL processes and data pipeline development.
Ability to work independently on Scala coding challenges, with a focus on logic and efficiency.
Working Arrangements
Hybrid model: Initial expectation of 2-3 days per week on-site (Northampton or Glasgow) for the first month, then proceeds to fully remote role with occasional travel.
Travel expenses may be covered for required on-site work.
If you are an experienced Scala Data Engineer looking for an exciting challenge, I'd love to hear from you. Apply now! Or reach out to me @t.goodwin@tenthrevolution.com
About the Company
As the global leaders in solving the technology skills gap, we find, train, and deploy experienced professionals, reskill your existing staff and deliver world-class consulting services, all through our unique range of talent solutions. What we do Find talent Permanent and contract recruitment for one role or an entire team Train talent Upskill existing employees via our training programs Deploy talent Access experienced professionals through our hire-train-deploy model Consulting services A new team or project support ... Know more
Related Jobs
- Company Name
- Simon James I.T. Ltd
- Job Title
- Azure Data Engineer - Service Bus
- Job Description
- Senior Data Engineer - Integration / Azure Service Bus London - Hybrid - 2 days: Wembley We’re looking for a Senior Data Engineer, with extensive Azure Service Bus, and DB Architecture, to define the system design on a project to improve data integration across a National Sports Organisation. The role will be a mix of hands-on development and assuring the quality of work produced by an offshore development team. You will also help define the system design and approach. You’ll have a hands-on skill set with Azure Service Bus, DB Architecture and real time ingestions frameworks Key Experience: System Design lead within a project Message Based Integration – Azure Service Bus MS SQL rational Databases with CDC Realtime / Batch processing Delivery of Non-functional requirements Logical Data Design Designing Schema’s for relational Databases Be the SME for integration related communication Strong stakeholder management and reporting skills Previous onshore/offshore management Tech Stack: Azure environment – Azure Data Factory C# (.NET Core), ASP.NET MVC, T-SQL Web API / REST Unit Testing, TDD, BDD IOC Frameworks: Autofac, StructureMap ORM Frameworks: Entity Framework, Dapper MCPD / MCSD Qualified The role will be a 5 month contract to start and extend based on performance, based in Wembley, hybrid with 2 days per week onsite (non-negotiable).
London, United Kingdom
Hybrid
Freelance
28-03-2025
- Company Name
- Sush Talent Limited
- Job Title
- Data Modeller (SQL)
- Job Description
- Job Title-Data Modeller (SQL) Client-Global Consulting Firm Day Rate-£375-£400 (Outside IR35) Duration-6 months (extendable) Location-London (Hybrid, 2 days in the office) Experience and Skills: · 10+ years of hands-on experience in data modeling, database architecture, or data engineering. · Expertise in SQL, including query optimization, indexing, partitioning, and stored procedures. · Deep understanding of relational and dimensional data modeling (normalization, denormalization, star/snowflake schema). · Proficiency with data modeling tools such as Erwin, ER/Studio, or equivalent. · Strong knowledge of banking and financial data structures, regulatory frameworks, and reporting standards. · Experience in data governance, metadata management, and data lineage tracking. · Familiarity with cloud data platforms (AWS Redshift, Azure Synapse, Google BigQuery, Snowflake). · Experience with ETL/ELT design, data integration, and data warehousing best practices. · Experience with risk and compliance data models (Basel III, IFRS 9/17, AML, BCBS 239). · Knowledge of Data Vault modeling and modern data warehouse/lakehouse architectures. . Certifications in data modeling, cloud databases, or data governance (CDMP, AWS/Azure certifications) are a plus.
London, United Kingdom
Hybrid
Freelance
28-03-2025
- Company Name
- NHS Counter Fraud Authority
- Job Title
- Data Analyst
- Job Description
- Job Summary The NHS Counter Fraud Authority is the national body responsible for all matters relating to the prevention, detection and investigation of economic crime across the NHS. Further information about our work and annual plan for delivering this is available on our website. Our new team are embarking on a piece of work to monitor data to identify and respond to patterns indicative of potential fraud. This will support our current work that reduces the likelihood of fraud occurring. We will bring in data science capabilities to be deployed in counter fraud activity and work closely with partners across health and government to further maximise the preventative impact of proactive counter fraud analysis. We will combine this with our range of counter fraud and domain expertise to maximise our impact using your knowledge, experience, and passion for your chosen field. This role offers a unique opportunity to use data analysis to detect and prevent fraud within the NHS, directly impacting patient care and public funds. You'll work with advanced analytics tools like Python, R, SQL, and Alteryx to uncover hidden patterns and anomalies. Join a collaborative team where your insights drive real-world action against financial crime. Potential applicants can contact Santosh Kumar at santosh.kumar@nhscfa.gov.uk for an informal chat if you have any questions regarding the role. Main duties of the job The role of the data analyst plays a key role within the programme of work, providing a comprehensive data and information expertise to the team in support the work undertaken together within the data science and respond team. The successful candidate will liaise with internal and external stakeholders to examine anomalies and patterns within data which could be indicative of fraud, being responsible for delivery of their workstream, including collating data, defining, and developing methodologies and producing actionable insight across several areas of concern. The post holder will be required to have a NPPV2. About Us We have offices based in Coventry, Newcastle and London and offer flexible, hybrid, office and home-based working. In addition to the advertised salary working in the London area will attract High-Cost Area Supplement where appropriate. The NHSCFA values and respects the diversity of its employees and aims to recruit a workforce which reflects our diverse communities. We welcome applications irrespective of people's age, disability, gender, race or ethnicity, religion or belief, sexual orientation, or other personal circumstances. We have policies and procedures in place to ensure that all applicants are treated fairly and consistently at every stage of the recruitment process, including an invitation to the first stage of the selection process and consideration of reasonable adjustments for people who have a disability. If you are applying to undertake this role on a secondment basis you should have agreement to being released from your current role in principle, prior to submitting an application form. When you apply for this role, you will be redirected to our recruitment system TRAC. The NHSCFA does not hold a sponsor licence in respect of skilled worker visas and so is unable to employ candidates requiring sponsorship. We reserve the right to close this vacancy before the advertised closing date should we receive a significant number of applications. Date posted 28 March 2025 Pay scheme Agenda for change Band Band 5 Salary £29,970 to £36,483 a year Contract Fixed term Duration 12 months Working pattern Full-time, Home or remote working Reference number TEMP_500 Job locations 7th Floor, HM Government Hub 10 South Colonnade, Canary Wharf London E14 4PU Job Description Job responsibilities To work as part of the programme of work and provide support in delivering NHS CFAs objectives. Providing an analytical service to all parts of the organisation by analysing data, interpreting, and reporting on the results. Undertaking complex statistical analyses requiring accuracy, attention to detail and frequent, prolonged periods of concentration. Communicating analytical and statistical matters to non-analytical/statistical professionals, offering advice and persuasion on statistical techniques. Dealing with statistical and analytical queries, assessing whether analyses are robust e.g., investigating data anomalies identified during analyses. Establishing deadlines and provide on-going communication of progress to keep projects on track and on time. Responsibilities Job description Job responsibilities Please see full Job Description and Person Specification To work as part of the programme of work and provide support in delivering NHS CFAs objectives. Providing an analytical service to all parts of the organisation by analysing data, interpreting, and reporting on the results. Undertaking complex statistical analyses requiring accuracy, attention to detail and frequent, prolonged periods of concentration. Communicating analytical and statistical matters to non-analytical/statistical professionals, offering advice and persuasion on statistical techniques. Dealing with statistical and analytical queries, assessing whether analyses are robust e.g., investigating data anomalies identified during analyses. Establishing deadlines and provide on-going communication of progress to keep projects on track and on time. Please See Full Job Description And Person Specification Person Specification Knowledge And Experience Essential Significant experience of using a range of statistical, numerical, and analytical techniques to analyse data and ability to work with: NHS Specific Data. Structured and unstructured data. Dynamic ETL processes and scripts. Raw data to transform into useful formats specific to a business problem. Key transactional organisation data sets to produce products that support Performance Management Reporting and statistical insights at all levels. Key transactional organisation data sets to produce external benchmarking products. Appropriate mediums to visualise data to show compelling actionable products for internal and external stakeholders. Demonstrable experience in managing deadlines and prioritising workloads. Desirable Significant experience of using a range of statistical, numerical, and analytical techniques to analyse data and ability to work with: NHS Specific Data. Structured and unstructured data. Dynamic ETL processes and scripts. Raw data to transform into useful formats specific to a business problem. Key transactional organisation data sets to produce products that support Performance Management Reporting and statistical insights at all levels. Key transactional organisation data sets to produce external benchmarking products. Appropriate mediums to visualise data to show compelling actionable products for internal and external stakeholders. Demonstrable experience in managing deadlines...
London, United Kingdom
On site
Freelance
30-03-2025
- Company Name
- Insight International (UK) Ltd.
- Job Title
- Snowflake Data Engineer
- Job Description
- Role- Snowflake Data Engineer Location- Luton, UK (Hybrid) Employment type - Contract Job Description: The ideal candidate with a minimum of 5 +years of experience having strong experience working with Snowflake, DBT, Python, and AWS to deliver ETL/ELT Pipelines using different resources. • Proficiency in Snowflake data warehouse architecture Design, build, and optimize ETL/ELT pipelines using DBT (Data Build Tool) and Snowflake. • Experience with DBT (Data Build Tool) for data transformation and modelling. Implement data transformation workflows using DBT (core/cloud). • Strong Python programming skills for automation and data processing. Leverage Python to create automation scripts and optimize data processing tasks. • Proficiency in SQL performance tuning, and query optimization techniques using snowflake. • Troubleshoot and optimize DBT models, and Snowflake performance. • Knowledge of CI/CD, version control (Git) tools. Experience with orchestration tools such as Airflow, • Strong analytical and problem-solving skills with an ability to work in agile development environment independently. • Ensure data quality, reliability, and consistency across different environments. • Collaborate with other data engineers, data analysts, and business stakeholders to understand data needs and translate them into engineering solutions. • Certification in AWS, Snowflake, or DBT is a plus.
Luton, United Kingdom
Hybrid
Freelance
28-03-2025