Data Engineer

Hybrid

Newcastle Upon Tyne, United Kingdom

£ 80 / hour

Freelance

21-01-2025

Share this job:

Score my CV

Job Specifications

Data Engineer (Contract) – Security Cleared
We are seeking a highly skilled and motivated Data Engineer on a contract basis with expertise in Databricks to join our dynamic team, offering an exciting opportunity to contribute to critical projects within public sector. The ideal candidate will be a self-starter, driven, and an excellent communicator who thrives in a fast-paced environment.
Key Responsibilities
Develop and maintain data pipelines and ETL processes using Databricks.
Ensure data quality, security, and compliance in line with public sector standards.
Collaborate with teams to deliver actionable insights and optimize data workflows.

Essential Skills
Extensive experience with Databricks and Apache Spark.
Strong proficiency in Python, SQL, and cloud platforms (e.g., Azure, AWS).
Proven track record as a self-starter and strong communicator.

About the Company

We are Apprilis; user-inspired digital transformation and cloud consultancy specialists, guided by principles of empathy, engagement, and excellence. Since 2019, we've been on a mission to help our public sector partners realise their ambitions of creating a better service for end users. Whilst we work very closely with many vendors and technologies, our independence empowers our expert teams to offer truly agnostic and unbiased advice, resulting in true value for money and a completely tailored experience. To find out mo... Know more

Related Jobs

Company Name: Entasis Partners
Job Title: Lead Data Engineer
Job Description: Data Engineering Lead (Credit Risk, Cloud Migration) Location: City of London (2-3 days onsite) Start Date: ASAP Inside IR35 Unfortunately we are not able to offer visa sponsorship for this role Entasis Partners has been engaged by a specialist consultancy on a major programme to migrate critical IRB risk models from a legacy platform to the cloud (GCP, AWS). We’re assembling a team of Data Engineering Leads to drive this transformation, managing both onshore and offshore engineering Key Responsibilities: Lead data engineering teams in building and migrating risk models to target cloud platforms. Design and develop processes to integrate various data sources related to credit risk, ensuring data quality and consistency. Build and maintain scalable data pipelines to support the ingestion, transformation, and loading of data into credit risk models. Manage and optimise databases and data warehouses to store large volumes of credit risk data, ensuring efficient querying and retrieval. Develop automated workflows to streamline data processing tasks and reduce manual intervention, increasing efficiency and accuracy. Work closely with credit risk modellers to understand data requirements and provide the necessary datasets and tools for model development and validation. Solve lineage issues and ensure compliance with BS239 standards. Collaborate with strategy analysts who code, ensuring models are fit for purpose. Manage a distributed team across India and Poland, balancing execution and iteration. Required Skills & Experience: Technical: Python, Java, SQL, Hadoop, Apache ecosystem, GCP, AWS (Scala a plus). Banking & Risk: Strong knowledge of IRB models and credit risk frameworks Leadership: Experience managing distributed engineering teams in an agile environment. Mindset: Critical thinkers who challenge the norm—not just backlog processors. Imperfect environments - Experience of working in a complex FS environment—think classic spaghetti architecture. Prior experience with Palantir or similar platforms is a plus. This is a dynamic, fast-moving engagement. If you're interested, apply now—interviews early next week.

London, United Kingdom

Hybrid

Freelance

30-01-2025

Company Name: Mirai Talent
Job Title: Data Engineer
Job Description: Data Engineer – Professional Services, Manchester We are seeking a talented Data Engineer to join our dynamic professional services team based in Manchester. This role offers the opportunity to work in a highly regulated environment where data accuracy and security are paramount. You will play a pivotal role in analysing, documenting, and implementing data solutions that empower analytics and drive business insight. What you’ll be doing: Build and maintain data warehouses on the Azure Data Stack, ensuring a single source of truth for consistent and efficient business reporting. Collaborate with multiple business units (Finance, Risk, Compliance, Operations, Actuarial, and more) to collect, balance, and update data through repeatable and automated processes. Work closely with IT and business stakeholders to produce accurate Management Information and automate data flows, including reconciliations with key departments. Develop and maintain regulatory/statutory reporting tools through automation of data retrieval and reporting forms. Ensure robust data security controls in collaboration with IT teams. Support automation initiatives across the business to drive operational efficiency. Maintain compliance with all relevant UK and international statutory and regulatory obligations related to the role. What you can bring: Strong expertise in SQL and experience with the Azure Data Stack (Azure Data Lake, Azure Data Factory, Databricks, Synapse Analytics, etc.). Knowledge of BI tools such as Power BI. Familiarity with VBA, R, or Python would be advantageous. Excellent Excel, Word, and Access skills. Strong communication and presentation abilities. Exceptional attention to detail and organisational skills. Proven experience working in a highly regulated industry. Bachelor’s degree in a quantitative field such as Computer Science, Mathematics, Actuarial Science, or similar. 3-5 years of experience working with analytical teams (e.g., Actuarial, Finance, Risk o Legal). What’s in it for you? Competitive salary package. Up to 10% performance-based bonus. Private health and medical care. Opportunities for career progression and personal development. A supportive, collaborative, and inclusive work culture. Join us and be part of a forward-thinking professional services firm where data drives decision-making and innovation. Mirai is committed to building a diverse and inclusive workplace. We value different perspectives and actively seek to attract a wide range of talent. We encourage applications from all qualified candidates, regardless of race, gender, disability, age, sexual orientation, gender identity, or any other characteristic.

Manchester, United Kingdom

Remote

Freelance

31-01-2025

Company Name: Aquent
Job Title: B2B Marketing Analytics Manager
Job Description: Job Title: B2B Marketing Analytics Manager Client Location: London - hybrid Starting: March 2025 Salary/Pay Rate: £94,9k pa pro rata (PAYE) Hours: Full-time; 35-hour week Duration: 12 months Responsibilities: Explore client's data infrastructure, extract necessary data, perform data analysis, and visualise findings to understand key marketing patterns and trends, developing compelling data-driven stories. Summarise analysis on customer needs, product positioning, campaign performance, market trends, and competition in regular, actionable, and engaging business updates. Communicate the story behind the numbers to a variety of business partners, influencing and inspiring corrective actions in business strategy. Acquire, summarise, and circulate key takeaways from primary research and market trend analysis, working closely with the marketing research team. Bring key marketing insights to life to drive account penetration and upsell motions, enhancing customer lifetime value (LTV). Understand and communicate what drives performance and identify opportunities for product marketing messaging. Partner with the marketing team to create data-driven campaigns that optimise prospect conversion. Build feedback loops to highlight knowledge gaps and drive future analysis and research. Skills: Strong knowledge of B2B marketing and sales is essential. Excellent communication and presentation skills are a key requirement. Proficient in data analysis, with a passion for uncovering significant patterns and meaningful insights. A proactive self-starter with a continuous learning mindset, capable of working in a virtual environment. Exceptional attention to detail, ability to manage multiple datasets and data requests, and flexibility to respond quickly and meticulously. Ability to manage stakeholders (Director+ level) autonomously and navigate a matrix environment across time zones. Proficiency in CRM tools (e.g., Salesforce or Microsoft Dynamics) is mandatory. Experience in data visualisation is required, with Power BI strongly preferred. Proficiency in SQL, Hive, or Azure Databricks is highly desirable. Education & Experience: 5+ years of relevant work experience in Data Analytics, Consulting, or Marketing Analytics. Experience in B2B SaaS marketing and sales analytics is highly preferred. An MBA is preferred. If this sounds like you, contact the Aquent team today! The next steps will be shared with shortlisted candidates. Thank you for taking the time to apply. Client Description: A multinational cloud-based software company specialising in a series of products designed to drive creative innovation across multimedia. Used by millions around the world for personal and professional use across all industries. Aquent is dedicated to improving inclusivity & is proudly an equal opportunities employer. We encourage applications from under-represented groups & are committed to providing support to applicants with disabilities. We aim to provide reasonable accommodation for any part of the employment process, to those with a medical condition, disability or neurodivergence.

London, United Kingdom

On site

Freelance

30-01-2025

Company Name: Global Resourcing
Job Title: Senior Data Architect
Job Description: Principal Data Architect Initial 6 month contract, flexible daily rate, inside IR35, 4 days per week onsite in London, DV Clearance Required We are seeking an experienced Data Architect to lead the development and delivery of innovative data architecture strategies. This role offers the opportunity to influence and shape data architecture for our clients, driving change and delivering key capabilities. Key Responsibilities: Own and lead the data architecture vision, strategy, and roadmaps. Define policies, standards, and guidelines for data strategy and planning. Manage the development, communication, and review of business strategies. Lead the design, modeling, and analysis of data structures and ensure adherence to data standards. Provide guidance and mentorship to teams on data architecture best practices. Collaborate with internal teams and clients to ensure alignment with data architecture strategy. Essential Competencies: Proven experience with Enterprise Architecture frameworks like TOGAF or Zachman. Skilled in architectural modeling tools such as Sparx Enterprise Architect. TOGAF certification with hands-on application experience. Strong communication and consultancy skills with senior stakeholders. Ability to quickly build customer trust and intimacy. Please note, we can only consider candidates with active DV Clearance at this time.

London, United Kingdom

Remote

Freelance

29-01-2025