Data Engineer
Hybrid
England, United Kingdom
Freelance
18-03-2025
Job Specifications
Data Engineer (Security Cleared)
Location – Northern Ireland (Belfast) If based in the UK candidates must be willing to frequently travel to Northern Ireland.
Contract – 6 Months
Day rate – Flexible (Inside IR35)
Your responsibilities in the role
Design and implement efficient data ingestion pipelines to and from databases and file storage services.
Transform data from source to target to ensure data quality and consistency, based in agreed specifications.
Build, maintain and optimise data pipelines to automate data flows and enable real time data processing.
Monitor data quality and implement measures to ensure data accuracy and completeness.
Manage and maintain databases to ensure optimal performance and security.
Deploy and manage data infrastructure on cloud platforms – primarily AWS
Work closely with data analysts, data scientists, and other stakeholders to understand their data needs and deliver high-quality data solutions.
Skills and Experience
AWS focused, Ideally a AWS Certified Data Engineer.
SQL, Python, and Spark and experience with metadata-driven ETL/ELT.
AWS Glue, Databrew, S3, AWS Lambda, PostgreSQL, Quicksight.
Version Control (Gitlab), CI/CD and IaC.
Familiar with security and networking principles, especially in AWS deployment.
Experience and understanding of handling both structured and unstructured data.
Complex data migrations.
Strong problem-solving analytical skills.
Excellent communication and collaboration skills.
Understanding of GIS data models.
Further information required upon application
About the Company
Our ambition is to work with IT solutions businesses and end clients to deliver outstanding IT resource. We are passionate about being the first choice for exceptional contractors and candidates seeking new opportunities. We also attract the most talented people seeking a personally rewarding career in IT recruitment. Our teams are passionate about what they do and this shows in their work. Our consultants are dedicated to building relationships with both clients and contractors. ECS has gone from strength to strength by co... Know more
Related Jobs
- Company Name
- DataAnnotation
- Job Title
- Biology Instructor - AI Trainer
- Job Description
- We are looking for a *biology instructor* to join our team to train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each model. Scroll down for a complete overview of what this job will require Are you the right candidate for this opportunity In this role you will need to hold an expert understanding of biology- a completed or in progress Masters/PhD is preferred but not required. Other related fields include, but are not limited to: Microbiology, Cell Biology, Genetics, Physiology, Biochemistry, Molecular Biology, Biotechnology, Environmental Science. Benefits This is a full-time or part-time REMOTE position You’ll be able to choose which projects you want to work on You can work on your own schedule Projects are paid hourly starting at $40+ USD per hour, with bonuses on high-quality and high-volume work Responsibilities Give AI chatbots diverse and complex biology problems and evaluate their outputs Evaluate the quality produced by AI models for correctness and performance Qualifications A current, in progress, or completed Masters and/or PhD is preferred but not required Fluency in English (native or bilingual level) Detail-oriented Proficient in biology and inductive/deductive reasoning, experimental design, data interpretation, and systems-level thinking. Note: Payment is made via PayPal. We will never ask for any money from you. #INDUKBIO Job Types: Full-time, Part-time Pay: From £31.61 per hour Location: London (preferred) Work Location: Remote
- Company Name
- W3Global
- Job Title
- Data Analyst
- Job Description
- Location: London, UK (Hybrid) Primary Skills Analyse API data to understand compliance to data standards and highlight areas for improvement. Develop insights from API data and usage patterns to showcase value and drive strategic decisions. Create reports and dashboards to track adoption KPIs and communicate results to senior stakeholders. Provide recommendations for improving metadata quality and API discoverability based on data insights.
- Company Name
- DataAnnotation
- Job Title
- Biology Lecturer - AI Trainer
- Job Description
- We are looking for a *biology lecturer* to join our team to train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each model. Scroll down for a complete overview of what this job will require Are you the right candidate for this opportunity In this role you will need to hold an expert understanding of biology- a completed or in progress Masters/PhD is preferred but not required. Other related fields include, but are not limited to: Microbiology, Cell Biology, Genetics, Physiology, Biochemistry, Molecular Biology, Biotechnology, Environmental Science. Benefits This is a full-time or part-time REMOTE position You’ll be able to choose which projects you want to work on You can work on your own schedule Projects are paid hourly starting at $40+ USD per hour, with bonuses on high-quality and high-volume work Responsibilities Give AI chatbots diverse and complex biology problems and evaluate their outputs Evaluate the quality produced by AI models for correctness and performance Qualifications A current, in progress, or completed Masters and/or PhD is preferred but not required Fluency in English (native or bilingual level) Detail-oriented Proficient in biology and inductive/deductive reasoning, experimental design, data interpretation, and systems-level thinking. Note: Payment is made via PayPal. We will never ask for any money from you. #INDUKBIO Job Types: Full-time, Part-time Pay: From £31.61 per hour Location: Coventry (preferred) Work Location: Remote
- Company Name
- TESTQ Technologies Limited
- Job Title
- Oracle Database Engineer
- Job Description
- Need 2-3 day's onsite per week. Requirements Experience with Oracle database administration, including installation, configuration, backup and recovery and performance tuning. Strong knowledge of Jenkins, including setup, configuration, and management of CI/CD pipelines. Proficiency in Ansible for automation of infrastructure and application deployment. Proven experience as a vSphere Engineer, with hands-on experience in designing, implementing, and managing vSphere environments specially around Oracle database servers. Solid understanding of networking concepts, storage solutions, and virtualization technologies. Excellent problem-solving skills and the ability to work under pressure. Strong communication and collaboration skills. Relevant certifications (e.g., Oracle Certified Professional, VMware Certified Professional etc.) are a plus. Preferred Qualifications Experience with other automation tools and scripting languages (e.g., Python, Shell Scripting). Familiarity with cloud platforms (e.g., OCI). Experience with containerization technologies (e.g., Docker, Kubernetes).