ETL Developer
Hybrid
London, United Kingdom
Freelance
25-02-2025
Job Specifications
Job Title: ETL Developer (Python / Big Data Engineer)
Location: Hybrid (2-3 days in customer office)
Mode of Work: Hybrid work environment, with 2-3 days onsite at the customer office.
Type: Contract (Initial duration 6 months)
Job Description:
We are looking for an experienced ETL Developer with a strong background in Python development and Big Data technologies to join our team. As an ETL Developer, you will be responsible for the design, development, and implementation of data processing pipelines using Python, Spark, and other related technologies to handle large-scale data efficiently. You will also be involved in ensuring the integration of data into cloud environments such as Azure, alongside basic DevOps tasks and RDBMS fundamentals.
Responsibilities:
Develop and maintain ETL pipelines using Python for data extraction, transformation, and loading.
Utilize Apache Spark for big data processing to handle large datasets and optimize performance.
Work with cloud technologies, particularly Azure, to deploy and integrate data solutions.
Implement key Python concepts and leverage libraries/packages like Pandas, NumPy, and others for data manipulation.
Perform data integration tasks involving various data sources and structures.
Collaborate with cross-functional teams to design and implement robust, scalable data solutions.
Apply basic DevOps practices to manage and automate workflows within the ETL process.
Ensure best practices in database management and integration with RDBMS systems.
Participate in troubleshooting, optimization, and performance tuning of data processing systems.
Required Skills and Experience:
Proficient in Python with hands-on experience in key libraries (Pandas, NumPy, etc.) and a deep understanding of Python programming concepts.
Solid experience in Big Data Processing using Apache Spark for large-scale data handling.
Basic DevOps knowledge and familiarity with CI/CD pipelines for automating workflows.
Understanding of Azure Fundamentals and cloud data solutions.
Strong understanding of RDBMS database fundamentals (SQL, relational data modelling, etc.).
Previous experience in ETL development and data integration.
Senior/Lead level experience with hands-on development in relevant technologies.
Excellent problem-solving skills and ability to optimize data workflows.
Additional Desirable Skills:
Familiarity with cloud-based data storage and processing technologies in Azure.
Experience working in Agile or other collaborative development environments.
#ETL #contract #work #London #developer #hybrid
About the Company
Ntrinsic Consulting is a specialist talent business servicing the technology and business support sector across the UK and the Benelux Region. Placing the client at the epicentre of our strategy, we develop tailored solutions catered to unique challenges and realities of the business. We are dedicated to building long-lasting partnerships through bespoke, tailored services that allow us to showcase an understanding of our client’s business and the impact new hires can have on their projects. Ntrinsic Consulting is now part... Know more
Related Jobs
- Company Name
- Neuronic AI, Incorporated
- Job Title
- Technical Support Engineer
- Job Description
- Company Description Neuronic AI, Incorporated presents APIpie.ai, your gateway to global AI. It is the AI Super Aggregator and global load balancer for AI & LLM services, offering the fastest, least expensive, and most reliable AI solutions. This is an exciting opportunity to be part of a cutting-edge technology company revolutionizing the AI industry. See our discord for regular product updates: https://discord.gg/hs82THc9Tw Role Description This is a contract remote role for a Technical Support Engineer at Neuronic AI. The Technical Support Engineer will be responsible for providing technical support, troubleshooting issues, and delivering excellent customer support for AI & LLM services on a global scale. Qualifications Technical Support and Troubleshooting skills Analytical Skills for problem-solving Customer Support and Customer Service experience Excellent communication and interpersonal skills Ability to work independently and remotely Strong attention to detail and organizational skills Experience with AI technologies is a plus Bachelor's degree in Computer Science, Engineering, or related field Role not open to recruiters, agencies, or outsourcing.
- Company Name
- Robert Walters
- Job Title
- Java Developer - Payment
- Job Description
- Are you passionate about leveraging technology to solve business challenges in a dynamic and innovative environment? We are looking for a motivated Software Engineer to join our team and play a key role in delivering a highly visible, strategic initiative aimed at enabling new payment types and controls on a modern Cloud platform. Key Responsibilities: Design, develop, and deploy server-side Java microservices on Kubernetes. Work with Postgres and Azure SQL for database persistence. Contribute to the development of a cutting-edge web front-end with Angular. Implement inter-process communication using Kafka, Azure ServiceBus, and IBM MQ. Collaborate within a global Agile team to ensure successful delivery of payment solutions. Apply creativity and problem-solving skills to tackle complex business problems. Required Skills and Experience: At least 6+ years of experience in core Java application development. Experience with Test Driven Development (TDD) or Behaviour Driven Development (BDD) using frameworks like JUnit, Cucumber, or JBehave. Enthusiastic about learning new technologies and applying them to solve business challenges. Strong interpersonal and communication skills to collaborate with engineers, business stakeholders, and global team members. Proven track record of delivering distributed applications with minimal supervision in a fast-paced, dynamic environment. A passion for technology and a keen interest in keeping up with the latest developments in software and engineering practices. Experience contributing within a global Agile team. Desired Skills: Experience with Kafka or similar Pub/Sub or message queue technologies. Familiarity with Cloud-based software deployment on platforms like Azure. Strong SQL skills and experience querying relational databases. Knowledge of financial markets, asset classes, and particularly Payments is a plus. Flexible Working Options: We are committed to providing flexible work arrangements to empower employees to have greater freedom of choice in balancing their work and personal life. Speak with our recruitment team to learn more about flexible working opportunities available. If you're excited to be part of a forward-thinking team that values innovation, collaboration, and growth, we'd love to hear from you! We are committed to offering an inclusive recruitment experience. If you require accommodations because of disability or health condition, please email: gscemeaedi @ robertwalters.com. This position is being sourced through our Outsourcing service line.
- Company Name
- FDM Group
- Job Title
- Senior Software Engineer
- Job Description
- FDM is a global business and technology consultancy seeking a Senior Software Engineer to work for our client within the retail sector. This is initially a 12-month contract with the potential to extend and will be a hybrid role based in London. Our client is looking for a skilled Software Engineer with expertise in front-end development to join our engineering team. The ideal candidate will have a strong background in React, Next.js, and TypeScript, and experience integrating with third-party back ends. Responsibilities Develop and maintain user-facing features using React, Next.js, and TypeScript Collaborate with designers and back-end developers to implement and enhance web applications Ensure the technical feasibility of UI/UX designs by running iterative spikes Optimise applications for maximum speed and scalability Write clean, maintainable, and efficient code Integrate front-end components with third-party back-end services Participate in code reviews and contribute to team knowledge sharing Requirements Proven experience as a Front-End Developer or similar role Strong proficiency in JavaScript, including DOM manipulation and the JavaScript object model Thorough understanding of React.js and its core principles Experience with Next.js and server-side rendering Proficiency in TypeScript Familiarity with RESTful APIs and modern front-end build pipelines and tools Experience integrating with third-party back-end services Knowledge of modern authorisation mechanisms, such as JSON Web Token Familiarity with front-end testing frameworks and tools Why join us? Career coaching and access to upskilling throughout your entire FDM career Initial upskilling pre-assignment that has been accredited by TechSkills Assignments with global companies and opportunities to work abroad Opportunity to obtain certifications from Microsoft, Salesforce, Cisco and more Access to the Buy As You Earn share scheme About FDM We are a business and technology consultancy and one of the UK's leading employers, recruiting the brightest talent to become the innovators of tomorrow. We have centres across Europe, North America and Asia-Pacific, and a global workforce of over 4,000 Consultants. FDM has shown exponential growth throughout the years, firmly establishing itself as an award-winning employer and is listed on the FTSE4Good Index. Diversity and Inclusion FDM Group is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, colour, religion, sex, sexual orientation, national origin, age, disability, veteran status or any other status protected by federal, provincial or local laws.
- Company Name
- FDM Group
- Job Title
- Java Software Engineer
- Job Description
- FDM is a global business and technology consultancy seeking a Java Software Developer to work for our client within the finance sector. This is initially a 6-month contract with the potential to extend and will be a hybrid role that will be based in London. Our client is seeking an experienced Java Software Developer who has experience in Trade Capture, Settlements, Risk/PnL across any asset classes. The successful candidate will join a team of 8 developers working on the new Trade Capture and PnL platform which is written in Java17 and utilises Kubernetes, Kafka and Calypso. The goal of the project is to migrate all trade capture, lifecycle and PnL functionality from the existing legacy tech stack on to the new platform. Responsibilities Develop and maintain high-performance Java applications Deliver a result that will require little if any developer involvement post go-live Troubleshoot and optimise code to ensure efficiency and scalability Provide 3rd level support as and when required Proactively find the most pressing actions and confirm direction with the team Collaborate with people of all experience and abilities Share knowledge and best practice with those who need it and willingly learn from others Participate in all design discussions and contribute to its development Engage directly with people across the organisation, from technology infrastructure through to front office Requirements Strong working knowledge and experience with Java Demonstrable experience with Spring, ideally Spring Boot 3 Understanding of DB: MSSQL and Calypso Experience with Kafka and working on a system at scale Understanding of MicroService / Container with demonstrable experience on either on-prem or cloud-based orchestration platforms Experience working in a financial services environment, ideally cross-asset experience and a knowledge of structuring and trade lifecycle Knowledge of trade capture, settlements, risk/PnL across any asset classes Why join us? Career coaching and access to upskilling throughout your entire FDM career Initial upskilling pre-assignment that has been accredited by TechSkills Assignments with global companies and opportunities to work abroad Opportunity to obtain certifications from Microsoft, Salesforce, Cisco and more Access to the Buy As You Earn share scheme About FDM We are a business and technology consultancy and one of the UK's leading employers, recruiting the brightest talent to become the innovators of tomorrow. We have centres across Europe, North America and Asia-Pacific, and a global workforce of over 4,000 Consultants. FDM has shown exponential growth throughout the years, firmly establishing itself as an award-winning employer and is listed on the FTSE4Good Index. Diversity and Inclusion FDM Group is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, colour, religion, sex, sexual orientation, national origin, age, disability, veteran status or any other status protected by federal, provincial or local laws.