Kafka Real Time Architect
Hybrid
Leeds, United Kingdom
Freelance
23-04-2025
Job Specifications
Job Description:
Mandatory Skills: Ansible Tower
Experience: 5-8 Years
A Kafka Real-Time Architect is responsible for designing and implementing scalable, real time data processing systems in Kafka. This role involves architecting Kafka cluster, ensuring high availability, and integrating with other data processing tools and platforms
As part of the CTO Data Ingestion Service, the incumbent will be required to:
Designing and architecting scalable, real-time systems in Kafka.
Configuring, deploying, and maintaining Kafka clusters to ensure high availability and scalability.
Integrating Kafka with other data processing tools and platforms such as Kafka Streams, Kafka Connect, Spark Streaming Schema Registry, Flink and Beam.
Collaborating with cross-functional teams to understand data requirements and design solutions that meet business needs.
Implementing security measures to protect Kafka clusters and data streams.
Monitoring Kafka performance and troubleshooting issues to ensure optimal performance.
Providing technical guidance and support to development operations teams.
Staying updated with the latest Kafka features, updates and industry practices.
Required Skills Experience
Extensive Experience with Apache Kafka and real-time architecture including event driven frameworks.
Strong Knowledge of Kafka Streams, Kafka Connect, Spark Streaming, Schema Registry, Flink and Beam.
Experience with cloud platform such as GCP Pub/Sub.
Excellent problem-solving skills.
Knowledge & Experience / Qualifications
Knowledge of Kafka data pipelines and messaging solutions to support critical business operations and enable real-time data processing.
Monitoring Kafka performance, enhancing decision making and operational efficiency
Collaborating with development teams to integrate Kafka applications and services.
Maintain an architectural library for Kafka deployment models and patterns
Helping developers to maintain Kafka connectors such as JDBC, MongoDB and S3 connectors, along with topics schemas, to streamline data ingestion from databases, NoSQL data stores and cloud storage, enabling faster data insight.
About the Company
Infoplus Technologies UK Limited is a global IT services company focusing on Enterprise solutions and integration services consulting (SAP/Oracle), MRO Master Data Management, software development, product solutions for education segment, and IT consulting services offering outsourcing solutions to enterprises worldwide. Since inception in 2000, Infoplus has focused on a principle to maximize output for its clients and partners through cost-savings, enhanced productivity and quality. Headquartered in the United Kingdom, we... Know more
Related Jobs
- Company Name
- DataAnnotation
- Job Title
- Biology Tutor - AI Trainer
- Job Description
- We are looking for a *biology tutor* to join our team to train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each model. Make your application after reading the following skill and qualification requirements for this position. In this role you will need to hold an expert understanding of biology- a completed or in progress Masters/PhD is preferred but not required. Other related fields include, but are not limited to: Microbiology, Cell Biology, Genetics, Physiology, Biochemistry, Molecular Biology, Biotechnology, Environmental Science. Benefits This is a full-time or part-time REMOTE position You’ll be able to choose which projects you want to work on You can work on your own schedule Projects are paid hourly starting at $40+ USD per hour, with bonuses on high-quality and high-volume work Responsibilities Give AI chatbots diverse and complex biology problems and evaluate their outputs Evaluate the quality produced by AI models for correctness and performance Qualifications A current, in progress, or completed Masters and/or PhD is preferred but not required Fluency in English (native or bilingual level) Detail-oriented Proficient in biology and inductive/deductive reasoning, experimental design, data interpretation, and systems-level thinking. Note: Payment is made via PayPal. We will never ask for any money from you. #INDUKBIO Job Types: Full-time, Part-time Pay: From £30.05 per hour Location: Liverpool (preferred) Work Location: Remote
- Company Name
- TieTalent
- Job Title
- Azure Databricks Data Engineer (Contract OUTSIDE IR35)
- Job Description
- About Day Rate: £450 - £550 P/ day Start: Immediate Start Note: Capital Markets, or at least Banking experience is a MUST! Databricks Data Engineer - Contract Day Rate: £450 - £550 P/ day Location: Hybrid (Remote / 2 Days a week in London) Start: Immediate Start Note: Capital Markets, or at least Banking experience is a MUST! Key Expertise And Experience We're Looking For Data Engineering in Databricks: Spark programming with Scala, Python, SQL Ideally experience with Delta Lake Databricks workflows, jobs, etc. Familiarity with Azure Data Lake: experience with data ingestion and ETL/ELT frameworks Data Governance experience - Metadata, Data Quality, Lineage, Data Access Models Good understanding of Data Modelling concepts, Data Products and Data Domains Unity Catalog experience is a key differentiator - if not then experience with a similar Catalog/Data Governance Management component MS Purview (Metadata and Data Quality tool) experience is a bonus - experience in similar tools is valuable (Collibra, Informatica Data Quality/MDM/Axon etc.) Data Architecture experience is a bonus Python, Scala, Databricks Spark and Pyspark with Data Engineering skills Ownership and ability to drive implementation / solution design For more information please contact Aaron Perdesi - please email your CV and short summary directly to Nice-to-have skills Spark Scala Python SQL ETL Data Quality Collibra PySpark City of London, England Work experience Data Engineer Languages English
- Company Name
- E-Solutions
- Job Title
- Full Stack Engineer
- Job Description
- Role: Full Stack Engineer Location: Sheffield, UK Type: Contract (Inside IR35) Job Description: Git (particularly GitHub) Java / Kotlin JavaScript Python Shell Scripting knowledge of Jenkins, (CloudBees would be added advantage) Test-driven development Architectural and design patterns Troubleshooting skills Working in an agile, cross-functional team
- Company Name
- Spectrum IT Recruitment (South) Ltd
- Job Title
- Contract Banner Architect / Consultant
- Job Description
- Contract Banner Architect / Consultant - Banner SaaS Implementation Project Location: UK Remote Contract Length: Initial 2 Months (Scope to extend) IR35 Status: Outside IR35 Start Date: ASAP Join a high-impact education technology project! Spectrum IT are working with a leading university institution undergoing a Banner SaaS implementation. Our client needs an experienced Banner Architect / Consultant to provide specialist input across technical architecture, integration, and service delivery. This is a critical role focused on injecting Banner domain expertise and centred on keeping the project on track through a fast-paced delivery phase. Role: Act as the Contract Banner subject matter expert, you will advise on best practices for Banner SaaS and Banner v9 implementations You will lead on architecture decisions, particularly around integration design using Ethos, Data Connect, and potentially Insights Coordinating with project teams and stakeholder, you will aim to align technical delivery with business objectives Support data modelling and transformation, especially in a SaaS context Ensure scalable, maintainable, and secure integration strategies Offer guidance on service delivery best practices across the Banner ecosystem Skills / Experience: Strong hands-on experience with Banner SaaS or Banner Version 9 Deep understanding of Ethos Integration, Data Connect, and Insights Solid background in system integration, solution architecture, and project coordination Ability to act as a technical lead, providing actionable advice in a fast-paced implementation Strong communication skills and stakeholder engagement For more information and to submit your interest; please apply with an updated CV showcasing your previous Banner project experience. Candidates for this role must have previously worked on Elucian Banner projects / integration's to be considered. Spectrum IT Recruitment (South) Limited is acting as an Employment Business in relation to this vacancy.