Lead Software Engineer - SPARK, Java, Python, AWS
On site
London, United Kingdom
Full Time
03-04-2025
Job Specifications
Job Description
We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.
As a Lead Software Engineer at JPMorgan Chase within the Data Pipeline Technology Engineering team, you will have the opportunity to significantly influence your career trajectory and embark on a journey where you can redefine the boundaries of possibility. You will be instrumental in the development of our data pipeline applications on AWS, working closely with business and product teams to create robust data transformation (ETL) functionalities that cater to intricate business requirements. Your proficiency will steer our shift to the public cloud, with a focus on AWS product usage, authentication and authorization best practices, certificate management, performance enhancement, and database migration tools.
Job Responsibilities
Advise and make custom configuration changes in one to two tools to generate a product at the business or customer request.
Update logical or physical data models based on new use cases.
Produce architecture and design artifacts for complex applications while ensuring design constraints are met by software code development.
Gather, analyze, synthesize, and develop visualizations and reporting from large, diverse data sets for continuous improvement of software applications and systems.
Support business engineering leads through solution design and build out technical architectures to enable key business benefits.
Build complex distributed systems using Java (11/17) on AWS.
Build out real-world architectures that business engineering teams buy into and build their applications around.
Required Qualifications, Capabilities, And Skills
Experience across the data lifecycle with Spark-based frameworks for end-to-end ETL, ELT & reporting solutions using key components like Spark SQL & Spark Streaming.
Strong knowledge of multi-threading and high-volume batch processing.
Proficiency in performance tuning for Java/Python and Spark.
Deep knowledge of AWS products/services and Kubernetes/container technologies and their optimal use for specific workloads.
Real-world experience in building applications on AWS across multi-AZ, multi-region, and multi-cloud vendor environments.
Excellent understanding of modern engineering practices to leverage key benefits of Public Cloud (e.g., auto-scaling).
A mindset geared towards a fantastic end-to-end engineering experience supported by excellent tooling and automation.
Preferred Qualifications, Capabilities, And Skills
Good understanding of the Big Data stack (Spark/Iceberg).
Ability to learn new technologies and patterns on the job and apply them effectively.
Good understanding of established patterns, such as stability patterns/anti-patterns, event-based architecture, CQRS, and process orchestration.
Experience in building out technical architectures that align with business engineering requirements.
About Us
J.P. Morgan is a global leader in financial services, providing strategic advice and products to the world’s most prominent corporations, governments, wealthy individuals and institutional investors. Our first-class business in a first-class way approach to serving clients drives everything we do. We strive to build trusted, long-term partnerships to help our clients achieve their business objectives.
We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.
About The Team
J.P. Morgan’s Commercial & Investment Bank is a global leader across banking, markets, securities services and payments. Corporations, governments and institutions throughout the world entrust us with their business in more than 100 countries. The Commercial & Investment Bank provides strategic advice, raises capital, manages risk and extends liquidity in markets around the world.
About the Company
With a history tracing its roots to 1799 in New York City, JPMorganChase is one of the world's oldest, largest, and best-known financial institutions—carrying forth the innovative spirit of our heritage firms in global operations across 100 markets. We serve millions of customers and many of the world’s most prominent corporate, institutional, and government clients daily, managing assets and investments, offering business advice and strategies, and providing innovative banking solutions and services. Social Media Terms a... Know more
Related Jobs
- Company Name
- g2 Recruitment
- Job Title
- Support Engineer
- Job Description
- My market leading client has a superb new opening for a Support Engineer to join them on a permanent basis, working on-site in Central Manchester. Candidates must have at least 2 years commercial Windows support experience, with strong Azure fundamentals and proven abilities working with Microsoft products (i.e. M365). This role is incredibly diverse, offering a fast-paced, sociable environment working with all level of stakeholders. You will be joining an established, growing company, and from the start will be helping drive a large migration from Windows 10 to Windows 11. The role is mainly 2nd line with some phone-based work. It is fully client facing, so strong communication skills are essential. Salary to £30,000. Please send an up-to-date CV if interested for more details. Support analyst, 1st/2nd line support, first/second line support, second line support, service desk, windows, Microsoft, helpdesk support, desktop support, MCSE, azure, systems engineer, powershell, migration, M365, Office365, O365
- Company Name
- elyndra
- Job Title
- Founding Engineer (Full Stack)
- Job Description
- Our Mission At elyndra, we're transforming social care by solving the challenges of paperwork overload, staff burnout, and inefficient systems. Our technology gives time back to care professionals, so they can focus on what matters most; people, not paperwork. We're pioneering Ontological Hybrid Intelligence, combining the intuition and experience of care professionals with the pattern recognition capabilities of machine intelligence. By surfacing hidden connections across time, events, and behaviors, our system acts to provide insights that support faster, smarter decision-making while ensuring professionals remain in control. Our mission is personal, founded on family experience in care settings, we've seen firsthand how better technology can transform outcomes for both care professionals and those they support. Backed by leading London VCs and angel investors, we've completed a successful pilot and are now onboarding our first paying customers. We also have a strategic commercial partnership with a private equity group that owns over 160 care homes, creating a clear and scalable route to market. The Startup Reality A startup building something that matters without the corporate overhead: Zero BS culture - Direct communication, honest feedback, no politics Total transparency - You'll know the financials, the challenges, everything Tech for good - Commercial success how we scale our impact to where its needed Speed & Iteration - Fast feedback loops and rapid iteration are how we grow and improve every day Build-test-learn - We experiment, get things in front of critics, and let the real world guide us The Role You’ll help the founder take off the technical hat, becoming the technical lead that owns the platform, working closely with user needs, you’ll be someone who questions how things are "done" in legacy systems and isn't afraid to challenge and reinvent. We need a Founding Full Stack Engineer to own our platform architecture and core systems. You'll work directly with the founder (Marcus) and our development partner to build secure, scalable tech that literally changes how care happens. This role offers a clear path to Chief Technology Officer (CTO) or Head of Engineering as we grow, with the opportunity to shape our technical strategy from the ground up. What You'll Actually Build Platform & Infrastructure Design scalable cloud infrastructure for sensitive care data that won't leak or break Build robust backends that integrate with our AI systems without falling over Implement rock-solid auth systems that keep vulnerable people's data secure Set up logging and monitoring so we know when things go sideways Coordinate with our dev partner to ship features people actually use Establish and maintain GDPR compliance systems for healthcare data Implement Cyber Essentials security standards across all systems Build foundations for future NHS DTAC compliance requirements Application Development Create intuitive UIs that care workers can use without wanting to throw their device Build reusable components we can quickly assemble into new features Design data pipelines that respect the sensitivity of healthcare information Craft visualisations that make complex insights obvious to non-technical staff About You Technical Skills - Essential You design modular, maintainable software architectures that avoid monolithic patterns You implement clean code organisation with proper separation of concerns You're experienced with containerisation using Docker and Docker Compose You build secure, scalable cloud-based applications beyond basic VM deployments You develop RESTful APIs with asynchronous capabilities and proper documentation You understand and implement security best practices for handling sensitive data You're proficient with our tech stack: Python backend, React frontend, PostgreSQL database with Azure, GitHub and Docker Highly Desirable Experience integrating LLM services (OpenAI, Google, etc.) into applications Expertise with CI/CD pipelines and DevOps practices Strong full-stack capabilities across frontend and backend technologies Advanced database design skills with query optimisation experience Experience implementing GDPR compliance in technical systems Understanding of security standards and how to implement them Experience with rapid prototyping that can transition to maintainable systems Bonus Points Experience as a founding engineer or technical lead Track record of building production systems from scratch Experience with healthcare or social care sector systems Experience collaborating with external development teams Demonstrated ability to rapidly produce working prototypes Mindset You're a problem-solver who can break down complex challenges into manageable components You communicate technical concepts clearly to both technical and non-technical stakeholders You're adaptable and can shift between rapid prototyping and building maintainable systems You're a self-starter who takes initiative without needing direction You prioritise impact over technology for technology's sake You contribute meaningfully to technical documentation You understand that in a startup, your job description is "whatever needs doing" Must-Haves You can pass an enhanced DBS check (we work with vulnerable people's data) You're willing to occasionally visit care settings to understand the real problems You have the right to work in the UK What's In It For You Competitive Salary: Up to £90,000, depending on experience Meaningful Equity: 0.5% – 1.5% in a venture-backed startup Make an Impact: Build technology that genuinely improves lives—not just another ad platform Shape the Future: Define our technical stack and make key architectural decisions from the ground up Clear Progression to CTO: As we grow, there's a clear path to evolve into the CTO role Hybrid Remote Working: Flexibility to work remotely, with purpose-driven team connection Leave: 25 days holiday plus bank holidays Flexible Hours: Work in a way that suits your life and delivers your best Professional Development: Budget for professional tools, courses, and conference attendance Location Hybrid Remote London (WeWork, Canary Wharf / Central) with occasional care home visits. Our Hiring Process We aim to keep things transparent, efficient, and respectful of your time. Here’s what you can expect: CV Review Your CV will be reviewed by the Founder and our Development Partner. Initial discussion: A conversation with the Founder to explore your motivations, previous experience / portfolio, and current situation. Think of it as a vibe check to ensure alignment on both sides. Live Coding Task and Interview A focused exercise to assess your approach to solving a real problem we face, carried out by our Development Partner. Founder Interview A conversation with the Founder to explore your motivations, previous experience, and current situation. Think of it as a vibe check to ensure alignment ...
- Company Name
- Be-IT
- Job Title
- Senior Frontend Developer
- Job Description
- Are You a Senior Front-End Developer Looking for a High-Impact Role? We’re seeking a Senior Front-End Developer to join a high-performing UI engineering team within a global fintech organisation in their Glasgow office. You'll work in a team of talented engineers, making major contributions to the development of world-class applications in the financial markets. As a UI Developer in the core UI team, you'll design, develop, and maintain reusable UI components and frameworks that will be utilised by other engineers across the organisation. Why This Role Matters: High-Impact Position: Your work will directly influence the user experience for a multi-billion pound operation. Technical Innovation: Scope out future UI engineering opportunities and introduce new technologies, tools, and processes in the front-end team. Org-Wide Influence: Build components and frameworks used across the entire organisation. Modern Tech Stack: Work with the latest tools and methodologies in front-end development. Collaborative Environment: Work closely with engineers and directly with non-technical users of your solutions. What You’ll Need: Deep expertise in React and TypeScript and other modern front-end technologies. Experience with monorepo structures and component libraries A passion for clean, efficient, and scalable code A good standard of UX/UI capability. You'll be immersed in complex and rewarding tasks that not only stretch your capabilities but also provide a deep sense of accomplishment. In this environment, innovation is a fundamental part of the culture. You'll enjoy the autonomy to explore new ideas and implement cutting-edge techniques, tools, and technologies, all without the burden of bureaucracy and red tape. This is a place where your creativity and expertise can truly shine, allowing you to advance your skillset and make a significant impact. You'll earn a strong starting salary of £70,000 - £95,000, dependent on your experience with an outstanding yearly bonus on top. For immediate consideration, apply now.
- Company Name
- PRACYVA
- Job Title
- Cloud Architect
- Job Description
- You will play a critical role in designing developing and implementing complex data solutions on cloud platforms (primarily AWS) ensuring they meet the highest standards of quality scalability and performance. Serve as a subject matter expert in cloud data engineering providing technical guidance and mentorship to the team. Drive the design development and implementation of complex data pipelines and ETL/ELT processes using cloud-native technologies (e.g. AWS Glue AWS Lambda AWS S3 AWS Redshift AWS EMR). Develop and maintain data quality checks data validation rules and data lineage documentation. Collaborate with data analysts data scientists business stakeholders and product owners to understand their data needs and translate them into innovative and effective technical solutions. Troubleshoot and resolve complex data quality issues performance bottlenecks and production incidents. Participate in the evaluation selection and implementation of new data technologies and tools. Adhere to and champion best practices in data engineering including data security privacy and governance. Define and enforce data engineering standards processes and best practices within the team. Develop and maintain CI/CD pipelines for data engineering workflows using tools like Jenkins. Automate data ingestion transformation and loading processes. Work closely with DevOps teams and other engineering teams to ensure smooth deployment and operations of data pipelines. Experience working on Linux platforms and managing data on Linux servers. Stay abreast of the latest advancements in cloud computing and data engineering technologies. Contribute to the development and improvement of the team's overall performance and efficiency. May lead small projects or initiatives within the data engineering team. Your Profile 7+ years of experience in data engineering with a strong focus on cloud platforms (preferably AWS). 3+ years of experience as a Senior Engineer or SME in a data engineering role. Solid experience working on Linux platforms. Experience with CI/CD pipelines and tools like Jenkins. Strong understanding of DevOps methodologies and principles. Solid understanding of data warehousing data modeling and data integration principles. Proficiency in at least one scripting/programming language (e.g. Python Scala Java). Experience with SQL and NoSQL databases. Familiarity with data quality and data governance best practices. Strong analytical and problem-solving skills. Excellent communication interpersonal and presentation skills. Desired Skills: Experience with containerization technologies (e.g. Docker Kubernetes). Experience with data streaming platforms (e.g. Kafka Kinesis). Experience with data visualization and business intelligence tools. Experience with Agile development methodologies. AWS Certifications (e.g. AWS Certified Data Analytics - Specialty AWS Certified Solutions Architect)