Staff Data Engineer (based in the UAE)
On site
London, United Kingdom
Full Time
18-03-2025
Job Specifications
Staff Data Engineer – AI Solutions
Location: United Arab Emirates
Are you ready to build the backbone of cutting-edge AI systems? Here's an opportunity to join a team developing enterprise-grade AI products, working at the forefront of innovation with access to world-class data.
The Opportunity
We’re looking for a Staff Data Engineer to design and optimize large-scale data infrastructure, supporting the development of next-generation AI solutions. You’ll work with massive datasets, complex architectures, and real-time data pipelines, shaping the future of AI applications across multiple industries.
What You’ll Do
Architect Scalable Pipelines: Design, implement, and maintain data pipelines for training and fine-tuning advanced AI models
Optimize Data Infrastructure: Build and refine ETL/ELT processes for high-dimensional and unstructured data
Integrate and Manage Data: Work with diverse enterprise data sources, APIs, and cloud-based storage solutions
Collaborate with AI Experts: Partner with researchers, data scientists, and product teams to deliver data-driven AI solutions
Ensure High Performance: Monitor and optimize workflows for large-scale, real-time data processing
What You'll Need
Experience building large-scale data architectures and pipelines
Strong proficiency in Python, Java, or Scala
Deep knowledge of SQL and distributed data processing tools like Apache Spark, Hadoop, or Kafka
Hands-on experience with AWS, GCP, or Azure, including services like S3, BigQuery, or Azure Data Lake
Familiarity with unstructured data (text, images, videos)
Bonus Points For
Experience with MLOps and AI lifecycle workflows
Working knowledge of Generative AI frameworks (Hugging Face, OpenAI API)
Exposure to enterprise data tools like Snowflake or Databricks
Understanding of NLP concepts and techniques
Why Join
You'll have the opportunity to work on industry-defining AI projects, leveraging secured proprietary datasets and state-of-the-art computing power to develop cutting-edge solutions.
In addition to a highly competitive, tax-free salary, on offer is private healthcare, relocation support for international hires, annual flight tickets home, and private education contributions to ensure a seamless transition for you and your family
About the Company
For years, we've been at the forefront of the region's digital and technology landscape, helping to turn start-ups into unicorns, digitalising governments and global businesses, and supporting the hyper-growth of some of the biggest names in the world. Our team live and breathe digital. Their knowledge, passion and commitment to supporting the growth of our clients have won us awards and made us who we are today. Founded in 2016, Discovered was created in order to change the conventional recruitment stigma and stereotype. ... Know more
Related Jobs
- Company Name
- Instructure
- Job Title
- Senior AI Platform Engineer (remote)
- Job Description
- At Instructure, we empower teachers and learners to grow and succeed by creating intuitive products that simplify learning, facilitate meaningful relationships, and inspire innovation. We are looking for AI Platform Engineers to build and maintain core LLM-powered services and APIs to power the next generation of online learning tools. On this team, you’ll architect and implement services and infrastructure that will allow our feature teams to rapidly develop and deploy LLM-powered features that improve the teaching and learning experience of tens of millions of people around the world while maintaining our high standards for performance, security, and reliability. What You'll Do Design and implement APIs and domain services that abstract the complexity of using an LLM and enable rapid feature development from our product teams Build scalable AWS infrastructure for LLM interactions, including prompt management, context handling, auditing, and response processing Create developer tooling and documentation that makes integration with your services intuitive and easy Establish best practices for AI and LLM use at Instructure, considering things like auditability, cost, and performance Collaborate with feature teams to understand their needs and solve them with platform capabilities Design, develop, and maintain scalable and performant APIs Write clean, maintainable, and well-documented code Participate in code reviews and provide constructive feedback to other developers What You'll Need Prior software engineering experience with API design and distributed system development Strong experience building backend services and REST or GraphQL APIs Knowledge of API design best practices around security, performance monitoring, rate limiting, and more Understanding of LLM integration and usage patterns Strong collaboration and written and verbal communication skills; Past experience with cloud infrastructure, preferably on AWS Experience with Node.js or a desire to learn Experience with TypeScript or a desire to learn Background in developer tooling and API documentation is preferred Why Join Us At Instructure, you’ll lay the foundation for the use of AI in education and make a difference in the lives of millions of learners. We invest in our employees’ learning with thoughtful mentorship, hack weeks, internal conferences, and a culture where innovation and ownership thrive. We’ve always believed in hiring the most awesome people and treating them right. We know that the more diverse we are, the more diverse our ideas will be and when we openly welcome those ideas, our environment is better and our business is stronger. All Instructure employees are required to successfully pass a background check upon being hired.
United Kingdom
Remote
Full Time
20-03-2025
- Company Name
- Amici Procurement Solutions
- Job Title
- Senior Software Engineer - Data
- Job Description
- GLASGOW (HYBRID, 1 DAY PER WEEK IN OFFICE) Eden Scott is recruiting a Senior Data Software Engineer for Amici to develop a cutting-edge platform. With significant growth and an ambitious technology roadmap, Amici seeks an engineer skilled in Java, Python, and data to shape the future of the MyAmici platform. Why Join Us? You'll work in an agile, collaborative environment, leveraging modern technology stacks to build and optimize a powerful data platform and search engine. With an opportunity to explore vector search, machine learning, and large-scale data processing using Apache Lucene, Solr, or Elasticsearch. The position is hybrid, with one day per week in the Glasgow office. What You’ll Do: Design, build, and optimize a high-performance data platform and search solution. Develop robust search capabilities using Apache Lucene, Solr, or Elasticsearch. Engineer scalable data pipelines in Java or Python. Write high-quality, test-driven code using Agile methodologies. Collaborate with Business Analysts, Data Engineers, and UI Developers. Work across the full stack, from React/TypeScript front-end to Java-based search services. Leverage cloud technologies like Azure Data Factory, Batch Services, Azure SQL. Contribute to DevOps practices, code reviews, and system optimizations. What We’re Looking For: Strong experience in Java development and exposure to Python. Experience with large-scale data processing and search technologies. Expertise in Apache Lucene, Solr, Elasticsearch, or willingness to learn. Hands-on experience with SQL and NoSQL databases. Exposure to modern JavaScript frameworks like ReactJS or VueJS. Experience in Agile environments with modern DevOps and CI/CD practices. A degree in Computer Science/Software Engineering or equivalent experience. Familiarity with writing automated tests and maintaining high code quality. About Amici: Founded in 2005, Amici provides a cloud-based purchasing and inventory management platform for biotech and life sciences organizations. The MyAmici platform supports scientists in their research by handling supply chain and procurement needs. The Innovation Team ensures MyAmici remains at the forefront of technology. What’s In It for You? Work in an intrapreneurial and innovative environment. A flexible, hybrid working approach. A company culture valuing growth, collaboration, and continuous improvement. A fantastic suite of benefits. Join us to be part of a high-impact team transforming the biotech industry. Interested? Let’s talk! Contact our recruitment partners at Eden Scott for an informal discussion: amici@edenscott.com
Glasgow, United Kingdom
Remote
Full Time
20-03-2025
- Company Name
- Sainsbury's
- Job Title
- Data Engineer - SQL, Python and AWS/Azure
- Job Description
- We’d all like amazing work to do, and real work-life balance. That’s waiting for you at Sainsbury’s. Think about the scale it takes for us to feed the nation. The level of data, transactions and variety it involves. Then you’ll realise that ours is a modern software engineering environment because it has to be. We’ve made serious investment into a Tech Academy and into setting standards and principles. We iterate, learn, experiment and push ways of working such as Agile, Scrum and XP. So you can look forward to awesome opportunities in everything from AI to reusable tech. You’ll be part of one of our Engineering squads working on Ad-tech, interpreting and following architectural and engineering principles, operating frameworks, and new and improved technology and solutions. With your technical craft, curiosity and experimentation, you’ll use judgement to apply specific techniques to deliver focused outcomes that support our customers. We use a variety of tech here and you need to be willing to pick up new tools and techniques. We’d also like you to be yourself - analytical, curious and unafraid to challenge the status quo. You’ll constantly strive to improve the way things are done in your team, contributing as a progressive member of the engineering community. We are looking for an experienced Data Engineer confident in investigating, ingesting and exploiting large datasets with core skills in Python, Pyspark, EMR, AWS, SQL, CI/CD. At Sainsburys Tech, within the Media Agency, we’re unlocking petabytes of untapped potential. We have thousands of shops and millions of customers creating billions of transactions per year. We’re on a mission to use this data better than anyone else. What to expect as a Data Engineer: Work with various data squads at Sainsbury’s to ensure the right data is available for teams to build fantastic products. The aim of our products is to increase efficiency, speed of data ingestion into our reporting platform, data quality and ensure data security and compliance We are product focused and and are looking for engineers interested in data engineering and building brilliant data products from start to finish Writing code, we love writing beautiful code Big on automation including deployments and testing (CICD) Building out Monitoring and Alerting tools for live applications Working as a team during collaborative design hubs Sometimes going down a rabbit hole while exploring new data Jumping on a huddle with the team to discuss a tricky problem Pair programming to diagnose an elusive bug Jumping on a Pull Request to provide a constructive brain dump Building relationships with your colleagues – mentoring them, and teaching things you’ve learned Partnering with Data Modellers, Analytics Engineers, Data Scientists, Architects and Product Managers to deliver world-class data products We’d Love To Hear From You If: You’re interested in the world of Data, and have previous experience as a Data Engineer, Backend Software Engineer or similar domain You have experience building scalable, robust, and well-tested Software products with good coding practices, You’re curious and ask questions about technologies and use initiative to figure things out You like having ownership of your work and seeing it through You’ve got a point of view but are prepared to reconsider your opinion. Experience with these beneficial: Python AWS / Azure / GCP SQL Snowflake Terraform We are committed to being a truly inclusive retailer, so you’ll be welcomed whoever you are and wherever you work. Around here, there’s always the chance to try something new - whether that’s as part of an evolving team or somewhere else across the business - and we take development seriously and promise to support you. We also recognise and celebrate colleagues when they go the extra mile and, where possible, offer flexible working. When you join our team, we’ll also offer you an amazing range of benefits. Here are some of them: Starting off with colleague discount, you'll be able to get 10% off at Sainsbury's, Argos, TU and Habitat after 4 weeks. This increases to 15% off at Sainsbury’s every Friday and Saturday and 15% off at Argos every pay day. We've also got you covered for your future with our pensions scheme and life cover. You'll also be able to share in our success as you may be eligible for a performance-related bonus of up to 10% of salary, depending on how we perform. Your wellbeing is important to us too. You'll receive an annual holiday allowance, and you can buy additional holiday. We also offer other benefits that will help your money go further such as season ticket loans, cycle to work scheme, health cash plans, pay advance (where you can access some of your pay before pay day) as well access to a great range of discounts from hundreds of other retailers. And if you ever need it there is also an employee assistance programme. Moments that matter are as important to us as they are to you which is why we give up to 26 weeks’ pay for maternity or adoption leave and up to 4 weeks’ pay for paternity leave. Please see www.sainsburys.jobs for a range of our benefits (note, length of service and eligibility criteria may apply).
London, United Kingdom
On site
Full Time
19-03-2025
- Company Name
- Microsoft
- Job Title
- Member of Technical Staff, AI Pretraining
- Job Description
- Help deliver one of the best foundational models in the world at Microsoft AI. At Microsoft AI, we are on a mission to train the world’s most capable AI frontier models, pushing the boundaries of scale, performance and product deployment. The Pre-Training team at Microsoft AI tackles some of the most challenging problems in deep learning at scale. As a team, we will deliver one of the best foundation models in the world, forming the foundation of many initiatives across Microsoft AI. About We are looking for outstanding individuals excited about contributing to the next generation of systems that will transform the field. We are looking for candidates who: Have proven expertise in areas of interest, evidenced by an exceptional publication track record and significant technical leadership in high-impact projects Exhibit strong analytical skills, attention to detail, and a commitment to data-driven decision-making Have experience and/or in-depth understandings about large-scale distributed systems Demonstrate an ability to work collaboratively in a fast-paced, innovative environment Responsibilities Develop algorithms, model architectures, data mixtures, and scaling laws for large-scale training using a rigorous data-driven approach grounded in meticulous ablations Drive algorithmic implementations, conduct experiments, and oversee flagship training runs on our in-house large-scale distributed stack Collaborate closely with teams on infrastructure, data, post-training, and multimodality Embody our culture and values. Required/Minimum Qualifications Bachelor's Degree in Computer Science, or related technical discipline AND technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python Proven expertise in the area of pretraining Additional Or Preferred Qualifications Demonstrated experience in large-scale AI. Passionate about conversational AI and its deployment. Demonstrated written and verbal communication skills with the ability to work closely with cross-functional teams, including product managers, designers, and other engineers. Passion for learning new technologies and staying up to date with industry trends, best practices, and emerging technologies in AI. Proven ability to collaborate and contribute to a positive, inclusive work environment, fostering knowledge sharing and growth within the team.
London, United Kingdom
On site
Full Time
19-03-2025