Data Tech Lead
Hybrid
London, United Kingdom
Freelance
04-03-2025
Job Specifications
Job Specific Duties & Responsibilities:
Lead and mentor a team of Data Engineers, ensuring best practices and high-quality delivery
Architect and design scalable, high-performance data solutions on AWS & Databricks
Develop and optimize ETL/ELT workflows using Databricks, PySpark, SQL, and Python
Drive data migration from on-premise to AWS cloud, ensuring data integrity and minimal downtime
Implement data modeling, transformation, and integration strategies for analytics and reporting
Optimize AWS-based data infrastructure, ensuring performance, cost efficiency, and security
Oversee data governance, quality, and compliance to align with business requirements
Work closely with data analysts, scientists, and business stakeholders to define and implement data-driven solutions
Define and enforce best practices for code quality, CI/CD, and automation in data engineering workflows
Stay updated with emerging technologies and drive continuous improvement in data engineering processes
Required Skills, Experience & Qualifications:
10+ years of experience in Data Engineering with a focus on AWS & Databricks
Strong expertise in Databricks (PySpark, SQL, Delta Lake) and AWS services (S3, Glue, Redshift, Lambda, Athena)
Proficiency in Python, SQL, and stored procedures for data transformation
Hands-on experience in large-scale data migration to the cloud
Strong knowledge of data modeling, data warehousing, and analytics
Experience in data integration, transformation, and ETL pipeline optimization
Familiarity with CI/CD for data workflows, DevOps, and automation
Excellent leadership, stakeholder management, and problem-solving skills
About the Company
Revolutionize your applications with Al and data, modernizing cloud solutions to enhance customer experience. Mitra AI, formerly known as Mitra Innovation, is a forward-thinking company that has undergone a significant transformation to become an AI-centric enterprise. This rebranding highlights Mitra AI's dedication to harnessing artificial intelligence and data to boost productivity for clients across the USA, UK, EU, and APAC regions. With 12 years of experience, Mitra AI has established itself as a trusted partner in va... Know more
Related Jobs
- Company Name
- MANNING SERVICES LIMITED
- Job Title
- Big Data Developer
- Job Description
- Keywords like Spark, Hadoop, Bigdata, Scala, spark-scala, data engineer, ETL, AWS (S3, EMR, Glue ETL) etc. in the resumes. Job Titte: Big Data Engineer with Spark - Scala exp (mandatory) FTC for 12 month Job Description: As a Scala Developer, you will be responsible for designing, developing, and maintaining Scala applications. You will collaborate with cross-functional teams to define, design, and ship new features, as well as maintain and improve existing codebases. Your role will also involve troubleshooting, debugging, and optimizing application performance. You should have a strong understanding of functional programming concepts and be proficient in Scala, as well as have experience with related technologies. Skills and Qualifications: Bachelor's degree in Computer Science, Engineering, or a related field. Proven experience as a Scala Developer or similar role. Strong understanding of functional programming concepts. Proficiency in Scala programming language. Experience with Akka, Play Framework, or other Scala frameworks. Familiarity with build tools such as SBT. Knowledge of database systems (SQL and NoSQL) and experience with data modeling. Understanding of distributed computing principles. Familiarity with microservices architecture. Experience with version control systems, preferably Git. Excellent problem-solving and communication skills. Ability to work both independently and collaboratively in a team environment. Knowledge of Agile development methodologies Regards Shikha
- Company Name
- DataAnnotation
- Job Title
- Postdoctoral Biology Associate - AI Trainer
- Job Description
- We are looking for a *biology associate* to join our team to train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each model. Are you the right applicant for this opportunity Find out by reading through the role overview below. In this role you will need to hold an expert understanding of biology- a completed or in progress Masters/PhD is preferred but not required. Other related fields include, but are not limited to: Microbiology, Cell Biology, Genetics, Physiology, Biochemistry, Molecular Biology, Biotechnology, Environmental Science. Benefits This is a full-time or part-time REMOTE position You’ll be able to choose which projects you want to work on You can work on your own schedule Projects are paid hourly starting at $40+ USD per hour, with bonuses on high-quality and high-volume work Responsibilities Give AI chatbots diverse and complex biology problems and evaluate their outputs Evaluate the quality produced by AI models for correctness and performance Qualifications A current, in progress, or completed Masters and/or PhD is preferred but not required Fluency in English (native or bilingual level) Detail-oriented Proficient in biology and inductive/deductive reasoning, experimental design, data interpretation, and systems-level thinking. Note: Payment is made via PayPal. We will never ask for any money from you. #INDUKBIO Job Types: Full-time, Part-time Pay: From £30.90 per hour Location: Edinburgh (preferred) Work Location: Remote
- Company Name
- Games Workshop PLC
- Job Title
- Data Engineer
- Job Description
- About The Job Games Workshop is recruiting an exciting opportunity for a Data Engineer initially on a 12-month contract to support the reporting needs of a global change initiative and to replace legacy Access Databases used for ETL and reporting. We are looking for an experienced individual who understands the value of teamwork to work collaboratively with the business to design and implement robust ETL solutions based on documented requirements ensuring you use a methodical approach to ensure data is extracted efficiently, transformed and then loaded for optimal performance. Using your strong people and communication skills will enable you to conduct peer review solution with other members of the team ensuring you assist in both internally and in User Acceptance Testing Possessing strong analytical and critical thinking skills as well as having the ability to deconstruct complex challenges into manageable steps will allow you to maintain data integrity championing the accuracy and consistency of MI reporting through implementing robust reporting. Being a credible and knowledgeable individual understanding what good data looks like will allow you to advocate for best practice coding, testing and version control within MI projects always ensuring a high quality and maintainable solution. You will demonstrate a strong commitment to consistency, ensuring that all tasks are completed with the highest level of accuracy you create well performing data structure and streamline data processing workflows to improve efficiency and reduce manual intervention. This role requires excellent working relationships, strong critical thinking, and the ability to manage multiple projects simultaneously to meet deadlines and ensure initiatives align with Games Workshops business goals. The ideal candidates will have demonstrable experience within Data Warehousing within a Business Intelligence environment (both On premises and Cloud) coupled with the ability to write good quality design specifications. You will have knowledge of SQL Server, Transact SQL, Writing Stored Procedures, Tables, Views, and Functions along with ETL experience and Azure Data Factory along with an investigative and inquisitive mindset being focused on continuous improvement to learn new languages, frameworks and tools. If you are someone who approaches challenges with humility and embodies the courage to drive positive change apply today. Working at Games Workshop At Games Workshop we are looking for people who will do their best to understand the needs of the company and to put those needs first when they are at work. Because of this we believe that what you are like, hence the attitude you show to work and the way you choose to behave is even more important than your skills and experience. The Warhammer World site is based just outside of Nottingham city centre and benefits from a nearby tram stop and free onsite car parking. In return for your hard work, you will receive 33 days holiday per year (including public holidays), matching contributory pension scheme up to 7.5%, profit share bonus (subject to GW meeting profit targets) and option to join our Share Save scheme. Oh and let’s not forget, a staff discount of between 25% and 50% on our products! Other Essential Information Location: This position will be granted on a hybrid working basis and on a 12 month fixed term contract. Closing date: The closing date for applications is midnight, UK time, on Sunday 30th 2025. How to Apply To apply, please send us a letter or a video telling us why you want this job. This is a great opportunity for you to let us know that you understand what we are looking for. Please include an up-to-date CV to support your application. When you’re ready, please click apply, below.
- Company Name
- Free-Work UK
- Job Title
- Data Analyst with Big Data
- Job Description
- Job Description Data Analyst with Big Data - Canary Wharf Our Client is seeking a Data Analyst for the Data Products team is driving innovations in the Financial Services Sector using Big Data. The Client has a high-calibre, focused and a mission-driven team. The models we build and the analysis that we derive from financial data matters to crucial cutting-edge business decisions made across the global financial services firms every day and provides insight into real world problems. In this role, you will gain a deep understanding of income and expense transactions, financial classifications, and long term financial management within the UK market. You will participate in customer and partner calls to review requirements and client needs. You will quickly gain an understanding how local income and expense calculations, and financial management best practices can be leveraged to deliver financial wellness tools in the UK market. This role will allow you to partner analytics teams to review and enhance data categorization for key income and expense transactions, develop a specification for both rules based and machine learning driven enhancements to categorization by defining transaction types. You will also interact closely with the Financial Product team to provide requirements to localize the financial management tools for the UK market. You will perform regular and ongoing analysis on consumer transactions to identify methods for improved categorization, testing and certifying enhancements, and validating performance metrics. You will also work with the Financial Wellness Product team to adapt their products for the UK market. This requires you to develop a deep understanding of the UK financial management space in order to develop an ongoing UK roadmap with the rest of the Financial product team. Must have a Bachelor's Degree coupled with 2 - 4 years of experience in software-oriented Product Management, preferably in financial services. Experience in financial modelling and possessing knowledge of the financial services and transactions. Experience/Interest in analysing data and a high attention to detail especially in regards to data cleansing You possess superb written & oral communication skills. You have analytical skills with a background in financial analysis and carefully seek to understand underlying business needs, both on a market level as well as from individual client/prospects. You are adaptable and can work successfully in a technical environment as a non-technical leader. The ideal candidate is inquisitive and highly detail oriented. You are focused on execution and are able to make definitive decisions in uncertain environments with limited data. This is a 3 month contract assignment initially. Please send your CV to us in Word format along with your daily rate and availability.