Senior Data Engineer
On site
London, United Kingdom
Freelance
06-03-2025
Job Specifications
We are seeking a Senior Data Engineer with 6-8 years of experience in AWS data services, Snowflake, Python, and SQL to lead data engineering initiatives. The ideal candidate will design, build, and optimize scalable ETL pipelines, data workflows, and data architecture to drive business intelligence and analytics.
Key Responsibilities:
Develop & optimize ETL pipelines using Python and Spark (PySpark).
Handle large-scale data extraction, transformation, and loading (ETL) processes.
Architect, implement, and manage scalable data pipelines and data integration solutions.
Work with complex data structures (Structures, Maps, Python Lambda functions).
Process data from multiple sources (APIs, structured/unstructured files).
Utilize SQL (Snowflake) & shell scripting for querying, automation, and optimization.
Implement and optimize data workflows, storage, and performance tuning.
Work with file formats like CSV, JSON, Parquet, and Avro.
Provide solutions to enhance performance, efficiency, and scalability of data pipelines.
Collaborate with cross-functional teams to align data strategy with business needs.
Must-Have Skills:
Strong Python (Object-Oriented Programming) & API handling experience.
Expertise in building ETL pipelines using Python & PySpark.
Hands-on experience with SQL (Snowflake) & shell scripting.
Proficiency in data engineering libraries: Pandas, NumPy, SQLAlchemy, Elasticsearch, BeautifulSoup, requests, boto3.
Experience handling large-scale data processing with multiple file formats.
Strong problem-solving skills with the ability to optimize existing solutions.
Excellent communication skills for stakeholder collaboration.
Nice-to-Have Skills:
Experience with AWS services (EMR, EC2, S3).
Working knowledge of Apache Airflow for scheduling and automation.
About the Company
Welcome to Gravity Infosolutions, a visionary force reshaping the landscape of Digital Transformation, CRM, and Salesforce. Our mission? To empower businesses with the tools and strategies they need to not only thrive but surpass all expectations, delivering unprecedented growth on a global scale. With a dynamic global presence spanning the United States, United Kingdom, United Arab Emirates, and India, we are relentless in our pursuit of driving digital transformation and delivering remarkable results. We are more than a c... Know more
Related Jobs
- Company Name
- Square One Resources
- Job Title
- Security Master Data Analyst
- Job Description
- Job Title: Security Master Data Analyst Location: London, United Kingdom (Hybrid Working) Day Rate: £550 - £600 (Inside IR35) Job Type: 6months + Contract I am looking for a skilled Security Master Data Analyst to support a project focused on derived ratings and classifications. The role involves documenting existing logic, working with an outsourcer to implement it, and ensuring the final output meets business requirements. The analyst will also manage a backlog of derived data items, collaborate with stakeholders for approval, and establish an operating model for change and issue management. Job Responsibilities/Objectives Document and communicate derived ratings and classification logic for outsourcing. Work with business stakeholders to define and agree on data specifications. Translate codified rules into actionable specifications and ensure correct implementation with the outsourcer. Define and implement an operating model for change and issue management. Manage the backlog of derived data items independently. Use SQL for data analysis to support technical tasks. Required Skills/Experience The ideal candidate will have the following: Experience in asset management security master data, especially derived ratings and classifications. Strong stakeholder management skills for defining data specifications. Technical knowledge to translate rules into specifications and work with outsourcers. Ability to define operating models for issue and change management. Strong SQL skills for data analysis. If you are interested in this opportunity, please apply now with your updated CV in Microsoft Word/PDF format. Disclaimer Notwithstanding any guidelines given to level of experience sought, we will consider candidates from outside this range if they can demonstrate the necessary competencies. Square One is acting as both an employment agency and an employment business, and is an equal opportunities recruitment business. Square One embraces diversity and will treat everyone equally. Please see our website for our full diversity statement.
- Company Name
- JLR
- Job Title
- Master Data Specialist - 12 Month Fixed term contract
- Job Description
- REQ ID: 127296 JOB TITLE: Master Data Specialist - 12 Month Fixed term contract SALARY: £38,000 - £48,000 POSTING START DATE: 11/03/2025 POSTING END DATE: 18/03/2025 LOCATION: Wolverhampton EPMC We’re re-examining our vehicles and what a vehicle means in the emerging world of automation, connectedness, electrification and the shared economy. New ideas, new technology, and new approaches to mobility are our business. Join a team of next generation thinkers. What To Expect JLR currently have an exciting opportunity for a Master Data Specialist to join their Electric Propulsion Manufacturing Centre based in Wolverhampton. As a Master Data Specialist within Manufacturing, you will play a crucial role in the SAP delivery of new technologies into the EPMC. The role is a 1 year FTC and encompasses management of Bill of Materials (BoM), engineering change management and management of Manufacturing Execution System (MES) activities for both new and existing production lines. You will be responsible for ensuring enrichment and governance of materials throughout the lifecycle of JLR manufacturing data. Key Accountabilities And Responsibilities Management of engineering changes to ensure alignment between engineering release and production systems Management of master data enrichment activities using a Master Data Management (MDM) solution Management of BoM(s) to support Launch deliverables of new products Management of master data activities for new and existing production lines within SAP ECC/ MES (including routing, operations, work centres etc.) What You’ll Need Detailed working knowledge of master data in SAP ECC/ EWM systems. Working knowledge of Manufacturing Execution Systems (MES) (i.e. SAP MES). Experience in an operational/ manufacturing business environment and an understanding of end-to-end manufacturing processes. Good time-management skills and excellent problem-solving skills Hands on experience of an industry recognised Master Data Management (MDM) or Data Quality (DQ) toolset SO WHY US? Bring all this to the home of premium innovation, and you’ll find the opportunities to further your career working with a world-class team in state-of-the-art facilities. We offer acompetetive salary and performance related bonus scheme. As a manager, you’ll also be able to select one of our luxury premium vehicles to lease at a fraction of the cost. All this and more makes Jaguar Land Rover the perfect place to continue your journey. Jaguar Land Rover is committed to equal opportunity for all.
- Company Name
- Counter Terrorism Policing
- Job Title
- Business Analyst - Grade I - Data Science Unit - Counter Terrorism Policing NW
- Job Description
- Contract Type – Full Time Grade – I Information About The Role The core role of the Business analyst is to assist the development of Data Science projects, through the collation of precise user requirements, development of approach and maintenance of documentation, while acting as a technology conduit between the customer and data science specialists. This will include advising on the suitability of new and emerging data related technologies to the national CT Policing Community. You will assist in overseeing and coordinating the implementation of a range of projects and initiatives, develop business cases and track progress against delivery timelines. Responsibilities Please refer to the attached job description – Data Science Business Analyst.pdf How To Apply Apply to the role by clicking the button below. Further information about the role is also available via this link.
- Company Name
- SUEZ
- Job Title
- Procurement & Performance Data Analyst
- Job Description
- Contract type Permanent Working Pattern Full time Location based Middlesbrough Dates that interviews will take place Interviews will be held in person Salary £32,291 - £35,000 Summary of vacancy Are you an Excel expert with a keen eye for data and a passion for problem-solving? We are seeking a proactive Procurement & Performance Data Analyst to analyse procurement data, create visualizations using advanced Excel formulas, and leverage systems like Coupa and SAP to support sustainable business practices. In this role, you’ll transform complex datasets into clear insights, ensuring senior leadership has the information they need to optimise performance. In return we offer salary of £32,291 - £35,000 plus up to 10% annual bonus, 25 Holiday days + Bank Holidays, Company Pension- 5% contributions, and company benefits. About The Role What will you be doing? Analysing procurement and performance data, ensuring accuracy and actionable insights Creating dashboard summaries and infographics to visualise key trends Extracting and interpreting data using advanced Excel formulas (LOOKUPs, value analysis, etc.) Using Coupa and SAP for data extraction and reporting Communicating insights effectively to senior management and board members, providing the context behind the data Working independently, identifying trends, and recommending improvements What are the requirements? Advanced Excel skills (lookup formulas, data validation, analysis) Experience in dashboard creation and data visualisation Familiarity with Coupa and SAP (or similar procurement systems). Strong communication skills – able to present data in a clear, meaningful way Proactive mindset – able to take initiative and work independently, and collaboratively as needed Working Arrangements This role is initially office-based, transitioning to a hybrid model after the probationary period (3 days in the office, 2 days remote). Assessment Process The interview process includes an approximately 5-minute Excel assessment to evaluate data analysis skills. Our outlook is to have 1 interview round. Who We Are SUEZ recycling and recovery UK is a forward-thinking company recognised as one of the top places in the UK to work. We are proud of the fantastic opportunities for personal growth and development we offer our people. As we continue to develop and grow, you can play an important part in the essential work we are doing to make businesses and communities more sustainable. With a raft of benefits, family-friendly policies and excellent remuneration packages, there’s never been a better time to join SUEZ recycling and recovery UK. A friendly and supportive place that you will love to work in, we believe creativity, clear communication and our drive for excellence are the keys to our success. If you share our thinking – and have the qualities we’re looking for – you could play a big part in our dedicated team. No agencies please* Job Description Procurement_Performance_and_Data_Analyst_JD_240216.pdf Closing Date 26/03/2025 Once we have sufficient applicants we withhold the right to close job vacancies early.