Senior Data Engineer
On site
Edinburgh, United Kingdom
Full Time
22-10-2024
Job Specifications
Senior Data Engineer - Edinburgh, Hybrid
Bright Purple have the pleasure of working with leading tech company in Edinburgh to hire a new Senior Data Engineer as a hands-on lead overseeing the design and development of internal platforms and data solutions.
What is in it for you:
Competitive salary
Hybrid working with 3 days a week office based in Edinburgh.
They are a culture-first business with great care taken to ensure they maintain and grow a diverse, supported, and safe workspace
Excellent company benefits on offer The role:
Ideally you are a software or data engineerpassionate about the environment and motivated by the idea of working for one of the fast-growing techs in the sector.
you'll be richly rewarded by collaboration with exceptional colleagues on cutting edge, mission-driven tech-for-good. This opportunity could truly be the dream job for you.
This environments favours problem-solving and a flexible approach to tooling and tech. You would be joining a passion & intelligent team working with technologies like:
Azure
Python
Terraform
Machine Learning
Artificial Intelligence The ideal candidate will have the following experience:
Commercial experience in data, machine learning or software development
Previous experience with Python and its related libraries
Experience building cloud-hosted data pipelines
Knowledge of modern cloud and dev-ops tools
Linux/Unix
Experience in geospatial data Do you or someone you know have the skills, qualities and passion we're looking for? If so, don't delay, and get in touch today with your latest CV for immediate consideration.
Bright Purple is an equal opportunities employer: we are proud to work with clients who share our values of diversity and inclusion in our industry.
About the Company
Bright Purple are a team of specialist Technology and Business Change recruitment consultants based in the heart of Edinburgh. Since 1995 we have been supporting innovative clients of all sizes in placing permanent and contract candidates in IT, Data and Business Change roles. Our Bright Purple People have decades of experience between them, and we use our industry contacts, insight and know-how to help you make the best decisions for your career or business. We also offer extensive and bespoke background checks or bot... Know more
Related Jobs
- Company Name
- scrumconnect ltd
- Job Title
- Data Engineer
- Job Description
- Scrumconnect Consulting is seeking a highly skilled Data Engineer to join our innovative team. In this role, you will be responsible for building and optimizing our data pipelines and supporting the data needs of our Business Intelligence and analytics teams. If you have a passion for data and a knack for solving complex challenges, we invite you to apply. Key Responsibilities: - Implement data flows to connect operational systems with data for analytics and Business Intelligence (BI) systems. - Document source-to-target mappings and re-engineer manual data flows to enable scalability and repeatable use. - Support the build of data streaming systems to handle large volumes of data in real time. - Write ETL (Extract, Transform, Load) scripts and code to ensure optimal performance of the ETL processes. - Develop reusable Business Intelligence reports and build accessible data for analysis. - Collaborate with Data Scientists to build analytics tools that utilize the data pipeline to provide actionable insights for management, operational efficiency, and other key business performance metrics. Essential Skills and Experience: - Hands-on coding experience in R or Python, with a solid understanding of programming paradigms and concepts needed in Data Engineering. - Expertise in working with numpy, scipy, pandas, and data visualization tools in Python or equivalent packages in R. - Strong knowledge of SQL, with experience in working with both traditional RDBMS and distributed datasets. - Deep understanding of SQL, cloud-based data pipelines, architectures, and data sets. - Experience in writing complex queries against relational and non-relational data stores. - Good understanding of Data Warehousing and Data Lakehouse concepts. - Proven experience working with large data sets, data pipelines, and cloud services. - Experience in building reliable, efficient data applications, systems, services, and platforms. - Familiarity with big data tools such as Hadoop and Spark. - Background in programming using Open Source technologies, along with Python, Java, or C++/.Net. - Good written and verbal communication skills with a strong desire to work in cross-functional teams. - Awareness of data security best practices and GDPR compliance toward personal data. - Experience working in an agile environment or organizations with an agile culture. Desirable Skills: - Knowledge of Machine Learning and traditional Data Science concepts is beneficial but not mandatory. - Understanding of design choices for data storage and data processing, particularly with a focus on cloud data services. - Familiarity with technologies such as Apache Spark or Airflow. - Experience using parallel computing to process large datasets and optimize computationally intensive tasks is advantageous but not mandatory. Qualifications: - Degree or equivalent in a relevant subject, such as Computer Science, Information Systems, or a related technical discipline. Why Join Us: - Competitive salary and benefits package. - Opportunity to work with cutting-edge technologies in a dynamic environment. - Collaborative and inclusive culture that values professional growth and continuous learning. - Work-life balance with flexible working arrangements. - Skilled worker visa can be processed for candidates outside of the United Kingdom.
- Company Name
- i3 Resourcing
- Job Title
- Senior Business Systems Analyst - Data
- Job Description
- Senior Business System Analyst London £90,000 Data Warehouse, Snowflake 3 days a week in office My client are going through an exciting transformational change, rethinking data and analytics from the ground up form part of a high performing agile squad gather requirements for a new Snowflake data platform data subject matter expert Work with business stakeholders ensure effective and innovative technical solution design. Work with QA colleagues Plan and facilitate workshops and 1-to-1 interviews. Conduct system prototype demonstrations Assist the digital product manager WE NEED SOMEONE WITH: Solid understanding of business analysis concepts, methods and practices in an information technology environment. General and London Market Insurance domain experience. Experience in defining data lineage from source systems to an Enterprise Data Warehouse. Solid understanding of agile delivery methodologies. Greenfield Data Warehouse build experience highly desirable. Some experience using JIRA or similar agile tools. Solid understanding of SQL and ability to use SQL tools to query a database to retrieve data. Senior Business System Analyst London £90,000 Data Warehouse, Snowflake
- Company Name
- Crimson Limited
- Job Title
- Lead Data Engineer (x2) - London - Permanent - Hybrid
- Job Description
- Lead Data Engineer (x2) - London - Permanent - Hybrid This role requires hybrid working based in Moorgate, London The salary for this role ranges between £65,000 - £74,000 Lead Data Engineer required for a leading client based in Moorgate, London. Our customer is seeking a well experienced Lead Data Engineer to come on board to spearhead agile data engineering initiatives, delivering data and insights products. This role involves understanding the business and IT strategy to align technical solutions with desired outcomes, developing APIs and integrations for data transfer between systems, and providing aggregated data solutions. Key Responsibilities: Ability to lead complex data engineering projects Design, code, test, and document data applications Develop and manage scalable APIs, machine learning endpoints, data integration pipelines, and data storage solutions. Shape the information strategy and platform architecture Introduce new data engineering tools, frameworks, standards, and processes Ensure the application of agreed standards and tools Ensure technical solutions support the accessibility, retrievability, security, quality, retention, and ethical handling of data. Experience with strategies and design approaches for APIs and data pipelines. Experience in designing and implementing data-driven tools and solutions. Proficiency in developing scalable APIs in Python using frameworks like FastAPI or Flask. Proficiency in developing scalable data pipelines in Spark/Python using tools such as Airflow. Experience with SQL, Python, and other Scripting/programming languages Experience with diverse data infrastructure and systems, such as PostgreSQL, SQL Server, Azure Data Lakes, Databricks, and Kubernetes. Strong stakeholder management and communication skills at varying levels Interested? Please submit your updated CV to (see below) for immediate consideration. Not interested? Do you know someone who might be a perfect fit for this role? Refer a friend and earn £250 worth of vouchers! Crimson is acting as an employment agency regarding this vacancy
- Company Name
- Sphere Digital Recruitment | Best Small Company 2022
- Job Title
- Data Analyst - UK Leading Publisher
- Job Description
- Data Analyst - Leading UK Publisher - £35,000 - £40,000 The Company One of the leading media businesses in the UK and Ireland. Their world-famous brands provide news, analysis, opinion and entertainment to almost 40 million people each month. Spanning print and pixel, audio and video, events and experiences, their multi-format brands are home to a plurality of opinion, representing the diverse communities they serve. Exciting bits: -Join a multi-national media powerhouse with 16 sites across the UK and Ireland -Work on one of their leading brands who boast an audience of 30m+ monthly readers -Join a growing data & analytics team and a company who has been investing heavily to boost their data infrastructure and capability over the past few years The Job Work with diverse stakeholders/teams which include Newsrooms, Product, Marketing, User experience and Technology Utilise SQL and Google Big Query to manipulate large data sets and build stakeholder friendly dashboards in Looker Work with data stakeholders to understands KPIs, data strategic and generate useful insights/recommendations for the business Conduct and deliver analysis on customer acquisition, audience measurement, digital and subscription analytics A/B testing to understand performance of campaigns, user journey and subscription acquisition Develop an excellent understanding of the media landscape You 2/3+ years experience in Data & Analytics Degree level educated Proficiency with SQL, Google Big query and any dashboarding tools (ideally Looker) Ideally some experience in Media but also open to other industries Apply Now You can apply for this role now by sending us your CV or by calling us now! Don't forget to look at vacancies on our website and register as a candidate. Jordan Matthews Executive Consultant Sphere Digital Recruitment currently have a variety of job opportunities across digital so feel free to get in touch with us to find out how we can help you. Sphere Digital Recruitment currently have a variety of job opportunities across digital so feel free to get in touch with us to find out how we can help you. Please take a look at our website. Sphere is an equal opportunities employer. We encourage applications regardless of ethnic origin, race, religious beliefs, age, disability, gender or sexual orientation, and any other protected status as required by applicable law. If you require any adjustments or additional support during the recruitment process for any reason whatsoever, please let us know.