Criminal Misuse Research Scientist
On site
London, United Kingdom
Full Time
01-04-2025
Job Specifications
About The AI Security Institute
The AI Security Institute is the largest team in a government dedicated to understanding AI capabilities and risks in the world.
Our mission is to equip governments with an empirical understanding of the safety of advanced AI systems. We conduct research to understand the capabilities and impacts of advanced AI and develop and test risk mitigations. We focus on risks with security implications, including the potential of AI to assist with the development of chemical and biological weapons, how it can be used to carry out cyber-attacks, enable crimes such as fraud, and the possibility of loss of control.
The risks from AI are not sci-fi, they are urgent. By combining the agility of a tech start-up with the expertise and mission-driven focus of government, we’re building a unique and innovative organisation to prevent AI’s harms from impeding its potential.
Criminal Misuse Research Scientist
The AI Safety Institute research unit is looking for an exceptionally motivated and talented Research Scientist to work on our Criminal Misuse team.
Criminal Misuse
The Criminal Misuse team seeks to understand how highly capable AI systems can be misused by criminals or people wishing to cause disruption to society. The team is responsible for developing threat models that the potentially undesirable outcomes that could arise from criminal misuse of frontier AI. Additionally, the team conducts research that studies vulnerabilities to criminal misuse from AI systems already in deployment as well as those soon to be deployed and seeks to develop potential mitigations.
Criminal Misuse is a strongly collaborative research team, led by the Societal Impacts Research Director, Professor Christopher Summerfield. Within this role, you will also have the opportunity to regularly interact with our highly talented and experienced staff across the Institute (including alumni from Anthropic, DeepMind, OpenAI, and ML professors from the Universities of Oxford and Cambridge), as well as with other partners from across government.
Person Specification
We are seeking a talented and ambitious Research Scientist who excited about developing and implementing our research vision for this team. The successful candidate will have strong technical skills, including experience with Frontier AI systems, a visible research track record, and a demonstrable interest in AI Safety. Ideally, the candidate will also have experience in studying the potential misuse of Frontier AI systems, including by criminals, terrorists or other organised groups, or a track record of research relating to understanding the use of AI for topics like financial fraud, scams, influence operations, or radicalisation.
Required Skills And Experience
In this role, you will need work effectively within a team and will be expected to contribute to broader discussions about goals and strategy. However, you will be expected to be self-driven, to champion your own projects, to define the most important questions to answer, and to design and implement those experiments with the support of software engineers, data scientists and delivery staff. The Research Scientist should be prepared not only to lead research projects, but also to present them in a compelling way to decision-makers so that they create real impact. We would be particularly excited to hear from people who have the following skills and experience:
Demonstrable interest in AI Safety, and especially misuse of AI
Previous research experience with frontier AI systems (such as fine-tuning AI models)
Strong research experience in Computer Science, AI, or a related field (PhD-level or equivalent), including in experimental design and research problem selection
A track record of writing production quality code efficiently, especially using Python
Strong quantitative and statistical skills
Excellent verbal communication skills across technical and non-technical audiences
Published and/or forthcoming work on research topics relevant to the role (e.g., AI’s impact on society, multimodal AI, AI and criminal misuse)
Demonstrable experience of running research experiments involving AI models and/ or human participants
A collaborative approach to work, and experience of multi-disciplinary teamwork
Desired Skills And Experience
Experience of running AI capability evaluations
Research or technical experience with multimodal AI – in particular, audio and video
A background in research relating to the (criminal) misuse of AI systems
Experience of utilising public sector datasets
Salary & Benefits
We are hiring individuals at all ranges of seniority and experience. Your dedicated talent partner will work with you as you move through our assessment process to explain our internal benchmarking process. The full range of salaries are available below, salaries comprise of a base salary, technical allowance plus additional benefits as detailed on this page.
Level 3 - Total Package £65,000 - £75,000 inclusive of a base salary £35,720 plus additional technical talent allowance of between £29,280 - £39,280
Level 4 - Total Package £85,000 - £95,000 inclusive of a base salary £42,495 plus additional technical talent allowance of between £42,505 - £52,505
Level 5 - Total Package £105,000 - £115,000 inclusive of a base salary £55,805 plus additional technical talent allowance of between £49,195 - £59,195
Level 6 - Total Package £125,000 - £135,000 inclusive of a base salary £68,770 plus additional technical talent allowance of between £56,230 - £66,230
Level 7 - Total Package £145,000 inclusive of a base salary £68,770 plus additional technical talent allowance of £76,230
This role sits outside of the DDaT pay framework given the scope of this role requires in depth technical expertise in frontier AI safety, robustness and advanced AI architectures.
There are a range of pension options available which can be found through the Civil Service website.
Selection Process
In accordance with the Civil Service Commission rules, the following list contains all selection criteria for the interview process.
Additional Information
Internal Fraud Database
The Internal Fraud function of the Fraud, Error, Debt and Grants Function at the Cabinet Office processes details of civil servants who have been dismissed for committing internal fraud, or who would have been dismissed had they not resigned. The Cabinet Office receives the details from participating government organisations of civil servants who have been dismissed, or who would have been dismissed had they not resigned, for internal fraud. In instances such as this, civil servants are then banned for 5 years from further employment in the civil service. The Cabinet Office then processes this data and discloses a limited dataset back to DLUHC as a participating government organisations. DLUHC then carry out the pre employment checks so as to detect instances where known fraudsters are attempting to reapply for rol...
About the Company
We’re building a team of world leading talent to advance our understanding of frontier AI and strengthen protections against the risks it poses – come and join us: https://www.aisi.gov.uk/. The AISI is part of the UK Government's Department for Science, Innovation and Technology. Know more
Related Jobs
- Company Name
- Explore Group
- Job Title
- Platform Engineer
- Job Description
- Platform Engineer – AI Tech Start-Up – Remote First (1 Day/Month in Manchester) We’re a fast-growing AI tech startup on a mission to build cutting-edge solutions that harness the power of artificial intelligence. We're looking for a Platform Engineer to help us scale our infrastructure and support the growth of our platform from the ground up. What you’ll do: Design, build, and maintain secure, scalable infrastructure on AWS Develop and manage Infrastructure as Code (Terraform/CDK/etc.) Set up and optimize CI/CD pipelines and observability tooling Work closely with engineering and data science teams to enable smooth delivery What we're looking for: Proven experience with AWS and infrastructure engineering Strong understanding of cloud-native architecture and best practices Experience with IaC, containers (Docker), and CI/CD tools Startup mentality: proactive, adaptable, and collaborative What we offer: Fully remote with just 1 day per month in our Manchester office A chance to shape the platform and infrastructure from an early stage Work alongside a passionate, mission-driven team
- Company Name
- Energy Job Search
- Job Title
- Engineer - Nuclear System Engineer (Sheffield / Glasgow / Manchester / Epsom / Bristol)
- Job Description
- Job Description Do you enjoy working in safety critical industries? Do you like delivering solutions to technically complex problems? Join us as a Nuclear Safety Engineer and play a vital role in assessing the risks for our nuclear clients to help them and us to realise our low carbon energy ambitions, shaping a better future for our planet and its people. Your Purpose On a typical day working in this role, you might be producing a hazards assessment or authoring a complex safety case, justifying and supporting the critical decision-making in the design, operation, and/or decommissioning of nuclear facilities. On another day you may be working to influence the client's strategic direction to support obtaining a nuclear site licence for their innovative design, networking to develop the business pipeline within your capability or doing a technical presentation to the regulator. This role will also provide you with the opportunity to work with diverse clients from defence, nuclear generation and nuclear new build including innovative players from the fusion and SMR markets. You will be keen to support technical delivery of projects, address technically complex problems and present the solutions to different stakeholders. You will have the drive to deliver excellent technical work, paying attention to detail without missing out on the bigger picture. You will have the opportunity to contribute to and learn from the wider technical community within AtkinsRéalis, taking advantage of the global expertise we have to foster collaboration within multidisciplinary engineering teams. You will also begin to develop and mentor junior engineers to further support our growth and improve our capability for project delivery to clients whilst strengthening your leadership skills. Why work for AtkinsRéalis? The UK is the first major economy to legislate for a Net Zero target by 2050. To achieve this, our Energy Teams are ensuring a mix of secure and sustainable energies that can meet our industry and lifestyle demands today, and in 30 years' time. We help to power our world through exciting new technologies and intelligent cybersecurity systems on projects that vary greatly in size, scope, and scale. So, you'll be creating the right safe and resilient systems across nuclear power, renewables, decarbonisation development, new builds and energy efficiency. We value your diversity and believe that everyone deserves to thrive - no exceptions. You'll be part of a culture committed to finding new talent from underrepresented groups. We're Disability Confident, an Inclusive Employer, and support STEM Returners. We also want to see more women in senior roles at AtkinsRéalis. In the energy sector, we've signed up to the AXIS Pledge, promising to make equal pay, equal leadership, and equal opportunities a reality. Security Clearance This role may require security clearance and offers of employment will be dependent on obtaining the relevant level of clearance. If this is necessary, it will be discussed with you at interview. The vetting process is delivered by United Kingdom Security Vetting (UKSV) and may require candidates to provide proof of residency in the UK of 5 years or longer. If applying to this role please do not make reference to (in conversation) or include in your application or CV, details of any current or previously held security clearance. We are committed to promoting a diverse and inclusive community - a place where we can all be ourselves, thrive and develop. To help embed inclusion for all, from day one, we offer a range of family friendly, inclusive employment policies, flexible working arrangements and employee networks to support staff from different backgrounds. As an Equal Opportunities Employer, we value applications from all backgrounds, cultures and ability. Worker Type Employee Job Type Regular At AtkinsRéalis, we seek to hire individuals with diverse characteristics, backgrounds and perspectives. We strongly believe that world-class talent makes no distinctions based on gender, ethnic or national origin, sexual identity and orientation, age, religion or disability, but enriches itself through these differences.
- Company Name
- Motorway
- Job Title
- Senior Technical Lead
- Job Description
- About Motorway Motorway is the UK’s fastest-growing used car marketplace – our award winning, online-only platform connects private car sellers with over 7,500 verified dealers nationwide, who compete to offer the best price. Founded in 2017, our technology makes the process refreshingly easy, earning us an 'Excellent' Trustpilot rating with over 70,000 reviews. We're not just building a platform; we're changing how people sell cars. Backed by leading investors like Index Ventures and ICONIQ Growth, and following a successful $190 million funding round, we're on a mission to transform the used car market. About The Team Hi, I'm Matt, VP of Engineering at Motorway! I'm leading the charge to build the next generation of Motorway products, and I'm looking for a passionate and experienced Senior Technical Leader to join our team. We're disrupting the used car marketplace with cutting-edge technology, and we need your help to propel our products to new heights. Our team is unique because we're not just building software; we're revolutionising an entire industry. We work in a fast-paced, collaborative environment where everyone's ideas are valued. We're committed to innovation and using the latest technologies to deliver exceptional experiences for our customers. If you're excited about making a real impact and working with a talented team, then this is the place for you! About The Role At Motorway, we believe exceptional engineering leaders excel in three key areas: People Management, Technical Leadership, and Driving Results. We're looking for someone who can inspire and guide a team, provide technical expertise, and deliver impactful outcomes. Technical Leadership: Collaborate with product counterparts to define objectives, scope projects, and create effective backlogs. Identify and address cross-team dependencies. Own the end-to-end delivery of projects, breaking down ambiguous requirements into achievable milestones. Work with the Head of Engineering to align the team's backlog with the long-term technical strategy. Implement and maintain best engineering practices across planning, coding, design, quality, monitoring, deployment, and security. Ensure the quality of deliverables, including bug-free releases, clean code, and well-monitored systems. Own the target reference architecture and oversee design decisions. Communicate effectively with stakeholders at all levels, reporting up and down. Stay abreast of emerging technology trends and explore their application to Motorway products. Driving Results: Communicate clear goals and expectations to the team. Guide the team in running agile ceremonies (sprint planning, grooming, story mapping, etc.). Provide technical guidance and facilitate discussions. Own project estimations and guide team members on estimation techniques. Manage the team's backlog, balancing tech debt and feature delivery. Facilitate retrospectives to drive continuous improvement. Identify skill gaps and facilitate training on new technologies. Streamline processes for faster and smoother onboarding. Encourage innovation and plan spikes for exploring new technologies. Ensure the team understands and utilises company-wide tooling. Team Leadership: Lead and develop a high-performing team of 4-6 senior frontend and backend developers. Guide their career progression, identify skill gaps, and support their learning goals. Manage the recruitment process, including interviews, feedback, and onboarding. Monitor team health and well-being in collaboration with PMs and senior developers. About You You have a solid track record of leading and developing high-performing engineering teams. You can guide system design, architectural solutions, and ensure best engineering practices are followed. You can break down ambiguous requirements into clear milestones and deliver value iteratively. You have excellent communication skills and can work effectively with cross-functional teams. You could be a great fit if You're passionate about building high-quality products and leading talented engineers. You thrive in a fast-paced, collaborative environment. You're proactive, results-oriented, and have a strong sense of ownership. You're excited about the opportunity to disrupt the used car industry. You might not be a great fit if You prefer working independently with minimal collaboration. You're not comfortable with ambiguity or rapid change. You lack experience in leading and developing engineering teams. Interview Process Skills Our interview process is designed to give you a comprehensive understanding of the role and Motorway, while allowing us to assess your skills and experience. It typically involves the following stages: Initial Screening Call (30 minutes): A conversation with a member of our Talent Team to discuss your background and the role. System Design Interview (1 hour): A deep dive into your technical expertise and problem-solving skills with a senior engineer. Skills Assessment Interview (1 hour): A meeting with the team for a skills-based assessment. Final Interview (1 hour): A conversation with the Head of Engineering to discuss your leadership and values. You can expect to hear back from us within 2-3 business days of each interview stage. You'll have the opportunity to speak with a Talent Partner throughout the process should you have any questions or need any accommodations.
- Company Name
- Barclays
- Job Title
- Synapse Core Platform Technical Lead
- Job Description
- Platform owner and technical lead for a new workflow orchestration product that will digitise, automate and transform end-to-end workflow journeys via best-in-class in-house, open source and vendor capabilities for the Markets division and beyond Drive and make detailed design and architecture discussions aligned with broader technical strategy Ensure alignment to broader technical strategy, promoting re-use, adoption of minimum technical bar Managing infrastructure and data needs, functional and non-functional requirements, product lifecycle Oversee code quality, performance, and scalability of technical solutions Ensure adoption of modern development practices and DevOps standards Ensure proper documentation of technical designs and decisions Interface with product teams and business stakeholders to ensure technical implementation aligns to product goals and business priorities Purpose of the role To develop, and evolve the banks technology architecture through relevant solutions, strategies and execution plans aligned to and prioritized by business and technology objectives, including the development, evolution and adoption of foundational platforms and products. Accountabilities Development, evolution and implementation of the banks technology architecture and strategies aligned to the business and technology objectives, unlocking execution and run. Collaboration with stakeholders, including Enterprise Architecture teams and other developers to provide subject matter expertise and share knowledge to foster continuous improvement, and clients to understand and deliver on their technical needs. Motivation and leadership of a diverse collection of technologists, business and operations teams and enterprise leaders, with goal to align business & technology strategy & standards, identifying opportunities and connecting people. Assessment of new technologies to address current and future business needs, through a combination of curiosity and problem-solving skills. Determination of the optimal solutions while balancing continuous requirements imposed by compliance, governance, security and funding, through deep understanding of the business and customer outcomes and maintaining a strong and steady grasp on the underlying technologies. Monitoring and analysis of the performance, resiliency and stability of applications to identify and resolve issues and communicate and document key findings to stakeholders. Compliance with applicable regulatory standards and identification of industry developments that may impact the banks operations and controls to enhance the banks application portfolio. Support of engineering and architecture community initiatives to mentor team members, streamline operations, share and grow knowledge. Director Expectations To manage a business function, providing significant input to function wide strategic initiatives. Contribute to and influence policy and procedures for the function and plan, manage and consult on multiple complex and critical strategic projects, which may be business wide.. They manage the direction of a large team or sub-function, leading other people managers and embedding a performance culture aligned to the values of the business. Or for an individual contributor, they lead organisation wide projects and act as deep technical expert and thought leader, identifying new ways of working and collaborating cross functionally. They will train, guide and coach less experienced specialists and provide information affecting long term profits, organisational risks and strategic decisions.. Provide expert advice to senior functional management and committees to influence decisions made outside of own function, offering significant input to function wide strategic initiatives. Manage, coordinate and enable resourcing, budgeting and policy creation for a significant sub-function. Escalates breaches of policies / procedure appropriately. Foster and guide compliance, ensure regulations are observed that relevant processes in place to facilitate adherence. Focus on the external environment, regulators, or advocacy groups to both monitor and influence on behalf of Barclays, when appropriate. Demonstrate extensive knowledge of how the function integrates with the business division / Group to achieve the overall business objectives. Maintain broad and comprehensive knowledge of industry theories and practices within own discipline alongside up-to-date relevant sector / functional knowledge, and insight into external market developments / initiatives. Use interpretative thinking and advanced analytical skills to solve problems and design solutions in often complex/ sensitive situations. Exercise management authority to make significant decisions and certain strategic decisions or recommendations within own area. Negotiate with and influence stakeholders at a senior level both internally and externally. Act as principal contact point for key clients and counterparts in other functions/ businesses divisions. Mandated as a spokesperson for the function and business division. All Senior Leaders are expected to demonstrate a clear set of leadership behaviours to create an environment for colleagues to thrive and deliver to a consistently excellent standard. The four LEAD behaviours are: L – Listen and be authentic, E – Energise and inspire, A – Align across the enterprise, D – Develop others. All colleagues will be expected to demonstrate the Barclays Values of Respect, Integrity, Service, Excellence and Stewardship – our moral compass, helping us do what we believe is right. They will also be expected to demonstrate the Barclays Mindset – to Empower, Challenge and Drive – the operating manual for how we behave.