Abuse Investigator San Francisco at OpenAI — task breakdown

--- BEGIN UNTRUSTED EXTERNAL CONTENT (source: https://openai.com/careers/abuse-investigator-san-francisco/) --- Skip to main contentResearchProductsBusinessDevelopersCompanyFoundation(opens in a new window)Log inTry ChatGPT(opens in a new window)ResearchProductsBusinessDevelopersCompanyFoundation(opens in a new window)Abuse Investigator | OpenAICareersAbuse Investigator Intelligence & Investigations - San Francisco and Remote - USApply now(opens in a new window)About the TeamOpenAI’s mission is to ensure that general-purpose artificial intelligence benefits all of humanity. We believe that achieving our goal requires real world deployment and iteratively updating based on what we learn.The Intelligence and Investigations team supports this by identifying and investigating misuses of our products – especially new types of abuse. This enables our partner teams to develop data-backed product policies and build scaled safety mitigations. Precisely understanding abuse allows us to safely enable users to build useful things with our products.About the RoleAs an Abuse Investigator on the Intelligence and Investigations team, you will be responsible for detecting and/or reviewing malicious uses and activities of our platform and disrupting actors that abuse our policies and other harmful behavior. This will require expert understanding of our products and data and experience investigating threat actors. You will also respond to time sensitive escalations, especially those that are not caught by our existing tools and safeguards.This role requires deep domain-specific expertise in identifying, understanding, and mitigating risk from violent attacks and behavior, and terrorist-related activity. You’ll need experience investigating sophisticated and harmful threats and the ability to navigate ambiguous signals in a complex and adversarial threat environment. You’ll need a proven ability to quickly learn new processes, systems and team dynamics while thriving in ambiguous, rapidly changing, and high-pressure environments.This role will work PST hours and is remote-friendly, though you’re welcome to work from our San Francisco, New York, or Washington, DC offices if desired. The role will include resolving urgent escalations outside of normal work hours and on-call shift work. Investigations will involve sensitive content, including sexual, violent, or otherwise-disturbing material, to include child safety-related content. As such, you should have strong resiliency in managing similar high stress environments in the past.In this role, you will:Review leads, investigate activity and disrupt abusive operations in partnership with our policy, legal, and integrity teams focused on violent and terrorist activities, especially associated with time sensitive threat to life risksDevelop abuse signals and tracking strategies to help proactively detect harmful activity on our platformIdentify operational workflow improvements and processes that expedite work while still mitigating riskCommunicate investigation findings from your work with stakeholders internally and, at times, externallyDevelop a categorical understanding of our products and data, and work with technical teams to improve our data and toolingSupport an on-call process and role that requires rapid threat triaging, investigation, mitigation, sound judgement and concise briefing to senior leadershipBe someone people enjoy working with and appreciate the opportunity to help othersYou might thrive in this role if you:Have deep expertise in violent activity domains, or conducting professional casework involving violent offenders, extremist actors, or high-risk individuals violent activity mitigation, ideally developed through law enforcement, legal, government, crisis response, social work, behavioral analysis units, special operations or similar environmentsHave strong familiarity with technical investigations, especially using SQL and Python, in a government/military, think tank setting

Abuse Investigator San Francisco

Classified Tasks (16)

Augment (8)

Human-Only (8)

Job description