Software Engineer, Trust & Safety Job at Gamma, San Francisco, CA

  • Gamma
  • San Francisco, CA

Job Description

Why this role matters now

AI has dramatically lowered the barrier for bad actors. Generating convincing phishing pages, spinning up realistic-looking fraudulent accounts, and producing abusive content at scale no longer requires specialized skill—a motivated attacker with access to widely available models can do it. The volume and sophistication of platform abuse is increasing faster than traditional approaches can keep up with.

At the same time, AI is transforming what's possible on the defensive side. A small, sharp T&S team equipped with frontier models can now build detection, triage, and response systems that would have required a team five times the size just a couple of years ago. AI-assisted content scanning, automated investigation workflows, and intelligent alert prioritization mean that a lean team can protect millions of users—if they build the right infrastructure.

About the role

Gamma is tackling one of the most critical challenges for any fast-growing AI platform: keeping millions of users safe while preserving the creative freedom that makes the product magical. As a Trust & Safety Engineer, you'll architect the systems that protect our platform from phishing, abuse, fraud, and malicious content, all while ensuring Gamma stays fast, reliable, and delightful to use.

You'll join a small, high-impact team building the foundation for trust at scale. You'll design infrastructure that serves millions, ship improvements daily, and build the internal tools that let our support teams act quickly on threats. You'll collaborate across engineering, product, and design to define how Gamma approaches safety for the long term.

Our team has a strong in-office culture and works in person 4–5 days per week in San Francisco. We love working together to stay creative and connected, with flexibility to work from home when focus matters most.

What you'll do

  • Own detection and prevention systems for fraud, abuse, spam, and malicious content across millions of daily users

  • Design and build scalable trust infrastructure including rate limiting, content scanning, anomaly detection, and account security

  • Build tools that empower internal support teams to investigate and act on suspicious or malicious activity

  • Investigate and resolve complex security incidents with limited context

  • Partner with engineering and product to balance security with user experience

  • Shape Gamma's long-term trust and safety strategy and technical roadmap

  • Leverage AI/LLM-based detection to stay ahead of AI-generated abuse—phishing, fraud, and malicious content that's increasingly indistinguishable from legitimate activity

  • Build automated triage and investigation workflows that let a small team operate at the scale of a much larger one

What you'll bring

  • 5+ years as a software engineer with a focus on abuse, spam, or fraud prevention

  • Strong systems thinking and experience building highly available web APIs, with proficiency in at least one programming language and comfort working across a modern web stack

  • Hands-on experience implementing trust features like rate limiting, content detection, and fraud prevention

  • Experience with event streaming systems (Redis, Kafka, or similar)

  • Passion for security, user protection, and solving problems at scale

Nice to have

  • Experience with AI/LLMs for content moderation, or familiarity with TypeScript, Prisma, Apollo GraphQL, or AWS

  • Experience building AI-assisted moderation pipelines or using frontier models for automated abuse detection and response

  • Familiarity with the evolving AI threat landscape—how generative models are being used for phishing, social engineering, and content abuse at scale

Compensation range:

The base salary for this full-time position, which spans multiple internal levels depending on qualifications, ranges between $180K - $310K plus benefits & equity.

Final offer amounts are determined by multiple factors, including but not limited to experience and expertise in the requirements listed above.

If you're interested in this role but you don't meet every requirement, we encourage you to apply anyway! We're always excited about meeting great people.

Job Tags

Full time, Work at office, Work from home

Similar Jobs

The Borgen Project

Nonprofit Leadership Internship Job at The Borgen Project

From CNN to The Huffington Post, the world is talking about the innovative movement that is downsizing global poverty. The Borgen Project believes that leaders of the most powerful nations on earth should be doing more to address global poverty. The national campaign is... 

Nashville Veterinary Specialists + Animal Emergency

Veterinary Assistant/Receptionist Job at Nashville Veterinary Specialists + Animal Emergency

 ...Veterinary Assistant/Veterinary Receptionist The Veterinary Assistant/Veterinary Receptionist provides vital support to our veterinarians and veterinary technicians by ensuring a clean, safe, and efficient clinical environment. This role involves handling animals,... 

Ski Windham

Busser Job at Ski Windham

 ...weekends and holiday are needed. Conditions: This role is primarily performed indoors in a fast-paced restaurant environment. Position Summary: The Busser plays an important role in creating an exceptional dining experience by ensuring tables are cleaned,... 

Payne & Dolan Incorporated

Solar Design Engineer Job at Payne & Dolan Incorporated

 ...structures, or providing site engineering and construction solutions for solar,Walbec is yourbridge toexpertisein construction and engineering....  ...sites throughout the Midwest. The Position: The Solar Design Technician will work with a project team throughout the design... 

Christus Health

CHRISTUS DOD SkillBridge Program - Spohn Surgical Hospital Job at Christus Health

 ...Description Summary: In collaboration with the U.S. Department of Defense (DoD), the CHRISTUS Health SkillBridge Internship Program provides military service members who are within 180 days of separation from military service, with opportunities in a variety of different...