Cognitive Collective

Helping you find your next career in AI. Learn more about the job board on the Scale blog.

Are you a scaling AI startup? Email to be added to our board.

Software Engineer, Backend Infrastructure



Software Engineering, Other Engineering
San Francisco, CA, USA
Posted on Monday, March 11, 2024

Why Harvey

Harvey is a secure AI platform for professionals in law, tax, and finance that augments productivity and automates complex workflows. Harvey uses algorithms with reasoning-adept LLMs that have been customized by our expert team of lawyers, engineers and research scientists. We’ve found product market fit and are scaling our team very quickly. Some reasons to join Harvey are:

  • Exceptional product market fit: We have partnered with the largest law firms and professional service providers in the world like A&O, PwC, and many others.

  • Strategic investors: Raised over $100 million from strategic investors including Sequoia, Kleiner Perkins, and the OpenAI Startup Fund.

  • World-class team: Harvey is hiring the best technical and non-technical talent from places like DeepMind, Google Brain, Stripe, FAIR, Tesla Autopilot, Superhuman, and Glean.

  • Partnerships: Our engineers and researchers work directly with OpenAI to build the future of generative AI and redefine professional services.

  • Performance: $0-20M ARR in the last 12 months.

  • Value: Top of market cash and equity compensation.

About the Role

As a Software Engineer on the Infrastructure team at Harvey, you will build and maintain the infrastructure for serving our legal AI platform at scale. We are looking for software engineers with past infrastructure experience building large-scale distributed systems who are excited to build the foundational infrastructure for a fast growing startup.

This role is based in San Francisco, CA. We use an in-person work model and offer relocation assistance to new employees.


  • Build and deploy a globally-redundant distributed system with 1000+ servers (using Kubernetes and 20+ other tools/services), emphasizing reliability.

  • Scale our infrastructure to handle billions of requests and petabytes of data per month, spread across thousands of data stores (SQL DBs, vector DBs, cloud storages, caches).

  • Ensure our infrastructure adheres to NSA-level security constraints.

  • Debug production issues across services and multiple levels of the stack.

  • Enable the engineering organization to move faster by setting up standards, tooling, and processes.


  • 5+ years of experience building and scaling distributed systems.

  • A deep understanding of how infrastructure-layer (Kubernetes, Database, OS, Cloud Storage etc) software systems work.

  • Strong attention to detail and spidey sense for where and when things could go wrong.

  • Track record of shipping high quality products.

  • Strong programming skills and general Computer Science knowledge.


In consideration of market analysis and relevant factors, the salary range for this position is set between $190,000 and $265,000. However, adjustments outside of this range may be considered for candidates whose qualifications significantly differ from those outlined in the job description. Additionally, this role is eligible to participate in our equity plan and benefits program. Benefits include, but not limited to: Comprehensive health, dental and vision coverage, retirement benefits (401k match up to 4%), and flexible PTO.

Harvey is an equal opportunity employer and does not discriminate on the basis of race, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition, or any other basis protected by law.