Cognitive Collective

Helping you find your next career in AI. Learn more about the job board on the Scale blog.

Are you a scaling AI startup? Email to be added to our board.

Full Stack LLM Engineer

Software Engineering
Posted on Thursday, May 30, 2024

Full Stack LLM Engineer

About the role at is transforming the way healthcare works, and we are looking for an exceptional Generalist Full Stack Engineer with LLM development experience to join our team. As a member of our team, you will be at the forefront of generative AI in healthcare, making a significant impact on the lives of patients around the world.

This role is central to developing applications that integrate & optimize large language models (LLMs) within our current products.


  • Security, security, security. We work with healthcare data so security is of the upmost importance. You need to know concepts like authentication, authorization, oauth2 and the various standards that are used when implementing.
  • Full lifecycle management of software applications, from development to deployment and maintenance, focusing on integrating large language models.
  • Develop both the front-end user interfaces and back-end services that leverage LLMs, ensuring high performance and seamless integration.
  • Collaborate with healthcare professionals to identify and explore new opportunities for applying AI in healthcare scenarios.
  • Manage APIs that interface with LLMs, ensuring they are scalable and can handle significant user loads and data volumes.
  • Develop evaluation process and criteria for implementing LLMs into different workflows.
  • Keep up-to-date with the latest developments in AI technologies and healthcare applications, continuously improving our solutions.
  • Deeply familiar with AWS or comparable cloud systems including infrastructure and networking components.


  • Strong background in Python and Javascript software development with experience developing and deploying AI models in productionExperience with Next.js, Express, Flask, FastAPI, Django or other server side API frameworks
  • Ability to quickly produce working prototypes An expert intuition at understanding development tradeoffs with regard to development speed, stability, system design and architecture
  • Understanding of various authorization and account connectivity standards like OAuth2, SAML, ActiveDirectory
  • Understand how to mitigate security risks with authentication, rate-limiting, and security led design
  • Experience with Cloud Operations and automating deployment, testing, and scaling including Docker and Terraform
  • Deft with shell, CI/CD, and cloud environments like AWS or GCP to connect and provision resources
  • Experience working with EHR, FHIR, Claims or other healthcare dataPassion for making a significant impact on the healthcare industry using AI
  • Must be US citizen or permanent resident, and currently living in the US

Compensation & Benefits

The salary for this role is $100,000 – $200,000. In addition to salary, total compensation includes the following:

  • Healthcare, dental, and vision insurance for your entire family
  • Equity (stock options) valued between $25,000 - $100,000.
  • Unlimited vacation and 15+ company holidays per year
  • Work directly with the founders

At, we are transforming the healthcare industry with cutting-edge Generative AI technology. As an Engineer at our company, you will work on projects that will improve the lives of millions of patients around the world. If you are passionate about using AI to make a significant impact on the healthcare industry and have experience in scaling Transformer Neural Network in production, we encourage you to apply today!

We take pride in our focus on equity. We are a proud equal opportunity employer and encourage individuals from all backgrounds and identities to apply for this position. We believe in fostering an inclusive and diverse workplace and are committed to supporting our employees’ professional growth and development.

Apply Now