Cognitive Collective

Helping you find your next career in AI. Learn more about the job board on the Scale blog.

Are you a scaling AI startup? Email maxwell@scalevp.com to be added to our board.
131
companies
4,290
Jobs

Junior Prompt Engineer

Gong

Gong

Tel Aviv-Yafo, Israel
Posted on May 7, 2025

As a Junior Prompt Engineer (aka an LLM Whisperer) at Gong, you’ll play a key role in building features and capabilities powered by Large Language Models (LLMs) and Generative AI. You’ll collaborate with cross-functional teams, innovate through prompt design, and directly impact the future of Gong’s AI-driven product.

As a Junior Prompt Engineer, you will:

  • Design clear, creative, and effective prompts to drive user-facing product experiences.
  • Develop and iterate on prompt strategies (e.g., few-shot prompting, chain-of-thought) to optimize outputs from LLMs.
  • Analyze prompt performance, write evaluations, conduct experiments, and use data to continuously improve quality.
  • Partner with research, product, UX, and engineering teams to design features that solve real user needs using AI.
  • Troubleshoot and refine prompt behavior across various use cases.
  • Stay up to date with trends, tools, and best practices in prompt engineering, LLMs, and GenAI.
  • Dive into the fast-moving world of AI/ML with ongoing on-the-job learning.
  • Work with cutting-edge LLM technology that’s reshaping the future of work.
  • Help Gong continue to lead in a time of radical technological change.

You should apply if you are:

  • A strong communicator with exceptional command of language and attention to detail.
  • Creative, curious, and analytical, with the ability to turn vague ideas into structured prompt designs.
  • Familiar with core machine learning concepts and evaluation metrics (e.g., accuracy, precision, recall, F1 score).
  • Experienced or knowledgeable in prompting techniques and prompt engineering best practices (an advantage).
  • A team player who thrives in a fast-paced, dynamic environment.
  • Someone with strong business understanding, who can empathize with users, their goals, and perspectives.
  • Passionate about learning, especially in the fields of AI and NLP.

We operate in a flexible hybrid work model.

What makes Engineering at Gong unique?

Here at Gong, we trust and empower our employees with ownership to solve complex problems, make the right decisions, and build the best products that create radical impact. We call this “Own. Solve. Impact.”

If you are curious to explore Gong’s exciting world of AI and innovation - don’t delay. Apply now. Who knows, maybe there’s a Gongster in you!

About us

Gong empowers everyone in revenue teams to improve productivity, increase predictability, and drive revenue growth by deeply understanding customers and business trends; driving impactful decisions and actions. The Gong Revenue AI Platform captures and contextualizes customer interactions, surfaces insights and predictions, and powers actions and workflows that are essential for business success. More than 4,500 companies around the world rely on Gong to unlock their revenue potential. For more information, visit www.gong.io.

At Gong, we celebrate individuality and diversity, ensuring fairness and equal opportunities for all employees. We follow a hybrid work model that blends remote flexibility with in-office collaboration - allowing for autonomy, strong relationships, and effective teamwork.

If these values resonate with you, we’d love to have you on board!

To review Gong’s privacy policy, visit www.gong.io/privacy-policy for more details.

#LI-MK3