Explore thousands of opportunities across Tech:NYC’s member network.


Prompt Engineer



New York, NY, USA
Posted on Wednesday, August 30, 2023

About Hebbia

Hebbia is reinventing the search engine to intelligently answer the world's most complex questions. Our AI understands and reasons over written knowledge to synthesize meaningful responses for users in seconds. We develop advanced algorithms and platforms that enable businesses to leverage the power of AI for enhanced decision-making, automation, and optimization. Our team of experts is dedicated to pushing the boundaries of innovation and delivering impactful solutions across various industries. We've raised significant funding from Peter Thiel, Index Ventures (via Mike Volpi), Jerry Yang (founder of Yahoo), Ram Sriram (one of the first investors in Google), and others, and have built the fastest-moving team in the world.

Job description

As Hebbia’s first prompt engineer, you will be at the forefront of a new art: teaching, instructing, and programming large language models to get the best from them.

Your role is to deeply understand our users’ needs, figure out and test the best way to prompt models to meet these needs, and then teach our users. You’ll work closely with our customer success, engineering, and product teams.

This role is based out of our New York City office in Soho.


  1. Understand our users’ needs: spend time with our users, deeply understand their explicit and implicit needs and where Hebbia can add the most value
  2. Figure out and test the best way to prompt models to meet these needs: discover the best way to prompt models - thinking through typical use cases and edge cases; and test - code your changes into the tool and continue to refine
  3. Work with engineering and product teams to implement best practices into tool: help engineering team code changes into tools, work with product teams to iterate on use cases and work flows
  4. Teach users: Share best practices with users, customer success & sales teams through documentation, onboardings etc.

Who you are

- Bachelor's or Master's degree in Computer Science, Data Science, Statistics, or a related field.

- Proficiency in Python and popular machine learning libraries (e.g., TensorFlow, PyTorch, scikit-learn) for model development and deployment

- Experience in AI or LLM product development preferred

- High level familiarity with architecture and operation of large language models

- Customer obsessed: extremely excited about diving deeply into user needs and workflows, and getting the best out of our tool for them

- Problem-solving and analytical skills: Ability to logically break down complex problems, propose precise but innovative solutions, think through edge cases

- Persistence and pace: iterate repeatedly and at pace to improve our prompting for users

- Communication: excellent communicator - with users, engineers, product teams - particularly adept at explaining complex technical concepts to non-technical audiences

- Leadership and teamwork: Proven experience collaborating with cross-functional teams. Strong interpersonal and communication skills to foster a collaborative and inclusive work environment.