When a user asks a question to your bot, the first step consists in retrieving sections of your content that may contain relevant information to produce an answer. These sections are then injected as context into a parent prompt, as explained here.
Today, we are exposing a
sections API endpoint, specifically to retrieve relevant sections, without the completions part. The endpoint is part of the Enterprise plan, and is available at:
Head over to the docs for the full API documentation.
This opens up for a lot of new possibilities, such as using other completions models or finding thematic groupings of your content.