🧪Response Synthesizer

Response Synthesizer nodes are responsible for sending the query, nodes, and prompt templates to the LLM to generate a response. There are 4 modes for generating a response:

1)Refine

Create and refine an answer by sequentially going through each retrieved text chunk.

Pros: Good for more detailed answers

Cons: Separate LLM call per Node (can be expensive)

2)Tree Summarize

When provided with text chunks and a query, recursively build a tree structure and return the root node as the result.

Pros: Beneficial for summarization tasks

Cons: Accuracy of answer might be lost during traversal of tree structure