Class LLMReranker

LLM-based implementation of the BaseReranker class. Uses AI Prompts to perform semantic reranking via large language models.

This reranker is useful when:

• You want to use your existing LLM infrastructure
• You need more control over the reranking logic via custom prompts
• Cohere or other dedicated rerankers are not available

Configuration:

• Requires a rerank prompt ID to be provided
• The prompt should accept 'query', 'documents', and 'topK' template variables
• The prompt should return JSON array: [{ index: number, score: number }, ...]

Usage:

const reranker = ClassFactory.CreateInstance<BaseReranker>(
    BaseReranker,
    'LLMReranker',
    '', // No API key needed, uses AI Prompts system
    '', // No model name, uses prompt configuration
    promptID,
    contextUser
);

const response = await reranker.Rerank({
    query: 'What is the capital of France?',
    documents: [
        { id: '1', text: 'Paris is the capital of France.' },
        { id: '2', text: 'London is in England.' }
    ],
    topK: 5
});
Copy