Protected_Protected property to store additional provider-specific settings
ProtectedthinkingState tracking for streaming thinking extraction Providers should initialize this if they support thinking models
Get the current additional settings
Read only getter method to get the Anthropic client instance
ProtectedapiOnly sub-classes can access the API key
Anthropic natively supports assistant prefill
Anthropic supports streaming
Anthropic natively supports tool calling (tool_use / tool_result content blocks).
ProtectedaddAdd thinking content to a chat completion message
OptionalthinkingContent: stringProtectedBuildThe result of a cancelled request, the same for every driver: a failed result with no choices,
statusText 'cancelled', and an errorInfo that says Cancelled (Fatal, never failed over) —
or, when the signal was aborted by a timeout, a retriable NetworkError.
Optionaloptions: { error?: unknown; message?: string; signal?: AbortSignal }Optionalerror?: unknownThe error the abort raised, kept on exception.
Optionalmessage?: stringThe message to report; defaults to one naming the signal's reason.
Optionalsignal?: AbortSignalThe request's abort signal, read for why it was aborted.
Process a chat completion request. If streaming is enabled and supported, this will route to the streaming implementation.
Process multiple chat completion requests in parallel. This is useful for:
Array of chat completion parameter objects
Optionalcallbacks: ParallelChatCompletionsCallbacksOptional callbacks for progress and individual completions
Promise resolving to an array of ChatResults in the same order as the input params
Classification through a driver method is deprecated along with the legacy AI
Actions system, its only caller, and will be removed in the next major version. Most drivers
do not implement it. Run an AI Prompt through AIPromptRunner (@memberjunction/ai-prompts)
instead, which adds model selection, failover and cost tracking.
Clear all additional settings This is useful for resetting the state of the provider or when switching between different configurations.
Utility method to map a MemberJunction role to OpenAI role
ProtectedcreateProtectedextractExtract thinking content from non-streaming content This method handles case-insensitive extraction of thinking blocks
ProtectedfinalizeCreate the final response from streaming results for Anthropic
ProtectedflushReturns (and clears) any user-visible content the thinking-tag stripper is still holding back at
the end of a stream. Mid-stream, processStreamChunkWithThinking holds back a trailing
fragment that could be the start of a <think>/</think> tag so a split tag never leaks as
partial text; once the stream ends, such a fragment is real content and must be emitted (bug A5).
Only flushes when NOT inside a thinking block: an unterminated <think> block's buffered text is
reasoning, not answer, and is left held back (never surfaced as visible content). Returns ''
when thinking extraction isn't active (no state) or there's nothing to flush.
ProtectedformatFormat messages for Anthropic API with caching support. Handles both text and multi-modal content (images).
Messages to format
Whether to enable caching
Formatted messages
ProtectedformatFormat system messages for Anthropic API with caching support. System messages support multi-modal content (images).
Messages to format
Whether to enable caching
Flattened array of formatted content blocks
Anthropic supports PDF and image file inputs natively.
ProtectedgetGet the thinking tag format for this provider Providers can override this to customize the thinking tag format
ProtectedhandleTemplate method for handling streaming chat completion This implements the common pattern across providers while delegating provider-specific logic to abstract methods.
ProtectedinitializeInitialize thinking stream state for streaming extraction
ProtectedIsWhether a request ended because it was aborted: its signal is aborted, the error is an abort by
name (AbortError, APIUserAbortError, RequestAbortedError), or IsProviderAbortError
recognizes it.
Optionalsignal: AbortSignalProtectedIsRecognizes an abort error the shared names miss. A driver whose SDK raises its own class for an aborted request overrides this. Default: false.
ProtectedisExtends the framework's metadata-flag test with a text fallback: a message whose text opens with
the runtime-state or agent-specialization tag literal is treated as the trailing fragment even
when the caller passed plain ChatMessages without metadata. Forged tags in history cannot
reach here as an opening literal because the agent layer escapes them before sending.
ProtectednonProtectedprocessProcess streaming chunk with thinking extraction This method handles case-insensitive extraction across chunk boundaries
ProtectedprocessProcess a streaming chunk from Anthropic
ProtectedresetReset streaming state for a new request. Overrides the base-class hook so
BaseLLM.handleStreamingChatCompletion calls this both at the start of a
request AND in its finally block — the latter releases accumulated
thinking buffers (which can grow to 100k+ chars on extended-thinking
outputs) and prevents state from a prior request bleeding into the next.
See audit R2-C5.
ProtectedresetReset thinking stream state
Set additional provider-specific settings Subclasses should override this method to validate required settings
Provider-specific settings
ProtectedsplitSplits an outgoing request around its trailing volatile-state message, so a driver can place
its cache boundary on the last message of head and send tail uncached. Returns null when the
request has no trailing volatile state, in which case the driver formats the whole list as usual.
Neither array is a copy of the input's messages; only the list is new.
Summarization through a driver method is deprecated along with the legacy AI
Actions system, its only caller, and will be removed in the next major version. Run a
summarization AI Prompt through AIPromptRunner (@memberjunction/ai-prompts) instead,
which adds model selection, failover and cost tracking.
ProtectedsupportsCheck if the provider supports thinking models Providers should override this to return true if they support thinking extraction
ProtectedtrailingIndex of the trailing volatile-state message in an outgoing request, or -1 when there is none. The fragment is the LAST message, or the one before it when an assistant prefill has been appended after it. -1 is also returned when nothing precedes the fragment, because then there is no stable history for a provider to cache ahead of it.
Base class for all LLM sub-class implementations. Not all sub-classes will support all methods. If a method is not supported an exception will be thrown.