Interface CacheMetadata

Cache metadata returned from the provider

interface CacheMetadata {
cachedTokenCount?: number;
cacheHit?: boolean;
}

Index

Properties

cachedTokenCount? cacheHit?

Properties

`Optional`cachedTokenCount

cachedTokenCount?: number

The number of tokens retrieved from cache

`Optional`cacheHit

cacheHit?: boolean

Whether the request had a cache hit