ProtectedColocatedThe host relational connection a colocated provider borrows to store and query
vectors in the same database as the application's entity data. undefined until
SetColocatedHost (or TryWireColocatedHost) is called.
ProtectedApiOnly sub-classes can access the API key
True when this driver does not accept ingestion via CreateRecord(s) /
UpdateRecord(s) — implies vectors are managed out-of-band (e.g.
SimpleVectorServiceProvider reads embeddings directly from
MJ: Entity Record Documents.VectorJSON). Pipelines that would
otherwise call ingestion APIs should short-circuit when this is true
to avoid spurious "unsupported" error logs.
Subclasses that genuinely support ingestion leave the default false.
Whether this provider's QueryIndex/HybridQuery params.id is the EntityDocumentID
(a GUID) rather than an external/logical index name. External services (Pinecone, Qdrant)
and DB-colocated providers key by an index name and return false (the default). The
in-process SimpleVectorServiceProvider reads vectors out of
MJ: Entity Record Documents keyed by EntityDocumentID, so it overrides this to true.
Callers that hold both identifiers (e.g. the duplicate-record detector) consult this to
pass the correct id for the resolved provider instead of assuming index-name semantics.
Whether this provider requires an API key / credential to operate. Defaults to true
for external, cloud-hosted vector services (Pinecone, Qdrant, …). Override and return
false for in-process / local providers that authenticate via the host process or the
application's own database rather than a remote credential — e.g. the in-memory
SimpleVectorServiceProvider, which reads vectors out of MJ: Entity Record Documents.VectorJSON and never calls an external service.
Callers that gate on a missing key (e.g. the Entity Vector Sync pipeline and the duplicate-record detector) consult this so a keyless local provider isn't rejected with a spurious "No API Key found" error.
Whether this provider stores vectors inside the application's relational database and
can resolve query results to entity records without an external mapping hop. Override
and return true in colocated providers (e.g. PgVectorColocated, SQLServerVectorDatabase).
Whether this provider supports hybrid (vector + keyword) search. Override and return true in providers that implement HybridQuery().
Convert SharedIndexFilterOptions to a provider-native filter object.
Override this method in provider subclasses to produce provider-specific filter syntax (e.g., Pinecone, Weaviate, Qdrant, etc.).
The high-level filter options
A native filter object, or undefined if no filters
Build per-record routing and operational directives for this provider.
Called by the generic sync pipeline once per source database row, before the
VectorRecord is constructed. The returned object is stored on
VectorRecord.providerTemporaryDirectives and passed to CreateRecords alongside
the stored metadata — but is never itself persisted in the vector index.
Providers override this to extract whatever routing values they need from
providerConfig (the parsed VectorIndex.ProviderConfig JSON) and from
sourceRecord (the raw database row). Example: the Pinecone driver reads
providerConfig.namespaceField, looks up the corresponding value in sourceRecord,
and returns { namespace: '<orgId>' } so CreateRecords can route each vector
to the correct Pinecone namespace without embedding org data in the stored metadata.
The default implementation returns an empty object — providers that do not need per-record routing need not override this method.
The raw database row being vectorized.
The parsed VectorIndex.ProviderConfig JSON blob.
An opaque key/value map consumed by this provider's CreateRecord(s).
Run a colocated query that fuses a vector component with an optional keyword component
in a single server-side statement, applying an optional metadata filter. Only meaningful
when SupportsColocatedQuery is true; the default implementation throws to surface
misuse on providers that don't support it.
Optional_contextUser: UserInfoOptionalindexName: stringOptionalindexName: stringDelete ALL records from an index. Use with caution.
The name of the index to clear
Optional_namespace: stringOptional namespace within the index
OptionalindexName: stringOptionalindexName: stringPerform a hybrid search combining vector similarity with keyword (BM25) matching. Only available on providers where SupportsHybridSearch is true. Default implementation falls back to a standard vector QueryIndex call.
OptionalcontextUser: UserInfoList vector IDs in an index with optional metadata filtering and pagination. Used by duplicate detection to discover which records exist in the index without loading entity data from the database.
List parameters including index name, optional metadata filter, and pagination
Page of vector IDs with optional pagination token for next page
Query the vector index with metadata filtering using SharedIndexFilterOptions.
Default implementation converts the filter options to a native filter object and delegates to QueryIndex. Providers can override BuildMetadataFilter() for custom filter syntax.
Standard query options with an additional metadataFilter field
OptionalcontextUser: UserInfoThe query response from the vector database
Standard vector query (abstract on the base). Delegates to ColocatedQuery in
vector-only mode and adapts the result into the QueryResponse envelope so callers
that only know QueryIndex (e.g. duplicate detection) keep working unchanged.
OptionalcontextUser: UserInfoWire in the host relational connection so this provider reuses it for colocated storage and queries instead of opening its own pool. No-op semantics for providers that ignore it; colocated providers require it before any operation.
Convenience used by callers that hold an opaque provider reference (the active MJ data
provider). If host implements IColocatedVectorHost and this provider supports
colocated queries, wire it in.
true if the host was wired in, false otherwise.
ProtectedwrapBuild a standard FAILURE BaseResponse.
Always return this (never a success response) from a catch block — returning a
success response on error silently swallows real failures and makes callers, and the
vectorization pipeline, believe an operation worked when it did not.
Optionalmessage: stringOptional human-readable error detail; falls back to a generic message.
ProtectedwrapBuild a standard SUCCESS BaseResponse. Shared across all drivers so every provider reports results in a uniform shape.
The provider-specific payload to attach to the response.
Colocated MemberJunction vector provider backed by the application's own PostgreSQL database via the pgvector extension.
Unlike PgVectorDatabase (which opens its own connection pool to a separate vector database), this provider borrows the active MJ data provider's connection through IColocatedVectorHost. Vectors live in the same database as the entity rows, written in the same transaction, and queried with true hybrid search (vector + full-text, fused via Reciprocal Rank Fusion) in a single statement.
Storage: each logical index is a sibling table with
id(TEXT PK),embedding(vector(N)),metadata(JSONB),content(TEXT), and a generatedtsv(tsvector) column for full-text. HNSW index on the embedding, GIN indexes on metadata and tsv.Wiring: callers obtain the instance via the class factory, then call VectorDBBase.TryWireColocatedHost with the active data provider before use.
Registered with the MJ class factory as
'PgVectorColocated'.