Member Junction
    Preparing search index...

    PostgreSQL implementation of the CodeGen database provider. Generates PostgreSQL-native DDL for views, CRUD functions, triggers, indexes, full-text search, permissions, and other database objects.

    Registered with MJGlobal.ClassFactory against the canonical 'postgresql' platform key — SQLCodeGenBase resolves this provider via ClassFactory.CreateInstance(CodeGenDatabaseProvider, configInfo.dbPlatform).

    Hierarchy (View Summary)

    Index

    Constructors

    Accessors

    Methods

    addColumnSQL addDefaultConstraintSQL alterColumnTypeAndNullabilitySQL buildExecParamForField buildPrimaryKeyComponents callRoutineSQL canSelfJoinViewForVirtualNameField columnToken compareDataTypes conditionalInsertSQL dropDefaultConstraintSQL dropObjectSQL executeEntityPhased executeSQLFileViaShell foreignKeyIndexName formatDefaultValue formatIndexStatement formatInsertDefaultValue generateAllEntitiesSQLFileHeader generateBaseView generateCRUDCreate generateCRUDDelete generateCRUDParamString generateCRUDPermissions generateCRUDUpdate generateDropGuard generateForeignKeyIndexes generateFullTextSearch generateFullTextSearchPermissions generateInsertFieldString generateRootFieldJoin generateRootFieldSelect generateRootIDFunction generateSingleCascadeOperation generateSQLFileHeader generateTimestampColumns generateTimestampTrigger generateUpdateFieldString generateViewPermissions generateViewRefreshSQL generateViewTestQuerySQL getCheckConstraintsSchemaFilter getCompositeUniqueConstraintCheckSQL getCRUDRoutineName getEntitiesWithMissingBaseTablesFilter getFixVirtualFieldNullabilitySQL getForeignKeyIndexExistsSQL getMetadataSupportObjectsSQL getPendingEntityFieldsSQL getPrimaryKeyIndexNameSQL getRoutineNamesBySchemaSQL getSystemSchemasToExclude getViewColumnsSQL getViewDefinitionSQL getViewExistsSQL indexPrefix isIndexableForeignKey isParamRequired maxIdentifierLength needsClearCompanion parseColumnDefaultValue quoteSQLForExecution regenerateBaseView renderParameterType SetupDataSource shouldIncludeFieldInParams tableToken validateExpectedCRUDFunctions wrapInsertWithConflictGuard

    Constructors

    Accessors

    • get BatchSeparator(): string

      Returns the batch separator for the database platform. SQL Server: 'GO' PostgreSQL: '' (empty string, uses semicolons)

      Returns string

    • get NeedsVirtualFieldNullabilityFix(): boolean

      PostgreSQL requires a nullability fix for virtual (computed) fields in views. View columns derived from expressions may report incorrect nullability in information_schema.columns, so CodeGen must correct these after view creation.

      Returns boolean

    Methods

    • Generates ALTER TABLE ... ADD COLUMN SQL. SQL Server: ALTER TABLE [schema].[table] ADD colName TYPE [NOT] NULL [DEFAULT expr] PostgreSQL: ALTER TABLE schema."table" ADD COLUMN "colName" TYPE [NOT] NULL [DEFAULT expr]

      Parameters

      • schema: string
      • tableName: string
      • columnName: string
      • dataType: string
      • nullable: boolean
      • OptionaldefaultExpression: string

      Returns string

    • Builds the EXEC parameter fragment(s) for a single field when calling a tolerant update SP. Returns an array of @ParamName = value strings.

      For most fields this is just ['@FieldName = @variable']. But when clearValue is true and the field has a _Clear companion (see needsClearCompanion), an additional @FieldName_Clear = 1 is prepended so the tolerant SP actually sets the column to NULL instead of treating the NULL parameter as "leave unchanged".

      This is the single source of truth for the calling convention of tolerant update SPs. All codepaths that generate EXEC calls to spUpdate — cascade-update cursors, future SP-to-SP calls, etc. — should use this method to stay in sync with the SP declaration logic in generateCRUDParamString.

      Parameters

      • ef: EntityFieldInfo

        The entity field being passed

      • valueExpr: string

        The SQL expression for the value (e.g. @prefixed_var)

      • clearValue: boolean = false

        Whether this field is being explicitly set to NULL

      Returns string[]

    • Builds a set of PL/pgSQL components for working with an entity's primary key(s) in cascade operations: variable declarations, SELECT field list, FETCH INTO variable list, and named routine parameter assignments. Used by cascade delete and update-to-NULL generators to construct cursor-based loops.

      Parameters

      Returns {
          fetchInto: string;
          routineParams: string;
          selectFields: string;
          varDeclarations: string;
      }

    • Generates SQL to invoke a stored procedure or function. SQL Server: EXEC [schema].[spName] @Param1='val1', @Param2='val2' PostgreSQL: SELECT * FROM schema."spName"('val1', 'val2')

      Parameters

      • schema: string

        The schema containing the routine.

      • routineName: string

        The routine name (e.g., spUpdateExistingEntitiesFromSchema).

      • params: string[]

        Ordered array of parameter values as pre-formatted SQL strings. For SQL Server these become @ParamName='value' pairs; for PostgreSQL they become positional arguments.

      • Optional_paramNames: string[]

        Optional parameter names for SQL Server's @Name=value syntax. Ignored on PostgreSQL.

      Returns string

    • Returns boolean

      NOT supported. PG's strict CREATE OR REPLACE VIEW parser resolves view names against the existing catalog state at parse time, so a body that LEFT-JOINs the view-being-created to itself (e.g. for a self-FK's virtual NameField) raises 42P01 undefined_table on first creation. A CREATE OR REPLACE retry against a NULL-typed stub then fails with cannot change data type of view column ... from text to character varying(N) because PG enforces strict column-type compat in CREATE OR REPLACE.

      Returning false tells sql_codegen.ts to skip the self-join entirely for self-FK + virtual-NameField cases. The trade-off: the corresponding virtual column (e.g. RestoredFrom on vwRecordChanges) is not emitted. Matches the baseline-shipped vwRecordChanges shape, which never had this column either.

    • Generates a PL/pgSQL DO $$ block that drops both a named CHECK constraint (if one exists on the column, found via pg_catalog.pg_constraint) and the column's default value. Uses dynamic SQL (EXECUTE format(...)) to drop the constraint by name, then unconditionally runs ALTER COLUMN ... DROP DEFAULT.

      Parameters

      • schema: string
      • tableName: string
      • columnName: string

      Returns string

    • Generates a DROP statement for a database object (view/procedure/function). SQL Server: IF OBJECT_ID('...', 'P') IS NOT NULL DROP PROCEDURE ... PostgreSQL: DROP FUNCTION IF EXISTS ... CASCADE

      Note: This differs from generateDropGuard() which is used for CREATE OR REPLACE patterns. This method is used for cleanup operations.

      Parameters

      • objectType: "VIEW" | "PROCEDURE" | "FUNCTION"
      • schema: string
      • name: string

      Returns string

    • Phased per-entity execution for PG. Runs view → CRUD functions → view permissions against the target DB, guaranteeing phase 2 is skipped if phase 1 failed (so we never leave fn_create_* functions pointing at a missing or stale view's rowtype).

      Phase 1 routes through executeWithFallback so a 42P16 triggers the capture/drop/recreate/restore flow rather than blowing up. Phase 2 runs each CRUD function's CREATE individually — we do NOT concatenate them because node-pg's simple query protocol would then abort the whole batch on the first failure; running them separately gives a per-routine error signal. Phase 3 applies view-level GRANTs.

      Parameters

      • opts: {
            crudCreateSQL: string;
            crudDeleteSQL: string;
            crudUpdateSQL: string;
            entity: EntityInfo;
            tvfSQL: string;
            viewPermSQL: string;
            viewSQL: string;
            willRegenerate?: Set<string>;
        }

      Returns Promise<PhasedExecutionResult>

    • Composes the automatic foreign-key index name and enforces the dialect's identifier length limit. Dialect-independent in shape — {prefix}{table}_{column} — while the casing of the prefix, the table/column token spelling, and the length cap come from the dialect hooks.

      NOTE: the resulting names are deliberately NOT unified across dialects. SQL Server names from BaseTableCodeName/CodeName, PostgreSQL from snake-cased BaseTable/Name. Changing either would orphan every existing index in deployed databases (CodeGen would create new ones alongside the old), so the token hooks preserve each dialect's historical spelling exactly.

      Parameters

      Returns string

    • Generates a PostgreSQL view-regeneration block for an entity's base view.

      Includes all base table columns, parent/related field joins, and root field lateral joins. Applies a soft-delete WHERE filter when the entity uses soft deletes.

      Two-path emission (try-then-fallback). The output wraps CREATE OR REPLACE VIEW in a DO $$ ... EXCEPTION WHEN invalid_table_definition THEN DROP VIEW ... CASCADE; EXECUTE vsql; END $$ block. Why:

      • Happy path: CREATE OR REPLACE VIEW succeeds (new column list is a prefix of the existing one plus optional trailing additions). Zero destruction. No dependent views, functions, triggers, or grants are touched.

      • Sad path: PG raises SQLSTATE 42P16 invalid_table_definition for any column rename / reorder / type change / removal. The exception handler runs DROP VIEW ... CASCADE and re-executes the CREATE. Dependent codegen-managed functions (spCreate/spUpdate/spDelete returning SETOF vwFoo) and dependent views are CASCADE-dropped — they are regenerated later in the same codegen output stream, so by the end of the run all dependents are restored to the new shape. GRANTs on the view itself are also lost on the CASCADE; codegen always re-emits permissions immediately after the view, so they come back too.

      The runtime-apply path also calls this, so the live DB applies the same DO block. executeWithFallback (the runtime helper) becomes a no-op for these statements because the DO block handles 42P16 internally — but it still runs as a safety net for any other failure modes.

      What this DOES NOT preserve on the sad path: non-codegen-managed dependent objects (e.g. a hand-written sproc against this view that codegen doesn't know about). Those would be CASCADE-dropped and not restored. MJ codegen-generated sprocs cover all standard CRUD pathways; bespoke sprocs against base views are extremely rare in practice. If a project does have them, they need to be re-applied after a 42P16 fallback fires.

      This pattern matches the v5.30.x fix migration V202604282300 — which used the same DO/EXCEPTION construct to recreate vwEntityPermissions after the unquoted RoleName alias bug — proving the pattern is production-tested.

      Permissions are handled separately by sql_codegen.ts via generateViewPermissions().

      Parameters

      Returns string

    • Generates a PostgreSQL CREATE OR REPLACE FUNCTION for inserting a new record. The function accepts typed parameters for each writable field, performs an INSERT into the base table, and returns the newly created row from the base view via RETURN QUERY SELECT. Handles auto-increment PKs (using RETURNING ... INTO), UUID PKs (with COALESCE to gen_random_uuid()), and composite PKs. Also emits GRANT EXECUTE permissions for authorized roles.

      Prepends a DROP-all-overloads block (see generateDropAllOverloadsBlock) so adding/removing a column doesn't trigger PG's overload-ambiguity error.

      Wide entities (where useJsonArgShape returns true) emit a JSON-arg variant via generateCRUDCreateJsonArg — single p_data JSONB parameter, dynamic INSERT built from keys present in the payload. Same semantics; different wire shape needed because of PostgreSQL's 100-arg function ceiling.

      Parameters

      Returns string

    • PostgreSQL override: same tolerant-SP shape as the base class, but with PG's "all params after the first DEFAULT must also have DEFAULTs" rule enforced. Once any parameter becomes optional (or a _Clear companion is emitted), every subsequent parameter is forced to DEFAULT NULL even if it would otherwise be required, because PG function signatures don't allow gaps between defaulted params.

      All decision logic and dialect-syntax bits route through the same base-class helpers / dialect methods used by SQL Server — the only thing that differs is the sticky-defaults walk.

      Parameters

      Returns string

    • Generates a PostgreSQL DROP ... IF EXISTS ... CASCADE statement as a guard before creating or replacing a database object. For triggers, PostgreSQL relies on CREATE OR REPLACE on the trigger function, so a comment is emitted instead.

      Parameters

      • objectType: "VIEW" | "PROCEDURE" | "FUNCTION" | "TRIGGER"
      • schema: string
      • name: string

      Returns string

    • Generates the column-list or value-list portion of an INSERT statement, depending on whether prefix is empty (column names) or non-empty (parameter values).

      Empty prefix — produces dialect-quoted column names suitable for the INSERT INTO ... (col1, col2) clause.

      Non-empty prefix — produces the parameter-value list suitable for the VALUES (...) clause, with tolerant-SP behavior:

      • Special-date fields are substituted with the dialect's CurrentTimestampUTC() (created/updated) or NullLiteral (deleted-at).
      • GUID fields with database defaults emit a CASE that detects the empty-GUID sentinel and falls back to the database default; otherwise wraps with IsNull.
      • Non-nullable fields with defaults are wrapped in IsNull(@Param, default).
      • Nullable fields with non-NULL defaults emit a _Clear companion CASE so callers can distinguish "leave default" from "explicitly NULL."
      • Plain nullable fields with no default pass the parameter reference through directly (NULL flows through).

      Skips auto-increment, virtual, and non-updatable fields. The PK column can be optionally excluded (used by the two-branch GUID-PK insert pattern in generateCRUDCreate).

      Dialect-specific syntax is fully delegated to:

      • Dialect.QuoteIdentifier, Dialect.ParameterRef,
      • Dialect.IsNull, Dialect.NullLiteral,
      • Dialect.CurrentTimestampUTC, Dialect.EmptyUUIDLiteral,
      • formatInsertDefaultValue(ef) render hook (for type-strict dialects that need to massage default values).

      Parameters

      Returns string

    • Generates the SET clause body for an UPDATE statement with tolerant merge semantics. Each non-PK column wraps the parameter with the dialect's null-coalescing call against the column's existing value (SET [Col] = ISNULL(@Param, [Col]) on SQL Server, SET "col" = COALESCE(p_col, "col") on PostgreSQL) so omitting a parameter preserves the existing row value. Nullable columns whose database default is non-NULL also emit a _Clear companion branch that lets callers distinguish "leave unchanged" from "explicitly NULL."

      The full structural logic lives here in the base class; only the per-line render is dialect-specific and that's resolved through the Dialect accessor's helpers (QuoteIdentifier, ParameterRef, IsNull, NullLiteral). Subclasses can override to customize line formatting if a future dialect needs something different.

      Parameters

      Returns string

    • Returns DDL that creates/replaces the platform's metadata-management support objects (introspection views and the routines manage-metadata invokes via callRoutineSQL), or null when the platform ships them through migrations instead.

      These objects are CodeGen's own machinery — only CodeGen calls them — so platforms that return DDL here get it executed (idempotently) at the start of every manageMetadata run. That guarantees the objects can never be missing or version-skewed relative to the CodeGenLib code that calls them.

      SQL Server: returns null (objects ship in the baseline migrations). PostgreSQL: returns the full support-object DDL.

      Parameters

      • mjCoreSchema: string

      Returns string | null

    • Generates the SQL to retrieve pending entity fields that exist in the database but not yet in the MJ metadata. This is a large, platform-specific query.

      Parameters

      • mjCoreSchema: string

        The MJ core schema name (e.g., __mj).

      • OptionalentityIDs: string[]

        Optional list of entity UUIDs to scope the query to. When provided, the query filters to fields belonging to those entities only — used by Pass 2 to avoid re-scanning the entire schema for entities that haven't changed. undefined or empty preserves the prior unscoped behavior.

      Returns string

    • Returns a SQL query that lists every stored procedure / function name in the given schemas. Used by the post-run CRUD validator to diff expected vs actual routine presence in one round trip.

      The result set must contain exactly two columns: schema_name — the schema the routine lives in routine_name — the proc/function name as stored in the catalog

      SQL Server: queries sys.objects for procedures and functions. PostgreSQL: queries pg_proc joined to pg_namespace.

      Default: returns empty string. Providers that don't implement this opt out of the post-run CRUD validator (the validator returns no missing when this returns empty), preserving backwards compatibility for downstream subclasses that haven't been updated.

      Parameters

      • schemas: string[]

      Returns string

    • Decides whether a field should get an automatic foreign-key index. Dialect-independent.

      A field qualifies when it points at another entity and is a real, materialized column:

      • RelatedEntityID — the field is a foreign key. This is the base-table column that actually stores the relationship. (The sibling RelatedEntity field is a view join on that ID, not a base column; the two never disagree in practice — verified 0/793 divergence across the FK fields in the reference database — so keying off the ID is both equivalent and more direct.)
      • !IsPrimaryKey — a primary key is already covered by its own index. In 1:1 extension-table patterns the child's PK is also an FK to the parent, and indexing it again would be pure overhead.
      • !IsVirtual — virtual fields have no underlying column, so CREATE INDEX on one would reference a column that does not exist.

      The PK/virtual exclusions previously existed only on the PostgreSQL side; hoisting them here applies them to every dialect by construction. Current real-world exposure is zero (no FK field in the reference database is also a primary key or virtual), so this is a guard against a future case rather than a change in today's generated output.

      Parameters

      Returns boolean

    • Tolerant-SP semantics: returns true when this parameter must be provided by every caller (no default, no fallback). Pure decision logic — Pillar 1 of the cross-app migration architecture.

      • PKs: required on update, optional on non-AutoIncrement create (codegen emits a default that lets the database supply the value).
      • Non-PK on update: never required (merge semantics).
      • Non-PK on create: required only when the column is NOT NULL with no database default — i.e. a value the DB has no way to fill in.

      Parameters

      Returns boolean

    • Returns true when codegen should emit a <Param>_Clear companion parameter for the given field. The companion lets callers disambiguate "leave unchanged / apply DB default" (omit the parameter) from "explicitly set this column to NULL" (<Param>_Clear = 1). Required only for nullable columns whose database default is itself non-NULL — without the companion, a caller could not preserve a literal NULL because the dialect's IsNull wrap would always substitute the default.

      Routes the NULL-literal check through the dialect so future dialects can override what "this value is NULL" looks like in their generated SQL. Pure decision logic — no rendering.

      Parameters

      Returns boolean

    • PG-specific base-view regeneration with 42P16 recovery.

      Runs the provided CREATE OR REPLACE VIEW SQL through executeWithFallback on a dedicated connection: happy path issues the CREATE OR REPLACE directly, and only on SQLSTATE 42P16 does the capture/drop/recreate/restore dance fire inside a transaction that preserves every dependent view, function, grant, comment, and owner. See viewFallback.ts for the contract.

      willRegenerate is passed through so dependents CodeGen is about to rebuild in the same run are skipped at restore time (avoids restoring a stale captured definition against a newly-regenerated target).

      Parameters

      • entity: EntityInfo
      • viewSQL: string
      • OptionalwillRegenerate: Set<string>

      Returns Promise<void>

    • PostgreSQL implementation of CodeGenDatabaseProvider.SetupDataSource.

      Acquires the module-cached pg.Pool via PGConnection (so repeated CodeGen operations reuse the same pool — matching SQL Server's behavior), wires up PostgreSQLDataProvider, registers it as the active provider, and loads the audit user.

      User-loading asymmetry — SQL Server uses UserCache.Instance.Refresh(pool) which is hard-typed to mssql.ConnectionPool in @memberjunction/sqlserver-dataprovider. Refactoring it to be cross-platform would touch that package's public API; until then PG hand-queries vwUsers/vwUserRoles here. Same audit-user semantics (find Owner, else first user), just a different load path. Tracked for follow-up: unify behind a platform-agnostic cache that takes a CodeGenConnection.

      Env var resolution — PG_HOST / PG_PORT / PG_DATABASE / PG_USERNAME / PG_PASSWORD now flow through configInfo.{dbHost,dbPort,dbDatabase,codeGenLogin,codeGenPassword} via DEFAULT_CODEGEN_CONFIG (see Config/config.ts). The provider just reads configInfo.

      Returns Promise<DataSourceResult>

    • Cross-checks the entity-level AllowAPI/spGenerated/sp* configuration against the routines actually present in the database after CodeGen finishes. Returns one entry per missing routine.

      Why this exists: silent generation gaps (e.g. an entity dropped because an upstream batch errored, or stale entity-field metadata causing the PK check to fail) historically reported success at the pipeline level while leaving runtime CRUD broken. This validator turns that into a loud, actionable failure list before the install pipeline exits.

      What's expected per entity:

      • Skip virtual entities (no DB-backed routines).
      • For each of Create / Update / Delete:
        • Skip when the corresponding Allow{Type}API flag is false.
        • Look up the routine name via getCRUDRoutineName (which honors entity.spCreate/spUpdate/spDelete overrides; otherwise returns the dialect-generated default).
        • Report it as missing when not found in the DB catalog.

      Schema-level case sensitivity: SQL Server is case-insensitive, PostgreSQL is case-preserving. Both lookups normalize via lowercase to keep the validator dialect-agnostic.

      Default implementation works for both dialects via the getRoutineNamesBySchemaSQL helper. Providers may override to add platform-specific shortcuts (e.g. checking only sys.procedures on SQL Server) but the default is fine for all current dialects.

      Parameters

      Returns Promise<CRUDValidationMissing[]>

    • Wraps an INSERT statement with a conditional existence check at the statement level. SQL Server: Adds IF NOT EXISTS (...) BEGIN prefix and END suffix. PostgreSQL: Adds ON CONFLICT DO NOTHING suffix (no prefix needed).

      Parameters

      • _conflictCheckSQL: string

        The SQL Server existence check query. Ignored on PostgreSQL.

      Returns { prefix: string; suffix: string }

      An object with prefix and suffix strings to wrap around the INSERT.