[PULL REQUEST] Startup Module - Blockgroups, Validation, Debug

[GregorSchroeder]

Describe this pull request. What changes are being made?

Census blockgroups are added to the [inputs].[mgra] table and inserted along with MGRA data as part of the Startup Module.

The Startup Module is given both Validation and Debug functionality by altering the original sql/insert_mgra.sql SQL statement and replacing it with sql/startup/get_mgra.sql and additional Python logic.

What issues does this pull request address?

closes #209
closes #210

Additional context

See [run_id]=13 in [ws].

The following queries will be run in the production database.

ALTER TABLE [inputs].[mgra] ADD [2010_census_blockgroup] NVARCHAR(12) NULL
ALTER TABLE [inputs].[mgra] ADD [2020_census_blockgroup] NVARCHAR(12) NULL

UPDATE [inputs].[mgra]
SET [2010_census_blockgroup] = [xref].[to_zone]
FROM [inputs].[mgra]
INNER JOIN [GeoAnalyst].[geography].[fn_xref_zones](87) AS [xref]
    ON [mgra].[mgra] = CONVERT(INTEGER, [xref].[from_zone])

UPDATE [inputs].[mgra]
SET [2020_census_blockgroup] = [xref].[to_zone]
FROM [inputs].[mgra]
INNER JOIN [GeoAnalyst].[geography].[fn_xref_zones](90) AS [xref]
    ON [mgra].[mgra] = CONVERT(INTEGER, [xref].[from_zone])

ALTER TABLE [inputs].[mgra] ALTER COLUMN [2010_census_blockgroup] NVARCHAR(12) NOT NULL
ALTER TABLE [inputs].[mgra] ALTER COLUMN [2020_census_blockgroup] NVARCHAR(12) NOT NULL

[Copilot]

Pull request overview

This PR updates the Startup module to support Census blockgroup geographies in the [inputs].[mgra] table and adds validation + debug behavior by splitting the former “insert-only” SQL into a “get/insert switch” query plus Python orchestration.

Changes:

• Add [2010_census_blockgroup] and [2020_census_blockgroup] columns to [inputs].[mgra] schema definition.
• Replace sql/insert_mgra.sql with sql/startup/get_mgra.sql, supporting both “return tabular data” and “insert with geometry” modes.
• Update python/startup.py to fetch MGRA data into pandas for validation and to write debug CSV output.

Reviewed changes

Copilot reviewed 4 out of 4 changed files in this pull request and generated 3 comments.

File	Description
sql/startup/get_mgra.sql	New Startup MGRA loader query with @insert_switch behavior and added blockgroup xrefs
sql/insert_mgra.sql	Removed legacy single-purpose insert script
sql/create_objects.sql	Updates [inputs].[mgra] DDL to include the new blockgroup columns (plus added GO separators)
python/startup.py	Adds Python-side validation and debug CSV output; switches to new SQL loader

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.