Bulk copy program utility for mssql and files
02-06-2025
- https://learn.microsoft.com/en-us/sql/tools/bcp-utility?view=sql-server-ver16&tabs=windows
- used in the context of dagster
- https://github.com/cody-scott/dagster-mssql-bcp
- https://github.com/cody-scott/dagster-mssql-bcp/blob/main/src/dagster_mssql_bcp/bcp_core/bcp_core.py
- quite nice and clean, handles pre-processing (datetime values, nulls, number formats and newlines), loading (using temp directories / files, with options to pass in relevant sql arguments, bcp arguments, meta column arguments), post-processing (row hashes, modifications)