Connectors

pyrula.connectors holds the IO atoms that read and write external stores. They sit below both the Pipelines recipes and workflow-step code, so the same connector serves a streaming pipeline or a one-off script. Their high-level calls return an Either, so errors surface as values rather than exceptions.

Each connector is an optional extra, so you install only what you use:

pip install 'pyrula-connectors[delta]'        # Delta Lake
pip install 'pyrula-connectors[postgres]'     # Postgres over ADBC
pip install 'pyrula-connectors[databricks]'   # Unity Catalog -> Delta

Connector	Import	Use it for
Delta	pyrula.connectors.delta	Delta Lake tables on local disk or any object store delta-rs supports (S3, Azure, GCS).
Postgres	pyrula.connectors.postgres	Arrow-native read/write against Postgres over ADBC.
Databricks	pyrula.connectors.databricks	Resolve a Unity Catalog table and vend short-lived credentials, then read/write it as Delta (AWS, external-location-backed UC tables). Backs DatabricksSource/DatabricksSink.

The Snowflake and BigQuery ADBC atoms (pyrula.connectors.snowflake, pyrula.connectors.bigquery) expose the same read_arrow/write_arrow Arrow surface as the Postgres atom and back the pipeline sources and sinks. Install pyrula-connectors[snowflake] or pyrula-connectors[bigquery].