> ## Documentation Index
> Fetch the complete documentation index at: https://docs.dqlabs.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Data Sources Overview

> Connect Prizm to your entire data ecosystem — from cloud data warehouses to BI tools, and pipelines.

<script type="application/ld+json">
  {`{
            "@context": "https://schema.org",
            "@type": "TechArticle",
            "headline": "Data Sources Overview",
            "description": "Connect Prizm to your entire data ecosystem - from cloud data warehouses to BI tools, and pipelines.",
            "url": "https://docs.dqlabs.ai/sources/overview",
            "publisher": {
              "@type": "Organization",
              "name": "DQLabs Inc",
              "logo": "https://media.brand.dev/332adc35-5bc4-4d2b-bf78-256aa4a5e414.svg"
            }
            }`}
</script>

## Overview

Prizm connects to a broad range of data sources, orchestration tools, BI platforms, and third-party systems. Each connector enables Prizm to discover assets, extract lineage, monitor quality, and surface observability signals from that source.

***

## Supported Sources

### Cloud Data Warehouses & Lakehouses

<CardGroup cols={3}>
  <Card title="Snowflake" color="#29B5E8" icon="snowflake" href="/sources/snowflake/overview">
    Deep integration with native query log lineage, query history, and schema discovery.
  </Card>

  <Card title="Databricks" color="#FF3621" icon="bolt" href="/sources/databricks/overview">
    Unified platform support for Delta Lake, Unity Catalog, and Databricks SQL.
  </Card>

  <Card title="BigQuery" color="#4285F4" icon="google" href="/sources/bigquery">
    Google BigQuery integration with dataset discovery and query-level lineage.
  </Card>

  <Card title="Amazon Redshift" color="#FF9900" icon="aws" href="/sources/redshift">
    Redshift cluster and Serverless support with usage-based lineage extraction.
  </Card>

  <Card title="SQL Server" color="#0078D4" icon="microsoft" href="/sources/sql-server">
    Microsoft SQL Server and Azure SQL Database integration.
  </Card>

  <Card title="SAP HANA" color="#0FAAFF" icon="database" href="/sources/sap-hana">
    SAP HANA in-memory database connectivity for enterprise data assets.
  </Card>
</CardGroup>

### Cloud Storage

<CardGroup cols={2}>
  <Card title="ADLS — Azure Data Lake Storage" color="#0078D4" icon="microsoft" href="/sources/adls">
    Azure Data Lake Storage Gen2 with hierarchical namespace and file-level lineage.
  </Card>
</CardGroup>

### Data Transformation & Pipeline Tools

<CardGroup cols={3}>
  <Card title="dbt" color="#FF6849" icon="code" href="/sources/dbt/overview">
    Parse dbt manifests for model-level lineage, tests, and documentation sync.
  </Card>

  <Card title="Apache Airflow" color="#017CEE" icon="wind" href="/sources/airflow/overview">
    DAG discovery, task-level lineage, and execution metadata from Airflow deployments.
  </Card>

  <Card title="Azure Data Factory" color="#0078D4" icon="microsoft" href="/sources/airflow">
    ADF pipeline integration for transformation lineage and execution monitoring.
  </Card>
</CardGroup>

### BI & Visualization Tools

<CardGroup cols={2}>
  <Card title="Tableau" color="#E97627" icon="chart-bar" href="/sources/tableau/overview">
    Workbook and datasource discovery with field-level lineage back to source tables.
  </Card>

  <Card title="Power BI" color="#F2C811" icon="microsoft" href="/sources/powerbi/overview">
    Dataset, report, and dashboard lineage with semantic model integration.
  </Card>
</CardGroup>

### ITSM & Ticketing

<CardGroup cols={2}>
  <Card title="ServiceNow" color="#62D84E" icon="headset" href="/integrations/servicenow/overview">
    Auto-create and synchronize incidents and change requests from Prizm quality events.
  </Card>

  <Card title="Jira" color="#0052CC" icon="jira" href="/integrations/jira/overview">
    Create Jira issues from data quality exceptions and track resolution status.
  </Card>
</CardGroup>

### Data Catalog & Governance Platforms

<CardGroup cols={2}>
  <Card title="Alation" icon="book" href="/integrations/alation/overview">
    Bidirectional metadata sync with Alation's data catalog.
  </Card>

  <Card title="Atlan" icon="book-open">
    Integration with Atlan for unified governance and metadata exchange. *(Documentation page coming soon.)*
  </Card>
</CardGroup>

***

## Connector Architecture

All Prizm connectors share a common architecture:

```text theme={null}
Data Source
    │
    ├─ Schema Discovery (metadata extraction)
    ├─ Asset Inventory (tables, views, models)
    ├─ Query Log / Audit Log Analysis (lineage)
    ├─ Profiling Execution (JDBC / API)
    └─ Event / Webhook Signals (freshness, failures)
```

### Connection Types

| Connection Type | Use Case                                                 |
| --------------- | -------------------------------------------------------- |
| **JDBC**        | Direct SQL-based connectivity for warehouse sources      |
| **REST API**    | BI tools, ITSM platforms, and SaaS data sources          |
| **Webhooks**    | Real-time event signals from pipelines and orchestrators |
| **Native SDK**  | Deep platform integrations (Snowflake, Databricks, dbt)  |

***

## Adding a New Source

<Steps>
  <Step title="Navigate to Connections">
    Go to **Settings → Connections** in the Prizm UI.
  </Step>

  <Step title="Select Source Type">
    Choose from the supported connector list and provide connection credentials.
  </Step>

  <Step title="Configure Discovery Scope">
    Define which databases, schemas, and tables to include in Prizm's catalog.
  </Step>

  <Step title="Run Initial Discovery">
    Trigger the first asset discovery run to populate the catalog with metadata and lineage.
  </Step>

  <Step title="Configure Profiling Schedule">
    Set profiling frequency, run scope (full, incremental, sampling), and alert thresholds.
  </Step>
</Steps>