Projects

Selected work from data ingestion, observability, and platform engineering.

Dynatrace Ingestion Connector

Active

Modular ingestion for Dynatrace metrics/logs into Azure Data Lake Gen2. Supports snapshot and incremental modes, Teams alerting, run state persistence and lineage emission.

PythonAzureObservabilityIngestion

TAP Data Lake DTS

Internal

Multi-source ingestion framework (DB2, Jira, Jenkins, etc.) writing to raw/stg/curated layers in ADLS Gen2, with scheduled snapshots, backfills, and environment-aware modes.

Data PlatformAirline OpsADLS Gen2Governance

OpenLineage Integration

In progress

Emits lineage events from ingestion runs so downstream analysts know where data originated, which job produced it, and what tables were touched.

OpenLineageMarquezLineageMetadata