All jobs → Partner boards

Data Architect (Databricks,Azure)

Marathon TS • McLean, VA, US • published 2026-11-02 21:16:42.093551

Description

Data Architect (Databricks, Azure)About the role We are looking for a Data Architect to design the data foundation for a generative AI program at a regulatory client. You will own how business applications and a Databricks lakehouse exchange data, so that every AI workflow has clean inputs, stable output contracts and governed access to highly confidential information. What you'll do * Define the interface contracts between business applications and AI workflows: inputs, output schemas, versioning and error handling. * Design ingestion of large document submissions (PDF, Excel and Word, with single submissions of up to hundreds of gigabytes) from Azure storage into Databricks, including metadata, document keys and text extraction. * Design the Unity Catalog model for confidential data: catalogs, schemas, fine\-grained access controls tied to user assignments, and lineage. * Model AI outputs and reviewer feedback: the AI draft versus the human final, provenance fields (model and prompt version, evidence links, confidence) and the write\-back tables used to refine prompts. * Recommend the operational data store pattern (Azure SQL, PostgreSQL or Databricks Lakebase) and how it stays i...

Get jobs like this daily in Telegram: @careeri_bot