Principal AI Architect – Data Platforms & Cyber Security
Location: Remote
Experience: 15+ Years
Position Type: Full Time
Job Description
We are looking for a Principal Technical Architect to lead the architecture, design, security, and strategic evolution of enterprise Data Platforms and Multi-Agent GenAI Systems. The ideal candidate should have deep expertise across Databricks, AI/LLM architecture, cloud platforms, Python, data governance, and cybersecurity.
Key Responsibilities
- Architect enterprise-scale Multi-Agent AI and LLM-powered systems using Python, Pydantic, OpenAI APIs, and Databricks Model Serving.
- Design AI tooling including graph-based execution, YAML rule engines, capability registries, and structured retry/error-repair mechanisms.
- Implement LLM security, threat modeling, prompt-injection/jailbreak protection, guardrails, and red-teaming.
- Architect zero-trust identity and access patterns using OAuth 2.0, Okta, Entra ID, Service Principals, and token lifecycle management.
- Lead Databricks platform architecture, migrations, governance, Unity Catalog, Delta Lake, Workflows, Jobs API, and Delta Sharing.
- Design RLS, dynamic column masking, PII/PCI classification, and enterprise data-security controls.
- Build data quality and observability frameworks for automated monitoring, incident detection, onboarding, and file freshness.
- Drive multi-cloud AWS/Azure/GCP architecture, cost governance, FinOps, and infrastructure optimization.
- Define enterprise GenAI adoption strategies and establish standards, reusable architecture patterns, and developer AI tooling.
- Partner with engineering, security, data, and executive teams to drive enterprise-wide technology transformation.
Must Have
- 15+ years of progressive experience in software engineering, enterprise architecture, data platforms, AI systems, and/or security architecture.
- Strong enterprise Technical Architecture and technology leadership experience.
- Hands-on Databricks, Unity Catalog, Delta Lake, PySpark, and Data Engineering.
- Strong AI/LLM and Multi-Agent architecture experience.
- Advanced Python / Async Python, Pydantic, REST APIs, and OpenAI APIs.
- Experience with LLM threat modeling, prompt injection, jailbreak mitigation, AI guardrails, and AI security.
- Strong knowledge of OAuth 2.0, Okta/Entra ID, Service Principals, and Zero-Trust architecture.
- Data governance and security experience including RLS, dynamic masking, PII/PCI classification, SIEM and audit logging.
- Strong AWS/Azure/GCP and cloud security architecture experience.
- Experience with SQL, relational databases, C#/.NET Core, YAML, and API architecture.
- Enterprise governance, stakeholder management, technical strategy, and executive communication.
Nice to Have
- GitHub Copilot / enterprise developer AI tooling
- Streamlit
- Databricks Model Serving
- Delta Sharing
- Data Observability
- Cloud FinOps
- Kubernetes / DevOps / CI-CD
- AI adoption and enterprise transformation programs
- Infrastructure and licensing governance
Apply: [email protected]