Alysian Data & AI Cloud Solution Architect Principal PE, Technology & Advisory

Job description

<p><u><b>CONTEXT ON ROLE</b></u><br/><br/>We are seeking an experienced Data and AI Cloud Solution Architect to lead design and implement enterprise-scale cloud data and AI solutions using Microsoft Fabric, Azure Databricks, and the broader Azure ecosystem.

This role requires a proven solution architect with extensive Microsoft technology expertise who will lead customer engagements, design scalable cloud architectures, and drive the adoption of modern data and AI platforms while ensuring seamless integration between IES Gateway and our analytics ecosystem.<br/><br/>The Data and AI Senior Cloud Solution Architect will help clients use cloud technology, data engineering, and AI/ML to improve how they manage and use data.

They will design solutions that transform data systems and enable large-scale use of advanced analytics and generative AI.<br/><br/><u><b>KEY ATTRIBUTES & EXPECTATIONS</b></u><br/><br/>- Operates at a very rapid pace to deliver high-impact outcomes in fast-moving environments.<br/><br/>- Able to work with incomplete information, applying intelligence, experience, and sound judgment to fill gaps and make informed decisions.<br/><br/>- Takes full ownership of deliverables, ensuring they provide the best possible value to the client- which may involve challenging initial requests and steering towards more effective solutions.<br/><br/>- Confident engaging with all levels of a client's organization, from team leads to executives, efficiently gathering relevant information and presenting insights with clarity, authority, and the appropriate level of gravitas for senior audiences.<br/><br/>- Committed to building reusable assets and operating efficiencies within their specialism, contributing to Alysian's broader capability and intellectual capital.<br/><br/>- Consistently seeks and drives solutions that deliver value aligned with Private Equity expectations - recognizing that these priorities may differ from long-term business goals, as PE ownership may focus on rapid, short-term improvements that enhance sale value<br/><br/>- Comfortable challenging established thinking and influencing stakeholders at all levels by presenting alternative solutions supported with robust financial, operational, and technical Architecture & Design</b><br/><br/>- Lead solution design sessions with stakeholders to translate business requirements into technical architectures<br/><br/>- Design comprehensive cloud data and AI solutions for data engineering, data lakes, analytics, and AI/ML use cases leveraging Microsoft Fabric, Azure AI Services, and Azure Machine Learning<br/><br/>- Define target architectures and roadmaps for AI/data platforms (e.g., Lakehouse, MLOps)<br/><br/>- Create scalable, secure, and cost-effective cloud solutions that meet enterprise requirements<br/><br/>- Architect end-to-end data and AI platforms that integrate seamlessly with customer environments<br/><br/>- Select and configure tools and technologies across the data & AI stack: ingestion, storage, processing, modelling, and serving<br/><br/>- Develop reference architectures and best practice guidelines for data and AI implementations<br/><br/><b>Customer Engagement & Technical Leadership</b><br/><br/>- Serve as the primary technical advisor for cloud data strategy and complex data and AI solution implementations<br/><br/>- Lead technical discussions with customer architects, engineers, and business stakeholders<br/><br/>- Conduct solution workshops, proof-of-concepts, solutions demos and technical deep-dive sessions<br/><br/>- Provide technical guidance during pre-sales activities and solution validation<br/><br/>- Mentor and guide implementation teams on Microsoft best practices and architectural patterns<br/><br/><b>Microsoft Fabric & Azure Databricks Platform Expertise</b><br/><br/>- Design and implement Microsoft Fabric solutions including OneLake, Data Factory, and Synapse Analytics.<br/><br/>- Architect data flows, integration patterns, and analytics workspaces within the Fabric ecosystem.<br/><br/>- Establish Power BI integration patterns and advanced analytics frameworks.<br/><br/>- Design and configure Azure Databricks clusters, workspaces, and job orchestration for enterprise-scale data processing.<br/><br/>- Implement performance tuning strategies for Azure Databricks including Spark optimization, cluster autoscaling, and resource management.<br/><br/>- Configure Azure Databricks security patterns including workspace isolation, access controls, and network security.<br/><br/>- Implement modern data lakehouse architectures using Delta Lake with integrated AI/ML capabilities.<br/><br/>- Design Azure Databricks integration patterns with Microsoft Fabric for seamless data flow and analytics.<br/><br/><b>Data Integration & AI Platform Implementation</b><br/><br/>- Design sophisticated data integration patterns between IES Gateway and cloud analytics platforms using Azure Databricks and Microsoft Fabric.<br/><br/>- Architect Delta Lake implementations optimized for IES Gateway data workflows with advanced partitioning and performance tuning.<br/><br/>- Implement medallion architecture (Bronze/Silver/Gold layers) using Azure Databricks with embedded AI/ML processing capabilities.<br/><br/>- Create real-time data ingestion patterns using Azure Databricks structured streaming and Delta Live Tables.<br/><br/>- Design scalable data pipelines using Azure Databricks for complex ETL/ELT processes and real-time data integration.<br/><br/>- Establish MLOps pipelines and AI model deployment patterns using Azure Databricks Machine Learning and Azure Machine Learning integration.<br/><br/>- Implement Azure Databricks workflows for automated data quality monitoring and data governance processes.<br/><br/>- Design and implement data governance frameworks using Microsoft Purview with integrated Azure Databricks lineage tracking.<br/><br/><b>Security, Governance & Compliance</b><br/><br/>- Architect comprehensive security patterns aligned with federal and state requirements for sensitive data and AI systems<br/><br/>- Design secure data architectures on Azure with a strong understanding of cloud identity and access management (IAM) - including role-based access control (RBAC), attribute-based access control (ABAC) and principle of least privilege - and securing data at rest and in transit with cloud key management services implement advanced authentication, authorization, and data protection mechanisms<br/><br/>- Establish data classification and tagging strategies (e.g., PII, PHI, PCI), encryption standards (AES-256, TLS, HMAC) across structured and unstructured data and data loss prevention (DLP) and tokenization solutions<br/><br/>- Implement compliance frameworks such as GDPR, HIPAA, SOC 2, ISO 27001, CCPA<br/><br/>- Design audit logging, monitoring, and compliance reporting frameworks<br/><br/>- Establish responsible AI practices and governance frameworks for machine learning operations<br/><br/>- Configure Microsoft Purview for data lineage, quality monitoring, and AI model Optimization & Innovation</b><br/><br/>- Implement performance tuning strategies for large-scale data processing, analytics, and AI workloads<br/><br/>- Optimize Azure resource utilization and cost management across data and AI services<br/><br/>- Design intelligent caching, partitioning, and scaling mechanisms for cloud-native architectures<br/><br/>- Establish comprehensive monitoring and alerting frameworks for data and AI operations<br/><br/>- Drive innovation by evaluating and integrating emerging Microsoft data and AI services<br/><br/><u><b>REQUIRED QUALIFICATION</b></u><br/><br/>- Bachelor's degree in Computer Science, Information Technology, Data Engineering, or related field<br/><br/>- 12+ years of progressive experience in cloud solution architecture with focus on data and AI platforms<br/><br/>- 4+ years of experience working as a Cloud Solution Architect or Data Architect specifically within Microsoft technology environments<br/><br/>- 2+ years hands-on production experience with Azure Databricks, Apache Spark, and Azure Machine Learning<br/><br/>- Current hands-on experience with Microsoft Fabric platform, Azure AI Services, and Azure Databricks advanced features (Delta Live Tables, MLflow, Databricks SQL)<br/><br/>- Proven track record of leading customer-facing technical engagements and solution design sessions<br/><br/>- Deep expertise in Azure Databricks architecture including workspace management, cluster optimization, and integration patterns<br/><br/>- Experience with cloud data architecture patterns including data lakes, data warehouses, lakehouses, and Delta Lake implementations<br/><br/>- Experience with AI/ML solution architecture including model deployment, MLOps, and responsible AI practices<br/><br/>- Strong knowledge of Azure ecosystem including Azure Data Factory, Azure Synapse Analytics, Azure Cognitive Services, and Azure EXPERTISE</b></u><br/><br/>- Microsoft Fabric: OneLake, Data Factory, Synapse Analytics, Power BI, Data Activator<br/><br/>- Azure AI Platform: Azure Machine Learning, Azure Cognitive Services, Azure OpenAI, Azure AI Search<br/><br/>- Data Processing & Analytics: Azure Databricks (cluster management, job orchestration, performance optimization), Apache Spark, Delta Lake, Delta Live Tables, structured streaming analytics<br/><br/>- Integration & Orchestration: Azure Data Factory, Logic Apps, Event Hubs, Service Bus, Azure Databricks workflows<br/><br/>- Governance: Microsoft Purview, Azure Policy, security and compliance frameworks<br/><br/>- Programming: Python, SQL, Spark SQL, KQL (Kusto Query Language)</p><p><br/></p><p>- AI/ML: Machine learning model development, MLOps pipelines, responsible AI practices</p> (ref:iimjobs.com)

Required Skill Profession

Computer Occupations