Data Engineer - Python/Scala

<p>Job Description :</p><p><br/></p><p>Responsibilities :</p><p><br/></p><p>- Build and maintain ingestion pipelines into AEP (batch, streaming, APIs).<br/><br/>- Map and transform source data (CRM, billing, OCS, channels) into XDM schemas.<br/><br/>- Ensure data quality, deduplication, and reconciliation across datasets.<br/><br/>- Optimize data pipelines for performance, scale, and cost efficiency.<br/><br/>- Support debugging of ingestion issues and coordinate fixes with Adobe/vendor teams.<br/><br/>- Document data pipelines, mappings, and transformation logic for sustainability.<br/><br/>Skills & Qualifications : </p><p><br/></p><p>- Strong SQL, Python/Scala, and ETL/ELT development skills.<br/><br/>- Hands-on experience with APIs, JSON, Kafka, and cloud data platforms (AWS, Azure, GCP).<br/><br/>- Familiarity with Adobe AEP XDM schemas and Identity Service.<br/><br/>- Strong problem-solving and debugging ability.<br/><br/>- Experience in data quality frameworks and reconciliation processes.</p> (ref:hirist.tech)