Mycom - Technical Lead - DataLake Development

<p><p><b>Job Title :</b> Technical Lead - Data Lake Developer<br/><br/><b>Experience Required :</b> 8 to 10 years<br/><br/><b>Employment Type :</b> the Role :</b></p><p><b><br/></b></p>We are seeking a highly skilled and experienced Technical Lead Data Lake Developer to architect and implement scalable, high-performance data lakehouse solutions.<br/><br/></p><p>You will lead the development of robust data pipelines and work with cutting-edge Big Data and Cloud technologies to enable real-time and batch data processing across the Responsibilities :</b></p><p><br/></p><p>Design & Implement Scalable Data Lakehouse Architectures :</p><p><br/></p>- Architect and build modern data lakehouse ecosystems using open-source and cloud-native technologies.<br/><br/></p><p>- Ensure scalability, reliability, and performance of data platforms.<br/><br/></p><p>Develop High-Performance Data Pipelines :</p><p><br/></p><p>- Build and optimize real-time and batch data pipelines using Spark, Kafka, and streaming technologies.<br/><br/></p><p>- Implement data ingestion, transformation, and storage strategies.<br/><br/></p><p>Collaborate Across Teams :</p><p><br/></p><p>- Work closely with data engineers, data scientists, and business stakeholders to understand data requirements.<br/><br/></p><p>- Mentor junior developers and contribute to technical leadership.<br/><br/></p><p>Ensure Data Quality & Governance :</p><p><br/>- Implement data validation, monitoring, and governance frameworks.<br/><br/></p><p>- Ensure compliance with data security and privacy Technical Skills :</b></p><p><b><br/></b></p><p><b>Big Data & Streaming Technologies :</b></p></p><p><b><br/></b>- Apache Kafka</p><p><br/>- Apache Pekko (formerly Akka)<br/><br/></p><p>- Apache Spark & Spark & Storage Technologies :</b></p><p><b><br/></b></p>- Delta Lake or Apache Iceberg<br/><br/></p><p>- AWS S3 or MinIO S3<br/><b><br/></b></p><p><p><b>Query Engines & Databases :</b></p><p><b><br/></b></p>- AWS Athena<br/><br/></p><p>- Trino (PrestoSQL)<br/><br/></p><p>- & Containerization :</b></p><p><b> </b></p>- AWS Cloud Services<br/><br/></p><p>- Kubernetes or Qualifications :</b></p><p><b><br/></b></p>- Bachelors degree in Computer Science, Engineering, or related field.<br/><br/></p><p>- Proven experience in designing and implementing large-scale data platforms.<br/><br/></p><p>- Strong understanding of distributed systems and microservices architecture.<br/><br/></p><p>- Experience with CI/CD pipelines and DevOps practices.<br/><br/></p><p>- Excellent problem-solving and communication Join Us?</b></p><p><br/></p>- Work on cutting-edge technologies in a fast-paced, innovative environment.<br/><br/></p><p>- Lead impactful projects that drive data-driven decision-making.<br/><br/></p><p>- Collaborate with a passionate and talented team.<br/><br/></p><p>- Opportunities for continuous learning and career growth</p><br/></p> (ref:hirist.tech)