Job description
Role Overview:As Director of Engineering, you will lead the technical direction and execution of our engineering organization.
You will be directly involved in system design, architecture reviews, code quality, and scaling data pipelines.
You will work with senior engineers and architects to design resilient, high-throughput systems capable of processing massive event streams in real time.
This role demands someone who can dive deep technically, make critical architectural decisions, and set engineering standards, while also fostering a high-performance engineering culture.Key Responsibilities:● Lead architecture and implementation of scalable, distributed data pipelines (real-time and batch) for ingesting and processing security telemetry at high volume (5,000–10,000+ events/sec).
● Guide hands-on engineering efforts in Java, Python, and big data frameworks (Kafka, Spark, Flink, Elasticsearch, Hadoop ecosystem).
● Define technical standards for system reliability, data quality, performance, and observability.
● Implement secure design principles and practices, ensuring the integrity and confidentiality of our systems.
● Work closely with Data Science and Security Research teams to productize ML models within real-time and streaming environments.
● Drive adoption of cloud-native architectures (Kubernetes, Docker, microservices) and ensure secure, scalable deployments on AWS/GCP/Azure.
● Participate in design and code reviews, ensuring engineering teams produce clean, maintainable, and testable code.
● Mentor senior engineers and technical leads, raising the overall technical bar of the organization.
● Work with various AWS services such as EC2, EKS, etc.
● Utilize Monitoring Tools like ELK, Grafana/Prometheus, Datadog or similar for cloud-scale monitoring.
● Anticipate scaling bottlenecks and proactively design solutions for data growth, query performance, and fault tolerance.
● Partner with the CTO to define long-term technical strategy and evaluate emerging technologies.
Qualifications :● Education: Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
● Technical Skills: ○ Strong coding background in Java and Python with experience building scalable, cloud-native enterprise applications.
○ Experience designing and implementing microservices based architecture using Java, Spring Boot and relevant technologies.
○ Deep expertise in big data systems: Kafka, Flink, Hadoop, Elasticsearch, etc.
○ Experience designing and scaling real-time and batch data pipelines at enterprise scale.
○ Solid knowledge of distributed systems, concurrency, fault tolerance, and data consistency models.
○ Strong grasp of cloud-native infrastructure (Kubernetes, Docker, Terraform, CI/CD pipelines).
○ Experience with RDBMS and No SQL databases (e.g., Postgres, My SQL, Mongo DB, Redis).
○ Prior experience in deploying workloads at scale in AWS EKS/ECS/Fargate ● Experience: ○ 10+ years in software engineering, with at least 5 years leading high performing technical teams.
○ Experience leading a high-trust, high-performance engineering culture, where teams are empowered to innovate and deliver enterprise-grade solutions at scale.
○ Proven track record building enterprise applications with massive data throughput.
Write to me at for more details
Required Skill Profession
Architecture & Construction
Expertini
India Jobs Expertini
