Job Description
<p><p><b>Description :</b><br/><br/>While technology is the heart of our business, a global and diverse culture is the heart of our success.<br/><br/>We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.<br/><br/>If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you you would enjoy your career with Quantiphi!.<br/><br/>Role : Senior Data Engineer (SQL/Elasticsearch).<br/><br/>Experience : 3 - 8 Years.<br/><br/>Work location : Mumbai, Bangalore & Trivandrum.<br/><br/><b>Role & Responsibilities :</b><br/><br/>- Design and optimize search and analytics solutions using Elasticsearch for handling structured, semi-structured, and unstructured healthcare data.<br/><br/>- Build and optimize SQL-based ETL/ELT pipelines for ingestion, transformation, and reporting at scale.<br/><br/>- Diagnose and troubleshoot distributed systems problems, including search performance, query optimization, and data indexing challenges.<br/><br/>- Design and implement scalable storage and query solutions leveraging relational databases and search engines.<br/><br/>- Help developers in debugging data related issues.<br/><br/>- Capable of creating APIs using Python(fastAPI).<br/><br/>- Communicate effectively with Infrastructure, Network, DevOps, SiteOps, and customer teams to ensure smooth operations.<br/><br/>- Build automation and monitoring tools to ensure high availability and performance of SQL and Elasticsearch-based systems.<br/><br/><b>Must Have Skills :</b><br/><br/>- Strong expertise in SQL (query optimization, stored procedures, indexing, partitioning).<br/><br/>- Hands-on experience with Elasticsearch : designing indices, mapping, analyzers, query DSL, performance tuning, scaling clusters.<br/><br/>- Solid understanding of data modeling, normalization, and search schema design.<br/><br/>- Proficiency in Python for scripting and API development.<br/><br/>- Familiarity with GitHub/Bitbucket/GitLab for version control.<br/><br/>- Strong grasp of data structures, exception handling, and debugging.<br/><br/>- Experience with GCP services (BigQuery, Data Fusion, Pub/Sub, Cloud Storage) or equivalent AWS/Azure data services.<br/><br/>- Exposure to orchestration frameworks such as Airflow, NiFi, or Google Cloud Composer.<br/><br/>- Experience developing pipelines and utilities for data migration, storage, search, and analytics on Google Cloud.<br/><br/>- Experience in developing and maintaining large-scale data ingestion pipelines capable of handling terabytes of daily data.<br/><br/>- Familiarity with message/event streaming solutions such as Kafka, Kinesis, or Pub/Sub.<br/><br/>- Knowledge of containerization and orchestration (Docker, Kubernetes).<br/><br/>- Hands-on experience in optimizing Elasticsearch clusters for high availability, security, and scalability in production.<br/><br/>- Experience supporting large-scale, real-time data systems in production.<br/><br/>If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!.<br/><br/></p><br/></p> (ref:hirist.tech)