Role: Senior Data Engineer - (AWS, Opensearch)
Years of Experience: 5-8 Years
Location: Ahmedabad, Pune, Indore
Notice Period: Immediate to 45 Days Max
Job Description: We are seeking a highly motivated and enthusiastic Senior Data Engineer with 5- 8 years of experience to join our dynamic team.
The ideal candidate will have a strong background in Data Engineering/Data analytics and a passion for leveraging data to drive business insights and innovation.
Qualifications:
- Bachelor’s degree in Computer Science, Data Science, or a related field.
Required Skills and Qualifications:
- 5-8 years of experience in data engineering, with a proven track record of building and managing data solutions.
- Design, develop, and manage scalable data solutions on AWS (RDS, DynamoDB, S3)
- Build and optimize Logstash pipelines to push Kafka events into OpenSearch for real-time search and monitoring.
- Work on OpenSearch indexing and query optimization to improve performance and scalability.
- Collaborate with cross-functional teams to design and implement efficient ETL/ELT pipelines using Logstash, AWS Glue, Lambda, PySpark, and other tools.
- Manage and optimize data warehouses such as DynamoDB and SQL
- Ensure high availability, performance tuning, and reliability of relational and NoSQL databases.
- Work with structured and unstructured data formats (JSON, CSV, XML, Excel).
- Integrate data solutions with BI tools like PowerBI or any reporting.
- Having Knowledge on LLM/NLP techniques, providing basic integration knowledge where applicable.
- Collaborate using version control (GitHub, SVN), ticketing systems (Jira)
- Excellent problem-solving, analytical, and communication skills.
Must Have
- AWS
- Amazon RDS
- DynamoDB
- Data warehouse
- Logstash
- Kafka
- OpenSearch
- Elasticsearch (alternative keyword to for OpenSearch)
Should Have
- Power BI
- LLM and NLP Awareness