Senior Data Engineer - Python/SQL

<p><p><b>Role : Senior Data Engineer</b><br/><br/>This is a full-time position with D Square Consulting Services Pvt Ltd<br/><br/>Location : Bangalore (Hybrid)<br/><br/>Experience : 5+ years<br/><br/>Notice Period : Candidates available to join within 15 days are preferred</p><p><br/></p><p><b>Job Summary : </b></p><p><br/></p><p>We are seeking a skilled and experienced Senior Data Engineer with strong Python expertise, API development experience, and a deep understanding of containerized, CI/CD-driven workflows.<br/><br/> You will play a key role in designing, building, and scaling data pipelines and backend services that support our analytics and business intelligence platforms.<br/><br/> This is a hands-on engineering role that requires a strong technical foundation and a collaborative mindset.</p><p><br/></p><p><b>Key Responsibilities : </b></p><p><br/></p><p>- Design, implement, and optimize robust, scalable data pipelines and ETL workflows using modern Python tools and libraries.<br/><br/>- Build and maintain production-grade RESTful and/or GraphQL APIs to serve data to internal and external stakeholders.<br/><br/>- Collaborate with Data Analysts, Scientists, and Engineering teams to enable end-to-end data solutions.<br/><br/>- Containerize data services using Docker and manage deployments within Kubernetes environments.<br/><br/>- Develop and maintain CI/CD pipelines using GitHub Actions to automate testing, data validations, and deployment processes.<br/><br/>- Ensure code quality through rigorous unit testing, type annotations, and adherence to Python best practices.<br/><br/>- Participate in architecture reviews, design discussions, and code reviews in an agile development process.<br/><br/>- Proactively identify opportunities to optimize data access, transformation, and Skills & Qualifications : </b></p><p><br/></p><p>- Bachelors or Masters degree in Computer Science, Engineering, or a related technical field.<br/><br/>- 5+ years of hands-on experience in data engineering or backend development roles.<br/><br/>- Expert-level Python skills, with strong understanding of idiomatic patterns, async programming, and typing.<br/><br/>- Proven experience in building production-grade RESTful or GraphQL APIs using frameworks like FastAPI, Graphene, or Strawberry.<br/><br/>- Hands-on experience with Docker, container-based workflows, and CI/CD automation using GitHub Actions.<br/><br/>- Experience working with Kubernetes for orchestrating deployments in production environments.<br/><br/>- Proficient with SQL and data modeling; familiarity with ETL tools, data lakes, or warehousing concepts is a plus.<br/><br/>- Strong communicator with a proactive and self-driven approach to problem-solving and Skills :</b></p><p><br/></p><p>- Familiarity with data orchestration tools (e.g., Airflow, Prefect).<br/><br/>- Experience with streaming data platforms like Kafka or Spark.<br/><br/>- Knowledge of data governance, security, and observability best practices.<br/><br/>- Exposure to cloud platforms like AWS, GCP, or Azure</p><br/></p> (ref:hirist.tech)