BigStep Technologies - Data Engineer - Python/SQL/ETL

<p><p><b>Key Responsibilities : </b><br/><br/></p><p>- Build, scale, and maintain robust data solutions to support business objectives.<br/><br/></p><p>- Design, implement, and optimize high-performance data pipelines (extraction, loading, transformation, and orchestration) with scalability, reliability, and speed.<br/><br/></p><p>- Lead end-to-end software development projects involving large language models (LLMs), retrieval-augmented generation (RAG) frameworks, and other AI technologies.<br/><br/></p><p>- Champion modern software engineering practices such as CI/CD, infrastructure-as-code, containerization, and cloud-native deployments.<br/><br/></p><p>- Collaborate with business stakeholders to transform use cases into production-ready services and solutions, owning systems from concept to production.<br/><br/></p><p>- Implement rigorous testing and monitoring practices to ensure superior data quality and integrity.<br/><br/></p><p>- Mentor and guide junior team members, fostering a culture of excellence and continuous & Certifications : </b></p><p><b><br/></b></p><p>- Bachelors degree or higher in a STEM field (Computer Science, Math, Physics, Engineering, or related), required.<br/><br/></p><p>- Advanced degree in Computer Science or related field, Experience : </b><br/><br/></p><p>- 5 to 7 years of total professional experience.<br/><br/></p><p>- 3 to 5 years of experience in Data Engineering or a related discipline with a proven track record of success.<br/><br/></p><p>- Experience in financial services or product development environments is a strong Skills & Competencies : </b></p><p><br/></p>- Expertise in Python and SQL with strong data manipulation and analysis skills.<br/><br/></p><p>- Proficiency with Databricks/PySpark and dbt for data warehousing and transformation.<br/><br/></p><p>- Hands-on experience with workflow orchestration tools (e.g., Airflow, Temporal).<br/><br/></p><p>- Experience working with LLMs, prompt engineering, RAG frameworks, and vector databases.<br/><br/></p><p>- Knowledge of machine learning fundamentals, feature engineering, and knowledge graphs is an advantage.<br/><br/></p><p>- Strong experience in designing and implementing complex data systems from scratch.<br/><br/></p><p>- Ability to handle large-scale data projects including ETL, data cleaning, and information retrieval.<br/><br/></p><p>- Strong communication skills (verbal and written).</p><br/></p> (ref:hirist.tech)