Data Engineer - Python/SQL

<p>Job profile and Role: Data Engineer<br/><br/>Job description : <br/><br/>- Strong experience with Postgres and SQL and experience working with, supporting and maintaining relational databases.

<br/><br/>- Experience building and optimizing 'big data' data pipelines, architectures, and data sets.

<br/><br/>- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.

<br/><br/>- Experience with AWS cloud services <br/><br/>- Experience in migrating data across the database/environments with zero downtime.

<br/><br/>- Experience with AWS integration tool, AWS Glue.

<br/><br/>- Experience supporting complex ETL & ; Integration Projects <br/><br/>- Create and maintain comprehensive documentation for advanced analytics models, data dictionaries, and data flows.

<br/><br/>- Hands on engineering of solutions and data pipelines utilizing CI/CD and automation.

<br/><br/>- Design and maintain testing processes and automation workflows for data feature changes, upgrades, and releases.

<br/><br/>- Strong analytic skills related to working with semi structured datasets.

<br/><br/>- Build processes supporting data transformation, data structures, metadata, dependency and workload management.

<br/><br/>- A successful history of manipulating, processing and extracting value from large, disconnected datasets.

<br/><br/>- Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores.

<br/><br/>- Strong project management and organizational skills.

<br/><br/>- Experience supporting and working with cross-functional teams in a dynamic environment.<br/><br/>Required Skills<br/><br/>- Bachelor's degree in Computer Science or equivalent degree.<br/><br/>- 5+ years of software experience<br/><br/>- Experience with Machine learning frameworks and models.

Pytorch experience preferred<br/><br/>- Strong understanding of statistical analysis and mathematical data manipulation<br/><br/>- Work with web technology including Java, Python, JavaScript, React/Redux, Kotlin.<br/><br/>- Follow best practices for software development and deployment<br/><br/>- Understanding of relational database, big data, and experience in SQL<br/><br/>- Proficient at using GIT, GitFlow, JIRA, Gitlab and Confluence.<br/><br/>- Strong analytical and problem solving skills.<br/><br/>- Open-minded and passionate to learn and grow technology skills<br/><br/>- Strong sense of accountability<br/><br/>- Solution-focused and ability to drive change within the organization<br/><br/>- Experience in writing unit/integration tests including test automation.<br/><br/>- Strong testing and debugging abilities, functional, analytical and technical abilities, ability to find bugs, attention to detail, troubleshooting</p> (ref:hirist.tech)