Big Data Engineer - SQL/Python

<p><p><b>Job Description :</b></p><p><p><b><br/></b></p>- Minimum of 7+ years of progressive experience in Data Engineering, with a proven track record in pipeline creation and implementation.<br/><br/></p><p>- Strong awareness and hands-on experience with various data tools and platforms, including Hive, Hadoop, Starburst, and other Big Data technologies.<br/><br/></p><p>- Proficiency in programming languages such as SQL, Python, Spark, and Java.<br/><br/></p><p>- Good working knowledge and practical experience with ETL processes utilizing Java Spark, Python Spark, or Spring Batch.<br/><br/></p><p>- Advanced SQL skills and extensive experience with relational databases and database design principles.<br/><br/></p><p>- Strong proficiency in object-oriented programming languages, specifically Python, PySpark and Java, Java Spark (a must-have).<br/><br/></p><p>- Demonstrable experience working with data Lakehouse architectures, such as Iceberg/Starburst.<br/><br/></p><p>- Strong proficiency in scripting languages like Bash for automation and system administration tasks.<br/><br/></p><p>- Strong proficiency in designing, implementing, and managing data pipeline and workflow management tools (e.g., Apache Airflow, Luigi, etc.).<br/><br/></p><p>- Knowledge of cloud platforms such as Databricks, AWS (Amazon Web Services), or GCP (Google Cloud Platform) is a significant plus.</p><br/></p> (ref:hirist.tech)