Data Engineer - PySpark/AWS/Azure

<p><b>Job Description :</b><br/><br/>- Minimum 5 years of experience in data analytics field<br/><br/>- Experience with Azure/AWS Databricks<br/><br/>- Experience in building and optimizing data pipelines, architectures and data sets<br/><br/>- Excellent experience in Scala or Python, PySpark and SQL<br/><br/>- Ability to troubleshoot and optimize complex queries on the Spark platform<br/><br/>- Knowledgeable on structured and unstructured data design / modelling, data access and data storage techniques<br/><br/>- Expertise in designing and deploying data applications on cloud solutions, such as Azure or AWS<br/><br/>- Hands on experience in performance tuning and optimizing code running in Databricks environment<br/><br/>- Demonstrated analytical and problem-solving skills particularly those that apply to a big data environment<br/><br/>- Data Engineering expertise in Big Data Management using Cloudera, Python, Hive, Scala, Data Warehouse, Data Lake, AWS, Azure<br/><br/><b>Technical / Professional Skills :</b><br/><br/>- Azure/AWS Databricks<br/><br/>- Python / Scala / Spark / PySpark<br/><br/>- HIVE / HBase / Impala / Parquet<br/><br/>- Sqoop, Kafka, Flume<br/><br/>- SQL and RDBMS<br/><br/>- Airflow<br/><br/>- Jenkins / Bamboo<br/><br/>- Github / Bitbucket<br/><br/>- Nexus</p> (ref:hirist.tech)