Mandatory Skills Description:
• Excellent command of English
• Bachelor's or Master's degree in Computer Science, Information Technology, or related field.
• 5+ years of experience in data integration and pipeline development using Azure Data Integration Services including Azure Data Factory and Azure Databricks.
- Hands-on with
- Python and Spark (Pyspark)
- Delta tables
- Unity Catalog
- Parquet
• Strong understanding of security principles in the context of data integration and DevSecOps
• Proven experience with SQL and other data query languages.
• Ability to write, debug, and optimize data transformations and datasets.
• Extensive experience in designing and implementing ETL solutions using Azure Databricks, Azure Data Factory or similar technologies.
• Familiar with automated testing frameworks using Squash