Job Overview
Category
Computer Occupations
Ready to Apply?
Take the Next Step in Your Career
Join Confidential and advance your career in Computer Occupations
Apply for This Position
Click the button above to apply on our website
Job Description
<p><p><b>Required Skills and Experience :</b></p><p><br/></p><p>- 5+ years of hands-on experience as a Python Developer.<br/><br/></p><p>- Strong experience with PySpark.<br/><br/></p><p>- Proficient in Azure Databricks, PySpark, and Delta Lake.<br/><br/></p><p>- Solid experience with Python and FastAPI for API development.<br/><br/></p><p>- Experience with Azure Functions for serverless API deployments.<br/><br/></p><p>- Skilled in managing ETL pipelines using Apache Airflow.<br/><br/></p><p>- Hands-on experience with PostgreSQL and MongoDB.<br/><br/></p><p>- Strong SQL skills and experience handling large Responsibilities : </b></p><p><br/></p><p><b>Azure Cloud s Databricks : </b></p><br/></p><p>- Design and build efficient data pipelines using Azure Databricks (PySpark).</p><p><br/>- Implement business logic for data transformation and enrichment at scale.<br/><br/></p><p>- Manage and optimize Delta Lake storage solutions.<br/><br/></p><p><b>API Development :</b></p><p><br/></p><p>- Develop REST APIs using FastAPI to expose processed data.<br/><br/></p><p>- Deploy APIs on Azure Functions for scalable and serverless data access.<br/><br/></p><p><b>Data Orchestration ETL : </b><br/><br/></p><p>- Develop and manage Airflow DAGs to orchestrate ETL processes.<br/><br/></p><p>- Ingest and process data from various internal and external sources on a scheduled Management : </b></p><p><br/></p>- Handle data storage and access using PostgreSQL and MongoDB.<br/><br/></p><p>- Write optimized SQL queries to support downstream applications and : </b><br/><br/></p><p>- Work cross-functionally with teams to deliver reliable, high-performance data solutions.<br/><br/></p><p>- Follow best practices in code quality, version control, and documentation.</p><br/></p> (ref:hirist.tech)
Don't Miss This Opportunity!
Confidential is actively hiring for this Python Developer - Azure Data Factory position
Apply Now