One of our clients is looking for an experienced Python Data Engineer to join their team.
Key Responsibilities:
- Strong Python Experience (web services, background jobs; we use Fast API)
- Data processing and reporting using Python (Pandas, Polars, openpyxl and Duck DB are used, Airflow, dbt, streamlit experience is nice to have)
- Experience with data pipeline design (data lake, medallion architecture, star schema)
- Experience with CI/CD (GitHub Actions is used)
- Azure development experience (Container Apps, Azure Storage, Service Bus, SignalR)
- Experience with IaC automation (Bicep Azure is used; AWS CDK, terraform experience is transferrable)
- Spec-Driven Development with AI (GitHub Copilot and Claude Code are used)
Nice to have:
- Distributed Processing, async workflows, enterprise messaging patterns.
- Snowflakes (stored procedures, streams, tasks, pipes, time travel).
- Web development and angular or NextJS.