Job Description:
We are seeking a highly skilled Full Stack Big Data Engineer to join our team.
The ideal candidate will have strong expertise in big data technologies, cloud platforms, microservices, and system design, with the ability to build scalable and efficient data-driven applications.
This role requires hands-on experience across data engineering, backend development, and cloud deployment, along with a strong foundation in modern DevOps and monitoring practices.
Key Responsibilities:
- Design, build, and optimize big data pipelines using Scala, PySpark, Spark SQL, Spark Streaming, and Databricks.
- Develop and maintain real-time data processing solutions using Kafka Streams or similar event-driven platforms.
- Implement cloud-based solutions on Azure, leveraging services such as Azure Data Factory (ADF) and Azure Functions.
- Build scalable microservices with Core Java (8+) and Spring Boot.
- Collaborate on system design , including API development and event-driven architecture.
- Contribute to front-end development (JavaScript, React) as needed.
- Ensure application reliability through monitoring tools such as Grafana, New Relic, or similar.
- Utilize modern CI/CD tools (Git, Jenkins, Kubernetes, ArgoCD, etc.) for deployment and version control.
- Work cross-functionally with data engineers, software developers, and architects to deliver high-quality solutions.
Qualifications:
- 5+ years of professional experience as a Software/Data Engineer or Full Stack Engineer.
- Strong programming skills in Scala, Python, and Java .
- Experience with Databricks, Spark SQL, Spark Streaming , and PySpark .
- Hands-on experience with Azure cloud services and data engineering tools.
- Solid knowledge of microservices development with Spring Boot.
- Familiarity with event-driven platforms such as Kafka.
- Experience with CI/CD pipelines and containerization/orchestration tools.
- Strong problem-solving and communication skills.
- Bachelor’s or master’s degree in computer science, Engineering, or a related field (preferred).
Nice to Have:
- Experience with API design and event-driven architecture .
- Frontend development experience with React and JavaScript .