Big Data Developer

About the Role
We are looking for a highly skilled Senior Software Engineer with strong experience in Flink/Beam, Kafka, and Java/Scala to design, build, and optimize real-time, event-driven streaming systems .
The ideal candidate will have deep knowledge of distributed systems, containerization, and security best practices, preferably in banking or financial environments .
Technology Area
Flink / Beam, Kafka, Java
Education
Degree or Postgraduate in Computer Science or related field (or equivalent industry experience)
Experience
Minimum 5+ years of development and design experience in Java/Scala with Flink, Beam (or Spark Streaming) and Kafka .
Technical Skills
Extensive coding experience and knowledge in Event-driven and Streaming Architecture
Experience in JVM tuning for performance optimization
Knowledge of Containerization using Docker and Kubernetes
Working knowledge on Caching systems , preferably Redis (Nice to have)
Strong command of Linux OS configuration and Shell scripting
Good hands-on experience with Design Patterns and their implementation
Well-versed with CI/CD principles (GitHub, Jenkins, etc.) and troubleshooting in distributed services ecosystems
Experience working with SQL and NoSQL databases
Familiar with Distributed services resiliency and monitoring in production environments
Experience designing, building, testing, and implementing security systems , including identifying design gaps and recommending enhancements
Adherence to established security and compliance policies , understanding of vulnerabilities and corrective actions
Knowledge of security controls for data transfer (CRON, ETLs, JDBC-ODBC scripts)
Understanding of Networking basics including DNS, Proxy, ACL, Policy, and troubleshooting
Awareness of compliance and regulatory requirements (encryption, anonymization, data integrity, policy control)
Understanding of data sensitivity in logging and in-memory storage (e.g., ensuring no card numbers or PII in logs)
Ability to implement wrapper solutions for components lacking security controls to ensure compliance with banking standards
Functional Skills
Experience working in Agile methodology
Ensure quality of technical and application architecture and design across systems
Research and benchmark technologies against best-in-class solutions
Banking, Financial, or FinTech experience in an enterprise environment is preferred
Ability to influence multiple teams on technical considerations, sharing deep knowledge and improving team effectiveness
Self-motivated and proactive , capable of owning tasks independently while collaborating effectively across teams