Sr. Java Developer with GenAI Integration (Java, LLM, RAG) - Immediate Joiners

Role Overview:

We are looking for a skilled

Senior Java Backend Engineer

to join our team focused on building scalable and high-performance backend systems for Generative AI applications.

You’ll play a key role in designing APIs, orchestrating AI agents, and integrating Large Language Models (LLMs) into production-ready systems.

This role is ideal for backend developers with a passion for modern AI technologies and distributed systems.

Key Responsibilities:
Design, build, and maintain scalable backend services using

Java

and the

Spring Boot

framework
Develop APIs to enable

LLM integration

and support AI agent orchestration workflows
Architect microservices to power

RAG (Retrieval-Augmented Generation)

and other LLM-driven systems
Optimize performance through efficient

caching strategies

and

vector database interactions
Integrate and manage connections with multiple

LLM providers

(e.g., OpenAI, Gemini, Claude), including

rate limiting

and

failover handling
Implement

real-time streaming

features for conversational AI systems using

WebSockets

or similar technologies
Ensure robust system observability with

logging ,

monitoring , and

tracing

Required Skills & Qualifications:
3–7 years total, with a minimum of 1 year working on Generative AI projects

Backend Development:
Minimum 3 years of hands-on experience with

Java

and

Spring Boot
Strong grasp of

RESTful API

design principles and

microservices architecture
Proficiency with core Spring modules:

Spring Security ,

Spring Data JPA ,

Spring Cloud
Experience working with relational and NoSQL databases:

PostgreSQL ,

MongoDB ,

Redis
Familiarity with

message brokers

such as

RabbitMQ

or

Apache Kafka
Expertise in

caching mechanisms

and system performance tuning

Generative AI Integration:
Experience integrating

LLM APIs

(OpenAI, Gemini, Claude, etc.) into backend services
Knowledge of

vector databases

and

semantic search

technologies
Familiarity with

AI agent orchestration frameworks

(e.g.,

LangGraph )
Understanding of

RAG systems

and how to implement them effectively
Experience developing

streaming responses

using WebSockets or server-sent events
Working knowledge of

prompt templating and management systems

Nice to Have:
Experience in

fine-tuning LLMs

and managing

model deployment pipelines
Knowledge of

self-hosted LLM environments

and infrastructure management
Exposure to

observability tools

like LangSmith or custom monitoring setups
Familiarity with

natural language to SQL systems

or BI applications powered by LLMs

Note:

If you are matching on to the above job description & skills, please feel free to fill in your details on the below Form enclosed (https://forms.gle/bUyXMBhgSxxBZVeK9).