Job Description
<p><p><b>The Opportunity : Senior Backend Engineer (Python) / Tech Lead</b><br/><br/>As Senior Backend Engineer / Tech Lead, you will own the backend architecture and LLM/agent infrastructure powering our Chatbot platforms.
Our stack includes FastAPI, async Python, SQLAlchemy/ Alembic, Redis, Playwright automation, and LiteLLM/OpenAI integrations.
You will serve as the technical lead for architecture, reliability, cost optimization, and team mentorship, ensuring robust, scalable, and efficient systems.<br/><br/>This is a hands-on leadership role for someone who thrives on solving complex backend challenges, building scalable AI-driven platforms, and guiding engineers to excellence.<br/><br/><b>Key Responsibilities : </b></p><p><p><b><br/></b></p><p><b>1.
Backend Architecture & Delivery :</b></p><p><b><br/></b></p>- Lead design and implementation of backend systems including conversation graphs, LLM integrations, persistence layers, and automation workflows.<br/><br/></p><p>- Define and evolve architecture to ensure scalability, reliability, and cost efficiency.<br/><br/></p><p>- Collaborate with cross-functional teams to integrate backend services with chatbot platforms </p><p>and external systems.<br/><br/><b>2.
LLM Pipelines & Integrations :</b></p><p><br/></p><p>- Implement robust LLM call pipelines including context construction, token management, safety filters, retries, and cost controls.</p><p><br/></p><p>- Design inbound webhook adapters and outbound flows for Turn.io / WhatsApp orchestration, ensuring idempotency, retries, and observability.<br/><br/></p><p>- Optimize performance of LiteLLM/OpenAI integrations to deliver seamless AI experiences.<br/><br/><b>3.
Data Persistence & Storage :</b></p><p><br/></p><p>- Own persistence patterns using Postgres + SQLAlchemy/Alembic and Redis for session/history management.</p><p><br/></p><p>- Design and manage embedding/vector workflows to support intelligent retrieval and personalization.<br/><br/></p><p>- Establish standards for database migrations, indexing, and query optimization.<br/><br/><b>4.
Reliability, Testing & DevOps : </b></p><p><p><b><br/></b></p>- Improve CI/CD pipelines, test coverage, and release reliability across environments.<br/><br/></p><p>- Implement monitoring and observability frameworks (Prometheus, Grafana, Sentry) to ensure uptime and performance.</p><p><br/></p><p>- Drive best practices in containerization, deployment, and automation (Docker, Kubernetes/Helm).<br/><br/><b>5.
Technical Leadership & Mentorship :</b></p><p><br/></p><p>- Mentor engineers through code reviews, knowledge sharing, and technical guidance.<br/><br/></p><p>- Define coding standards, enforce engineering best practices, and champion a strong testing </p><p>culture (pytest).<br/><br/></p><p>- Participate in technical hiring and ensure continuous capability building within the team.<br/><br/><b>Who Will Thrive in This Role?
- Youll love this role (and well love working with you) if : </b><br/><br/></p><p>- 6+ years of backend engineering with at least 3+ years in technical leadership or project ownership.<br/><br/></p><p>- Deep expertise in Python (asyncio), FastAPI, async SQLAlchemy/Alembic, Postgres, and Redis.<br/><br/></p><p>- Proven experience integrating LLMs or similar AI systems (prompt pipelines, safety </p><p>frameworks).<br/><br/></p><p>- Hands-on experience with Playwright or other browser automation tools.<br/><br/></p><p>- Strong foundation in testing, observability, CI/CD, Docker, and deployment practices.<br/><br/></p><p>Bonus if you have : <br/><br/></p><p>- Exposure to LiteLLM, Langfuse, sentence-transformers, vector DBs, or embedding pipelines.<br/><br/></p><p>- Familiarity with Kubernetes/Helm for container orchestration.<br/><br/></p><p>- Working knowledge of TypeScript and React to collaborate effectively with frontend teams.<br/><br/></p><p>At RightWalk, thriving also means embodying our core values every day<br/><br/>Integrity & Ethics : Do whats right, always.</p><p><br/>Ownership & Excellence : Take full charge, no excuses.</p><p><br/></p><p>Resilience & Audacity : Be fearless, even when its hard.<br/><br/></p><p>Empathy & End-User First : Listen, understand, and design what matters most.<br/><br/></p><p>Helicopter Mindset : Zoom out to think big, zoom in to deliver relentlessly.</p><br/></p> (ref:hirist.tech)