This is us

At Avenga, we believe that human creativity empowers technology that matters. Operating globally, our 6000+ specialists provide a full spectrum of services, including business and tech advisory, enterprise solutions, CX, UX and Ul design, managed services, product development, and software development.

This is the job

We are looking for a Lead Backend & Data Engineer to join an innovative AI initiative focused on building a highly deterministic, zero-hallucination Dual-Engine Retrieval-Augmented Generation (RAG) platform.

This is you

• Extensive experience with Python and modern backend development.

• Deep expertise in Apache Beam and distributed data processing concepts, including windowing, watermarks, and idempotent writes.

• Strong experience with Google Cloud Spanner or another distributed SQL database.

• Working knowledge of graph query languages such as ISO GQL, Cypher, or Gremlin.

• Advanced proficiency in asynchronous Python development using FastAPI and Pydantic.

• Hands-on experience with workflow orchestration platforms such as Temporal or Cadence.

• Strong understanding of deterministic workflow execution and separating non-deterministic operations into Activities.

• Experience implementing retries, compensation logic, and state management in distributed systems.

• Solid understanding of distributed systems architecture and cloud-native application design.

• Strong problem-solving skills with the ability to drive technical decisions.

• Upper-Intermediate or higher level of English.

This is your role

• Design, build, and optimize Apache Beam data ingestion pipelines running on multiple execution engines such as Dataflow and Flink.

• Structure and optimize multi-hop graph queries using ISO GQL to trace physical and logical data provenance.

• Develop scalable backend services using FastAPI and optimize Google Cloud Spanner performance through advanced gRPC connection pooling.

• Define robust API contracts with Pydantic to support seamless integration with downstream AI orchestration frameworks such as LangChain and LangGraph.

• Design backend architectures that efficiently separate synchronous request handling from long-running asynchronous processing.

• Develop and maintain Workflow Definitions, Activity Definitions, and Temporal clients using the Temporal Python SDK.

• Deploy and manage a horizontally scalable fleet of Temporal Workers responsible for complex database operations and AI routing logic.

• Implement resilient distributed workflows with automated retries, compensation mechanisms, and reliable state management.

• Collaborate closely with AI, Platform, and Data Engineering teams to deliver scalable, production-ready solutions.

• Contribute to architectural decisions, code reviews, and engineering best practices while ensuring high standards of performance, reliability, and maintainability.

What awaits you at Avenga?

At Avenga, everyone matters. We provide equal opportunities in recruitment, career development, and leadership, regardless of race, ethnicity, gender identity, sexual orientation, disability, age, religion, or any other characteristic. We are committed to fostering a work environment where our diverse community of employees, candidates, and business partners actively shapes our growth. By bringing together people from different backgrounds and experiences, we build a workplace where everyone feels free to be themselves while honoring the boundaries of others.