Senior Software Engineer (AI / LLMs)

Stack

Responsibilities

• ▹Design and implement backend services for intelligent agent workflows and autonomous infrastructure actions
• ▹Develop APIs and orchestration layers in Python and TypeScript, integrating LLMs, vector databases and observability pipelines
• ▹Build scalable systems supporting LLM-based reasoning, retrieval and decision-making across cloud infrastructure
• ▹Integrate with AWS Bedrock and other LLM platforms for multi-model capabilities
• ▹Develop data access and semantic search layers using vector databases (e.g. pgvector, Pinecone, Qdrant)
• ▹Build robust monitoring, testing and CI/CD systems for reliable, reproducible AI workflows
• ▹Work with the product and DevOps teams on architecture diagrams, deployment planning and system health monitoring
• ▹Write clean, maintainable, documented code; take part in code reviews and design discussions

Requirements

• ▹6+ years of backend engineering experience in production environments
• ▹Strong Python and TypeScript for distributed, event-driven systems
• ▹Deep understanding of AWS services (Lambda, ECS, Bedrock, S3, CloudWatch, etc.)
• ▹Experience designing APIs, microservices and event pipelines that interface with LLMs or AI models
• ▹Familiarity with vector databases and concepts such as embeddings, similarity search and retrieval-augmented generation
• ▹Experience with infrastructure-as-code tools such as Terraform or AWS CDK
• ▹Understanding of SQL and schema migration workflows (PostgreSQL or similar)
• ▹Hands-on experience with Docker, GitHub Actions and cloud-native CI/CD
• ▹Ability to diagram systems, communicate architecture decisions clearly and work asynchronously in a distributed team
• ▹Strong sense of ownership and ability to deliver in fast-moving, ambiguous environments

Nice to have

• ▹Experience with LangChain, OpenAI or Anthropic APIs
• ▹Familiarity with agentic frameworks or AI orchestration systems
• ▹Background in observability or APM tooling (e.g. Datadog, Dynatrace)
• ▹Prior experience building automation or infrastructure management tools
• ▹Contributions to open-source LLM or MLOps projects
• ▹Interest in shaping how AI is applied to real-world IT operations

Soft skills

What we offer

• ▹Base salary USD 120,000-160,000
• ▹Remote work
• ▹Medical, dental and vision: 100% paid for employees, 50% for dependents (US employees)
• ▹Life and disability insurance, 401K with 3% employer contribution
• ▹Education and tuition reimbursement
• ▹Paid time off up to 6 weeks, sick leave up to 2 weeks, parental leave up to 12 weeks
• ▹International employees get statutory benefits under local law through the Deel employer of record

About the company

Apiphani is a small but rapidly growing technology-enabled managed services company supporting mission-critical enterprise workloads.