Senior AI Engineer

Stack

Responsibilities

• ▹Taking a leading role in designing, developing and integrating LLM-based AI systems into production
• ▹Participating in end-to-end technical design of AI systems, defining infrastructure, integration, and deployment needs
• ▹Developing applications built on large language models, particularly RAG, agentic, and tool-using solutions
• ▹Tracking innovations in the generative AI market and the AI engineering ecosystem and evaluating their business value
• ▹Integrating and tuning vendor AI solutions within the bank's technology environment
• ▹Integrating AI solutions with backend systems, data platforms, and business applications (REST APIs, event-driven architecture)
• ▹Participating in building the model serving and AI service layer
• ▹Supporting monitoring, performance optimization, and stable operation of AI systems
• ▹Developing containerized AI components and supporting their rollout (Docker, Kubernetes, CI/CD, MLOps)
• ▹Overseeing code quality, shaping development standards, and mentoring junior colleagues
• ▹Close collaboration with architect, enablement, and developer roles

Requirements

• ▹Several years of experience in AI engineering, ML engineering, or software development
• ▹Confident Python skills and experience building production-ready, maintainable code
• ▹Experience developing or integrating LLM-based applications, particularly RAG or agentic solutions
• ▹Experience integrating and technically tuning AI vendor solutions
• ▹Knowledge of REST APIs, microservice architectures, and enterprise integration patterns
• ▹Experience with containerization and cloud environments (e.g. Docker, Kubernetes)
• ▹A CI/CD and MLOps mindset
• ▹Good communication skills and professional English

Nice to have

• ▹Experience with LLM fine-tuning (e.g. PEFT, LoRA, qLoRA)
• ▹Experience developing multi-agent systems
• ▹Knowledge of model serving frameworks (e.g. vLLM, Triton, BentoML, KServe)
• ▹Experience with MLOps and monitoring tools (e.g. MLflow, Airflow, Kubeflow, Prometheus, Grafana)
• ▹Hands-on experience with GPU/CUDA environments
• ▹Knowledge of distributed data processing frameworks (e.g. Spark, Dask)
• ▹Backend or frontend development experience (e.g. Java, Node.js, Angular)
• ▹Higher education degree in IT or a related technical field

Soft skills

What we offer

• ▹A strategically important role with real influence on shaping enterprise AI systems
• ▹A modern technology environment built on large language models, RAG, and agentic solutions
• ▹Meaningful influence on development direction and engineering standards
• ▹Continuous professional development and an active knowledge-sharing culture
• ▹Competitive benefits package and flexible work
• ▹Private health insurance package, and support for health fund and voluntary pension savings
• ▹Wide range of employee discounts (mobile phone, mortgage, bank account, vacation)
• ▹Modern office environment in Budapest

About the company

OTP Bank is a leading banking group in Central and Eastern Europe. Its AI team works on enterprise-scale solutions built on large language models, in close collaboration with architect and developer roles.