Software Backend Engineer (Java) - Artificial Intelligence

Stack

Responsibilities

• ▹Own the full LLM pipeline from data preparation to production use
• ▹Design, iterate, and optimize prompts (zero-/few-shot, chain-of-thought, tool-calling, etc.)
• ▹Build and maintain Retrieval-Augmented Generation (RAG) QA/search systems connected to multi-source knowledge bases
• ▹Work with vLLM/SGLang inference architectures, deploying and operating LLM services on multi-GPU or cluster environments
• ▹Design, implement, and operate multi-agent LLM architectures (e.g. LangGraph, CrewAI, AutoGen), including task decomposition, agent orchestration, memory sharing, and tool-calling workflows
• ▹Develop evaluation pipelines (automatic metrics and human feedback) to measure prompt and model quality, bias, and hallucination rates
• ▹Collaborate with product and CS teams to integrate AI models into conversational chatbots
• ▹Track cutting-edge research, author tech blogs, and continuously improve the architecture

Requirements

• ▹Master's degree or higher in Computer Science, Data Science, or a related field
• ▹At least 2 years of deep-learning/NLP experience, including 1+ year of practical LLM work (SFT, DPO, RAG, quantization, inference optimization, etc.)
• ▹Demonstrated prompt engineering and tuning expertise (few-shot design, structured prompting, prefix-/p-tuning, reward re-ranking, safety filtering)
• ▹Practical experience building and deploying multi-agent LLM workflows, with understanding of agent-orchestrator patterns, shared memory, long-horizon planning, and guard-rail design
• ▹Proficient in both English and Chinese communication for cross-team collaboration

What we offer

• ▹Competitive salary and company benefits
• ▹Work-from-home arrangement (may vary depending on business team)

About the company

Binance is a leading global blockchain ecosystem behind the world's largest cryptocurrency exchange by trading volume and registered users, trusted by 300+ million people in 100+ countries for its industry-leading security, trading engine speed, and deep liquidity. Its offerings range from trading and finance to education, research, payments, institutional services, and Web3 features.