Applied AI Engineer

Stack

Responsibilities

• ▹Build and own analyst agents end to end: Slack-native agents that translate natural-language business questions into governed SQL over the analytical warehouse, answer executive P&L questions, post daily health briefings and explain metric movements with data-backed root cause analysis; guarded by SQL and schema validation, result sanity checks and cross-checks of daily metrics against canonical reporting views
• ▹Your first deliverable is a production SQL BI analyst agent that answers with validated queries, sanity-checked results and cited evidence behind every number
• ▹Extend into customer-facing agents: intent triage and routing, retrieval-grounded (RAG) responses over versioned knowledge bases with strict abort-and-escalate fallbacks, multi-turn conversational state machines, localized brand voice and escalation logic; integrated with helpdesk and CRM platforms (webhook ingestion, session lifecycle management, intent metadata tagging, automated escalation tickets with pre-packaged tool context)
• ▹Build the risk-stratified tool layer between agents and back-office APIs: read-only context-gathering tools, information-first validation before any action, multi-turn confirmation workflows and a per-tool switch that moves low-risk mutations from lead approval to fully autonomous execution as evidence accumulates
• ▹Harden agents against adversarial input: prompt injection screening, confidence-threshold freezes on sensitive intents, silent security escalation paths and defences against tool misuse and data exfiltration
• ▹Build agents up the autonomy ladder using LangGraph, the Anthropic Agent SDK / Model Context Protocol (MCP) or equivalent orchestration frameworks; engineer the closed feedback loop (corrections capture, proven-query and semantic memory), decision audit logging and evaluation harnesses, including regression suites proving new tools or intents introduce zero degradation to existing paths
• ▹Build and productionise the models behind the platform's decision signals: churn, lifetime value and bonus-sensitivity models for engagement; composite player risk scores across identity, payment, gameplay, bonus and network signals; collusion, bot-play and multi-accounting detection; anomaly detection for treasury and payments
• ▹Ship models as governed signals, not notebooks: versioned, SLA'd contracts with the decision engine and your agents, with freshness, drift and calibration monitoring and automated retraining paths, served across real-time (Kafka/MSK), near-real-time and batch (ClickHouse) tiers
• ▹Own multi-vector withdrawal risk scoring: per-vector scores with cited rationale and confidence, evidence-aware aggregation and automatic re-scoring when late evidence lands
• ▹Codify business rules with domain owners and keep policy auditable: translate policy into deterministic, configurable rules; simulate and backtest every rule or threshold change against historical data before activation; design holdouts and control groups to measure true uplift; run the deep-dive analyses that feed both your agents and the executive team
• ▹Build the supervisor and approval surfaces for your agents: review queues with one-click action proposal cards for high-risk mutations, searchable session replay exposing prompts, model outputs, reasoning chains and tool calls, and a structured grading module whose output feeds evaluation and fine-tuning datasets
• ▹Design and ship the dashboards through which the business consumes your work: decision audit views, agent performance dashboards (correction rate, failure rate, decision volume by rule and vector), risk review queues and KPI views built with the BI team, moving dashboarding toward AI-assisted anomaly detection and explanation

Requirements

• ▹4+ years of experience in software, data science or machine learning engineering, including 1+ years building LLM-powered agents in production: tool use and function calling, structured outputs, retrieval and memory, and multi-step orchestration with frameworks such as LangGraph or the Anthropic Agent SDK
• ▹You have shipped a production RAG system and can talk concretely about grounding, chunking and retrieval quality, hallucination control and when to refuse to answer
• ▹You treat customer-facing agents as an attack surface: you can explain how you would defend against prompt injection, tool-call abuse and data leakage through model outputs
• ▹Production ML lifecycle ownership: feature engineering, training, serving, monitoring and retraining; fraud, risk or abuse detection experience is a strong signal (imbalanced classes, adversarial users, cost-asymmetric decisions)
• ▹Statistical rigour: experiment design, holdouts and control groups, uplift measurement and score calibration; you can defend a threshold choice to a compliance officer as comfortably as to an engineer
• ▹Evaluation discipline for non-deterministic systems: you have built evaluation harnesses and regression suites and caught quality drift before your users did
• ▹Strong Python for production services, comfort in TypeScript for the review and approval surfaces you will ship, and strong SQL skills on columnar analytical databases (ClickHouse preferred)
• ▹Able to take your own work to a stakeholder-ready surface (review queues, approval interfaces, dashboards and lightweight internal apps) using a front-end framework or tools such as Streamlit; you do not wait for another team to make your work visible
• ▹Experience designing systems where model outputs feed deterministic execution, keeping that boundary clean (models score, suggest and draft; governed logic decides), with LLM observability and tracing (Langfuse, LangSmith or similar) and ownership of what you ship, including when it breaks

Nice to have

• ▹Experience in iGaming or other high-trust, transaction-intensive environments where security, fraud prevention, auditability, traceability, data integrity and robust operational controls are core engineering requirements
• ▹Helpdesk or CS-platform integration experience (Intercom, Zendesk or similar): webhooks, conversation APIs, agent-assist or full automation
• ▹Exposure to blockchain or crypto-native transaction flows, including on-chain data, wallet clustering or stablecoin settlement
• ▹Experience with constrained optimisation, bandits or reinforcement learning applied within hard business constraints (budgets, caps, exclusion lists)
• ▹Experience with rule engines or decision-management systems, and Slack app development
• ▹Event-driven and streaming experience: Kafka or MSK consumers, idempotent processing and failure handling

Soft skills

What we offer

• ▹Fully remote with asynchronous-first communication; EU timezone overlap is preferred
• ▹Small, high-autonomy Intelligence team within the Data function; you report to the Head of Data
• ▹Architecture decisions are documented and debated; you participate in design reviews and own your domain decisions
• ▹Autonomy is earned by evidence: models and agents start in propose-only, human-gated mode and graduate one level at a time, backed by simulation and outcome data

About the company

Block Labs is a technology studio working at the edge of Web3, Artificial Intelligence and iGaming, engineering high-scale, production-grade platforms. It is a collective of senior engineers, product strategists and builders who value deep technical expertise and thoughtful system design.