
About the Role You'll own the reliability and quality of a web extraction infrastructure that processes millions of pages daily through hundreds of scripts, embedded within a fast-moving AI startup team. Reporting to the Forward Deployed Engineer, this role is critical to keeping a high-throughput data pipeline running smoothly and accurately. What You'll Do Monitor and triage a queue of broken scrapers and data quality alerts to maintain smooth operations. Build and deploy new web scraping scripts for sites that require data extraction. Validate scraped data for accuracy and investigate discrepancies as they arise. Create dashboards to visualize and monitor scraped data in real time. Collaborate with AI agents to fill capability gaps, fix issues, and improve existing scripts. What We're Looking For 1+ years of hands-on professional experience building or maintaining web scraping solutions. Proficiency with TypeScript and Node.js for building and debugging scraping scripts. Proficiency with SQL for data querying and validation. Experience with Puppeteer or similar browser automation libraries. Experience debugging and fixing broken scrapers in production environments. Experience with message queues such as RabbitMQ or similar asynchronous job processing systems. Experience with Redis or similar in-memory caching systems. Familiarity with Google Cloud Platform or equivalent cloud infrastructure (BigQuery experience is a plus). Experience with bash scripting, git, and gRPC. Experience building dashboards or data visualization tools is a plus. Strong async communicator who proactively flags blockers and sends updates without prompting. Comfortable with ambiguity and energized by a fast-paced, early-stage environment. Location Fully remote, open to any time zone. Candidates must have 8+ hours of daily availability with overlap during US business hours. Visa sponsorship is not available.
Hasonló állások

Állás
Manager, Engineering Support
Bestow
BigqueryGrpc
+6
137 000–172 000 USD/év
bruttó
🌍 Remote
🗣️ EN

Állás
[EUROPE ONLY] GTM MarTech Engineer (Growth & Attribution) at Video MarTech SaaS
Vidalytics
Bigquery
+5
💰 Bér: nincs megadva
🌍 Remote
Anywhere in the World
🗣️ EN

Állás
.NET Engineer
GFT Technologies
+10
💰 Bér: nincs megadva
🏢 Helyszíni
Warszawa
🗣️ EN

Állás
Software Development Co-op (Later Influence)
Later
+11
4 000 USD/hó
bruttó
🏢 Helyszíni
Vancouver
🗣️ EN

Állás
Python Engineer
WorldQuant
+9
💰 Bér: nincs megadva
🏢 Helyszíni
Ho Chi Minh City
🗣️ EN

Állás
Digital Systems Engineer
Formlabs
Bigquery
+9
100 000–140 000 USD/év
bruttó
🏢 Helyszíni
Somerville
🗣️ EN