Junior Python Developer - Data Capture & Sustainment (Web Crawling & APIs)

Stack

Responsibilities

• ▹Handling and tracking incidents
• ▹Troubleshooting and bug fixing
• ▹Developing and maintaining efficient, scalable crawlers/scrapers for data capture
• ▹Ensuring the quality, security, and governance of captured data
• ▹Monitoring performance indicators (structured logs, alerts, tracing)
• ▹Documenting processes, flows, and technical decisions
• ▹Integrating different data sources (APIs, relational and non-relational databases, message queues)

Requirements

• ▹Completed degree in Computer Science, Engineering, Information Systems, or a related field
• ▹Knowledge of Python and interest in data capture and sustainment
• ▹Knowledge of AWS, especially SQS, Lambda, ECS, EC2, S3
• ▹Basic knowledge of relational databases (e.g. PostgreSQL, MySQL)
• ▹Basic knowledge of REST APIs
• ▹Familiarity with Git
• ▹Basic familiarity with Docker
• ▹Good learning ability, organization, and teamwork
• ▹Good communication and willingness to work in dynamic environments

Nice to have

• ▹Familiarity with data-capture stacks (Selenium, BeautifulSoup, Requests, etc.)
• ▹Knowledge of infrastructure as code (e.g. Terraform, CloudFormation)
• ▹Experience with data orchestration tools (e.g. Airflow)

Soft skills

About the company

Experian is a global data and technology company with about 25,200 employees across 32 countries, operating in financial services, healthcare, automotive, and other markets.