stephen/apartment-dashboard-api

SCRAPE-2: Add scraper config constants #7

Merged

stephen merged 3 commits from scraper/config into dev

2026-01-31 20:54:44 -07:00

Author	SHA1	Message	Date
stephen	7a10aa3036	Update .github/workflows/deploy.yml All checks were successful CI/CD Pipeline - Apartment API / Scan Dependencies (pull_request) Successful in 15s Details CI/CD Pipeline - Apartment API / Run Linting (pull_request) Successful in 9m35s Details CI/CD Pipeline - Apartment API / Run Tests (pull_request) Successful in 9m46s Details CI/CD Pipeline - Apartment API / Send Webhook Notification (pull_request) Successful in 2s Details CI/CD Pipeline - Apartment API / Build & Push Image (pull_request) Has been skipped Details CI/CD Pipeline - Apartment API / Deploy to Production (pull_request) Has been skipped Details	2026-01-31 20:13:06 -07:00
stephen	30aea78d8c	Update .github/workflows/deploy.yml	2026-01-31 20:10:15 -07:00
Stephen Minakian	7114aee239	Add scraper configuration module with environment variable support Some checks failed CI/CD Pipeline - Apartment API / Scan Dependencies (pull_request) Failing after 0s Details CI/CD Pipeline - Apartment API / Run Linting (pull_request) Successful in 9m35s Details CI/CD Pipeline - Apartment API / Run Tests (pull_request) Successful in 9m45s Details CI/CD Pipeline - Apartment API / Send Webhook Notification (pull_request) Successful in 2s Details CI/CD Pipeline - Apartment API / Build & Push Image (pull_request) Has been skipped Details CI/CD Pipeline - Apartment API / Deploy to Production (pull_request) Has been skipped Details - Create config/scraper.js with all scraper constants - Add TARGET_URL for apartment listing page - Add SCRAPER_SCHEDULE, SCRAPER_TIMEZONE, SCRAPER_ENABLED settings - Add SCRAPER_TIMEOUT and USER_AGENT settings - Add RETRY_CONFIG with maxRetries, baseDelay, timeout - Add COLLECTIONS object with env var overrides for all 4 collections - Create comprehensive test suite with 25 test cases	2026-01-29 16:17:20 -07:00