Stephen Minakian
2e3ef0580c
All checks were successful
CI/CD Pipeline - Apartment API / Scan Dependencies (pull_request) Successful in 13s
CI/CD Pipeline - Apartment API / Lint & Test (pull_request) Successful in 43s
CI/CD Pipeline - Apartment API / Send Webhook Notification (pull_request) Successful in 2s
CI/CD Pipeline - Apartment API / Build & Push Image (pull_request) Has been skipped
CI/CD Pipeline - Apartment API / Deploy to Production (pull_request) Has been skipped
Add createScraperIndexes() to create indexes on the scraper_runs collection: a compound index on status+startedAt for active job queries and a descending index on startedAt for recent run lookups. Change default collection names from production tables (units_migration_test, unit_prices_migration_test) to dedicated validation collections (units_scraper, unit_prices_scraper). This enables the Node.js scraper to run in parallel with the existing Python scraper during validation without interfering with production data. Update all scraper test files to reference the new default collection names.