apartment-dashboard-api

Author	SHA1	Message	Date
Stephen Minakian	406672c16b	Implement insertPrices() bulk operation for daily price records All checks were successful CI/CD Pipeline - Apartment API / Scan Dependencies (pull_request) Successful in 13s Details CI/CD Pipeline - Apartment API / Run Tests (pull_request) Successful in 9m47s Details CI/CD Pipeline - Apartment API / Send Webhook Notification (pull_request) Successful in 2s Details CI/CD Pipeline - Apartment API / Run Linting (pull_request) Successful in 9m37s Details CI/CD Pipeline - Apartment API / Build & Push Image (pull_request) Has been skipped Details CI/CD Pipeline - Apartment API / Deploy to Production (pull_request) Has been skipped Details Add insertPrices() to scraperService that performs bulk upsert of daily unit price records to the prices collection. Key behaviors: - Uses bulkWrite with updateOne/upsert ops for atomic batch writes - Compound key (unit_code + date_checked) ensures idempotent re-runs - Filters out units with null prices before writing - Stores price, last_updated, and data_source fields per record - Uses ordered:false for parallel write performance - Logs warnings for empty/all-null input without hitting the database - Propagates bulkWrite errors with detailed logging Includes 30 tests covering filtering, upsert behavior, composite key logic, field validation, idempotency, error handling, and logging.	2026-02-05 22:20:33 -07:00
Stephen Minakian	4863dc1824	SCRAPE-6: Implement upsertUnits() bulk operation (#11 ) Co-authored-by: Stephen Minakian <stephenminakian@gmail.com> Co-committed-by: Stephen Minakian <stephenminakian@gmail.com>	2026-02-05 22:10:54 -07:00
Stephen Minakian	0cbeaaf9d5	SCRAPE-5: Implement convertDataTypes() with type parsing helpers (#10 ) Co-authored-by: Stephen Minakian <stephenminakian@gmail.com> Co-committed-by: Stephen Minakian <stephenminakian@gmail.com>	2026-02-05 21:33:58 -07:00
Stephen Minakian	072e80d069	SCRAPE-4: Implement parseUnits() with cheerio selectors (#9 ) Co-authored-by: Stephen Minakian <stephenminakian@gmail.com> Co-committed-by: Stephen Minakian <stephenminakian@gmail.com>	2026-02-05 17:14:01 -07:00
Stephen Minakian	c6beaf8333	SCRAPE-3: Implement fetchPage() with axios, timeout, retry (#8 ) Co-authored-by: Stephen Minakian <stephenminakian@gmail.com> Co-committed-by: Stephen Minakian <stephenminakian@gmail.com>	2026-02-05 15:58:07 -07:00
Stephen Minakian	9dba679221	Add scraperLogger.js with credential redaction (#6 ) Co-authored-by: Stephen Minakian <stephenminakian@gmail.com> Co-committed-by: Stephen Minakian <stephenminakian@gmail.com>	2026-01-28 10:52:00 -07:00
Stephen Minakian	81e5682ab1	Admin Dashboard Backend (Phases 1-4) (#5 ) Some checks failed Deploy Apartment API / deploy (push) Failing after 5m1s Details Co-authored-by: Stephen Minakian <stephenminakian@gmail.com> Co-committed-by: Stephen Minakian <stephenminakian@gmail.com>	2026-01-22 14:11:43 -07:00
Stephen Minakian	ef4ddc0de0	Add Google OAuth authentication system (#4 ) Some checks failed Deploy Apartment API / deploy (push) Failing after 1s Details Co-authored-by: Stephen Minakian <stephenminakian@gmail.com> Co-committed-by: Stephen Minakian <stephenminakian@gmail.com>	2026-01-21 19:15:22 -07:00

8 Commits