Automation2026

PropertyPal Investment Analyzer

Scrapy-based web scraper for extracting property listings with AI-powered investment ratings and geocoding analysis.

property-pal-analyser.zisiskostakakis.com/

PropertyPal Investment Analyzer screenshot

01 Overview

PropertyPal Investment Analyzer is a web scraper built with Scrapy that extracts property listings from PropertyPal.com and rates them as investments. It automates property research by combining scraping, AI analysis, and geocoding.

An interactive CLI with multi-select search lets users configure and run multiple property searches at once. Each property is analysed with Perplexity's Housing Agent API, which returns an investment rating out of 10 with pros, cons, and market outlook.

The scraper follows ethical scraping practices: rate limiting, robots.txt compliance, and honest user-agent identification. Data is validated with Pydantic models and exported to JSON and CSV through custom pipelines.

02 Key Features

Automated property data extraction with pagination support

AI-powered investment ratings via Perplexity Housing Agent

Geocoding with distance calculations from custom destinations

Interactive CLI with multi-select search functionality

Automated mortgage payment calculations (configurable parameters)

CSV/JSON export pipelines with Pydantic validation

Ethical scraping with rate limiting and robots.txt compliance

Error handling and retry mechanisms

Structured data extraction (descriptions, features, room details)

Makefile for convenient command execution

03 Architecture

Scrapy Pipeline Architecture

The spider crawls PropertyPal.com with pagination, yielding raw items through a pipeline chain: Pydantic validation → geocoding + mortgage calculation → optional Perplexity AI rating → JSON and CSV export.

rendering diagram…

Scraping & Data Extraction Flow

The spider follows search result pages, extracts property card links, then visits each detail page to extract structured fields using CSS selectors.

rendering diagram…