[Feature]: Scrape move-in dates, descriptions, and improve listing accuracy

[CommanderTvis]

Related Problem

It’s currently difficult to compare or filter properties across different websites, because some important information (like earliest move-in date, property descriptions, or attributes such as "has kitchen" / "no pets") is not being scraped. This makes it harder for users to evaluate listings quickly or make decisions without manually visiting the source sites.

Proposed Feature

I would like Fredy to automatically scrape additional data from real estate websites, starting with:

1. Property descriptions (merged into one text field for simplicity).
2. Earliest move-in date (priority, since it’s often the main decision-making attribute).
3. Key property attributes like "has kitchen" or "no pets" (optional for later).

Since attributes vary a lot across sites, unifying them may be complex. For a first step, only earliest move-in date should be implemented.

Additionally, I propose adding a cron job that pings existing listings in the database to verify whether they are still active. This would improve accuracy by removing expired listings.

Alternatives Considered

I tried implementing this in my own client code, but sites like Immoscout24 do not return useful data with a plain fetch. It likely requires Chromium-based scraping to work reliably.

Benefits

• Helps users filter and prioritize listings more effectively, especially based on move-in dates.
• Saves users time by reducing the need to click through to the original sites.
• Improves database accuracy by removing outdated listings with the proposed cron job.
• Creates a better overall user experience for people actively looking for properties.

Additional Context

No response

[orangecoding]

tbh, I do think that is a neat feature, but truly if I look through all the platforms, only immoscout rly seems to support most of them. I don't know if it makes sense to put in the effort when most of the platforms does not support it

[CommanderTvis]

Description and move-in dates are common across platforms; other attributes are only available on Immonet, Immowelt, and Immoscout.

[gorgobacka]

If I see it correctly, Fredy currently only parses the listings page for a provider. But the additional attributes are only visible on the details page and would require to scrape all those individual pages. I'm not sure how save this is against bot detection.

[orangecoding]

@gorgobacka is correct on this. We made sure to scrape description where possible, but we cannot open every single listing..