Redfin Scouting Report: Data Accuracy Issues and Solutions for Home Buyers

In its initial launch, Redfin's Scouting Report tool faced significant data inaccuracies affecting critical metrics like agent performance and property sales history. The company has since addressed most of these errors, highlighting the inherent challenges of aggregating real estate data from multiple listing services (MLSs). For home buyers, this situation underscores the importance of verifying agent track records and sale data through multiple sources before making a purchasing decision.

What Data Issues Did Redfin Encounter?

Redfin identified and corrected several core problems shortly after the Scouting Report launch. The most critical error was a miscalculation of Days on Market (DOM), a key metric indicating how long a property was listed for sale before going under contract. This bug was fixed on the same day it was reported. Other issues included incorrect brokerage affiliations for agents in markets like Phoenix and incomplete historical sales data in regions including Denver and San Diego. These inaccuracies originated from bugs in the data feed or limitations imposed by the data providers.

How Are Issues with Dual Agency Represented?

A more complex issue involved the representation of dual agency, a practice where one agent represents both the buyer and the seller in a transaction. The original data incorrectly labeled some transactions as dual agency when the buyer was actually unrepresented. To address this, Redfin updated its platform to provide a more nuanced description that includes the possibility of a transaction involving an unrepresented buyer. This is a common data integrity issue stemming from how MLSs record transaction details.

What Challenges Exist with Data Licensing?

Data accessibility proved to be a major hurdle. In some areas, data providers suspended access to the Scouting Report pending review. For example, service was suspended in Washington D.C. and the East Bay of San Francisco. In Sacramento and Atlanta, Redfin concluded it could not obtain complete data and disabled the tool entirely. These scenarios illustrate that data completeness varies significantly by region due to licensing rules established by local MLSs.

What Should Home Buyers and Agents Do?

For consumers, the key takeaway is to use any agent performance tool as one piece of a broader research strategy. Cross-reference an agent’s claimed sales history directly with the agent or their brokerage. For real estate agents, if your team's transactions are not being accurately aggregated under a single profile, the resolution process is handled on a case-by-case basis by contacting the platform directly.

The reliability of real estate data is not absolute. While platforms like Redfin work to provide transparent information, discrepancies can occur. Home buyers are advised to conduct thorough, independent verification of any data critical to their decision-making process.