When I create a user report for resident owners for one of the buildings, the report includes resident owners of the other buildings too.

When creating a report, ensure that you only select residents from the System Groups. Avoid selecting options from User or Unit Groups. After the report has been generated, save it in CSV format. Then, open the file in Excel, apply a filter by Unit, and remove any units that do not belong to the building.