Skip to content

This repository contains an RPA robot that was designed to scrap up to 500 pieces of property information for a given location from a real estate website. The extracted data is then intelligently organized, filtered, and sorted according to user-defined criteria, and integrated into the Excel file, output.xlsx.

Notifications You must be signed in to change notification settings

MaxineXiong/Web-Scraping-RPA

Repository files navigation

UiPath RPA Robot

Web Scraping for Real Estate Data

GitHub License: MIT Platform - UiPath RPA


This repository contains a robust and efficient solution built using the UiPath Automation Platform that streamlines the process of gathering real estate data from zillow.com, a popular online real estate marketplace. The robot is designed to extract essential information about properties in a given location, including price, number of bedrooms, number of bathrooms, area (sqft), and address, for a maximum of 500 properties. The extracted data is then intelligently organized, filtered, and sorted according to user-defined criteria, and seamlessly integrated into an Excel file named output.xlsx.

Having access to accurate and up-to-date property information is essential for making timely, informed decisions on property investment and management. This UiPath RPA robot provides a solution to efficiently collect and manage property data from internet, and can save you significant time and effort by automating the repetitive and time-consuming data search and entry process.

This repository includes solutions created using both Classic Design and Modern Design in UiPath Studio. You can check out the automation demo videos by clicking on the badge below:

View Demo - Web-Scraping-Real-Estate-Data

View Demo - Web-Scraping-Real-Estate-Data


Installation

Before installing UiPath Softwares, please make sure your system meets the hardware and software requirements outlined in the UiPath documentation.

The Uipath Platform includes the following tools:

  • UiPath Studio
  • UiPath Assistant
  • UiPath Automation Cloud, including UiPath Orchestrator
To run this project successfully, please follow these steps to install UiPath Studio:

Step 1 : Visit uipath.com and click Try UiPath Free button.

Step 2: Sign up for a personal account.

Step 3: Verify your account in email.

Step 4: Log into the UiPath Automation Cloud using your account, and click the Download Uipath Studio button.

Step 5: Click Sign in.

Step 6: Select UiPath Studio Pro.

Step 7: Follow the system instructions to complete the installation of UiPath Studio Pro.

Please also follow these steps below to connect your local machine to the UiPath Automation Cloud for deploying this workflow (if desired):

Step 1: Sign up and log into UiPath Automation Cloud.

Step 2: Add a Tenant.

Step 3: Edit the user and assign the Automation Users role to grant them permission to execute processes.

Step 4: Go to the Orchestrator interface and click on Tenant in the left pane.

Choose Folders and then click the + icon to create a new folder.

Step 5: Navigate back to Tenant interface and follow the steps below to start adding an Automation User for Unattended Robot in Manage Access.

a) Scroll down to locate the target user, then assign the Automation User role to grant them the necessary permissions. Click Next button to move on to the next page.

b) In the Personal automations setup page, select the options to Enable user to run automations and Create a personal workspace for this user and enable optimal Studio Web experience, then click on the Next button.

c) On the Unattended setup page, check the option to Enable this user to run unattended automations, choose Specific Windows credentials for local machine connection to Orchestrator, provide Domain\Username of your user account on local machine (which can be found by executing whoami in Command Prompt), and enter the Password for accessing your local machine. Finally, click on the Update button.

Step 6: Now, go to the Machines page where you should see the workspace machine for the target user already created. Click the ellipsis to select Edit Machine.

Enter 1 for both the Production (Unattended) and Testing fields, then click the Update button.

Step 7: Now return to the newly created folder, choose the Machines menu, and click Manage Machines in Folder button to assign the machine you just configured to the folder.

You should now have both the User and Machine assigned to the new folder.

Step 8: Open UiPath Assistant and click Sign In. If you see the green circle in the top right corner, you’ve successfully connected your local UiPath Studio to the UiPath Automation Cloud.

You can confirm the connection by opening UiPath Studio and checking for a green circle at the bottom.


To publish a process from UiPath Studio to Orchestrator, switch to the new folder you just created in the Orchestrator, and then click to Publish the process as a package.

To learn more about other best practices on Orchestrator, please refer to the Orchestrator User Guide.


Usage

To run the RPA workflow on your local machine, follow these steps:

  1. Either download this repository to your local machine or clone it directly within your UiPath Studio.
  2. Open the UiPath Studio software on your machine.
  3. Locate and open the Main.xaml file from the downloaded repository in UiPath Studio.
  4. Run the Main.xaml file to initiate the web scraping process.

Acknowledgement

I would like to express my gratitude to the UiPath community for providing resources, tutorials, and a platform for automation enthusiasts to learn and collaborate.


License

This project is licensed under the MIT License, which means you're free to modify, distribute, and use the code in your own projects.

About

This repository contains an RPA robot that was designed to scrap up to 500 pieces of property information for a given location from a real estate website. The extracted data is then intelligently organized, filtered, and sorted according to user-defined criteria, and integrated into the Excel file, output.xlsx.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published