Skip to content

Importing mechanism for the Texas Real Estate Commission TREC "High Value Data Sets" into PostgreSQL

License

Notifications You must be signed in to change notification settings

EvanCarroll/db-TREC-Texas-Real-Estate-Commission

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Texas Real Estate Commission (TREC)

Currently we download from TREC the following "High Value Data Sets"

  • Broker and Sales Agent License Holder Information
  • Inspector License Holder Information
  • Easement or Right-Of-Ways agents License Holder Information

You can find the data and field definitions on the TREC High Value Data Sets Instructions page

Rationale

I'm looking for a broker that is independent in my area, that

  1. Won't charge me a desking fee.
  2. Doesn't want a percentage cut.
  3. Preferably local and clever.

Thus...

SELECT *
FROM trec.view_all_licenses
WHERE license_type = 'Individual Broker'
	AND license_status     = 'Current and active'
	AND mailing_county     = 'HARRIS'
	AND physical_county    = 'HARRIS'
	AND addr_mailing_city  = 'KINGWOOD'
	AND addr_physical_city = 'KINGWOOD';

And, I can go broker shopping.

Instructions

Inside this repo, you'll find a script called init.sh. Running that script should download and convert the raw data to a format for ingestion. This scripts calls runall.sql which handles the creation of the schema and loading the data into PostgreSQL.

Requirements

  • PostgreSQL
  • iconv (to convert from CP850 to UTF-8)
  • sed to remove \x00's from the feed.
  • curl to download the raw data files.

Fund work and integration

Want to use this technology for an application or need help developing an idea, integration or further work with the data set? Shoot me an email for a quote.

Releases

No releases published

Packages

No packages published