Epic - Open Data Publishing 2024

[tiffanychu90]

After receiving a research request, use this template to plan and track your work. Be sure to also add the appropriate project-level label to this issue (eg gtfs-rt, DLA).

Epic Information - Open Data Publishing 2024

Summary

• Easily track the PRs related to monthly updates to open data portal
  • 2022-2023 work Epic - Open Data Publishing 2023 #544
• Going forward, no need to open an issue each month, just link PR here
• Reference: Monthly dates downloaded for open data
• Publish 6 geospatial datasets each month:
  • ca_hq_transit_areas (HQTA polygons)
  • ca_hq_transit_stops (HQTA points)
  • ca_transit_routes (initially Traffic Ops request)
  • ca_transit_stops (initially Traffic Ops request)
  • speeds_by_stop_segments
  • speeds_route_time_of_day
• Steps to produce open data portal:
  • add current month's date in shared_utils/rt_dates
  • download GTFS scheduled trips, stops, shapes, stop_times, and vehicle_locations tables for a single day: cd gtfs_funnel/ && make funnel_gtfs_data
  • HQ areas/stops datasets: cd high_quality_transit_areas/ && make hqta_data (interspersed with notebook checks)
  • GTFS stops/routes geospatial datasets: cd open_data/ && make create_gtfs_schedule_geospatial_open_data
  • update metadata XML and publish to enterprise geodatabaes: cd open_data/ && make compile_open_data_portal (this step is more manual)

Issues

2024 open data

• Jan 2024: Jan open data #998
• Feb 2024: Feb open data #1029, Feb open data part 2 #1038 (publishing workflow refactor)
  • HQTA methodology / BRT changes: Research Task - Additional Muni stops added for HQTA #1017
• Mar 2024: Mar open data #1047, March open data part 2 #1048, March metadata #1051, March hqta rerun  #1056
• Apr 2024: Apr open data #1080, fix duplicates in gtfs data availability, xml for April 2024 open data #1082
• May 2024:
• Jun 2024: