Bill Scraper

• Located in lametro/bills.py
• Creates board reports and their associated attachments, sponsorships, votes, relations, and topics
• Further reading: https://open-civic-data.readthedocs.io/en/latest/proposals/0006.html

Tip

The following terms all refer to the same thing:

• Matter (Legistar API)
• Bill (Open Civic Data universe)
• Board report (Legistar UI, Councilmatic universe)

Key issues

• Board reports are added to the Legistar API before they are published to InSite. We need to determine which are “private” in order to suppress them in Councilmatic.
  • Why do we need to scrape private bills?
  • Limit private scrape
• Our windowed scrapes rely on timestamps from the Legistar API, however the timestamps are not always updated when changes are made.
  • Metro scraper did not scrape EventAgendaStatusName
  • Metro: Scrape matters updated within a window, as well as matters related to events updated within a window