"CS 544" (CS 639-4) Resources

Software

• hadoop-3.2.4.tar.gz
• spark-3.2.2-bin-hadoop3.2.tgz
• apache-cassandra-4.0.7-bin.tar.gz
• spark-cassandra-connector_2.12-3.2.0.jar(wget https://repo1.maven.org/maven2/com/datastax/spark/spark-cassandra-connector_2.12/3.2.0/spark-cassandra-connector_2.12-3.2.0.jar)
• apache-hive-3.1.3-bin.tar.gz

Datasets

HDMA Loan Applications

• HDMA loan applications (WI): hdma-wi-2021.zip (https://ffiec.cfpb.gov/v2/data-browser-api/view/csv?states=WI&years=2021)
• HDMA loan applications (WI), gzip files: wi2021.csv.gz, wi2022.csv.gz, wi2023.csv.gz
• bank LEIs: arid2017_to_lei_xref_csv.zip (https://s3.amazonaws.com/cfpb-hmda-public/prod/snapshot-data/arid2017tolei/arid2017_to_lei_xref_csv.zip)
• HDMA code lookups: code_sheets.zip (https://github.com/cfpb/api/tree/master/resources/datasets/hmda/code_sheets)
• HDMA Parquet Sample hdma-wi-2021.parquet

Weather Data

• Station Metadata: ghcnd-stations.txt (https://www.ncei.noaa.gov/pub/data/ghcn/daily/ghcnd-stations.txt)
• WI Records: wi-stations.zip (https://www.ncei.noaa.gov/pub/data/ghcn/daily/by_station/)
• Select WI Records: select-wi-stations.zip (https://www.ncei.noaa.gov/pub/data/ghcn/daily/by_station/)

San Francisco

• Fire Department Calls for Service: sf.zip (https://data.sfgov.org/Public-Safety/Fire-Department-Calls-for-Service/nuek-vuh3)

Other Misc

• land use data
• census data
• Madison properties
• EDGAR
• SF fires
• Weather Data
• Flight Delays