Web Download Exercises

All Data Between Days

This exercises use the data from https://www.githubarchive.org/

Create a script that downloads all data from the Github archive between two dates.

Example:

$ python fetch_github_data.py 2016-02-28 2017-03-02
Fetching 2017-02-28-0.json.gz
Fetching 2017-02-28-1.json.gz
Fetching 2017-02-28-2.json.gz
Fetching 2017-02-28-3.json.gz
Fetching 2017-02-28-4.json.gz
Fetching 2017-02-28-5.json.gz
Fetching 2017-02-28-6.json.gz
Fetching 2017-02-28-7.json.gz
Fetching 2017-02-28-8.json.gz
Fetching 2017-02-28-9.json.gz
Fetching 2017-02-28-10.json.gz
Fetching 2017-02-28-11.json.gz
Fetching 2017-02-28-12.json.gz
Fetching 2017-02-28-13.json.gz
Fetching 2017-02-28-14.json.gz
Fetching 2017-02-28-15.json.gz
Fetching 2017-02-28-16.json.gz
Fetching 2017-02-28-17.json.gz
Fetching 2017-02-28-18.json.gz
Fetching 2017-02-28-19.json.gz
Fetching 2017-02-28-20.json.gz
Fetching 2017-02-28-21.json.gz
Fetching 2017-02-28-22.json.gz
Fetching 2017-02-28-23.json.gz
Fetching 2017-03-01-0.json.gz
Fetching 2017-03-01-1.json.gz
Fetching 2017-03-01-2.json.gz
Fetching 2017-03-01-3.json.gz
Fetching 2017-03-01-4.json.gz
Fetching 2017-03-01-5.json.gz
Fetching 2017-03-01-6.json.gz
Fetching 2017-03-01-7.json.gz
Fetching 2017-03-01-8.json.gz
Fetching 2017-03-01-9.json.gz
Fetching 2017-03-01-10.json.gz
Fetching 2017-03-01-11.json.gz
Fetching 2017-03-01-12.json.gz
Fetching 2017-03-01-13.json.gz
Fetching 2017-03-01-14.json.gz
Fetching 2017-03-01-15.json.gz
Fetching 2017-03-01-16.json.gz
Fetching 2017-03-01-17.json.gz
Fetching 2017-03-01-18.json.gz
Fetching 2017-03-01-19.json.gz
Fetching 2017-03-01-20.json.gz
Fetching 2017-03-01-21.json.gz
Fetching 2017-03-01-22.json.gz
Fetching 2017-03-01-23.json.gz
Fetching 2017-03-02-0.json.gz
Fetching 2017-03-02-1.json.gz
Fetching 2017-03-02-2.json.gz
Fetching 2017-03-02-3.json.gz
Fetching 2017-03-02-4.json.gz
Fetching 2017-03-02-5.json.gz
Fetching 2017-03-02-6.json.gz
Fetching 2017-03-02-7.json.gz
Fetching 2017-03-02-8.json.gz
Fetching 2017-03-02-9.json.gz
Fetching 2017-03-02-10.json.gz
Fetching 2017-03-02-11.json.gz
Fetching 2017-03-02-12.json.gz
Fetching 2017-03-02-13.json.gz
Fetching 2017-03-02-14.json.gz
Fetching 2017-03-02-15.json.gz
Fetching 2017-03-02-16.json.gz
Fetching 2017-03-02-17.json.gz
Fetching 2017-03-02-18.json.gz
Fetching 2017-03-02-19.json.gz
Fetching 2017-03-02-20.json.gz
Fetching 2017-03-02-21.json.gz
Fetching 2017-03-02-22.json.gz
Fetching 2017-03-02-23.json.gz