Will Cleland (Work Log)

Will Cleland Work Logs (log page)

20160210 (Wed) 2:30 - Finish reading NHL paper, determine necessary variables for paper, find variables in SQL code

20160210 (Wed) 5:30 - Read paper, and created list of necessary variables and where to find them

20160211 (Thur) 2:30 - Update NHL page with all work done so far created new dropbox with necessary files and variables and where to find them

20160211 (Thur) 5:30 - Updated page and dropbox worked with Ed to determine create final list of necessary information in order to begin downloads

20160216 (Tue) 2:30 - Download all of the databases in order to begin creating master table and get as far as possible on master table

20160216 (Tue) 5:30 - Downloaded databases and found distinct player-seasons to help begin join

20160217 (Wed) 2:30 - Continue working on the master table, today we want to count unique data entries in each table to facilitate the join and whatever else is needed.

20160217 (Wed) 5:30 - Created new tables for each of the original tables where all player-seasons are unique.

20160219 (Fri) 2:00 - Join tables

20160219 (Fri) 6:00 - Joined everything except the Cap Geek Table

20160222 (Mon) 2:00 - Join the CapGeek Table to the other tables

20160222 (Mon) 5:45 - Reformatted date of birth, team, and season entries in order to begin fuzzy matching

20160224 (Wed) 2:10 - Set up Fuzzy Match and do it

20160224 (Wed) 5:19 - Fuzzy Matched

20160226 (Fri) 2:00 - Sort through fuzzy matched and determine exceptions so that we can join tables

20160226 (Fri) 5:00 - Refined fuzzy match search and began search

20160307 (Mon) 2:00 - Sort through Fuzzy Match

20160307 (Mon) 6:00 - Found path and set up terminal, fixed date of birth issue, learned how to join bios and historical table with bios data

20160308 (Tue) 2:30 - join bios and historical table

20160308 (Tue) 5:30 - joined tables and cleaned up previous work, ready to begin fuzzy match again

20160309 (Wed) 2:10 - fuzzy match or pull new NHL data

20160309 (Wed) 5:25 - Pulled all the new NHL for the 2014 season and added this data to the NHL database

20160314 (Mon) 1:59 - Continue pulling NHL data and see where Sahil is on Fanager webcrawler

20160314 (Mon) 5:13 - Pulled all of NHL 2015 season data and wrote SQL to join tables to create comprehensive data on NHL statistics

20160316 (Wed) 2:00 - Finish compiling NHL data and if Sahil is done fuzzy match Fanager data

20160316 (Wed) 3:45 - Finished compiling all of the NHL data and am now waiting for the Fanager info

20160318 (Fri) 2:00 - Check to see how far Sahil is on the crawler and decide what I do today

20160318 (Fri) 5:00 - Finished uploading Fanager data to NHL database and had the team meeting

20160321 (Mon) 2:00 - Fuzzy Match Fanager to NHL data

20160321 (Mon) 5:00 - Cleaned fanager data and now ready to match with capgeek data

20160323 (Wed) 2:00 - Join fanager data with capgeek data and fuzzy match if there is time

20160323 (Wed) 5:20 - Fuzzy matching fanager data with capgeek data

20160325 (Fri) 2:00 - Finish Fuzzy Matching fanager and capgeek data

20160325 (Fri) - Rewrote lost code and began fuzzy matching again