Will Cleland (Work Log)
Will Cleland Work Logs (log page)
20160210 (Wed) 2:30 - Finish reading NHL paper, determine necessary variables for paper, find variables in SQL code
20160210 (Wed) 5:30 - Read paper, and created list of necessary variables and where to find them
20160211 (Thur) 2:30 - Update NHL page with all work done so far created new dropbox with necessary files and variables and where to find them
20160211 (Thur) 5:30 - Updated page and dropbox worked with Ed to determine create final list of necessary information in order to begin downloads
20160216 (Tue) 2:30 - Download all of the databases in order to begin creating master table and get as far as possible on master table
20160216 (Tue) 5:30 - Downloaded databases and found distinct player-seasons to help begin join
20160217 (Wed) 2:30 - Continue working on the master table, today we want to count unique data entries in each table to facilitate the join and whatever else is needed.
20160217 (Wed) 5:30 - Created new tables for each of the original tables where all player-seasons are unique.
20160219 (Fri) 2:00 - Join tables
20160219 (Fri) 6:00 - Joined everything except the Cap Geek Table
20160222 (Mon) 2:00 - Join the CapGeek Table to the other tables
20160222 (Mon) 5:45 - Reformatted date of birth, team, and season entries in order to begin fuzzy matching
20160224 (Wed) 2:10 - Set up Fuzzy Match and do it
20160224 (Wed) 5:19 - Fuzzy Matched
20160226 (Fri) 2:00 - Sort through fuzzy matched and determine exceptions so that we can join tables
20160226 (Fri) 5:00 - Refined fuzzy match search and began search
20160307 (Mon) 2:00 - Sort through Fuzzy Match
20160307 (Mon) 6:00 - Found path and set up terminal, fixed date of birth issue, learned how to join bios and historical table with bios data
20160308 (Tue) 2:30 - join bios and historical table
20160308 (Tue) 5:30 - joined tables and cleaned up previous work, ready to begin fuzzy match again
20160309 (Wed) 2:10 - fuzzy match or pull new NHL data
20160309 (Wed) 5:25 - Pulled all the new NHL for the 2014 season and added this data to the NHL database
20160314 (Mon) 1:59 - Continue pulling NHL data and see where Sahil is on Fanager webcrawler
20160314 (Mon) 5:13 - Pulled all of NHL 2015 season data and wrote SQL to join tables to create comprehensive data on NHL statistics
20160316 (Wed) 2:00 - Finish compiling NHL data and if Sahil is done fuzzy match Fanager data
20160316 (Wed) 3:45 - Finished compiling all of the NHL data and am now waiting for the Fanager info
20160318 (Fri) 2:00 - Check to see how far Sahil is on the crawler and decide what I do today
20160318 (Fri) 5:00 - Finished uploading Fanager data to NHL database and had the team meeting
20160321 (Mon) 2:00 - Fuzzy Match Fanager to NHL data
20160321 (Mon) 5:00 - Cleaned fanager data and now ready to match with capgeek data
20160323 (Wed) 2:00 - Join fanager data with capgeek data and fuzzy match if there is time
20160323 (Wed) -
