Minh Le (Work Log)

Summer 2018

Minh Le Work Logs (log page) 2018-06-25:

• Fixed Peter's Parser's compatibility issue with Python3. All code can now be used with Python 3
• Ran through everything in the Parser on a small test set.
• Completed moving all the files.
• Ran the Parser on the entire list.
• The run took 3h45m to execute the crawling (not counting the other steps) with 5 results per accelerators
• Update @5:48PM The Analysis has been taking an hour and 15 to run and only 70% done. I need to go home now but these steps are taking a lot of time

2018-06-22:

• Moved Peter's Parser into my project folder. Details can be read under the folder "Notes. READ THIS FIRST\movelog".
• The current Selenium version and Chrome seem to hate each other on the RDP (throwing a bunch of errors on registry key), so I had to switch to a Firefox webdriver. Adjusting code and inserting a bunch of sleep statements.
• For some reason (yet to be understood) if I save HTML pages with the utf-8 encoding, it will get mad at me. So commented that out for now.
• The code seemed slow compared to those existed in Kyran's project. Might attempt to optimize and parallelize it?
• it seems that python 3 does not support write(stuff).encoding('utf-8')?

2018-06-21:

• Continued reading through past projects (it's so disorganized...)
• Moved Kyran's Google Classifier to my project folder. Details can be read under the folder "Notes. READ THIS FIRST\movelog".
• Tried running the Classifier from a new folder. The Shell crashed once on the web_demo_feature.py
• Ran through everything in the Classfier. Things seemed to be functioning with occasional error messages
• Talked to Kyran about the project and clarified some confusions up
• Made a to-do list in the general note file ("Notes. READ THIS FIRST\NotesAndTasks.txt")

2018-06-20:

• Set up Work Log page.
• Edited Profile page with more information.
• Created project page: Accelerator Demo Day.
• Made new project folder at E:\McNair\Projects\Accelerator Demo Day.
• Read through old projects and started copying scripts over as well as cleaned things up.
• Created movelog.txt to track these moving details.
• Talked to Ed more about the project goals and purposes

2018-06-19: More SQL. Talked to Ed and received my project (Demo Day Crawler).

2018-06-18: Set up RDPs, Slacks, Profile page and learned about SQL.