227
edits
Changes
Jump to navigation
Jump to search
Listing Page Classifier Progress (view source)
Revision as of 12:51, 25 April 2019
, 12:51, 25 April 2019→Progress Log
**WebDriverException: invalid session id occurred during the iteration (solved it by not closing the driver each time)
*test run site map
**BFS takes much more time than DFS when depth is big(trying to fix will look into this later)
'''4/22/2019'''
**e.g. https://bunkerlabs.org/
**get the scroll height before running headless browsers (Nope, doesn’t work)
**trying try out a different package ‘splinter’
https://splinter.readthedocs.io/en/latest/screenshot.html
*Documentation on wiki
*went back to the time complexity issue with BFS and DFS
**DFS algorithm has flaws!! (it does not visit all nodes that we wanted to visit, this is why DFS is much faster)**need to look into the problem with the DFStomorrow '''4/25/2019''' Site map:*the recursive DFS will not work in this type of problem, and if we rewrite it in an iterative way, it will be similar to the BFS approach. So, I decided to only keep the BFS since the BFS is working just fine.*Implement the BFS algorithm: trying out deque etc. to see if it runs faster
