Changes

Jump to navigation Jump to search
'''To use STEP1_crawl.py''':
1. Change LIST_FILEPATH in line 26 to be the name of the file that contains the list of things you would like to search.
 
2. Change NUMRESULT to be however many results you would like from Google.
 
3. Adjust DONT_COLLECT to include any websites that you don't want.
 
4. If you would like to add another search keyword, add this in line 87 which is queries.append(name + "whatever you want here")
 
5. Change line 127 to be the name of your output file.
145

edits

Navigation menu