Difference between revisions of "Scholar Crawler Main Program"

From edegan.com
Jump to navigation Jump to search
 
(5 intermediate revisions by 2 users not shown)
Line 1: Line 1:
{{McNair Projects
+
{{Project
 +
|Has project output=Tool
 +
|Has sponsor=McNair Center
 
|Has title=Scholar Crawler Main Program
 
|Has title=Scholar Crawler Main Program
 
|Has owner=Christy Warden,
 
|Has owner=Christy Warden,
Line 21: Line 23:
  
 
=Stage 4=
 
=Stage 4=
 +
[[PDF to Text Converter]]
 +
 +
=Stage 5=
 +
[[Key Terms Search]]

Latest revision as of 12:47, 21 September 2020


Project
Scholar Crawler Main Program
Project logo 02.png
Project Information
Has title Scholar Crawler Main Program
Has owner Christy Warden
Has start date 10/23/2017
Has deadline date
Has keywords Google Scholar, python
Has project status Active
Has sponsor McNair Center
Has project output Tool
Copyright © 2019 edegan.com. All Rights Reserved.


Overview

This code is located at E:/McNair/Software/Google_Scholar_Crawler/mainProgram.py. It calls on various other pieces of code to create a cohesive program for the patent thicket project which takes in a search term and a number of pages. It responds by searching on Google Scholar for that term, downloaded as many papers as it can from that search, converting them to text and searching for key terms and a definition of patent thicket in the text. Each piece of code can also be used individually for other applications.

Stage 1

Sets up a series of directories for results to go in.

Stage 2

Google Scholar Crawler under scholarcrawl.py heading.

Stage 3

PDF Downloader

Stage 4

PDF to Text Converter

Stage 5

Key Terms Search