Difference between revisions of "Crunchbase Accelerator Founders"
| Line 12: | Line 12: | ||
==Updated LinkedIn Crawler== | ==Updated LinkedIn Crawler== | ||
| − | New Test Account | + | We will be using a LinkedIn Crawler to find information about accelerator founders. There is a previous project whose code is found in |
| + | E:/McNair/Projects/LinkedIn Crawler/LinkedIn_Crawler/linkedin | ||
| + | |||
| + | My code is found in the selenium computer at the root. | ||
| + | |||
| + | =New Test Account= | ||
Username: mcboatfaceboaty670@gmail.com | Username: mcboatfaceboaty670@gmail.com | ||
Password: McNair2018 | Password: McNair2018 | ||
Use the selenium computer on Rice Visitor wifi. | Use the selenium computer on Rice Visitor wifi. | ||
| − | After logging in a couple of times, LinkedIn will get suspicious and ask you to confirm that you are not a robot using reCaptcha. I got around this by delaying the program by 3 minutes so that I had time to complete the reCaptcha test. However, sometimes reCaptcha loses connection and it forces you to continue the tests which can be frustrating. When this happens, I disconnect and reconnect from the wifi as well as switch between the test accounts. | + | After logging in a couple of times, LinkedIn will get suspicious and ask you to confirm that you are not a robot using reCaptcha. I got around this by delaying the program by 3 minutes so that I had time to complete the reCaptcha test. However, sometimes reCaptcha loses connection and it forces you to continue the tests which can be frustrating. When this happens, I disconnect and reconnect from the wifi as well as switch between the test accounts. |
| − | |||
==Getting Data== | ==Getting Data== | ||
Revision as of 16:36, 9 July 2018
| Crunchbase Accelerator Founders | |
|---|---|
| Project Information | |
| Project Title | Crunchbase Accelerator Founders |
| Owner | Grace Tan |
| Start Date | 6/18/18 |
| Deadline | |
| Primary Billing | |
| Notes | |
| Has project status | Active |
| Copyright © 2016 edegan.com. All Rights Reserved. | |
Contents
Related Pages
Crunchbase Data Crunchbase Accelerator Equity LinkedIn Crawler (Python)
Updated LinkedIn Crawler
We will be using a LinkedIn Crawler to find information about accelerator founders. There is a previous project whose code is found in
E:/McNair/Projects/LinkedIn Crawler/LinkedIn_Crawler/linkedin
My code is found in the selenium computer at the root.
New Test Account
Username: mcboatfaceboaty670@gmail.com Password: McNair2018
Use the selenium computer on Rice Visitor wifi. After logging in a couple of times, LinkedIn will get suspicious and ask you to confirm that you are not a robot using reCaptcha. I got around this by delaying the program by 3 minutes so that I had time to complete the reCaptcha test. However, sometimes reCaptcha loses connection and it forces you to continue the tests which can be frustrating. When this happens, I disconnect and reconnect from the wifi as well as switch between the test accounts.
Getting Data
To get the founder UUIDs from each accelerator, input the accelerator UUID (or name all lowercase if its one work) into this link:
https://api.crunchbase.com/v3.1/organizations/ + UUID of organization + ?relationships=founders&user_key=662e263576fe3e4ea5991edfbcfb9883
Code
scrapefounders.py
This code lives in Z:\crunchbase2\scrapefounders.py
This program takes Accelerators and UUIDs.txt found in a Z:\crunchbase2\Accelerators and UUIDs.txt and extracts the accelerator UUIDs and loads the information of each founder from the crunchbase API using the link above. It then takes the information given by the API and returns a dictionary of accelerator UUIDs as keys and founder UUIDs as values.
