* Company name with link to a separate page within cluster mapping* on that page there is a link to the incubator's website, description, address 1, address 2, city, state, zip code
| regular expression
|-
| [https://thembaisdead.com/list-of-startup-accelerators-and-incubators/ The MBA Is Dead ]
:*Regional DataGaebler incubator list is in E:\projects\Kauffman Incubator Project\01 Classify entrepreneurship ecosystem organizations\Gaebler\Results.txt and the script to retrieve the results is in the same director and called Gaebler.py. ==Extract incubator data from data on regional resources==
| [https://www.okbia.org/our-members Oklahoma Business Incubator Association]
| Done
| 34
| Oklahoma
| Incubator name and link to it
| regular expression
|-
| [https://www.socaltech.com/incubate.php High Tech News and Information for South California]
| Done
| 34
| California
| Url, company name, description, city, state
| regular expression
|-
| [http://barberacorporatelaw.com/blog/2014/4/8/28-business-incubators-in-the-los-angeles-area Leagal Counsel to Entrepreneurs and Emerging Growth Companies]
| [https://www.delawarebusinesstimes.com/coworking-incubators/ Delaware Business Times]
| Done
| 11
| DE
| URL, company name, address, city, state code, phone number, email, description
| Regular expression
|-
| [https://dmped.dc.gov/page/incubators-accelerators-and-co-working-spaces Incubators/Accelerators In DC]
| Done
| 55*
| DC
| Incubator name and link to it and brief description
| regular expression
|-
| [http://www.fbiaonline.org/Incubators/incubators.htm Florida Business Incubation Association]
| Done
| 72
| FL
| Company name, address, city, state code, zip code, phone number, URL
| regular expression
|-
| [https://www.georgia.org/business-incubators Georgia Department of Economic Development]
| Done
| 12
| GA
| URL, company name, address, city, state code, zip code, phone number, contact person
| regular expression
|-
| [https://ideagist.com/list-of-startup-accelerators-and-incubators-in-hawaii-usa/ IdeaGist - Hawaii] [http://www.buzgate.org/8.0/hi/fh_incubators.html?cb=none Business Utility Zone Gateway]
| Company name, address, city, state code, zip code, url, description
| regular expression
|-
| Done
| 25
| LouisianaLA| * incubator Company name* , contact name* person, title, address and , city, state code, zip code, phone number, email, url| regular expression|-| [http://www.innovatorsguide.org/incubators/maine_business_incubators.htm Innovators Guide - Maine]* link to website| Done| 4| ME| URL, company name, city, state code
| regular expression
|-
| Done
| 35
| MarylandMD| Incubator URL, company name, short state code, description, and link to another page within main site with contains a link to the incubator home page
| regular expression
|-
| Done
| 21
| MassachusettsMA| incubator nameCompany Name, short descriptionURL, and link to incubator home pageState Code, Description| regular expression|-| [https://www.viethconsulting.com/members/googlemaps/google_maps.php?mode=normal&orgcode=MBIA Michigan Business Innovation Association]| Done| 15| MI| Company Name, URL, Address, City, State Code, Zip Code
| regular expression
|-
|[https://bostonstartupsguidewww.americaninno.com/minne/guides-minne/everything-you-need-to-know-about-minnesotas-startup-incubators-and-accelerators/ MinneInno] [https://ideagist.com/list-of-accelerators-and-incubators-in-minnesota/ IdeaGist - Minnesota]| Done| 7| MN| URL, Company Name, City, State Code, Description| Regular Exes|-| [https://www.mississippi.org/home-page/business-services/entrepreneurs-small-business/mississippi-business-incubators/ Mississippi Delevlopment Authority]| Done| 26| MS| Company Name, Address, City, State Code, Zip Code, Phone Number, Contact Person, Title, Email, URL| Regular Exes|-|-| [https://www.mosourcelink.com/guides/innovation-led/wet-labs-and-technology-incubators SourceLink - MO] [https://ideagist.com/list-of-startup-accelerators-and-incubators-in-missouri-usa/ IdeaGist - Missouri]| Done| 23| MO| Company Name, URL, City, State Code, Description| Regular Exes|-| [https://ideagist.com/list-of-startup-accelerators-and-incubators-in-montana-usa/ IdeaGist - Montana]| Done| 2| MT| Company Name, URL, City, State Code| Manual|-| [https://www.omaha.com/special_sections/outlook/accelerators-incubators-help-boost-startups/article_97005ca0-1949-57e6-87bc-21fc4df9adba.html Omaha World Herald]| Done| 9| NE| Company Name, Address, City, State Code, Phone Number, URL, Description| Regular Exes|-| [http://business.nv.gov/Resource_Center/Coworking/_Incubator/_Accelerator_Spaces/ Department of Business and Industry - Nevada]| Done| 25| NV| URL, Company Name, State Code, Description| Regular Exes|-| [https://livefreeandstart.com/guideresources/incubators-makerspaces/ NH Tech Alliance ]| Done| 10| NH| Company Name, City, State Code, URL, Description| Regular Exes|-| [https://libguides.rutgers.edu/c.php?g=336746&p=2267151 Rutgers University Libraries]| Done| 15| NJ| URL, Company Name, City, State Code| Regular Exes|-| [https://gonm.biz/business-development/start/small-business-incubators-accelerators New Mexico Economic Development]| Done| 8| NM| Company Name, State Code, URL, Description| Regular Exes|-| [https://fuzehub.com/fuzehub-blog/fuzehub-report-new-york-state-incubators-and-innovation-hot-spots/ FuzeHub]| Done| 33| NY| URL, Company Name, Type, Manufacturing Sector, Services, Description| Regular Exes|-| [http://www.ncincubation.org/NCIncubators.aspx North Carolina Business Incubation Association]| Done| 33| NC| Company Name, Address, City, State Code, Contact Person, Title, Phone Number, URL, email| Manual|-| [https://www.business.nd.gov/aviation/TechnologyParksandIncubators/ Economic Development and Finance of North Dakota]| Done| 2| ND| Company Name, URL, Address, City, State Code, Description| Manual|-| [https://ideagist.com/list-of-startup-accelerators-and-incubators-in-ohio-usa/everyIdeaGist -bostonOhio]| Done| 7| OH| Company Name, URL, Ciry, State Code| Manual|-| [http://startup.choosewashingtonstate.com/resources/work-acceleratorspaces/ Washington State Department of Commerce]| Done| 25| WA| Url, company name, address, city, state, zipcode| manual collection|-incubator| [https://www.newtechnorthwest.com/resource-guide/incubators/ Boston Startup GuideSeattle Incubators]
| Done
| 10
| BostonSeattle|*Company Name and URL* Capital Provided & equity taken* Application Processname, url, description
| regular expression
|-
| [https://www.viethconsultingdigital.comnyc/membersincubators/googlemaps/google_maps.phpsearch?modekeywords=normal&orgcodefield_incubator_type_value=MBIA Michigan Business Innovation Association0 Digital NYC]| Not Done| 1525| MichiganNYC| incubator Company name, address, link to location on map, and link to incubator home pagedescription
| regular expression
|- | [https://livefreeandstartwww.oregon4biz.com/resourcesInnovate-&-Create/incubatorsR&D-makerspacesBusiness/ NH Tech Alliance Incubators/ Business Oregon]| Not Done| 825| New HampshireOregon| incubator Company name, town within NHaddress, city, state, zip code, service area, brief description, and link to home page
| regular expression
|-
| [httphttps://wwwtech.ncincubation.orgco/news/NCIncubatorsarizona-incubators-accelerator-listed-2017-08 Tech.aspx NC Business Incubation Associationco]
| Done
| 3316| North CarolinaArizona| Incubator URL, Company name, address, contact, title, phone number, url and emaildescription| Manual Data Collectionregular expression
|-
| [https://www.okbiaarkansasedc.orgcom/ourbusiness-members Oklahoma Business Incubator Associationresources/entrepreneurial-resources Arkansas Inc]
| Done
| 343| OklahomaArkansas| Incubator URL, Company name and link to it, description
| regular expression
|-
| [https://dmpedwww.dccreativeportland.govcom/pageresources/incubators-acceleratorsbusiness-and-co-working-spaces Incubators/Accelerators In DCcounseling CreativePortland]| Not Done| 1511| DCPortland| Incubator Company name and link to it and brief , url, description
| regular expression
|}
Notes:
*DC includes both incubators and accelerators
*Oregon includes both incubators and accelerators
*Arizona includes both incubators and accelerators
*Nevada includes incubators, accelerators and coworking space
*Clustermapping contains non-US data. They have been highlighted in the spreadsheet
DC, Oregon, Arizona and Nevada where all reprocessed in '''US Incubators - Reviewed By Ed.xlsx''' and files named statename-incubators.txt were created for import. For these 4 states, organizations were excluded by default and only included if they self-identified as an incubator in some fashion (name, description, etc.). Note that the US incubators data contains social impact incubators (though it does not appear to contain virtual ones as it is location based).
The SQL script LoadTables.sql, in E:\projects\Kauffman Incubator Project\01 Classify entrepreneurship ecosystem organizations\YiMaResearch\US Incubators, loads all of the tables in the '''incubators''' dbase and does the basic manipulation of the data. This code is also in Incubators.sql in E:\projects\Kauffman Incubator Project -- and this file's version was the last one updated.
The resulting assembly of the state data, which also includes cities like Los Angeles, Boston, NYC, and others, results in the '''USIncubators''' table and corresponding '''USIncubators.txt''' text file, which has 707 records and the following fields with the following coverage:
*orgname --707
*statecode --707
*url --609
*description --343
*city --524
*address --252
*zip --235
==Retrieving Incubators from Crunchbase Database==
We are pulling out relevant fields from crunchbase database using incubator uuids chosen by Yi and Libby following the process:
1) Create a file of uuids of incubators
*CrunchbaseShortOrgDescChosenByYi.txt (275)
*CrunchbaseShortOrgDescChosenByLibby.txt (301)
File path: Z:\crunchbase3
2) Load the file into the database
DROP TABLE ChosenShortOrgUUIDs;
CREATE TABLE ChosenShortOrgUUIDs (
uuid varchar(100)
);
\COPY ChosenShortOrgUUIDs FROM 'CrunchbaseShortOrgDescChosenByYi.txt' WITH DELIMITER AS E'\t' HEADER NULL AS '' CSV
--275
DROP TABLE ChosenLongOrgUUIDs;
CREATE TABLE ChosenLongOrgUUIDs (
uuid varchar(100)
);
\COPY ChosenShortOrgUUIDs FROM 'CrunchbaseShortOrgDescChosenByLibby.txt' WITH DELIMITER AS E'\t' HEADER NULL AS '' CSV
--301
3) Run a query that joins uuids with related fields
Fields we are interested in:
company_name, domain, homepage_url, country_code, state_code, region, city, address, status, short_description, category_list, category_group_list, funding_rounds, funding_total_usd, founded_on, employee_count, A.uuid, primary_role, type
1. Replace “\s+$” with [leave blank] removes to remove all the empty lines
2. Replace "s+$" with [leave blank] to removes all the whitespaces
3. <.*> finds everything that starts with < and ends with >
4. Replace href=" with "\n" to start a new line for each url
5. Replace "\s\s+" with [leave blank] to remove more than one white spaces
6. Replace "(?-s)^(.+)\R(.+)\R(.+)\R(.+)\R(.+)\R(.+)\R" with "\1\2\3\4\5\6\r\n" to merge every six lines
7. Replace "[ ]{2,}" with [leave blank] removes more than one spaces between two words
8. Crtl+Q, B turns on the block select mode
9. Replace " .*" with [leave black] to remove noncharacters
=Useful PostgreSQL Script=
==Loading/Unloading Data==
Always load/unload data using the PostgreSQL specific copy function below. Always load tab-delimited data that is UTF-8 encoded, with PC or UNIX line endings, and that has a header row. NEVER DEVIATE FROM THIS (unless there is a VERY good reason, like the source data is huge and comes preformatted differently).
Load using:
<nowiki>\COPY tablename FROM 'filename.txt' WITH DELIMITER AS E'\t' HEADER NULL AS '' CSV </nowiki>
Unload (copy to txt file) using:
<nowiki>\COPY tablename TO 'filename.txt' WITH DELIMITER AS E'\t' HEADER NULL AS '' CSV</nowiki>