Federal Grant Data - Revision history

Ed: /* NIH */

2022-04-10T21:58:05Z

NIH

2020-10-06T16:33:07Z

2020-10-06T16:11:55Z

2020-09-21T17:41:42Z

2020-09-21T17:34:18Z

2020-09-20T17:19:59Z

2020-09-20T17:12:12Z

2020-04-29T19:24:35Z

2020-04-29T19:20:12Z

2019-04-10T01:36:16Z

NSF

@@ Line 53: / Line 53: @@
 ===NIH===
-The update process was:
+The 2018 update process was:
 *Visit https://exporter.nih.gov/ExPORTER_Catalog.aspx
 *Retrieve 2016, 2017, and 2018 csvs to E:\projects\grants\NIH\Source Files
@@ Line 67: / Line 67: @@
 *SBIR/STTR Joint codes: RC3,SB1,UB1,UC3
 *'''Total_Cost''' is only available in certain instances but is the best cost variable.
 ==grants.gov==

@@ Line 8: / Line 8: @@
 |Does subsume=NSF Data, NIH Data,
 }}
 <onlyinclude>The [[Federal Grant Data]] project collects and processes [[NIH Data]], [[NSF Data]], and other federal grant information from structured government sources and imports it into a relational database for use. See also: The [[Trial Data Project]] and the [[FDA Trials Data]] project.</onlyinclude>
 ==Latest Update==

@@ Line 9: / Line 9: @@
 }}
-==General==
+<onlyinclude>
+The [[Federal Grant Data]] project collects and processes [[NIH Data]], [[NSF Data]], and other federal grant information from structured government sources and imports it into a relational database for use. See also: The [[Trial Data Project]] and the [[FDA Trials Data]] project.
-Working with NIH, NSF, and other federal grant data
+</onlyinclude>
 ==Latest Update==

@@ Line 1: / Line 1: @@
 {{Project
-|Has project output=
+|Has project output=Data
 |Has sponsor=McNair Center
 |Has title=Federal Grant Data

@@ Line 1: / Line 1: @@
 {{Project
 |Has sponsor=McNair Center
 |Has title=Federal Grant Data

@@ Line 49: / Line 49: @@
    </xsd:complexType>
   </xsd:element>
 ===NIH===

@@ Line 27: / Line 27: @@
 *Run LoadNSF.sql to produce tables NSFGeneral, NSFInvestigator and NSFInstitution in dbase '''grants'''
-Note that SBIR '''program_code'''s are available from https://www.nsf.gov/awardsearch/lookup?type=program&qrytxt=*SBIR*
+Note that '''program_code'''s are available from
-  SBIR/STTR codes
+  Combined SBIR/STTR codes
-  '168E','5370','169E','166E','165E','164E','163E','167E','5151','5727','4804','Y052','1532','Y813','2282','6537','Y350','4645','9311','2266','1591','1505','Z408'
+  '168E','5370','169E','166E','165E','164E','5371','163E','167E','5151','5727','4804','Y052','1532','Y813','2282','6537','Y350','4645','9311','2266','5370','168E','1591','1505','Z408'
 Unfortunately, we need the Program Element code, shown below, but our extractor doesn't currently pull it.

@@ Line 22: / Line 22: @@
 *Extract them to E:\projects\grants\NSF\XML
 *Remove 3 bad XML files that cause the parser to crash
-*Run Jeemin_NSF_XML_Parser.py
+*Move the whole thing back to E:\mcnair\Projects\Federal Grant Data\NSF\NSF Extracted Data
-*Add new data to old, removing dups and creating three files:
+*Fix up and run Jeemin_NSF_XML_Parser.py, so that it also takes ProgramElement (see below) and make:
-**general.txt
+**
-**institutions.txt
+*Run LoadNSF.sql to produce tables NSFGeneral, NSFInvestigator and NSFInstitution in dbase '''grants'''
 Note that SBIR '''program_code'''s are available from https://www.nsf.gov/awardsearch/lookup?type=program&qrytxt=*SBIR*