Software Repository Listing - Revision history

Ed at 20:01, 21 March 2017

2017-03-21T20:01:41Z

Ed at 16:23, 13 March 2017

2017-03-13T16:23:50Z

Ed at 16:22, 13 March 2017

2017-03-13T16:22:54Z

Ed at 16:20, 13 March 2017

2017-03-13T16:20:23Z

MyTornado: /* Web Crawler */

2016-08-05T20:22:51Z

Web Crawler

ShoebMohammed: /* Geocoding Inventor Locations */

2016-07-18T17:15:22Z

Geocoding Inventor Locations

ShoebMohammed: Created page with "This page lists all software/tools available on our Software Repository. The documentation on using a particular tool will be on its separate wiki page. For information..."

2016-07-18T17:06:27Z

Created page with "This page lists all software/tools available on our Software Repository. The documentation on using a particular tool will be on its separate wiki page. For information..."

New page

This page lists all software/tools available on our [[Software Repository]]. The documentation on using a particular tool will be on its separate wiki page.

For information and tutorial on how to access McNair git server, see [[Software Repository]].
Read the tutorial and instructions first before pushing anything to the git-server.

=Repositories on McNair [[Software Repository|git server]]=

==Center IT Sysadmin==
This repository contains all tools and scripts meant for system administration (stuff like backup scripts..)
*See the [[Center IT]] page for current documentation.

==Harvard Dataverse==
This repository contains all tools and scripts related to Harvard Dataverse.
*The [[Harvard Dataverse]] page provides instruction on how to access data.

==Geocoding Inventor Locations==
This repository holds software for matching Inventor addresses to known locations.
There are two programs/scripts that do same job. One is implemented in Perl(old) and other in Python(new). You should probably use the newer tool.
*See [[Geocoding Inventor Locations (Tool)]] for documentation on the older version implemented in Perl.
*See [[Geocoding Inventor Locations - New (Tool)]] for the newer version in Python.

==Matcher==
This repository contains the matcher tool which is used to match firm names given two lists.
*See [[The Matcher (Tool)]] for documentation.

==Patent Data Parser==
This repository contains all tools developed for patent data parsing.
*[[Patent Data (Tool)]] and [[Patent Data Extraction Scripts (Tool)]] pages on the wiki describe our Patent Database schema and corresponding XML parsing tools.
*Also, see [[USPTO Assignees Data]] which explains Patent Assignee Database schema and relevant XML parsing tools.

==Utilities==
This repository contains various utilities developed for text processing and other generally useful tools. See the wiki pages for each tool's documentation.
*[[Fuzzy match names (Tool)]]
*[[Godo (Tool)]]
*[[Normalizer Documentation | Normalizer]]. On the [[Software Repository|git-server]] we have many different versions like normalize fixed width, normalize surnames.

==Web Crawler==
This repository contains all software for web crawlers.
*[[Whois Parser]] pulls the Whois information given a list for URLs.
*[[PhD Masterclass - How to Build a Web Crawler]]: Ed's class on building a web crawler.

[[category:McNair Admin]]
[[admin_classification::Software Repository| ]]

@@ Line 9: / Line 9: @@
 This repository contains all tools and scripts meant for system administration (stuff like backup scripts..)
 *See the [[Center IT]] page for current documentation.
 ==Harvard Dataverse==
 This repository contains all tools and scripts related to Harvard Dataverse.
 *The [[Harvard Dataverse]] page provides instruction on how to access data.
-==Geocoding Inventor Locations==
+''cleaning db.sql''
-==Matcher==
+''copytable.sql''
-==Patent Data Parser==
+''createtables.sql''
-==Utilities==
+''droptables.sql''
 ==ExecutiveOrderCrawler==
@@ Line 58: / Line 40: @@
 ''Extractor.py''
 This script runs through the text files of the executive orders, and outputs a CSV with a 1 if the order hit a buzzword, and a 0 if it did not.
 ==GovTrack==
@@ Line 74: / Line 69: @@
 ''Govtrack_webcrawler_AllEnactedBills.pl'' Perl code.
 ==Geocoding Inventor Locations==
@@ Line 98: / Line 75: @@
 *See [[Geocoding Inventor Locations (Tool)]] for documentation on the older version implemented in Perl.
 *See [[Geocode.py]] for the newer version in Python.
 ==Matcher==
@@ Line 138: / Line 108: @@
 The first instantiation of the Twitter Crawler application 1 described above.
 [[category:McNair Admin]]
 [[admin_classification::Software Repository| ]]

@@ Line 3: / Line 3: @@
   For information and tutorial on how to access McNair git server, see [[Software Repository]].
   Read the tutorial and instructions first before pushing anything to the git-server.
 ==Center IT Sysadmin==

@@ Line 42: / Line 42: @@
 *[[PhD Masterclass - How to Build a Web Crawler]]: Ed's class on building a web crawler.
 *[[LinkedIn Crawler (Tool)]] : web scraper for Linked In.
 [[category:McNair Admin]]
 [[admin_classification::Software Repository| ]]