GSP
Quick Navigator

Search Site

Unix VPS
A - Starter
B - Basic
C - Preferred
D - Commercial
MPS - Dedicated
Previous VPSs
* Sign Up! *

Support
Contact Us
Online Help
Handbooks
Domain Status
Man Pages

FAQ
Virtual Servers
Pricing
Billing
Technical

Network
Facilities
Connectivity
Topology Map

Miscellaneous
Server Agreement
Year 2038
Credits
 

USA Flag

 

 

Man Pages
VOCABULARY(1) User Contributed Perl Documentation VOCABULARY(1)

vocabulary -- extract vocabularies from Penn treebank files

vocabulary [-NT ntfile] [-POS posfile] [-word wordfile] [-count] [-binarized] [-verbose] file1 [file2...]

File1, file2 etc. are the names of Penn treebank files. If none are specified, STDIN is used.

NT
Write the non-terminal node vocabulary to ntfile.
POS
Write the part of speech vocabulary to posfile
word
Write the word vocabulary to wordfile.
count
Print the frequency counts for each of the categories.
binarized
The file is in binarized format.
verbose
Print filenames as they are processed.

Given a list of Penn treebank files, this script extracts the words, parts of speech, and non-terminal node names and emits each in a separate file in order of frequency.

Note that giving a "-" argument for any of ntfile, posfile, or wordfile causes the results to be written to STDOUT.

W.P. McNeill <billmcn@ssli.ee.washington.edu>
2005-01-05 perl v5.32.1

Search for    or go to Top of page |  Section 1 |  Main Index

Powered by GSP Visit the GSP FreeBSD Man Page Interface.
Output converted with ManDoc.