GSP
Quick Navigator

Search Site

Unix VPS
A - Starter
B - Basic
C - Preferred
D - Commercial
MPS - Dedicated
Previous VPSs
* Sign Up! *

Support
Contact Us
Online Help
Handbooks
Domain Status
Man Pages

FAQ
Virtual Servers
Pricing
Billing
Technical

Network
Facilities
Connectivity
Topology Map

Miscellaneous
Server Agreement
Year 2038
Credits
 

USA Flag

 

 

Man Pages


Manual Reference Pages  -  HTTPINDEX (1)

NAME

httpindex - HTTP front-end for SWISH++ indexer

CONTENTS

Synopsis
Description
Options
Example
Exit Status
Caveats
See Also
Author

SYNOPSIS

wget [ options ] URL... 2>&1 | httpindex [ options ]

DESCRIPTION

httpindex is a front-end for index(1) to index files copied from remote servers using wget(1). The files (in a copy of the remote directory structure) can be kept, deleted, or replaced with their descriptions after indexing.

OPTIONS

    wget Options

The wget(1) options that are required are: -A, -nv, -r, and -x; the ones that are highly recommended are: -l, -nh, -t, and -w. (See the EXAMPLE.)

    httpindex Options

httpindex accepts the same short options as index(1) except for -H, -I, -l, -r, -S, and -V.

The following options are unique to httpindex:
-d Replace the text of local copies of retrieved files with their descriptions after they have been indexed. This is useful to display file descriptions in search results without having to have complete copies of the remote files thus saving filesystem space. (See the extract_description() function in WWW(3) for details about how descriptions are extracted.)
-D Delete the local copies of retrieved files after they have been indexed. This prevents your local filesystem from filling up with copies of remote files.

EXAMPLE

To index all HTML and text files on a remote web server keeping descriptions locally:


wget -A html,txt -linf -t2 -rxnv -nh -w2 http://www.foo.com 2>&1 | httpindex -d -e’html:*.html,text:*.txt’
Note that you need to redirect wget(1)’s output from standard error to standard output in order to pipe it to httpindex.

EXIT STATUS

Exits with a value of zero only if indexing completed sucessfully; non-zero otherwise.

CAVEATS

In addition to those for index(1), httpindex does not correctly handle the use of multiple -e, -E, -m, or -M options (because the Perl script uses the standard GetOpt::Std package for processing command-line options that doesn’t). The last of any of those options ‘‘wins.’’

The work-around is to use multiple values for those options seperated by commas to a single one of those options. For example, if you want to do:


httpindex -e’html:*.html’ -e’text:*.txt’
do this instead:


httpindex -e’html:*.html,text:*.txt’

SEE ALSO

index(1), wget(1), WWW(3)

AUTHOR

Paul J. Lucas <pauljlucas@mac.com>
Search for    or go to Top of page |  Section 1 |  Main Index


SWISH++ F3HTTPINDEXF1 (1) August 2, 2005

Powered by GSP Visit the GSP FreeBSD Man Page Interface.
Output converted with manServer 1.07.