GSP
Quick Navigator

Search Site

Unix VPS
A - Starter
B - Basic
C - Preferred
D - Commercial
MPS - Dedicated
Previous VPSs
* Sign Up! *

Support
Contact Us
Online Help
Handbooks
Domain Status
Man Pages

FAQ
Virtual Servers
Pricing
Billing
Technical

Network
Facilities
Connectivity
Topology Map

Miscellaneous
Server Agreement
Year 2038
Credits
 

USA Flag

 

 

Man Pages


Manual Reference Pages  -  SQL::TOKENIZER (3)

.ds Aq ’

NAME

SQL::Tokenizer - A simple SQL tokenizer.

CONTENTS

VERSION

0.20

SYNOPSIS



 use SQL::Tokenizer qw(tokenize_sql);

 my $query= q{SELECT 1 + 1};
 my @tokens= SQL::Tokenizer->tokenize($query);

 # @tokens now contains (SELECT,  , 1,  , +,  , 1)

 @tokens= tokenize_sql($query); # procedural interface



DESCRIPTION

SQL::Tokenizer is a simple tokenizer for SQL queries. It does not claim to be a parser or query verifier. It just creates sane tokens from a valid SQL query.

It supports SQL with comments like:



 -- This query is used to insert a message into
 -- logs table
 INSERT INTO log (application, message) VALUES (?, ?)



Also supports , "" and \ escaping methods, so tokenizing queries like the one below should not be a problem:



 INSERT INTO log (application, message)
 VALUES (myapp, Hey, this is a single quoted string!)



API

tokenize_sql


 use SQL::Tokenizer qw(tokenize_sql);

 my @tokens= tokenize_sql($query);
 my $tokens= tokenize_sql($query);

 $tokens= tokenize_sql( $query, $remove_white_tokens );



tokenize_sql can be imported to current namespace on request. It receives a SQL query, and returns an array of tokens if called in list context, or an arrayref if called in scalar context.

tokenize


 my @tokens= SQL::Tokenizer->tokenize($query);
 my $tokens= SQL::Tokenizer->tokenize($query);

 $tokens= SQL::Tokenizer->tokenize( $query, $remove_white_tokens );



This is the only available class method. It receives a SQL query, and returns an array of tokens if called in list context, or an arrayref if called in scalar context.

If $remove_white_tokens is true, white spaces only tokens will be removed from result.

ACKNOWLEDGEMENTS

o Evan Harris, for implementing Shell comment style and SQL operators.
o Charlie Hills, for spotting a lot of important issues I haven’t thought.
o Jonas Kramer, for fixing MySQL quoted strings and treating dot as punctuation character correctly.
o Emanuele Zeppieri, for asking to fix SQL::Tokenizer to support dollars as well.
o Nigel Metheringham, for extending the dollar signal support.
o Devin Withers, for making it not choke on CR+LF in comments.
o Luc Lanthier, for simplifying the regex and make it not choke on backslashes.

AUTHOR

Copyright (c) 2007, 2008, 2009, 2010, 2011 Igor Sutton Lopes <IZUT@cpan.org>. All rights reserved.

This module is free software; you can redistribute it and/or modify it under the same terms as Perl itself.

Search for    or go to Top of page |  Section 3 |  Main Index


perl v5.20.3 SQL::TOKENIZER (3) 2011-07-05

Powered by GSP Visit the GSP FreeBSD Man Page Interface.
Output converted with manServer 1.07.