Smart questions
Smart answers
Smart people
INTELLIGENT WORK FORUMS
FOR COMPUTER PROFESSIONALS

Member Login

Come Join Us!

Are you a
Computer / IT professional?
Join Tek-Tips now!
  • Talk With Other Members
  • Be Notified Of Responses
    To Your Posts
  • Keyword Search
  • One-Click Access To Your
    Favorite Forums
  • Automated Signatures
    On Your Posts
  • Best Of All, It's Free!

Join Tek-Tips
*Tek-Tips's functionality depends on members receiving e-mail. By joining you are opting in to receive e-mail.

LINK TO THIS FORUM!

Add Stickiness To Your Site By Linking To This Professionally Managed Technical Forum.
Just copy and paste the
code below into your site.

Partner With Us!

"Best Of Breed" Forums Add Stickiness To Your Site
Partner Button
(Download This Button Today!)

Feedback

"...I really enjoy your site. You have a lot of helpful and friendly experts who contribute so willingly. Thank you for past (and future) technical advice..."

Geography

Where in the world do Tek-Tips members come from?

Perl Hand Coded Lexical Analyzer (Tokenizer)

LeafSy (TechnicalUser)
27 Jul 12 12:08
I just want to ask how will i develop a Perl Lexical analyzer that will mimic language like C, for example the input will be:

main(){
printf("Hello World");
}

How will i broken down the input into tokens like main = reserve words, printf = function, ( = character symbol etc so that the output will be

reserveword_openparenthesis_closeparenthesis_opencurlybraces
function_openparenthesis_doublequote_stringConstants_doubleqoute_closeparenthesis_semicolon
closecurlybraces

I know the basic of perl like using regular expressions, I just dont know how will i break does lines of codes into tokens.
MillerH (Programmer)
3 Aug 12 20:53
No need to reinvent the wheel using REGEX. This is already solved using PPI:

http://search.cpan.org/perldoc?PPI

- Miller

Reply To This Thread

Posting in the Tek-Tips forums is a member-only feature.

Click Here to join Tek-Tips and talk with other members!

Back To Forum

Close Box

Join Tek-Tips® Today!

Join your peers on the Internet's largest technical computer professional community.
It's easy to join and it's free.

Here's Why Members Love Tek-Tips Forums:

Register now while it's still free!

Already a member? Close this window and log in.

Join Us             Close