Windows Vista Forums
Vista Forums Home Join Vista Forums Windows 7 Forum Vista Tutorials Tags
Welcome to Windows Vista Forums. Our forum is dedicated to helping you find solutions with any problems, errors or issues you are experiencing with Windows Vista. The Vista forum also covers news and updates and has an extensive Windows Vista tutorial section that covers a wide range of tips and tricks.

Go Back   Vista Forums > Misc Newsgroups > PowerShell

Vista - I am looking for information on parsing log files (text)

Reply
 
Old 10-31-2007   #1 (permalink)
rferrisx


 
 

I am looking for information on parsing log files (text)

I am looking for information on parsing log files (text).

My System SpecsSystem Spec
Old 10-31-2007   #2 (permalink)
Shay Levi


 
 

Re: I am looking for information on parsing log files (text)

Check out Microsoft's LogParser 2.2


-----
Shay Levi
$cript Fanatic
http://scriptolog.blogspot.com


Quote:

> I am looking for information on parsing log files (text).
>

My System SpecsSystem Spec
Old 10-31-2007   #3 (permalink)
Marco Shaw [MVP]


 
 

Re: I am looking for information on parsing log files (text)

rferrisx wrote:
Quote:

> I am looking for information on parsing log files (text).
This might get you started:
http://www.microsoft.com/technet/scr.../payette1.mspx

Might need to be more specific though...

Marco

--
Microsoft MVP - Windows PowerShell
http://www.microsoft.com/mvp

PowerGadgets MVP
http://www.powergadgets.com/mvp

Blog:
http://marcoshaw.blogspot.com
My System SpecsSystem Spec
Old 10-31-2007   #4 (permalink)
Joe Brinkman


 
 

Re: I am looking for information on parsing log files (text)

You might also look at Scott Hanselman's recent blog - http://feeds.feedburner.com/~r/Scott...owerShell.aspx


Joe Brinkman
----------------------------------------------------------
DotNetNuke Corp. ASP.Net MVP
www.dotnetnuke.com
----------------------------------------------------------
Quote:

> rferrisx wrote:
>
Quote:

>> I am looking for information on parsing log files (text).
>>
> This might get you started:
> http://www.microsoft.com/technet/scr.../payette1.mspx
> Might need to be more specific though...
>
> Marco
>
> PowerGadgets MVP
> http://www.powergadgets.com/mvp
> Blog:
> http://marcoshaw.blogspot.com

My System SpecsSystem Spec
Old 10-31-2007   #5 (permalink)
Keith Hill [MVP]


 
 

Re: I am looking for information on parsing log files (text)

"Shay Levi" <no@xxxxxx> wrote in message
news:8766a944bc578c9ea017bee4006@xxxxxx
Quote:

> Check out Microsoft's LogParser 2.2
>
Dude, you totally beat Flowering Weeds to the punch on this one! Way to go!
:-)

--
Keith

My System SpecsSystem Spec
Old 11-01-2007   #6 (permalink)
Karl Mitschke


 
 

Re: I am looking for information on parsing log files (text)

Hello Keith Hill [MVP],
Quote:

> "Shay Levi" <no@xxxxxx> wrote in message
> news:8766a944bc578c9ea017bee4006@xxxxxx
>
Quote:

>> Check out Microsoft's LogParser 2.2
>>
> Dude, you totally beat Flowering Weeds to the punch on this one! Way to
go! :-)
Quote:

>
> --
> Keith
You should have put a screen warning there, Keith!

Thanks for the laugh.

Karl


My System SpecsSystem Spec
Old 11-01-2007   #7 (permalink)
rferrisx


 
 

Re: I am looking for information on parsing log files (text)

Thanks for all of this. I know about log parser and will reconsider using
it. This is more of the post I am looking for. I want to maximize the dot
net interface and PS ability to store very large log files (GBs) in memory
as a variable to produce specific output and charts. I will reconsider log
parser as a useful tool, but quite frankly I think PS can do more for me.
Help not run X and gnu plot on my windows box....

Thanks again,

Ryan

"Joe Brinkman" wrote:
Quote:

> You might also look at Scott Hanselman's recent blog - http://feeds.feedburner.com/~r/Scott...owerShell.aspx
>
>
> Joe Brinkman
> ----------------------------------------------------------
> DotNetNuke Corp. ASP.Net MVP
> www.dotnetnuke.com
> ----------------------------------------------------------
>
Quote:

> > rferrisx wrote:
> >
Quote:

> >> I am looking for information on parsing log files (text).
> >>
> > This might get you started:
> > http://www.microsoft.com/technet/scr.../payette1.mspx
> > Might need to be more specific though...
> >
> > Marco
> >
> > PowerGadgets MVP
> > http://www.powergadgets.com/mvp
> > Blog:
> > http://marcoshaw.blogspot.com
>
>
>
My System SpecsSystem Spec
Old 11-01-2007   #8 (permalink)
Brandon Shell [MVP]


 
 

Re: I am looking for information on parsing log files (text)

It really depends on the format of the Log file... Powershell is pretty good
at parsing natively.

Brandon Shell
---------------
Blog: http://www.bsonposh.com/
PSH Scripts Project: www.codeplex.com/psobject

r> Thanks for all of this. I know about log parser and will reconsider
r> using it. This is more of the post I am looking for. I want to
r> maximize the dot net interface and PS ability to store very large log
r> files (GBs) in memory as a variable to produce specific output and
r> charts. I will reconsider log parser as a useful tool, but quite
r> frankly I think PS can do more for me. Help not run X and gnu plot
r> on my windows box....
r>
r> Thanks again,
r>
r> Ryan
r>
r> "Joe Brinkman" wrote:
r>
Quote:
Quote:

>> You might also look at Scott Hanselman's recent blog -
>> http://feeds.feedburner.com/~r/Scott...324/ParsingCSV
>> sAndPoorMansWebLogAnalysisWithPowerShell.aspx
>>
>> Joe Brinkman
>> ---------------------------------------------------------- DotNetNuke
>> Corp. ASP.Net MVP www.dotnetnuke.com
>> ----------------------------------------------------------
>>
Quote:

>>> rferrisx wrote:
>>>
>>>> I am looking for information on parsing log files (text).
>>>>
>>> This might get you started:
>>> http://www.microsoft.com/technet/scr...sh/payette1.ms
>>> px Might need to be more specific though...
>>>
>>> Marco
>>>
>>> PowerGadgets MVP
>>> http://www.powergadgets.com/mvp
>>> Blog:
>>> http://marcoshaw.blogspot.com

My System SpecsSystem Spec
Old 11-01-2007   #9 (permalink)
Flowering Weeds


 
 

Re: I am looking for information on parsing log files (text)


"rferrisx"
Quote:

> Thanks for all of this. I know about log
> parser and will reconsider using it. This
> is more of the post I am looking for. I
> want to maximize the dot net interface
> and PS ability to store very large log files
> (GBs) in memory as a variable to produce
> specific output and charts. I will reconsider
> log parser as a useful tool, but quite frankly
> I think PS can do more for me. Help not run
> X and gnu plot on my windows box....
>
Okay all, the ball is in your hands!

Show us all how PowerShell is the right
way (tool) here and not Microsoft's data
parser, Log Parser 2.2 (even when ran
within PowerShell) using Log Parser's
own .NET classes ("to maximize the dot
net interface - and charts")?

So what is the PowerShell only (mmm define
PowerShell too) way of doing the above?


My System SpecsSystem Spec
Old 11-03-2007   #10 (permalink)
Keith Hill [MVP]


 
 

Re: I am looking for information on parsing log files (text)

"rferrisx" <rferrisx@xxxxxx> wrote in message
news:753FCC93-E652-497D-846B-6D970DFB5CD5@xxxxxx
Quote:

> Thanks for all of this. I know about log parser and will reconsider using
> it. This is more of the post I am looking for. I want to maximize the
> dot
> net interface and PS ability to store very large log files (GBs) in
> memory
> as a variable to produce specific output and charts. I will reconsider log
> parser as a useful tool, but quite frankly I think PS can do more for me.
> Help not run X and gnu plot on my windows box....
>
We poke fun at Flowering Weeds for his undaunted support of LogParser but
honestly, in this case, he's right. LogParser, as a dedicated tool for
handling log files (even large ones) will give you much better performance
than using PowerShell in the way you have indicated. For instance, you say
you want to store GBs in a single variable. Well on 32 bit windows, each
process only gets 2 GB of virtual address space (unless you use the /3GB
boot.ini switch). Even then, I've seen processes top out at a little over 1
GB of private memory usage before die-ing with OutOfMemoryExceptions.

Now if you are on x64 then perhaps PowerShell is worth giving a go but I
suspect LogParser will have much better performance.

--
Keith

My System SpecsSystem Spec
Reply

Thread Tools


Similar Threads
Thread Forum
Parsing fixed line of text to CSV PowerShell
Writing information to text file VB Script
Parsing mixed formated text using powershell PowerShell
Parsing Text File and returning variables PowerShell
Parsing a text file PowerShell


Vista Forums is an independent web site and has not been authorized,
sponsored, or otherwise approved by Microsoft Corporation.
"Windows Vista", the Start Orb, and related materials are trademarks of Microsoft Corp.
© Designer Media Ltd

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46