From pkessler at buyonlinenow.com Wed Jan 7 12:04:18 2009 From: pkessler at buyonlinenow.com (Paul Kessler) Date: Wed, 7 Jan 2009 11:04:18 -0600 Subject: [gltail] Newbie Message-ID: I am completely new to using gl_tail, yesterday was my first try at running it. After a short while I had it up and running on Fedora 10. A few things that I noticed right off the bat, the lack of decent instructions included with the release, and that ruby appears to be a system hog. If somebody could provide an explanation of the settings included in the config.yaml file that would be great. Right now I am guessing my way through them, while this works it is hardly time efficient and I am sure I am missing out of some of the features. For example while visualizing access logs I am making assumptions about the size of the "balls", knowing the relation of size to request would be helpful. Last night I had gl_tail configured to connect to four web servers (CentOs) and monitor the Apache access logs, I found that at times the ruby process would chew up 100% of the CPU and average in the 90% range. I reduced the traffic to just two servers this morning and ruby hovers around 40% until some serious traffic roles in and then it is back to spiking to 100%. Knowing very little about Ruby are there optimizations that can be made to help this perform better? I am running this on: Fedora 10 AMD X2 4400+ Dual Core with 2 GB of ram Thank you all for any assistance you can provide in getting my feet wet with this cool project. Paul -------------- next part -------------- An HTML attachment was scrubbed... URL: From cody.oliver at majesticresearch.com Wed Jan 7 14:03:16 2009 From: cody.oliver at majesticresearch.com (Cody Oliver) Date: Wed, 7 Jan 2009 14:03:16 -0500 Subject: [gltail] Newbie In-Reply-To: References: Message-ID: <90F03D1A9D2D434DBB2AAA23C55C89E605147D47@exchange1.MajesticResearch.local> It's just a hog. Ruby that is. When I get network choke it also cause's CPU to spike for me. Cody From: gltail-general-bounces at rubyforge.org [mailto:gltail-general-bounces at rubyforge.org] On Behalf Of Paul Kessler Sent: Wednesday, January 07, 2009 9:04 AM To: 'gltail-general at rubyforge.org' Subject: [gltail] Newbie I am completely new to using gl_tail, yesterday was my first try at running it. After a short while I had it up and running on Fedora 10. A few things that I noticed right off the bat, the lack of decent instructions included with the release, and that ruby appears to be a system hog. If somebody could provide an explanation of the settings included in the config.yaml file that would be great. Right now I am guessing my way through them, while this works it is hardly time efficient and I am sure I am missing out of some of the features. For example while visualizing access logs I am making assumptions about the size of the "balls", knowing the relation of size to request would be helpful. Last night I had gl_tail configured to connect to four web servers (CentOs) and monitor the Apache access logs, I found that at times the ruby process would chew up 100% of the CPU and average in the 90% range. I reduced the traffic to just two servers this morning and ruby hovers around 40% until some serious traffic roles in and then it is back to spiking to 100%. Knowing very little about Ruby are there optimizations that can be made to help this perform better? I am running this on: Fedora 10 AMD X2 4400+ Dual Core with 2 GB of ram Thank you all for any assistance you can provide in getting my feet wet with this cool project. Paul -------------- next part -------------- An HTML attachment was scrubbed... URL: From lists at pingle.org Thu Jan 8 20:51:14 2009 From: lists at pingle.org (Jim Pingle) Date: Thu, 08 Jan 2009 20:51:14 -0500 Subject: [gltail] Newbie In-Reply-To: References: Message-ID: <4966AD92.6050709@pingle.org> Paul Kessler wrote: > Last night I had gl_tail configured to connect to four web servers > (CentOs) and monitor the Apache access logs, I found that at times the > ruby process would chew up 100% of the CPU and average in the 90% range. > I reduced the traffic to just two servers this morning and ruby hovers > around 40% until some serious traffic roles in and then it is back to > spiking to 100%. Knowing very little about Ruby are there optimizations > that can be made to help this perform better? It is very resource hungry, but I'm not sure if Ruby is to blame or OpenGL. It is drawing a lot of moving data over a very large amount of screen area (for me anyhow) so I've learned to live with it. I can easily max out one core of my Core Duo T2300 laptop. On the plus side it makes my laptop run hot, and when the fan kicks into high gear it pumps out so much warm air that I can use it as a coffee warmer. :) Jim From mr at fudgie.org Fri Jan 9 07:09:44 2009 From: mr at fudgie.org (Erlend Simonsen) Date: Fri, 9 Jan 2009 13:09:44 +0100 Subject: [gltail] Newbie In-Reply-To: <4966AD92.6050709@pingle.org> References: <4966AD92.6050709@pingle.org> Message-ID: On Fri, Jan 9, 2009 at 2:51 AM, Jim Pingle wrote: > Paul Kessler wrote: > > Last night I had gl_tail configured to connect to four web servers > > (CentOs) and monitor the Apache access logs, I found that at times the > > ruby process would chew up 100% of the CPU and average in the 90% range. > > I reduced the traffic to just two servers this morning and ruby hovers > > around 40% until some serious traffic roles in and then it is back to > > spiking to 100%. Knowing very little about Ruby are there optimizations > > that can be made to help this perform better? > > It is very resource hungry, but I'm not sure if Ruby is to blame or > OpenGL. It is drawing a lot of moving data over a very large amount of > screen area (for me anyhow) so I've learned to live with it. > > I can easily max out one core of my Core Duo T2300 laptop. On the plus > side it makes my laptop run hot, and when the fan kicks into high gear > it pumps out so much warm air that I can use it as a coffee warmer. :) > I've done quite a bit of profiling trying to make glTail and Ruby perform, and the lastest Git version from GitHub has a lot of optimizations which gives a nice performance boost. Most of the CPU is spent on sorting lists and moving blobs, while most of the OpenGL time is spent on rendering the text. Polling / parsing the log files is done once every second, but the rest is attempted to be done 60 times / second, which means you have 1000ms / 60 = 16.6666 ms to do it in. I've thought about rendering the text to a texture instead of rendering each character by itself from a font texture, but my knowledge of OpenGL isn't as great as it needs to be to get this done. Another thing, which I just now thought of, would be to pre-calculate the movement of the balls, as they follow the same path, and just step through an array of positions instead of actually moving each ball by itself. That would probably help quite a bit. -- Erlend -------------- next part -------------- An HTML attachment was scrubbed... URL: From pkessler at buyonlinenow.com Fri Jan 9 10:13:01 2009 From: pkessler at buyonlinenow.com (Paul Kessler) Date: Fri, 9 Jan 2009 09:13:01 -0600 Subject: [gltail] Configuration Questions Message-ID: I am running the latest version from gitHub (0.1.7) and I still have some questions on the configuration file. Question 1: Ok this section is straight forward with the exception of the "color" line. Is there any documentation available on the options for this line? site1: host: foobar.com user: foo password: topsecret command: tail -f -n0 files: /var/log/apache/access_log parser: apache color: 0.2, 1.0, 0.2, 1.0 Question 2: Can somebody please explain what this section is even used for? I assume to parse a log file, but I am not familiar with the use of port 222. Also can somebody explain the parser line? rails: host: anotherfunsite.com user: anotherfunuser port: 222 command: tail -f -n0 files: /var/www/apps/funapp/current/log/production.log parser: rails color: 0.2, 0.2, 1.0, 1.0 That should get me through the weekend, and once again thank you everyone for your responses! Paul -------------- next part -------------- An HTML attachment was scrubbed... URL: From mr at fudgie.org Fri Jan 9 12:45:05 2009 From: mr at fudgie.org (Erlend Simonsen) Date: Fri, 9 Jan 2009 18:45:05 +0100 Subject: [gltail] Configuration Questions In-Reply-To: References: Message-ID: 1) Color is [Red, Green, Blue, Alpha], with each value between 0.0 and 1.0. So, [1.0, 0.0, 0.0, 1.0] would give red, while [1.0, 1.0, 0.0, 1.0] would give yellow. You can also use some preconfigured colors, white, red, green, blue, yellow, cyan, magenta, purple, orange and pink are built in and usable via color: magenta 2) That's just an example to show that you can use multiple sites/hosts with different log-file parsers and configurations. The 2nd examples connects over SSH on port 222, and expects a Ruby on Rails production logfile instead of an apache logfile. -- Erlend On Fri, Jan 9, 2009 at 4:13 PM, Paul Kessler wrote: > I am running the latest version from gitHub (0.1.7) and I still have some > questions on the configuration file. > > > > Question 1: > > Ok this section is straight forward with the exception of the "color" line. > Is there any documentation available on the options for this line? > > > > site1: > > host: foobar.com > > user: foo > > password: topsecret > > command: tail -f -n0 > > files: /var/log/apache/access_log > > parser: apache > > color: 0.2, 1.0, 0.2, 1.0 > > > > > > Question 2: > > Can somebody please explain what this section is even used for? I assume to > parse a log file, but I am not familiar with the use of port 222. Also can > somebody explain the parser line? > > > > rails: > > host: anotherfunsite.com > > user: anotherfunuser > > port: 222 > > command: tail -f -n0 > > files: /var/www/apps/funapp/current/log/production.log > > parser: rails > > color: 0.2, 0.2, 1.0, 1.0 > > > > > > That should get me through the weekend, and once again thank you everyone > for your responses! > > > > Paul > > > > _______________________________________________ > gltail-general mailing list > gltail-general at rubyforge.org > http://rubyforge.org/mailman/listinfo/gltail-general > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From pkessler at buyonlinenow.com Tue Jan 13 14:45:35 2009 From: pkessler at buyonlinenow.com (Paul Kessler) Date: Tue, 13 Jan 2009 13:45:35 -0600 Subject: [gltail] Remote displays Message-ID: Has anyone had any success displaying gl_tail remotely? For example with vnc, xdmcp or X forwarding? I have tried all of these and haven't had any luck. I would like to display the visualization on a large screen across the room, just wondering if I can do this remotely or will I end up just running the app on the machine it is hooked up to. Paul -------------- next part -------------- An HTML attachment was scrubbed... URL: From cody.oliver at majesticresearch.com Tue Jan 13 15:10:41 2009 From: cody.oliver at majesticresearch.com (Cody Oliver) Date: Tue, 13 Jan 2009 15:10:41 -0500 Subject: [gltail] Remote displays In-Reply-To: References: Message-ID: <90F03D1A9D2D434DBB2AAA23C55C89E6051BA524@exchange1.MajesticResearch.local> I've shown a few remote displays but it was a hack job. You can use webcam software to grab the display and next send it to a streaming service like ustream.tv or justin.tv those guys with software such as http://www.webcammax.com/ will get the job done. For just across the room will need to setup your own server to broadcast the video. Or like you said just run it on the machine that drives the display. Cody From: gltail-general-bounces at rubyforge.org [mailto:gltail-general-bounces at rubyforge.org] On Behalf Of Paul Kessler Sent: Tuesday, January 13, 2009 11:46 AM To: 'gltail-general at rubyforge.org' Subject: [gltail] Remote displays Has anyone had any success displaying gl_tail remotely? For example with vnc, xdmcp or X forwarding? I have tried all of these and haven't had any luck. I would like to display the visualization on a large screen across the room, just wondering if I can do this remotely or will I end up just running the app on the machine it is hooked up to. Paul -------------- next part -------------- An HTML attachment was scrubbed... URL: From pkessler at buyonlinenow.com Thu Jan 22 14:56:06 2009 From: pkessler at buyonlinenow.com (Paul Kessler) Date: Thu, 22 Jan 2009 13:56:06 -0600 Subject: [gltail] gltail on Windows Message-ID: Ok so I am trying to get gl_tail running on Windows now that I have it working on Fedora. I downloaded the file ruby186-27_rc2.exe and installed that as my first step. Then per the gl_tail README I started the Gems package manager and entered "gem install net-ssh". The results were: Successfully installed net-ssh-2.0.8 1 gem installed Installing ri documentation for net-ssh-2.0.8... Installing RDoc documentation for net-ssh-2.0.8... Then I configured my yaml file and entered gl_tail.rb config.yaml and the result was: Missing gem net-ssh. Ubuntu: Sudo gem install -y net-ssh -v 1.1.4 -r Any suggestions? Paul -------------- next part -------------- An HTML attachment was scrubbed... URL: From lists at pingle.org Thu Jan 22 15:30:11 2009 From: lists at pingle.org (Jim Pingle) Date: Thu, 22 Jan 2009 15:30:11 -0500 Subject: [gltail] gltail on Windows In-Reply-To: References: Message-ID: <4978D753.1090201@pingle.org> Paul Kessler wrote: > Ok so I am trying to get gl_tail running on Windows now that I have it > working on Fedora. I downloaded the file ruby186-27_rc2.exe and > installed that as my first step. Then per the gl_tail README I started > the Gems package manager and entered ?gem install net-ssh?. The results > were: > > Successfully installed net-ssh-2.0.8 [snip] > Missing gem net-ssh. > > Ubuntu: > > Sudo gem install ?y net-ssh ?v 1.1.4 ?r As it shows there, you need a specific version of the gem. It can be installed like so: gem install net-ssh -v 1.1.4 It should pick up on that once it is installed. The gem installation commands should be similar on Ubuntu/Windows, just without "sudo". Jim From lists at pingle.org Thu Jan 22 15:46:18 2009 From: lists at pingle.org (Jim Pingle) Date: Thu, 22 Jan 2009 15:46:18 -0500 Subject: [gltail] gltail on Windows In-Reply-To: References: <4978D753.1090201@pingle.org> Message-ID: <4978DB1A.7040808@pingle.org> Paul Kessler wrote: > That did the trick now it is letting me know anything else I need installed. Are there any docs on building Chipmunk for Windows? > > "Windows: There is an included MSVC project for building the library > and demo application." > > From the Chipmunk README isn't all that helpful. > > Thanks again! I wish I could help with that one. I haven't been able to get Chipmunk to compile, but I've been trying with MinGW and MSYS. I don't currently have access to a machine with MSVC to try. Jim From pkessler at buyonlinenow.com Fri Jan 23 11:32:14 2009 From: pkessler at buyonlinenow.com (Paul Kessler) Date: Fri, 23 Jan 2009 10:32:14 -0600 Subject: [gltail] Running on Windows Message-ID: So has anyone gotten this to run on Windows? If so how? Paul -------------- next part -------------- An HTML attachment was scrubbed... URL: From lists at pingle.org Fri Jan 23 12:28:37 2009 From: lists at pingle.org (Jim Pingle) Date: Fri, 23 Jan 2009 12:28:37 -0500 Subject: [gltail] Running on Windows In-Reply-To: References: Message-ID: <4979FE45.2010506@pingle.org> Paul Kessler wrote: > So has anyone gotten this to run on Windows? If so how? I run a slightly older version of the codebase on Windows systems. The one from the old SVN repo, to be exact: http://gltail.rubyforge.org/svn/trunk You can grab it with something like TortoiseSVN. There is probably a way to get a version from the git repo from before the Chipmunk addition, but I am not yet familiar enough with git to help with that one. Jim From cody.oliver at majesticresearch.com Fri Jan 23 12:32:23 2009 From: cody.oliver at majesticresearch.com (Cody Oliver) Date: Fri, 23 Jan 2009 12:32:23 -0500 Subject: [gltail] Running on Windows In-Reply-To: References: Message-ID: <90F03D1A9D2D434DBB2AAA23C55C89E60522916B@exchange1.MajesticResearch.local> gl_tail.rb v0.01 Still rocking me on windows. Cosy From: gltail-general-bounces at rubyforge.org [mailto:gltail-general-bounces at rubyforge.org] On Behalf Of Paul Kessler Sent: Friday, January 23, 2009 8:32 AM To: 'gltail-general at rubyforge.org' Subject: [gltail] Running on Windows So has anyone gotten this to run on Windows? If so how? Paul -------------- next part -------------- An HTML attachment was scrubbed... URL: From KenD at payscale.com Fri Jan 23 12:47:02 2009 From: KenD at payscale.com (Ken DeMaria) Date: Fri, 23 Jan 2009 09:47:02 -0800 Subject: [gltail] Running on Windows In-Reply-To: Message-ID: I'm running it on Windows server 2008, using a custom IISParser, and a custom config generation script to monitor rolling IIS logs. Use the one click ruby installer to install Ruby install cygwin with defaults plus add/ensure the following get installed: openssh bash sed (used to create a config.yaml from a template using a shell script) date (in Utils package... there is no specific 'date' package) Then, as long as you are able to get ssh to tail your remote machine's log files (this is actually the hardest part, in my experience) away it goes. If you need more details, please drop me a note and I'll see what I can help with. -Ken On 1/23/09 8:32 AM, "Paul Kessler" wrote: So has anyone gotten this to run on Windows? If so how? Paul Ken DeMaria PayScale, Inc. 315 5th Avenue S, Suite 700 | Seattle WA 98104 www.payscale.com kend at payscale.com 206-576-5090 -------------- next part -------------- An HTML attachment was scrubbed... URL: From pkessler at buyonlinenow.com Fri Jan 23 14:28:41 2009 From: pkessler at buyonlinenow.com (Paul Kessler) Date: Fri, 23 Jan 2009 13:28:41 -0600 Subject: [gltail] Getting closer Message-ID: I seem to be getting closer. So far here is what I did. Installed the one-click Ruby, cygwin. I installed net-ssh 1.1.4, file-tail and ruby-opengl. When I fire up gl_tail with a basic config file I see it connect to the remote server and it draws the display box. I am left with a black screen with the two grayish bars down the middle. But nothing else is drawn. In the command window I see text for setting the window shape and the FPS. But is has zeros for the Elements, Activities and blobs. I manually sshed into the remote box under cygwin and ran tail -f -n0 on the http access log to verify the log traffic and that all looked great. Any more suggestions? Paul -------------- next part -------------- An HTML attachment was scrubbed... URL: From KenD at payscale.com Fri Jan 23 14:46:17 2009 From: KenD at payscale.com (Ken DeMaria) Date: Fri, 23 Jan 2009 11:46:17 -0800 Subject: [gltail] Getting closer In-Reply-To: Message-ID: Are you sure you have the parser set correctly. This sounds like it's not parsing any data. Here is what one of my server config entries looks like for a windows box with Cygwin, parsing an iis log. psweb01a: host: psweb01a user: xxxxxx password: xxxxxx command: tail -f files: /cygdrive/c/payscale/LogFiles/w3svc1/ex090123.log parser: iisps color: 0.2, 1.0, 0.2, 1.0 On 1/23/09 11:28 AM, "Paul Kessler" wrote: I seem to be getting closer. So far here is what I did. Installed the one-click Ruby, cygwin. I installed net-ssh 1.1.4, file-tail and ruby-opengl. When I fire up gl_tail with a basic config file I see it connect to the remote server and it draws the display box. I am left with a black screen with the two grayish bars down the middle. But nothing else is drawn. In the command window I see text for setting the window shape and the FPS. But is has zeros for the Elements, Activities and blobs. I manually sshed into the remote box under cygwin and ran tail -f -n0 on the http access log to verify the log traffic and that all looked great. Any more suggestions? Paul Ken DeMaria PayScale, Inc. 315 5th Avenue S, Suite 700 | Seattle WA 98104 www.payscale.com kend at payscale.com 206-576-5090 -------------- next part -------------- An HTML attachment was scrubbed... URL: From mr at fudgie.org Mon Jan 26 14:33:52 2009 From: mr at fudgie.org (Erlend Simonsen) Date: Mon, 26 Jan 2009 20:33:52 +0100 Subject: [gltail] Running on Windows In-Reply-To: References: Message-ID: I used to run on Windows ages ago, and the only major problem I had was realising that ATI didn't ship the OpenGL lib with the pre-installed driver, so I had to get the full version from their site. Other than that it was just a matter of installing the gems and creating the config file. -- Erlend On Fri, Jan 23, 2009 at 5:32 PM, Paul Kessler wrote: > So has anyone gotten this to run on Windows? If so how? > > > > Paul > > > > > > > > _______________________________________________ > gltail-general mailing list > gltail-general at rubyforge.org > http://rubyforge.org/mailman/listinfo/gltail-general > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From mr at fudgie.org Mon Jan 26 14:36:05 2009 From: mr at fudgie.org (Erlend Simonsen) Date: Mon, 26 Jan 2009 20:36:05 +0100 Subject: [gltail] Getting closer In-Reply-To: References: Message-ID: Have you tried with debugging on? ./bin/gltail --debug config.yml If you see the gray bars, the OpenGL part works, but you're either being prompted for a password (setup ssh-key authentication) or you've got the wrong parser/path to the logfile. -- Erlend On Fri, Jan 23, 2009 at 8:28 PM, Paul Kessler wrote: > I seem to be getting closer. So far here is what I did. > > > > Installed the one-click Ruby, cygwin. I installed net-ssh 1.1.4, file-tail > and ruby-opengl. When I fire up gl_tail with a basic config file I see it > connect to the remote server and it draws the display box. I am left with a > black screen with the two grayish bars down the middle. But nothing else is > drawn. In the command window I see text for setting the window shape and the > FPS. But is has zeros for the Elements, Activities and blobs. I manually > sshed into the remote box under cygwin and ran tail ?f ?n0 on the http > access log to verify the log traffic and that all looked great. Any more > suggestions? > > > > Paul > > > > > > > > _______________________________________________ > gltail-general mailing list > gltail-general at rubyforge.org > http://rubyforge.org/mailman/listinfo/gltail-general > > -------------- next part -------------- An HTML attachment was scrubbed... URL: