Date: Wed, 21 Sep 2005 16:09:25 GMT
From: "Dexter J" <>
Subject: Re: Calling Dexter J, I need to e-mail you the Saabvideo logs

Salutations: On Tue, 20 Sep 2005 22:28:56 -0300, Saab Guy <> wrote: > > Dexter J, > > I need to e-mail you the Saabvideo logs. I just received them from the > system administrator in what seems to be a .gz compressed archive. > > SG Actually - all you need is to pick up compression tool for the file. GZ is a type of zip file that should have your logs inside. Have a poke around here for an app to decompress: Once they are decompressed, use a text editor (word wrap off) or spread sheet to review transactions with the server. Here is a fairly good start page regarding how read raw Apache Logs: .. don't worry about the server set-up detail outlined above just yet, you just want to get a handle on visit patterns and from what IP ranges. There is some good detail above on what each item in a given log line means as you scroll down a bit. Most folks wimp out and go for a 'web log analyzer' - I don't recommend them until you at least have enough basic literacy to understand the raw log. The features on most log analyzers make *much* more sense if you understand what they are doing for you. So, very basically, each visit should generate several log lines as each page item is passed to the visitor. You are looking for anomalies in the pattern where the visiting IP *doesn't* read the top page and all it's images first - and/or - repeated visits from the same IP on any kind of schedule - but most importantly - video downloads without any corresponding top page visit. Towards the end of each log entry the 'user agent' is listed. You should see visits from google, yahoo et al (relatively useful bots/slurpers). They usually only take the page text body - but not always. Pay attention to the detail here, because I'm still betting you are seeing a pile of visits from things like Wget, DA, psbot and a bunch of others. Here is a good page for reviewing bots and their place in your universe: Finally - as to tightening up your site security after you figure out what is going on - that unfortunately is where we get back to the question of my per diem and your personal responsibilities as a 'webmaster'. As I have said previously, I don't think it's worth your money to hire me for what is simply a hobby site on a shared server. I dearly wish you had a fat sponsor and it was worth the cash because I like the idea of your site, but I guess the best you are going to be able to do is enough reading to stop the obvious packet leaks like most everyone else. I will again repeat my advise as regards your basic architecture though. You should at least look at a teaser index page with several video specific sub-pages as your top page now runs better than 1.2 megs every time it's viewed without downloading any videos. While you are at it - you might want to look at changing links to specific video's you have already posted out here - it will help you narrow down who is swiping your vids (they will now appear in the error logs as dead link attempts) and it should slow down the transfer totals for a while. -- Radio Free Dexterdyne Top Tune o'be-do-da-day Martin Sinatra Davis - Me and My Shadow all tunes - no cookies no subscription no weather no ads no news no phone in no sign up required - all the Time

Return to Main Index

The content on this site may not be republished without permission. Copyright © 1988-2020 - The Saab Network -
For usage guidelines, see the Mission and Purpose Page.
[Contact | Site Map | on Facebook | on Twitter | Shop Amazon via TSN | Site Donations]