Web Design, Part 6: Reading Your Web Log

2000 – You’ve got your site up and running. You know people are visiting it, because they send you email (you do have a contact link on every page, don’t you). You’ve even registered with some search engines, joined a banner exchange or Web ring, and received a few links from other sites. But how do you measure your success?

You do it by measuring your site traffic. You can put a “hitometer” on your home page or even all of your pages, but that’s not the most convenient way of looking at site traffic. What you really want is a tool that will analyze your site logs. If your site is being hosted by someone else, they may already have Analog or some similar program installed. [We have since switched to Google Analytics.]

Every site will have different traffic patterns. For most sites, the home page will have the most traffic, but whether that’s nearly all of your site traffic (portals, headline news sites) or a small percentage of it depends on the nature of your site. Here at Low End Mac, it varies from day to day, ranging between 15 and 20% of our site traffic. [In 2016, it’s 7.3%. Since 2000, we get a lot more site traffic through search engines and links on Facebook than from visits to the home page.]

Page by Page

Analog and other log analysis programs can list the pages and other files on your site sorted by how many times each file was served. By checking the logs regularly, you can see patterns develop, such as:

  • A year ago, the iMac Channel home page was our second most popular page. Today it lags well behind the Power Mac Page. Was the iMac a flash in the pan? Are there that many more Power Mac users today? Have we somehow changed the Power Mac Page to make it a more popular target?
  • Editorial content will tend to rise quickly, then slow down over time. For instance, we usually post new articles about 9:00 P.M. Eastern Time. A new article might get 100 hits the first night, 2,000 the following day, 500 more the day after that, and 200 more the third full day it’s up. A month later, nobody may remember it – or it may still be generating a few hits a day and become an Internet gem.
  • You can tell which parts of a site are the busiest and which are the least visited. We get a lot of hits in the Power Macs section, with the most on the Power Mac 6100 page. We don’t get a whole lot of traffic in the Lisa section or too many hits on the obscure Macintosh IIvi, which wasn’t even sold in the U.S. market.
  • You can analyze traffic to see not only which articles are popular, but then try to correlate them by author and topic. Mac Daniel columns about early Power Macs and Internet connections seem to do very well; articles about specific less-popular computers don’t generate as much traffic.

That’s probably the first thing you’ll want to know: How many hits are on your home page, and which pages are popular. Then you have to decide what to do about it. When we discovered the Power Mac index was our #2 page, we decided to make it a richer resource and added links to Power Mac-related articles, which only made it more popular.

On the other hand, when we discovered our Mac Webmasters section just wasn’t getting much traffic, we found someone else to take those pages to their site. They were good, but not popular enough to keep putting our efforts into.

The Big Picture

The figure most webmasters have on the tip of their tongue is total pages served per month (“hits” for short). It’s taken us three years since our launch in April 1997, but we’re in the half-million pages per month range. Apple computer is somewhere around 10 million, if I recall correctly. [In 2016, we’re at over 200,000 pages per month.]

Total successful requests for pages is one of the first statistics a good log analyzer will give you. It’s a real ego booster.

The other “vital statistic” – and probably equally important to potential sponsors – is the number of unique visitors per month. Our average is roughly one-fourth of the total hits, but that will vary from site to site. [From August 24 through Sept. 23, 2016, we had 136,645 unique users, 165,243 sessions, and 246,365 page views.]

Some programs can go further, telling you how often people visit: every day, once a month, etc. They may also determine how many pages each person visits. Our overall average is two visits per month and two pages per visit, but some people visit Low End Mac every day. Some even make our home page their home page.

Other Information

You can tell Analog to display information on GIF, JPEG, and other file types – or not. I don’t really care how often you see the graphics; I just want to know which pages you’re visiting. Other webmasters feel otherwise.

Log analyzers can also break your traffic into other reports, displaying hits for each day of the month, each day of the week, and each hour of the day. I’ve found weekend traffic tends to be lower than weekday traffic, and a lot less people visit Low End Mac between 02:00 a.m. and 7:00 a.m. than during the middle of the day.

That kind of information can help determine what time of day to do your site updates (before the heavy traffic arrives, not after) and if you want to do weekend updates or not. Because of persistently poor weekend traffic, Low End Mac rarely posts new content between Thursday night and late Sunday. We do post new links to other sites, but rarely new articles on our own site.

Depending on the information your server tracks, you are often able to learn where the traffic is coming from. The referrer reports for Low End Mac show that about two-thirds of our traffic comes from links within our site. The remaining one-third comes from MacSurfer’s Headline News, Google, Pico Search (our site’s search engine, since defunct – now we use Google), AltaVista, and a number of other places.

The referrer report is a reminder of the importance of links and search engines. Most of our outside traffic comes from links on other sites, especially search engines, MacSurfer, and other Mac related site. That’s why it pays to send out PR mailings, to make sure other sites know about your website and your articles – and have the opportunity to link to them. [In 2016, we use Facebook, Twitter, LinkedIn and Google Plus rather than sending out email.]

Registering with search engines is also crucial. Somewhere around 10% of our traffic comes from search engines, or nearly 30% of hits from outside sites. [In 2016, the 70% of our traffic comes from Google, 17% from links within Low End Mac, 1.7% from Bing, and things drop quickly from there.] But the real success came from adding our own search engine, handled for free by Pico Search. It let visitors search Low End Mac quickly and accounted for 2% of our total traffic. In fact, we’ve made Pico Search more prominent because of the great success people have had using it to find pages on our site. [As noted above, we switched to Google years ago, and it does a great job finding content. With over 7,500 pages on Low End Mac in nearly 20 years online, nobody knows everything we’ve posted, so we need the power of Google to locate our legacy content.]

The almost depressing statistic is that about 40% of you are reading this on Windows computers. On the other hand, this also indicates that even when you’re using Windows, you’re thinking Macintosh. I guess that is a good thing. [Thanks to the iPhone and iPad, in 2016, 57.5% of our traffic is from Macs and iOS devices, 29.4% from Windows computers and mobile devices, 9.8% from Android devices, 2.2% from Linux computers, and everything else falls below the 1% mark. In terms of browsers, Chrome holds the top spot at 39.9% over the past month, with Safari just behind it at 38.5%. Firefox holds third place at 13.3%, with Internet Explorer and Edge combined coming in at 4.8%. All other browsers are below the 1% mark.]

Another report you really should check is failed links. The failure report let me know of a few bad links within the site – pages that had disappeared, graphics that had been removed but still had live links, typos in links, and other problems. One significant issue with some servers, as I’ve learned the hard way, is the importance of case in links. LEM.GIF and lem.gif may be the same file as far as your server is concerned, or it may believe they are completely different. For consistency, and unless you know you’ll never change servers, stick with lowercase text in file names. [Since switching to WordPress in 2013, we have a broken link tool that lets us know of bad links in content that is on WordPress. That’s over 2,700 pages of content, and I try to move some of our archive content over every week. We’re maybe one-third of the way through that, and some content will never be ported over – our weekly news roundups from years past, for instance.]

Conclusion

As a webmaster, you probably know a lot about the content of your site. Web logs let you know how that content is being accessed. It can point out both your strengths and weaknesses, letting you decide where to focus your efforts.

In the end, it will help you run your site more effectively.

Our Web Design Series

  1. Using Include Files
  2. Site Organization
  3. Cascading Style Sheets
  4. Site Graphics
  5. Web Content To Go
  6. Reading Your Web Log
  7. Redirects, Naming Files, and Some Rants

Keywords: #weblog #googleanalytics

Short link: https://goo.gl/4l9f1c

searchword: weblog