How Do You Archive Pages on a High Post Volume Website

http://www.wolf-howl.com/wp-content/uploads/high-volume.jpg

Today’s post is an answer to a question I took a few weeks ago:

your site’s link equity will determine your crawling depth and crawling frequency The first thing I want to bring up is that generally, if you’re publishing that volume of posts per day, your posts probably are date sensitive, so you don’t mind Google attaching a date to your posts. You can include the date in your URL structure, but it’s not necessary. However, you do want to have date archives available and close to the top. As an example, in the top of my masthead, you’ll see a link to the archive page which has a link to every month I have published a post. So if you wanted to reach a post I wrote, the path is 4 levels deep

Home > Archives > October 2005 > Bacon Polenta

This is what people mean when they mention a flat site architecture or crawling path: you aren’t more than 4 clicks from any other post. You also want to make sure you have your robots.txt and robots meta tags configured properly to allow the spiders to crawl that path. If you are publishing a very high volume of posts/pages, you’re going to want to get as many links on the archive page as possible, without becoming excessive. Google recommends no more than 100 links per page. In reality that number is really affected by the trust and authority of your inbound links or your link equity.

If you aren’t familiar with the term link equity you should read this article by Eric Ward on link equity. Basically, your site’s link equity will determine your crawling depth and crawling frequency. The more links you have and the stronger those links are, the deeper the search engines will crawl and the more frequently they will re-crawl it. This is a difficult problem for new websites: they need to add content, but if they add too much too soon, it won’t get crawled. So new sites need to balance content creation with link building.

Some other tools you can use to help flatten out a website and increase crawling depth are breadcrumbs. Joost De Valk makes an excellent breadcrumb plugin for Wordpress websites. A related posts plugin that changes the related posts at the end of each post will also help. I like yet another related posts plugin. Also make sure you are generating an HTML sitemap I like the dagon sitemap generator.

So, to wrap things up, here’s what you want to do:

• Provide one or more short crawling paths for spiders. Try to keep the path as short as possible because anything beyond 5 levels is a problem.
• Make sure your robots.txt and robots meta tags don’t accidentally block the crawling path.
• Provide alternate crawling paths or access to the website content with breadcrumbs, related posts, and sitemaps.
• Try to minimize maintenance and make sure all or as many of these solutions as possible update automatically.

Advertisement: Need an SEO Audit for your website, look at my SEO Consulting Services #1

This post originally came from Michael Gray who is an SEO Consultant. Be sure not to miss the Thesis Wordpress Theme review. How Do You Archive Pages on a High Post Volume Website

http://www.wolf-howl.com/?ak_action=api_record_view&id=5367&type=feedRelated posts:

1. Website Informational Pages Now that I’ve covered long term content and short term...
2. Crawling Difficulties and Error Pages I like to put my error pages in a subdirectory...
3. Is My Website Banned in Google? One of the more difficult problems to diagnose is has...

Related posts brought to you by Yet Another Related Posts Plugin.

http://feeds.feedburner.com/~ff/Wolf-howl?i=pPzzNHdKkM4:XYuh2d4NSpU:V_sGLiPBpWU</img> http://feeds.feedburner.com/~ff/Wolf-howl?i=pPzzNHdKkM4:XYuh2d4NSpU:wF9xT3WuBAs</img> http://feeds.feedburner.com/~ff/Wolf-howl?d=dnMXMwOfBR0</img> http://feeds.feedburner.com/~ff/Wolf-howl?i=pPzzNHdKkM4:XYuh2d4NSpU:aKCwKftKxY0</img> http://feeds.feedburner.com/~ff/Wolf-howl?d=7Q72WNTAKBA</img> http://feeds.feedburner.com/~ff/Wolf-howl?i=pPzzNHdKkM4:XYuh2d4NSpU:D7DqB2pKExk</img> http://feeds.feedburner.com/~ff/Wolf-howl?i=pPzzNHdKkM4:XYuh2d4NSpU:JEwB19i1-c4</img> http://feeds.feedburner.com/~ff/Wolf-howl?d=yIl2AUoC8zA</img>http://feeds.feedburner.com/~r/Wolf-howl/~4/pPzzNHdKkM4

View the full article