Wednesday, May 18, 2011

Google Crawling Technology Overview

Before you even enter your query in the search box, Google is continuously traversing the web in real time with software programs called crawlers, or “Googlebots”. A crawler visits a page, copies the content and follows the links from that page to the pages linked to it, repeating this process over and over until it has crawled billions of pages on the web.

Next Google processes these pages and creates an index, much like the index in the back of a book. If you think of the web as a massive book, then Google‘s index is a list of all the words on those pages and where they‘re located, as well as information about the links from those pages, and so on. The index is parceled into manageable sections and stored across a large network of computers around the world.

When you type a query into the Google search box, your query is sent to Google machines and compared with all the documents stored in our index to identify the most relevant matches. In a split second, our system prepares a list of the most relevant pages and also determines the relevant sections and bits of text, images, videos and more. What you get is a list of search results with relevant information excerpted in “snippets” (short text summary) beneath each result.
As Larry said long ago, we want to give you back “exactly what you want.”
Describing the basic crawling, indexing and serving processes of a search engine is just part of the story. The other key ingredients of Google search are: 

Relevance. As Larry said long ago, we want to give you back “exactly what you want.” When Google was founded, one key innovation was PageRank, a technology that determined the “importance” of a webpage by looking at what other pages link to it, as well as other data. Today we use more than 200 signals, including PageRank, to order websites, and we update these algorithms on a weekly basis. For example, we offer personalized search results based on your web history and location.  

Comprehensiveness. Google launched in 1998 with just 25 million pages, which even then was a small fraction of the web. Today we index billions and billions of webpages, and our index is roughly 100 million gigabytes. We continue investing to expand the comprehensiveness of our services. In 2007 we introduced Universal Search, which made search more comprehensive by integrating images, videos, news, books and more into our main search results.   

Freshness. In the early days, Googlebots crawled the web every three or four months, which meant that the information you found on Google typically was out of date. Today we’re continually crawling the web ensuring that you can find the latest news, blogs and status updates minutes or even seconds after they’re posted. With Realtime Search, we’re able to serve up breaking topics from a comprehensive set of sources just moments after events occur. 

Speed. Our average query response time is roughly one-fourth of a second. In comparison, the average blink of an eye is one-tenth of a second. Speed is a major search priority, which is why in general we don’t turn on new features if they will slow our services down. Instead, search engineers are always working not just on new features, but ways to make search even faster. In addition to smart coding, on the back end we’ve developed distributed computing systems around that globe that ensure you get fast response times. With technologies like autocomplete and Google Instant, we help you find the search terms and results you’re looking for before you’re even finished typing.

    Wednesday, May 11, 2011

    How to get traffic to your site the right way

    The image is neat because it makes the site stand out in the Bookmarks no?
    Some cool browsers - like Firefox - also support this tag in the <head> section:

    <link rel="icon" href="/favicon.gif" type="image/gif">

    This allows you to use an animated gif -- called favicon.gif in this case -- to replace the static favicon.ico
    Here's how you do it (for a static .ico file):
    • Make an image of 16 * 16 pixels.
    • Save it as an ICON file (.ico) extension with the name favicon.ico in the root folder of your Website. (The folder with your index.html file)
    • Done. It's that simple.
    • To also allow browsers that support animated gifs, add the following line to the <head> section of your HTML:
      <link rel="icon" href="/favicon.gif" type="image/gif">  and, of course, make the gif file and place it
      in the root folder of your site.
    When someone bookmarks your site, the Browser looks for a file called http://YourSite.com/favicon.ico. If it finds a file it uses your file instead of it's default file.
    There is lots of software out there that can save gif or JPEG images as an .ico file. A good free one is Irfanview.

    Friday, May 6, 2011

    Google Knol

    This knol describes how to use the Knol tools to create, edit, and publish your knols.  Here are some links to other pages that will help you:
     You can also send us email at knolhelp@google.com.


    Creating and Publishing a New Knol 

    To create a new knol page, click Write a New Knol at the right side of the screen, under your profile. If this is the first time you have accessed the Knol site, the system will automatically create a new knol for you and put you in edit mode.
    For every knol:
    1. Enter a title.  Try to include keywords in the title for easier searchability.
    2. Enter a subtitle.  The subtitle is optional but it makes it easier for readers to get an idea of the knol content.
    3. Enter a summary at the top.
    4. Set the publishing mode for the knol.  By default your knol starts out unpublished. You can decide to publish your knol at any time by clicking on the Publish button in the author controls on the right hand side of your knol.
    5. Set the permissions for who can edit your knol.  By default, Moderated Collaboration is set (at the right).  This means that if someone suggests a change to the page, you must approve the change before it is made.  You can also disable collaboration entirely or make pages open to anyone who wishes to change them.
    6. Select your copyright settings at the right. By default, a Creative Commons Attribution license is specified. You can change this to “All Rights Reserved” (a non-public, traditional copyright choice that prohibits reuse of your materials without express permission) or to a Creative Commons Attribution Noncommercial license, which permits reuse of your knol, provided the reuse gives proper attribution and is not for commercial purposes. Learn more about license options for your knol here.

    Saving and Publishing Your Work 

    As you work on your knol, you can click Save to save drafts of your work (the button at the left of the toolbar).  When your knol is complete, click Close to exit editing mode.  If your knol is currently published (i.e. visible to the public), then every time you click on Save, your saved knol will be made public, replacing the previous version. Please remember to publish your knol only when you are ready to share it with the public.

    Entering Text into a New or Existing Knol

    To edit an existing knol, first display the knol. You can see a list of all the knols you have written by clicking on the My Knols link at the top of the screen.  Initially the knol displays in View mode. To edit your knol, click on the Edit tab.
     To enter the contents of your knol:
    1. The Knol platform provides basic tools to create your own knol.  Simply type your knol into the editing screen and use the formatting tools (described below) to enter your text.  
    2. If you prefer, you can type your text using another editor and paste the contents into a knol. Just use the copy and paste commands in the usual way.
    3. Import another document (e.g. a Microsoft Word document or a .PDF file) and create a new knol.  To import a document, click on the Settings link and choose the General tab. Then click on Import Knol to proceed.