These are all terms for software packages used by Search Engines to scan through the millions of web pages on the internet, indexing and categorizing them as they as they find them. They travel through the internet by following links. A variety of data is collected and sent to central indexing warehouses where it is stored and checked for relevancy.