Question

I need help with these questions.

1. Explain the concept of a crawler search engine.
2. How has the utilization of mobile technologies impacted search engine optimization practices?
3. Describe how mashups create new benefits and functionality from existing data or information.

Answer 1

Answer:

Crawler search engine: A Search Engine Spider (also known as a crawler, Robot, SearchBot or simply a Bot) is a program that most search engines use to find what's new on the Internet. Google's web crawler is known as GoogleBot. ... When a web crawler visits one of your pages, it loads the site's content into a database.

A web crawler (also known as a web spider or web robot) is a program or automated script which browses the World Wide Web in a methodical, automated manner. This process is called Web crawling or spidering. Many legitimate sites, in particular, search engines, use spidering as a means of providing up-to-date data.

A search engine crawler is a program or automated script that browses the World Wide Web in a methodical manner in order to provide up to date data to the particular search engine. While search engine crawlers go by many different names, such as web spiders and automatic indexers, the job of the search engine crawler is still the same. The process of web crawling involves a set of website URLs that need to be visited, called seeds, and then the search engine crawler visits each web page and identifies all the hyperlinks on the page, adding them to the list of places to crawl. URLs from this list are re-visited occasionally according to the policies in place for the search engine. The policies of the search engine can be different for each search engine and maybe a cautionary action to ensure that some of the pages that have been added to the index before have not become spam.

Search engine crawlers have a hard time crawling the web on occasion because the Internet has three main characteristics that make it harder to continually keep the index up to date. Because of the large volume of web pages on the Internet, the fast pace and frequency of change to the pages, and the addition of dynamic pages, many search engine crawlers have a hard time crawling. These variations produce a massive amount of URLs to crawl and cause the search engine crawler to prioritize certain web pages and hyperlinks. This prioritization can be summed up in four different search engine crawler policies that are found commonly within all search engines, though they might differ slightly.

*AS per the Chegg policy give you answer, for other, post separately, thank you & rate.