Introduction to Web Layers

The Internet Layers

• The internet is divided into three main layers: Surface Web, Deep Web, and Dark Web.

Surface Web

• The Surface Web is the normal, basic level of the internet and the primary entry point for most users.
• It includes websites filled with data that are indexed by search engines.
• Standard normal websites that users access daily reside here.
• However, the Surface Web does not contain much information, which is instead contained deeper inside the internet.

Deep Web

• The Deep Web contains most of the internet's data and is not a secret place.
• It is accessible by knowing the URL, but most of the information here is related to personal information, such as medical and financial records.
• Most of these sites require access control, and search engines do not index this information.
• The Deep Web contains 400-500 times more information and has a 15% larger visit capacity than the Surface Web.
• Deep Web pages are generated dynamically from a database and are difficult for standard crawler-based search engines to index.
• Data in the Deep Web cannot be accessed directly through hyperlinks, but most useful web data is saved in the Deep Web.
• The Deep Web is also called the hidden Web or invisible Web.

Information Extraction from Deep Web

• The information extraction task can be classified into three categories:
  • Record-level: discovers record boundaries and divides them into separate attributes.
  • Page-level: extracts all data embedded in one Web page.
  • Site-level: populates a database from pages of a Web site.

Accessing Deep Web

• The Deep Web can be accessed using special browsers like TOR (The Onion Router).
• These browsers can find information not available through surface browsers, such as Hidden WIKI and Bitcoins.

Internet Levels

• Level S: ClearNet, includes social networks, search engines, wiki, e-mail services, and common internet content.
• Level 1: Surface Web, includes closed social networks, e-commerce sites, blogs, university databases, hosting services, and forums.
• Level 2: Bergie Web, includes web archives, torrents, streaming services, restricted access content, robots.txt, and anti-virus databases.
• Level 3: Deep Web, includes hacking guides, spambots, virtual reality, computer security, and advanced artificial intelligence.
• Level 4: Dark Web, includes hacking groups, hidden wiki, most .onion sites, drug dealers, and banned media.
• Level 4B: Private Web, includes FPI mid-classified, supercomputing, closed systems, and geometric algorithms researches.
• Level 5: Marianas Web, also called the final boss of the web, and is considered the most dangerous level.

This quiz covers the basics of the internet, including the surface web and deep web, and how they differ in terms of data availability and accessibility.