TY - GEN
T1 - Web structure in 2005
AU - Hirate, Yu
AU - Kato, Shin
AU - Yamana, Hayato
PY - 2008
Y1 - 2008
N2 - The estimated number of static web pages in Oct 2005 was over 20.3 billion, which was determined by multiplying the average number of pages per web server based on the results of three previous studies, 200 pages, by the estimated number of web servers on the Internet, 101.4 million. However, based on the analysis of 8.5 billion web pages that we crawled by Oct. 2005, we estimate the total number of web pages to be 53.7 billion. This is because the number of dynamic web pages has increased rapidly in recent years. We also analyzed the web structure using 3 billion of the 8.5 billion web pages that we have crawled. Our results indicate that the size of the "CORE," the central component of the bow tie structure, has increased in recent years, especially in the Chinese and Japanese web.
AB - The estimated number of static web pages in Oct 2005 was over 20.3 billion, which was determined by multiplying the average number of pages per web server based on the results of three previous studies, 200 pages, by the estimated number of web servers on the Internet, 101.4 million. However, based on the analysis of 8.5 billion web pages that we crawled by Oct. 2005, we estimate the total number of web pages to be 53.7 billion. This is because the number of dynamic web pages has increased rapidly in recent years. We also analyzed the web structure using 3 billion of the 8.5 billion web pages that we have crawled. Our results indicate that the size of the "CORE," the central component of the bow tie structure, has increased in recent years, especially in the Chinese and Japanese web.
UR - http://www.scopus.com/inward/record.url?scp=49049111137&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=49049111137&partnerID=8YFLogxK
U2 - 10.1007/978-3-540-78808-9_4
DO - 10.1007/978-3-540-78808-9_4
M3 - Conference contribution
AN - SCOPUS:49049111137
SN - 3540788077
SN - 9783540788072
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 36
EP - 46
BT - Algorithms and Models for the Web-Graph - Fourth International Workshop, WAW 2006, Revised Papers
T2 - 4th International Workshop on Algorithms and Models for the Web-Graph, WAW 2006
Y2 - 30 November 2006 through 1 December 2006
ER -