The crawling process begins with a list of web addresses from past crawls and sitemaps provided by website owners. As our crawlers visit these websites, they use links on those sites to discover other pages. The software pays special attention to new sites, changes to existing sites and dead links. Computer programs determine which sites to crawl, how often and how many pages to fetch from each site.This is the link list
http://diced.jp/~shiketai11/index.php?techiesam
http://timeflow.webcrow.jp/pukiwiki/index.php?techiesam
https://pastelink.net/37lg4
http://www.jaist.ac.jp/~t-konno/pw-e/index.php?techiesam
http://www.ryusuke.org/index.php?techiesam
http://dev.xoopscube.jp/modules/doc/?techiejohn
http://celldesigner.org/forum/index.php?techiejohn
http://kitaoka-group.com/pukiwiki/index.php?techiejohn
http://kitaoka-group.com/pukiwiki/index.php?techiejohn
http://hakatath.ed.jp/~fc/index.php?techiejohn
http://ee72078.moo.jp/chinsan/pc/Lab/index.php?techiejohn
http://players-club.sub.jp/index.php?techiejohn
http://fortune.daa.jp/hosigamitaiju/index.php?techiejohn
http://k-pool.pupu.jp/wiki/index.php?techiejohn
http://tokiminori.under.jp/miyagi_anison/index.php?techiejohn
http://drill.lovesick.jp/drilldata/index.php?techiejohn
http://kimimoru.minibird.jp/moruwiki/index.php?techiejohn
https://coastal.jp/archive/cej/index.php?techiejohn
http://hichiso.mond.jp/i_hhh_wiki/index.php?techiejohn
http://hcxadmin310.kir.jp/it-solutions/hcxwiki/index.php?techiejohn
http://www.sse.tottori-u.ac.jp/hp-keiei/index.php?techiejohn
http://kuri6005.sakura.ne.jp/aspnet/wiki/index.php?techiejohn
http://diced.jp/~shiketai11/index.php?techiejohn
http://timeflow.webcrow.jp/pukiwiki/index.php?techiejohn
https://pastelink.net/37m32
http://www.jaist.ac.jp/~t-konno/pw-e/index.php?techiejohn
http://www.ryusuke.org/index.php?techiejohn
http://dev.xoopscube.jp/modules/doc/?techessam
http://celldesigner.org/forum/index.php?techessam
http://kitaoka-group.com/pukiwiki/index.php?techessam
http://kitaoka-group.com/pukiwiki/index.php?techessam
http://hakatath.ed.jp/~fc/index.php?techessam
http://ee72078.moo.jp/chinsan/pc/Lab/index.php?techessam
http://players-club.sub.jp/index.php?techessam
http://fortune.daa.jp/hosigamitaiju/index.php?techessam
http://k-pool.pupu.jp/wiki/index.php?techessam
http://tokiminori.under.jp/miyagi_anison/index.php?techessam
http://drill.lovesick.jp/drilldata/index.php?techessam
http://kimimoru.minibird.jp/moruwiki/index.php?techessam
https://coastal.jp/archive/cej/index.php?techessam