Buy Me a Coffee at ko-fi.com

Web crawler

internet bot that systematically browses the World Wide Web, typically for the purpose of Web indexing (web spidering)

Pronunciation
/wɛb ˈkrɔːlə/
/wɛb ˈkrɔlər/