Apple Insider reports on the discovery of a web-crawling bot originating from Apple’s servers. It was first “outed” by developer Jan Moesen. Moesen reports that the bot is only crawling HTML, “not the CSS, JavaScript or image files.” Then he asks whether this is an “official Apple project” or just “someone crawling the web from their workplace at Apple?” Search Engine Land things Apple is doing something purposeful with a webcrawler. Not like taking on Google directly by trying to be a general or all-purpose search engine, but web search and related content capabilities are an increasingly important part of the virtual assistant experience. Get the full story at Search Engine Land