What is the main purpose of a web crawler program?

A. To search for illicit or illegal web activity
B. To create meta tags for web content
C. To index web pages for quick retrieval of content
D. To convert keywords to HTML