crawler
noun/ˈkrɔlər/
Frequency rank: #15,535 of 20,003 in the WORDED list (wordfreq data)
Meaning
a program that automatically browses the internet to index or collect information from web pages.
Example sentence
The software engineer built a new crawler to automatically collect data from thousands of websites.
Synonyms & related words
More words in ranks 15,501–15,600
- concoctionA mixture or drink made by combining various ingredients, often in a creative or unusual way.
- conspireto secretly plan together with others to do something harmful or illegal.
- consternationa feeling of anxiety or dismay, typically caused by something unexpected.
- cornealrelating to the cornea, the transparent front layer of the eye.
- corneta brass wind instrument similar to a trumpet but with a mellower tone.
- cynica person who believes that people are motivated purely by self-interest and distrusts sincerity
- daemonA background process that runs continuously on a computer system, handling tasks without direct user interaction.
- dampento make something less strong, intense, or enthusiastic; to make slightly wet.
- defensibleAble to be justified or defended against criticism or attack.
- descriptora word or phrase that identifies or describes something.