LeadmasterBot, the Leadmaster crawler

LeadmasterBot is the web crawler Leadmaster sends to a business's public pages. It looks for the phone numbers, email addresses and social profiles we list, so our customers can contact that business.

What it reads

It reads a business's public homepage. When the homepage shows no email, it visits up to 3 more pages on the same site, such as the contact or about page. Nothing behind a login, no forms filled in, no posts, no shopping carts.

Its user agent

Every request names itself:

LeadmasterBot/1.0 (+https://leadmaster.tech/bot)

It obeys robots.txt

If your site says no, we do not crawl it. To keep LeadmasterBot off your whole site, put this in your robots.txt:

User-agent: LeadmasterBot
Disallow: /

It never checks WhatsApp

It never checks whether a phone number is on WhatsApp. We simply link mobile numbers to WhatsApp so our customers can try them there.

Remove a business

You do not need robots.txt for that. Email nadhim@leadmaster.tech and we will take the business out of every new list.

Questions

Something we should know about? Email nadhim@leadmaster.tech and we will sort it out.