The bidric crawler

Who bidric is

bidric collects publicly posted government bid listings and documents so small contractors can find them.

How bidric's crawler works

In force today

• If you ask us to stop visiting your site or to slow down, we do, and we coordinate allowlisting with you on request. Email the address below.
• Some bid portals require a free supplier account. Where we use one, we sign in as that account and read only what it can see.

Rolling out now

These are commitments we are rolling out across our system, not yet how every part of it behaves:

• It identifies itself with the User-Agent below on every request.
• It reads robots.txt first and follows it.
• It stops when a site refuses or challenges it, and it doesn't try to get past a block.
• It loads one page at a time from each site, with pauses between pages.

Each one moves to "In force today" once it applies to every part of our system.

User-Agent

Our crawler's User-Agent string:

Mozilla/5.0 (compatible; bidric/1.0; +https://bidric.com/crawler)

Outbound IP addresses

Published here once static addresses are in place.

Contact and opt-out

Email crawler@bidric.com to ask us to stop visiting your site, slow down, or coordinate allowlisting bidric.

Include your site URL and what you would like us to change.