What the bots actually did
Straight from our server logs. Every fetch by a named AI crawler of a listing page or its markdown twin. No modelling, no estimates, no flattering rounding.
Total fetches
1,663
Last 7 days
174
Brands listed
1
Cells taken
50
Day by day
Last 14 days, UTC. Empty days are shown as empty — this chart is drawn from the same rows as the table below.
Industry context, so the numbers above have a yardstick.
TIME told Digiday that AI crawler requests to its site now exceed human
traffic on most days, and that it receives more of them than most of the roughly 7,000 sites in
TollBit's network. Its ad partner Mobian puts the share of brands with a markdown version of their
own site at about 15%. Those are their figures for their properties, not ours — our own counts are
the ones above, whatever they happen to be today.
By crawler
| Crawler | Fetches |
|---|---|
| Bingbot | 748 |
| GPTBot | 356 |
| Googlebot | 192 |
| Amazonbot | 120 |
| ClaudeBot | 104 |
| Applebot | 84 |
| Meta-AI | 58 |
| PerplexityBot | 1 |
Most fetched listings
| Company | Fetches |
|---|---|
| Fishbox | 83 |
Latest visits
| When (UTC) | Crawler | Path |
|---|---|---|
| 2026-10-02 07:23 | ClaudeBot | / |
| 2026-10-02 06:05 | Bingbot | /c/general |
| 2026-10-02 05:42 | Bingbot | /c/general |
| 2026-10-02 05:02 | Googlebot | /c/agency |
| 2026-10-02 03:49 | Googlebot | / |
| 2026-10-02 03:49 | Googlebot | / |
| 2026-10-02 03:49 | Googlebot | / |
| 2026-10-02 03:47 | Googlebot | / |
| 2026-10-02 03:47 | Googlebot | / |
| 2026-10-02 03:05 | Bingbot | /c/general |
| 2026-10-02 02:48 | Amazonbot | /c/health |
| 2026-10-02 02:34 | Bingbot | /c/agency |
| 2026-10-02 02:19 | Bingbot | /c/health |
| 2026-10-02 01:00 | Amazonbot | /b/fishbox |
| 2026-10-02 00:56 | Googlebot | /sitemap.xml |
| 2026-10-02 00:53 | Bingbot | /c/finance.md |
| 2026-10-02 00:05 | Bingbot | /c/general |
| 2026-10-01 23:57 | GPTBot | / |
| 2026-10-01 19:36 | Googlebot | / |
| 2026-10-01 19:36 | Googlebot | / |
| 2026-10-01 19:32 | Bingbot | /b/fishbox.md |
| 2026-10-01 19:04 | Bingbot | /c/travel |
| 2026-10-01 16:11 | Bingbot | /c/general |
| 2026-10-01 13:59 | GPTBot | /sitemap.xml |
| 2026-10-01 12:49 | Bingbot | /c/general |
| 2026-10-01 11:52 | Bingbot | /c/finance.md |
| 2026-10-01 10:48 | GPTBot | / |
| 2026-10-01 09:05 | Bingbot | /c/general |
| 2026-10-01 08:29 | Bingbot | /c/education |
| 2026-10-01 07:21 | Bingbot | / |
| 2026-10-01 06:05 | Bingbot | /c/general |
| 2026-10-01 06:04 | Bingbot | /c/general.md |
| 2026-10-01 03:51 | Bingbot | /c/agency |
| 2026-10-01 03:05 | Bingbot | /c/general |
| 2026-10-01 00:05 | Bingbot | /c/general |
| 2026-09-30 23:31 | Bingbot | /c/ai |
| 2026-09-30 21:57 | Bingbot | / |
| 2026-09-30 21:29 | Bingbot | /c/education.md |
| 2026-09-30 18:39 | Bingbot | /c/ai.md |
| 2026-09-30 13:55 | GPTBot | /sitemap.xml |
| 2026-09-30 12:59 | Bingbot | /b/fishbox.md |
| 2026-09-30 10:27 | Bingbot | /c/general.md |
| 2026-09-30 10:07 | Bingbot | / |
| 2026-09-30 10:04 | Amazonbot | /llms.txt |
| 2026-09-30 09:54 | Googlebot | /b/fishbox |
| 2026-09-30 09:05 | Bingbot | /c/general |
| 2026-09-30 08:39 | Googlebot | /c/education |
| 2026-09-30 07:43 | Bingbot | / |
| 2026-09-30 06:33 | Bingbot | /c/finance.md |
| 2026-09-30 06:05 | Bingbot | /c/general |
| 2026-09-30 05:46 | Bingbot | /c/health |
| 2026-09-30 05:09 | Amazonbot | /c/general |
| 2026-09-30 04:45 | Bingbot | /c/saas.md |
| 2026-09-30 04:40 | Bingbot | /c/agency |
| 2026-09-30 04:20 | Bingbot | /c/travel |
| 2026-09-30 04:17 | Bingbot | /c/saas |
| 2026-09-30 03:41 | Googlebot | /c/finance |
| 2026-09-30 03:09 | Bingbot | /c/education.md |
| 2026-09-30 03:05 | Bingbot | /c/general |
| 2026-09-30 02:08 | Bingbot | /c/agency |
Machine-readable copy of these numbers: /api/stats