| crawler | operator | pages | rate | amount |
|---|---|---|---|---|
| Amazonbot | Amazon model training |
724 | $0.01 | $7.24 |
| Googlebot | Google search indexing |
615 | $0.01 | $6.15 |
| ClaudeBot | Anthropic model training |
456 | $0.01 | $4.56 |
| GPTBot | OpenAI model training |
412 | $0.01 | $4.12 |
| Bingbot | Microsoft search indexing |
287 | $0.01 | $2.87 |
| OAI-SearchBot | OpenAI AI answers (live retrieval) |
214 | $0.01 | $2.14 |
| CCBot | Common Crawl model training |
132 | $0.01 | $1.32 |
| ChatGPT-User | OpenAI AI answers (live retrieval) |
119 | $0.01 | $1.19 |
| Applebot | Apple search indexing |
73 | $0.01 | $0.73 |
| Claude-User | Anthropic AI answers (live retrieval) |
42 | $0.01 | $0.42 |
| Bytespider | ByteDance model training |
32 | $0.01 | $0.32 |
| Meta-ExternalAgent | Meta model training |
28 | $0.01 | $0.28 |
| DuckDuckBot | DuckDuckGo search indexing |
13 | $0.01 | $0.13 |
| PerplexityBot | Perplexity AI answers (live retrieval) |
9 | $0.01 | $0.09 |
| Perplexity-User | Perplexity AI answers (live retrieval) |
1 | $0.01 | $0.01 |
| Claude-SearchBot | Anthropic AI answers (live retrieval) |
1 | $0.01 | $0.01 |