| crawler | operator | pages | rate | amount |
|---|---|---|---|---|
| ClaudeBot | Anthropic model training |
10,236 | $0.01 | $102.36 |
| Googlebot | Google search indexing |
1,116 | $0.01 | $11.16 |
| Amazonbot | Amazon model training |
1,023 | $0.01 | $10.23 |
| Meta-ExternalAgent | Meta model training |
992 | $0.01 | $9.92 |
| Bingbot | Microsoft search indexing |
682 | $0.01 | $6.82 |
| GPTBot | OpenAI model training |
316 | $0.01 | $3.16 |
| OAI-SearchBot | OpenAI AI answers (live retrieval) |
260 | $0.01 | $2.60 |
| Applebot | Apple search indexing |
126 | $0.01 | $1.26 |
| PerplexityBot | Perplexity AI answers (live retrieval) |
102 | $0.01 | $1.02 |
| ChatGPT-User | OpenAI AI answers (live retrieval) |
81 | $0.01 | $0.81 |
| Claude-User | Anthropic AI answers (live retrieval) |
30 | $0.01 | $0.30 |
| CCBot | Common Crawl model training |
12 | $0.01 | $0.12 |
| Perplexity-User | Perplexity AI answers (live retrieval) |
9 | $0.01 | $0.09 |
| DuckDuckBot | DuckDuckGo search indexing |
8 | $0.01 | $0.08 |
| Bytespider | ByteDance model training |
5 | $0.01 | $0.05 |