April 24, 2025, 6:47 a.m. —
GET
/robots.txt
→ 200
User-Agent: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.2; +https://openai.com/gptbot)
April 23, 2025, 9:23 p.m. —
GET
/robots.txt
→ 301
User-Agent: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.2; +https://openai.com/gptbot)
April 23, 2025, 4:03 p.m. —
GET
/robots.txt
→ 200
User-Agent: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.2; +https://openai.com/gptbot)
April 23, 2025, 3:48 p.m. —
GET
/robots.txt
→ 301
User-Agent: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.2; +https://openai.com/gptbot)
April 23, 2025, 3:48 p.m. —
GET
/robots.txt
→ 200
User-Agent: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.2; +https://openai.com/gptbot)
April 23, 2025, 2:05 p.m. —
GET
/robots.txt
→ 200
User-Agent: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.2; +https://openai.com/gptbot)
April 23, 2025, 2:05 p.m. —
GET
/robots.txt
→ 301
User-Agent: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.2; +https://openai.com/gptbot)
April 23, 2025, 1:12 p.m. —
GET
/robots.txt
→ 200
User-Agent: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.2; +https://openai.com/gptbot)
April 23, 2025, 1:12 p.m. —
GET
/robots.txt
→ 301
User-Agent: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.2; +https://openai.com/gptbot)
April 23, 2025, 10:03 a.m. —
GET
/robots.txt
→ 200
User-Agent: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.2; +https://openai.com/gptbot)