PulseAugur
EN
LIVE 02:43:53

Mastercard blocks 88 bots by name, Visa's robots.txt empty

By PulseAugur Editorial · [1 sources] ·

Mastercard has implemented a robots.txt file that explicitly blocks 88 bots by name, some dating back to the early 2000s, including one identifying as Windows 95. In contrast, Visa's robots.txt file is empty. Notably, neither file specifically names or blocks AI crawlers, leaving them unrestricted by default, despite both files being updated in 2025 after the emergence of bots like GPTBot. AI

IMPACT Websites may need to update their robots.txt files to explicitly block or allow AI crawlers to manage data access and SEO.

RANK_REASON The article discusses website administration practices (robots.txt) for managing bot access, which is a technical tool for webmasters, rather than a core AI development or release.

Read on Mastodon — sigmoid.social →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Mastercard blocks 88 bots by name, Visa's robots.txt empty

How we ranked this

Signal score
1 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
The article discusses website administration practices (robots.txt) for managing bot access, which is a technical tool for webmasters, rather than a core AI development or release.
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
other
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
Standard
On-topic for AI-industry coverage; kept in the public index.
Story freshness
Same-day
Cluster formed today. Ranking reflects the current source set at time of score.

Full methodology in our editorial standards.

COVERAGE [1]

  1. Mastodon — sigmoid.social TIER_1 English(EN) · [email protected] ·

    Mastercard's robots.txt blocks 88 bots by name. Most date from the early 2000s, and one still introduces itself as Windows 95. Visa's robots.txt is empty. Zero

    Mastercard's robots.txt blocks 88 bots by name. Most date from the early 2000s, and one still introduces itself as Windows 95. Visa's robots.txt is empty. Zero bytes. Neither file names a single AI crawler, so every one of them is let in by default. Both were edited in 2025, well…

    LINKS flowpane.com/…/mastercard-visa-robots-txt…

RELATED ENTITIES

RELATED TOPICS