Tier unsupported sites by scraping difficulty#357
Conversation
|
Preview deployment for your docs. Learn more about Mintlify Previews.
💡 Tip: Enable Workflows to automatically generate PRs for you. |
There was a problem hiding this comment.
Stale comment
Risk assessment: Very Low.
The actual diff only adds a short informational
<Info>callout with an external link inbrowsers/bot-detection/overview.mdx. There are no codepath, config, navigation, prompt, infrastructure, auth, permissions, or data changes, and I didn’t find aCODEOWNERSfile in the repo.The PR is already approved on the current head commit, so I’m leaving this assessment as a comment only and not re-approving.
Sent by Cursor Automation: Assign PR reviewers
There was a problem hiding this comment.
Stale comment
Risk assessment: Very Low.
The actual diff only adds a short
<Info>callout with an external Scraperly link inbrowsers/bot-detection/overview.mdx. There are no codepath, config, navigation, prompt/model-instruction, infrastructure, auth, permissions, or data changes, and I didn’t find aCODEOWNERSfile in the repo.The PR already has an approval recorded, so I’m leaving this assessment as a comment only and not re-approving.
Sent by Cursor Automation: Assign PR reviewers
There was a problem hiding this comment.
Risk assessment: Very Low.
The current diff only updates copy in browsers/faq.mdx to categorize unsupported websites by scraping difficulty. There are no codepath, config, navigation, infrastructure, auth, permissions, data, or model-instruction changes, and I didn’t find a CODEOWNERS file in the repo.
The PR is already approved, so I’m leaving this assessment as a comment only and not re-approving.
Sent by Cursor Automation: Assign PR reviewers


Summary
Restructures the Unsupported Websites section of the browsers FAQ into a tiered list (Very Hard / Hard) of sites that are difficult or infeasible to automate today, with a short description of what to expect at each tier.
Inspired by per-site difficulty resources elsewhere in the scraping community, but using our own observations rather than linking out.
Drops the earlier
<Info>callout inbot-detection/overview.mdx.Preview
https://tbd-6fc993ce-hypeship-scraperly-link.mintlify.app/browsers/faq#unsupported-websites
Test plan
#unsupported-websitesanchor still resolves