Future

Hope everything is okay. I’m gonna try to buy more software to put with the SEO T can you see acer. Able to sneak copy able to copy

Sneak copy, able to copy data after crawed

let user copy data cell by a touch, also support select Right now we are not able to do any except export whole crawed data, not convenient

Support <base> tag

It looks like the tag is not supported. If one is specified all links on the page will be reported as broken as they are resolved incorrectly.

Scheduling / Automation

Automate crawls with built-in scheduling, command-line control, and scripted exports into external systems.

Configuration Profiles

Save (and allow exporting for backup) complete crawl configurations (user agents, extraction rules, limits, speed, etc.) for quick reuse.

Robots & Directives Handling

Automatically follows robots.txt, meta robots, and x-robots headers, with options to ignore or override them for testing.

Custom Search

Run regex or string searches across raw HTML, rendered DOM, or page text to locate specific code snippets, tags, or patterns.

Crawl Backup (Compressed Export)

Option to manually export and save a compressed snapshot of a crawl state (.seospider file in Screaming Frog). Can be reopened to continue, inspect, or re-export data without rerunning the crawl.

Memory Settings

Configures how the program handles large crawls: in-memory (faster, limited by RAM) vs. database storage (slower but supports very large sites).

Save Rendered HTML

Saves the browser-rendered DOM (post-JavaScript execution) for each page, giving access to dynamic content that doesn’t exist in the raw source.

Save HTML

Exports the raw, original HTML source of each crawled page into local files for later analysis.

Custom extraction

Custom Extraction (with element selection) – Lets you define CSS selectors, XPath, or regex to extract specific data (e.g., meta tags, schema attributes, custom text) from each crawled page. Export possibility in various fomats, mainly csv.

Scan a prespecified list of URLs

Scan urls by list, switches from crawling to visiting targeted urls, simply paste the list or upload urls as a .txt file. (Basically clone the setting in Screaming Frog “List mode”.) Add more settings regarding domain handling (do crawl, do not crawl, crawl outside, do not, etc.). Remaining settings still apply to this crawl mode.

saving raw + rendered HTML

compare crawls

improved crawl settings: threads, crawl delay, resource limits

include / exclude rules for URLs

iOS Version

Web Version

Reddit Request: Add contextual help tooltips and detailed info screens for SEO warnings and errors

Enhanced help features for the SEO audit results. Currently, when warnings or errors appear, it's not always clear what they mean or how to fix them. Two specific improvements would be really helpful: Contextual Tooltips: Add a "?" icon next to each warning/error that shows a tooltip on hover. For example, hovering over "missing meta description" could explain that meta descriptions are what search engines display on result pages and use for categorization, maybe with links to resources like learningseo.io or Google's SEO starter guide. Detailed Info Screens: Allow clicking on any result to open a standalone screen with more comprehensive information in a user-friendly layout, making it easier to understand the issue and learn how to resolve it.