Backlog

Next up

In Progress

Done

Main Roadmap

<blockquote>Lighthouse analyzes web apps and web pages, collecting modern performance metrics and insights on developer best practices.</blockquote><a target="_blank" rel="noopener noreferrer nofollow" class="link" href="https://github.com/GoogleChrome/lighthouse">https://github.com/GoogleChrome/lighthouse</a>

In Review

WEB: Adding lighthouse to crawler

SEO Tracer

Web Version

Automate crawls with built-in scheduling, command-line control, and scripted exports into external systems.

Planned

Scheduling / Automation

Signup.Only

compare crawls

Completed

iOS Version

Enhanced help features for the SEO audit results. Currently, when warnings or errors appear, it's not always clear what they mean or how to fix them.Two specific improvements would be really helpful:Contextual Tooltips: Add a "?" icon next to each warning/error that shows a tooltip on hover. For example, hovering over "missing meta description" could explain that meta descriptions are what search engines display on result pages and use for categorization, maybe with links to resources like <a target="_blank" rel="noopener noreferrer nofollow" class="link" href="http://learningseo.io">learningseo.io</a> or Google's SEO starter guide.Detailed Info Screens: Allow clicking on any result to open a standalone screen with more comprehensive information in a user-friendly layout, making it easier to understand the issue and learn how to resolve it.

Reddit Request: Add contextual help tooltips and detailed info screens for SEO warnings and errors

Would it be possible to offer options for disabling unwanted warnings (e.g., "Title is shorter than 30 characters") and skipping checks of external links

Reddit Request: - Options to disable unwanted warnings

Ability to crawl password-protected areas of sites

HTTP authentication and cookie-based authentication

Option to manually export and save a compressed snapshot of a crawl state (.seospider file in Screaming Frog). Can be reopened to continue, inspect, or re-export data without rerunning the crawl.

Crawl Backup (Compressed Export)

Configures how the program handles large crawls: in-memory (faster, limited by RAM) vs. database storage (slower but supports very large sites).

Memory Settings

Saves the browser-rendered DOM (post-JavaScript execution) for each page, giving access to dynamic content that doesn’t exist in the raw source.

Save Rendered HTML

Exports the raw, original HTML source of each crawled page into local files for later analysis.

Save HTML

Custom Extraction (with element selection) – Lets you define CSS selectors, XPath, or regex to extract specific data (e.g., meta tags, schema attributes, custom text) from each crawled page. Export possibility in various fomats, mainly csv.

Custom extraction

Scan urls by list, switches from crawling to visiting targeted urls, simply paste the list or upload urls as a .txt file. (Basically clone the setting in Screaming Frog “List mode”.) Add more settings regarding domain handling (do crawl, do not crawl, crawl outside, do not, etc.). Remaining settings still apply to this crawl mode.