WEB: Adding lighthouse to crawler

Lighthouse analyzes web apps and web pages, collecting modern performance metrics and insights on developer best practices. https://github.com/GoogleChrome/lighthouse

Future

Hope everything is okay. I’m gonna try to buy more software to put with the SEO T can you see acer. Able to sneak copy able to copy

Web Version

Scheduling / Automation

Automate crawls with built-in scheduling, command-line control, and scripted exports into external systems.

compare crawls

Memory Settings

Configures how the program handles large crawls: in-memory (faster, limited by RAM) vs. database storage (slower but supports very large sites).

iOS Version

Reddit Request: Add contextual help tooltips and detailed info screens for SEO warnings and errors

Enhanced help features for the SEO audit results. Currently, when warnings or errors appear, it's not always clear what they mean or how to fix them. Two specific improvements would be really helpful: Contextual Tooltips: Add a "?" icon next to each warning/error that shows a tooltip on hover. For example, hovering over "missing meta description" could explain that meta descriptions are what search engines display on result pages and use for categorization, maybe with links to resources like learningseo.io or Google's SEO starter guide. Detailed Info Screens: Allow clicking on any result to open a standalone screen with more comprehensive information in a user-friendly layout, making it easier to understand the issue and learn how to resolve it.

Reddit Request: - Options to disable unwanted warnings

Would it be possible to offer options for disabling unwanted warnings (e.g., "Title is shorter than 30 characters") and skipping checks of external links

HTTP authentication and cookie-based authentication

Ability to crawl password-protected areas of sites

Support <base> tag

It looks like the tag is not supported. If one is specified all links on the page will be reported as broken as they are resolved incorrectly.

Crawl Backup (Compressed Export)

Option to manually export and save a compressed snapshot of a crawl state (.seospider file in Screaming Frog). Can be reopened to continue, inspect, or re-export data without rerunning the crawl.

Save Rendered HTML

Saves the browser-rendered DOM (post-JavaScript execution) for each page, giving access to dynamic content that doesn’t exist in the raw source.

Save HTML

Exports the raw, original HTML source of each crawled page into local files for later analysis.

Custom extraction

Custom Extraction (with element selection) – Lets you define CSS selectors, XPath, or regex to extract specific data (e.g., meta tags, schema attributes, custom text) from each crawled page. Export possibility in various fomats, mainly csv.