Industry Context — Common BS Fingerprints in Marketing, SEO & Advertising Agencies
Generic Claims:
we grow businesses, results that speak for themselves, your marketing partner, proven track record…
Red Flags:
guaranteed rankings or specific position promises, case studies with no client names or metrics, proprietary tools that are rebranded free tools, results claims without timeframes or baselines…
Semantic Drift Patterns:
homepage claims data-driven but case studies show no metrics, claims full-service but team is three people, homepage targets enterprise but case studies are local businesses, claims proprietary methodology but describes standard practices…
Proof Expectations:
named client case studies with before-and-after metrics, specific revenue or traffic numbers achieved, verified vendor partnerships with tier levels, team member profiles with specific expertise and career history…
Screaming Frog
(https://screamingfrog.co.uk) 📸 Data Snapshot: June 19, 2026Analyze the raw signals below. How would a machine score this business’s credibility?
Here are the exact signals captured from up to six pages of the site — the same raw inputs the evaluation engine analyzed. They are grouped by signal type so you can weigh each the way the machine does.
🏗️ Semantic Structure — heading hierarchy & page identity (Info Density · Commodity Fingerprint)
HOMEPAGE SEO Agency – Screaming Frog (https://screamingfrog.co.uk)
Title
SEO Agency – Screaming Frog
Meta
We run remarkably successful search engine optimisation (SEO) and paid search (PPC) campaigns using a unique blend of data, technology & creativity.
H1 We are a UK based SEO agency and the creators of the famous website crawler and log file analyser tools.
H2 Search Engine Marketing
H2 Search Engine Optimisation
H2 Pay Per Click Management
H2 Social Media Marketing
H2 Content Marketing
H2 Link Building
H2 Google Ads Audits
H2 Analytics Consultancy
H2 Technical SEO
H2 Digital Copywriting
H2 Digital PR
H2 AI Search Optimisation
H2 SEO Spider Tool
H2 We're an agency that develops search strategies for large brands to small and medium sized enterprises.
H2 Latest from the blog
H2 Screaming Frog SEO Spider Update – Version 24.0
H2 Screaming Frog Log File Analyser Update – Version 7.0
H2 The brightonSEO Crawling Clinic April/May '26
H2 Using the Screaming Frog SEO Spider to Generate Markdown at Scale
H2 Green SEO: Leveraging Screaming Frog for a Sustainable Web
H2 Out of Site, Out of Mind: Best Practices for Creating Valuable On-Site Campaign Content
H2 Design Trends That Are Shaping 2026
H2 Analysing and Reconstructing Site Architecture Using Breadcrumbs: A Practical SEO Guide
H2 Data-Driven Content Pruning at Scale Using APIs and the Screaming Frog SEO Spider
H2 Screaming Frog & Good Travel Management Take Flight With UK Search Awards Win
H2 SEO Spider v.24.1
H2 SEO Spider v.24.1
H2 SEO Spider v.24.1
H2 Log File Analyser v.7.0
H2 Log File Analyser v.7.0
H2 Log File Analyser v.7.0
H2 Support Ticket
H2 Support Ticket
H3 Services
H3 Latest Posts
H3 Latest Guides
H3 Contact Us
H3 About Us
H4 Available On
HEADING_REPEATED_BODY_FOOTER Screaming Frog SEO Spider Update – Version 24.0 – Screaming Frog (https://screamingfrog.co.uk/blog/seo-spider-24/)
Title
Screaming Frog SEO Spider Update – Version 24.0 – Screaming Frog
H1 Screaming Frog SEO Spider Update – Version 24.0
H2 Screaming Frog SEO Spider Update – Version 24.0
H2 1) Screaming Frog SEO Spider MCP
H2 2) Auto Compare Crawls
H2 3) View Crawl Changes in Email Notifications
H2 4) Send Crawl Export Attachments by Email
H2 5) Find Uncrawlable Links
H2 6) Usage Stats
H2 Other Updates
H2 Small Update – Version 24.1 Released 8th June 2026
H2 Join the mailing list for updates, tips & giveaways
H2 Get in touch
H2 Back to top
H2 SEO Spider v.24.1
H2 SEO Spider v.24.1
H2 SEO Spider v.24.1
H2 Log File Analyser v.7.0
H2 Log File Analyser v.7.0
H2 Log File Analyser v.7.0
H3 Services
H3 Latest Posts
H3 Latest Guides
H3 Contact Us
H3 About Us
H4 31 Comments
H4 Leave A Comment.
HEADING_REPEATED_BODY_FOOTER Screaming Frog Log File Analyser Update – Version 7.0 – Screaming Frog (https://screamingfrog.co.uk/blog/log-file-analyser-7-0/)
Title
Screaming Frog Log File Analyser Update – Version 7.0 – Screaming Frog
H1 Screaming Frog Log File Analyser Update – Version 7.0
H2 Screaming Frog Log File Analyser Update – Version 7.0
H2 1) Bot Verification for AI Bots
H2 2) User Agent Grouping
H2 3) Customisable Bot Verification
H2 4) Discovery of Unknown User Agents
H2 5) Import & Export Projects
H2 6) Export to Google Sheets
H2 7) New lower ‘Time Series’ Charts
H2 8) Ubuntu and Fedora packages for Arm
H2 Other Updates
H2 Join the mailing list for updates, tips & giveaways
H2 Get in touch
H2 Back to top
H2 SEO Spider v.24.1
H2 SEO Spider v.24.1
H2 SEO Spider v.24.1
H2 Log File Analyser v.7.0
H2 Log File Analyser v.7.0
H2 Log File Analyser v.7.0
H3 Services
H3 Latest Posts
H3 Latest Guides
H3 Contact Us
H3 About Us
H4 0 Comments
H4 Leave A Comment.
HEADING_REPEATED_BODY_FOOTER The brightonSEO Crawling Clinic April/May '26 – Screaming Frog (https://screamingfrog.co.uk/blog/the-brightonseo-crawling-clinic-april-may-26/)
Title
The brightonSEO Crawling Clinic April/May '26 – Screaming Frog
H1 The brightonSEO Crawling Clinic April/May ’26
H2 The brightonSEO Crawling Clinic April/May ’26
H2 GreenSEO Meet-up
H2 Join the mailing list for updates, tips & giveaways
H2 Get in touch
H2 Back to top
H2 SEO Spider v.24.1
H2 SEO Spider v.24.1
H2 SEO Spider v.24.1
H2 Log File Analyser v.7.0
H2 Log File Analyser v.7.0
H2 Log File Analyser v.7.0
H3 Services
H3 Latest Posts
H3 Latest Guides
H3 Contact Us
H3 About Us
H4 0 Comments
H4 Leave A Comment.
📝 The Narrative — clean text per page (Info Density · Semantic Coherence)
HOMEPAGE (https://screamingfrog.co.uk) SEO Agency – Screaming Frog
[H1] We are a UK based SEO agency and the creators of the famous website crawler and log file analyser tools. Agency Services SEO Spider Tool [H2] SEO Spider Tool We develop the industry leading Screaming Frog SEO Spider software, trusted by thousands of SEOs and SEO agencies worldwide for technical SEO audits. Download for free, or buy a licence for additional features. Features Download [H4] Available On windows mac linux [H2] We're an agency that develops search strategies for large brands to small and medium sized enterprises. Our team of technical and creative experts are dedicated to smarter search engine marketing. We run remarkably successful search engine optimisation (SEO) and paid search (PPC) campaigns using a unique blend of data, technology and creativity. We also develop some of the best SEO tools in the industry. Get in touch to work with an SEO agency that gets results. The team at Screaming Frog has been part of my extended marketing team, both at moo.com and now DogBuddy. They’re my go-to SEO agency - helping me achieve remarkable results from organic search in two very different industry sectors. Simon Goble, Dogbuddy Marketing Director [IMG: Screaming Frog Badge] [IMG: Screaming Frog Badge] [H2] Latest from the blog More from the blog 19 May, 2026 by Dan Sharp [H2] Screaming Frog SEO Spider Update – Version 24.0 We’re delighted to announce Screaming Frog SEO Spider version 24.0, codenamed internally as ‘bolus’. In this release we have introduced a number of much demanded new features, as well as smaller quality of life improvements and updates. Let’s take a... Continue Reading 31 Comments 29 April, 2026 by Dan Sharp [H2] Screaming Frog Log File Analyser Update – Version 7.0 We’re delighted to announce the release of the Screaming Frog Log File Analyser 7.0. If you’re not already familiar with the Log File Analyser, it allows you to upload raw server log files, verify bots, and get valuable insight into... Continue Reading 0 Comments 27 April, 2026 by Mark Porter [H2] The brightonSEO Crawling Clinic April/May '26 We’ve packed our bags, triple-checked the weather forecast (don’t want to jinx it, but it’s looking ?), and we’re getting ready to crawl our way down to the coast. The Screaming Frog team is returning to the Brighton Centre for... Continue Reading 0 Comments 21 April, 2026 by Mark Porter [H2] Using the Screaming Frog SEO Spider to Generate Markdown at Scale LLMs, RAG pipelines and various AI-powered tools are now a regular part of a lot of SEOs’ workflows, and a common starting point for many of them is getting content out of web pages and into a clean, usable format... Continue Reading 2 Comments 16 April, 2026 by Mark Porter Et al. [H2] Green SEO: Leveraging Screaming Frog for a Sustainable Web As SEOs, we obsess over performance. Speed. Crawl efficiency. Core Web Vitals. Conversions. But we rarely talk about the environmental cost of what we ship. The internet now accounts for roughly 4% of global greenhouse gas emissions – on par... Continue Reading 0 Comments 13 April, 2026 by Chloe Meek [H2] Out of Site, Out of Mind: Best Practices for Creating Valuable On-Site Campaign Content PR efforts often focus outward, prioritising outreach and coverage from external publications. As a result, some campaigns struggle to demonstrate lasting value once coverage fades — with over half of PR professionals stating that proving ROI beyond vanity metrics is... Continue Reading 0 Comments 26 February, 2026 by Danny Sturrock Et al. [H2] Design Trends That Are Shaping 2026 2025 was a big year for technology, and we’re all gearing up for the same rapid developments to emerge in 2026. But as tech has evolved, design has evolved alongside it – distilling large-scale advancement into creative digital visual expression.... Continue Reading 1 Comment 20 February, 2026 by Arash Seyfi [H2] Analysing and Reconstructing Site Architecture Using Breadcrumbs: A Practical SEO Guide Analysing site architecture is one of the most important — and often most challenging — aspects of technical SEO, particularly for large websites. In many projects, SEO professionals rely on signals such as URL folder structures, crawl depth, or internal... Continue Reading 0 Comments 12 January, 2026 by Liam Lesani [H2] Data-Driven Content Pruning at Scale Using APIs and the Screaming Frog SEO Spider One of the most important projects that comes to mind for SEOs when it comes to crawl budget optimisation and improving topical authority is content pruning. Content pruning refers to the process of removing, merging, or updating low-value or low-traffic... Continue Reading 1 Comment 5 December, 2025 by Oliver Brett [H2] Screaming Frog & Good Travel Management Take Flight With UK Search Awards Win The Screaming Frog agency team are pleased to announce victory in the UK Search Awards with our client Good Travel Management for ‘Best Low Budget Campaign (SEO)’. This award marks a five-year winning streak at the event. Attending the glitzy... Continue Reading 0 Comments
5326 chars
SUB-PAGE (https://screamingfrog.co.uk/blog/seo-spider-24/) Screaming Frog SEO Spider Update – Version 24.0 – Screaming Frog
[H1] Screaming Frog SEO Spider Update – Version 24.0
Dan Sharp
Posted 19 May, 2026 by Dan Sharp in Screaming Frog SEO Spider
[H2] Screaming Frog SEO Spider Update – Version 24.0
We’re delighted to announce Screaming Frog SEO Spider version 24.0, codenamed internally as ‘bolus’.
In this release we have introduced a number of much demanded new features, as well as smaller quality of life improvements and updates.
Let’s take a look at what’s new.
[H2] 1) Screaming Frog SEO Spider MCP
You can now run crawls, analyse, export and manipulate data using the SEO Spider and node.js within Claude, LM Studio and other AI chat assistants.
[IMG: MCP Server]
The MCP allows you to connect to the SEO Spider and automate countless crawl related activities using natural language. From the basic, such as running and summarising a crawl.
[IMG: MCP Basic chat for a crawl with summarised issues]
To more fun, and advanced tasks.
Such as manipulating or visualising the data the way you want to view it.
[IMG: MCP Chat more advanced results]
As well as performing the leg work for exporting, combining data, running the analysis pipeline and installing relevant scripts for interactive visuals for greater insight.
Like this pretty link equity analysis we made earlier using the Ahrefs integration in a crawl.
[IMG: Internal link equity flow]
Integrating with Claude Cowork, also opens up lots of possibilities.
There are plenty of use cases, ultimately the idea of the integration is to make daily tasks and workflows that much more efficient. This is not a replacement for an experienced SEO professional, obviously.
To set this up, please refer to our documentation on the MCP Server.
Please note – Not every feature and function is currently supported in the SEO Spider MCP. However, we plan to extend functionality based upon user feedback.
So let us know what else you’d like to see!
[H2] 2) Auto Compare Crawls
You’re now able to select ‘Auto Compare Crawls’ for scheduled (and CLI) crawls.
[IMG: Auto Compare Crawls]
This can be set up in the scheduled crawl task, which will then auto compare the last two crawls performed in a project.
[IMG: Auto Crawl Comparison crawl results]
This allows you to quickly view a crawl comparison of the last two crawls, including all changes that have occurred since the last crawl.
Read more in our crawl comparison tutorial.
[H2] 3) View Crawl Changes in Email Notifications
If you have enabled crawl completion notifications, you will already be familiar with the email summary upon crawl completion.
[IMG: Screaming Frog Crawl Complete Notification email]
This has been improved to include all issues found within the crawl in a table below the summary.
If you have selected to ‘Auto Compare Crawls’, you will see a crawl comparison of issues in the email – highlighting any changes in issues found between the last two crawls.
[IMG: Crawl completion notification with changes]
This is a great way to monitor and be alerted to website changes and SEO issues – such as pages being added or removed, a sudden spike in non-indexable pages, or page titles disappearing.
All without having to open up the crawl.
[H2] 4) Send Crawl Export Attachments by Email
You’re now also able to send emails with export attachments automatically upon crawl completion.
This can be set up in the scheduled crawl task under ‘Notifications‘.
[IMG: Email Notifications - Export Attachments]
For example, if you need to send a weekly broken links export to a developer, or a crawl issues summary to a stakeholder, you can input their email and the report of choice and it will appear in their inbox.
[IMG: Crawl notifications email attachment with export]
Attachments are zipped and the email will warn the receiver if there is an error, such as attachments being too large in size for the email provider.
Please read our tutorial on ‘How To Set Up Crawl Email Notifications & Export Attachments‘.
[H2] 5) Find Uncrawlable Links
You can now find common uncrawlable link types in the SEO Spider.
These can be viewed in the Links tab and the new ‘Pages With Uncrawlable Internal Outlinks‘ filter.
[IMG: Pages With Uncrawlable Internal Outlinks]
There is a new ‘Link Crawlability’ column in the lower Outlinks tab, which helps to identify any of these link types as ‘Uncrawlable’. They can be exported in bulk via the ‘Bulk Export > Links > Pages With Uncrawlable Internal Outlinks’ export.
Uncrawlable links are links found in the HTML, but do not conform to link best practices outlined by Google. For example:
<span href="https://example.com">
<div href="https://example.com">
<a>
<a href="javascript:goTo('products')">
To find uncrawlable link types, please ensure ‘Store’ is enabled in the ‘Config > Spider > Crawl’ menu.
[IMG: Uncrawlable Links config]
There isn’t an option to crawl these currently, but this might be available in the future as we refine how we parse some of these link types.
Please note – Our research indicates Google will crawl anything in the HTML that looks like a link. They will attempt to parse it and use for discovery. So strictly speaking, many of these link types will likely be ‘crawlable’.
However they are not recommended, and should not be relied upon. They might not be treated in the same way as a recommended hyperlink for passing link signals.
[H2] 6) Usage Stats
If you’ve ever wondered how much time you spend crawling, then you can now see your own usage data via ‘Help > Usage Stats’.
[IMG: Usage Stats Summary]
[IMG: Usage Stats Usage]
This has limited practical use (!), but is fun and might give you a better idea of how much value you’re getting from the tool each year. This data is stored locally on your machine.
[H2] Other Updates
Version 24.0 also includes a number of smaller updates and bug fixes.
New Arm64 Linux Versions – We now have two more packages available for Arm users for both Ubuntu and Fedora. Our three Linux users will rejoice again!
Improved Reporting of Syntactically Invalid Links – There’s a new ‘Crawl Invalid Links‘ option under ‘Config > Spider > Crawl’. Enabling this setting means URLs that are syntactically invalid such as hppts://example.com will be parsed, crawled and reported upon. These will typically appear under ‘Response Codes > No Response’ as malformed links.
Skip Empty Reports – You can now skip exporting empty reports in ‘Output Settings’ of scheduled crawl tasks, and ‘Bulk Export > Multi Export’. This means any exports that have been selected that do not contain any data, will not be exported. They will also not be attached in email notifications exports.
Ahrefs Country Level Metrics – There’s a new ‘Options’ tab in the Ahrefs integration with filters to adjust data for countries and volume (monthly or average).
Filterable Content Clusters – You’re now able to click on the content cluster legends in the graph to enable and disable their appearance in the diagram.
Live Model Validation & List In AI Integrations – When you connect to an AI provider, the model selected in the prompt will be checked against the live model list endpoint and alert you if they don’t exist – and allow you to select a live model. With models changing so frequently, both system and user prompts can quickly become deprecated.
System Wide Prompt for AI Integrations – In the ‘Advanced’ tab of each AI provider integration, you’re able to include a chat system prompt to establish the role, personality, constraints, and overall behaviour, providing foundational instructions that guide all its responses for consistency and relevance.
AI Provider Token Usage – Token usage is now displayed on the ‘Account Information’ dialog for each AI provider when connected.
Ollama Image Generation & Request Timeout – The Ollama integration now supports their image generation and has an adjustable ‘Request Timeout’ in the advanced tab.
Renamed Looker Studio Back to Data Studio Again – For our automated crawl reports in Looker Data Studio. Google is definitely messing with us all at this point.
Java 25 – One for the purists. Version 24 has been updated to Java 25.
That’s everything for version 24.0!
Thanks to everyone for their continued support, feature requests and feedback. Please let us know if you experience any issues with this latest update via our support.
[H2] Small Update – Version 24.1 Released 8th June 2026
We have just released a small update to version 24.1 of the SEO Spider. This release is mainly bug fixes and small improvements –
Added recently crawled URLs to scheduled crawl seed textbox.
Added a view to ‘Usage Stats’ graph to switch away from cumulative (a running total), to standard non-cumulative data points.
Added ‘Auto-start MCP Server on application launch’ setting for cloud.
Added ability to Bulk Export all multi file exports in MCP Server.
Included an option to download MCP API as markdown via ‘MCP > Configure > View Tools’ and the button at the top.
Increased GSC read time out to 2 minutes from 20 seconds.
Updated MCP Server progress to include APIs and Crawl Analysis.
Fixed issue with URL Inspection not working in API mode with ‘Ignore Non-Indexable URLs For URL Inspection’ enabled.
Fixed issue with MCP server returning “Tool error: Page content size too large” using sf_url_content tool.
Fixed issue with MCP Server logging to stdout in CLI Mode.
Fixed issue with some MCP server tools not working in non-English languages.
Fixed various unique crashes.
Dan Sharp Dan Sharp is founder & Director of Screaming Frog. He has developed search strategies for a variety of clients from international brands to small and medium-sized businesses and designed and managed the build of the innovative SEO Spider software.
[IMG: Like us on Facebook]
[IMG: Connect with us on LinkedIn]
[IMG: Follow us on X]
[IMG: Subscribe to our channel us YouTube]
[IMG: View our RSS feed]
[H2] Join the mailing list for updates, tips & giveaways
How we use the data in this form
[H2] Get in touch
For an in-depth proposal on our services, complete our contact form to request a proposal.
Contact us
We'll get back to you asap.
[H4] 31 Comments
Roy Zhu 1 month ago
Cool, I was thinking about how to use headless mode with AI. Finally, the Screaming Frog team did it!!! I’m so excited about the new update.
Reply
Roy Zhu 1 month ago
by the way hou do you connect MCP with claude?
Reply
screamingfrog 1 month ago
Hi Roy,
Check out our user guide here – https://www.screamingfrog.co.uk/seo-spider/user-guide/configuration/#mcp-server
We have an MCP extension you can use essentially!
Cheers
Dan
Reply
Roy Zhu 1 month ago
Hello Dan,
Thanks for quick reply. This is extreme helpful, I was wondering how could you use chat mode to run screaming frog hahaha
Thanks,
Roy
Reply
Dan 1 month ago
When/where is the 24.0 update link at? keen to give it a go
Reply
screamingfrog 1 month ago
Hi Dan,
You can download from the SEO Spider page – https://www.screamingfrog.co.uk/seo-spider/
There’s a download button.
Cheers.
Dan
Reply
Patrick 4 weeks ago
Hi Dan, still says 23.3 for me on that page. Can you provide a direct download button for v 24? Thanks!
Reply
screamingfrog 4 weeks ago
Hi Patrick,
I think the text is just cached, it will still be v.24 you download!
I’ll purge!
Cheers.
Dan
Reply
Lee 4 weeks ago
Heads up it still says “SEO Spider v.23.3” after you click the “download” button. The actual download is v24.0 though.
Reply
screamingfrog 4 weeks ago
Cheers, Lee!
Reply
Emmanuel 1 month ago
Hi Dan,
very nice new features.
Is it still not possible to pause or cancel an ongoing scheduled crawl though or has that been updated?
Reply
screamingfrog 1 month ago
Thanks, Emmanuel.
Not yet, but this is on the ‘todo’ list. Happy to add a vote in for you for it.
Cheers.
Dan
Reply
Shaikat Ray 4 weeks ago
Wow! This is some serious update! Claude + SF MCP would be crazy good!
Reply
Thibault Besson-Magdelain 4 weeks ago
This is truly amazing, thanks for all of us !
Reply
Muhammad Usman Ali 4 weeks ago
Finally, the MCP integration is here. Running crawls and pulling data straight into Claude using natural language is going to save a serious amount of time on technical audits.
Reply
Angel Martínez 4 weeks ago
Buen día!
Excelente actualización, seguramente nos será de gran ayuda. Sin embargo, no logro verla; únicamente me aparece la versión 23.3 y no la 24.
Reply
Nitish Kumar 4 weeks ago
Does it work with other llms as well? /co-pilot chatgpt?
Reply
Daniel Stanica 4 weeks ago
Great update! I just installed it and am now going to connect it with Claude for automatic audit interpretation and reporting.
Let’s see how it goes
Reply
Himanshu Tyagi 4 weeks ago
MCP Server excites me the most. Just updated to the latest version! Thanks for this amazing update and please keep up the good work :)
Reply
Oliver 3 weeks ago
Just updated and the MCP server is incredible. Letting Claude handle the export and visualisation step while I focus on the actual analysis is going to change my whole audit workflow.
Reply
Alessandro 3 weeks ago
Oh come on, we’re more than 3! =D
Reply
Tim 3 weeks ago
Hi, when Claude.app starts and connects to the Screaming Frog MCP Extension, it consistently throws a JSON parse error: “Unexpected non-whitespace character after JSON at position 4 (line 1 column 5)”. This appears at every startup and shows as a “failed” status in Claude’s MCP settings.
After the initial error the connection recovers and all tools work correctly, so it’s not breaking anything — but the persistent error notification is annoying.
Looking at the logs, it seems Screaming Frog is outputting non-JSON content to stdout during startup, before the MCP handshake completes. Claude.app tries to parse everything on stdout as JSON and throws on the unexpected characters.
Using Screaming Frog SEO Spider v1.0.0 on macOS with Claude desktop app.
Reply
screamingfrog 2 weeks ago
Hi Tim,
To resolve the above, please –
1) Set the language to any supported language other than ‘System’ . If you open the UI and go to ‘File-> Settings-> Language’ you can adjust it. This will be fixed in our next update, as it is a bug.
2) Ensure you have version 24 installed before the MCP extension (https://www.screamingfrog.co.uk/seo-spider/faq/#why-do-i-get-a-unexpected-non-whitespace-character-error-after-installing-the-claude-mcp-extension). You may need to uninstall the extension and reinstall.
Cheers
Dan
Reply
Jakub Wiącek 2 weeks ago
wow let me update. i was waiting for this MCP server freature! thank you
15000 chars
SUB-PAGE (https://screamingfrog.co.uk/blog/log-file-analyser-7-0/) Screaming Frog Log File Analyser Update – Version 7.0 – Screaming Frog
[H1] Screaming Frog Log File Analyser Update – Version 7.0 Dan Sharp Posted 29 April, 2026 by Dan Sharp in Screaming Frog Log File Analyser [H2] Screaming Frog Log File Analyser Update – Version 7.0 We’re delighted to announce the release of the Screaming Frog Log File Analyser 7.0. If you’re not already familiar with the Log File Analyser, it allows you to upload raw server log files, verify bots, and get valuable insight into both search engine and AI bots crawling your website. [IMG: Screaming Frog Log File Analyser 7.0] In this release we have a number of new features, as well as plenty of smaller quality of life improvements. Here’s what’s new. [H2] 1) Bot Verification for AI Bots AI bots now support bot verification, so you can confirm it is a genuine AI bot crawling your website, and not being spoofed. [IMG: AI Bot Verification] Similar to search bot verificiation, you can just verify bots during the upload process. [IMG: Verify bots on Import] Or via the ‘Project > Verify Bots’ menu after upload. [IMG: Verify Bots menu] This opens up the verification status filter for bot types that support it, so you can only view verified genuine bots, or identify spoofed bots. [IMG: Verification Status] [H2] 2) User Agent Grouping With so many different bots today, we have added bot groupings to make it easy to filter for the bots you wish to upload and analyse in projects. [IMG: User-Agent Groupings] This then allows you to analyse by the same groups using the global user agent filter, such as ‘All Search Bots’, or ‘All AI Bots’. [IMG: User-agent Groupings filter] The Overview tab also includes top level statistics of these groupings, so you can quickly see the proporition crawling a site. [H2] 3) Customisable Bot Verification When you add a new user agent, you’re able to configure bot verification. You can input IP ranges from a JSON URL, reverse DNS, ASN or static IP ranges to perform verification. [IMG: Customisable Bot Verification] If bot verification changes for any existing user agents, you do not need to wait for our team to push an updated version of the Log File Analyser, you can just update immediately. [H2] 4) Discovery of Unknown User Agents There’s a new ‘Include unknown User Agents’ setting in the User Agents tab of a new project. [IMG: Unknown User-agents] Enabling this option means any user agents that are not known (defined by your full ‘Available’ list of user agents) will be included in the analysis. This can be really useful for analysing bots that are crawling your website, that are not browsers, or known search or AI bots etc. [IMG: Unknown User-agents in the user-agents tab] These might be bots you wish to add to the full user agent list to monitor more closely, or potentially block. [H2] 5) Import & Export Projects You’re now able to export and import projects. This can be seen under the top level ‘Project’ menu. [IMG: Export and Import projects] This allows you to share projects with other users, or archive without having to re-analyse the log files. [H2] 6) Export to Google Sheets Alongside exporting as a CSV, or Excel, you’re now able to export to Google Sheets directly. [IMG: Export to Google Sheets] Just add your Google account, authorise the Log File Analyser and export. [H2] 7) New lower ‘Time Series’ Charts Across various tabs there is a new lower ‘Time Series’ tab, which shows (you guessed it) a time series chart of the data. The filter allows you to switch the graph to different views, from Events, to Response Codes, Bytes, Average Response Times etc. [IMG: Time Series tab] You’re able to highlight a single URL individually, or multiple URLs for an aggregated view. This time series graph can be extremely useful when analysing patterns, such as sudden changes in response codes, or average response times suddenly spiking over a period of time. [H2] 8) Ubuntu and Fedora packages for Arm We now have two more packages available for Arm users for both Ubuntu and Fedora. At least three users will rejoice! [H2] Other Updates Version 7.0 also includes a number of smaller updates and bug fixes, outlined below. Usage Stats – There’s some fun Usage Stats available under ‘Help > Usage Stats’ which display the number of files you’ve imported, number of log lines as well as top user agents and tabs. Re-run Bot Verification – It’s now possible to re-run bot verification, without starting a new project. Simply hit ‘File > Verify Bots…’ in the menu. Advanced Table Search – There’s a new advanced table search across all tabs with better filtering options. Import XML Sitemaps – It’s now possible to import Sitemap files into the Imported URL Data tab to combinie data against log files and see if they are being crawled, or missing. Start a Crawl via Right Click – You can right click and ‘Start Crawl in SEO Spider‘ for improved efficiency. Updated Project Dialog – The dialog has been updated to include last modified time, and size. Projects are now ordered by last modified. Customisable Overview Charts – Click on the ‘Charts’ button on the Overview tab, and you can add additional charts for Average Response Time, Total Co2 and Bytes. This collates data in the details views/graphs when you multi-select in the main view. Improved Importing – There’s been a number of improvements to make it more likely to be able to import a log file without user adjustment. More Responsive – Loading data, and navigating between tabs or using filters is now much faster! Java 25 – One for the purists. Version 7.0 has been updated to Java 25. We hope you like version 7.0! If you’re looking for inspiration for log file analysis, then read our guide on 22 ways to analyse log files for SEO. Once again, thanks to everyone for their continued support, feedback and feature requests. Please let us know if you experience any issues with version 7.0 of the Log File Analyser via our support. Dan Sharp Dan Sharp is founder & Director of Screaming Frog. He has developed search strategies for a variety of clients from international brands to small and medium-sized businesses and designed and managed the build of the innovative SEO Spider software. [IMG: Like us on Facebook] [IMG: Connect with us on LinkedIn] [IMG: Follow us on X] [IMG: Subscribe to our channel us YouTube] [IMG: View our RSS feed] [H2] Join the mailing list for updates, tips & giveaways How we use the data in this form [H2] Get in touch For an in-depth proposal on our services, complete our contact form to request a proposal. Contact us We'll get back to you asap. [H4] 0 Comments [H4] Leave A Comment. Click here to cancel reply. [H2] Back to top
6846 chars
SUB-PAGE (https://screamingfrog.co.uk/blog/the-brightonseo-crawling-clinic-april-may-26/) The brightonSEO Crawling Clinic April/May '26 – Screaming Frog
[H1] The brightonSEO Crawling Clinic April/May ’26 Mark Porter Posted 27 April, 2026 by Mark Porter in Events [H2] The brightonSEO Crawling Clinic April/May ’26 We’ve packed our bags, triple-checked the weather forecast (don’t want to jinx it, but it’s looking ?), and we’re getting ready to crawl our way down to the coast. The Screaming Frog team is returning to the Brighton Centre for the April edition of brightonSEO! You can find us near our usual exhibition spot in stand 18, on Thursday 30th April and Friday 1st May. Whether you want to talk through a technical SEO nightmare, request a shiny new feature for the SEO Spider, or just chat about our latest updates, our team is all ears. We’re also offering a full 2-week trial licence for the SEO Spider and Log File Analyser, and the team are more than happy to give you a primer on how best to use them. And as always, we’ll have some brand new merch to add to your collection. [H2] GreenSEO Meet-up If you’re heading down early, we’re supporting and attending the GreenSEO Meetup, taking place on the Wednesday evening (29th April). If you’re interested in how SEO practices can contribute to reducing the environmental impact of websites, you’ll definitely want to attend (and take a look at our recent post on Green SEO). We look forward to seeing you all next week. Safe travels! Mark Porter Mark is a self-confessed geek who has always had a love/hate relationship with blogging, coupled with an addiction to buying domain names. Outside of SEO, Mark loves Manchester United, gadgets and games. If anyone can beat him at FIFA he will happily buy them a drink. [IMG: Like us on Facebook] [IMG: Connect with us on LinkedIn] [IMG: Follow us on X] [IMG: Subscribe to our channel us YouTube] [IMG: View our RSS feed] [H2] Join the mailing list for updates, tips & giveaways How we use the data in this form [H2] Get in touch For an in-depth proposal on our services, complete our contact form to request a proposal. Contact us We'll get back to you asap. [H4] 0 Comments [H4] Leave A Comment. Click here to cancel reply. [H2] Back to top
2318 chars
🛡️ Trust Signals — reviews, proof links, trust-theatre flag (Trust & Proof)
184Review mentions (all pages)
10External proof links (all pages)
| Page | Reviews | Proof links |
|---|---|---|
| / (home) | 129 | 1 |
| /blog/seo-spider-24/ | 19 | 3 |
| /blog/log-file-analyser-7-0/ | 18 | 3 |
| /blog/the-brightonseo-crawling-clinic-april-may-26/ | 18 | 3 |
🔗 Identity & Technical Layer — schema JSON-LD: identity chains, entity gaps (Identity & Authority)
Homepage schema
{
"@context": "https://schema.org",
"@graph": [
{
"@type": "WebPage",
"@id": "https://www.screamingfrog.co.uk/",
"url": "https://www.screamingfrog.co.uk/",
"name": "SEO Agency - Screaming Frog",
"isPartOf": {
"@id": "https://www.screamingfrog.co.uk/#website"
},
"about": {
"@id": "https://www.screamingfrog.co.uk/#organization"
},
"datePublished": "2012-04-13T09:41:50+00:00",
"dateModified": "2024-06-26T14:02:21+00:00",
"description": "We run remarkably successful search engine optimisation (SEO) and paid search (PPC) campaigns using a unique blend of data, technology & creativity.",
"breadcrumb": {
"@id": "https://www.screamingfrog.co.uk/#breadcrumb"
},
"inLanguage": "en-US",
"potentialAction": [
{
"@type": "ReadAction",
"target": [
"https://www.screamingfrog.co.uk/"
]
}
]
},
{
"@type": "BreadcrumbList",
"@id": "https://www.screamingfrog.co.uk/#breadcrumb",
"itemListElement": [
{
"@type": "ListItem",
"position": 1,
"name": "Home"
}
]
},
{
"@type": "WebSite",
"@id": "https://www.screamingfrog.co.uk/#website",
"url": "https://www.screamingfrog.co.uk/",
"name": "Screaming Frog",
"description": "",
"publisher": {
"@id": "https://www.screamingfrog.co.uk/#organization"
},
"potentialAction": [
{
"@type": "SearchAction",
"target": {
"@type": "EntryPoint",
"urlTemplate": "https://www.screamingfrog.co.uk/?s={search_term_string}"
},
"query-input": {
"@type": "PropertyValueSpecification",
"valueRequired": true,
"valueName": "search_term_string"
}
}
],
"inLanguage": "en-US"
},
{
"@type": "Organization",
"@id": "https://www.screamingfrog.co.uk/#organization",
"name": "Screaming Frog",
"url": "https://www.screamingfrog.co.uk/",
"logo": {
"@type": "ImageObject",
"inLanguage": "en-US",
"@id": "https://www.screamingfrog.co.uk/#/schema/logo/image/",
"url": "https://www.screamingfrog.co.uk/wp-content/uploads/2018/11/screaming-frog-logo-kg.jpg",
"contentUrl": "https://www.screamingfrog.co.uk/wp-content/uploads/2018/11/screaming-frog-logo-kg.jpg",
"width": 564,
"height": 564,
"caption": "Screaming Frog"
},
"image": {
"@id": "https://www.screamingfrog.co.uk/#/schema/logo/image/"
},
"sameAs": [
"https://www.facebook.com/screamingfrog/",
"https://x.com/screamingfrog",
"https://www.instagram.com/screamingfroguk/",
"https://www.linkedin.com/company/screaming-frog",
"https://www.youtube.com/user/screamingfroguk"
]
}
]
}
/blog/seo-spider-24/
{
"@context": "https://schema.org",
"@graph": [
{
"@type": "Article",
"@id": "https://www.screamingfrog.co.uk/blog/seo-spider-24/#article",
"isPartOf": {
"@id": "https://www.screamingfrog.co.uk/blog/seo-spider-24/"
},
"author": [
{
"@id": "https://www.screamingfrog.co.uk/#/schema/person/1864ec3b40bbe76b823e77f9f0f4e5b7"
}
],
"headline": "Screaming Frog SEO Spider Update – Version 24.0",
"datePublished": "2026-05-19T07:29:22+00:00",
"dateModified": "2026-06-09T08:08:51+00:00",
"mainEntityOfPage": {
"@id": "https://www.screamingfrog.co.uk/blog/seo-spider-24/"
},
"wordCount": 1436,
"commentCount": 31,
"publisher": {
"@id": "https://www.screamingfrog.co.uk/#organization"
},
"image": {
"@id": "https://www.screamingfrog.co.uk/blog/seo-spider-24/#primaryimage"
},
"thumbnailUrl": "https://www.screamingfrog.co.uk/wp-content/uploads/2026/05/screaming-frog-seo-spider-v24.png",
"articleSection": [
"Screaming Frog SEO Spider"
],
"inLanguage": "en-US",
"potentialAction": [
{
"@type": "CommentAction",
"name": "Comment",
"target": [
"https://www.screamingfrog.co.uk/blog/seo-spider-24/#respond"
]
}
]
},
{
"@type": "WebPage",
"@id": "https://www.screamingfrog.co.uk/blog/seo-spider-24/",
"url": "https://www.screamingfrog.co.uk/blog/seo-spider-24/",
"name": "Screaming Frog SEO Spider Update – Version 24.0 - Screaming Frog",
"isPartOf": {
"@id": "https://www.screamingfrog.co.uk/#website"
},
"primaryImageOfPage": {
"@id": "https://www.screamingfrog.co.uk/blog/seo-spider-24/#primaryimage"
},
"image": {
"@id": "https://www.screamingfrog.co.uk/blog/seo-spider-24/#primaryimage"
},
"thumbnailUrl": "https://www.screamingfrog.co.uk/wp-content/uploads/2026/05/screaming-frog-seo-spider-v24.png",
"datePublished": "2026-05-19T07:29:22+00:00",
"dateModified": "2026-06-09T08:08:51+00:00",
"breadcrumb": {
"@id": "https://www.screamingfrog.co.uk/blog/seo-spider-24/#breadcrumb"
},
"inLanguage": "en-US",
"potentialAction": [
{
"@type": "ReadAction",
"target": [
"https://www.screamingfrog.co.uk/blog/seo-spider-24/"
]
}
]
},
{
"@type": "ImageObject",
"inLanguage": "en-US",
"@id": "https://www.screamingfrog.co.uk/blog/seo-spider-24/#primaryimage",
"url": "https://www.screamingfrog.co.uk/wp-content/uploads/2026/05/screaming-frog-seo-spider-v24.png",
"contentUrl": "https://www.screamingfrog.co.uk/wp-content/uploads/2026/05/screaming-frog-seo-spider-v24.png",
"width": 1205,
"height": 200,
"caption": "Screaming Frog SEO Spider version 24"
},
{
"@type": "BreadcrumbList",
"@id": "https://www.screamingfrog.co.uk/blog/seo-spider-24/#breadcrumb",
"itemListElement": [
{
"@type": "ListItem",
"position": 1,
"name": "Home",
"item": "https://www.screamingfrog.co.uk/"
},
{
"@type": "ListItem",
"position": 2,
"name": "Blog",
"item": "https://www.screamingfrog.co.uk/blog/"
},
{
"@type": "ListItem",
"position": 3,
"name": "Screaming Frog SEO Spider Update – Version 24.0"
}
]
},
{
"@type": "WebSite",
"@id": "https://www.screamingfrog.co.uk/#website",
"url": "https://www.screamingfrog.co.uk/",
"name": "Screaming Frog",
"description": "",
"publisher": {
"@id": "https://www.screamingfrog.co.uk/#organization"
},
"potentialAction": [
{
"@type": "SearchAction",
"target": {
"@type": "EntryPoint",
"urlTemplate": "https://www.screamingfrog.co.uk/?s={search_term_string}"
},
"query-input": {
"@type": "PropertyValueSpecification",
"valueRequired": true,
"valueName": "search_term_string"
}
}
],
"inLanguage": "en-US"
},
{
"@type": "Organization",
"@id": "https://www.screamingfrog.co.uk/#organization",
"name": "Screaming Frog",
"url": "https://www.screamingfrog.co.uk/",
"logo": {
"@type": "ImageObject",
"inLanguage": "en-US",
"@id": "https://www.screamingfrog.co.uk/#/schema/logo/image/",
"url": "https://www.screamingfrog.co.uk/wp-content/uploads/2018/11/screaming-frog-logo-kg.jpg",
"contentUrl": "https://www.screamingfrog.co.uk/wp-content/uploads/2018/11/screaming-frog-logo-kg.jpg",
"width": 564,
"height": 564,
"caption": "Screaming Frog"
},
"image": {
"@id": "https://www.screamingfrog.co.uk/#/schema/logo/image/"
},
"sameAs": [
"https://www.facebook.com/screamingfrog/",
"https://x.com/screamingfrog",
"https://www.instagram.com/screamingfroguk/",
"https://www.linkedin.com/company/screaming-frog",
"https://www.youtube.com/user/screamingfroguk"
]
},
{
"@type": "Person",
"@id": "https://www.screamingfrog.co.uk/#/schema/person/1864ec3b40bbe76b823e77f9f0f4e5b7",
"name": "screamingfrog",
"image": {
"@type": "ImageObject",
"inLanguage": "en-US",
"@id": "https://secure.gravatar.com/avatar/cd0f550dbfa1f1bc25abaf67f5cd340dffa9a140e6a49358750a3e4e3f616903?s=96&d=mm&r=gdcea7525842a6548ff7b2caf702e13e1",
"url": "https://secure.gravatar.com/avatar/cd0f550dbfa1f1bc25abaf67f5cd340dffa9a140e6a49358750a3e4e3f616903?s=96&d=mm&r=g",
"contentUrl": "https://secure.gravatar.com/avatar/cd0f550dbfa1f1bc25abaf67f5cd340dffa9a140e6a49358750a3e4e3f616903?s=96&d=mm&r=g",
"caption": "screamingfrog"
},
"description": "Dan Sharp is founder & Director of Screaming Frog. He has developed search strategies for a variety of clients from international brands to small and medium-sized businesses and designed and managed the build of the innovative SEO Spider software.",
"sameAs": [
"screamingfrog",
"/in/dansharpseo",
"https://x.com/screamingfrog"
],
"url": "https://www.screamingfrog.co.uk/author/screamingfrog/"
}
]
}
/blog/log-file-analyser-7-0/
{
"@context": "https://schema.org",
"@graph": [
{
"@type": "Article",
"@id": "https://www.screamingfrog.co.uk/blog/log-file-analyser-7-0/#article",
"isPartOf": {
"@id": "https://www.screamingfrog.co.uk/blog/log-file-analyser-7-0/"
},
"author": [
{
"@id": "https://www.screamingfrog.co.uk/#/schema/person/1864ec3b40bbe76b823e77f9f0f4e5b7"
}
],
"headline": "Screaming Frog Log File Analyser Update – Version 7.0",
"datePublished": "2026-04-29T10:41:56+00:00",
"mainEntityOfPage": {
"@id": "https://www.screamingfrog.co.uk/blog/log-file-analyser-7-0/"
},
"wordCount": 916,
"commentCount": 0,
"publisher": {
"@id": "https://www.screamingfrog.co.uk/#organization"
},
"image": {
"@id": "https://www.screamingfrog.co.uk/blog/log-file-analyser-7-0/#primaryimage"
},
"thumbnailUrl": "https://www.screamingfrog.co.uk/wp-content/uploads/2026/04/screaming-frog-log-file-analyser-7.jpg",
"articleSection": [
"Screaming Frog Log File Analyser"
],
"inLanguage": "en-US",
"potentialAction": [
{
"@type": "CommentAction",
"name": "Comment",
"target": [
"https://www.screamingfrog.co.uk/blog/log-file-analyser-7-0/#respond"
]
}
]
},
{
"@type": "WebPage",
"@id": "https://www.screamingfrog.co.uk/blog/log-file-analyser-7-0/",
"url": "https://www.screamingfrog.co.uk/blog/log-file-analyser-7-0/",
"name": "Screaming Frog Log File Analyser Update – Version 7.0 - Screaming Frog",
"isPartOf": {
"@id": "https://www.screamingfrog.co.uk/#website"
},
"primaryImageOfPage": {
"@id": "https://www.screamingfrog.co.uk/blog/log-file-analyser-7-0/#primaryimage"
},
"image": {
"@id": "https://www.screamingfrog.co.uk/blog/log-file-analyser-7-0/#primaryimage"
},
"thumbnailUrl": "https://www.screamingfrog.co.uk/wp-content/uploads/2026/04/screaming-frog-log-file-analyser-7.jpg",
"datePublished": "2026-04-29T10:41:56+00:00",
"breadcrumb": {
"@id": "https://www.screamingfrog.co.uk/blog/log-file-analyser-7-0/#breadcrumb"
},
"inLanguage": "en-US",
"potentialAction": [
{
"@type": "ReadAction",
"target": [
"https://www.screamingfrog.co.uk/blog/log-file-analyser-7-0/"
]
}
]
},
{
"@type": "ImageObject",
"inLanguage": "en-US",
"@id": "https://www.screamingfrog.co.uk/blog/log-file-analyser-7-0/#primaryimage",
"url": "https://www.screamingfrog.co.uk/wp-content/uploads/2026/04/screaming-frog-log-file-analyser-7.jpg",
"contentUrl": "https://www.screamingfrog.co.uk/wp-content/uploads/2026/04/screaming-frog-log-file-analyser-7.jpg",
"width": 1161,
"height": 227,
"caption": "Screaming Frog Log File Analyser 7.0"
},
{
"@type": "BreadcrumbList",
"@id": "https://www.screamingfrog.co.uk/blog/log-file-analyser-7-0/#breadcrumb",
"itemListElement": [
{
"@type": "ListItem",
"position": 1,
"name": "Home",
"item": "https://www.screamingfrog.co.uk/"
},
{
"@type": "ListItem",
"position": 2,
"name": "Blog",
"item": "https://www.screamingfrog.co.uk/blog/"
},
{
"@type": "ListItem",
"position": 3,
"name": "Screaming Frog Log File Analyser Update – Version 7.0"
}
]
},
{
"@type": "WebSite",
"@id": "https://www.screamingfrog.co.uk/#website",
"url": "https://www.screamingfrog.co.uk/",
"name": "Screaming Frog",
"description": "",
"publisher": {
"@id": "https://www.screamingfrog.co.uk/#organization"
},
"potentialAction": [
{
"@type": "SearchAction",
"target": {
"@type": "EntryPoint",
"urlTemplate": "https://www.screamingfrog.co.uk/?s={search_term_string}"
},
"query-input": {
"@type": "PropertyValueSpecification",
"valueRequired": true,
"valueName": "search_term_string"
}
}
],
"inLanguage": "en-US"
},
{
"@type": "Organization",
"@id": "https://www.screamingfrog.co.uk/#organization",
"name": "Screaming Frog",
"url": "https://www.screamingfrog.co.uk/",
"logo": {
"@type": "ImageObject",
"inLanguage": "en-US",
"@id": "https://www.screamingfrog.co.uk/#/schema/logo/image/",
"url": "https://www.screamingfrog.co.uk/wp-content/uploads/2018/11/screaming-frog-logo-kg.jpg",
"contentUrl": "https://www.screamingfrog.co.uk/wp-content/uploads/2018/11/screaming-frog-logo-kg.jpg",
"width": 564,
"height": 564,
"caption": "Screaming Frog"
},
"image": {
"@id": "https://www.screamingfrog.co.uk/#/schema/logo/image/"
},
"sameAs": [
"https://www.facebook.com/screamingfrog/",
"https://x.com/screamingfrog",
"https://www.instagram.com/screamingfroguk/",
"https://www.linkedin.com/company/screaming-frog",
"https://www.youtube.com/user/screamingfroguk"
]
},
{
"@type": "Person",
"@id": "https://www.screamingfrog.co.uk/#/schema/person/1864ec3b40bbe76b823e77f9f0f4e5b7",
"name": "screamingfrog",
"image": {
"@type": "ImageObject",
"inLanguage": "en-US",
"@id": "https://secure.gravatar.com/avatar/cd0f550dbfa1f1bc25abaf67f5cd340dffa9a140e6a49358750a3e4e3f616903?s=96&d=mm&r=gdcea7525842a6548ff7b2caf702e13e1",
"url": "https://secure.gravatar.com/avatar/cd0f550dbfa1f1bc25abaf67f5cd340dffa9a140e6a49358750a3e4e3f616903?s=96&d=mm&r=g",
"contentUrl": "https://secure.gravatar.com/avatar/cd0f550dbfa1f1bc25abaf67f5cd340dffa9a140e6a49358750a3e4e3f616903?s=96&d=mm&r=g",
"caption": "screamingfrog"
},
"description": "Dan Sharp is founder & Director of Screaming Frog. He has developed search strategies for a variety of clients from international brands to small and medium-sized businesses and designed and managed the build of the innovative SEO Spider software.",
"sameAs": [
"screamingfrog",
"/in/dansharpseo",
"https://x.com/screamingfrog"
],
"url": "https://www.screamingfrog.co.uk/author/screamingfrog/"
}
]
}
/blog/the-brightonseo-crawling-clinic-april-may-26/
{
"@context": "https://schema.org",
"@graph": [
{
"@type": "Article",
"@id": "https://www.screamingfrog.co.uk/blog/the-brightonseo-crawling-clinic-april-may-26/#article",
"isPartOf": {
"@id": "https://www.screamingfrog.co.uk/blog/the-brightonseo-crawling-clinic-april-may-26/"
},
"author": [
{
"@id": "https://www.screamingfrog.co.uk/#/schema/person/8699ee7de7a8064a2006ec952a94ae27"
}
],
"headline": "The brightonSEO Crawling Clinic April/May ’26",
"datePublished": "2026-04-27T12:36:48+00:00",
"mainEntityOfPage": {
"@id": "https://www.screamingfrog.co.uk/blog/the-brightonseo-crawling-clinic-april-may-26/"
},
"wordCount": 226,
"commentCount": 0,
"publisher": {
"@id": "https://www.screamingfrog.co.uk/#organization"
},
"image": {
"@id": "https://www.screamingfrog.co.uk/blog/the-brightonseo-crawling-clinic-april-may-26/#primaryimage"
},
"thumbnailUrl": "https://www.screamingfrog.co.uk/wp-content/uploads/2026/04/johnmuft.png",
"articleSection": [
"Events"
],
"inLanguage": "en-US",
"potentialAction": [
{
"@type": "CommentAction",
"name": "Comment",
"target": [
"https://www.screamingfrog.co.uk/blog/the-brightonseo-crawling-clinic-april-may-26/#respond"
]
}
]
},
{
"@type": "WebPage",
"@id": "https://www.screamingfrog.co.uk/blog/the-brightonseo-crawling-clinic-april-may-26/",
"url": "https://www.screamingfrog.co.uk/blog/the-brightonseo-crawling-clinic-april-may-26/",
"name": "The brightonSEO Crawling Clinic April/May '26 - Screaming Frog",
"isPartOf": {
"@id": "https://www.screamingfrog.co.uk/#website"
},
"primaryImageOfPage": {
"@id": "https://www.screamingfrog.co.uk/blog/the-brightonseo-crawling-clinic-april-may-26/#primaryimage"
},
"image": {
"@id": "https://www.screamingfrog.co.uk/blog/the-brightonseo-crawling-clinic-april-may-26/#primaryimage"
},
"thumbnailUrl": "https://www.screamingfrog.co.uk/wp-content/uploads/2026/04/johnmuft.png",
"datePublished": "2026-04-27T12:36:48+00:00",
"breadcrumb": {
"@id": "https://www.screamingfrog.co.uk/blog/the-brightonseo-crawling-clinic-april-may-26/#breadcrumb"
},
"inLanguage": "en-US",
"potentialAction": [
{
"@type": "ReadAction",
"target": [
"https://www.screamingfrog.co.uk/blog/the-brightonseo-crawling-clinic-april-may-26/"
]
}
]
},
{
"@type": "ImageObject",
"inLanguage": "en-US",
"@id": "https://www.screamingfrog.co.uk/blog/the-brightonseo-crawling-clinic-april-may-26/#primaryimage",
"url": "https://www.screamingfrog.co.uk/wp-content/uploads/2026/04/johnmuft.png",
"contentUrl": "https://www.screamingfrog.co.uk/wp-content/uploads/2026/04/johnmuft.png",
"width": 1938,
"height": 417
},
{
"@type": "BreadcrumbList",
"@id": "https://www.screamingfrog.co.uk/blog/the-brightonseo-crawling-clinic-april-may-26/#breadcrumb",
"itemListElement": [
{
"@type": "ListItem",
"position": 1,
"name": "Home",
"item": "https://www.screamingfrog.co.uk/"
},
{
"@type": "ListItem",
"position": 2,
"name": "Blog",
"item": "https://www.screamingfrog.co.uk/blog/"
},
{
"@type": "ListItem",
"position": 3,
"name": "The brightonSEO Crawling Clinic April/May ’26"
}
]
},
{
"@type": "WebSite",
"@id": "https://www.screamingfrog.co.uk/#website",
"url": "https://www.screamingfrog.co.uk/",
"name": "Screaming Frog",
"description": "",
"publisher": {
"@id": "https://www.screamingfrog.co.uk/#organization"
},
"potentialAction": [
{
"@type": "SearchAction",
"target": {
"@type": "EntryPoint",
"urlTemplate": "https://www.screamingfrog.co.uk/?s={search_term_string}"
},
"query-input": {
"@type": "PropertyValueSpecification",
"valueRequired": true,
"valueName": "search_term_string"
}
}
],
"inLanguage": "en-US"
},
{
"@type": "Organization",
"@id": "https://www.screamingfrog.co.uk/#organization",
"name": "Screaming Frog",
"url": "https://www.screamingfrog.co.uk/",
"logo": {
"@type": "ImageObject",
"inLanguage": "en-US",
"@id": "https://www.screamingfrog.co.uk/#/schema/logo/image/",
"url": "https://www.screamingfrog.co.uk/wp-content/uploads/2018/11/screaming-frog-logo-kg.jpg",
"contentUrl": "https://www.screamingfrog.co.uk/wp-content/uploads/2018/11/screaming-frog-logo-kg.jpg",
"width": 564,
"height": 564,
"caption": "Screaming Frog"
},
"image": {
"@id": "https://www.screamingfrog.co.uk/#/schema/logo/image/"
},
"sameAs": [
"https://www.facebook.com/screamingfrog/",
"https://x.com/screamingfrog",
"https://www.instagram.com/screamingfroguk/",
"https://www.linkedin.com/company/screaming-frog",
"https://www.youtube.com/user/screamingfroguk"
]
},
{
"@type": "Person",
"@id": "https://www.screamingfrog.co.uk/#/schema/person/8699ee7de7a8064a2006ec952a94ae27",
"name": "Mark Porter",
"image": {
"@type": "ImageObject",
"inLanguage": "en-US",
"@id": "https://secure.gravatar.com/avatar/d397bb96aa8c1672712b1ee67f3f1c3ceea8f5301957148305899f1f70596303?s=96&d=mm&r=g633205d6261ca5d9179c807e5a81411e",
"url": "https://secure.gravatar.com/avatar/d397bb96aa8c1672712b1ee67f3f1c3ceea8f5301957148305899f1f70596303?s=96&d=mm&r=g",
"contentUrl": "https://secure.gravatar.com/avatar/d397bb96aa8c1672712b1ee67f3f1c3ceea8f5301957148305899f1f70596303?s=96&d=mm&r=g",
"caption": "Mark Porter"
},
"description": "Mark is a self-confessed geek who has always had a love/hate relationship with blogging, coupled with an addiction to buying domain names. Outside of SEO, Mark loves Manchester United, gadgets and games. If anyone can beat him at FIFA he will happily buy them a drink.",
"sameAs": [
"https://twitter.com/markcporter",
"screamingfrog",
"in/mcporter",
"https://x.com/markcporter"
],
"url": "https://www.screamingfrog.co.uk/author/markporter/"
}
]
}
Your Diagnosis
Before revealing the machine’s verdict, predict the BS score for each signal. Higher = more BS (more fluff, less verifiable substance). Drag each slider, then submit to compare your judgment against the engine.
Information Density
0 / 30
Read the Narrative & headings: do hard facts (prices, dates, numbers) outweigh fluff power-words?
Semantic Coherence
0 / 20
Compare the homepage promise against the sub-page reality. Do they hold the same line?
Trust & Proof
0 / 20
Weigh review mentions against actual external proof links. Claims without verification = theatre.
Commodity Fingerprint
0 / 15
Check headings & narrative against the industry clichés in the setup above.
Identity & Authority
0 / 15
Inspect the schema: is there real Organization/Person identity with sameAs links, or gaps?
Your predicted BS score
0 / 100
Stuck? Reveal the heuristic lens — how the deterministic page-auditor reads each signal (no AI, pure pattern rules)
These are the structural rules a local, deterministic auditor applies — the same lens you can use to judge each signal. They describe what to look for, not this company’s result.
Information Density
Classify each sentence as substantive or hollow. Grounding markers — numbers, currencies, dates, technical units, named entities — outweigh marketing adjectives. When fluff sits right next to hard evidence, the fluff is forgiven.
Semantic Alignment
Pull the main entities out of the H1, then check whether they actually recur through the body. A page that announces one thing and then talks about another drifts. Headings with no real sentences underneath read as pseudo-substance.
Trust & Proof
Count trust words (review, testimonial, rating, verified) against real outbound proof links (Google, Trustpilot, Clutch, G2, Yelp). Lots of trust language with zero verification links is trust theatre. Unlinked logo galleries count against it.
Commodity Fingerprint
Look at how much sentence length varies. Natural writing varies its rhythm; templated or mass-produced copy is statistically uniform. Very low variation reads as commodity content — unless unique named entities break the pattern.
Identity & Authority
Inspect the JSON-LD. Is there an Organization or Person schema, and does it carry sameAs links to real external profiles (LinkedIn, socials)? Missing schema or no identity declaration signals an anonymous entity.
Want to apply this lens yourself? The free BS Indicator Chrome extension runs these heuristic checks live on any page. Bear in mind it is a single-page, deterministic tool — it relies only on pattern rules for the page in front of it and does not perform the cross-page semantic correlation this audit uses, so its readout is a starting lens, not the full verdict.
B
BS Level
Marketing, SEO & Advertising Agencies
45.1 Avg BS
Based on 1856 businesses audited.
BS Detector
Marketing, SEO & Advertising Agencies BS: Screaming Frog (screamingfrog.co.uk)
https://screamingfrog.co.uk
📍 Industry: Marketing, SEO & Advertising Agencies
8
BS / 100
A rare example of a marketing entity with negative BS pressure. Screaming Frog avoids almost all agency cliches by leading with a tangible, high-utility product rather than service-based vaporware. This is a technical authority site using its content to prove its competence rather than describe it.
Info Density
Power-words vs. Substance ratio.
3
10% BS
Semantic Coherence
Homepage promise vs. Sub-page reality.
0
0% BS
Trust & Proof
Verifiable evidence vs. Trust Theatre.
3
15% BS
Commodity Fingerprint
Detection of industry clichés/templates.
2
13% BS
Identity & Authority
Expert verifiability & Schema depth.
0
0% BS
Hyperlink the specific mention of the UK Search Awards win directly to the official 2025 results page to close the proof path. Replace the subjective adjective remarkably in the homepage meta description with a statistic regarding user count or crawl volume. Add SoftwareApplication schema to the tool pages to further distinguish product substance from agency services.
The site is a perfect match for the SEO and Marketing Agency category, though it significantly differentiates itself as a software developer for the same industry. The content is deeply technical, focusing on search engine crawlers, log analysis, and data-driven marketing.
“The score of 8 reflects a nearly perfect substance-to-signal ratio. Minor points were deducted in Information Density (3) for standard marketing adjectives in the hero section and Trust and Proof (3) for the generic trusted by thousands claim. Commodity Fingerprint (2) was noted only for the inclusion of standard service categories, which are necessary for industry navigation.”
Verified Analysis Date: June 19, 2026
© 1EuroSEO Independent Evaluator — Non-Sponsored Result
Analysis Disclosure & Source Attribution
This training module utilizes a snapshot of public data from Screaming Frog, captured on June 19, 2026, to demonstrate how machine logic evaluates different types of business narratives.
Purpose: This data is presented under “Fair Use” / “Educational Exception” for the purpose of forensic semantic analysis, allowing users to compare human intuition against machine-generated evaluations.
Notice to Screaming Frog: This analysis is part of a non-adversarial audit conducted by 1 Euro SEO. The results provided by 1EuroSEO are intended as professional feedback to help improve any website’s machine-readability and authority signals. The 1EuroSEO BS Detection Tool is a free tool, and anyone can test any company to see how their content is interpreted by AI models.
Any company can use the insights for free and improve its voice by comparing it to industry clichés or competitors. When a company has updated its content, it can always submit a new audit request, which will be reflected in a new current score.
To all users: You are encouraged to visit the live site at https://screamingfrog.co.uk to view the most current version of its content and learn from the source what this company is about and what it offers.