News

Python scripts for structured data validation and gap analysis

Schema has been a constant topic in SEO for years. Recently, though, the conversation has shifted toward whether it still matters—both for traditional search and for LLM-driven experiences like ChatGPT. I don’t think its importance has diminished. If anything, it’s evolving. In March 2025, Google updated its structured data requirements for return policies. That alone […]

Oncrawl MCP: Connect your crawl data to Claude Code to automate your SEO audits

When a technical SEO audit involves tens of thousands of pages, the constraint is no longer the data. You already have the data: Oncrawl collects it, cross-references it, and makes it readable. The real challenge is the time it takes to turn that data into a structured, prioritized, and justifiable report. Oncrawl’s MCP server turns […]

Common website migration mistakes that drag down SEO performance

Why do migrations go wrong (even with great teams)? Website migrations are like moving houses, you know it’s going to be chaotic, things will inevitably go wrong, and yet you still have to do it. No matter how meticulously you plan, something always gets left behind or breaks in transit. The frustrating part? Most migration […]

Scrape your website’s data with our custom fields

Looking for a powerful way to extract and analyze specific data from your website? Oncrawl’s custom fields feature lets you scrape any content from your pages during a crawl, giving you complete flexibility to collect the exact information you need for your SEO analysis. What are custom fields? Custom fields allow you to extract specific […]

Managing faceted navigation at scale

Faceted navigation helps users find exactly what they’re looking for. It lets them filter and sort products or content quickly, making large websites easier to explore. But from an SEO perspective, it can get tricky. Poorly implemented faceted navigation can create duplicate content, waste crawl budget, and confuse search engines about which pages to index. […]

How technical debt in web architecture slows down product growth

Your product’s growing fast. You’ve got new users every week and the team is sprinting to keep up. Then one day, bam! Load times spike, features start breaking, bug reports flood in and everything feels like it’s on fire. That’s technical debt and in web architecture, it builds up quickly and bites hard. In this […]

What is Latent Semantic Indexing and how does it work?

Editor’s note: This article has been updated to reflect developments in Google Search and SEO best practices. Latent Semantic Indexing (LSI) has long been cause for debate amongst search marketers. If you Google the term ‘latent semantic indexing ranking factor,’ you will encounter both advocates and skeptics. However, as of 2025, there is a clearer […]

Evaluating the quality of CausalImpact predictions

CausalImpact is one of the most popular packages used in SEO experimentation. Its popularity is understandable. SEO experimentation provides exciting insights and ways for SEOs to report on the value of their work. Yet, the accuracy of any machine learning model is dependent on the input information it is given. Simply put, poor input data […]

6 Ways subdomains impact your SEO performance

There are many aspects of an organization that can make it a successful, thriving business.  For many, an engaging, user-friendly website is a crucial factor for building a brand and attracting customers. This is especially the case if you are running an e-commerce business.  A website gives you brand identity and creates a place for […]

5 Most underrated Oncrawl features

Are you a seasoned Oncrawl user who navigates the platform like the back of their hand? Or, have you recently partnered with us and you’re looking for the top insider tips to get you started? As a member of the CSM team here at Oncrawl, I have a particular view on the features that I’ve […]

Proactive indexing: The competitive advantage your SEO strategy needs

Search visibility doesn’t begin with publishing, it begins with indexing. In a digital landscape defined by speed, relevance, and competition, proactive indexing is no longer an optional technical step; it must be a core component of your SEO strategy. However, indexing effectiveness is influenced not just by submission, but by a site’s crawlability, structure, and […]