Skip to content
    Moz logo Menu open Menu close
    • Products
      • Moz Pro
      • Moz Pro Home
      • Moz Local
      • Moz Local Home
      • STAT
      • Moz API
      • Moz API Home
      • Compare SEO Products
      • Moz Data
    • Free SEO Tools
      • Domain Analysis
      • Keyword Explorer
      • Link Explorer
      • Competitive Research
      • MozBar
      • More Free SEO Tools
    • Learn SEO
      • Beginner's Guide to SEO
      • SEO Learning Center
      • Moz Academy
      • SEO Q&A
      • Webinars, Whitepapers, & Guides
    • Blog
    • Why Moz
      • Agency Solutions
      • Enterprise Solutions
      • Small Business Solutions
      • Case Studies
      • The Moz Story
      • New Releases
    • Log in
    • Log out
    • Products
      • Moz Pro

        Your all-in-one suite of SEO essentials.

      • Moz Local

        Raise your local SEO visibility with complete local SEO management.

      • STAT

        SERP tracking and analytics for enterprise SEO experts.

      • Moz API

        Power your SEO with our index of over 44 trillion links.

      • Compare SEO Products

        See which Moz SEO solution best meets your business needs.

      • Moz Data

        Power your SEO strategy & AI models with custom data solutions.

      Maximize online visibility with NEW Moz Local
      NEW Moz Local

      Maximize online visibility with NEW Moz Local

      Learn more
    • Free SEO Tools
      • Domain Analysis

        Get top competitive SEO metrics like DA, top pages and more.

      • Keyword Explorer

        Find traffic-driving keywords with our 1.25 billion+ keyword index.

      • Link Explorer

        Explore over 40 trillion links for powerful backlink data.

      • Competitive Research

        Uncover valuable insights on your organic search competitors.

      • MozBar

        See top SEO metrics for free as you browse the web.

      • More Free SEO Tools

        Explore all the free SEO tools Moz has to offer.

      What is your Brand Authority?
      Moz

      What is your Brand Authority?

      Check yours now
    • Learn SEO
      • Beginner's Guide to SEO

        The #1 most popular introduction to SEO, trusted by millions.

      • SEO Learning Center

        Broaden your knowledge with SEO resources for all skill levels.

      • On-Demand Webinars

        Learn modern SEO best practices from industry experts.

      • How-To Guides

        Step-by-step guides to search success from the authority on SEO.

      • Moz Academy

        Upskill and get certified with on-demand courses & certifications.

      • SEO Q&A

        Insights & discussions from an SEO community of 500,000+.

      Unlock flexible pricing & new endpoints
      Moz API

      Unlock flexible pricing & new endpoints

      Find your plan
    • Blog
    • Why Moz
      • Small Business Solutions

        Uncover insights to make smarter marketing decisions in less time.

      • Agency Solutions

        Earn & keep valuable clients with unparalleled data & insights.

      • Enterprise Solutions

        Gain a competitive edge in the ever-changing world of search.

      • The Moz Story

        Moz was the first & remains the most trusted SEO company.

      • Case Studies

        Explore how Moz drives ROI with a proven track record of success.

      • New Releases

        Get the scoop on the latest and greatest from Moz.

      Surface actionable competitive intel
      New Feature

      Surface actionable competitive intel

      Learn More
    • Log in
      • Moz Pro
      • Moz Local
      • Moz Local Dashboard
      • Moz API
      • Moz API Dashboard
      • Moz Academy
    • Avatar
      • Moz Home
      • Notifications
      • Account & Billing
      • Manage Users
      • Community Profile
      • My Q&A
      • My Videos
      • Log Out

    The Moz Q&A Forum

    • Forum
    • Questions
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. Home
    2. SEO Tactics
    3. Technical SEO
    4. Question about a Screaming Frog crawling issue

    Moz Q&A is closed.

    After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.

    Unsolved Question about a Screaming Frog crawling issue

    Technical SEO
    technical seo crawl errors
    5
    5
    1649
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with question management privileges can see it.
    • KyleSennikoff
      KyleSennikoff Subscriber last edited by

      Hello,

      I have a very peculiar question about an issue I'm having when working on a website. It's a WordPress site and I'm using a generic plug in for title and meta updates. When I go to crawl the site through screaming frog, however, there seems to be a hard coded title tag that I can't find anywhere and the plug in updates don't get crawled.

      If anyone has any suggestions, thatd be great. Thanks!

      jhonmike8 1 Reply Last reply Reply Quote 0
      • jhonmike8
        jhonmike8 @KyleSennikoff last edited by

        @KyleSennikoff Hi there! It sounds like you're encountering a common challenge. Check your WordPress theme files, especially header.php, for any hardcoded title tags. Additionally, ensure that the plugin-generated title and meta updates are reflected in the betflixs HTML source code. If the issue persists, consider reaching out to the plugin's support for assistance. Good luck.

        1 Reply Last reply Reply Quote 0
        • porpercris
          porpercris @Kateparish last edited by

          Undoubtedly it is https://writepaper.com/do-my-project-for-me that is the favorite of many in custom academic assignment writing. The quick turnaround makes it so that you don't have to worry about the assignment for a long time and quickly save yourself from worries by entrusting everything to real professionals who know exactly what they are doing. The experience and skills of the writers are amazing, so turn to them.

          1 Reply Last reply Reply Quote 0
          • emmamiller843
            emmamiller843 @Kateparish last edited by

            @Kateparish Thank you for giving your solution information. I am now using the rank math plugin for my WordPress website.

            1 Reply Last reply Reply Quote 0
            • Kateparish
              Kateparish last edited by

              there are a few possible explanations and solutions you can try:

              Theme settings: Some WordPress themes have built-in options to set a default title tag or meta description for your website. Check your theme settings to see if there's a section where you can modify the title tag. Look for options like "SEO" or "Header" settings within the theme's customization options.

              Child theme modifications: If you're using a child theme, it's possible that the hard-coded title tag is coming from a modification made within the child theme's files. Review the code of your child theme, particularly the header.php file, to see if there's any direct reference to the title tag.

              SEO plugin conflicts: It's possible that there is a conflict between the generic plugin you're using for title and meta updates and another SEO-related plugin installed on your WordPress site. Try deactivating other SEO plugins temporarily to see if the issue persists. If the problem is resolved, you may need to choose one plugin for managing your SEO metadata.

              Caching plugins or server caching: If you're using any caching plugins or server-level caching, it's possible that the changes made by the plugin are not immediately reflected due to caching. Clear the cache within the caching plugin or purge the server cache to ensure that the latest changes are being served.

              Plugin compatibility: Check if the generic plugin you're using for title and meta updates is compatible with your current version of WordPress. If the plugin hasn't been updated in a while, it may not work correctly with the latest WordPress version. In that case, consider finding an alternative plugin or contacting the plugin developer for support.

              Manual inspection: If you've exhausted the above steps and the issue still persists, you may need to manually inspect your website's code. Use the browser's developer tools to inspect the source code and search for the specific hard-coded title tag. This will help identify where it's coming from and allow you to make the necessary modifications directly in the code.

              Remember to take a backup of your WordPress site and its database before making any changes to your theme files or modifying the code.

              emmamiller843 porpercris 2 Replies Last reply Reply Quote 0
              • 1 / 1
              • First post
                Last post

              Got a burning SEO question?

              Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.


              Start my free trial


              Browse Questions

              Explore more categories

              • Moz Tools

                Chat with the community about the Moz tools.

              • SEO Tactics

                Discuss the SEO process with fellow marketers

              • Community

                Discuss industry events, jobs, and news!

              • Digital Marketing

                Chat about tactics outside of SEO

              • Research & Trends

                Dive into research and trends in the search industry.

              • Support

                Connect on product support and feature requests.

              • See all categories

              Related Questions

              • mohammadrehanseo

                How to Boost Your WordPress Website Speed to 95+ (Without Premium Plugins)

                speed wordpress website speed technical seo

                I'm reaching out for some advice on improving my WordPress website's speed. I'm currently using a free theme for this fusion magazine and aiming for a score of 95+ on Google PageSpeed Insights. I'm aware that premium plugins can significantly enhance performance, but I'm hoping to achieve similar results using primarily free solutions and manual optimizations.

                Technical SEO | | mohammadrehanseo
                0
              • peteboyd

                Unsolved Capturing Source Dynamically for UTM Parameters

                technical seo google analytics utm parameters

                Does anyone have a tutorial on how to dynamically capture the referring source to be populated in UTM parameters for Google Analytics? We want to syndicate content and be able to see all of the websites that provided referral traffic for this specific objective. We want to set a specific utm_medium and utm_campaign but have the utm_source be dynamic and capture the referring website. If we set a permanent utm_source, it would appear the same for all incoming traffic. Thanks in advance!

                Technical SEO | | peteboyd
                0
              • Dingos

                URL structure for same product in multiple categories?

                url inspection breadcrumbs technical seo seo tactics

                Hello everyone ! I am building an ecom store using wordpress. I have assigned multiple categories to the same product. What should be the URL structure when users are navigating with different product categories? Categories Assigned: tshirt, blue, striped
                Product Name: blue-striped-tshirt Option 01: Matching site navigation breadcrumb to product url URL - ecomstore.com/tshirt/blue-striped-tshirt
                Breadcrumb - home/tshirt/blue-striped-tshirt URL - ecomstore.com/blue/blue-striped-tshirt (canonical to 1 product page)
                Breadcrumb - home/color/blue/blue-striped-tshirt URL - ecomstore.com/striped/blue-striped-tshirt (canonical to 1 product page)
                Breadcrumb - home/type/striped/blue-striped-tshirt Option 02: Same product urls and different breadcrumbs based on user site navigation URL - ecomstore.com/tshirt/blue-striped-tshirt
                Breadcrumb - home/tshirt/blue-striped-tshirt URL - ecomstore.com/tshirt/blue-striped-tshirt (url same as 1 product page)
                Breadcrumb - home/color/blue/blue-striped-tshirt URL - ecomstore.com/tshirt/blue-striped-tshirt (url same as 1 product page)
                Breadcrumb - home/type/striped/blue-striped-tshirt I have decided to got with Option 01 so that the product in each category can be ranked according to each category keyword. Which option is the best according to your experience or is there any other best practice?

                Technical SEO | | Dingos
                0
              • GoogleAlgoServant

                Unsolved Duplicate LocalBusiness Schema Markup

                schema markup schema local seo technical seo

                Hello! I've been having a hard time finding an answer to this specific question so I figured I'd drop it here. I always add custom LocalBusiness markup to clients' homepages, but sometimes the client's website provider will include their own automated LocalBusiness markup. The codes I create often include more information. Assuming the website provider is unwilling to remove their markup, is it a bad idea to include my code as well? It seems like it could potentially be read as spammy by Google. Do the pros of having more detailed markup outweigh that potential negative impact?

                Local Website Optimization | | GoogleAlgoServant
                0
              • Michael_M

                Solved How to solve orphan pages on a job board

                technical seo

                Working on a website that has a job board, and over 4000 active job ads. All of these ads are listed on a single "job board" page, and don’t obviously all load at the same time. They are not linked to from anywhere else, so all tools are listing all of these job ad pages as orphans. How much of a red flag are these orphan pages? Do sites like Indeed have this same issue? Their job ads are completely dynamic, how are these pages then indexed? We use Google’s Search API to handle any expired jobs, so they are not the issue. It’s the active, but orphaned pages we are looking to solve. The site is hosted on WordPress. What is the best way to solve this issue? Just create a job category page and link to each individual job ad from there? Any simpler and perhaps more obvious solutions? What does the website structure need to be like for the problem to be solved? Would appreciate any advice you can share!

                Reporting & Analytics | | Michael_M
                2
              • Merkle-Impaqt

                Can you use Screaming Frog to find all instances of relative or absolute linking?

                My client wants to pull every instance of an absolute URL on their site so that they can update them for an upcoming migration to HTTPS (the majority of the site uses relative linking). Is there a way to use the extraction tool in Screaming Frog to crawl one page at a time and extract every occurrence of _href="http://" _? I have gone back and forth between using an x-path extractor as well as a regex and have had no luck with either. Ex. X-path: //*[starts-with(@href, “http://”)][1] Ex. Regex: href=\”//

                Technical SEO | | Merkle-Impaqt
                0
              • ggpaul562

                Sitelinks Issue - Different Languages

                Hey folks, We run different ccTLD's for revolveclothing.com (revolveclothing.es, revolveclothing.com.br, etc. etc.) and they all have their own WMT/Google Console with their own href lang tags etc. The problem is this. https://www.google.fr/#q=revolve+clothing When you look at the sitelinks, you'll see that one of them (sales page) happens to be in Portuguese on the French site. Can anyone investigate and see why?

                Technical SEO | | ggpaul562
                0
              • seoessentials

                Screaming Frog Content Showing charset=UTF-8

                I am running a site through Screaming Frog and many of the pages under "Content" are reading text/html; charset=UTF-8. Does this harm ones SEO and what does this really mean? I'm running his site along with this competitors and the competitors seems very clean with content pages reading text/html. What does one do to change this if it is a negative thing? Thank you

                Technical SEO | | seoessentials
                0
              Moz logo
              • Contact
              • Community
              • Free Trial
              • Terms & Privacy
              • Accessibility
              • Jobs
              • Help
              • What's New
              • News & Press
              • MozCon
              © 2021 - 2025 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.

              Looks like your connection to Moz was lost, please wait while we try to reconnect.