Google: Do Not Use Robots.txt To Block Indexing Of URLs ...
文章推薦指數： 80 %
Google's John Mueller said you should absolutely not "use robots.txt to block indexing of URLs with parameters." He said if you do that then ... Home>GoogleNews>GoogleSEO>Google:DoNotUseRobots.txtToBlockIndexingOfURLsWithParameters Google:DoNotUseRobots.txtToBlockIndexingOfURLsWithParameters Nov8,2019• 7:28am| (10) byBarrySchwartz |FiledUnderGoogleSearchEngineOptimization PrevStory Nextstory Tweet Share PrevStory NextStory Google'sJohnMuellersaidyoushouldabsolutelynot"userobots.txttoblockindexingofURLswithparameters."HesaidifyoudothatthenGoogle"cannotcanonicalizetheURLs,andyouloseallofthevaluefromlinkstothosepages."Insteaduserel-canonicalsandlinkconsistentlythroughoutyoursite.JohnsaidthisonTwitter,hereisanembedofthetweet:Don'tuserobots.txttoblockindexingofURLswithparameters.Ifyoudothat,wecan'tcanonicalizetheURLs,andyouloseallofthevaluefromlinkstothosepages.Userel-canonical,linkcleanlyinternally,etc.—🍌John🍌(@JohnMu)November8,2019HethenhadafollowupaboutwhyitissobadtoblocktheseURLswithrobots.txt:Wewouldn'tseetherel-canonicalifit'sblockedbyrobots.txt,soI'dpickeitheroneortheother.Ifyoudouserobots.txt,we'lltreatthemlikeotherrobottedpages(andwewon'tknowwhat'sonthepage,sowemightindextheURLwithoutcontent).—🍌John🍌(@JohnMu)November8,2019Sobecarefulaboutthisanddoublecheckallofthesethingsonyourwebsites.ForumdiscussionatTwitter. Previousstory:GoogleAdsEditorv1.2AddsNewCampaignTypes&Cross-AccountFeatures blogcommentspoweredbyDisqus Thepulseofthesearchcommunity Subscribe Subscribeoptions HowtoAvoidBeingSuspendedonGoogleBusinessProfile(&GetReinstatedWhenYouAre)withBenFisher HowtoBuildanEffectiveDigitalMarketingTeamwithTrumanHedding PPCDO’sandDONT’SwithTrumanHedding SEOTechnicalAudit:WhattoLookatWhenCrawlingYourSitewithBillHartzer WhatistheFutureofAffiliateMarketingwithTrumanHedding SearchVideoRecaps 08/12/202208:01am Subscribe Morevideos VideoDetails SearchVlog 08/22/202208:01am Subscribe Morevlogs VlogDetails Browseby: BrowsebyDate FindbyCategory DiscoverbyAuthor ScanMostRecent SeeComments ViewTagCloud SubmitaThread ForumSearch Awards AboutUs Seals Advertise Contact Google GoogleUpdates GoogleNews GoogleSEO AdSense GoogleAds MiscGoogle GoogleMaps Bing BingSEO BingAds ContentAds Yahoo YahooSEO YahooSearchAds YahooPublisherNetwork YahooNews OtherYahoo Overture SEO Sitemaps Spiders InformationalSitesSEO SEOCopywriting KeywordResearch LinkBuilding DynamicSiteSEO Cloaking LocalSEO OtherSearchTopics Honor SearchNews SEOTools Spam ForumNews SEMCompanies WebPromotion SEOInterviews SearchTechnology SearchTheory SEMOrganizations SEOBooks LegalSearchIssues AffiliateMarketing SocialSearch More... Logos OtherSearchEngines SEOConferences PPCEngines WebDirectories Ask.com Photos ShoppingSearch MultilingualSearch SearchPulse SearchVideoRecaps DiggDigest SearchForumRecap SearchEngineRoundtableVlog Misc AdEmail SubmitaThread ForumSearch Awards AboutUs Seals Advertise Contact MobileSite Thecontentat theSearchEngineRoundtablearethesoleopinionoftheauthorsandinnowayreflectviewsofRustyBrick®,Inc Copyright©1994-2022 RustyBrick®,Inc. WebDevelopmentAllRightsReserved. ThisworkbySearchEngineRoundtableislicensedunderaCreativeCommonsAttribution3.0UnitedStatesLicense.CreativeCommonsLicenseandYouTubevideosunderYouTube'sToS.
延伸文章資訊
- 1Should I disallow all URL query strings/parameters in Robots ...
Add "Disallow: *?" to hide all query/parameter URLs from Google. ... this when I added an exclusi...
- 2How Google interprets the robots.txt specification
The disallow directive specifies paths that must not be accessed by the crawlers identified by th...
- 3Google: Do Not Use Robots.txt To Block Indexing Of URLs ...
Google's John Mueller said you should absolutely not "use robots.txt to block indexing of URLs wi...
- 4No indexing url including query string with Robots txt - Moz
Disallow: the url or folder or other url with conditions you need to block. As you have asked in ...
- 5Ignore URLs in robot.txt with specific parameters?
Here's a solutions if you want to disallow query strings: Disallow: /*?*. or if you want to be mo...
