Belajar Membuat Robots TXT

 

Bagi Anda yang akan mencoba robots.txt untuk blog, silahkan coba robots.txt di bawah ini

 

# If you are regularly crawling WordPress.com sites, please use our firehose to receive real-time push updates instead.

# Please see https://developer.wordpress.com/docs/firehose/ for more details.

 

Sitemap: https://ainamulyana.wordpress.com/sitemap.xml

Sitemap: https://ainamulyana.wordpress.com/news-sitemap.xml

 

User-agent: *

Disallow: /wp-admin/

Allow: /wp-admin/admin-ajax.php

Disallow: /wp-login.php

Disallow: /wp-signup.php

Disallow: /press-this.php

Disallow: /remote-login.php

Disallow: /activate/

Disallow: /cgi-bin/

Disallow: /mshots/v1/

Disallow: /next/

Disallow: /public.api/

 

# This file was generated on Thu, 01 Feb 2024 06:17:32 +0000

 

 

Sitemap: https://majubersma.blogspot.com/sitemap.xml

Sitemap: https://majubersma.blogspot.com/feeds/posts/default?max-results=999999&alt=json-in-script&callback=loadtoc

User-agent: Mediapartners-Google

Disallow: 

User-agent: *

Disallow: /search

Allow: /