In response to the need to add a noindex
to Web Framework pages, an update has been made to include a noindex checkbox on the Page metadata set.
The “noindex” directive is used on websites to tell search engines not to index a specific page. When a page is marked with “noindex,” it means search engines like Google will not include that page in their search results.
The noindex option allows users to select this option from the Metadata tab when in edit mode.
Once the page is published, the <meta name="robots" content="noindex" />
tag will be added to the page, telling search engines not to index the content of the page. This functionality is commonly used for things like campaign pages, where a page is intended for specific, targeted users that should not appear in search engine results.
In addition to selecting the noindex checkbox, the page should also be removed from the site’s sitemap. This can be done by the Sitehost account owner, proxy, or developer via SSH on the group Sitehost account. Once connected, navigate the the webs folder and edit the sitemap.ini file. Following the instructions in sitemap.ini, files and folders may be excluded. When finished, save the file. When the sitemap generation script automatically runs again, the file(s) and/or folder(s) will be excluded from the sitemap.xml file.
Note: The file should not be excluded from robots.txt, only the sitemap.