What to change
A search engine needs to fetch a page to read its page-level instructions. Ask the supplier to explain whether the current search-engine access rule prevents that fetch, then choose a coherent approach for the intended public resource. Keep private material behind genuine access controls. For a public page intended for search exclusion, the evidence should show that the relevant indexing instruction is reachable.
A worked example
Illustrative example
Illustrative test: Use a public obsolete help page, not a confidential file, for the diagnostic. Consider an obsolete public help page that should remain available to existing readers but no longer be offered in search. One supplier blocks search-engine visits while another adds an exclusion instruction to the page. Ask them to explain why those choices conflict for this task and demonstrate the corrected public arrangement. Keep this example separate from a staff document, which needs real access protection regardless of search visibility.
What this means for your practice
Search exclusion involves more than hiding a page from visitors or blocking a search engine's visit. A search engine must be able to read the instruction that asks it to leave an otherwise public page out of results. Your supplier may describe this as a conflict between crawling and search-exclusion instruction. You do not need to choose the technical rule yourself. Explain whether the material should remain public and ask the supplier to show a coherent approach for that decision. For a withdrawn public help page, that may mean making the exclusion instruction readable. For private information, the priority is genuine access control. Ask for evidence about the exact address rather than a general statement that the site has been blocked.
How to check the result
The supplier confirms that search engines can read the intended exclusion instruction on the public page, and records any separate access restrictions.
A mistake to avoid
Index controls are not a substitute for authentication of private information.
Turn reading into a next step
Your action checklist
Work through these checks with your team or supplier. Tick the ones you have resolved and leave unknowns open.
Record what you know, what is still missing and the answer you need from your team or supplier.
Use project decisions only, without personal, patient or confidential details. Entries stay in this page and are not submitted to Kay & Co. Copy or download before leaving; this page does not save your notes.
Further reading
These sources provide background for the topic. The practice examples and checklist are illustrative planning suggestions from Kay & Co.
Related guides
Need help with this?
Tell us what is getting in the way. Kay & Co. can help you understand the options and turn the next step into something that works for your practice.
Explore marketing & search services or discuss your project.
Try the free Healthcare Digital Planner to find your starting priority.