Field note / 2 March 2011
Search crawls need a budget, even in SharePoint 2007
A full crawl is not a maintenance button. It is a large read of the content estate with a cost that must be planned.
A full crawl asks the search service to revisit the entire content source. It is sometimes necessary after a configuration change or a suspected index problem. It is rarely a good default response to every search complaint.
The crawl consumes processing, storage and network capacity. On a mature farm, the content estate may be far larger and slower than it was during the initial build. A crawl that was harmless in a pilot can become a production event.
Decide what the crawl is meant to prove
If the problem is a few missing items, a targeted recrawl or a content source check is more proportionate than a full pass. If the index is suspected to be corrupt, the support guidance and the recovery plan matter more than the crawl button. Start with the smallest action that can confirm or eliminate a cause.
Schedule large crawls outside business hours and monitor duration, errors and host load. Agree a stop condition in advance. If the crawl is slower than the available window, stop and redesign the schedule rather than allowing it to run into the next working day.
The short list
Checks worth running
- State the question the crawl is expected to answer.
- Check content source scope and access before starting.
- Agree a stop time and monitor host impact during the run.
Search is an operational service with a finite capacity. A crawl plan that respects that capacity is more useful than a habit of restarting the biggest job whenever results look wrong.
Outside reading
Reference shelf
Official documentation and independent community reading for the subjects in this note.
- Microsoft Learn: SharePoint search (opens in a new tab)Documentation for search architecture, crawling and result management.
- Microsoft Learn: SharePoint administration (opens in a new tab)Operational guidance for service settings, site management and the modern admin experience.
- Microsoft Learn: SharePoint documentation (opens in a new tab)The starting point for current SharePoint administration, development and hybrid guidance.
- Microsoft Support (opens in a new tab)Support articles, troubleshooting steps and product help from Microsoft.
- Microsoft Tech Community (opens in a new tab)Community discussion, product announcements and practical posts from Microsoft teams.
- Microsoft Learn Q&A (opens in a new tab)A community question and answer space hosted by Microsoft.
- SharePoint Stack Exchange (opens in a new tab)An independent question and answer community for SharePoint practitioners.
- Microsoft Learn: Windows Server documentation (opens in a new tab)Current guidance for Windows Server roles, networking, storage and management.
- Microsoft Learn: IIS documentation (opens in a new tab)Reference material for web server configuration, authentication and diagnostics.
- Microsoft Download Center (opens in a new tab)Official downloads for Microsoft tools, updates and supporting packages.
- Microsoft Security Response Center (opens in a new tab)Security advisories, update guidance and vulnerability response information.
- SharePoint community on Reddit (opens in a new tab)An independent discussion space for administrators, developers and users.
- Microsoft Learn: PowerShell documentation (opens in a new tab)Language reference, cmdlet documentation and guidance for repeatable automation.
- PowerShell Gallery (opens in a new tab)A public repository for PowerShell modules and scripts. Review package provenance before use.
- Microsoft Learn: SQL Server documentation (opens in a new tab)Official reference material for database engine configuration, performance and recovery.