Skip to content

Business knowledge preparation guide · By Yes AI

How tidy must your files be before AI search?

Published 5 min read

AI search returns what is in the folders it reads, including the old draft and the copy someone saved to their own folder. You do not need a perfect file system before starting, but the documents behind your first set of questions need to be current and unambiguous. This guide covers what to tidy, what to exclude and what you must not delete.

Quick answer

Your files do not need to be perfect. The documents that answer your first set of staff questions need one current version each, a clear owner and a title people would recognise. Move superseded versions and drafts to an archive that the index does not read instead of deleting them, because tax and employment records have minimum retention periods. Leave HR, payroll and personal folders out of the first scope.

Practice manager and team leader sorting printed procedure versions into keep and archive piles in a Ballarat office
One current version per topic, with an owner who can confirm it.

How clean do the files need to be?

Clean enough that a person could answer the pilot questions from the folders in scope without guessing which version applies. That is a narrower job than reorganising the whole drive. Start from the questions staff ask, find the documents that answer them, and tidy only those folders first. The documents behind the first questions may be a small share of the whole drive. Expanding the scope later is easier once the first set works, because you will have a tested routine for choosing, checking and archiving documents.

Hypothetical example: a service business whose first 40 staff questions cover vehicle checks, leave requests and job sign-off may find the answers in a few dozen procedures and forms, even though its drive holds tens of thousands of files. Those few dozen documents are the ones to tidy first.

How do you find duplicates and old versions?

Search the folders in scope for the usual markers, sort by modified date to find procedures nobody has touched in years, and compare files with identical names in different folders. For each topic, ask the document owner which version is current and record the answer. In SharePoint, version history stores earlier versions inside the same file, with limits set by your administrator or site owner, so separate 'v2 final' copies are rarely needed once staff save over the original.

  • File names containing copy, old, draft, final or a version number.
  • Identical file names in more than one folder.
  • Procedures not modified for several years.
  • Documents with no identifiable owner.

Should you delete superseded documents?

Usually not straight away. Move them to an archive library or folder that the knowledge search does not index, and keep them for as long as the law and your own policies require. The ATO says you need to keep most business records for 5 years, and the Fair Work Ombudsman says employers have to keep time and wages records for 7 years. Other obligations may apply in your industry. Excluding a document from search keeps it out of answers without destroying a record you may need. This is administrative guidance only, so confirm retention periods with your accountant or adviser.

How do you keep archives out of search?

For a custom knowledge search, define the index scope by site, library or folder and leave the archive out. In SharePoint, a site owner can also stop a library's items appearing in search results through the library's advanced settings, or stop a whole site appearing through its search settings. Microsoft notes that search results are always security trimmed and that these settings only control what goes into the search index. They hide content from SharePoint search without changing who can open it, so the archive still needs sensible permissions.

What details should each document carry?

Give each document in scope an owner, a status and a review date. The owner is the person who can say whether the content is right. Status separates current, draft and superseded documents, and lets retrieval filter out anything that is not current. The review date tells the owner when to check it again. In SharePoint these can be library columns, and in Google Drive a naming convention or a register works. Add a plain title that matches how staff ask, such as 'Vehicle pre-start check' in place of a bare procedure number.

Which folders should stay out of scope?

Leave out folders whose contents staff should not receive as answers, and folders that only add noise. Human resources, payroll and individual staff files belong in the first group. Personal working folders, old project folders, marketing image libraries and email exports usually belong in the second. Customer job files can be useful for questions about past work, but they carry personal information and client confidentiality. Add them deliberately, with permissions checked, after the policy and procedure set is working.

What to do with each kind of folder content

ContentInclude in first index?Action before indexing
Current policies and proceduresYesOne version per topic, with owner and review date added
Superseded versionsNoMove to an archive outside the index and keep as required
Drafts and working filesNoKeep in a separate drafts area outside the scope
Duplicate copies in personal foldersNoRemove the copies once the master version is confirmed
Forms and templatesYesKeep the current blank version only
HR, payroll and staff filesNoExclude, and review permissions separately
Financial and tax recordsNoExclude, and keep for the required retention period
Customer job filesLater, if neededAdd deliberately with permissions checked

Practical checklist

  • Each pilot question has a source document that its owner has confirmed is current.
  • Superseded and draft versions of those documents have been moved out of the index scope.
  • Nothing has been deleted that tax, employment or industry rules require you to keep.
  • Every document in scope has an owner, a status and a review date.
  • HR, payroll and personal folders are excluded from the first scope.
  • Document titles in scope use the words staff use when they ask.

Common questions

Do we need to rename every file?

No. Rename the documents in the first scope where the title gives no clue to the content, such as a form number on its own. AI search reads the text inside files, so a poor title matters less than it did for keyword search, but a clear title still helps staff recognise the right source when it is cited.

Can AI search work out which version is current?

Only if something tells it. Retrieval ranks passages by how closely they match the question, and an old document on exactly the right topic can outrank a newer one. A status field or a separate archive gives the system a rule to follow. Without one, it may quote whichever version matches best.

How long does the tidy-up take?

It depends on how many documents sit behind your first questions and how quickly owners can confirm the current versions. Scoped to the pilot questions, it stays manageable. For a supplier-led project, timing is confirmed in your written quote, and the free 30-minute consultation can help size the job.

What about files in Google Drive?

The same principles apply. Put current documents in shared drives owned by the organisation, keep an archive drive outside the search scope, and record owners and review dates in the file name or a register. The Google Drive guide covers the connector requirements and the text limits that apply to Drive search.

Should we fix the folder structure first?

Only where it gets in the way of the pilot questions. AI search reads the text inside files, so it does not need a perfect folder tree. It does need to know which folders are in scope and which are archives. A clear split between current, draft and archive areas is the part of the structure that changes the answers staff get.

Sources and further reading

Continue planning

Plan a useful knowledge-search pilot

Describe the documents your staff use, the questions they need answered and how uncertainty should be reviewed. We can discuss preparation and a bounded pilot. Keep source documents, customer records and confidential information out of this enquiry.