Skip to content

Business knowledge preparation guide · By Yes AI

Microsoft 365 Copilot or a custom knowledge search?

Published 6 min read

Most Australian businesses that ask about AI search over their policies already pay for Microsoft 365, so the first question is whether Microsoft's own Copilot covers the need. Microsoft now calls the product Microsoft Copilot, and the older Microsoft 365 Copilot name still appears in some licensing pages. This guide sets out what Copilot does with your SharePoint content and where a separately built knowledge search differs.

Quick answer

If your documents live in SharePoint and OneDrive, your permissions are tidy and staff want help across email, Teams and files, start by testing Microsoft Copilot. It answers only from content each user can already view. A custom knowledge search fits better when you need a narrow, approved document set, tighter refusal rules, a measured accuracy target, sources outside Microsoft 365, or control over which model and region processes the passages.

Operations manager and IT administrator comparing two laptop screens of search results in a Melbourne office meeting room
Compare both options on your own staff questions, using an ordinary staff account.

What does Microsoft Copilot do with your SharePoint files?

Microsoft Copilot connects a language model to content in Microsoft Graph, such as documents, emails, chats and meetings, and to the Microsoft 365 apps people already use. Microsoft states that Copilot only surfaces organisational data that the individual user has at least view permission for, and that prompts, responses and data accessed through Microsoft Graph are not used to train foundation models. In practice it answers across everything a person can open. That suits drafting and summarising. For policy lookups it is less predictable, because a draft in someone's OneDrive is as visible to that person as the approved procedure.

How is Copilot licensed for a small or mid-sized business?

Microsoft lists Copilot as included in Microsoft 365 E7 or as an add-on to eligible plans. For smaller organisations, Microsoft Copilot Business is an add-on for up to 300 users on eligible Microsoft 365 Business plans, with an annual commitment. Microsoft also offers pay-as-you-go billing for Copilot Chat and SharePoint agents, charged through an Azure subscription and disabled by default, which can suit occasional users. Microsoft notes that licensing availability and terms can change, so confirm the current eligibility and price with your reseller before you model costs.

Where does a custom knowledge search differ?

A custom build indexes a defined set of documents, such as the current policy library and approved manuals, and answers only from that set. You decide how documents are split into passages, whether keyword and vector search are combined, how many passages reach the model and when the system should say it cannot find an answer. You can test it against an agreed list of real questions before anyone relies on it. The price of that control is a build, an internal owner and ongoing maintenance that a Microsoft licence does not require.

  • Answer scope: only approved, current documents, instead of everything a user can open.
  • Refusal rules: a relevance threshold below which the system says the documents do not cover the question.
  • Model and region: a choice of model provider and hosting region, which matters for some client contracts.
  • Access: staff who do not need a full Microsoft Copilot licence can still be given an approved sign-in.

What about documents outside Microsoft 365?

Microsoft offers Copilot connectors that bring outside content into Copilot and Microsoft Search. Its documentation lists over 100 prebuilt connectors, including Google Drive, Box, Dropbox, Confluence, ServiceNow and network file shares, and says synced connectors respect source permissions, so users only see items they can access in the source system. If your knowledge sits in one of those systems, a connector may close the gap without a custom build. If it sits in a job management system with no connector, or in scanned files that need careful preparation, a custom pipeline gives you more control over what is read and how.

Where is the data processed?

Microsoft says Copilot calls to the language model are routed to the closest data centres in the region but can use other regions where capacity is available during busy periods, and that customers outside the EU may have queries processed in the US, the EU or other regions. Its data residency commitments for Copilot are set out in the Microsoft Product Terms. If a contract or client requires processing in Australia, ask Microsoft or your reseller in writing which commitments apply to your tenant. A custom build lets you choose a model and region, though an onshore-only rule can narrow the model choice.

How do you compare them fairly?

Run both against the same test. Collect at least 50 real staff questions with known answers and the document each answer should come from, then ask each option the same questions from an ordinary staff account. Record whether the answer was right, whether the citation pointed at the current document and whether it declined questions the documents do not cover. Include a few questions whose answers sit in restricted HR or finance folders to confirm nothing leaks. Choose the option that performs better on your own questions, whichever one that turns out to be.

Microsoft Copilot and a custom knowledge search compared

QuestionMicrosoft CopilotCustom knowledge search
Which content it answers fromAnything in Microsoft Graph the user can view, plus connected sourcesA defined, approved document set chosen for the use case
How permissions are handledUses Microsoft 365 permissions, so any oversharing in SharePoint carries throughMust be designed into retrieval, and also inherits any oversharing it indexes
How it is paid forPer-user add-on licence, or metered pay-as-you-go for Copilot Chat and SharePoint agentsBuild work, a search service, model usage and maintenance
Control over refusals and thresholdsSet through Microsoft's admin settings and any agents you configureSet and tuned against your own test questions
Model and processing regionDecided by Microsoft under its Product TermsChosen for the build, within what providers offer
Work it needs from youLicences, permission clean-up and staff trainingScoping, document preparation and an internal owner

Practical checklist

  • A permissions report has been run on every SharePoint site the tool will reach, and broad sharing has been fixed or excluded.
  • At least 50 real staff questions with known answers and source documents are written down before either option is tested.
  • Both options have been tested from an ordinary staff account, not an administrator account.
  • The licence or billing model, and its monthly cost for your actual user count, has been confirmed in writing.
  • The processing region for prompts and passages has been checked against any client or contract requirement.
  • A named person will own the tool after launch, whichever option is chosen.

Common questions

Does Copilot train on our documents?

Microsoft states that prompts, responses and data accessed through Microsoft Graph are not used to train the foundation models behind Copilot. Training is a separate question from what Copilot can show people. It can surface any content a user already has permission to view, so the practical risk inside your business is oversharing: files shared too widely become much easier to find.

Can we use both?

Yes. Some businesses license Copilot for office staff who work across email, Teams and documents, and use a narrower knowledge search for policy and procedure questions from field or front-line staff. Both can read the same SharePoint libraries. Keep one set of test questions so you can compare answers from each tool on the same questions.

Can staff without a Copilot licence query work files?

Microsoft offers pay-as-you-go billing for Copilot Chat, SharePoint agents and the Copilot Retrieval API, charged through an Azure subscription that an administrator links to a billing policy. Microsoft says this billing is disabled by default, can be applied to selected groups of users and can carry a spending budget. Check what your tenant has enabled before staff rely on it.

What if our files are a mess?

Copilot and a custom build both reflect the files they read. Superseded versions, duplicate procedures and drafts in shared folders will show up in answers from either. Tidy the documents behind your most common questions first, then test. The guide on tidying a shared drive covers which folders to include, archive or leave out.

Who should run the comparison?

Someone who fields staff questions today, such as an operations manager, working with whoever administers Microsoft 365. The first knows what a correct answer looks like. The second can run the permission reports and set up a test account with ordinary access. Run it on your own documents, because a demonstration on sample content shows little about how either option handles your files.

Sources and further reading

Continue planning

Plan a useful knowledge-search pilot

Describe the documents your staff use, the questions they need answered and how uncertainty should be reviewed. We can discuss preparation and a bounded pilot. Keep source documents, customer records and confidential information out of this enquiry.