Oklahoma Data Partners
Data Consulting

Your Website Chatbot Speaks for Your Company. Is It Reading the Right Files?

Customer chatbots are easy to switch on now. They read your website and documents and answer questions all day. The trouble is that a bot only knows what it is given, and many companies feed it files that are outdated, conflicting or never meant for customers.

Don KarlosOctober 29, 20267 min read
A customer support agent wearing a headset speaks with a caller while working at a laptop.

The helper on your website now talks back

For years the chat box on a company website was a form that sent a message to someone's inbox. Today it can answer on its own. Tools from Azure AI, AWS AI and Google AI make it simple to point a chatbot at your website and files and let it reply to customers right away.

That is useful. It also means a piece of software is now explaining your prices, your return rules and your service terms to customers, around the clock, in your company's name. What it says depends on what it reads.

What the evidence says

In February 2024 the Civil Resolution Tribunal of British Columbia decided Moffatt v. Air Canada. After a grandparent died, a customer named Jake Moffatt asked the airline's website chatbot about bereavement fares. The bot said the reduced fare could be claimed after booking, within 90 days of the ticket being issued. Air Canada's own bereavement page said the policy did not apply once travel was complete. When Moffatt applied, the airline refused.

Air Canada argued that the chatbot was a separate legal entity responsible for its own actions. The tribunal member called that a remarkable submission. The decision says the chatbot is still just a part of Air Canada's website and that the airline is responsible for all the information on its website, whether it comes from a static page or a chatbot. It added that a customer should not have to double check one part of a website against another. Air Canada was ordered to pay $812.02 in damages, interest and fees.

In March 2024 The Markup reported on the MyCity chatbot launched by New York City to help business owners. The city said it would draw on more than 2,000 NYC Business web pages, and it ran on Azure AI services. The Markup found it told users that bosses could take workers' tips, that landlords did not have to accept housing vouchers and that restaurants could go cash free. All three answers were wrong under city law. When ten Markup staffers asked the same housing question, all ten got the wrong answer. The bot carried a small note that it may occasionally produce incorrect, harmful or biased content.

The National Institute of Standards and Technology names this risk in its guidance on generative AI, NIST AI 600 1. It calls it confabulation, which it defines as the production of confidently stated but erroneous or false content.

Why chatbots give customers the wrong answer

Old and new versions sit side by side

Most companies have three versions of the return policy floating around. The current page, last year's PDF and a sales sheet from a promotion that ended. A bot that reads all three may pick the wrong one.

Internal files get mixed in

When a bot is pointed at a whole shared drive, it can read draft pricing, staff notes and exception rules meant for managers. Customers then hear terms that were never offered to them.

Nobody owns the source material

Policies change when a manager sends an email. The website gets updated weeks later, if at all. The chatbot keeps reading whatever is there.

A disclaimer will not carry the weight

Air Canada had the right policy on its own website and still lost. A note telling customers to double check the bot does not fix wrong answers. The tribunal said customers should not have to check one part of a site against another.

How to get your documents ready before the bot goes live

  1. 1Decide exactly which pages and files the chatbot may read and keep internal drives out of reach.
  2. 2Gather every version of your prices, return rules, warranties and service terms and keep only the current one.
  3. 3Give each customer facing policy a named owner and a review date.
  4. 4Make sure the website and the bot read from the same source so a change in one shows up in both.
  5. 5Write down the questions customers ask most and test the bot against them before launch and after every policy change.
  6. 6Set clear topics the bot should hand to a person, such as refunds, legal terms and anything about money owed.
  7. 7Keep a log of bot conversations and review a sample every month for wrong answers.

This work pays off even without a chatbot. Clean, current documents help your staff give the same answer every time, and they make your website easier to trust.

What this means if you run a company in Oklahoma

Oklahoma companies of every size are being offered chatbots by their website host, their phone system or their software vendor. Many can be switched on in an afternoon. The documents behind them usually cannot be cleaned up that fast.

A bank, a clinic, a utility contractor or a retailer that launches a bot on messy files is taking on risk it may not see until a customer screenshots a wrong answer. Doing the document work first is cheaper than explaining a mistake later.

At Oklahoma Data Partners, we help Oklahoma companies sort out which documents are current, give each one an owner and set up a single trusted source that a website and a chatbot can both read. If you are thinking about putting a chatbot in front of customers, book a consultation.

Key takeaway

A website chatbot speaks for your company, and a tribunal held Air Canada to its bot's wrong answer. Limit what the bot reads, remove outdated versions, give every policy an owner and test the bot before customers rely on it.

Frequently asked questions

Ready to get started?

Planning a customer chatbot? Book a consultation with Oklahoma Data Partners to clean up the documents it will read before it starts answering for you.

Share this article:Share on XShare on LinkedIn

Don Karlos

Founder, Oklahoma Data Partners

Don Karlos is a senior data engineer and database specialist who founded Oklahoma Data Partners to give Oklahoma organizations one partner for understanding their data (analytics, dashboards, data engineering) and for hiring the data people behind it. Oklahoma Data Partners is an Oklahoma-based, data-only firm with two equal pillars: data consulting and data talent recruiting. We help organizations stabilize critical databases, build reliable data pipelines, design scalable data architecture, and turn raw information into trusted business intelligence — and we help Oklahoma companies hire the permanent data professionals who keep those systems running.

About Oklahoma Data Partners

Data consulting & data talent recruiting · Clean. Structured. Reliable.

Follow Oklahoma Data Partners

Follow Oklahoma Data Partners on X and LinkedIn for practical data insights, SQL tips, analytics best practices, and database consulting guidance.

Data insights, occasionally

Practical notes on database health, data pipelines, and analytics — sent only when we have something genuinely useful to share. No noise.