Insights to Help You Grow, Automate, and Lead

+27 83 383 7832

How to Test an AI Workflow Before Automating |

How to Test an AI Workflow Before Automating | BizWithAI

November 10, 2026•6 min read

How to Test an AI Workflow Before You Automate It

You have found a task AI might help with. Perhaps it is researching prospects, sorting enquiries or preparing information for your team.

The next step can feel obvious: connect the tools and automate the process.

But there is a useful step before that.

Run the task manually with AI and check whether the finished result deserves a place in your business.

A small trial helps you discover what information is missing, which instructions need work and how much checking the output requires.

Here is a practical way to run one, using prospect research as an example.

1. Choose one result you can check

“Find us better prospects” sounds useful, but it leaves too much open to interpretation.

What makes somebody a better prospect? Location? Type of business? Services offered? Evidence of a particular need?

For a first trial, choose a narrower result:

Prepare a short research record for ten businesses, showing their location, relevant services and published enquiry route, with a source for each finding.

That gives you something concrete to review.

It also sets a boundary. You are collecting information for a person to assess. You are not yet asking AI to decide who needs your service or contact anybody.

Write down three things before opening the tool:

  • Input: The business website addresses you will supply.

  • Output: The research fields you want completed.

  • Finish: A checked record that another person can understand and use.

If you cannot describe the finish clearly, keep working on the task before automating it.

2. Decide which information matters and why

Every field creates work. Someone must find it, check it and keep it useful.

Choose fields that support an actual decision.

For our example:

Research field

Why it matters

What counts as evidence

Business location

Helps check geographic fit

An address on the business’s website

Relevant service

Helps check whether it belongs in your chosen market

A service description on its website

Published enquiry route

Shows how the business invites enquiries

A contact page, form or booking link

Source and date checked

Helps another person verify the finding

The exact page URL and your review date

Now consider a tempting extra field: “Needs better follow-up.”

Can a website establish that?

Usually, the information available will not be enough to draw that conclusion. A contact form tells you that a form exists. It does not tell you whether enquiries receive a response.

Separate what you can observe from what you still need to ask.

That distinction prevents a research record from becoming a collection of confident guesses.

3. Set the standard before seeing the output

A full-looking table can create a false sense of progress.

For this trial, a useful record should meet these conditions:

  • Each factual finding has a supporting source.

  • The source says what the finding claims it says.

  • Missing information is marked clearly.

  • Assumptions are kept separate from facts.

  • The record contains no invented contact details or claims about business problems.

An honest “Not found” can be a better result than a plausible answer.

It tells your team where further checking is needed.

Also decide what requires correction before a record can be used. An unsupported location or a source that does not support the claim should send that record back for review.

Do not hide an important error inside an overall score that looks acceptable.

4. Compare against your current method

Research a few businesses using your usual approach first.

Time the whole task:

  1. Open the website.

  2. Find the information.

  3. Record the findings.

  4. Add the sources.

  5. Check the completed record.

Then try the AI-assisted method on the same businesses.

Use the same fields and the same quality standard. Otherwise, you may be comparing a careful manual record with an incomplete AI version.

Here is a hypothetical example:

Method

Records checked

Total handling time

Usual manual method

10

80 minutes

AI-assisted method, including corrections

10

50 minutes

That suggests a potential saving of 30 minutes for that set.

But suppose you also spent an hour preparing the instructions and test log. The trial has taken more time overall.

That does not automatically make it unsuccessful. It means you have made an initial investment that needs to be considered alongside any future benefit.

These figures are illustrative. Your own timings will tell you whether the idea deserves more work.

5. Give AI a consistent instruction

Use one instruction across the first set of examples.

Here is a starting prompt you can adapt:

Research only the businesses and website addresses I provide.

For each business, return: business name, published location, relevant services, published enquiry route, source URLs and unresolved questions.

Use information from the business’s own website. For each factual finding, identify the page that supports it.

Write “Not found” when the information cannot be established. Do not guess contact details, internal processes, budgets, buying intent or business problems.

Keep observations separate from interpretations.

If you cannot access a page, say so. Do not imply that you reviewed it.

Do not contact anyone or submit any forms. Prepare the research for human review.

Choose a tool that can access the sources you need. If it cannot open websites, you can supply the relevant page text for a limited test, but record that extra collection work in your timing.

The prompt is a starting instruction. Check the results against the original pages.

6. Test where the process struggles

Straightforward examples are useful, but they will not show you every weakness.

Include businesses with:

  • More than one office.

  • An unclear service description.

  • Missing contact information.

  • Pages that cannot be accessed.

  • A similar name to another business.

Watch what happens when information is incomplete or ambiguous.

Does the tool flag the uncertainty? Does it choose an answer without enough evidence? Does the reviewer know what to check next?

If you change the instruction, save the revised version. Repeat the earlier examples, then try fresh ones.

Fresh examples help you check whether the improvement works beyond the cases you used to refine the prompt.

A small trial can reveal weaknesses. It cannot establish reliability across your entire market.

7. Keep a simple test log

You do not need a complicated dashboard.

A spreadsheet with these columns is enough to begin:

Column

What to record

Business reference

Which example was tested

Instruction version

Which prompt was used

Total handling time

Research, checking and corrections

Unsupported findings

Claims the sources did not establish

Missing information

What remained unresolved

Accepted after review?

Whether the record met your standard

Next action

Correct, investigate, accept or exclude

This log helps you diagnose the cause of poor results.

For example:

Accurate records, but little time saved: The task may need a simpler output or a different method.

Fast records with unsupported claims: Tighten the instructions and source checks before expanding.

Repeatedly missing information: The source may not contain what you need. Another tool cannot necessarily solve that gap.

Useful results with manageable checking: Try a larger, more varied sample while retaining human review.

Decide what deserves automation

Before connecting the process to live systems, answer four questions:

Does it meet the standard?
Can your team use the checked output for its intended purpose?

Does the whole job improve?
Include checking, corrections and

Tilly Davies

Tilly Davies

Tech Smart Marketer - a visionary with over 40 years of unparalleled experience in B2B Business Analysis, IT, Finance and digital marketing.

LinkedIn logo icon
Instagram logo icon
Youtube logo icon
Back to Blog
Comments
Be the first to comment
Comments
Be the first to comment