Write your own mystery shop scenarios (and share them with the network)

Modified on Sat, 11 Jul at 10:30 AM

The built-in mystery shop scenarios cover the common cases, but nobody knows your shop's tricky calls like you do. You can write your own scenarios - the birthday caller who never knows the budget, the corporate account that always asks for an invoice - and test Riley against exactly those. If a scenario turns out great, you can share it with the whole BloomLine network.

Create a scenario

  1. Go to Shop > Mystery shop (/dashboard/shop/mystery-shop) and open the create scenario form.
  2. Fill in the fields:
    • Name: a short handle you'll recognize in the picker, like "Sympathy caller, no budget in mind".
    • Description: what this scenario is testing and why.
    • Category and Tags: keep your scenario list organized and filterable as it grows.
    • Expected gambits: the sales plays Riley should fire during this call. Grading checks whether the right plays actually showed up.
    • Tester opening lines: up to 8 opening lines the AI tester can start the call with. Writing several variations keeps runs realistic - Riley shouldn't just learn one script.
  3. Click Save scenario. It now appears in your scenario picker under the Your scenario source filter.

The Mystery shop page where scenarios are created and picked, with the source filter showing Your scenario

Tips for scenarios that actually catch problems

  • Base them on real calls. Browse your Calls list for a call that went sideways, then write a scenario that recreates it. Re-run it after every fix until it passes.
  • Vary the opening lines. Use all 8 slots when you can: different phrasings, different levels of caller certainty, different moods.
  • Be specific in Expected gambits. If the scenario is a wedding inquiry, list the wedding consult plays you expect. A pass means the right plays fired, not just that the call was polite.
  • One situation per scenario. A scenario that tries to test five things at once gives you a score you can't act on.

Edit an existing scenario

Open the scenario from the Mystery shop page and edit any field - name, description, category, tags, expected gambits, or the tester opening lines - then save. Your next run uses the updated version.

Share a scenario with the network

Wrote a scenario other florists would benefit from? You can share it to the BloomLine network. Shared scenarios go through an approval review by the BloomLine team first. Once approved, your scenario appears for every shop under the Shared by network source filter in their scenario picker. It works the other way too: check that filter yourself to run scenarios contributed by other shops - it's a free library of test calls you didn't have to write.

Still stuck? Submit a ticket from this help center and we'll take it from there.

Was this article helpful?

That’s Great!

Thank you for your feedback

Sorry! We couldn't be helpful

Thank you for your feedback

Let us know how can we improve this article!

Select at least one of the reasons
CAPTCHA verification is required.

Feedback sent

We appreciate your effort and will try to fix the article