The built-in mystery shop scenarios cover the common cases, but nobody knows your shop's tricky calls like you do. You can write your own scenarios - the birthday caller who never knows the budget, the corporate account that always asks for an invoice - and test Riley against exactly those. If a scenario turns out great, you can share it with the whole BloomLine network.
Create a scenario
- Go to Shop > Mystery shop (/dashboard/shop/mystery-shop) and open the create scenario form.
- Fill in the fields:
- Name: a short handle you'll recognize in the picker, like "Sympathy caller, no budget in mind".
- Description: what this scenario is testing and why.
- Category and Tags: keep your scenario list organized and filterable as it grows.
- Expected gambits: the sales plays Riley should fire during this call. Grading checks whether the right plays actually showed up.
- Tester opening lines: up to 8 opening lines the AI tester can start the call with. Writing several variations keeps runs realistic - Riley shouldn't just learn one script.
- Click Save scenario. It now appears in your scenario picker under the Your scenario source filter.

Tips for scenarios that actually catch problems
- Base them on real calls. Browse your Calls list for a call that went sideways, then write a scenario that recreates it. Re-run it after every fix until it passes.
- Vary the opening lines. Use all 8 slots when you can: different phrasings, different levels of caller certainty, different moods.
- Be specific in Expected gambits. If the scenario is a wedding inquiry, list the wedding consult plays you expect. A pass means the right plays fired, not just that the call was polite.
- One situation per scenario. A scenario that tries to test five things at once gives you a score you can't act on.
Edit an existing scenario
Open the scenario from the Mystery shop page and edit any field - name, description, category, tags, expected gambits, or the tester opening lines - then save. Your next run uses the updated version.
Share a scenario with the network
Wrote a scenario other florists would benefit from? You can share it to the BloomLine network. Shared scenarios go through an approval review by the BloomLine team first. Once approved, your scenario appears for every shop under the Shared by network source filter in their scenario picker. It works the other way too: check that filter yourself to run scenarios contributed by other shops - it's a free library of test calls you didn't have to write.
Still stuck? Submit a ticket from this help center and we'll take it from there.
Was this article helpful?
That’s Great!
Thank you for your feedback
Sorry! We couldn't be helpful
Thank you for your feedback
Feedback sent
We appreciate your effort and will try to fix the article