Novus Documentation
← Documentation
Channel Configuration Overview

#6-Testing Channel Configuration

Learn how to test your Novus AI Channel Configuration, verify automatic and mention-only responses, check Discord permissions, and make sure the assistant responds only in the channels where it should operate.

Testing Channel Configuration

After configuring your AI-enabled channels, Response Modes, Discord permissions, threads, and ticket behavior, you should test the complete Channel Configuration inside Discord.

Testing helps confirm that Novus AI responds where it should, when it should, and remains silent where AI interaction is not intended.

Why Test Channel Configuration?

A channel may appear correctly configured in the Novus AI dashboard while a Discord permission, category override, or Response Mode prevents the expected behavior.

Testing can help identify:

  • Incorrect AI-enabled channels
  • Missing Discord permissions
  • Incorrect Response Modes
  • Mention-only problems
  • Unwanted automatic responses
  • Category permission conflicts
  • Thread access problems
  • Ticket channel permission problems
  • AI responding in unintended channels
  • AI not responding in configured channels

Testing the actual Discord experience is the best way to verify the complete configuration.

Create a Simple Test Plan

Before testing, identify the expected behavior of each configured channel.

For example:

#ai-support

Expected behavior: Automatic responses.

#general-chat

Expected behavior: Mention-only responses.

#announcements

Expected behavior: No AI interaction.

Support Tickets

Expected behavior: AI assistance according to the configured Ticket Profile.

Having an expected result makes it easier to recognize incorrect behavior.

Test Automatic Response Channels

Start with a channel configured for automatic AI responses.

Send a normal question without mentioning Novus AI.

For example:

Where can I find the server rules?

Novus AI should process the message according to your configured AI behavior.

Then try other questions such as:

  • "How do I register?"
  • "Where can I download?"
  • "Can you explain this feature?"
  • "My launcher isn't working."

The assistant should respond without requiring a direct mention.

Test Mention-Only Channels

Next, test a channel configured for mention-only responses.

First send:

Where can I find the rules?

If the channel requires a mention, Novus AI should not automatically respond to the message.

Then send:

@Novus AI Where can I find the rules?

Novus AI should now process the request.

This confirms that the mention requirement is working.

Test an Actual Discord Mention

Typing the bot's name is not necessarily the same as mentioning it.

For example:

Novus AI where are the rules?

may simply be normal text.

Use Discord's actual mention functionality:

@Novus AI where are the rules?

This ensures you are testing the correct behavior.

Test Normal Conversations

In shared community channels, send messages that are clearly not intended for Novus AI.

For example:

Anyone joining tonight?

Good game everyone.

I'll be online later.

Does anyone want to party?

If the channel uses mention-only behavior, Novus AI should not unnecessarily interrupt these conversations.

This is an important test for busy community channels.

Test Channels Where AI Is Disabled

Testing disabled channels is just as important as testing enabled channels.

Choose a channel where Novus AI should not normally provide AI responses.

Send a normal question.

For example:

How do I register?

Novus AI should respect your Channel Configuration and avoid providing a normal AI response there.

This confirms that AI interaction is limited to the intended channels.

Test Different AI Routes

Channel Configuration determines whether a message can be processed, but AI Routing determines how the concern should be handled.

Inside an enabled channel, test different types of questions.

For example:

General Support

"What are the community rules?"

Technical Support

"My launcher keeps crashing."

Account Support

"I forgot my password."

Payment Support

"What payment methods are available?"

Verify that the channel accepts the messages and that the appropriate AI behavior is applied afterward.

Test Knowledge Base Responses

Ask questions that should have known answers in your Knowledge Base.

Verify that Novus AI:

  • Uses the correct information
  • Preserves important values
  • Provides the appropriate links
  • Follows conditions and restrictions
  • Does not invent unsupported information

If the bot responds but the answer is incorrect, the problem may not be Channel Configuration.

Review the Knowledge Base, AI Routing, or AI Instructions instead.

Test Missing Knowledge

Ask a community-specific question for which no verified information exists.

Verify that Novus AI follows your configured fallback behavior instead of inventing an answer.

This also confirms that the complete flow works after the message passes through Channel Configuration.

Test Discord Permissions

For every important AI-enabled channel, verify that Novus AI has the permissions required for its configured behavior.

Check:

  • View Channel
  • Send Messages
  • Read Message History

Also check any additional permissions required by the features you use.

Test Category Permissions

If several support channels belong to the same Discord category, test more than one of them.

A category may contain:

SUPPORT

  • #general-support
  • #technical-support
  • #payment-support

One channel may have a custom permission override even if the others inherit the category permissions.

Testing multiple channels can reveal these differences.

Test Private Channels

If Novus AI is intentionally configured in a private support channel, test access from the perspective of the members who are supposed to use it.

Verify that:

  1. The member can access the channel.
  2. Novus AI can access the channel.
  3. The member can send the support question.
  4. Novus AI can respond.
  5. Unauthorized members remain restricted according to your Discord permissions.

Novus AI should not require broader server access simply to operate in one private support area.

Test Threads

If you use Discord threads for support, create or use a test thread.

Verify that Novus AI can:

  • Access the thread
  • Read relevant messages
  • Send responses
  • Follow the configured Response Mode
  • Maintain useful conversation context
  • Apply the correct AI Route

If the bot works in the parent channel but not inside the thread, review your Discord thread permissions.

Test Ticket Channels

If Novus AI is configured to assist inside support tickets, create a test ticket using the same process your members use.

Do not rely only on manually created test channels because dynamically created ticket channels may use different permissions.

Verify that:

  • The ticket is created successfully.
  • Novus AI can access it.
  • The member can communicate with the AI.
  • AI Routing works.
  • Knowledge Base information is available.
  • Follow-up questions work.
  • Staff can participate when necessary.
  • Escalation behavior works.
  • Closing behavior works according to the Ticket Profile.

Test AI and Staff Interaction

If staff members and Novus AI share support channels or tickets, test what happens when a staff member begins assisting.

The support conversation should remain understandable.

Verify that Novus AI does not unnecessarily compete with staff or repeatedly respond when human support is already handling the concern according to your configuration.

Test Follow-Up Questions

Start a normal AI conversation.

For example:

Member:
My launcher won't open.

After Novus AI responds:

Member:
I already tried that.

Then:

Member:
What should I do next?

Verify that the conversation remains coherent when sufficient context is available.

This is particularly important for support channels and tickets.

Test Topic Changes

Members may change their concern during the same conversation.

For example:

Member:
My launcher isn't opening.

After troubleshooting:

Member:
Also, where can I see the available packages?

The second question should be handled according to its new intent.

Channel Configuration should continue allowing the conversation while AI Routing determines the appropriate handling.

Test With a Normal Member Account

Whenever possible, test your configuration from a normal member perspective.

Server owners and administrators may have permissions that bypass restrictions experienced by normal members.

Testing as a normal member can reveal problems involving:

  • Channel visibility
  • Private support access
  • Mentions
  • Thread access
  • Ticket permissions
  • Role restrictions

This gives you a more accurate picture of the real member experience.

Test After Moving a Channel

If you move an AI-enabled channel to another Discord category, test it again.

The channel may inherit new category permissions.

A channel that previously worked correctly may stop working after being moved.

Verify both Discord permissions and Novus AI behavior after reorganizing your server.

Test After Changing Permissions

Whenever you make significant changes to the Novus AI role or Discord channel permissions, run a quick test.

Verify at minimum:

  1. Novus AI can access an enabled channel.
  2. It can send a response.
  3. Mention-only behavior still works where configured.
  4. Disabled channels remain unaffected.

This can catch permission problems before members encounter them.

If Novus AI Does Not Respond

If Novus AI does not respond in an enabled channel, check the problem in order.

1. Channel Configuration

Confirm that the correct channel is enabled.

2. Response Mode

Check whether a mention is required.

3. Discord Permissions

Verify that Novus AI can view and send messages in the channel.

4. Category Permissions

Check whether the parent category is restricting the bot.

5. Thread or Ticket Permissions

If applicable, verify access to dynamically created conversations.

6. AI Configuration

Confirm that your AI provider and model configuration are functioning.

Checking the system in this order can make troubleshooting easier.

If Novus AI Responds in the Wrong Channel

If Novus AI responds somewhere it should not, verify:

  1. Whether the channel is currently AI-enabled.
  2. Whether it was accidentally added to the configuration.
  3. Whether the message came from a thread associated with an enabled channel.
  4. Whether another enabled feature is responsible for the response.
  5. Whether the current configuration was saved correctly.

Do not immediately change your AI Instructions.

If the problem is where the bot responds, investigate Channel Configuration first.

If Novus AI Responds to Too Many Messages

If the assistant frequently interrupts normal conversations, review the Response Mode.

A shared community channel may be better configured as Mention-Only.

You may also consider moving normal AI support into a dedicated channel.

For example:

#ai-support

Automatic responses.

#general-chat

Mention-only responses.

This provides a clearer separation between AI assistance and normal conversation.

Channel Configuration Testing Checklist

Before considering your Channel Configuration ready, verify that:

  • Automatic-response channels work without mentions.
  • Mention-only channels require an actual mention.
  • Normal conversations do not trigger unwanted responses.
  • Disabled channels do not receive normal AI responses.
  • Novus AI has the necessary Discord permissions.
  • Category permissions are correct.
  • Private channels work only for intended members.
  • Threads work when enabled.
  • Ticket channels work when configured.
  • AI Routing still selects the appropriate behavior.
  • Knowledge Base information remains available.
  • Follow-up conversations work correctly.
  • Staff interaction behaves as expected.
  • Channel changes do not break AI access.

Retest as Your Discord Server Changes

Channel Configuration should be reviewed whenever you significantly reorganize your Discord server.

Retest after:

  • Creating new support channels
  • Removing channels
  • Moving channels
  • Changing categories
  • Changing role permissions
  • Changing Response Modes
  • Modifying ticket configurations
  • Changing thread usage

Regular testing helps keep Novus AI aligned with your Discord server.

Channel Configuration Complete

You now understand how to:

  • Add AI-enabled channels
  • Configure automatic and mention-only responses
  • Manage Discord permissions
  • Update and remove AI Channels
  • Use Novus AI with threads and tickets
  • Test the complete Channel Configuration

Your Discord server can now control where and when Novus AI is allowed to provide AI assistance.

Next Step

With the core AI channels configured, the next major area is controlling how Novus AI handles support tickets from creation through resolution, escalation, closing, and AI-assisted ticket management.

Continue to the Ticket System documentation.