> For the complete documentation index, see [llms.txt](https://communityone.gitbook.io/communityone/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://communityone.gitbook.io/communityone/feature-deepdive/sparkai/spark-knowledge.md).

# Spark Knowledge

{% hint style="info" %}
**Click** [**here**](https://discord.com/oauth2/authorize?client_id=1069423090225918082\&permissions=275146722545\&integration_type=0\&scope=applications.commands+bot\&redirect_uri=https%3A%2F%2Fcommunityone.io%2Fdashboard%2Fbot-auth-complete%2F%3Fsource%3Dgitbook\&response_type=code) **to introduce our bot to your server.**
{% endhint %}

### Go to [our dashboard ](https://communityone.io/dashboard)and click on the SparkAI Chat tab to get started

If you're unsure about setting up our bot, feel free to ask @communityone on Discord for guidance. Our bot is knowledgeable about its own features and can answer related questions directly. No need to provide any knowledge documents; you can see our bot in action right away!"

Spark setup consists of two parts: the Knowledge Center and Agents.

<figure><img src="/files/D2NK1YEVn8g7yUxx0okS" alt=""><figcaption></figcaption></figure>

1. Knowledge Center: where you can set up everything related to your community knowledge. This includes .txt files and other third-party integrations such as Gitbook.&#x20;
2. Agents: This is where you configure how Spark should behave, including custom instructions, conversation styles, and safety and compliance settings.&#x20;

### Knowledge Center

When you click on "Add Knowledge" button, here are the two options that you have: .txt doc and gitbook integration. We will be adding GitHub and Notion very soon. Check out our Discord for the latest update.&#x20;

<figure><img src="/files/4DCA65eEzyK5gncNZ6eG" alt=""><figcaption></figcaption></figure>

### Manual Upload

<figure><img src="/files/6a18DmNUiELhoVCSqCdO" alt=""><figcaption></figcaption></figure>

You can upload a .txt file up to 5 MB. In addition, you have the option to add an expiration date. This is useful if you have some seasonal promotions and want our Spark to remember these details until the event is over.&#x20;

If you want to make any changes to your .txt file, simply download a copy, edit, and reupload it.&#x20;

If you are on our free tier, you can upload two text files up to 5 MB each. There is no limit for premium packages.&#x20;

### Third Party Integration

Currently, we support Gitbook, GitHub repository, and Notion integration.<img src="/files/yZQ5Rxgx3BAI2jPCSmIv" alt="" data-size="original">

### Git Integration

We ask for the following inputs for GitBook integration:&#x20;

<figure><img src="/files/GOZeqIpCTGLt4qIcVIWQ" alt=""><figcaption></figcaption></figure>

1. **Base URL**: This is for our bot to be able to refer to your GitBook if users have any questions.  For example, the base URL for our GitBook is <https://communityone.gitbook.io/communityone>
2. **API Token:** To get your API token, go to the [Developer settings](https://app.gitbook.com/account/developer) of your GitBook user account and create a new token if this is your first time requesting one.
3. **Space ID**: The Space ID is a unique identifier of a Space in GitBook. You can find the space ID in the URL of any space you're in. For example, in this url: <https://app.gitbook.com/o/6DshSpVsoE/s/I6OHwf4UHU/>, your space id is "I6OHwf4UHU".

If you are using one of our premium packages, you can resync your Gitbook anytime by pressing the "Re-Sync" button.&#x20;

<figure><img src="/files/T8qwFQpGUm0QWqAy5VF5" alt=""><figcaption></figcaption></figure>

While there are alternative market solutions that can download your GitBook content without requiring a token input, we notice that most of them are highly unreliable. Under the hood, we are using Llamaindex to handle all the content reading.&#x20;

### GitHub Integration

Here's a list of input for Spark to be integrated with GitHub: GitHub Token, Repository Owner, Repository Name.

<figure><img src="/files/wYACUwETgeyTs4RhQ6Ne" alt=""><figcaption></figcaption></figure>

* Github Token: Get your personal or company's fine-grained personal access token here: <https://github.com/settings/personal-access-tokens/new>

<figure><img src="/files/dsdeu5CKzBOZnINL3BzD" alt=""><figcaption></figcaption></figure>

If an organization owns your Repo, you can switch the resource owner as listed below.

<figure><img src="/files/PCtxBPVp2Mgj8zIrFgch" alt=""><figcaption></figcaption></figure>

Select what access this token will have, and then click on "Generate Token".

<figure><img src="/files/6tD7CtFnsNcAZHhrEPfw" alt=""><figcaption></figcaption></figure>

You can find the Repository owner and name in the upper left corner of your repo.&#x20;

<figure><img src="/files/ZurMjybMmD9XcqJNa1cX" alt=""><figcaption></figcaption></figure>

### Notion Integration

For Notion Integration, we need your token for secure access.

<figure><img src="/files/bxReii5kQFxvhwztVZrh" alt=""><figcaption></figcaption></figure>

You can generate your Notion token here: <https://www.notion.so/profile/integrations>

<figure><img src="/files/G21dJKE1l6cUppNXDCYd" alt=""><figcaption></figcaption></figure>

Ensure that the newly generated tokens have access to the documents you'd like us to integrate.  You can edit each token's access by clicking on each token ⇒ Access ⇒ Edit Access.

<figure><img src="/files/9Oj8dYfcvDwfcJpjmzRy" alt=""><figcaption></figcaption></figure>

<figure><img src="/files/Eh3Qhs8fcw2l5IRpy8xU" alt=""><figcaption></figcaption></figure>

## Keep Your Bot Up to Date

You can schedule automatic updates to keep Spark in sync with your latest documentation. This feature is currently available for the following integrations:

* **YouTube Channels** — We automatically download transcripts for the public videos in your channel. Please note that private and unlisted videos are not updated by default.
* **Website Integration** — We automatically refresh your website content. If you're using **deep crawl mode**, we'll also discover newly added webpages and import their content automatically.
* **GitBook / GitHub Integration** — We automatically download all new content and pages that belong to the same workspace.

### Enabling Auto-Sync

To check whether a specific integration supports auto-sync:

1. Open the corresponding **knowledge modal**.
2. Scroll down until you find the **Auto-Refresh Schedule** section.
3. Choose your preferred update frequency — we support **weekly** or **monthly** automatic updates.

You'll receive a notification on your email or Discord notification channel each time an update is completed.

<figure><img src="/files/EinLjsvqcWeaGUloK8SC" alt=""><figcaption></figcaption></figure>

## Discord Knowledge Discovery

Discord Knowledge Discovery automatically syncs your Discord messages with Spark so that you never have to answer the same questions twice.&#x20;

<figure><img src="/files/BCsxJxN3Wy3yFjNhyuoB" alt=""><figcaption></figcaption></figure>

How does it work?

Spark helps streamline your community interactions by passively listening to specified conversations on your Discord. Once you designate the person and channels Spark should monitor, it syncs only the relevant topic-based knowledge.

* **Knowledge Prioritization**: When users ask questions, Spark prioritizes the information from your knowledge documents over past Discord messages, ensuring high-quality responses.
* **API Provider**: Spark relies on Google Gemini (Enterprise) for its API services. Your data is not trained by Gemini, nor CommunityOne, in any shape or form.
* **Manage knowledge:** You can manage and edit all knowledge bits that we collect directly via your Spark dashboard. \
  \
  To start, click on **+ Add Knowledge** and click on **Discord Knowledge Discovery**:<br>

<figure><img src="/files/V6X52vJEBgJI0Bhkj4d0" alt="" width="371"><figcaption></figcaption></figure>

Here are the setups:

<figure><img src="/files/XUiSJDbNvzZR4yXPtVln" alt="" width="375"><figcaption></figcaption></figure>

* Where should we update the knowledge from: the channels that you want us to listen to the messages
* Who should we include? Users that Spark should consider for knowledge syncing. We recommend adding only users who can be viewed as a "truth of source", such as the core team (as opposed to part-time moderators).&#x20;
  * Your members will need to give us EXPLICIT APPROVAL before we start to sync their chat messages. You need to copy the consent link and pass it to the user.&#x20;

<figure><img src="/files/XhmDiqLSkDWyHFJmzxNr" alt="" width="375"><figcaption></figcaption></figure>

* What topics should we focus on?

To ensure quality in your knowledge docs, Spark only syncs chat messages related to specified topics. Clearly define these topics to maintain high data quality, which enhances AI performance. For example, messages about "visiting Iceland" might be ignored if your server is focused on community management. Provide as many relevant keywords as possible to help Spark identify significant topics. If topics are unique to your server, ensure there are existing documents for Spark to understand them better.

<figure><img src="/files/mHVnPm6GpBI3bhhPUNHS" alt=""><figcaption></figcaption></figure>

When you click on **Start Discovery Process,** You can check the current status and your quotes here:

<figure><img src="/files/qmeDFhhToekiLiVcsqGQ" alt="" width="563"><figcaption></figcaption></figure>

### Retroactive Discovery Plan

Depending on whether you have a free or premium tier, different parameters apply for message look-up limits, maximum message count, and retroactive look-back opportunities. For premium tiers, the retroactive discovery plan limit resets monthly. However, for free users, the limit is cumulative, so double-check your setup before scheduling a scan. Once a "scan past messages" for Discord Knowledge Discovery is scheduled, it cannot be canceled.

If you exhaust your free limit, you can manually manage your knowledge bits directly via the dashboard. Your knowledge bit synchronization will continue as usual going forward.

### Discord Knowledge Discovery limits

You have different limitations for Discord Knowledge Discovery depending on your tiers:

* For the free tier: Get 50 messages checked daily, store up to 100 knowledge bits, and enjoy a retroactive look-up period of 1 month or up to 1500 messages. Plus, you can collect Discord knowledge retroactively up to 3 times.
* For Spark Tier ($14.99/month): Get 300 messages checked daily, store up to 1500 knowledge bits, and enjoy a retroactive look-up period of 3 months or up to 10000 messages. Plus, you can collect Discord knowledge retroactively up to 3 times per month.
* For all other tiers: Get 500 messages checked daily, store up to 3000 knowledge bits, and enjoy a retroactive look-up period of 6 months or up to 15000 messages. Plus, you can collect Discord knowledge retroactively up to 6 times per month.

### Your Data

Your data is not used for any AI training in any shape or form.

{% hint style="info" %}
Join [Discord](https://discord.gg/nVqt3z78Mw) for questions, comments, and a little gift <img src="https://fonts.gstatic.com/s/e/notoemoji/latest/1f381/512.gif" alt="🎁" data-size="line"> or back to [CommunityOne Home](https://communityone.io/)
{% endhint %}
