Skip to main content

🧠 AI Leaderboard

The AI Leaderboard ranks members by the quality of what they say, not how much they say. The agent scores every message for relevance to your knowledge base and publishes a leaderboard of the most helpful contributors — a counterpart to the volume-driven XP leaderboard.

Overview​

When configured, the agent can:

  • Score each member's messages with AI relevancy against your knowledge base
  • Rank members with a scoring formula that rewards consistent quality or pure volume of quality
  • Limit scoring to a time period and to the channels you choose
  • Exempt roles and specific members from scoring
  • Show the resulting top 20 in the webapp and in Discord via /ai-leaderboard
A knowledge base is required

The AI Leaderboard ranks members by how relevant their messages are to your knowledge base. Add a document in 📚 Knowledge Base first — until then it can't be enabled. The page shows this warning and keeps the enable toggle disabled while no knowledge base document exists.

Configuration​

To configure the AI Leaderboard:

  1. Open your project in the Fren One webapp.
  2. Select the Discord server you want to configure.
  3. In the sidebar under Agent Configuration, select Gamification, then the AI Leaderboard tab.
  4. Toggle "Rank members by AI-judged message quality" on.

Scoring​

Controls how individual message scores combine into a ranking, and which messages qualify for scoring at all.

OptionDescription
Scoring FormulaQuality × Log(Quantity) (default) rewards consistent quality with diminishing returns on volume. Sum of Relevancy totals helpful contributions — pure volume of quality.
Time PeriodOnly messages inside this window count toward the leaderboard. All Time (default), Last 7 Days, Last 30 Days, or Last 90 Days.
Min Message LengthMinimum characters for a message to be scored. Default: 10.
Min Word CountMinimum words for a message to be scored. Default: 3. Set to 0 to disable the word minimum.
Show relevancy scoresWhether the leaderboard displays each member's score. Default: on.

Channels​

Decide which channels count toward scoring.

OptionDescription
Tracked ChannelsAll channels (default) or Only selected channels.
Channels to TrackShown for "Only selected channels" — pick at least one channel to score.
Excluded ChannelsShown for "All channels" — messages in these channels are never scored.

Exemptions​

Keep certain people off the leaderboard entirely.

OptionDescription
Exempt RolesMembers with any of these roles are never scored.
Exempt MembersExcluded by member ID. Enable Developer Mode in Discord to copy IDs.

Leaderboard​

Below the settings, a read-only leaderboard shows the top 20 members by AI score — rank, member, message count, and score.

How it works in Discord​

Once enabled, the agent scores every qualifying message from 0 to 1 for relevance to your knowledge base. Scoring runs as a background task, so rankings update shortly after messages are posted rather than instantly. The AI Leaderboard is entirely distinct from XP — a member can top one without appearing on the other.

Members view the ranking in Discord with /ai-leaderboard.

Saving your changes​

This page uses a batched save — edits stay local until you select Save in the bar that appears at the bottom of the page. Leaving the page with unsaved changes shows a warning first.

Best practices​

Getting meaningful rankings
  • Invest in your knowledge base first — scores measure relevance to it, so a thin knowledge base produces noisy rankings.
  • Keep the default Quality × Log(Quantity) formula unless you specifically want to reward sheer output of good messages.
  • Exclude off-topic channels (memes, voice chat text) so casual conversation doesn't dilute scores.
  • Exempt admin and helper roles if you want the leaderboard to spotlight regular members.
Troubleshooting

The enable toggle is disabled?

  • The AI Leaderboard requires at least one document in the 📚 Knowledge Base. Add one, then return to this page.

Messages don't seem to be scored?

  • Very short messages are skipped — check Min Message Length (default 10 characters) and Min Word Count (default 3 words).
  • Confirm the message's channel is tracked and not in Excluded Channels.
  • Check the author isn't covered by Exempt Roles or Exempt Members.

A member's rank doesn't match their XP?

  • That's by design — the AI Leaderboard measures message quality and is separate from the XP system.

On this page