Prefer the Reactome tool that needs no installation - #222
Merged
Merged
Conversation
Asked "can you run gsea for me", beta answered with ReactomeFIViz -- the
Cytoscape plugin -- and gave steps for installing Cytoscape. ReactomeGSA is a
web tool at reactome.org/gsa that needs nothing installed, and is what someone
asking that question wants.
Not a retrieval failure. The top four passages were the ReactomeGSA page:
1. [analysis/gsa] 2. [analysis/gsa] 3. [analysis/gsa]
4. [analysis/gsa] 5. [reactome-fiviz]
The FIViz page arrives fifth because the rephrase expands "gsea" into "Gene Set
Enrichment Analysis (GSEA)", and that page carries a "Perform GSEA Analysis"
menu item. The model then led with it, because the prompt asks for clear
actionable steps and FIViz has by far the most step-by-step text.
That is the general trap, and the prompt now names it: the most detailed
instructions are usually for the most involved tool. Where several Reactome
tools do the same job, lead with the one needing least setup -- web before
desktop application, plugin or R package -- and offer the rest as alternatives.
Both phrasings now lead with ReactomeGSA and say it needs no installation.
Checked that this did not simply bury FIViz: asked for by name, or asked about
Cytoscape, it still answers with FIViz and its install steps.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Contributor
Author
Checked for over-correctionThe risk with this change is that it trades one wrong answer for another: pushing ReactomeGSA at someone who genuinely wants the Cytoscape plugin. I ran six questions against the branch — three where the least-setup rule should lead with ReactomeGSA, three where ReactomeFIViz is the honest answer.
6/6. The three FIViz questions are answered with FIViz and are not deflected to the web tool — the rule is scoped to "when several tools can do the same job" and stays out of the way when they cannot. That direction is guarded permanently by the expectation in #223: "Preferring the web tool must not bury the plugin for someone who wants it." 🤖 Generated with Claude Code |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Asked "can you run gsea for me", beta answered with ReactomeFIViz — the Cytoscape plugin — and gave steps for installing Cytoscape. ReactomeGSA is a web tool at
reactome.org/gsathat needs nothing installed, and is what someone asking that question wants.Not a retrieval failure
The top four passages were the ReactomeGSA page:
The FIViz page arrives fifth because the rephrase expands "gsea" into "Gene Set Enrichment Analysis (GSEA)", and that page carries a "Perform GSEA Analysis" menu item.
The model then led with it — because the prompt asks for "clear, actionable steps" and FIViz has by far the most step-by-step text.
The general trap, now named in the prompt
The most detailed instructions are usually for the most involved tool, which is rarely what someone asking "can you run this for me" wants.
Where several Reactome tools do the same job: lead with the one needing least setup — web before desktop application, plugin, or R package — and offer the rest as alternatives.
Verified both ways
Leads with ReactomeGSA now:
And FIViz isn't buried — asked for by name, or asked about Cytoscape, it still answers with FIViz and its install steps:
One test pins the prompt wording, including the named trap, so a later edit can't quietly reintroduce it.
🤖 Generated with Claude Code