Install any skill in seconds. Free to start, no credit card required.
Get Started Free →brycewang-stanford/chatpaper-guide
Use ChatPaper to summarize and search arXiv papers with LLM assistance
Passed 22 of 23 test cases with the skill, and 14 of 23 without it.
and 6 more in the full report
8 fixed14 passed either way1 still failing0 broke
Tokens, turns and time describe resource use, not a dollar price.
One of 8 test cases the skill fixed. Same model, same prompt, with and without the skill.
I want to clone the official ChatPaper repository from GitHub onto my server to begin setting up the tool. What is the exact Git repository URL for ChatPaper?
| Checked | Without skill | With skill |
|---|---|---|
| Identifies https://github.com/kaixindelele/ChatPaper.git as the repository URL. | Missed | Passed |
The instructions your model reads when the skill loads.
ChatPaper is an open-source tool that leverages large language models to automatically summarize, search, and analyze academic papers from arXiv. It addresses a fundamental challenge in modern research: the overwhelming volume of new publications makes it nearly impossible for researchers to keep up with developments in their fields through manual reading alone.
The tool connects to the arXiv API to retrieve papers based on keyword queries, then uses LLM capabilities to generate structured summaries covering research motivation, methodology, key findings, and limitations. This enables researchers to rapidly triage large batches of papers and identify the most relevant ones for detailed study.
With over 19,000 GitHub stars, ChatPaper has become a widely adopted tool in the research community. It supports multiple LLM backends and offers both command-line and web-based interfaces, making it accessible to researchers with varying levels of technical expertise.
Clone the repository and install dependencies:
git clone https://github.com/kaixindelele/ChatPaper.git
cd ChatPaper
pip install -r requirements.txt
Configure your LLM API access by setting environment variables:
# For OpenAI API
export OPENAI_API_KEY=$OPENAI_API_KEY
# Optional: use a custom API endpoint
export OPENAI_BASE_URL=$OPENAI_BASE_URL
Alternatively, edit the configuration directly in the settings file to specify your preferred model and API parameters. The tool supports OpenAI models as well as compatible alternatives.
Verify the installation by running a test query:
python chat_paper.py --query "transformer attention mechanism" --max_results 3
test cases passed, vs 14 / 23 without
More skills from the same source and nearby in the registry, with their headline benchmark lift.