Install any skill in seconds. Free to start, no credit card required.
Get Started Free →brycewang-stanford/rd-agent-guide
Microsoft AI-driven R&D agent for automated data and model development
Passed 21 of 23 test cases with the skill, and 6 of 23 without it.
and 29 more in the full report
15 fixed6 passed either way2 still failing0 broke
Tokens, turns and time describe resource use, not a dollar price.
One of 15 test cases the skill fixed. Same model, same prompt, with and without the skill.
What are the four sequential phases that make up the continuous R&D improvement cycle in this automation framework? Please list the exact four phase names in order.
| Checked | Without skill | With skill |
|---|---|---|
| Lists Proposal as the initial phase of the loop. | Missed | Passed |
| Lists Implementation, Evaluation, and Feedback as the remaining three phases in sequence. | Missed | Passed |
The instructions your model reads when the skill loads.
RD-Agent is an open-source AI-powered research and development automation framework developed by Microsoft Research, with over 12,000 stars on GitHub. It automates key steps in the R&D lifecycle -- including hypothesis generation, experiment design, code implementation, and result analysis -- enabling researchers and data scientists to accelerate their development cycles significantly.
The framework implements a closed-loop R&D automation pipeline where an AI agent iteratively proposes hypotheses, implements experiments, evaluates results, and refines its approach based on feedback. This mirrors the scientific method but operates at machine speed, allowing researchers to explore a much larger space of ideas and configurations than would be feasible manually.
RD-Agent is particularly valuable for researchers working in quantitative finance, data science, and machine learning, where the development process involves iterating on feature engineering, model architectures, and hyperparameter configurations. The framework has demonstrated the ability to autonomously develop competitive machine learning models and trading strategies, achieving results comparable to experienced human practitioners.
# Clone the repository
git clone https://github.com/microsoft/RD-Agent.git
cd RD-Agent
# Install dependencies
pip install -e .
# Or install from PyPI
pip install rdagent
# LLM configuration (required)
export OPENAI_API_KEY=$OPENAI_API_KEY
export CHAT_MODEL=gpt-4o
# Or use Azure OpenAI
export AZURE_OPENAI_API_KEY=$AZURE_OPENAI_API_KEY
export AZURE_OPENAI_ENDPOINT=$AZURE_OPENAI_ENDPOINT
export AZURE_OPENAI_DEPLOYMENT=$AZURE_OPENAI_DEPLOYMENT
# Docker is required for sandboxed code execution
# Ensure Docker is installed and running
docker --version
test cases passed, vs 6 / 23 without
More skills from the same source and nearby in the registry, with their headline benchmark lift.