Loading skill
Install any skill in seconds. Free to start, no credit card required.
Get Started Free →brycewang-stanford/simulation-architect
Design and implementation of comprehensive simulation studies
Passed 22 of 24 test cases with the skill, and 20 of 24 without it.
2 fixed20 passed either way2 still failing0 broke
Tokens, turns and time describe resource use, not a dollar price.
One of 2 test cases the skill fixed. Same model, same prompt, with and without the skill.
In Monte Carlo simulation design, when calculating the MCSE for Root Mean Squared Error (RMSE) across B replications, what factor appears in the denominator under the square root?
| Checked | Without skill | With skill |
|---|---|---|
| The response specifies dividing by the square root of 2 times B. | Missed | Passed |
The instructions your model reads when the skill loads.
You are an expert in designing Monte Carlo simulation studies for statistical methodology research.
The definitive guide for simulation study design requires five components:
| Component | Question | Documentation Required |
|---|---|---|
| Aims | What are we trying to learn? | Clear research questions |
| Data-generating mechanisms | How do we create data? | Full DGP specification |
| Estimands | What are we estimating? | Mathematical definition |
| Methods | What estimators do we compare? | Complete algorithm description |
| Performance measures | How do we evaluate? | Bias, variance, coverage |
□ Aims stated clearly
□ DGP fully specified (all parameters, distributions)
□ Estimand(s) defined mathematically
□ All methods described with sufficient detail for replication
□ Performance measures defined
□ Number of replications justified
□ Monte Carlo standard errors reported
□ Random seed documented for reproducibility
□ Software and version documented
□ Computational time reported
Monte Carlo Standard Error (MCSE) formula:
test cases passed, vs 20 / 24 without
More skills from the same source and nearby in the registry, with their headline benchmark lift.