Install any skill in seconds. Free to start, no credit card required.
Get Started Free →refoundai/interviewing-evaluating-candidates
Help users design and execute a high-signal interview process that prioritizes real-world performance over superficial charisma or pedigree.
Passed 20 of 24 test cases with the skill, and 16 of 24 without it.
and 6 more in the full report
5 fixed15 passed either way3 still failing1 broke
Tokens, turns and time describe resource use, not a dollar price.
One of 5 test cases the skill fixed. Same model, same prompt, with and without the skill.
I am hiring a Principal Product Manager for our team and want to move away from standard resume screening and abstract case studies. Can you help me build a structured evaluation plan for this role? I need a guide that covers defining core role outcomes, creating a hands-on practical assignment, and evaluating candidates on problem-solving capabilities rather than just past domain experience.
| Checked | Without skill | With skill |
|---|---|---|
| Recommends sending an email at the offer stage detailing company flaws and challenges to verify candidate commitment. | Missed | Passed |
| Prioritizes asking reference checks if the candidate is in the top 1 percent of employees and if they would enthusiastically rehire them. | Missed | Passed |
| Evaluates candidates on how they build their own frameworks rather than relying on prior playbook experience. | Missed | Passed |
The instructions your model reads when the skill loads.
Move beyond resumes to assess high-fidelity signals like agency, first-principles thinking, and actual craft.
Help the user with interviewing and evaluating candidates using insights from 27 guests and posts across Lenny's Podcast and Newsletter.
Brian Halligan: "I think CEOs and everyone dramatically overrates their ability to interview, and overrates their gut feeling, and underrates a really high quality blind reference."
The most effective hiring signal is asking a reference if the candidate was in the top 1 percent of employees and if they would enthusiastically rehire them.
Kevin Yien: "When you get to offer stage, I send an email and I say all the terrible things that are probably going to reinforce their fears. If you can tell them that upfront and they can read that whole email and still be equally excited to join you, find yourself a A+ hire."
Send an email at the offer stage detailing your company's biggest flaws and challenges to ensure the candidate's commitment is based on reality.
Melissa Tan: "I think they looked for two main things. They looked for first principles thinkers, so not necessarily your experience, but how do you approach problems, how do you know the right questions to ask? And then create your own framework around that. Dropbox also hired for people that were just really humble, collaborative and team oriented."
Evaluate how candidates create their own frameworks rather than relying on experience to find those capable of driving cross-functional innovation.
Peter Deng: "In 6 months, if I'm telling you what to do, I've hired the wrong person. It helps me and the person operate on a different level where the goal is not, did you hit this OKR? The Meta goal becomes, are we calibrating enough? Are we actually getting into a spot where in 6 months you're the one telling me what needs to be done?"
Focus on finding individuals who will eventually drive the strategy and direct their managers within six months of starting.
Shishir Mehrotra: "I generally value the reference check over interview signals. If I had to stack rank in interviews, what is the best signal? The reference check is the top of the list. Those people, they worked with this person sometimes for years, their knowledge, what you're going to get out of 30 minutes of artificial scenarios it's just like never going to compare what a good reference check will give you."
Reference checks offer a high-fidelity signal of long-term performance that artificial interview environments cannot replicate; treat them as your primary signal.
test cases passed, vs 16 / 24 without
More skills from the same source and nearby in the registry, with their headline benchmark lift.