Loading skill
Install any skill in seconds. Free to start, no credit card required.
Get Started Free →brycewang-stanford/repository-harvesting-guide
Harvest metadata from open repositories using OAI-PMH protocol
Passed 21 of 24 test cases with the skill, and 20 of 24 without it.
1 fixed20 passed either way3 still failing0 broke
Tokens, turns and time describe resource use, not a dollar price.
A test case the skill fixed. Same model, same prompt, with and without the skill.
When mapping an OAI-PMH Dublin Core XML record into a Python dictionary payload for downstream indexing, I need to extract the fields representing the intellectual property license and the kind of material. What exact dictionary keys should I use for these two fields to maintain consistency?
| Checked | Without skill | With skill |
|---|---|---|
| Assigns the license or rights statement to the key 'rights' | Missed | Passed |
| Assigns the material kind to the key 'type' | Missed | Passed |
The instructions your model reads when the skill loads.
A skill for harvesting metadata from open access repositories using the OAI-PMH (Open Archives Initiative Protocol for Metadata Harvesting) protocol. Covers protocol fundamentals, building harvesters in Python, handling resumption tokens for large collections, metadata format parsing (Dublin Core, MARC, METS), selective harvesting by date and set, and integrating harvested data into research workflows.
OAI-PMH is a standardized protocol that allows metadata to be harvested from repository systems. It is the backbone of library interoperability and is supported by virtually every institutional repository, preprint server, and digital library worldwide.
OAI-PMH Architecture:
Data Providers (repositories):
- Expose metadata through a standardized HTTP interface
- Must support Dublin Core as minimum metadata format
- May support additional formats (MARC, MODS, DataCite, etc.)
- Examples: arXiv, PubMed Central, DSpace repositories,
EPrints, institutional repositories
Service Providers (harvesters):
- Send HTTP requests to data providers
- Collect, aggregate, and index metadata
- Build search services, union catalogs, analytics
- Examples: BASE (Bielefeld), CORE, OpenDOAR
Protocol Version: 2.0 (current, since 2002)
Transport: HTTP GET or POST
Response format: XML
Base URL example: https://arxiv.org/oai2
OAI-PMH defines exactly six request types (verbs):
1. Identify
Purpose: Describe the repository
URL: baseURL?verb=Identify
test cases passed, vs 20 / 24 without
More skills from the same source and nearby in the registry, with their headline benchmark lift.