MLE Agent Guide

MLE Agent Guide

A skill for using an intelligent ML engineering companion that integrates arXiv paper discovery with experiment implementation, tracking, and iteration. Based on MLE-agent (2K stars), this skill helps researchers bridge the gap between reading about new ML techniques and implementing them in their own projects.

Overview

Machine learning research moves at an extraordinary pace, with hundreds of new papers appearing on arXiv daily. Researchers struggle not just to keep up with the literature but to translate promising ideas into working implementations. MLE-agent addresses this by combining paper discovery, technique extraction, implementation assistance, and experiment management into a unified workflow.

This skill is designed for ML researchers and engineers who want to quickly prototype ideas from papers, systematically compare approaches, and maintain organized experiment records throughout the research process.

arXiv Integration

The skill provides sophisticated arXiv paper discovery and analysis:

Paper Discovery

• Monitor arXiv categories relevant to the researcher's interests (cs.LG, cs.CL, cs.CV, stat.ML, etc.)
• Filter new papers by keyword relevance, author familiarity, and citation velocity
• Rank papers by potential applicability to current research projects
• Generate daily or weekly digests of the most relevant new papers
• Track papers from specific authors or research groups

Paper Analysis

• Extract the core technical contribution from each paper
• Identify the proposed method's key components and hyperparameters
• Compare the method against baselines reported in the paper
• Note the datasets and evaluation metrics used
• Assess reproducibility based on available code, data, and method description detail

Technique Extraction

• Distill the algorithmic steps from the paper's method section
• Identify required input data formats and preprocessing steps
• Map the technique's computational requirements (GPU memory, training time)
• Note dependencies on specific frameworks or libraries
• Extract training recipes including learning rate schedules, batch sizes, and augmentation strategies

Experiment Workflow

The core experiment management workflow:

Project Setup