Zhongzhi1228/Terminal-Bench-Hard
Terminal-Bench-Hard: Harbor dataset on Hugging Face with 100 tasks. Terminal-Bench Hard is a set of 100 challenging terminal-based agent tasks. The tasks cover software engineering, debugging, data processing, system administration, security, scientific computing, and related command-line workflows.
Tasks
- monitoring specialist setting up alerts
- open-source maintainer reviewing a broken PR
- forensics analyst recovering evidence from a compromised host
- researcher running simulations
- configuration manager tracking changes
- forensics analyst recovering evidence from a compromised host
- database reliability engineer managing backups
- site administrator managing user accounts
- FinOps analyst optimizing cloud costs
- system administrator maintaining servers
- release manager preparing deployments
- performance engineer profiling applications
- performance engineer profiling applications
- machine learning engineer preparing training data
- support engineer collecting diagnostics
- network engineer inspecting traffic
- data engineer building ETL pipelines
- site reliability engineer monitoring uptime
- red-team operator crafting an evasion payload
- developer organizing project files
- engineer investigating a memory leak in a long-running service
- data scientist cleaning datasets
- performance engineer profiling applications
- configuration manager tracking changes
- DevSecOps engineer enforcing policy as code
- DevOps engineer debugging logs
- data engineer building ETL pipelines
- database administrator optimizing queries
- IT support technician resolving tickets
- mobile build engineer maintaining pipelines
- data scientist fitting models
- bioinformatics analyst processing sequences
- engineer porting a Linux tool to work in a minimal container
- script developer creating utilities
- backup administrator archiving data
- security researcher analysing a suspicious binary
- engineer porting a Linux tool to work in a minimal container
- data analyst processing CSV files
- backup administrator archiving data
- developer debugging a failing build
- engineer investigating a memory leak in a long-running service
- support engineer collecting diagnostics
- machine learning engineer preparing training data
- script developer creating utilities
- developer organizing project files
- QA engineer setting up test environments
- on-call engineer responding to a 3am page
- security researcher analysing a suspicious binary
- configuration manager tracking changes
- developer organizing project files
- data analyst processing CSV files
- observability engineer tuning dashboards
- infrastructure engineer automating provisioning
- IT support technician resolving tickets
- data analyst processing CSV files
- configuration manager tracking changes
- script developer creating utilities
- developer organizing project files
- automation specialist creating workflows
- forensics analyst recovering evidence from a compromised host
- FinOps analyst optimizing cloud costs
- network engineer inspecting traffic
- developer bisecting a regression across 200 commits
- DevSecOps engineer enforcing policy as code
- security engineer rotating credentials
- bioinformatics analyst processing sequences
- researcher organizing datasets
- log analyst investigating patterns
- data analyst processing CSV files
- on-call engineer responding to a 3am page
- performance engineer profiling applications
- data scientist cleaning datasets
- site reliability engineer monitoring uptime
- developer fixing a multi-file Rust project that fails to compile
- developer inheriting an unfamiliar codebase
- machine learning engineer preparing training data
- storage administrator managing disk space
- researcher organizing datasets
- incident responder investigating issues
- machine learning engineer preparing training data
- storage administrator managing disk space
- incident responder investigating issues
- researcher organizing datasets
- network engineer inspecting traffic
- configuration manager tracking changes
- machine learning engineer preparing training data
- engineer investigating a memory leak in a long-running service
- compliance officer auditing systems
- machine learning engineer preparing training data
- developer organizing project files
- platform engineer maintaining CI/CD pipelines
- data analyst processing CSV files
- FinOps analyst optimizing cloud costs
- systems programmer debugging a C library linking issue
- configuration manager tracking changes
- automation specialist creating workflows
- release manager preparing deployments
- developer organizing project files
- configuration manager tracking changes
- configuration manager tracking changes