Home

LLMs (Large Language Models) are becoming increasingly important across various domains. To guide their development and improvement, benchmarks have been established. A popular benchmark is BIG-bench, but it currently only includes two chemistry-related tasks.

ChemBench aims to address this gap by compiling a wider range of chemistry benchmark tasks in a format compatible with BIG-bench.

ChemBench is open-source software licensed under the MIT license.

Table of Contents

• Installation
• Getting Started
• Development
• Contribute Questions
• ChemBench Leaderboard