Compare commits
7
Commits
| Author | SHA1 | Date | |
|---|---|---|---|
|
|
6c0071ff08 | ||
|
|
124c76413c | ||
|
|
b3b67f8b51 | ||
|
|
b9cea1ed17 | ||
|
|
1ab812ba92 | ||
|
|
ff0fbd8785 | ||
|
|
268b9aaacc |
@@ -2,9 +2,9 @@
|
||||
title: "Readme"
|
||||
task: ""
|
||||
lineage_type: import
|
||||
upstream_source: https://github.com/ai-boost/awesome-ai-for-science/blob/230e8724/README.md
|
||||
upstream_sha: 230e8724
|
||||
imported_at: 2026-07-10
|
||||
upstream_source: https://github.com/ai-boost/awesome-ai-for-science/blob/be91bc08/README.md
|
||||
upstream_sha: be91bc08
|
||||
imported_at: 2026-07-25
|
||||
prompt_class: catalogue
|
||||
upstream_changes: accepted
|
||||
author: upstream
|
||||
@@ -144,6 +144,7 @@ validated: false
|
||||
- [Chat2Plot](https://github.com/nyanp/chat2plot) - Secure text-to-visualization through standardized chart specifications
|
||||
- [AutoViz](https://github.com/AutoViML/AutoViz) - Automated data visualization with minimal code
|
||||
- [PlotlyAI](https://plotly.com/ai/) - AI-powered data visualization and dashboard creation
|
||||
- [Flint (Microsoft)](https://github.com/microsoft/flint-chart) - Visualization intermediate language that lets AI agents create expressive, polished charts from simple, human-editable specs, compiling the same input to 30+ chart types across Vega-Lite, ECharts, and Chart.js with an MCP server for agent integration (1.9K+ stars, MIT License, 2026)
|
||||
|
||||
---
|
||||
|
||||
@@ -214,6 +215,8 @@ validated: false
|
||||
- [open-science](https://github.com/ai4s-research/open-science) - Local-first, open-source AI workbench for scientists — an open alternative to Claude Science (by ai4s-research, maintainers of this list; TypeScript, MIT, 2026)
|
||||
- [OpenScience (Synthetic Sciences)](https://github.com/synthetic-sciences/openscience) - Open-source AI workbench for scientific research that automates the full research loop — literature review, hypothesis generation, code writing, experiment execution, database querying, and report writing — with 290+ skills, specialized research agents, and a browser-based workspace (1453+ stars, Apache 2.0, 2026)
|
||||
- [Claude Scholar](https://github.com/Galaxy-Dawn/claude-scholar) - Semi-automated research assistant for academic research and software development, supporting Claude Code, Codex CLI, Kimi Code CLI, and OpenCode across ideation, coding, experiments, writing, and publication (Galaxy-Dawn, 4.5K+ stars, MIT License, 2026)
|
||||
- [K-Dense BYOK](https://github.com/K-Dense-AI/k-dense-byok) - Free, open-source desktop AI research assistant that runs locally and turns natural-language requests into real data analysis, literature search, figure generation, and manuscript review; ships with 149 scientific skills, 326 workflow templates, and 229 databases across genomics, proteomics, drug discovery, and materials science, plus a living lab notebook, 60+ scientific file previews, and LaTeX editing (K-Dense-AI, 908+ stars, MIT License, 2026)
|
||||
- [Academic Research Skills (ARS)](https://github.com/Imbad0202/academic-research-skills) - Comprehensive Claude Code skill suite covering the full academic pipeline from deep research and paper writing to multi-perspective peer review, revision, and finalization; features multi-agent teams, PRISMA systematic review, style calibration, claim-level citation audits, integrity gates, and human-in-the-loop safeguards (38K+ stars, CC BY-NC 4.0, 2026)
|
||||
|
||||
### Literature Management Plugins
|
||||
- [llm-for-zotero](https://github.com/yilewang/llm-for-zotero) - Research agent system deeply integrated with Zotero supporting Agent Mode, skills, multi-model backends (OpenAI-compatible, Claude Code, WebChat, Codex), and MinerU PDF parsing for literature Q&A, summarization, figure inspection, and source comparison (1.3K+ stars, 2026)
|
||||
@@ -249,6 +252,7 @@ validated: false
|
||||
- [FunSearch (DeepMind, Nature 2023)](https://github.com/google-deepmind/funsearch) - First system to make novel, verifiable scientific discoveries by pairing LLMs with evolutionary search, solving open problems in combinatorics (cap set problem) and discovering faster matrix multiplication algorithms
|
||||
- [OpenEvolve](https://github.com/algorithmicsuperintelligence/openevolve) - Open-source implementation of AlphaEvolve's evolutionary coding agent paradigm, enabling LLMs to autonomously discover and optimize algorithms through iterative evolution, matching the approach behind DeepMind's breakthrough matrix multiplication discovery (6.2K+ stars, 2025)
|
||||
- [SkyDiscover](https://github.com/skydiscover-ai/skydiscover) - Modular framework for AI-driven scientific and algorithmic discovery, providing a unified interface for implementing, running, and fairly comparing discovery algorithms across 200+ optimization tasks; introduces AdaEvolve and EvoX adaptive/evolutionary algorithms and natively supports OpenEvolve, GEPA, and Harbor-format benchmarks (skydiscover-ai, 568+ stars, Apache 2.0, 2026)
|
||||
- [EvoMaster (SJTU SAI, arXiv 2026)](https://github.com/sjtu-sai-agents/EvoMaster) - Foundational auto-research agent framework for agentic science at scale, providing modular agent construction, run-level self-evolution, and multiple SciMaster domain agents (ML-Master, X-Master, Browse-Master); outperforms general-purpose agents across authoritative benchmarks including the OpenAI Frontier Science Benchmark (206+ stars, Apache 2.0, 2026)
|
||||
- [Virtual Lab (Stanford Zou Group, Nature 2025)](https://github.com/zou-group/virtual-lab) - AI-human collaborative research platform where a human researcher works with a team of LLM agents via team and individual meetings to perform scientific research; demonstrated by designing new SARS-CoV-2 nanobodies with wet-lab validation
|
||||
- [The AI Scientist (SakanaAI)](https://github.com/SakanaAI/AI-Scientist) - First fully autonomous open-ended scientific discovery system with official implementation: hypothesis→experiment→writing→review simulation (13.8K+ stars, 2024)
|
||||
- [The AI Scientist v2 (SakanaAI)](https://github.com/SakanaAI/AI-Scientist-v2) - Official implementation of the second-generation fully autonomous scientific discovery system, extending the original with agentic tree search and reduced template dependency to achieve workshop-level accepted papers (6.7K+ stars, 2025)
|
||||
@@ -287,6 +291,9 @@ validated: false
|
||||
- [Science-Star (USTC AI4Science, 2025)](https://github.com/ustc-ai4science/Science-Star) - Open-source platform for building, extending, and experimenting with scientific agents, providing modular agent construction tools and standardized evaluation pipelines for accelerating autonomous scientific discovery research (748+ stars, MIT License)
|
||||
- [SR-Scientist (ICLR 2026)](https://github.com/GAIR-NLP/SR-Scientist) - Scientific equation discovery with agentic AI, elevating LLMs from equation proposers to autonomous scientists that write code, analyze data, implement equations, and optimize based on experimental feedback; outperforms baselines by 6-35% across four science disciplines with robustness to noise and out-of-domain generalization (GAIR-NLP / SJTU, 49+ stars, Apache 2.0)
|
||||
- [ARA (Agent-Native Research Artifact)](https://github.com/ARA-Labs/Agent-Native-Research-Artifact) - Research ecosystem for rigorous and trustworthy AI scientists — a protocol and skill bundle that makes autonomous research verifiable, crystallized, and observable through structured, machine-executable research artifacts and five agent skills for research management, compilation, verification, visualization, and publication (ARA-Labs, 447+ stars, MIT License, 2026)
|
||||
- [Scholar Loop](https://github.com/renee-jia/scholar-loop) - Autonomous multi-agent AI scientist that mirrors a PhD workflow: literature review → grounded hypothesis → real ML experiments → self-critique → write-up; features a deterministic harness with frozen-metric scoring, edit allowlists, and a verified registry to make reward-hacking and hallucination impossible, plus 108 unit tests runnable without API keys or GPUs (461+ stars, MIT License, 2026)
|
||||
- [ResearchStudio (Microsoft)](https://github.com/microsoft/ResearchStudio) - AI co-author covering the entire research lifecycle — from an under-specified research direction to a published paper; includes ResearchStudio-Idea for evidence-grounded research ideation and ResearchStudio-Reel for turning finished papers into posters, narrated videos, blogs, and interactive reels; runs as skills on Claude Code and Codex (1.2K+ stars, MIT License, 2026)
|
||||
- [Principia](https://github.com/pzqpzq/Principia) - Principle-first scientific idea discovery framework that extracts reusable principles from public literature and private research materials, composes them into traceable Idea Cards with prior-art comparisons, and exports validation-ready research packs; emphasizes inspectable scientific objects, risk disclosure, and falsification paths (ICML 2026, 411+ stars, MIT License)
|
||||
|
||||
### Evaluation & Benchmarking
|
||||
- [ScienceAgentBench (ICLR 2025)](https://github.com/OSU-NLP-Group/ScienceAgentBench) - 102 executable tasks from 44 peer-reviewed papers across 4 disciplines with containerized evaluation
|
||||
@@ -300,6 +307,7 @@ validated: false
|
||||
- [SciBench](https://arxiv.org/abs/2307.10635) - College-level scientific problem-solving evaluation across multiple domains
|
||||
- [NewtonBench (ICLR 2026)](https://github.com/HKUST-KnowComp/NewtonBench) - First benchmark evaluating LLMs' ability to rediscover scientific laws through interactive experimentation across 324 tasks in 12 physics domains, featuring memorization-resistant metaphysical shifts of canonical laws (HKUST)
|
||||
- [ResearchClawBench (InternScience, arXiv 2026)](https://github.com/InternScience/ResearchClawBench) - Benchmark evaluating AI agents for end-to-end automated research from re-discovery to new-discovery, with 40 real-science tasks across 10 disciplines, curated datasets from published papers, and expert-curated multimodal rubrics (170+ stars, MIT License)
|
||||
- [Terminal-Bench Science (Harbor Framework, 2026)](https://github.com/harbor-framework/terminal-bench-science) - Benchmark evaluating AI agents on complex real-world scientific workflows in terminal environments across life, physical, earth, and mathematical sciences; featured on model cards for Claude Opus 4.7, GPT-5.5, and Gemini 3.1 Pro (200+ stars, Apache 2.0)
|
||||
|
||||
### Academic Review & Evaluation
|
||||
- [AgentReview](https://agentreview.github.io/) - LLM agents simulating academic peer review ecosystems
|
||||
@@ -326,6 +334,7 @@ validated: false
|
||||
- [Coscientist](https://www.nature.com/articles/s41586-023-06792-1) - Autonomous chemical experiment planning and execution
|
||||
- [SciAgents](https://github.com/lamm-mit/SciAgentsDiscovery) - Bioinspired multi-agent intelligent graph reasoning system that autonomously traverses ontological knowledge graphs to generate, critique, and refine novel research hypotheses, demonstrated on bio-inspired materials discovery with cross-disciplinary connection mining (MIT Lamm Group, 2024)
|
||||
- [TxAgent](https://github.com/mims-harvard/TxAgent) - AI agent for therapeutic reasoning across a universe of tools, achieving 92.1% accuracy in drug reasoning and outperforming GPT-4o by 25.8% (Harvard MIMS, 2025)
|
||||
- [ATHENA-R1 (Harvard MIMS)](https://github.com/mims-harvard/ATHENA) - Reinforcement-learning-trained AI agent for treatment reasoning over a universe of 212 biomedical tools, performing multi-step evidence gathering and spawning parallel reasoning branches to reach evidence-grounded clinical decisions (55+ stars, MIT License, 2026)
|
||||
- [ClawBio](https://github.com/ClawBio/ClawBio) - First bioinformatics-native AI agent skill library enabling local-first, reproducible genomic and population-genetics research workflows built on OpenClaw (871+ stars, MIT License, 2026)
|
||||
|
||||
---
|
||||
@@ -437,6 +446,7 @@ validated: false
|
||||
- [ChemCrow: Augmenting large-language models with chemistry tools](https://arxiv.org/abs/2304.05376) (2023.04) - LLM agents for chemistry research
|
||||
- [Autonomous chemical research with large language models](https://www.nature.com/articles/s41586-023-06792-0) - Automated chemical experimentation
|
||||
- [Coscientist: Autonomously planning and executing scientific experiments](https://www.nature.com/articles/s41586-023-06792-1) - Robotic lab automation
|
||||
- [The AutoResearch Moment: From Experimenter to Research Director](https://www.preprints.org/manuscript/202603.1329) (2026.03) - Position paper on claim governance for autonomous research: proposes a research-director bundle (objective sheet, discovery trace, verification ledger, provenance bundle) for evaluating agent-driven science
|
||||
|
||||
### Recent Advances & Domain Applications
|
||||
- [AlphaFold: Protein Structure Prediction](https://www.nature.com/articles/s41586-021-03819-2)
|
||||
@@ -474,6 +484,7 @@ validated: false
|
||||
- [ModelAngelo](https://github.com/3dem/model-angelo) - Automatic atomic model building program for cryo-EM maps using deep learning, enabling rapid de novo protein structure determination from electron density with high accuracy (3DEM/EMBL, 169+ stars)
|
||||
- [AlphaFold](https://github.com/google-deepmind/alphafold) - Protein structure prediction
|
||||
- [AlphaFold3](https://github.com/google-deepmind/alphafold3) - AlphaFold 3 inference pipeline for unified biomolecular structure prediction of proteins, nucleic acids, small molecules, ions, and post-translational modifications (Google DeepMind, Nature 2024)
|
||||
- [AlphaFold Server](https://alphafoldserver.com/) - Free, easy-to-use web platform by Google DeepMind and Isomorphic Labs for running AlphaFold 3 predictions of biomolecular structures and interactions, enabling researchers without local infrastructure to model proteins, nucleic acids, small molecules, ions, and post-translational modifications through a searchable proteome interface (2024)
|
||||
- [AlphaProteo](https://github.com/google-deepmind/alphaproteo) - Deep learning system for de novo design of high-affinity protein binders, achieving strong binding across diverse target classes including challenging intracellular proteins with significantly higher success rates than traditional wet-lab screening methods (Google DeepMind, Nature 2024)
|
||||
- [AlphaPulldown](https://github.com/KosinskiLab/AlphaPulldown) - Automated pipeline for proteome-scale protein-protein interaction screening with AlphaFold-Multimer and AlphaFold 3, supporting flexible inputs (UniProt IDs, FASTA, residue regions, multimers, AF3 JSON features) and integrated downstream analysis for hit prioritization (Kosinski Lab, EMBL, Nature Protocols 2024, 317+ stars, GPL-3.0)
|
||||
- [RareFold](https://github.com/PatrickBryant1/RareFold) - Structure prediction and design of proteins with noncanonical amino acids, enabling AI-powered modeling of synthetic biology constructs and expanded genetic code systems (133+ stars, 2025)
|
||||
@@ -599,8 +610,10 @@ validated: false
|
||||
- [AlphaGenome](https://github.com/google-deepmind/alphagenome) - Google DeepMind's unified DNA sequence foundation model predicting molecular consequences of genetic variants from single-base resolution up to 1 megabase context, jointly outputting thousands of regulatory tracks (RNA expression, splicing, chromatin accessibility, TF binding, contact maps) for human and mouse genomes via a Python client and non-commercial API (2025)
|
||||
- [GPN-Star (Song Lab, UC Berkeley, bioRxiv 2025)](https://github.com/songlab-cal/gpn) - Phylogeny-aware genomic language model trained on whole-genome alignments across multiple evolutionary timescales, predicting functional constraints and variant effects for human, mouse, chicken, fly, worm, and Arabidopsis genomes (344+ stars, MIT License)
|
||||
- [GENERanno (bioRxiv 2025)](https://github.com/GenerTeam/GENERanno) - Genomic foundation model for metagenomic and genome annotation, featuring an 8k base-pair context and 500M parameters trained on 386B base pairs of eukaryotic DNA; provides expert models and a unified CLI for prokaryotic/eukaryotic coding-sequence annotation with strong performance on Genomic Benchmarks, Nucleotide Transformer tasks, and custom Gener tasks (GenerTeam, 314+ stars, MIT License)
|
||||
- [GENERator (bioRxiv 2026)](https://github.com/GenerTeam/GENERator) - Long-context generative genomic foundation model using 6-mer tokenization for DNA sequence modeling and generation, with v2 model families for prokaryote and eukaryote genomes and pretrained weights available on HuggingFace (GenerTeam, 460+ stars, MIT License, 2025-2026)
|
||||
- [DeepVariant](https://github.com/google/deepvariant) - Google DeepMind's deep learning analysis pipeline for calling genetic variants (SNPs and indels) from next-generation DNA sequencing data, achieving human expert-level accuracy and widely adopted in clinical genomics, population genetics, and precision medicine; pre-trained models available for multiple sequencing platforms and organismal genomes (Nature Biotechnology 2018, 3.7K+ stars)
|
||||
- [Casanovo](https://github.com/Noble-Lab/casanovo) - Transformer encoder-decoder for de novo peptide sequencing from tandem mass spectrometry, translating MS/MS spectra directly to peptide sequences without reference databases, enabling identification of novel peptides for immunopeptidomics, antibody repertoires, and metaproteomes (Noble Lab UW, Nature Communications 2024)
|
||||
- [Dorado](https://github.com/nanoporetech/dorado) - Oxford Nanopore's official deep-learning basecaller for nanopore sequencing, converting raw electrical signals into DNA/RNA sequences with integrated modified-base (methylation) detection and efficient CPU/GPU inference; foundational tool for long-read genomics, epigenetics, and real-time sequencing analysis (nanoporetech, 846+ stars, actively maintained)
|
||||
|
||||
#### Neuroscience & Behavioral Analysis
|
||||
- [DeepLabCut](https://github.com/DeepLabCut/DeepLabCut) - Markerless pose estimation of user-defined features with deep learning for all animals including humans, enabling quantitative behavioral analysis in neuroscience and ethology (Nature Neuroscience 2018, 5.6K+ stars)
|
||||
@@ -640,12 +653,14 @@ validated: false
|
||||
- [micro-sam](https://github.com/computational-cell-analytics/micro-sam) - Segment Anything Model for microscopy: interactive and automatic segmentation of light, electron, and fluorescence microscopy images in 2D and 3D, with domain-specific fine-tuning workflows for scientific imaging (1.5K+ stars)
|
||||
- [MedSAM](https://github.com/bowang-lab/MedSAM) - Universal medical image segmentation foundation model trained on 1.57M image-mask pairs across 10 imaging modalities and 30+ cancer types (Nature Communications 2024)
|
||||
- [MedSAM2](https://github.com/bowang-lab/MedSAM2) - Segment Anything in 3D medical images and videos, extending SAM2 to volumetric and temporal medical imaging with state-of-the-art zero-shot segmentation performance across CT, MRI, and surgical video (arXiv 2025)
|
||||
- [Medical SAM3 (AIM Research Lab, arXiv 2026)](https://github.com/AIM-Research-Lab/Medical-SAM3) - Foundation model for universal prompt-driven medical image segmentation extending SAM3 to clinical imaging, supporting 2D public benchmarks and 3D training/evaluation with text and box prompts; pretrained weights available on HuggingFace (189+ stars)
|
||||
- [MedSegX](https://github.com/MedSegX/MedSegX-code) - Generalist foundation model and database for open-world medical image segmentation, enabling universal segmentation of diverse anatomical structures and pathologies with zero-shot generalization to unseen tasks and modalities (Nature Biomedical Engineering 2025)
|
||||
- [VoxTell (MIC-DKFZ, 2025)](https://github.com/MIC-DKFZ/VoxTell) - Free-text promptable universal 3D medical image segmentation foundation model enabling zero-shot segmentation of diverse anatomical structures and pathologies via natural language prompts across CT, MRI, and other volumetric imaging modalities (DKFZ, 195+ stars, Apache 2.0)
|
||||
- [BiomedParse](https://github.com/microsoft/BiomedParse) - Foundation model for joint segmentation, detection, and recognition of biomedical objects across nine imaging modalities, with v2 introducing BoltzFormer architecture for end-to-end 3D inference (Microsoft, Nature Methods 2025)
|
||||
- [UniBiomed (Nature Communications 2026)](https://github.com/Luffy03/UniBiomed) - Universal foundation model for grounded biomedical image interpretation, enabling comprehensive visual understanding, reasoning, and grounding across diverse biomedical imaging modalities with strong zero-shot generalization (55+ stars, Apache 2.0, 2025-2026)
|
||||
- [MIRA (NeurIPS 2025)](https://github.com/microsoft/MIRA) - Medical time series foundation model pretrained on 454B time points from heterogeneous clinical corpora spanning ICU physiological signals and hospital EHR, with continuous-time rotary positional encoding, frequency-specialized Mixture-of-Experts, and neural ODE extrapolation for zero-shot forecasting across irregular and multimodal temporal health data (Microsoft, 399+ stars, MIT License)
|
||||
- [HealthGPT (ICML 2025 Spotlight)](https://github.com/ZJU4HealthCare/HealthGPT) - Medical large vision-language model unifying comprehension and generation via heterogeneous knowledge adaptation, enabling holistic medical image understanding, visual question answering, and clinical report generation across diverse modalities (ZJU4HealthCare, 1.6K+ stars)
|
||||
- [Merlin (Stanford MIMI, Nature 2026)](https://github.com/StanfordMIMI/Merlin) - 3D vision-language model for computed tomography that leverages both structured electronic health records (EHR) and unstructured radiology reports for pretraining, enabling multimodal medical understanding and radiology report generation (447+ stars, MIT License, 2026)
|
||||
- [MedAgents](https://github.com/gersteinlab/MedAgents) - Multi-disciplinary collaboration framework for zero-shot medical reasoning using role-playing LLM agents (ACL 2024)
|
||||
- [MedAgentGym](https://github.com/wshi83/MedAgentGym) - Scalable agentic training environment for code-centric reasoning in biomedical data science
|
||||
- [MedRAX (ICML 2025)](https://github.com/bowang-lab/MedRAX) - First versatile medical reasoning agent for chest X-ray interpretation, dynamically integrating state-of-the-art CXR analysis tools and multimodal LLMs into a unified framework; introduces ChestAgentBench with 2,500 complex medical queries across 7 categories (bowang-lab, 1.1K+ stars)
|
||||
@@ -673,6 +688,7 @@ validated: false
|
||||
- [All-atom Diffusion Transformers (ADiT)](https://github.com/facebookresearch/all-atom-diffusion-transformer) - Unified latent diffusion transformer that jointly generates periodic crystals and non-periodic molecules, scaling to 500M parameters with SOTA results on QM9, MP20, and GEOM-DRUGS (Meta FAIR, ICML 2025, 310+ stars)
|
||||
- [JARVIS](https://github.com/usnistgov/jarvis) - NIST's open-source platform for data-driven atomistic materials design, integrating DFT datasets (JARVIS-DFT), machine learning property prediction (JARVIS-ML), and a comprehensive leaderboard for benchmarking materials AI methods across the periodic table (384+ stars)
|
||||
- [NVIDIA ALCHEMI Toolkit](https://github.com/NVIDIA/nvalchemi-toolkit) - Developer toolkit for accelerating training and inference for AI in chemistry and material science, providing optimized GPU-accelerated workflows for molecular and materials machine learning (NVIDIA, 2026)
|
||||
- [CatGo (UCSD)](https://github.com/Hello-QM/catgo-LRG) - AI-driven desktop workbench for computational materials science with an interactive 3D structure editor, natural-language CatBot assistant, visual DAG workflow engine, remote-cluster access, and HPC job submission for VASP, ORCA, CP2K, Quantum ESPRESSO, GPAW, DFTB+, SIESTA, and LAMMPS (172+ stars, AGPL-3.0, 2026)
|
||||
- [NequIP](https://github.com/mir-group/nequip) - E(3)-equivariant neural network interatomic potentials achieving DFT accuracy with up to 1000× less training data than invariant models, foundational architecture behind MACE and Allegro (Harvard, MIT, Nature Communications 2022)
|
||||
- [Allegro](https://github.com/mir-group/allegro) - Highly scalable equivariant deep learning interatomic potentials enabling million-atom molecular dynamics simulations with ab initio accuracy, building on E(3)-equivariant architectures for large-scale atomistic modeling (mir-group, MIT License, 480+ stars)
|
||||
- [SchNetPack](https://github.com/atomistic-machine-learning/schnetpack) - PyTorch toolkit for deep neural networks in atomistic simulations, implementing SchNet, DimeNet++, PaiNN, and GemNet for molecular dynamics and quantum chemistry (900+ stars)
|
||||
@@ -776,7 +792,7 @@ validated: false
|
||||
|
||||
#### Social Science Research & Simulation
|
||||
- [AgentSociety](https://github.com/tsinghua-fib-lab/AgentSociety) - Modern LLM-native agent simulation platform for social science research and experimental design, providing a flexible framework for creating and managing intelligent agents in simulated environments (Tsinghua FIB Lab, 984+ stars, 2025)
|
||||
- [Awesome Agent Skills for Empirical Research](https://github.com/brycewang-stanford/Awesome-Agent-Skills-for-Empirical-Research) - Curated collection of 23,000+ agent skills for empirical research across 8 social science disciplines, enabling reproducible social science research with AI agents (Stanford REAP & CoPaper.AI, 1.1K+ stars, 2026)
|
||||
- [Auto-Empirical-Research-Skills](https://github.com/brycewang-stanford/Auto-Empirical-Research-Skills) - Curated collection of 23,000+ agent skills for empirical research across 8 social science disciplines, enabling reproducible social science research with AI agents (Stanford REAP & CoPaper.AI, 3K+ stars, 2026)
|
||||
- [EDSL](https://github.com/expectedparrot/edsl) - Design, conduct and analyze results of AI-powered surveys and experiments. Simulate social science and market research with large numbers of AI agents and LLMs (460+ stars, 2024)
|
||||
|
||||
---
|
||||
@@ -790,6 +806,10 @@ validated: false
|
||||
- [TimesFM (Google Research)](https://github.com/google-research/timesfm) - Pretrained time series foundation model for long-horizon forecasting across diverse scientific domains including climate variables, biomedical signals, and physical observations; decoder-only Transformer architecture with strong zero-shot generalization (19.8K+ stars, Apache 2.0, 2024-2025)
|
||||
- [Chronos (Amazon Science, NeurIPS 2024)](https://github.com/amazon-science/chronos-forecasting) - Pretrained time series foundation model for zero-shot forecasting across diverse scientific and real-world domains; tokenizes continuous time series into discrete bins to train transformer language models on large-scale corpora, achieving strong zero-shot generalization and competitive performance with task-specific supervised models on climate, energy, and health benchmarks (5.3K+ stars, Apache 2.0, 2024-2026)
|
||||
- [TabPFN (Prior Labs, Nature 2025)](https://github.com/PriorLabs/tabpfn) - Foundation model for tabular data that predicts on unseen real-world tables in a single forward pass, achieving accurate small-data classification and regression without task-specific training; widely applicable to scientific datasets with limited samples (7.4K+ stars, 2022-2026)
|
||||
- [TabFM (Google Research, 2026)](https://github.com/google-research/tabfm) - Scikit-learn compatible tabular foundation model for zero-shot classification and regression on mixed-type tabular datasets via in-context learning; applicable to diverse scientific datasets (1.8K+ stars, Apache 2.0)
|
||||
- [DeepInnovator (HKUDS, arXiv 2026)](https://github.com/HKUDS/DeepInnovator) - Scientific foundation model and AI research copilot for idea generation, cross-disciplinary connection discovery, and hypothesis formation; trained with a decoupled reward-comment RL architecture and achieves GPT-4o-competitive novelty/rationale on STEM and social-science idea-generation benchmarks (270+ stars, MIT License, 2026)
|
||||
- [AI Can Learn Scientific Taste (OpenMOSS, arXiv 2026)](https://github.com/tongjingqi/AI-Can-Learn-Scientific-Taste) - Scientific taste learning framework showing AI can judge and propose research ideas with long-term impact; trains Scientific Judge as a generative reward model and Scientific Thinker as an ideation policy using Reinforcement Learning from Community Feedback (RLCF) on large-scale citation signals, with SciJudgeBench and released HuggingFace model weights (425+ stars, Apache 2.0, 2026)
|
||||
- [LOGOS (arXiv 2026)](https://github.com/LOGOS-Hub/LOGOS) - First multi-domain generative foundation model for the natural sciences built on a unified scientific grammar, encoding proteins, antibodies, small molecules, chemical reactions, materials, and their spatial interactions into a shared token vocabulary; enables unified generation, prediction, and design across domains under a purely autoregressive paradigm (134+ stars, Apache 2.0, 2026)
|
||||
- [MinervaAI](https://github.com/google-research/minerva) - Mathematical reasoning
|
||||
- [PaLM-2](https://ai.google/discover/palm2) - Scientific reasoning capabilities
|
||||
|
||||
|
||||
@@ -0,0 +1,352 @@
|
||||
---
|
||||
title: "Awesome AI Agents for Scientific Discovery [](https://awesome.re)"
|
||||
task: ""
|
||||
lineage_type: import
|
||||
upstream_source: https://github.com/zhoujieli/Awesome-LLM-Agents-Scientific-Discovery/blob/bb3be5bc/README.md
|
||||
upstream_sha: bb3be5bc
|
||||
imported_at: 2026-08-08
|
||||
prompt_class: prompt
|
||||
upstream_changes: accepted
|
||||
author: upstream
|
||||
validated: false
|
||||
---
|
||||
|
||||
# Awesome AI Agents for Scientific Discovery [](https://awesome.re)
|
||||
<div align="center">
|
||||
<img src="agents4science.webp" alt="AI Agents for Scientific Discovery" width="600px">
|
||||
</div>
|
||||
|
||||
A curated list of papers about AI agents for scientific discovery and research automation.
|
||||
|
||||
|
||||
Maintained by [Jieli Zhou](mailto:[email protected])
|
||||
|
||||
If you use this paper list for your research, please cite it using:
|
||||
```bibtex
|
||||
@misc{zhou2024awesome,
|
||||
title={Awesome AI Agents for Scientific Discovery},
|
||||
author={Zhou, Jieli},
|
||||
year={2024},
|
||||
publisher={GitHub},
|
||||
journal={GitHub repository},
|
||||
howpublished={\url{https://github.com/zhoujieli/Awesome-LLM-Agents-Scientific-Discovery}}
|
||||
}
|
||||
```
|
||||
|
||||
|
||||
## Introduction
|
||||
|
||||
The convergence of large language models (LLMs) and autonomous agents has ushered in a new era in scientific discovery, fundamentally transforming how research is conducted across disciplines. This emerging paradigm, articulated in Kitano's seminal "Nobel Turing Challenge" (2021), envisions AI systems capable of making scientific discoveries worthy of Nobel Prize recognition. Recent advances in LLM-based agents have brought us closer to this vision, enabling increasingly sophisticated automation of scientific workflows and decision-making processes.
|
||||
|
||||
### Evolution and Current Landscape
|
||||
|
||||
The field has evolved rapidly since early visions of AI-driven scientific discovery. While traditional AI systems focused on narrow tasks, modern LLM-based agents demonstrate remarkable capabilities in complex scientific reasoning, experimental design, and hypothesis generation. The breakthrough capabilities of models like GPT-4 have catalyzed this transition, enabling agents to engage in sophisticated scientific discourse, interpret complex data, and even design novel experiments.
|
||||
|
||||
### Key Research Directions
|
||||
|
||||
Several major research themes have emerged in this space:
|
||||
|
||||
1. **Multi-Agent Architectures**: Research has increasingly focused on collaborative multi-agent systems, where specialized agents work together to tackle complex scientific problems.
|
||||
|
||||
2. **Domain-Specific Applications**: The healthcare sector has seen particularly rapid adoption, with agents being developed for clinical decision support, medical diagnosis, and healthcare administration.
|
||||
|
||||
3. **Scientific Process Automation**: Agents are being developed to automate various aspects of the research pipeline, from literature review and hypothesis generation to experimental design and data analysis.
|
||||
|
||||
### Impact and Future Directions
|
||||
|
||||
The emergence of AI agents in scientific discovery represents more than just technological advancement; it signals a fundamental shift in how science is conducted. These systems promise to:
|
||||
- Accelerate the pace of scientific discovery
|
||||
- Enable exploration of previously intractable research questions
|
||||
- Democratize access to scientific expertise
|
||||
- Foster more efficient use of research resources
|
||||
|
||||
# Awesome LLM Agents for Scientific Discovery [](https://awesome.re)
|
||||
<div align="center">
|
||||
<img src="agents4science.webp" alt="AI Agents for Scientific Discovery" width="600px">
|
||||
</div>
|
||||
|
||||
A curated list of papers about AI agents for scientific discovery and research automation.
|
||||
|
||||
|
||||
Maintained by [Jieli Zhou](mailto:[email protected])
|
||||
|
||||
If you use this paper list for your research, please cite it using:
|
||||
```bibtex
|
||||
@misc{zhou2024awesome,
|
||||
title={Awesome AI Agents for Scientific Discovery},
|
||||
author={Zhou, Jieli},
|
||||
year={2024},
|
||||
publisher={GitHub},
|
||||
journal={GitHub repository},
|
||||
howpublished={\url{https://github.com/zhoujieli/Awesome-LLM-Agents-Scientific-Discovery}}
|
||||
}
|
||||
```
|
||||
|
||||
|
||||
## Introduction
|
||||
|
||||
The convergence of large language models (LLMs) and autonomous agents has ushered in a new era in scientific discovery, fundamentally transforming how research is conducted across disciplines. This emerging paradigm, articulated in Kitano's seminal "Nobel Turing Challenge" (2021), envisions AI systems capable of making scientific discoveries worthy of Nobel Prize recognition. Recent advances in LLM-based agents have brought us closer to this vision, enabling increasingly sophisticated automation of scientific workflows and decision-making processes.
|
||||
|
||||
### Evolution and Current Landscape
|
||||
|
||||
The field has evolved rapidly since early visions of AI-driven scientific discovery. While traditional AI systems focused on narrow tasks, modern LLM-based agents demonstrate remarkable capabilities in complex scientific reasoning, experimental design, and hypothesis generation. The breakthrough capabilities of models like GPT-4 have catalyzed this transition, enabling agents to engage in sophisticated scientific discourse, interpret complex data, and even design novel experiments.
|
||||
|
||||
### Key Research Directions
|
||||
|
||||
Several major research themes have emerged in this space:
|
||||
|
||||
1. **Multi-Agent Architectures**: Research has increasingly focused on collaborative multi-agent systems, where specialized agents work together to tackle complex scientific problems.
|
||||
|
||||
2. **Domain-Specific Applications**: The healthcare sector has seen particularly rapid adoption, with agents being developed for clinical decision support, medical diagnosis, and healthcare administration.
|
||||
|
||||
3. **Scientific Process Automation**: Agents are being developed to automate various aspects of the research pipeline, from literature review and hypothesis generation to experimental design and data analysis.
|
||||
|
||||
### Impact and Future Directions
|
||||
|
||||
The emergence of AI agents in scientific discovery represents more than just technological advancement; it signals a fundamental shift in how science is conducted. These systems promise to:
|
||||
- Accelerate the pace of scientific discovery
|
||||
- Enable exploration of previously intractable research questions
|
||||
- Democratize access to scientific expertise
|
||||
- Foster more efficient use of research resources
|
||||
|
||||
## Table of Contents
|
||||
|
||||
1. [Foundations & Vision](#foundations--vision)
|
||||
2. [Core Technologies](#core-technologies)
|
||||
3. [Scientific Process Automation](#scientific-process-automation)
|
||||
4. [Domain Applications](#domain-applications)
|
||||
5. [Infrastructure & Tools](#infrastructure--tools)
|
||||
8. [AI Agent Frameworks & Tools](#ai-agent-frameworks--tools)
|
||||
6. [Evaluation & Benchmarking](#evaluation--benchmarking)
|
||||
7. [Surveys & Reviews](#surveys--reviews)
|
||||
|
||||
## Foundations & Vision
|
||||
|
||||
### Vision Papers
|
||||
- **[Nobel Turing Challenge: Creating the Engine for Scientific Discovery](https://www.nature.com/articles/s41592-021-01091-w)**
|
||||
*Hiroaki Kitano.* NPJ Systems Biology and Applications 2021
|
||||
|
||||
- **[Artificial Intelligence to Win the Nobel Prize and Beyond: Creating the Engine for Scientific Discovery](https://www.aaai.org/ojs/index.php/aimagazine/article/view/2624)**
|
||||
*Hiroaki Kitano.* AI Magazine 2016
|
||||
|
||||
- **[The AI Scientist: Towards Fully Automated Open-ended Scientific Discovery](https://arxiv.org/abs/2408.06292)**
|
||||
*Chris Lu, Cong Lu, Robert Tjarko Lange, Jakob Foerster, Jeff Clune, David Ha.* arXiv 2024
|
||||
|
||||
- **[Emergent autonomous scientific research capabilities of large language models](https://arxiv.org/abs/2304.05332)**
|
||||
*Daniil A Boiko, Robert MacKnight, Gabe Gomes.* arXiv 2023
|
||||
|
||||
- **[What is missing in autonomous discovery: open challenges for the community](https://pubs.rsc.org/en/content/articlelanding/2023/dd/d3dd00089c)**
|
||||
*Phillip M Maffettone, Pascal Friederich, Sterling G Baird, et al.* Digital Discovery 2023
|
||||
|
||||
- **[The future of fundamental science led by generative closed-loop artificial intelligence](https://arxiv.org/abs/2307.07522)**
|
||||
*Hector Zenil, Jesper Tegnér, Felipe S Abrahão, Alexander Lavin, et al.* arXiv 2023
|
||||
|
||||
## Core Technologies
|
||||
|
||||
### Multi-Agent Systems & Architectures
|
||||
- **[CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society](https://proceedings.neurips.cc/paper_files/paper/2023/hash/9a86e0c5-e09e-4ad7-96d6-b2ed61855e37-Abstract-Conference.html)**
|
||||
*Guohao Li, Hasan Hammoud, Hani Itani, Dmitrii Khizbullin, Bernard Ghanem.* NeurIPS 2023
|
||||
|
||||
- **[Dynamic LLM-Agent Network: An LLM-Agent Collaboration Framework with Agent Team Optimization](https://arxiv.org/abs/2310.02170)**
|
||||
*Zijun Liu, Yanzhe Zhang, Peng Li, Yang Liu, Diyi Yang.* arXiv 2023
|
||||
|
||||
- **[AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation Framework](https://arxiv.org/abs/2308.08155)**
|
||||
*Qingyun Wu, Gagan Bansal, Jieyu Zhang, Yiran Wu, et al.* arXiv 2023
|
||||
|
||||
### Reasoning & Knowledge Systems
|
||||
- **[Graph of Thoughts: Solving Elaborate Problems with Large Language Models](https://ojs.aaai.org/index.php/AAAI/article/view/28877)**
|
||||
*Maciej Besta, Nils Blach, Ales Kubicek, Robert Gerstenberger, et al.* AAAI 2024
|
||||
|
||||
- **[KnowAgent: Knowledge-augmented Planning for LLM-based Agents](https://arxiv.org/abs/2403.03101)**
|
||||
*Yuqi Zhu, Shuofei Qiao, Yixin Ou, Shumin Deng, et al.* arXiv 2024
|
||||
|
||||
- **[Improving Factuality and Reasoning in Language Models through Multiagent Debate](https://arxiv.org/abs/2305.14325)**
|
||||
*Yilun Du, Shuang Li, Antonio Torralba, Joshua B. Tenenbaum, Igor Mordatch.* arXiv 2023
|
||||
|
||||
## Scientific Process Automation
|
||||
|
||||
### Research Planning & Literature Review
|
||||
- **[ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Models](https://arxiv.org/abs/2404.07738)**
|
||||
*Jinheon Baek, Sujay Kumar Jauhar, Silviu Cucerzan, Sung Ju Hwang.* arXiv 2024
|
||||
|
||||
- **[SciMon: Scientific Inspiration Machines Optimized for Novelty](https://arxiv.org/abs/2305.14259)**
|
||||
*Qingyun Wang, Doug Downey, Heng Ji, Tom Hope.* arXiv 2023
|
||||
|
||||
- **[AutoSurvey: Large Language Models Can Automatically Write Surveys](https://arxiv.org/abs/2406.10252)**
|
||||
*Yidong Wang, Qi Guo, Wenjin Yao, Hongbo Zhang, et al.* arXiv 2024
|
||||
|
||||
### Experimental Design & Workflow
|
||||
- **[DISCOVERYWORLD: A Virtual Environment for Developing and Evaluating Automated Scientific Discovery Agents](https://arxiv.org/abs/2406.06769)**
|
||||
*Peter Jansen, Marc-Alexandre Côté, Tushar Khot, Erin Bransom, et al.* arXiv 2024
|
||||
|
||||
- **[Genesis: Towards the Automation of Systems Biology Research](https://arxiv.org/abs/2408.10689)**
|
||||
*Ievgeniia A Tiukova, Daniel Brunnsåker, Erik Y Bjurström, Alexander H Gower, et al.* arXiv 2024
|
||||
|
||||
- **[AutoNumerics: An Autonomous, PDE-Agnostic Multi-Agent Pipeline for Scientific Computing](https://arxiv.org/abs/2602.17607)** ([code](https://github.com/Daviddjddu/Autonumerics))
|
||||
*Jianda Du, Youran Sun, Haizhao Yang.* arXiv 2026
|
||||
|
||||
## Domain Applications
|
||||
|
||||
### Healthcare & Medicine
|
||||
|
||||
#### Clinical Decision Support & Diagnosis
|
||||
- **[MDAgents: An Adaptive Collaboration of LLMs for Medical Decision-Making](https://arxiv.org/abs/2411.00248)**
|
||||
*Yubin Kim, Chanwoo Park, Hyewon Jeong, Yik Siu Chan, et al.* NeurIPS 2024
|
||||
|
||||
- **[Beyond Direct Diagnosis: LLM-based Multi-Specialist Agent Consultation for Automatic Diagnosis](https://arxiv.org/abs/2401.16107)**
|
||||
*Haochun Wang, Sendong Zhao, Zewen Qiang, Nuwa Xi, et al.* arXiv 2024
|
||||
|
||||
- **[MedAide: Towards an Omni Medical Aide via Specialized LLM-based Multi-Agent Collaboration](https://arxiv.org/abs/2410.12532)**
|
||||
*Jinjie Wei, Dingkang Yang, Yanshu Li, Qingyao Xu, et al.* arXiv 2024
|
||||
|
||||
- **[Large Language Models as Agents in the Clinic](https://arxiv.org/abs/2309.10895)**
|
||||
*Nikita Mehandru, Brenda Y. Miao, Eduardo Rodriguez Almaraz, et al.* NPJ Digital Medicine 2024
|
||||
|
||||
- **[MAGDA: Multi-Agent Guideline-Driven Diagnostic Assistance](https://link.springer.com/chapter/10.1007/978-3-031-49673-3_15)**
|
||||
*David Bani-Harouni, Nassir Navab, Matthias Keicher.* FMGMAI 2024
|
||||
|
||||
#### Healthcare Systems & Management
|
||||
- **[ColaCare: Enhancing Electronic Health Record Modeling through Large Language Model-Driven Multi-Agent Collaboration](https://arxiv.org/abs/2410.02551)**
|
||||
*Zixiang Wang, Yinghao Zhu, Huiya Zhao, Xiaochen Zheng, et al.* arXiv 2024
|
||||
|
||||
- **[Agent Hospital: A Simulacrum of Hospital with Evolvable Medical Agents](https://arxiv.org/abs/2405.02957)**
|
||||
*Junkai Li, Siyu Wang, Meng Zhang, Weitao Li, et al.* arXiv 2024
|
||||
|
||||
- **[ClinicalLab: Aligning Agents for Multi-Departmental Clinical Diagnostics in the Real World](https://arxiv.org/abs/2406.13890)**
|
||||
*Weixiang Yan, Haitian Liu, Tengxiao Wu, Qian Chen, et al.* arXiv 2024
|
||||
|
||||
- **[AIPatient: Simulating Patients with EHRs and LLM Powered Agentic Workflow](https://arxiv.org/abs/2409.18924)**
|
||||
*Huizi Yu, Jiayan Zhou, Lingyao Li, Shan Chen, et al.* arXiv 2024
|
||||
|
||||
#### Medical Education & Training
|
||||
- **[Medco: Medical education copilots based on a multi-agent framework](https://arxiv.org/abs/2408.12496)**
|
||||
*Hao Wei, Jianing Qiu, Haibao Yu, Wu Yuan.* arXiv 2024
|
||||
|
||||
- **[AgentClinic: a multimodal agent benchmark to evaluate AI in simulated clinical environments](https://arxiv.org/abs/2405.07960)**
|
||||
*Samuel Schmidgall, Rojin Ziaei, Carl Harris, Eduardo Reis, et al.* arXiv 2024
|
||||
|
||||
#### Medical Imaging & Pathology
|
||||
- **[CXR-Agent: Vision-language models for chest X-ray interpretation with uncertainty aware radiology reporting](https://arxiv.org/abs/2407.08811)**
|
||||
*Naman Sharma.* arXiv 2024
|
||||
|
||||
- **[PathGen-1.6M: 1.6 Million Pathology Image-text Pairs Generation through Multi-agent Collaboration](https://arxiv.org/abs/2407.00203)**
|
||||
*Yuxuan Sun, Yunlong Zhang, Yixuan Si, Chenglu Zhu, et al.* arXiv 2024
|
||||
|
||||
#### Medical Research
|
||||
- **[OpenLens AI: Fully Autonomous Research Agent for Health Infomatics](https://arxiv.org/abs/2509.14778)**
|
||||
*Yuxiao Cheng, Jinli Suo* arXiv 2025, [GitHub Repo](https://github.com/jarrycyx/openlens-ai)
|
||||
|
||||
### Biology & Life Sciences
|
||||
|
||||
#### Genomics & Molecular Biology
|
||||
- **[BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments](https://arxiv.org/abs/2405.17631)**
|
||||
*Yusuf Roohani, Andrew Lee, Qian Huang, Jian Vora, et al.* arXiv 2024
|
||||
|
||||
- **[GeneAgent: Self-verification Language Agent for Gene Set Knowledge Discovery using Domain Databases](https://arxiv.org/abs/2405.16205)**
|
||||
*Zhizheng Wang, Qiao Jin, Chih-Hsuan Wei, Shubo Tian, et al.* arXiv 2024
|
||||
|
||||
- **[Large Language Models as Biomedical Hypothesis Generators: A Comprehensive Evaluation](https://arxiv.org/abs/2407.08940)**
|
||||
*Biqing Qi, Kaiyan Zhang, Kai Tian, Haoxiang Li, et al.* arXiv 2024
|
||||
|
||||
#### Bioinformatics Tools & Platforms
|
||||
- **[BIA: BioInformatics Agent - Unleashing the Power of Large Language Models to Reshape Bioinformatics Workflow](https://www.biorxiv.org/content/10.1101/2024.05.22.595240v1)**
|
||||
*Qi Xin, Quyu Kong, Hongyi Ji, Yue Shen, et al.* bioRxiv 2024
|
||||
|
||||
- **[CellAgent: An LLM-driven Multi-Agent Framework for Automated Single-cell Data Analysis](https://www.biorxiv.org/content/10.1101/2024.05.13.593861v1)**
|
||||
*Yihang Xiao, Jinyi Liu, Yan Zheng, Xiaohan Xie, et al.* bioRxiv 2024
|
||||
|
||||
- **[SeqMate: A Novel Large Language Model Pipeline for Automating RNA Sequencing](https://arxiv.org/abs/2407.03381)**
|
||||
*Devam Mondal, Atharva Inamdar.* arXiv 2024
|
||||
|
||||
- **[ChatSpatial: Schema-Enforced Agentic Orchestration for Reproducible and Cross-Platform Spatial Transcriptomics](https://doi.org/10.64898/2026.02.26.708361)**
|
||||
*Chen Yang, Xianyang Zhang, Jun Chen.* bioRxiv 2026
|
||||
An MCP server that enables spatial transcriptomics analysis via natural language, integrating 60+ methods across Python and R into a single conversational workflow. [Code](https://github.com/cafferychen777/ChatSpatial)
|
||||
|
||||
### Chemistry & Materials Science
|
||||
|
||||
#### Drug Discovery & Development
|
||||
- **[DrugAgent: Explainable Drug Repurposing Agent with Large Language Model-based Reasoning](https://arxiv.org/abs/2408.13378)**
|
||||
*Yoshitaka Inoue, Tianci Song, Tianfan Fu.* arXiv 2024
|
||||
|
||||
- **[Malade: Orchestration of LLM-powered agents with retrieval augmented generation for pharmacovigilance](https://arxiv.org/abs/2408.01869)**
|
||||
*Jihye Choi, Nils Palumbo, Prasad Chalasani, Matthew M Engelhard, et al.* arXiv 2024
|
||||
|
||||
#### Molecular Modeling & Computation
|
||||
- **[ChatMol Copilot: An Agent for Molecular Modeling and Computation Powered by LLMs](https://aclanthology.org/2024.lm-1.6/)**
|
||||
*Jinyuan Sun, Auston Li, Yifan Deng, Jiabo Li.* L+M Workshop 2024
|
||||
|
||||
- **[A review of large language models and autonomous agents in chemistry](https://arxiv.org/abs/2407.01603)**
|
||||
*Mayk Caldas Ramos, Christopher J Collison, Andrew D White.* arXiv 2024
|
||||
|
||||
### Earth & Environmental Sciences
|
||||
- **[An LLM Agent for Automatic Geospatial Data Analysis](https://arxiv.org/abs/2410.18792)**
|
||||
*Yuxing Chen, Weijie Wang, Sylvain Lobry, Camille Kurtz.* arXiv 2024
|
||||
|
||||
## Evaluation & Benchmarking
|
||||
|
||||
### General Benchmarks
|
||||
- **[ClawBench: A Comprehensive Benchmark for Evaluating AI Web Agents](https://arxiv.org/abs/2604.08523)**
|
||||
*Reacher et al.* arXiv 2026. An open benchmark for browser agents on everyday tasks across live websites, with 153 V1 and 130 V2 tasks and reproducible execution traces ([code](https://github.com/reacher-z/ClawBench), [project](https://claw-bench.com/)).
|
||||
|
||||
- **[AgentBench: Evaluating LLMs as Agents](https://arxiv.org/abs/2308.03688)**
|
||||
*Xiao Liu, Hao Yu, Hanchen Zhang, Yifan Xu, et al.* arXiv 2023
|
||||
|
||||
- **[ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debate](https://arxiv.org/abs/2308.07201)**
|
||||
*Chi-Min Chan, Weize Chen, Yusheng Su, Jianxuan Yu, et al.* arXiv 2023
|
||||
|
||||
- **[Benchmarking large language models as ai research agents](https://arxiv.org/abs/2311.12741)**
|
||||
*Qian Huang, Jian Vora, Percy Liang, Jure Leskovec.* NeurIPS 2023 Workshop
|
||||
|
||||
### Domain-Specific Benchmarks
|
||||
- **[BioKGBench: A Knowledge Graph Checking Benchmark of AI Agent for Biomedical Science](https://arxiv.org/abs/2407.00466)**
|
||||
*Xinna Lin, Siqi Ma, Junjie Shan, Xiaojing Zhang, et al.* arXiv 2024
|
||||
|
||||
- **[GenoTEX: A Benchmark for Evaluating LLM-Based Exploration of Gene Expression Data](https://arxiv.org/abs/2406.15341)**
|
||||
*Haoyang Liu, Haohan Wang.* arXiv 2024
|
||||
|
||||
- **[IdeaBench: Benchmarking Large Language Models for Research Idea Generation](https://arxiv.org/abs/2411.02429)**
|
||||
*Sikun Guo, Amir Hassan Shariatmadari, Guangzhi Xiong, Albert Huang, et al.* arXiv 2024
|
||||
|
||||
## Surveys & Reviews
|
||||
|
||||
### Comprehensive Surveys
|
||||
- **[Scientific discovery in the age of artificial intelligence](https://www.nature.com/articles/s41586-023-06221-2)**
|
||||
*Hanchen Wang, Tianfan Fu, Yuanqi Du, Wenhao Gao, Kexin Huang, et al.* Nature 2023
|
||||
|
||||
- **[The rise and potential of large language model based agents: A survey](https://arxiv.org/abs/2309.07864)**
|
||||
*Zhiheng Xi, Wenxiang Chen, Xin Guo, Wei He, et al.* arXiv 2023
|
||||
|
||||
- **[Large language model based multi-agents: A survey of progress and challenges](https://arxiv.org/abs/2402.01680)**
|
||||
*Taicheng Guo, Xiuying Chen, Yaqi Wang, Ruidi Chang, et al.* arXiv 2024
|
||||
|
||||
- **[A survey on LLM-based multi-agent systems: workflow, infrastructure, and challenges](https://link.springer.com/article/10.1007/s44223-024-00009-0)**
|
||||
*Xinyi Li, Sai Wang, Siqi Zeng, Yu Wu, Yi Yang.* Vicinagearth 2024
|
||||
|
||||
### Domain-Specific Reviews
|
||||
- **[AI for Biomedicine in the Era of Large Language Models](https://arxiv.org/abs/2403.15673)**
|
||||
*Zhenyu Bi, Sajib Acharjee Dip, Daniel Hajialigol, Sindhura Kommu, et al.* arXiv 2024
|
||||
|
||||
- **[A Survey on Medical Large Language Models: Technology, Application, Trustworthiness, and Future Directions](https://arxiv.org/abs/2406.03712)**
|
||||
*Lei Liu, Xiaoyan Yang, Junchi Lei, Xiaoyang Liu, et al.* arXiv 2024
|
||||
|
||||
- **[From LLMs to LLM-based Agents for Software Engineering: A Survey](https://arxiv.org/abs/2408.02479)**
|
||||
*Haolin Jin, Linghan Huang, Haipeng Cai, Jun Yan, et al.* arXiv 2024
|
||||
|
||||
## AI Agent Frameworks & Tools
|
||||
|
||||
- **[Bride](https://tools.gracestack.se/bride-live.html)** — Cognitive AI agent with Active Inference, HDC, and anomaly detection for hypothesis generation. [Rust, MIT] `2026`
|
||||
|
||||
## Contributing
|
||||
|
||||
Please feel free to send a pull request if you want to:
|
||||
- Add new papers
|
||||
- Fix errors
|
||||
- Update paper information
|
||||
|
||||
## License
|
||||
|
||||
[](https://creativecommons.org/publicdomain/zero/1.0/)
|
||||
|
||||
|
||||
|
||||
|
||||
Reference in New Issue
Block a user