使用 Python -m build打包 Python 项目：详解过程与细节

使用 Python -m build 打包 Python 项目：详解过程与细节

Python 项目的打包是发布和分发软件的核心环节。本文将基于用户提供的 pyproject.toml 文件和项目目录结构，详细说明 Python -m build 命令的执行过程，并解答 是否会将 oe_eval 中的代码打包 的问题。

1. 项目目录结构简析

来源： https://github.com/allenai/olmes

(olmes) (base)@test:~/test$ tree -L 2 olmes/
olmes/
├── LICENSE
├── oe_eval
│   ├── components
│   ├── configs
│   ├── data
│   ├── default_configs.py
│   ├── dependencies
│   ├── __init__.py
│   ├── launch.py
│   ├── metrics
│   ├── models
│   ├── py.typed
│   ├── run_eval.py
│   ├── tasks
│   ├── utilities
│   ├── utils.py
│   └── version.py
├── OUTPUT_FORMATS.md
├── pyproject.toml
└── README.md

9 directories, 11 files

项目名为 olmes，核心模块位于 oe_eval 文件夹中。根据目录结构和 pyproject.toml 文件配置，oe_eval 包含以下内容：

• 代码模块：如 launch.py、run_eval.py 和子目录 models、tasks 等。
• 元数据文件：如 py.typed、version.py。
• 配置文件：default_configs.py 和其他子目录。

此外，项目根目录还包括 pyproject.toml、README.md、LICENSE 等。

2. pyproject.toml 文件的重要配置

pyproject.toml 是现代 Python 项目打包的核心配置文件，其关键部分包括：

1. 构建系统声明

   [build-system]
   requires = ["setuptools", "wheel"]
   build-backend = "setuptools.build_meta"
   

   • 指定使用 setuptools 和 wheel 完成打包。
   • build-backend 决定了构建逻辑。

2. 项目配置

   [project]
   name = "ai2-olmes"
   dynamic = ["version"]
   readme = "README.md"
   dependencies = ["numpy<2", "torch>=2.2,<2.5", ...]
   

   • 项目名为 ai2-olmes，动态版本号由 oe_eval.version.VERSION 提供。
   • dependencies 列出了安装依赖。

3. 打包规则

   [tool.setuptools.packages.find]
   exclude = [
       "*.tests", "*.tests.*", "tests.*", "tests", "docs*", "scripts*"
   ]
   

   • 使用 find_packages 查找项目包。
   • 排除了测试、文档和脚本相关目录。

4. 包数据

   [tool.setuptools.package-data]
   olmes = ["py.typed"]
   

   • 包含类型标注文件 py.typed。

3. Python -m build 命令详解

Python -m build 是构建 Python 分发包的工具，分为以下步骤：

1. 安装构建工具

   • 命令：pip install build
   • 确保安装了 build 包。

2. 执行构建
   在项目根目录运行：

   python -m build
   

   • 此命令会读取 pyproject.toml 配置，生成以下两类分发包：
     • 源代码分发包 (Source Distribution, .tar.gz)
     • 已构建分发包 (Built Distribution, .whl)

3. 具体执行过程

   • 解析配置：读取 pyproject.toml，加载 setuptools 作为构建工具。
   • 收集包内容：
     • 使用 find_packages 自动定位需要打包的目录，如 oe_eval。
     • 排除测试和文档目录。
   • 生成元数据：包含项目名、版本、依赖等信息。
   • 构建分发包：根据配置生成 .tar.gz 和 .whl 文件。

4. 是否会打包 oe_eval 目录中的代码？

根据 pyproject.toml 和项目结构：

• find_packages 默认会查找所有符合条件的子包和模块。
• 由于 oe_eval 是项目的核心模块，且未被 exclude 排除，因此会被打包。
• 打包后，oe_eval 中的代码将包含在 .tar.gz 和 .whl 文件中。

打包之后的结果：

后记

2024年12月30日18点52分于上海，在GPT4o大模型辅助下完成。

附录：具体打包过程

(olmes)@test:~/test$ ls
olmes
(olmes) (base) @test:~/test$ python -m build
* Creating isolated environment: venv+pip...
ERROR Source /test does not appear to be a Python project: no pyproject.toml or setup.py
(olmes) (base) @test:~/test$ cd olmes/
(olmes) (base) @test:~/test/olmes$ python -m build
* Creating isolated environment: venv+pip...
* Installing packages in isolated environment:
  - setuptools
  - wheel
* Getting build dependencies for sdist...
running egg_info
creating ai2_olmes.egg-info
writing ai2_olmes.egg-info/PKG-INFO
writing dependency_links to ai2_olmes.egg-info/dependency_links.txt
writing entry points to ai2_olmes.egg-info/entry_points.txt
writing requirements to ai2_olmes.egg-info/requires.txt
writing top-level names to ai2_olmes.egg-info/top_level.txt
writing manifest file 'ai2_olmes.egg-info/SOURCES.txt'
reading manifest file 'ai2_olmes.egg-info/SOURCES.txt'
adding license file 'LICENSE'
writing manifest file 'ai2_olmes.egg-info/SOURCES.txt'
* Building sdist...
running sdist
running egg_info
writing ai2_olmes.egg-info/PKG-INFO
writing dependency_links to ai2_olmes.egg-info/dependency_links.txt
writing entry points to ai2_olmes.egg-info/entry_points.txt
writing requirements to ai2_olmes.egg-info/requires.txt
writing top-level names to ai2_olmes.egg-info/top_level.txt
reading manifest file 'ai2_olmes.egg-info/SOURCES.txt'
adding license file 'LICENSE'
writing manifest file 'ai2_olmes.egg-info/SOURCES.txt'
running check
creating ai2_olmes-0.1.0
creating ai2_olmes-0.1.0/ai2_olmes.egg-info
creating ai2_olmes-0.1.0/oe_eval
creating ai2_olmes-0.1.0/oe_eval/components
creating ai2_olmes-0.1.0/oe_eval/configs
creating ai2_olmes-0.1.0/oe_eval/data
creating ai2_olmes-0.1.0/oe_eval/dependencies/AGIEval/src
creating ai2_olmes-0.1.0/oe_eval/dependencies/drop
creating ai2_olmes-0.1.0/oe_eval/dependencies/hf_evaluate
creating ai2_olmes-0.1.0/oe_eval/dependencies/ifeval
creating ai2_olmes-0.1.0/oe_eval/dependencies/squad
creating ai2_olmes-0.1.0/oe_eval/metrics
creating ai2_olmes-0.1.0/oe_eval/metrics/code_evals
creating ai2_olmes-0.1.0/oe_eval/models
creating ai2_olmes-0.1.0/oe_eval/tasks
creating ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
creating ai2_olmes-0.1.0/oe_eval/utilities
copying files to ai2_olmes-0.1.0...
copying LICENSE -> ai2_olmes-0.1.0
copying README.md -> ai2_olmes-0.1.0
copying pyproject.toml -> ai2_olmes-0.1.0
copying ai2_olmes.egg-info/PKG-INFO -> ai2_olmes-0.1.0/ai2_olmes.egg-info
copying ai2_olmes.egg-info/SOURCES.txt -> ai2_olmes-0.1.0/ai2_olmes.egg-info
copying ai2_olmes.egg-info/dependency_links.txt -> ai2_olmes-0.1.0/ai2_olmes.egg-info
copying ai2_olmes.egg-info/entry_points.txt -> ai2_olmes-0.1.0/ai2_olmes.egg-info
copying ai2_olmes.egg-info/requires.txt -> ai2_olmes-0.1.0/ai2_olmes.egg-info
copying ai2_olmes.egg-info/top_level.txt -> ai2_olmes-0.1.0/ai2_olmes.egg-info
copying oe_eval/__init__.py -> ai2_olmes-0.1.0/oe_eval
copying oe_eval/default_configs.py -> ai2_olmes-0.1.0/oe_eval
copying oe_eval/launch.py -> ai2_olmes-0.1.0/oe_eval
copying oe_eval/py.typed -> ai2_olmes-0.1.0/oe_eval
copying oe_eval/run_eval.py -> ai2_olmes-0.1.0/oe_eval
copying oe_eval/utils.py -> ai2_olmes-0.1.0/oe_eval
copying oe_eval/version.py -> ai2_olmes-0.1.0/oe_eval
copying oe_eval/components/instances.py -> ai2_olmes-0.1.0/oe_eval/components
copying oe_eval/components/requests.py -> ai2_olmes-0.1.0/oe_eval/components
copying oe_eval/configs/models.py -> ai2_olmes-0.1.0/oe_eval/configs
copying oe_eval/configs/task_suites.py -> ai2_olmes-0.1.0/oe_eval/configs
copying oe_eval/configs/tasks.py -> ai2_olmes-0.1.0/oe_eval/configs
copying oe_eval/configs/utils.py -> ai2_olmes-0.1.0/oe_eval/configs
copying oe_eval/data/__init__.py -> ai2_olmes-0.1.0/oe_eval/data
copying oe_eval/data/agi_eval_tasks.py -> ai2_olmes-0.1.0/oe_eval/data
copying oe_eval/data/bbh_tasks.py -> ai2_olmes-0.1.0/oe_eval/data
copying oe_eval/data/deepmind_math_categories.py -> ai2_olmes-0.1.0/oe_eval/data
copying oe_eval/data/hendrycks_math_split.py -> ai2_olmes-0.1.0/oe_eval/data
copying oe_eval/data/math_task_types.py -> ai2_olmes-0.1.0/oe_eval/data
copying oe_eval/data/mmlu_pro_categories.py -> ai2_olmes-0.1.0/oe_eval/data
copying oe_eval/data/mmlu_tasks.py -> ai2_olmes-0.1.0/oe_eval/data
copying oe_eval/data/mt_eval_tasks.py -> ai2_olmes-0.1.0/oe_eval/data
copying oe_eval/data/tydiqa_languages.py -> ai2_olmes-0.1.0/oe_eval/data
copying oe_eval/data/zero_scrolls_tasks.py -> ai2_olmes-0.1.0/oe_eval/data
copying oe_eval/dependencies/AGIEval/src/__init__.py -> ai2_olmes-0.1.0/oe_eval/dependencies/AGIEval/src
copying oe_eval/dependencies/AGIEval/src/constructions.py -> ai2_olmes-0.1.0/oe_eval/dependencies/AGIEval/src
copying oe_eval/dependencies/AGIEval/src/dataset_loader.py -> ai2_olmes-0.1.0/oe_eval/dependencies/AGIEval/src
copying oe_eval/dependencies/AGIEval/src/evaluation.py -> ai2_olmes-0.1.0/oe_eval/dependencies/AGIEval/src
copying oe_eval/dependencies/AGIEval/src/math_equivalence.py -> ai2_olmes-0.1.0/oe_eval/dependencies/AGIEval/src
copying oe_eval/dependencies/AGIEval/src/post_process.py -> ai2_olmes-0.1.0/oe_eval/dependencies/AGIEval/src
copying oe_eval/dependencies/AGIEval/src/utils.py -> ai2_olmes-0.1.0/oe_eval/dependencies/AGIEval/src
copying oe_eval/dependencies/drop/process_results.py -> ai2_olmes-0.1.0/oe_eval/dependencies/drop
copying oe_eval/dependencies/hf_evaluate/exact_match.py -> ai2_olmes-0.1.0/oe_eval/dependencies/hf_evaluate
copying oe_eval/dependencies/ifeval/__init__.py -> ai2_olmes-0.1.0/oe_eval/dependencies/ifeval
copying oe_eval/dependencies/ifeval/instructions.py -> ai2_olmes-0.1.0/oe_eval/dependencies/ifeval
copying oe_eval/dependencies/ifeval/instructions_registry.py -> ai2_olmes-0.1.0/oe_eval/dependencies/ifeval
copying oe_eval/dependencies/ifeval/instructions_util.py -> ai2_olmes-0.1.0/oe_eval/dependencies/ifeval
copying oe_eval/dependencies/ifeval/utils.py -> ai2_olmes-0.1.0/oe_eval/dependencies/ifeval
copying oe_eval/dependencies/squad/squad_emf1.py -> ai2_olmes-0.1.0/oe_eval/dependencies/squad
copying oe_eval/metrics/__init__.py -> ai2_olmes-0.1.0/oe_eval/metrics
copying oe_eval/metrics/llm_judge.py -> ai2_olmes-0.1.0/oe_eval/metrics
copying oe_eval/metrics/metric.py -> ai2_olmes-0.1.0/oe_eval/metrics
copying oe_eval/metrics/metric_utils.py -> ai2_olmes-0.1.0/oe_eval/metrics
copying oe_eval/metrics/code_evals/code_eval_routes.py -> ai2_olmes-0.1.0/oe_eval/metrics/code_evals
copying oe_eval/metrics/code_evals/code_execution_local.py -> ai2_olmes-0.1.0/oe_eval/metrics/code_evals
copying oe_eval/metrics/code_evals/code_execution_remote.py -> ai2_olmes-0.1.0/oe_eval/metrics/code_evals
copying oe_eval/metrics/code_evals/sanitize.py -> ai2_olmes-0.1.0/oe_eval/metrics/code_evals
copying oe_eval/models/__init__.py -> ai2_olmes-0.1.0/oe_eval/models
copying oe_eval/models/eleuther_huggingface.py -> ai2_olmes-0.1.0/oe_eval/models
copying oe_eval/models/eleuther_vllm_causallms.py -> ai2_olmes-0.1.0/oe_eval/models
copying oe_eval/models/litellm.py -> ai2_olmes-0.1.0/oe_eval/models
copying oe_eval/tasks/__init__.py -> ai2_olmes-0.1.0/oe_eval/tasks
copying oe_eval/tasks/aggregate_tasks.py -> ai2_olmes-0.1.0/oe_eval/tasks
copying oe_eval/tasks/base_task.py -> ai2_olmes-0.1.0/oe_eval/tasks
copying oe_eval/tasks/chat_templates.py -> ai2_olmes-0.1.0/oe_eval/tasks
copying oe_eval/tasks/eleuther_task.py -> ai2_olmes-0.1.0/oe_eval/tasks
copying oe_eval/tasks/fewshot_sources.py -> ai2_olmes-0.1.0/oe_eval/tasks
copying oe_eval/tasks/utils.py -> ai2_olmes-0.1.0/oe_eval/tasks
copying oe_eval/tasks/oe_eval_tasks/__init__.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/agi_eval.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/alpaca_eval.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/arc.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/bbh.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/boolq.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/codex_bigcodebench.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/codex_humaneval.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/codex_mbpp.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/copa.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/copycolors.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/coqa.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/cosmosqa.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/csqa.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/deepmind_math.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/drop.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/gpqa.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/gsm8k.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/hellaswag.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/ifeval.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/jeopardy.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/logiqa.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/minerva_math.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/mmlu.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/mmlu_pro.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/mt_eval.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/naturalqs_open.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/openbookqa.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/piqa.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/popqa.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/sciq.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/siqa.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/squad.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/squad2.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/triviaqa.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/truthfulqa.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/tydiqa.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/winogrande.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/zero_scrolls.py -> ai2_olmes-0.1.0/oe_eval/tasks/oe_eval_tasks
copying oe_eval/utilities/__init__.py -> ai2_olmes-0.1.0/oe_eval/utilities
copying oe_eval/utilities/gsheet_writing.py -> ai2_olmes-0.1.0/oe_eval/utilities
copying oe_eval/utilities/hf_hub_writing.py -> ai2_olmes-0.1.0/oe_eval/utilities
copying oe_eval/utilities/model_results_collation.py -> ai2_olmes-0.1.0/oe_eval/utilities
copying oe_eval/utilities/remote_utils.py -> ai2_olmes-0.1.0/oe_eval/utilities
copying oe_eval/utilities/rtest_helpers.py -> ai2_olmes-0.1.0/oe_eval/utilities
copying oe_eval/utilities/wandb_writing.py -> ai2_olmes-0.1.0/oe_eval/utilities
copying ai2_olmes.egg-info/SOURCES.txt -> ai2_olmes-0.1.0/ai2_olmes.egg-info
Writing ai2_olmes-0.1.0/setup.cfg
Creating tar archive
removing 'ai2_olmes-0.1.0' (and everything under it)
* Building wheel from sdist
* Creating isolated environment: venv+pip...
* Installing packages in isolated environment:
  - setuptools
  - wheel
* Getting build dependencies for wheel...
running egg_info
writing ai2_olmes.egg-info/PKG-INFO
writing dependency_links to ai2_olmes.egg-info/dependency_links.txt
writing entry points to ai2_olmes.egg-info/entry_points.txt
writing requirements to ai2_olmes.egg-info/requires.txt
writing top-level names to ai2_olmes.egg-info/top_level.txt
reading manifest file 'ai2_olmes.egg-info/SOURCES.txt'
adding license file 'LICENSE'
writing manifest file 'ai2_olmes.egg-info/SOURCES.txt'
* Building wheel...
running bdist_wheel
running build
running build_py
creating build/lib/oe_eval
copying oe_eval/run_eval.py -> build/lib/oe_eval
copying oe_eval/version.py -> build/lib/oe_eval
copying oe_eval/utils.py -> build/lib/oe_eval
copying oe_eval/default_configs.py -> build/lib/oe_eval
copying oe_eval/__init__.py -> build/lib/oe_eval
copying oe_eval/launch.py -> build/lib/oe_eval
creating build/lib/oe_eval/configs
copying oe_eval/configs/utils.py -> build/lib/oe_eval/configs
copying oe_eval/configs/task_suites.py -> build/lib/oe_eval/configs
copying oe_eval/configs/tasks.py -> build/lib/oe_eval/configs
copying oe_eval/configs/models.py -> build/lib/oe_eval/configs
creating build/lib/oe_eval/data
copying oe_eval/data/hendrycks_math_split.py -> build/lib/oe_eval/data
copying oe_eval/data/agi_eval_tasks.py -> build/lib/oe_eval/data
copying oe_eval/data/bbh_tasks.py -> build/lib/oe_eval/data
copying oe_eval/data/zero_scrolls_tasks.py -> build/lib/oe_eval/data
copying oe_eval/data/tydiqa_languages.py -> build/lib/oe_eval/data
copying oe_eval/data/mmlu_pro_categories.py -> build/lib/oe_eval/data
copying oe_eval/data/__init__.py -> build/lib/oe_eval/data
copying oe_eval/data/math_task_types.py -> build/lib/oe_eval/data
copying oe_eval/data/mt_eval_tasks.py -> build/lib/oe_eval/data
copying oe_eval/data/deepmind_math_categories.py -> build/lib/oe_eval/data
copying oe_eval/data/mmlu_tasks.py -> build/lib/oe_eval/data
creating build/lib/oe_eval/models
copying oe_eval/models/litellm.py -> build/lib/oe_eval/models
copying oe_eval/models/eleuther_huggingface.py -> build/lib/oe_eval/models
copying oe_eval/models/eleuther_vllm_causallms.py -> build/lib/oe_eval/models
copying oe_eval/models/__init__.py -> build/lib/oe_eval/models
creating build/lib/oe_eval/tasks
copying oe_eval/tasks/base_task.py -> build/lib/oe_eval/tasks
copying oe_eval/tasks/utils.py -> build/lib/oe_eval/tasks
copying oe_eval/tasks/chat_templates.py -> build/lib/oe_eval/tasks
copying oe_eval/tasks/__init__.py -> build/lib/oe_eval/tasks
copying oe_eval/tasks/fewshot_sources.py -> build/lib/oe_eval/tasks
copying oe_eval/tasks/aggregate_tasks.py -> build/lib/oe_eval/tasks
copying oe_eval/tasks/eleuther_task.py -> build/lib/oe_eval/tasks
creating build/lib/oe_eval/utilities
copying oe_eval/utilities/gsheet_writing.py -> build/lib/oe_eval/utilities
copying oe_eval/utilities/remote_utils.py -> build/lib/oe_eval/utilities
copying oe_eval/utilities/wandb_writing.py -> build/lib/oe_eval/utilities
copying oe_eval/utilities/hf_hub_writing.py -> build/lib/oe_eval/utilities
copying oe_eval/utilities/__init__.py -> build/lib/oe_eval/utilities
copying oe_eval/utilities/model_results_collation.py -> build/lib/oe_eval/utilities
copying oe_eval/utilities/rtest_helpers.py -> build/lib/oe_eval/utilities
creating build/lib/oe_eval/metrics
copying oe_eval/metrics/metric_utils.py -> build/lib/oe_eval/metrics
copying oe_eval/metrics/__init__.py -> build/lib/oe_eval/metrics
copying oe_eval/metrics/llm_judge.py -> build/lib/oe_eval/metrics
copying oe_eval/metrics/metric.py -> build/lib/oe_eval/metrics
creating build/lib/oe_eval/components
copying oe_eval/components/instances.py -> build/lib/oe_eval/components
copying oe_eval/components/requests.py -> build/lib/oe_eval/components
creating build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/minerva_math.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/codex_mbpp.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/squad2.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/openbookqa.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/gpqa.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/ifeval.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/coqa.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/sciq.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/mmlu_pro.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/popqa.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/logiqa.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/deepmind_math.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/cosmosqa.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/winogrande.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/drop.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/mmlu.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/alpaca_eval.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/jeopardy.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/copa.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/truthfulqa.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/csqa.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/codex_humaneval.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/agi_eval.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/gsm8k.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/siqa.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/boolq.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/piqa.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/squad.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/__init__.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/triviaqa.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/hellaswag.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/naturalqs_open.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/tydiqa.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/codex_bigcodebench.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/bbh.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/copycolors.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/zero_scrolls.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/mt_eval.py -> build/lib/oe_eval/tasks/oe_eval_tasks
copying oe_eval/tasks/oe_eval_tasks/arc.py -> build/lib/oe_eval/tasks/oe_eval_tasks
creating build/lib/oe_eval/dependencies/drop
copying oe_eval/dependencies/drop/process_results.py -> build/lib/oe_eval/dependencies/drop
creating build/lib/oe_eval/dependencies/ifeval
copying oe_eval/dependencies/ifeval/instructions_registry.py -> build/lib/oe_eval/dependencies/ifeval
copying oe_eval/dependencies/ifeval/utils.py -> build/lib/oe_eval/dependencies/ifeval
copying oe_eval/dependencies/ifeval/instructions.py -> build/lib/oe_eval/dependencies/ifeval
copying oe_eval/dependencies/ifeval/__init__.py -> build/lib/oe_eval/dependencies/ifeval
copying oe_eval/dependencies/ifeval/instructions_util.py -> build/lib/oe_eval/dependencies/ifeval
creating build/lib/oe_eval/dependencies/hf_evaluate
copying oe_eval/dependencies/hf_evaluate/exact_match.py -> build/lib/oe_eval/dependencies/hf_evaluate
creating build/lib/oe_eval/dependencies/squad
copying oe_eval/dependencies/squad/squad_emf1.py -> build/lib/oe_eval/dependencies/squad
creating build/lib/oe_eval/dependencies/AGIEval/src
copying oe_eval/dependencies/AGIEval/src/utils.py -> build/lib/oe_eval/dependencies/AGIEval/src
copying oe_eval/dependencies/AGIEval/src/dataset_loader.py -> build/lib/oe_eval/dependencies/AGIEval/src
copying oe_eval/dependencies/AGIEval/src/post_process.py -> build/lib/oe_eval/dependencies/AGIEval/src
copying oe_eval/dependencies/AGIEval/src/constructions.py -> build/lib/oe_eval/dependencies/AGIEval/src
copying oe_eval/dependencies/AGIEval/src/__init__.py -> build/lib/oe_eval/dependencies/AGIEval/src
copying oe_eval/dependencies/AGIEval/src/math_equivalence.py -> build/lib/oe_eval/dependencies/AGIEval/src
copying oe_eval/dependencies/AGIEval/src/evaluation.py -> build/lib/oe_eval/dependencies/AGIEval/src
creating build/lib/oe_eval/metrics/code_evals
copying oe_eval/metrics/code_evals/sanitize.py -> build/lib/oe_eval/metrics/code_evals
copying oe_eval/metrics/code_evals/code_eval_routes.py -> build/lib/oe_eval/metrics/code_evals
copying oe_eval/metrics/code_evals/code_execution_local.py -> build/lib/oe_eval/metrics/code_evals
copying oe_eval/metrics/code_evals/code_execution_remote.py -> build/lib/oe_eval/metrics/code_evals
running egg_info
writing ai2_olmes.egg-info/PKG-INFO
writing dependency_links to ai2_olmes.egg-info/dependency_links.txt
writing entry points to ai2_olmes.egg-info/entry_points.txt
writing requirements to ai2_olmes.egg-info/requires.txt
writing top-level names to ai2_olmes.egg-info/top_level.txt
reading manifest file 'ai2_olmes.egg-info/SOURCES.txt'
adding license file 'LICENSE'
writing manifest file 'ai2_olmes.egg-info/SOURCES.txt'
copying oe_eval/py.typed -> build/lib/oe_eval
installing to build/bdist.linux-x86_64/wheel
running install
running install_lib
creating build/bdist.linux-x86_64/wheel
creating build/bdist.linux-x86_64/wheel/oe_eval
creating build/bdist.linux-x86_64/wheel/oe_eval/configs
copying build/lib/oe_eval/configs/utils.py -> build/bdist.linux-x86_64/wheel/./oe_eval/configs
copying build/lib/oe_eval/configs/task_suites.py -> build/bdist.linux-x86_64/wheel/./oe_eval/configs
copying build/lib/oe_eval/configs/tasks.py -> build/bdist.linux-x86_64/wheel/./oe_eval/configs
copying build/lib/oe_eval/configs/models.py -> build/bdist.linux-x86_64/wheel/./oe_eval/configs
copying build/lib/oe_eval/run_eval.py -> build/bdist.linux-x86_64/wheel/./oe_eval
creating build/bdist.linux-x86_64/wheel/oe_eval/data
copying build/lib/oe_eval/data/hendrycks_math_split.py -> build/bdist.linux-x86_64/wheel/./oe_eval/data
copying build/lib/oe_eval/data/agi_eval_tasks.py -> build/bdist.linux-x86_64/wheel/./oe_eval/data
copying build/lib/oe_eval/data/bbh_tasks.py -> build/bdist.linux-x86_64/wheel/./oe_eval/data
copying build/lib/oe_eval/data/zero_scrolls_tasks.py -> build/bdist.linux-x86_64/wheel/./oe_eval/data
copying build/lib/oe_eval/data/tydiqa_languages.py -> build/bdist.linux-x86_64/wheel/./oe_eval/data
copying build/lib/oe_eval/data/mmlu_pro_categories.py -> build/bdist.linux-x86_64/wheel/./oe_eval/data
copying build/lib/oe_eval/data/__init__.py -> build/bdist.linux-x86_64/wheel/./oe_eval/data
copying build/lib/oe_eval/data/math_task_types.py -> build/bdist.linux-x86_64/wheel/./oe_eval/data
copying build/lib/oe_eval/data/mt_eval_tasks.py -> build/bdist.linux-x86_64/wheel/./oe_eval/data
copying build/lib/oe_eval/data/deepmind_math_categories.py -> build/bdist.linux-x86_64/wheel/./oe_eval/data
copying build/lib/oe_eval/data/mmlu_tasks.py -> build/bdist.linux-x86_64/wheel/./oe_eval/data
creating build/bdist.linux-x86_64/wheel/oe_eval/models
copying build/lib/oe_eval/models/litellm.py -> build/bdist.linux-x86_64/wheel/./oe_eval/models
copying build/lib/oe_eval/models/eleuther_huggingface.py -> build/bdist.linux-x86_64/wheel/./oe_eval/models
copying build/lib/oe_eval/models/eleuther_vllm_causallms.py -> build/bdist.linux-x86_64/wheel/./oe_eval/models
copying build/lib/oe_eval/models/__init__.py -> build/bdist.linux-x86_64/wheel/./oe_eval/models
creating build/bdist.linux-x86_64/wheel/oe_eval/tasks
copying build/lib/oe_eval/tasks/base_task.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks
creating build/bdist.linux-x86_64/wheel/oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/minerva_math.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/codex_mbpp.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/squad2.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/openbookqa.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/gpqa.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/ifeval.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/coqa.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/sciq.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/mmlu_pro.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/popqa.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/logiqa.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/deepmind_math.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/cosmosqa.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/winogrande.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/drop.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/mmlu.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/alpaca_eval.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/jeopardy.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/copa.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/truthfulqa.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/csqa.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/codex_humaneval.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/agi_eval.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/gsm8k.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/siqa.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/boolq.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/piqa.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/squad.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/__init__.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/triviaqa.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/hellaswag.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/naturalqs_open.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/tydiqa.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/codex_bigcodebench.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/bbh.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/copycolors.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/zero_scrolls.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/mt_eval.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/oe_eval_tasks/arc.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks/oe_eval_tasks
copying build/lib/oe_eval/tasks/utils.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks
copying build/lib/oe_eval/tasks/chat_templates.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks
copying build/lib/oe_eval/tasks/__init__.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks
copying build/lib/oe_eval/tasks/fewshot_sources.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks
copying build/lib/oe_eval/tasks/aggregate_tasks.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks
copying build/lib/oe_eval/tasks/eleuther_task.py -> build/bdist.linux-x86_64/wheel/./oe_eval/tasks
copying build/lib/oe_eval/version.py -> build/bdist.linux-x86_64/wheel/./oe_eval
creating build/bdist.linux-x86_64/wheel/oe_eval/utilities
copying build/lib/oe_eval/utilities/gsheet_writing.py -> build/bdist.linux-x86_64/wheel/./oe_eval/utilities
copying build/lib/oe_eval/utilities/remote_utils.py -> build/bdist.linux-x86_64/wheel/./oe_eval/utilities
copying build/lib/oe_eval/utilities/wandb_writing.py -> build/bdist.linux-x86_64/wheel/./oe_eval/utilities
copying build/lib/oe_eval/utilities/hf_hub_writing.py -> build/bdist.linux-x86_64/wheel/./oe_eval/utilities
copying build/lib/oe_eval/utilities/__init__.py -> build/bdist.linux-x86_64/wheel/./oe_eval/utilities
copying build/lib/oe_eval/utilities/model_results_collation.py -> build/bdist.linux-x86_64/wheel/./oe_eval/utilities
copying build/lib/oe_eval/utilities/rtest_helpers.py -> build/bdist.linux-x86_64/wheel/./oe_eval/utilities
copying build/lib/oe_eval/utils.py -> build/bdist.linux-x86_64/wheel/./oe_eval
creating build/bdist.linux-x86_64/wheel/oe_eval/dependencies
creating build/bdist.linux-x86_64/wheel/oe_eval/dependencies/drop
copying build/lib/oe_eval/dependencies/drop/process_results.py -> build/bdist.linux-x86_64/wheel/./oe_eval/dependencies/drop
creating build/bdist.linux-x86_64/wheel/oe_eval/dependencies/AGIEval
creating build/bdist.linux-x86_64/wheel/oe_eval/dependencies/AGIEval/src
copying build/lib/oe_eval/dependencies/AGIEval/src/utils.py -> build/bdist.linux-x86_64/wheel/./oe_eval/dependencies/AGIEval/src
copying build/lib/oe_eval/dependencies/AGIEval/src/dataset_loader.py -> build/bdist.linux-x86_64/wheel/./oe_eval/dependencies/AGIEval/src
copying build/lib/oe_eval/dependencies/AGIEval/src/post_process.py -> build/bdist.linux-x86_64/wheel/./oe_eval/dependencies/AGIEval/src
copying build/lib/oe_eval/dependencies/AGIEval/src/constructions.py -> build/bdist.linux-x86_64/wheel/./oe_eval/dependencies/AGIEval/src
copying build/lib/oe_eval/dependencies/AGIEval/src/__init__.py -> build/bdist.linux-x86_64/wheel/./oe_eval/dependencies/AGIEval/src
copying build/lib/oe_eval/dependencies/AGIEval/src/math_equivalence.py -> build/bdist.linux-x86_64/wheel/./oe_eval/dependencies/AGIEval/src
copying build/lib/oe_eval/dependencies/AGIEval/src/evaluation.py -> build/bdist.linux-x86_64/wheel/./oe_eval/dependencies/AGIEval/src
creating build/bdist.linux-x86_64/wheel/oe_eval/dependencies/ifeval
copying build/lib/oe_eval/dependencies/ifeval/instructions_registry.py -> build/bdist.linux-x86_64/wheel/./oe_eval/dependencies/ifeval
copying build/lib/oe_eval/dependencies/ifeval/utils.py -> build/bdist.linux-x86_64/wheel/./oe_eval/dependencies/ifeval
copying build/lib/oe_eval/dependencies/ifeval/instructions.py -> build/bdist.linux-x86_64/wheel/./oe_eval/dependencies/ifeval
copying build/lib/oe_eval/dependencies/ifeval/__init__.py -> build/bdist.linux-x86_64/wheel/./oe_eval/dependencies/ifeval
copying build/lib/oe_eval/dependencies/ifeval/instructions_util.py -> build/bdist.linux-x86_64/wheel/./oe_eval/dependencies/ifeval
creating build/bdist.linux-x86_64/wheel/oe_eval/dependencies/hf_evaluate
copying build/lib/oe_eval/dependencies/hf_evaluate/exact_match.py -> build/bdist.linux-x86_64/wheel/./oe_eval/dependencies/hf_evaluate
creating build/bdist.linux-x86_64/wheel/oe_eval/dependencies/squad
copying build/lib/oe_eval/dependencies/squad/squad_emf1.py -> build/bdist.linux-x86_64/wheel/./oe_eval/dependencies/squad
copying build/lib/oe_eval/default_configs.py -> build/bdist.linux-x86_64/wheel/./oe_eval
copying build/lib/oe_eval/py.typed -> build/bdist.linux-x86_64/wheel/./oe_eval
copying build/lib/oe_eval/__init__.py -> build/bdist.linux-x86_64/wheel/./oe_eval
creating build/bdist.linux-x86_64/wheel/oe_eval/metrics
copying build/lib/oe_eval/metrics/metric_utils.py -> build/bdist.linux-x86_64/wheel/./oe_eval/metrics
creating build/bdist.linux-x86_64/wheel/oe_eval/metrics/code_evals
copying build/lib/oe_eval/metrics/code_evals/sanitize.py -> build/bdist.linux-x86_64/wheel/./oe_eval/metrics/code_evals
copying build/lib/oe_eval/metrics/code_evals/code_eval_routes.py -> build/bdist.linux-x86_64/wheel/./oe_eval/metrics/code_evals
copying build/lib/oe_eval/metrics/code_evals/code_execution_local.py -> build/bdist.linux-x86_64/wheel/./oe_eval/metrics/code_evals
copying build/lib/oe_eval/metrics/code_evals/code_execution_remote.py -> build/bdist.linux-x86_64/wheel/./oe_eval/metrics/code_evals
copying build/lib/oe_eval/metrics/__init__.py -> build/bdist.linux-x86_64/wheel/./oe_eval/metrics
copying build/lib/oe_eval/metrics/llm_judge.py -> build/bdist.linux-x86_64/wheel/./oe_eval/metrics
copying build/lib/oe_eval/metrics/metric.py -> build/bdist.linux-x86_64/wheel/./oe_eval/metrics
creating build/bdist.linux-x86_64/wheel/oe_eval/components
copying build/lib/oe_eval/components/instances.py -> build/bdist.linux-x86_64/wheel/./oe_eval/components
copying build/lib/oe_eval/components/requests.py -> build/bdist.linux-x86_64/wheel/./oe_eval/components
copying build/lib/oe_eval/launch.py -> build/bdist.linux-x86_64/wheel/./oe_eval
running install_egg_info
Copying ai2_olmes.egg-info to build/bdist.linux-x86_64/wheel/./ai2_olmes-0.1.0-py3.10.egg-info
running install_scripts
creating build/bdist.linux-x86_64/wheel/ai2_olmes-0.1.0.dist-info/WHEEL
creating '/data/lishizheng/test/olmes/dist/.tmp-9hgqfz8k/ai2_olmes-0.1.0-py3-none-any.whl' and adding 'build/bdist.linux-x86_64/wheel' to it
adding 'oe_eval/__init__.py'
adding 'oe_eval/default_configs.py'
adding 'oe_eval/launch.py'
adding 'oe_eval/py.typed'
adding 'oe_eval/run_eval.py'
adding 'oe_eval/utils.py'
adding 'oe_eval/version.py'
adding 'oe_eval/components/instances.py'
adding 'oe_eval/components/requests.py'
adding 'oe_eval/configs/models.py'
adding 'oe_eval/configs/task_suites.py'
adding 'oe_eval/configs/tasks.py'
adding 'oe_eval/configs/utils.py'
adding 'oe_eval/data/__init__.py'
adding 'oe_eval/data/agi_eval_tasks.py'
adding 'oe_eval/data/bbh_tasks.py'
adding 'oe_eval/data/deepmind_math_categories.py'
adding 'oe_eval/data/hendrycks_math_split.py'
adding 'oe_eval/data/math_task_types.py'
adding 'oe_eval/data/mmlu_pro_categories.py'
adding 'oe_eval/data/mmlu_tasks.py'
adding 'oe_eval/data/mt_eval_tasks.py'
adding 'oe_eval/data/tydiqa_languages.py'
adding 'oe_eval/data/zero_scrolls_tasks.py'
adding 'oe_eval/dependencies/AGIEval/src/__init__.py'
adding 'oe_eval/dependencies/AGIEval/src/constructions.py'
adding 'oe_eval/dependencies/AGIEval/src/dataset_loader.py'
adding 'oe_eval/dependencies/AGIEval/src/evaluation.py'
adding 'oe_eval/dependencies/AGIEval/src/math_equivalence.py'
adding 'oe_eval/dependencies/AGIEval/src/post_process.py'
adding 'oe_eval/dependencies/AGIEval/src/utils.py'
adding 'oe_eval/dependencies/drop/process_results.py'
adding 'oe_eval/dependencies/hf_evaluate/exact_match.py'
adding 'oe_eval/dependencies/ifeval/__init__.py'
adding 'oe_eval/dependencies/ifeval/instructions.py'
adding 'oe_eval/dependencies/ifeval/instructions_registry.py'
adding 'oe_eval/dependencies/ifeval/instructions_util.py'
adding 'oe_eval/dependencies/ifeval/utils.py'
adding 'oe_eval/dependencies/squad/squad_emf1.py'
adding 'oe_eval/metrics/__init__.py'
adding 'oe_eval/metrics/llm_judge.py'
adding 'oe_eval/metrics/metric.py'
adding 'oe_eval/metrics/metric_utils.py'
adding 'oe_eval/metrics/code_evals/code_eval_routes.py'
adding 'oe_eval/metrics/code_evals/code_execution_local.py'
adding 'oe_eval/metrics/code_evals/code_execution_remote.py'
adding 'oe_eval/metrics/code_evals/sanitize.py'
adding 'oe_eval/models/__init__.py'
adding 'oe_eval/models/eleuther_huggingface.py'
adding 'oe_eval/models/eleuther_vllm_causallms.py'
adding 'oe_eval/models/litellm.py'
adding 'oe_eval/tasks/__init__.py'
adding 'oe_eval/tasks/aggregate_tasks.py'
adding 'oe_eval/tasks/base_task.py'
adding 'oe_eval/tasks/chat_templates.py'
adding 'oe_eval/tasks/eleuther_task.py'
adding 'oe_eval/tasks/fewshot_sources.py'
adding 'oe_eval/tasks/utils.py'
adding 'oe_eval/tasks/oe_eval_tasks/__init__.py'
adding 'oe_eval/tasks/oe_eval_tasks/agi_eval.py'
adding 'oe_eval/tasks/oe_eval_tasks/alpaca_eval.py'
adding 'oe_eval/tasks/oe_eval_tasks/arc.py'
adding 'oe_eval/tasks/oe_eval_tasks/bbh.py'
adding 'oe_eval/tasks/oe_eval_tasks/boolq.py'
adding 'oe_eval/tasks/oe_eval_tasks/codex_bigcodebench.py'
adding 'oe_eval/tasks/oe_eval_tasks/codex_humaneval.py'
adding 'oe_eval/tasks/oe_eval_tasks/codex_mbpp.py'
adding 'oe_eval/tasks/oe_eval_tasks/copa.py'
adding 'oe_eval/tasks/oe_eval_tasks/copycolors.py'
adding 'oe_eval/tasks/oe_eval_tasks/coqa.py'
adding 'oe_eval/tasks/oe_eval_tasks/cosmosqa.py'
adding 'oe_eval/tasks/oe_eval_tasks/csqa.py'
adding 'oe_eval/tasks/oe_eval_tasks/deepmind_math.py'
adding 'oe_eval/tasks/oe_eval_tasks/drop.py'
adding 'oe_eval/tasks/oe_eval_tasks/gpqa.py'
adding 'oe_eval/tasks/oe_eval_tasks/gsm8k.py'
adding 'oe_eval/tasks/oe_eval_tasks/hellaswag.py'
adding 'oe_eval/tasks/oe_eval_tasks/ifeval.py'
adding 'oe_eval/tasks/oe_eval_tasks/jeopardy.py'
adding 'oe_eval/tasks/oe_eval_tasks/logiqa.py'
adding 'oe_eval/tasks/oe_eval_tasks/minerva_math.py'
adding 'oe_eval/tasks/oe_eval_tasks/mmlu.py'
adding 'oe_eval/tasks/oe_eval_tasks/mmlu_pro.py'
adding 'oe_eval/tasks/oe_eval_tasks/mt_eval.py'
adding 'oe_eval/tasks/oe_eval_tasks/naturalqs_open.py'
adding 'oe_eval/tasks/oe_eval_tasks/openbookqa.py'
adding 'oe_eval/tasks/oe_eval_tasks/piqa.py'
adding 'oe_eval/tasks/oe_eval_tasks/popqa.py'
adding 'oe_eval/tasks/oe_eval_tasks/sciq.py'
adding 'oe_eval/tasks/oe_eval_tasks/siqa.py'
adding 'oe_eval/tasks/oe_eval_tasks/squad.py'
adding 'oe_eval/tasks/oe_eval_tasks/squad2.py'
adding 'oe_eval/tasks/oe_eval_tasks/triviaqa.py'
adding 'oe_eval/tasks/oe_eval_tasks/truthfulqa.py'
adding 'oe_eval/tasks/oe_eval_tasks/tydiqa.py'
adding 'oe_eval/tasks/oe_eval_tasks/winogrande.py'
adding 'oe_eval/tasks/oe_eval_tasks/zero_scrolls.py'
adding 'oe_eval/utilities/__init__.py'
adding 'oe_eval/utilities/gsheet_writing.py'
adding 'oe_eval/utilities/hf_hub_writing.py'
adding 'oe_eval/utilities/model_results_collation.py'
adding 'oe_eval/utilities/remote_utils.py'
adding 'oe_eval/utilities/rtest_helpers.py'
adding 'oe_eval/utilities/wandb_writing.py'
adding 'ai2_olmes-0.1.0.dist-info/LICENSE'
adding 'ai2_olmes-0.1.0.dist-info/METADATA'
adding 'ai2_olmes-0.1.0.dist-info/WHEEL'
adding 'ai2_olmes-0.1.0.dist-info/entry_points.txt'
adding 'ai2_olmes-0.1.0.dist-info/top_level.txt'
adding 'ai2_olmes-0.1.0.dist-info/RECORD'
removing build/bdist.linux-x86_64/wheel
Successfully built ai2_olmes-0.1.0.tar.gz and ai2_olmes-0.1.0-py3-none-any.whl