Lighteval 文档
管线
加入 Hugging Face 社区
并获得增强的文档体验
开始使用
管线
管线
class lighteval.pipeline.Pipeline
< 源码 >( tasks: str pipeline_parameters: PipelineParameters evaluation_tracker: EvaluationTracker model_config = None model = None metric_options = None )
PipelineParameters
class lighteval.pipeline.PipelineParameters
< 源码 >( launcher_type: ParallelismManager env_config: EnvConfig = <factory> job_id: int = 0 dataset_loading_processes: int = 1 nanotron_checkpoint_path: str | None = None custom_tasks_directory: str | None = None override_batch_size: int | None = None num_fewshot_seeds: int = 1 max_samples: int | None = None use_chat_template: bool = False system_prompt: str | None = None load_responses_from_details_date_id: str | None = None )
ParallelismManager
class lighteval.pipeline.ParallelismManager
< 源码 >( value names = None module = None qualname = None type = None start = 1 )
一个枚举。