verdict

• verdict package
  • Submodules
  • verdict.config module
    • Config
      • Config.rate_limiter_disabled
  • verdict.dataset module
    • DatasetWrapper
      • DatasetWrapper.dataset
      • DatasetWrapper.from_hf()
      • DatasetWrapper.from_pandas()
      • DatasetWrapper.input_fn
      • DatasetWrapper.load()
      • DatasetWrapper.max_samples
      • DatasetWrapper.samples
      • DatasetWrapper.save()
  • verdict.extractor module
    • ArgmaxScoreExtractor
      • ArgmaxScoreExtractor.extract()
    • CustomExtractor
      • CustomExtractor.extract()
      • CustomExtractor.inject()
      • CustomExtractor.post_extract()
    • Extractor
      • Extractor.extract()
      • Extractor.format()
      • Extractor.inject()
      • Extractor.response_schema
      • Extractor.streaming
    • PostHocExtractor
      • PostHocExtractor.extract()
      • PostHocExtractor.extract_client_wrappers
      • PostHocExtractor.format()
      • PostHocExtractor.model_selection_policy
    • RawExtractor
      • RawExtractor.extract()
      • RawExtractor.field_name
      • RawExtractor.inject()
    • RegexExtractor
      • RegexExtractor.FIRST_FLOAT
      • RegexExtractor.FIRST_INT
      • RegexExtractor.fields
      • RegexExtractor.post_extract()
    • SampleScoreExtractor
      • SampleScoreExtractor.extract()
    • StructuredOutputExtractor
      • StructuredOutputExtractor.extract()
    • TokenProbabilityExtractor
      • TokenProbabilityExtractor.extract()
      • TokenProbabilityExtractor.field_name
      • TokenProbabilityExtractor.inject()
      • TokenProbabilityExtractor.scale
      • TokenProbabilityExtractor.stream()
    • Usage
      • Usage.in_tokens
      • Usage.is_unknown()
      • Usage.out_tokens
      • Usage.unknown()
    • WeightedSummedScoreExtractor
      • WeightedSummedScoreExtractor.extract()
      • WeightedSummedScoreExtractor.inject()
  • verdict.model module
    • Client
      • Client.complete
      • Client.defaults()
      • Client.inference_parameters
      • Client.model
    • ClientWrapper
      • ClientWrapper.encode()
      • ClientWrapper.from_model()
      • ClientWrapper.inference_parameters
      • ClientWrapper.model
    • Model
      • Model.char
      • Model.connection_parameters
      • Model.name
      • Model.rate_limit
      • Model.rate_limiter
      • Model.use_nonce
    • ModelConfigurable
      • ModelConfigurable.model_selection_policy
      • ModelConfigurable.set()
      • ModelConfigurable.via()
    • ModelSelectionPolicy
      • ModelSelectionPolicy.char
      • ModelSelectionPolicy.from_any()
      • ModelSelectionPolicy.from_name()
      • ModelSelectionPolicy.from_names()
      • ModelSelectionPolicy.get_clients()
    • ProviderModel
      • ProviderModel.connection_parameters
      • ProviderModel.name
      • ProviderModel.rate_limiter
      • ProviderModel.use_nonce
    • vLLMModel
      • vLLMModel.api_base
      • vLLMModel.api_key
      • vLLMModel.connection_parameters
      • vLLMModel.name
      • vLLMModel.rate_limiter
  • verdict.prompt module
    • PromptMessage
      • PromptMessage.system
      • PromptMessage.to_messages()
      • PromptMessage.user
    • PromptRegistry
      • PromptRegistry.extract_sections()
      • PromptRegistry.strip_prompt_template()
    • Promptable
      • Promptable.populate_prompt_message()
  • verdict.scale module
    • BooleanScale
      • BooleanScale.pydantic_fields()
      • BooleanScale.token_support()
      • BooleanScale.value_mapping_fn()
    • ContinuousScale
      • ContinuousScale.prompt()
      • ContinuousScale.pydantic_fields()
      • ContinuousScale.value_mapping_fn()
    • DiscreteScale
      • DiscreteScale.index()
      • DiscreteScale.prompt()
      • DiscreteScale.pydantic_fields()
      • DiscreteScale.token_support()
      • DiscreteScale.value_mapping_fn()
      • DiscreteScale.values
    • LikertScale()
    • Scale
      • Scale.T
      • Scale.prompt()
      • Scale.pydantic_fields()
    • ScaleType
      • ScaleType.CONTINUOUS
      • ScaleType.DISCRETE
  • verdict.schema module
    • Schema
      • Schema.add()
      • Schema.append()
      • Schema.conform()
      • Schema.empty()
      • Schema.escape()
      • Schema.from_values()
      • Schema.generate_key()
      • Schema.get_scale()
      • Schema.infer()
      • Schema.infer_pydantic_annotation()
      • Schema.inline()
      • Schema.is_empty()
      • Schema.model_config
      • Schema.model_post_init()
      • Schema.of()
      • Schema.prepend()
  • verdict.transform module
    • MapUnit
      • MapUnit.InputSchema
      • MapUnit.OutputSchema
      • MapUnit.ResponseSchema
      • MapUnit.accumulate
      • MapUnit.execute()
      • MapUnit.lightweight
      • MapUnit.map_func
    • MaxPoolUnit
      • MaxPoolUnit.fields
    • MeanPoolUnit
      • MeanPoolUnit.fields
    • MeanVariancePoolUnit
      • MeanVariancePoolUnit.fields
  • Module contents
    • Block
      • Block.char
      • Block.leaf_view()
      • Block.link()
      • Block.materialize()
      • Block.root_view()
      • Block.use_root
    • Layer
      • Layer.char
      • Layer.clone()
      • Layer.copy()
      • Layer.how_inner
      • Layer.how_outer
      • Layer.leaf_idx
      • Layer.leaf_nodes
      • Layer.link()
      • Layer.order
      • Layer.root_idx
      • Layer.root_nodes
      • Layer.sort()
      • Layer.with_leaf()
      • Layer.with_root()
    • Pipeline
      • Pipeline.block
      • Pipeline.checkpoint()
      • Pipeline.collect_outputs()
      • Pipeline.copy()
      • Pipeline.executor
      • Pipeline.name
      • Pipeline.plot()
      • Pipeline.restore()
      • Pipeline.run()
      • Pipeline.run_from_dataset()
      • Pipeline.run_from_list()
      • Pipeline.via()
    • Unit
      • Unit.char
      • Unit.clone()
      • Unit.copy()
      • Unit.data
      • Unit.description
      • Unit.execute()
      • Unit.lightweight
      • Unit.link()
      • Unit.model_selection_policy
      • Unit.populate_prompt_message()
      • Unit.process()
      • Unit.shared
      • Unit.validate()