langchain_community.llms.azureml_endpoint.AzureMLBaseEndpoint¶

class langchain_community.llms.azureml_endpoint.AzureMLBaseEndpoint[source]¶

Bases: BaseModel

Azure ML Online Endpoint models.

Create a new model by parsing and validating input data from keyword arguments.

Raises ValidationError if the input data cannot be parsed to form a valid model.

param content_formatter: Any = None¶

The content formatter that provides an input and output transform function to handle formats between the LLM and the endpoint

param deployment_name: str = ''¶

Deployment Name for Endpoint. NOT REQUIRED to call endpoint. Should be passed to constructor or specified as env var AZUREML_DEPLOYMENT_NAME.

param endpoint_api_key: SecretStr = SecretStr('')¶

Authentication Key for Endpoint. Should be passed to constructor or specified as env var AZUREML_ENDPOINT_API_KEY.

Constraints

  • type = string

  • writeOnly = True

  • format = password

param endpoint_api_type: AzureMLEndpointApiType = AzureMLEndpointApiType.dedicated¶

Type of the endpoint being consumed. Possible values are serverless for pay-as-you-go and dedicated for dedicated endpoints.

param endpoint_url: str = ''¶

URL of pre-existing Endpoint. Should be passed to constructor or specified as env var AZUREML_ENDPOINT_URL.

param max_retries: int = 1¶
param model_kwargs: Optional[dict] = None¶

Keyword arguments to pass to the model.

param timeout: int = 50¶

Request timeout for calls to the endpoint