Docs Home Pulumi IaC Pulumi ESC Pulumi Cloud Packages Tutorials
  1. Packages
  2. Google Cloud Native
  3. API Docs
  4. dialogflow
  5. dialogflow/v2
  6. Evaluation

Google Cloud Native is in preview. Google Cloud Classic is fully supported.

Google Cloud Native v0.32.0 published on Wednesday, Nov 29, 2023 by Pulumi
pulumi/pulumi-google-native

google-native.dialogflow/v2.Evaluation

Explore with Pulumi AI

google-native logo

Google Cloud Native is in preview. Google Cloud Classic is fully supported.

Google Cloud Native v0.32.0 published on Wednesday, Nov 29, 2023 by Pulumi
pulumi/pulumi-google-native

    Creates evaluation of a conversation model. Note - this resource’s API doesn’t support deletion. When deleted, the resource will persist on Google Cloud even though it will be deleted from Pulumi state.

    Create Evaluation Resource

    Resources are created with functions called constructors. To learn more about declaring and configuring resources, see Resources.

    Constructor syntax

    new Evaluation(name: string, args: EvaluationArgs, opts?: CustomResourceOptions);
    @overload
def Evaluation(resource_name: str,
               args: EvaluationArgs,
               opts: Optional[ResourceOptions] = None)

@overload
def Evaluation(resource_name: str,
               opts: Optional[ResourceOptions] = None,
               conversation_model_id: Optional[str] = None,
               display_name: Optional[str] = None,
               evaluation_config: Optional[GoogleCloudDialogflowV2EvaluationConfigArgs] = None,
               location: Optional[str] = None,
               name: Optional[str] = None,
               project: Optional[str] = None)
    func NewEvaluation(ctx *Context, name string, args EvaluationArgs, opts ...ResourceOption) (*Evaluation, error)
    public Evaluation(string name, EvaluationArgs args, CustomResourceOptions? opts = null)
    public Evaluation(String name, EvaluationArgs args)
public Evaluation(String name, EvaluationArgs args, CustomResourceOptions options)

    type: google-native:dialogflow/v2:Evaluation
properties: # The arguments to resource properties.
options: # Bag of options to control resource's behavior.

    Parameters

    name string
    The unique name of the resource.
    args EvaluationArgs
    The arguments to resource properties.
    opts CustomResourceOptions
    Bag of options to control resource's behavior.
    resource_name str
    The unique name of the resource.
    args EvaluationArgs
    The arguments to resource properties.
    opts ResourceOptions
    Bag of options to control resource's behavior.
    ctx Context
    Context object for the current deployment.
    name string
    The unique name of the resource.
    args EvaluationArgs
    The arguments to resource properties.
    opts ResourceOption
    Bag of options to control resource's behavior.
    name string
    The unique name of the resource.
    args EvaluationArgs
    The arguments to resource properties.
    opts CustomResourceOptions
    Bag of options to control resource's behavior.
    name String
    The unique name of the resource.
    args EvaluationArgs
    The arguments to resource properties.
    options CustomResourceOptions
    Bag of options to control resource's behavior.

    Constructor example

    The following reference example uses placeholder values for all input properties.

    var evaluationResource = new GoogleNative.Dialogflow.V2.Evaluation("evaluationResource", new()
{
    ConversationModelId = "string",
    DisplayName = "string",
    EvaluationConfig = new GoogleNative.Dialogflow.V2.Inputs.GoogleCloudDialogflowV2EvaluationConfigArgs
    {
        Datasets = new[]
        {
            new GoogleNative.Dialogflow.V2.Inputs.GoogleCloudDialogflowV2InputDatasetArgs
            {
                Dataset = "string",
            },
        },
        SmartComposeConfig = new GoogleNative.Dialogflow.V2.Inputs.GoogleCloudDialogflowV2EvaluationConfigSmartComposeConfigArgs
        {
            MaxResultCount = 0,
            AllowlistDocument = "string",
        },
        SmartReplyConfig = new GoogleNative.Dialogflow.V2.Inputs.GoogleCloudDialogflowV2EvaluationConfigSmartReplyConfigArgs
        {
            MaxResultCount = 0,
            AllowlistDocument = "string",
        },
    },
    Location = "string",
    Name = "string",
    Project = "string",
});

    example, err := dialogflow.NewEvaluation(ctx, "evaluationResource", &dialogflow.EvaluationArgs{
	ConversationModelId: pulumi.String("string"),
	DisplayName:         pulumi.String("string"),
	EvaluationConfig: &dialogflow.GoogleCloudDialogflowV2EvaluationConfigArgs{
		Datasets: dialogflow.GoogleCloudDialogflowV2InputDatasetArray{
			&dialogflow.GoogleCloudDialogflowV2InputDatasetArgs{
				Dataset: pulumi.String("string"),
			},
		},
		SmartComposeConfig: &dialogflow.GoogleCloudDialogflowV2EvaluationConfigSmartComposeConfigArgs{
			MaxResultCount:    pulumi.Int(0),
			AllowlistDocument: pulumi.String("string"),
		},
		SmartReplyConfig: &dialogflow.GoogleCloudDialogflowV2EvaluationConfigSmartReplyConfigArgs{
			MaxResultCount:    pulumi.Int(0),
			AllowlistDocument: pulumi.String("string"),
		},
	},
	Location: pulumi.String("string"),
	Name:     pulumi.String("string"),
	Project:  pulumi.String("string"),
})

    var evaluationResource = new Evaluation("evaluationResource", EvaluationArgs.builder()
    .conversationModelId("string")
    .displayName("string")
    .evaluationConfig(GoogleCloudDialogflowV2EvaluationConfigArgs.builder()
        .datasets(GoogleCloudDialogflowV2InputDatasetArgs.builder()
            .dataset("string")
            .build())
        .smartComposeConfig(GoogleCloudDialogflowV2EvaluationConfigSmartComposeConfigArgs.builder()
            .maxResultCount(0)
            .allowlistDocument("string")
            .build())
        .smartReplyConfig(GoogleCloudDialogflowV2EvaluationConfigSmartReplyConfigArgs.builder()
            .maxResultCount(0)
            .allowlistDocument("string")
            .build())
        .build())
    .location("string")
    .name("string")
    .project("string")
    .build());

    evaluation_resource = google_native.dialogflow.v2.Evaluation("evaluationResource",
    conversation_model_id="string",
    display_name="string",
    evaluation_config=google_native.dialogflow.v2.GoogleCloudDialogflowV2EvaluationConfigArgs(
        datasets=[google_native.dialogflow.v2.GoogleCloudDialogflowV2InputDatasetArgs(
            dataset="string",
        )],
        smart_compose_config=google_native.dialogflow.v2.GoogleCloudDialogflowV2EvaluationConfigSmartComposeConfigArgs(
            max_result_count=0,
            allowlist_document="string",
        ),
        smart_reply_config=google_native.dialogflow.v2.GoogleCloudDialogflowV2EvaluationConfigSmartReplyConfigArgs(
            max_result_count=0,
            allowlist_document="string",
        ),
    ),
    location="string",
    name="string",
    project="string")

    const evaluationResource = new google_native.dialogflow.v2.Evaluation("evaluationResource", {
    conversationModelId: "string",
    displayName: "string",
    evaluationConfig: {
        datasets: [{
            dataset: "string",
        }],
        smartComposeConfig: {
            maxResultCount: 0,
            allowlistDocument: "string",
        },
        smartReplyConfig: {
            maxResultCount: 0,
            allowlistDocument: "string",
        },
    },
    location: "string",
    name: "string",
    project: "string",
});

    type: google-native:dialogflow/v2:Evaluation
properties:
    conversationModelId: string
    displayName: string
    evaluationConfig:
        datasets:
            - dataset: string
        smartComposeConfig:
            allowlistDocument: string
            maxResultCount: 0
        smartReplyConfig:
            allowlistDocument: string
            maxResultCount: 0
    location: string
    name: string
    project: string

    Evaluation Resource Properties

    To learn more about resource properties and how to use them, see Inputs and Outputs in the Architecture and Concepts docs.

    Inputs

    The Evaluation resource accepts the following input properties:

    ConversationModelId string
    DisplayName string
    Optional. The display name of the model evaluation. At most 64 bytes long.
    EvaluationConfig Pulumi.GoogleNative.Dialogflow.V2.Inputs.GoogleCloudDialogflowV2EvaluationConfig
    Optional. The configuration of the evaluation task.
    Location string
    Name string
    The resource name of the evaluation. Format: projects//conversationModels//evaluations/
    Project string
    ConversationModelId string
    DisplayName string
    Optional. The display name of the model evaluation. At most 64 bytes long.
    EvaluationConfig GoogleCloudDialogflowV2EvaluationConfigArgs
    Optional. The configuration of the evaluation task.
    Location string
    Name string
    The resource name of the evaluation. Format: projects//conversationModels//evaluations/
    Project string
    conversationModelId String
    displayName String
    Optional. The display name of the model evaluation. At most 64 bytes long.
    evaluationConfig GoogleCloudDialogflowV2EvaluationConfig
    Optional. The configuration of the evaluation task.
    location String
    name String
    The resource name of the evaluation. Format: projects//conversationModels//evaluations/
    project String
    conversationModelId string
    displayName string
    Optional. The display name of the model evaluation. At most 64 bytes long.
    evaluationConfig GoogleCloudDialogflowV2EvaluationConfig
    Optional. The configuration of the evaluation task.
    location string
    name string
    The resource name of the evaluation. Format: projects//conversationModels//evaluations/
    project string
    conversation_model_id str
    display_name str
    Optional. The display name of the model evaluation. At most 64 bytes long.
    evaluation_config GoogleCloudDialogflowV2EvaluationConfigArgs
    Optional. The configuration of the evaluation task.
    location str
    name str
    The resource name of the evaluation. Format: projects//conversationModels//evaluations/
    project str
    conversationModelId String
    displayName String
    Optional. The display name of the model evaluation. At most 64 bytes long.
    evaluationConfig Property Map
    Optional. The configuration of the evaluation task.
    location String
    name String
    The resource name of the evaluation. Format: projects//conversationModels//evaluations/
    project String

    Outputs

    All input properties are implicitly available as output properties. Additionally, the Evaluation resource produces the following output properties:

    CreateTime string
    Creation time of this model.
    Id string
    The provider-assigned unique ID for this managed resource.
    RawHumanEvalTemplateCsv string
    Human eval template in csv format. It tooks real-world conversations provided through input dataset, generates example suggestions for customer to verify quality of the model. For Smart Reply, the generated csv file contains columns of Context, (Suggestions,Q1,Q2)*3, Actual reply. Context contains at most 10 latest messages in the conversation prior to the current suggestion. Q1: "Would you send it as the next message of agent?" Evaluated based on whether the suggest is appropriate to be sent by agent in current context. Q2: "Does the suggestion move the conversation closer to resolution?" Evaluated based on whether the suggestion provide solutions, or answers customer's question or collect information from customer to resolve the customer's issue. Actual reply column contains the actual agent reply sent in the context.
    SmartReplyMetrics Pulumi.GoogleNative.Dialogflow.V2.Outputs.GoogleCloudDialogflowV2SmartReplyMetricsResponse
    Only available when model is for smart reply.
    CreateTime string
    Creation time of this model.
    Id string
    The provider-assigned unique ID for this managed resource.
    RawHumanEvalTemplateCsv string
    Human eval template in csv format. It tooks real-world conversations provided through input dataset, generates example suggestions for customer to verify quality of the model. For Smart Reply, the generated csv file contains columns of Context, (Suggestions,Q1,Q2)*3, Actual reply. Context contains at most 10 latest messages in the conversation prior to the current suggestion. Q1: "Would you send it as the next message of agent?" Evaluated based on whether the suggest is appropriate to be sent by agent in current context. Q2: "Does the suggestion move the conversation closer to resolution?" Evaluated based on whether the suggestion provide solutions, or answers customer's question or collect information from customer to resolve the customer's issue. Actual reply column contains the actual agent reply sent in the context.
    SmartReplyMetrics GoogleCloudDialogflowV2SmartReplyMetricsResponse
    Only available when model is for smart reply.
    createTime String
    Creation time of this model.
    id String
    The provider-assigned unique ID for this managed resource.
    rawHumanEvalTemplateCsv String
    Human eval template in csv format. It tooks real-world conversations provided through input dataset, generates example suggestions for customer to verify quality of the model. For Smart Reply, the generated csv file contains columns of Context, (Suggestions,Q1,Q2)*3, Actual reply. Context contains at most 10 latest messages in the conversation prior to the current suggestion. Q1: "Would you send it as the next message of agent?" Evaluated based on whether the suggest is appropriate to be sent by agent in current context. Q2: "Does the suggestion move the conversation closer to resolution?" Evaluated based on whether the suggestion provide solutions, or answers customer's question or collect information from customer to resolve the customer's issue. Actual reply column contains the actual agent reply sent in the context.
    smartReplyMetrics GoogleCloudDialogflowV2SmartReplyMetricsResponse
    Only available when model is for smart reply.
    createTime string
    Creation time of this model.
    id string
    The provider-assigned unique ID for this managed resource.
    rawHumanEvalTemplateCsv string
    Human eval template in csv format. It tooks real-world conversations provided through input dataset, generates example suggestions for customer to verify quality of the model. For Smart Reply, the generated csv file contains columns of Context, (Suggestions,Q1,Q2)*3, Actual reply. Context contains at most 10 latest messages in the conversation prior to the current suggestion. Q1: "Would you send it as the next message of agent?" Evaluated based on whether the suggest is appropriate to be sent by agent in current context. Q2: "Does the suggestion move the conversation closer to resolution?" Evaluated based on whether the suggestion provide solutions, or answers customer's question or collect information from customer to resolve the customer's issue. Actual reply column contains the actual agent reply sent in the context.
    smartReplyMetrics GoogleCloudDialogflowV2SmartReplyMetricsResponse
    Only available when model is for smart reply.
    create_time str
    Creation time of this model.
    id str
    The provider-assigned unique ID for this managed resource.
    raw_human_eval_template_csv str
    Human eval template in csv format. It tooks real-world conversations provided through input dataset, generates example suggestions for customer to verify quality of the model. For Smart Reply, the generated csv file contains columns of Context, (Suggestions,Q1,Q2)*3, Actual reply. Context contains at most 10 latest messages in the conversation prior to the current suggestion. Q1: "Would you send it as the next message of agent?" Evaluated based on whether the suggest is appropriate to be sent by agent in current context. Q2: "Does the suggestion move the conversation closer to resolution?" Evaluated based on whether the suggestion provide solutions, or answers customer's question or collect information from customer to resolve the customer's issue. Actual reply column contains the actual agent reply sent in the context.
    smart_reply_metrics GoogleCloudDialogflowV2SmartReplyMetricsResponse
    Only available when model is for smart reply.
    createTime String
    Creation time of this model.
    id String
    The provider-assigned unique ID for this managed resource.
    rawHumanEvalTemplateCsv String
    Human eval template in csv format. It tooks real-world conversations provided through input dataset, generates example suggestions for customer to verify quality of the model. For Smart Reply, the generated csv file contains columns of Context, (Suggestions,Q1,Q2)*3, Actual reply. Context contains at most 10 latest messages in the conversation prior to the current suggestion. Q1: "Would you send it as the next message of agent?" Evaluated based on whether the suggest is appropriate to be sent by agent in current context. Q2: "Does the suggestion move the conversation closer to resolution?" Evaluated based on whether the suggestion provide solutions, or answers customer's question or collect information from customer to resolve the customer's issue. Actual reply column contains the actual agent reply sent in the context.
    smartReplyMetrics Property Map
    Only available when model is for smart reply.

    Supporting Types

    GoogleCloudDialogflowV2EvaluationConfig, GoogleCloudDialogflowV2EvaluationConfigArgs

    datasets List<Property Map>
    Datasets used for evaluation.
    smartComposeConfig Property Map
    Configuration for smart compose model evalution.
    smartReplyConfig Property Map
    Configuration for smart reply model evalution.

    GoogleCloudDialogflowV2EvaluationConfigResponse, GoogleCloudDialogflowV2EvaluationConfigResponseArgs

    datasets List<Property Map>
    Datasets used for evaluation.
    smartComposeConfig Property Map
    Configuration for smart compose model evalution.
    smartReplyConfig Property Map
    Configuration for smart reply model evalution.

    GoogleCloudDialogflowV2EvaluationConfigSmartComposeConfig, GoogleCloudDialogflowV2EvaluationConfigSmartComposeConfigArgs

    MaxResultCount int
    The model to be evaluated can return multiple results with confidence score on each query. These results will be sorted by the descending order of the scores and we only keep the first max_result_count results as the final results to evaluate.
    AllowlistDocument string
    The allowlist document resource name. Format: projects//knowledgeBases//documents/. Only used for smart compose model.
    MaxResultCount int
    The model to be evaluated can return multiple results with confidence score on each query. These results will be sorted by the descending order of the scores and we only keep the first max_result_count results as the final results to evaluate.
    AllowlistDocument string
    The allowlist document resource name. Format: projects//knowledgeBases//documents/. Only used for smart compose model.
    maxResultCount Integer
    The model to be evaluated can return multiple results with confidence score on each query. These results will be sorted by the descending order of the scores and we only keep the first max_result_count results as the final results to evaluate.
    allowlistDocument String
    The allowlist document resource name. Format: projects//knowledgeBases//documents/. Only used for smart compose model.
    maxResultCount number
    The model to be evaluated can return multiple results with confidence score on each query. These results will be sorted by the descending order of the scores and we only keep the first max_result_count results as the final results to evaluate.
    allowlistDocument string
    The allowlist document resource name. Format: projects//knowledgeBases//documents/. Only used for smart compose model.
    max_result_count int
    The model to be evaluated can return multiple results with confidence score on each query. These results will be sorted by the descending order of the scores and we only keep the first max_result_count results as the final results to evaluate.
    allowlist_document str
    The allowlist document resource name. Format: projects//knowledgeBases//documents/. Only used for smart compose model.
    maxResultCount Number
    The model to be evaluated can return multiple results with confidence score on each query. These results will be sorted by the descending order of the scores and we only keep the first max_result_count results as the final results to evaluate.
    allowlistDocument String
    The allowlist document resource name. Format: projects//knowledgeBases//documents/. Only used for smart compose model.

    GoogleCloudDialogflowV2EvaluationConfigSmartComposeConfigResponse, GoogleCloudDialogflowV2EvaluationConfigSmartComposeConfigResponseArgs

    AllowlistDocument string
    The allowlist document resource name. Format: projects//knowledgeBases//documents/. Only used for smart compose model.
    MaxResultCount int
    The model to be evaluated can return multiple results with confidence score on each query. These results will be sorted by the descending order of the scores and we only keep the first max_result_count results as the final results to evaluate.
    AllowlistDocument string
    The allowlist document resource name. Format: projects//knowledgeBases//documents/. Only used for smart compose model.
    MaxResultCount int
    The model to be evaluated can return multiple results with confidence score on each query. These results will be sorted by the descending order of the scores and we only keep the first max_result_count results as the final results to evaluate.
    allowlistDocument String
    The allowlist document resource name. Format: projects//knowledgeBases//documents/. Only used for smart compose model.
    maxResultCount Integer
    The model to be evaluated can return multiple results with confidence score on each query. These results will be sorted by the descending order of the scores and we only keep the first max_result_count results as the final results to evaluate.
    allowlistDocument string
    The allowlist document resource name. Format: projects//knowledgeBases//documents/. Only used for smart compose model.
    maxResultCount number
    The model to be evaluated can return multiple results with confidence score on each query. These results will be sorted by the descending order of the scores and we only keep the first max_result_count results as the final results to evaluate.
    allowlist_document str
    The allowlist document resource name. Format: projects//knowledgeBases//documents/. Only used for smart compose model.
    max_result_count int
    The model to be evaluated can return multiple results with confidence score on each query. These results will be sorted by the descending order of the scores and we only keep the first max_result_count results as the final results to evaluate.
    allowlistDocument String
    The allowlist document resource name. Format: projects//knowledgeBases//documents/. Only used for smart compose model.
    maxResultCount Number
    The model to be evaluated can return multiple results with confidence score on each query. These results will be sorted by the descending order of the scores and we only keep the first max_result_count results as the final results to evaluate.

    GoogleCloudDialogflowV2EvaluationConfigSmartReplyConfig, GoogleCloudDialogflowV2EvaluationConfigSmartReplyConfigArgs

    MaxResultCount int
    The model to be evaluated can return multiple results with confidence score on each query. These results will be sorted by the descending order of the scores and we only keep the first max_result_count results as the final results to evaluate.
    AllowlistDocument string
    The allowlist document resource name. Format: projects//knowledgeBases//documents/. Only used for smart reply model.
    MaxResultCount int
    The model to be evaluated can return multiple results with confidence score on each query. These results will be sorted by the descending order of the scores and we only keep the first max_result_count results as the final results to evaluate.
    AllowlistDocument string
    The allowlist document resource name. Format: projects//knowledgeBases//documents/. Only used for smart reply model.
    maxResultCount Integer
    The model to be evaluated can return multiple results with confidence score on each query. These results will be sorted by the descending order of the scores and we only keep the first max_result_count results as the final results to evaluate.
    allowlistDocument String
    The allowlist document resource name. Format: projects//knowledgeBases//documents/. Only used for smart reply model.
    maxResultCount number
    The model to be evaluated can return multiple results with confidence score on each query. These results will be sorted by the descending order of the scores and we only keep the first max_result_count results as the final results to evaluate.
    allowlistDocument string
    The allowlist document resource name. Format: projects//knowledgeBases//documents/. Only used for smart reply model.
    max_result_count int
    The model to be evaluated can return multiple results with confidence score on each query. These results will be sorted by the descending order of the scores and we only keep the first max_result_count results as the final results to evaluate.
    allowlist_document str
    The allowlist document resource name. Format: projects//knowledgeBases//documents/. Only used for smart reply model.
    maxResultCount Number
    The model to be evaluated can return multiple results with confidence score on each query. These results will be sorted by the descending order of the scores and we only keep the first max_result_count results as the final results to evaluate.
    allowlistDocument String
    The allowlist document resource name. Format: projects//knowledgeBases//documents/. Only used for smart reply model.

    GoogleCloudDialogflowV2EvaluationConfigSmartReplyConfigResponse, GoogleCloudDialogflowV2EvaluationConfigSmartReplyConfigResponseArgs

    AllowlistDocument string
    The allowlist document resource name. Format: projects//knowledgeBases//documents/. Only used for smart reply model.
    MaxResultCount int
    The model to be evaluated can return multiple results with confidence score on each query. These results will be sorted by the descending order of the scores and we only keep the first max_result_count results as the final results to evaluate.
    AllowlistDocument string
    The allowlist document resource name. Format: projects//knowledgeBases//documents/. Only used for smart reply model.
    MaxResultCount int
    The model to be evaluated can return multiple results with confidence score on each query. These results will be sorted by the descending order of the scores and we only keep the first max_result_count results as the final results to evaluate.
    allowlistDocument String
    The allowlist document resource name. Format: projects//knowledgeBases//documents/. Only used for smart reply model.
    maxResultCount Integer
    The model to be evaluated can return multiple results with confidence score on each query. These results will be sorted by the descending order of the scores and we only keep the first max_result_count results as the final results to evaluate.
    allowlistDocument string
    The allowlist document resource name. Format: projects//knowledgeBases//documents/. Only used for smart reply model.
    maxResultCount number
    The model to be evaluated can return multiple results with confidence score on each query. These results will be sorted by the descending order of the scores and we only keep the first max_result_count results as the final results to evaluate.
    allowlist_document str
    The allowlist document resource name. Format: projects//knowledgeBases//documents/. Only used for smart reply model.
    max_result_count int
    The model to be evaluated can return multiple results with confidence score on each query. These results will be sorted by the descending order of the scores and we only keep the first max_result_count results as the final results to evaluate.
    allowlistDocument String
    The allowlist document resource name. Format: projects//knowledgeBases//documents/. Only used for smart reply model.
    maxResultCount Number
    The model to be evaluated can return multiple results with confidence score on each query. These results will be sorted by the descending order of the scores and we only keep the first max_result_count results as the final results to evaluate.

    GoogleCloudDialogflowV2InputDataset, GoogleCloudDialogflowV2InputDatasetArgs

    Dataset string
    ConversationDataset resource name. Format: projects//locations//conversationDatasets/
    Dataset string
    ConversationDataset resource name. Format: projects//locations//conversationDatasets/
    dataset String
    ConversationDataset resource name. Format: projects//locations//conversationDatasets/
    dataset string
    ConversationDataset resource name. Format: projects//locations//conversationDatasets/
    dataset str
    ConversationDataset resource name. Format: projects//locations//conversationDatasets/
    dataset String
    ConversationDataset resource name. Format: projects//locations//conversationDatasets/

    GoogleCloudDialogflowV2InputDatasetResponse, GoogleCloudDialogflowV2InputDatasetResponseArgs

    Dataset string
    ConversationDataset resource name. Format: projects//locations//conversationDatasets/
    Dataset string
    ConversationDataset resource name. Format: projects//locations//conversationDatasets/
    dataset String
    ConversationDataset resource name. Format: projects//locations//conversationDatasets/
    dataset string
    ConversationDataset resource name. Format: projects//locations//conversationDatasets/
    dataset str
    ConversationDataset resource name. Format: projects//locations//conversationDatasets/
    dataset String
    ConversationDataset resource name. Format: projects//locations//conversationDatasets/

    GoogleCloudDialogflowV2SmartReplyMetricsResponse, GoogleCloudDialogflowV2SmartReplyMetricsResponseArgs

    AllowlistCoverage double
    Percentage of target participant messages in the evaluation dataset for which similar messages have appeared at least once in the allowlist. Should be [0, 1].
    ConversationCount string
    Total number of conversations used to generate this metric.
    TopNMetrics List<Pulumi.GoogleNative.Dialogflow.V2.Inputs.GoogleCloudDialogflowV2SmartReplyMetricsTopNMetricsResponse>
    Metrics of top n smart replies, sorted by TopNMetric.n.
    AllowlistCoverage float64
    Percentage of target participant messages in the evaluation dataset for which similar messages have appeared at least once in the allowlist. Should be [0, 1].
    ConversationCount string
    Total number of conversations used to generate this metric.
    TopNMetrics []GoogleCloudDialogflowV2SmartReplyMetricsTopNMetricsResponse
    Metrics of top n smart replies, sorted by TopNMetric.n.
    allowlistCoverage Double
    Percentage of target participant messages in the evaluation dataset for which similar messages have appeared at least once in the allowlist. Should be [0, 1].
    conversationCount String
    Total number of conversations used to generate this metric.
    topNMetrics List<GoogleCloudDialogflowV2SmartReplyMetricsTopNMetricsResponse>
    Metrics of top n smart replies, sorted by TopNMetric.n.
    allowlistCoverage number
    Percentage of target participant messages in the evaluation dataset for which similar messages have appeared at least once in the allowlist. Should be [0, 1].
    conversationCount string
    Total number of conversations used to generate this metric.
    topNMetrics GoogleCloudDialogflowV2SmartReplyMetricsTopNMetricsResponse[]
    Metrics of top n smart replies, sorted by TopNMetric.n.
    allowlist_coverage float
    Percentage of target participant messages in the evaluation dataset for which similar messages have appeared at least once in the allowlist. Should be [0, 1].
    conversation_count str
    Total number of conversations used to generate this metric.
    top_n_metrics Sequence[GoogleCloudDialogflowV2SmartReplyMetricsTopNMetricsResponse]
    Metrics of top n smart replies, sorted by TopNMetric.n.
    allowlistCoverage Number
    Percentage of target participant messages in the evaluation dataset for which similar messages have appeared at least once in the allowlist. Should be [0, 1].
    conversationCount String
    Total number of conversations used to generate this metric.
    topNMetrics List<Property Map>
    Metrics of top n smart replies, sorted by TopNMetric.n.

    GoogleCloudDialogflowV2SmartReplyMetricsTopNMetricsResponse, GoogleCloudDialogflowV2SmartReplyMetricsTopNMetricsResponseArgs

    N int
    Number of retrieved smart replies. For example, when n is 3, this evaluation contains metrics for when Dialogflow retrieves 3 smart replies with the model.
    Recall double
    Defined as number of queries whose top n smart replies have at least one similar (token match similarity above the defined threshold) reply as the real reply divided by number of queries with at least one smart reply. Value ranges from 0.0 to 1.0 inclusive.
    N int
    Number of retrieved smart replies. For example, when n is 3, this evaluation contains metrics for when Dialogflow retrieves 3 smart replies with the model.
    Recall float64
    Defined as number of queries whose top n smart replies have at least one similar (token match similarity above the defined threshold) reply as the real reply divided by number of queries with at least one smart reply. Value ranges from 0.0 to 1.0 inclusive.
    n Integer
    Number of retrieved smart replies. For example, when n is 3, this evaluation contains metrics for when Dialogflow retrieves 3 smart replies with the model.
    recall Double
    Defined as number of queries whose top n smart replies have at least one similar (token match similarity above the defined threshold) reply as the real reply divided by number of queries with at least one smart reply. Value ranges from 0.0 to 1.0 inclusive.
    n number
    Number of retrieved smart replies. For example, when n is 3, this evaluation contains metrics for when Dialogflow retrieves 3 smart replies with the model.
    recall number
    Defined as number of queries whose top n smart replies have at least one similar (token match similarity above the defined threshold) reply as the real reply divided by number of queries with at least one smart reply. Value ranges from 0.0 to 1.0 inclusive.
    n int
    Number of retrieved smart replies. For example, when n is 3, this evaluation contains metrics for when Dialogflow retrieves 3 smart replies with the model.
    recall float
    Defined as number of queries whose top n smart replies have at least one similar (token match similarity above the defined threshold) reply as the real reply divided by number of queries with at least one smart reply. Value ranges from 0.0 to 1.0 inclusive.
    n Number
    Number of retrieved smart replies. For example, when n is 3, this evaluation contains metrics for when Dialogflow retrieves 3 smart replies with the model.
    recall Number
    Defined as number of queries whose top n smart replies have at least one similar (token match similarity above the defined threshold) reply as the real reply divided by number of queries with at least one smart reply. Value ranges from 0.0 to 1.0 inclusive.

    Package Details

    Repository
    Google Cloud Native pulumi/pulumi-google-native
    License
    Apache-2.0
    google-native logo

    Google Cloud Native is in preview. Google Cloud Classic is fully supported.

    Google Cloud Native v0.32.0 published on Wednesday, Nov 29, 2023 by Pulumi
    pulumi/pulumi-google-native