Vertex AI Batch Prediction Job

Vertex AI Batch Prediction Job is a Google Cloud resource that runs machine learning model predictions on large datasets asynchronously. It allows users to input data from sources like Cloud Storage or BigQuery and outputs predictions to a specified destination. This resource is ideal for processing high volumes of data efficiently without requiring real-time inference.

gcp.aiplatform_batch_prediction_job

Fields

TitleIDTypeData TypeDescription
_keycorestring
ancestorscorearray<string>
completion_statscorejsonOutput only. Statistics on completed and failed prediction instances.
create_timecoretimestampOutput only. Time when the BatchPredictionJob was created.
datadog_display_namecorestring
dedicated_resourcescorejsonThe config of resources used by the Model during the batch prediction. If the Model supports DEDICATED_RESOURCES this config may be provided (and the job will use these resources), if the Model doesn't support AUTOMATIC_RESOURCES, this config must be provided.
disable_container_loggingcoreboolFor custom-trained Models and AutoML Tabular Models, the container of the DeployedModel instances will send `stderr` and `stdout` streams to Cloud Logging by default. Please note that the logs incur cost, which are subject to [Cloud Logging pricing](https://cloud.google.com/logging/pricing). User can disable container logging by setting this flag to true.
encryption_speccorejsonCustomer-managed encryption key options for a BatchPredictionJob. If this is set, then all resources created by the BatchPredictionJob will be encrypted with the provided encryption key.
end_timecoretimestampOutput only. Time when the BatchPredictionJob entered any of the following states: `JOB_STATE_SUCCEEDED`, `JOB_STATE_FAILED`, `JOB_STATE_CANCELLED`.
errorcorejsonOutput only. Only populated when the job's state is JOB_STATE_FAILED or JOB_STATE_CANCELLED.
explanation_speccorejsonExplanation configuration for this BatchPredictionJob. Can be specified only if generate_explanation is set to `true`. This value overrides the value of Model.explanation_spec. All fields of explanation_spec are optional in the request. If a field of the explanation_spec object is not populated, the corresponding field of the Model.explanation_spec object is inherited.
gcp_display_namecorestringRequired. The user-defined name of this BatchPredictionJob.
generate_explanationcoreboolGenerate explanation with the batch prediction results. When set to `true`, the batch prediction output changes based on the `predictions_format` field of the BatchPredictionJob.output_config object: * `bigquery`: output includes a column named `explanation`. The value is a struct that conforms to the Explanation object. * `jsonl`: The JSON objects on each line include an additional entry keyed `explanation`. The value of the entry is a JSON object that conforms to the Explanation object. * `csv`: Generating explanations for CSV format is not supported. If this field is set to true, either the Model.explanation_spec or explanation_spec must be populated.
input_configcorejsonRequired. Input configuration of the instances on which predictions are performed. The schema of any single instance may be specified via the Model's PredictSchemata's instance_schema_uri.
instance_configcorejsonConfiguration for how to convert batch prediction input instances to the prediction instances that are sent to the Model.
labelscorearray<string>The labels with user-defined metadata to organize BatchPredictionJobs. Label keys and values can be no longer than 64 characters (Unicode codepoints), can only contain lowercase letters, numeric characters, underscores and dashes. International characters are allowed. See https://goo.gl/xmQnxf for more information and examples of labels.
manual_batch_tuning_parameterscorejsonImmutable. Parameters configuring the batch behavior. Currently only applicable when dedicated_resources are used (in other cases Vertex AI does the tuning itself).
modelcorestringThe name of the Model resource that produces the predictions via this job, must share the same ancestor Location. Starting this job has no impact on any existing deployments of the Model and their resources. Exactly one of model, unmanaged_container_model, or endpoint must be set. The model resource name may contain version id or version alias to specify the version. Example: `projects/{project}/locations/{location}/models/{model}@2` or `projects/{project}/locations/{location}/models/{model}@golden` if no version is specified, the default version will be deployed. The model resource could also be a publisher model. Example: `publishers/{publisher}/models/{model}` or `projects/{project}/locations/{location}/publishers/{publisher}/models/{model}`
model_version_idcorestringOutput only. The version ID of the Model that produces the predictions via this job.
namecorestringOutput only. Resource name of the BatchPredictionJob.
organization_idcorestring
output_configcorejsonRequired. The Configuration specifying where output predictions should be written. The schema of any single prediction may be specified as a concatenation of Model's PredictSchemata's instance_schema_uri and prediction_schema_uri.
output_infocorejsonOutput only. Information further describing the output of this job.
parentcorestring
partial_failurescorejsonOutput only. Partial failures encountered. For example, single files that can't be read. This field never exceeds 20 entries. Status details fields contain standard Google Cloud error details.
project_idcorestring
project_numbercorestring
region_idcorestring
resource_namecorestring
resources_consumedcorejsonOutput only. Information about resources that had been consumed by this job. Provided in real time at best effort basis, as well as a final value once the job completes. Note: This field currently may be not populated for batch predictions that use AutoML Models.
satisfies_pzicoreboolOutput only. Reserved for future use.
satisfies_pzscoreboolOutput only. Reserved for future use.
service_accountcorestringThe service account that the DeployedModel's container runs as. If not specified, a system generated one will be used, which has minimal permissions and the custom container, if used, may not have enough permission to access other Google Cloud resources. Users deploying the Model must have the `iam.serviceAccounts.actAs` permission on this service account.
start_timecoretimestampOutput only. Time when the BatchPredictionJob for the first time entered the `JOB_STATE_RUNNING` state.
statecorestringOutput only. The detailed state of the job.
tagscorehstore_csv
unmanaged_container_modelcorejsonContains model information necessary to perform batch prediction without requiring uploading to model registry. Exactly one of model, unmanaged_container_model, or endpoint must be set.
update_timecoretimestampOutput only. Time when the BatchPredictionJob was most recently updated.
zone_idcorestring