Bedrock Evaluation Job

An AWS Bedrock Evaluation Job is a managed resource that allows you to assess and compare the performance of foundation models on specific tasks. It runs evaluations using your chosen datasets and metrics, producing results that help you understand model quality, accuracy, and suitability for your use case.

aws.bedrock_evaluation_job

Fields

TitleIDTypeData TypeDescription
_keycorestring
account_idcorestring
application_typecorestringSpecifies whether the evaluation job is for evaluating a model or evaluating a knowledge base (retrieval and response generation).
creation_timecoretimestampThe time the evaluation job was created.
customer_encryption_key_idcorestringThe Amazon Resource Name (ARN) of the customer managed encryption key specified when the evaluation job was created.
evaluation_configcorejsonContains the configuration details of either an automated or human-based evaluation job.
failure_messagescorearray<string>A list of strings that specify why the evaluation job failed to create.
inference_configcorejsonContains the configuration details of the inference model used for the evaluation job.
job_arncorestringThe Amazon Resource Name (ARN) of the evaluation job.
job_descriptioncorestringThe description of the evaluation job.
job_namecorestringThe name for the evaluation job.
job_typecorestringSpecifies whether the evaluation job is automated or human-based.
last_modified_timecoretimestampThe time the evaluation job was last modified.
output_data_configcorejsonContains the configuration details of the Amazon S3 bucket for storing the results of the evaluation job.
role_arncorestringThe Amazon Resource Name (ARN) of the IAM service role used in the evaluation job.
statuscorestringThe current status of the evaluation job.
tagscorehstore