Storage Insights Dataset Config

Storage Insights Dataset Config in GCP defines the configuration for datasets used by Storage Insights. It manages how data is collected, stored, and analyzed for insights into storage usage and performance. This resource helps automate dataset creation and configuration to support reporting and monitoring of storage metrics across Google Cloud Storage environments.

gcp.storageinsights_dataset_config

Fields

TitleIDTypeData TypeDescription
_keycorestring
ancestorscorearray<string>
cloud_storage_object_pathcorestringInput only. Cloud Storage object path containing a list of project or folder numbers to include in the dataset; it cannot contain a mix of project and folders. The object must be a text file where each line has one of the following entries: - Project number, formatted as `projects/{project_number}`, for example, `projects/1234567890`. - Folder identifier, formatted as `folders/{folder_number}`, for example, `folders/9876543210`. Path must be in the format `gs://{bucket_name}/{object_name}`.
create_timecoretimestampOutput only. The UTC time at which the dataset configuration was created. This is auto-populated.
datadog_display_namecorestring
dataset_config_statecorestringOutput only. State of the `datasetConfig`.
descriptioncorestringOptional. A user-provided description for the dataset configuration. Maximum length: 256 characters.
exclude_cloud_storage_bucketscorejson
exclude_cloud_storage_locationscorejson
gcp_statuscorejsonOutput only. Status of the `datasetConfig`.
identitycorejsonIdentity used by this `datasetConfig`.
include_cloud_storage_bucketscorejson
include_cloud_storage_locationscorejson
include_newly_created_bucketscoreboolIf set to `true`, the request includes all the newly created buckets in the dataset that meet the inclusion and exclusion rules.
labelscorearray<string>Labels as key value pairs
linkcorejsonDetails of the linked dataset.
namecorestringIdentifier. name of resource
organization_idcorestring
organization_numbercoreint64Optional. Organization resource ID that the source projects should belong to. Projects that do not belong to the provided organization are not considered when creating the dataset.
organization_scopecoreboolDefines the options for providing a source organization for the dataset.
parentcorestring
project_idcorestring
project_numbercorestring
region_idcorestring
resource_namecorestring
retention_period_dayscoreint64Number of days of history that must be retained.
skip_verification_and_ingestcoreboolOptional. If set to `false`, then all the permission checks must be successful before the system can start ingesting data. This field can only be updated before the system ingests data for the first time. Any attempt to modify the field after data ingestion starts results in an error.
source_folderscorejsonDefines the options for providing source folders for the dataset.
source_projectscorejsonDefines the options for providing source projects for the dataset.
tagscorehstore_csv
uidcorestringOutput only. System generated unique identifier for the resource.
update_timecoretimestampOutput only. The UTC time at which the dataset configuration was last updated. This is auto-populated.
zone_idcorestring