For AI agents: A markdown version of this page is available at https://docs.datadoghq.com/infrastructure/resource_catalog/aws_datasync_location_hdfs.md. A documentation index is available at /llms.txt.

aws_datasync_location_hdfs

account_id

Type: STRING

agent_arns

Type: UNORDERED_LIST_STRING
Provider name: AgentArns
Description: The ARNs of the DataSync agents that can connect with your HDFS cluster.

authentication_type

Type: STRING
Provider name: AuthenticationType
Description: The type of authentication used to determine the identity of the user.

block_size

Type: INT32
Provider name: BlockSize
Description: The size of the data blocks to write into the HDFS cluster.

cmk_secret_config

Type: STRUCT
Provider name: CmkSecretConfig
Description: Describes configuration information for a DataSync-managed secret, such as a KerberosKeytab that DataSync uses to access a specific storage location, with a customer-managed KMS key.

  • kms_key_arn
    Type: STRING
    Provider name: KmsKeyArn
    Description: Specifies the ARN for the customer-managed KMS key that DataSync uses to encrypt the DataSync-managed secret stored for SecretArn. DataSync provides this key to Secrets Manager.
  • secret_arn
    Type: STRING
    Provider name: SecretArn
    Description: Specifies the ARN for the DataSync-managed Secrets Manager secret that that is used to access a specific storage location. This property is generated by DataSync and is read-only. DataSync encrypts this secret with the KMS key that you specify for KmsKeyArn.

creation_time

Type: TIMESTAMP
Provider name: CreationTime
Description: The time that the HDFS location was created.

custom_secret_config

Type: STRUCT
Provider name: CustomSecretConfig
Description: Describes configuration information for a customer-managed secret, such as a KerberosKeytab that DataSync uses to access a specific storage location, with a customer-managed Identity and Access Management (IAM) role that provides access to the secret.

  • secret_access_role_arn
    Type: STRING
    Provider name: SecretAccessRoleArn
    Description: Specifies the ARN for the Identity and Access Management role that DataSync uses to access the secret specified for SecretArn.
  • secret_arn
    Type: STRING
    Provider name: SecretArn
    Description: Specifies the ARN for an Secrets Manager secret.

kerberos_principal

Type: STRING
Provider name: KerberosPrincipal
Description: The Kerberos principal with access to the files and folders on the HDFS cluster. This parameter is used if the AuthenticationType is defined as KERBEROS.

kms_key_provider_uri

Type: STRING
Provider name: KmsKeyProviderUri
Description: The URI of the HDFS cluster’s Key Management Server (KMS).

location_arn

Type: STRING
Provider name: LocationArn
Description: The ARN of the HDFS location.

location_uri

Type: STRING
Provider name: LocationUri
Description: The URI of the HDFS location.

managed_secret_config

Type: STRUCT
Provider name: ManagedSecretConfig
Description: Describes configuration information for a DataSync-managed secret, such as a KerberosKeytab that DataSync uses to access a specific storage location. DataSync uses the default Amazon Web Services-managed KMS key to encrypt this secret in Secrets Manager.

  • secret_arn
    Type: STRING
    Provider name: SecretArn
    Description: Specifies the ARN for an Secrets Manager secret.

name_nodes

Type: UNORDERED_LIST_STRUCT
Provider name: NameNodes
Description: The NameNode that manages the HDFS namespace.

  • hostname
    Type: STRING
    Provider name: Hostname
    Description: The hostname of the NameNode in the HDFS cluster. This value is the IP address or Domain Name Service (DNS) name of the NameNode. An agent that’s installed on-premises uses this hostname to communicate with the NameNode in the network.
  • port
    Type: INT32
    Provider name: Port
    Description: The port that the NameNode uses to listen to client requests.

qop_configuration

Type: STRUCT
Provider name: QopConfiguration
Description: The Quality of Protection (QOP) configuration, which specifies the Remote Procedure Call (RPC) and data transfer protection settings configured on the HDFS cluster.

  • data_transfer_protection
    Type: STRING
    Provider name: DataTransferProtection
    Description: The data transfer protection setting configured on the HDFS cluster. This setting corresponds to your dfs.data.transfer.protection setting in the hdfs-site.xml file on your Hadoop cluster.
  • rpc_protection
    Type: STRING
    Provider name: RpcProtection
    Description: The RPC protection setting configured on the HDFS cluster. This setting corresponds to your hadoop.rpc.protection setting in your core-site.xml file on your Hadoop cluster.

replication_factor

Type: INT32
Provider name: ReplicationFactor
Description: The number of DataNodes to replicate the data to when writing to the HDFS cluster.

simple_user

Type: STRING
Provider name: SimpleUser
Description: The user name to identify the client on the host operating system. This parameter is used if the AuthenticationType is defined as SIMPLE.

tags

Type: UNORDERED_LIST_STRING