Dataproc Session

Dataproc Session in Google Cloud is a temporary interactive environment for running Spark workloads without managing clusters directly. It allows you to submit jobs, explore data, and test code in a serverless way, with resources automatically provisioned and scaled as needed. Sessions simplify development and experimentation by reducing setup overhead.

gcp.dataproc_session

Fields

TitleIDTypeData TypeDescription
_keycorestring
ancestorscorearray<string>
create_timecoretimestampOutput only. The time when the session was created.
creatorcorestringOutput only. The email address of the user who created the session.
datadog_display_namecorestring
environment_configcorejsonOptional. Environment configuration for the session execution.
jupyter_sessioncorejsonOptional. Jupyter session config.
labelscorearray<string>Optional. The labels to associate with the session. Label keys must contain 1 to 63 characters, and must conform to RFC 1035 (https://www.ietf.org/rfc/rfc1035.txt). Label values may be empty, but, if present, must contain 1 to 63 characters, and must conform to RFC 1035 (https://www.ietf.org/rfc/rfc1035.txt). No more than 32 labels can be associated with a session.
namecorestringIdentifier. The resource name of the session.
organization_idcorestring
parentcorestring
project_idcorestring
project_numbercorestring
resource_namecorestring
runtime_configcorejsonOptional. Runtime configuration for the session execution.
runtime_infocorejsonOutput only. Runtime information about session execution.
session_templatecorestringOptional. The session template used by the session.Only resource names, including project ID and location, are valid.Example: * https://www.googleapis.com/compute/v1/projects/[project_id]/locations/[dataproc_region]/sessionTemplates/[template_id] * projects/[project_id]/locations/[dataproc_region]/sessionTemplates/[template_id]The template must be in the same project and Dataproc region as the session.
spark_connect_sessioncorejsonOptional. Spark connect session config.
statecorestringOutput only. A state of the session.
state_historycorejsonOutput only. Historical state information for the session.
state_messagecorestringOutput only. Session state details, such as the failure description if the state is FAILED.
state_timecoretimestampOutput only. The time when the session entered the current state.
tagscorehstore
usercorestringOptional. The email address of the user who owns the session.
uuidcorestringOutput only. A session UUID (Unique Universal Identifier). The service generates this value when it creates the session.