Class: Google::Cloud::Dataproc::V1::ClusterConfig

Inherits:
Object
  • Object
show all
Defined in:
lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/clusters.rb

Overview

The cluster config.

Instance Attribute Summary collapse

Instance Attribute Details

#config_bucket ⇒ String

Returns Optional. A Google Cloud Storage staging bucket used for sharing generated SSH keys and config. If you do not specify a staging bucket, Cloud Dataproc will determine an appropriate Cloud Storage location (US, ASIA, or EU) for your cluster's staging bucket according to the Google Compute Engine zone where your cluster is deployed, and then it will create and manage this project-level, per-location bucket for you.

Returns:

  • (String) —

    Optional. A Google Cloud Storage staging bucket used for sharing generated SSH keys and config. If you do not specify a staging bucket, Cloud Dataproc will determine an appropriate Cloud Storage location (US, ASIA, or EU) for your cluster's staging bucket according to the Google Compute Engine zone where your cluster is deployed, and then it will create and manage this project-level, per-location bucket for you.



112
 
# File 'lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/clusters.rb', line 112

class ClusterConfig; end

#gce_cluster_config ⇒ Google::Cloud::Dataproc::V1::GceClusterConfig

Returns Required. The shared Google Compute Engine config settings for all instances in a cluster.

Returns:



112
 
# File 'lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/clusters.rb', line 112

class ClusterConfig; end

#initialization_actions ⇒ Array<Google::Cloud::Dataproc::V1::NodeInitializationAction>

Returns Optional. Commands to execute on each node after config is completed. By default, executables are run on master and all worker nodes. You can test a node's +role+ metadata to run an executable on a master or worker node, as shown below using +curl+ (you can also use +wget+):

ROLE=$(curl -H Metadata-Flavor:Google http://metadata/computeMetadata/v1/instance/attributes/dataproc-role)
if [[ "${ROLE}" == 'Master' ]]; then
  ... master specific actions ...
else
  ... worker specific actions ...
fi

Returns:

  • (Array<Google::Cloud::Dataproc::V1::NodeInitializationAction>) —

    Optional. Commands to execute on each node after config is completed. By default, executables are run on master and all worker nodes. You can test a node's +role+ metadata to run an executable on a master or worker node, as shown below using +curl+ (you can also use +wget+):

    ROLE=$(curl -H Metadata-Flavor:Google http://metadata/computeMetadata/v1/instance/attributes/dataproc-role)
if [[ "${ROLE}" == 'Master' ]]; then
  ... master specific actions ...
else
  ... worker specific actions ...
fi



112
 
# File 'lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/clusters.rb', line 112

class ClusterConfig; end

#master_config ⇒ Google::Cloud::Dataproc::V1::InstanceGroupConfig

Returns Optional. The Google Compute Engine config settings for the master instance in a cluster.

Returns:



112
 
# File 'lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/clusters.rb', line 112

class ClusterConfig; end

#secondary_worker_config ⇒ Google::Cloud::Dataproc::V1::InstanceGroupConfig

Returns Optional. The Google Compute Engine config settings for additional worker instances in a cluster.

Returns:



112
 
# File 'lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/clusters.rb', line 112

class ClusterConfig; end

#software_config ⇒ Google::Cloud::Dataproc::V1::SoftwareConfig

Returns Optional. The config settings for software inside the cluster.

Returns:



112
 
# File 'lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/clusters.rb', line 112

class ClusterConfig; end

#worker_config ⇒ Google::Cloud::Dataproc::V1::InstanceGroupConfig

Returns Optional. The Google Compute Engine config settings for worker instances in a cluster.

Returns:



112
 
# File 'lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/clusters.rb', line 112

class ClusterConfig; end