class Google::Apis::DataprocV1::ClusterConfig

The cluster config.

Attributes

config_bucket[RW]
Optional

A Google Cloud Storage staging bucket used for sharing generated

SSH keys and config. If you do not specify a staging bucket, Cloud Dataproc will determine an appropriate Cloud Storage location (US, ASIA, or EU) for your cluster's staging bucket according to the Google Compute Engine zone where your cluster is deployed, and then it will create and manage this project-level, per-location bucket for you. Corresponds to the JSON property `configBucket` @return [String]

gce_cluster_config[RW]

Common config settings for resources of Google Compute Engine cluster instances, applicable to all instances in the cluster. Corresponds to the JSON property `gceClusterConfig` @return [Google::Apis::DataprocV1::GceClusterConfig]

initialization_actions[RW]
Optional

Commands to execute on each node after config is completed. By

default, executables are run on master and all worker nodes. You can test a node's role metadata to run an executable on a master or worker node, as shown below: ROLE=$(/usr/share/google/get_metadata_value attributes/role) if [[ “$` ROLE`” == 'Master' ]]; then … master specific actions … else … worker specific actions … fi Corresponds to the JSON property `initializationActions` @return [Array<Google::Apis::DataprocV1::NodeInitializationAction>]

master_config[RW]

The config settings for Google Compute Engine resources in an instance group, such as a master or worker group. Corresponds to the JSON property `masterConfig` @return [Google::Apis::DataprocV1::InstanceGroupConfig]

secondary_worker_config[RW]

The config settings for Google Compute Engine resources in an instance group, such as a master or worker group. Corresponds to the JSON property `secondaryWorkerConfig` @return [Google::Apis::DataprocV1::InstanceGroupConfig]

software_config[RW]

Specifies the selection and config of software inside the cluster. Corresponds to the JSON property `softwareConfig` @return [Google::Apis::DataprocV1::SoftwareConfig]

worker_config[RW]

The config settings for Google Compute Engine resources in an instance group, such as a master or worker group. Corresponds to the JSON property `workerConfig` @return [Google::Apis::DataprocV1::InstanceGroupConfig]

Public Class Methods

new(**args) click to toggle source
# File generated/google/apis/dataproc_v1/classes.rb, line 149
def initialize(**args)
   update!(**args)
end

Public Instance Methods

update!(**args) click to toggle source

Update properties of this object

# File generated/google/apis/dataproc_v1/classes.rb, line 154
def update!(**args)
  @config_bucket = args[:config_bucket] if args.key?(:config_bucket)
  @gce_cluster_config = args[:gce_cluster_config] if args.key?(:gce_cluster_config)
  @master_config = args[:master_config] if args.key?(:master_config)
  @worker_config = args[:worker_config] if args.key?(:worker_config)
  @secondary_worker_config = args[:secondary_worker_config] if args.key?(:secondary_worker_config)
  @software_config = args[:software_config] if args.key?(:software_config)
  @initialization_actions = args[:initialization_actions] if args.key?(:initialization_actions)
end