org.apache.sysds.runtime.controlprogram.context

## Class SparkExecutionContext.SparkClusterConfig

- java.lang.Object
- - org.apache.sysds.runtime.controlprogram.context.SparkExecutionContext.SparkClusterConfig

- Enclosing class:
    SparkExecutionContext

      public static class SparkExecutionContext.SparkClusterConfig
      extends Object

  Captures relevant spark cluster configuration properties, e.g., memory budgets and degree of parallelism. This configuration abstracts legacy (< Spark 1.6) and current configurations and provides a unified view.

- - ### Constructor Summary

    Constructors
    Constructor and Description
    `SparkClusterConfig()`

  - ### Method Summary

    All Methods Instance Methods Concrete Methods
    Modifier and Type | Method and Description
    --- | ---
    `void` | `analyzeSparkConfiguation(org.apache.spark.SparkConf conf)`
    `void` | `analyzeSparkConfiguationLegacy(org.apache.spark.SparkConf conf)`
    `long` | `getBroadcastMemoryBudget()`
    `long` | `getDataMemoryBudget(boolean min, boolean refresh)`
    `int` | `getDefaultParallelism(boolean refresh)`
    `int` | `getNumExecutors()`
    `String` | `toString()`

    - ### Methods inherited from class java.lang.Object

      `equals, getClass, hashCode, notify, notifyAll, wait, wait, wait`

- - ### Constructor Detail

    - #### SparkClusterConfig

          public SparkClusterConfig()

  - ### Method Detail

    - #### getBroadcastMemoryBudget

          public long getBroadcastMemoryBudget()

    - #### getDataMemoryBudget

          public long getDataMemoryBudget(boolean min,
                                          boolean refresh)

    - #### getNumExecutors

          public int getNumExecutors()

    - #### getDefaultParallelism

          public int getDefaultParallelism(boolean refresh)

    - #### analyzeSparkConfiguationLegacy

          public void analyzeSparkConfiguationLegacy(org.apache.spark.SparkConf conf)

    - #### analyzeSparkConfiguation

          public void analyzeSparkConfiguation(org.apache.spark.SparkConf conf)

    - #### toString

          public String toString()

      Overrides:
        `toString` in class `Object`

Copyright © 2021 The Apache Software Foundation. All rights reserved.