Package org.apache.sysds.runtime.controlprogram.context

## Class SparkExecutionContext.SparkClusterConfig

- java.lang.Object
- - org.apache.sysds.runtime.controlprogram.context.SparkExecutionContext.SparkClusterConfig

- Enclosing class:
    SparkExecutionContext

      public static class SparkExecutionContext.SparkClusterConfig
      extends Object

  Captures relevant spark cluster configuration properties, e.g., memory budgets and degree of parallelism. This configuration abstracts legacy (< Spark 1.6) and current configurations and provides a unified view.

- - ### Constructor Summary

    Constructors
    Constructor | Description
    --- | ---
    `SparkClusterConfig()` |

  - ### Method Summary

    All Methods Instance Methods Concrete Methods
    Modifier and Type | Method | Description
    --- | --- | ---
    `void` | `analyzeSparkConfiguation​(org.apache.spark.SparkConf conf)` |
    `void` | `analyzeSparkConfiguationLegacy​(org.apache.spark.SparkConf conf)` |
    `long` | `getBroadcastMemoryBudget()` |
    `long` | `getDataMemoryBudget​(boolean min, boolean refresh)` |
    `int` | `getDefaultParallelism​(boolean refresh)` |
    `int` | `getNumExecutors()` |
    `String` | `toString()` |

    - ### Methods inherited from class java.lang.Object

      `equals, getClass, hashCode, notify, notifyAll, wait, wait, wait`

- - ### Constructor Detail

    - #### SparkClusterConfig

          public SparkClusterConfig()

  - ### Method Detail

    - #### getBroadcastMemoryBudget

          public long getBroadcastMemoryBudget()

    - #### getDataMemoryBudget

          public long getDataMemoryBudget​(boolean min,
                                          boolean refresh)

    - #### getNumExecutors

          public int getNumExecutors()

    - #### getDefaultParallelism

          public int getDefaultParallelism​(boolean refresh)

    - #### analyzeSparkConfiguationLegacy

          public void analyzeSparkConfiguationLegacy​(org.apache.spark.SparkConf conf)

    - #### analyzeSparkConfiguation

          public void analyzeSparkConfiguation​(org.apache.spark.SparkConf conf)

    - #### toString

          public String toString()

      Overrides:
        `toString` in class `Object`