Spark tips

December 1, 2017

How to start 2 or more workers in standalone mode ?

Starting 2 or more workers in standalone mode is based on exporting corresponding Spark's environment variable SPARK_WORKER_INSTANCES. Eventually it can be followed by the definition of SPARK_WORKER_M...

Continue Reading →