Summaries/Apache/Apache Spark/Configuarions.md

435 B

title updated created
Configuarions 2021-05-04 14:58:11Z 2021-05-04 14:58:11Z

Spark configuation options

SPARK_LOCAL_IP environment variable

SPARK_LOCAL_IP=127.0.0.1 ./bin/spark-shell

In a program set the bindAddress

val config = new SparkConf()
config.setMaster("local[*]")
config.setAppName("Test App")
config.set("spark.driver.bindAddress", "127.0.0.1")
val sc = new SparkContext(config)