Spark Job optimisation

1

spark-submit --py-files ./rs_commons_util.zip --executor-cores 4 --num-executors 4 ./main.py

Reference