File tree Expand file tree Collapse file tree 1 file changed +11
-4
lines changed Expand file tree Collapse file tree 1 file changed +11
-4
lines changed Original file line number Diff line number Diff line change 40
40
41
41
* SSH in using ` vagrant ssh hn0 ` or ` vagrant ssh wn0 ` .
42
42
43
+ * Spark is running as ` root ` .
44
+
43
45
* The Spark WebUI should be available at ` http://192.168.99.200:8080 ` .
44
46
47
+ ```
48
+ sudo jps -ml
49
+ PID org.apache.spark.deploy.master.Master --host 192.168.99.200 --port 7077 --webui-port 8080 -h 192.168.99.200
50
+ ```
51
+
45
52
* Setup Environment Vairables
46
53
* ` GSC_JAR=$(ls /vagrant/greenplum-spark_2.11-*.jar) `
47
54
* ` POSTGRES_JAR=$(ls /vagrant/postgresql-*.jar) `
48
55
49
56
* Run SCALA
50
57
51
- Spark Connector 1.2: Read from Greenplum with Spark Connector / Write to Greenplum with JDBC --
58
+ Spark Connector 1.2: Read from Greenplum with Spark Connector / Write to Greenplum with JDBC:
52
59
53
- * ` spark-shell --jars "${GSC_JAR},${POSTGRES_JAR}" --driver-class-path ${POSTGRES_JAR} `
60
+ * ` sudo spark-shell --jars "${GSC_JAR},${POSTGRES_JAR}" --driver-class-path ${POSTGRES_JAR}`
54
61
55
- Spark Connector 1.3: Read and Write to Greenplum with Spark Connector --
62
+ Spark Connector 1.3+ : Read and Write to Greenplum with Spark Connector:
56
63
57
- * ` spark-shell --jars "${GSC_JAR}" `
64
+ * ` sudo spark-shell --jars "${GSC_JAR}"`
58
65
59
66
# Cleanup #
60
67
You can’t perform that action at this time.
0 commit comments