Skip to content

Latest commit

 

History

History
13 lines (9 loc) · 480 Bytes

README.md

File metadata and controls

13 lines (9 loc) · 480 Bytes

Spark Examples

Examples for demonstrating profiling on a Spark cluster using Opsian

Instructions

  • Use the GenerateUsers and GenerateTransactions programs to generate example files to profile with.
  • cp example-vars.sh var.sh and fill in the values for your machine and demo.
  • ./start-master.sh and ./start-worker.sh in screen in order to run the cluster.
  • ./submit.sh to submit your job to the cluster.