Insufficient memory issue

[LouisChang]

I try to throw my data directly into Kafka but it seems like there are some bugs with that.

Now: 2015-07-12T14:02:31.332, Events:60000, Rate: 4401 epsJava HotSpot(TM) 64-Bit Server VM warning: INFO: os::commit_memory(0x00000006c9000000, 830472192, 0) failed; error='Cannot allocate memory' (errno=12)

There is insufficient memory for the Java Runtime Environment to continue.
Native memory allocation (mmap) failed to map 830472192 bytes for committing reserved memory.
An error report file with more information is saved as:
/home/ubuntu/eventsim/hs_err_pid3267.log
ubuntu@ip-172-31-1-10:~/eventsim$ rm hs_err_pid3267.log

[bengecko]

Hey Sidi,

This probably means the JRE is configured to run with 8g memory but there
is not enough memory on the machine. How much RAM is on the machine you are
running? Also how is the JVM configured?

On Thursday, June 16, 2016, Sidi Chang notifications@github.com wrote:

I try to throw my data directly into Kafka but it seems like there are
some bugs with that.

Now: 2015-07-12T14:02:31.332, Events:60000, Rate: 4401 epsJava HotSpot(TM)
64-Bit Server VM warning: INFO: os::commit_memory(0x00000006c9000000,
830472192, 0) failed; error='Cannot allocate memory' (errno=12)

There is insufficient memory for the Java Runtime Environment to continue. Native
memory allocation (mmap) failed to map 830472192 bytes for committing
reserved memory. An error report file with more information is saved as:
/home/ubuntu/eventsim/hs_err_pid3267.log

ubuntu@ip-172-31-1-10:~/eventsim$ rm hs_err_pid3267.log

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
#4, or mute the thread
https://github.com/notifications/unsubscribe/AIjLrpimyU78fTT1rLptJbChKP3W-QIpks5qMgGYgaJpZM4I3-M2
.

[LouisChang]

Hi Bengecko,

I am using Amazon AWS m4.large which should give me 8G or 16GB memory. I have one master and three workers. All the four machines are Kafka broker, the master node is the Spark Streaming seed node and Cassandra node. I run the data generator and put the throughput into the second worker, but it will give me this bug. Do you have any idea on this?

[bengecko]

If you AWS instance is configured with 8g then you will want to up it to
16g if possible.

Run:

free -m

To see how much memory you have. Also run:

ps -ef | grep java

Then copy and paste output into this thread.

On Friday, June 17, 2016, Sidi Chang notifications@github.com wrote:

Hi Bengecko,

I am using Amazon AWS m4.large which should give me 8G or 16GB memory. I
have one master and three workers. All the four machines are Kafka broker,
the master node is the Spark Streaming seed node and Cassandra node. I run
the data generator and put the throughput into the second worker, but it
will give me this bug. Do you have any idea on this?

—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
#4 (comment),
or mute the thread
https://github.com/notifications/unsubscribe/AIjLrvYlnGufASvF83eQL7TB7oFtrDw9ks5qMrHTgaJpZM4I3-M2
.

[LouisChang]

Hi,
After run free -m the output is
total used free shared buffers cached
Mem: 7983 7096 887 0 185 1272
-/+ buffers/cache: 5638 2345
Swap: 0 0 0

After running the second command, the output is
ubuntu 2771 1 0 Jun08 ? 00:11:42 /usr/bin/java -Dzookeeper.log.dir=. -Dzookeeper.root.logger=INFO,CONSOLE -cp /usr/local/zookeeper/bin/../build/classes:/usr/local/zookeeper/bin/../build/lib/.jar:/usr/local/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/usr/local/zookeeper/bin/../lib/slf4j-api-1.6.1.jar:/usr/local/zookeeper/bin/../lib/netty-3.7.0.Final.jar:/usr/local/zookeeper/bin/../lib/log4j-1.2.16.jar:/usr/local/zookeeper/bin/../lib/jline-0.9.94.jar:/usr/local/zookeeper/bin/../zookeeper-3.4.6.jar:/usr/local/zookeeper/bin/../src/java/lib/.jar:/usr/local/zookeeper/bin/../conf: -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.local.only=false org.apache.zookeeper.server.quorum.QuorumPeerMain /usr/local/zookeeper/bin/../conf/zoo.cfg
root 3897 3896 0 Jun08 ? 01:51:14 java -Xmx1G -Xms1G -server -XX:+UseG1GC -XX:MaxGCPauseMillis=20 -XX:InitiatingHeapOccupancyPercent=35 -XX:+DisableExplicitGC -Djava.awt.headless=true -Xloggc:/usr/local/kafka/bin/../logs/kafkaServer-gc.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.port=9999 -Dkafka.logs.dir=/usr/local/kafka/bin/../logs -Dlog4j.configuration=file:/usr/local/kafka/bin/../config/log4j.properties -cp :/usr/local/kafka/bin/../libs/* kafka.Kafka /usr/local/kafka/config/server.properties
ubuntu 4426 1 0 Jun08 ? 01:05:43 /usr/bin/java -Duser.dir=/usr/local/kafka-manager -Dhttp.port=9001 -cp /usr/local/kafka-manager/lib/../conf/:/usr/local/kafka-manager/lib/kafka-manager.kafka-manager-1.3.0.8-sans-externalized.jar:/usr/local/kafka-manager/lib/org.scala-lang.scala-library-2.11.7.jar:/usr/local/kafka-manager/lib/com.typesafe.play.twirl-api_2.11-1.1.1.jar:/usr/local/kafka-manager/lib/org.apache.commons.commons-lang3-3.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-server_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.build-link-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-exceptions-2.4.4.jar:/usr/local/kafka-manager/lib/org.javassist.javassist-3.19.0-GA.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-iteratees_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/org.scala-stm.scala-stm_2.11-0.7.jar:/usr/local/kafka-manager/lib/com.typesafe.config-1.3.0.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-json_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-functional_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-datacommons_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/joda-time.joda-time-2.8.1.jar:/usr/local/kafka-manager/lib/org.joda.joda-convert-1.7.jar:/usr/local/kafka-manager/lib/org.scala-lang.scala-reflect-2.11.6.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.core.jackson-core-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.core.jackson-annotations-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.core.jackson-databind-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.datatype.jackson-datatype-jdk8-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.datatype.jackson-datatype-jsr310-2.5.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-netty-utils-2.4.4.jar:/usr/local/kafka-manager/lib/org.slf4j.slf4j-api-1.7.12.jar:/usr/local/kafka-manager/lib/org.slf4j.jul-to-slf4j-1.7.12.jar:/usr/local/kafka-manager/lib/org.slf4j.jcl-over-slf4j-1.7.12.jar:/usr/local/kafka-manager/lib/ch.qos.logback.logback-core-1.1.3.jar:/usr/local/kafka-manager/lib/ch.qos.logback.logback-classic-1.1.3.jar:/usr/local/kafka-manager/lib/com.typesafe.akka.akka-actor_2.11-2.3.14.jar:/usr/local/kafka-manager/lib/com.typesafe.akka.akka-slf4j_2.11-2.3.14.jar:/usr/local/kafka-manager/lib/commons-codec.commons-codec-1.10.jar:/usr/local/kafka-manager/lib/xerces.xercesImpl-2.11.0.jar:/usr/local/kafka-manager/lib/xml-apis.xml-apis-1.4.01.jar:/usr/local/kafka-manager/lib/javax.transaction.jta-1.1.jar:/usr/local/kafka-manager/lib/com.google.inject.guice-4.0.jar:/usr/local/kafka-manager/lib/javax.inject.javax.inject-1.jar:/usr/local/kafka-manager/lib/aopalliance.aopalliance-1.0.jar:/usr/local/kafka-manager/lib/com.google.guava.guava-16.0.1.jar:/usr/local/kafka-manager/lib/com.google.inject.extensions.guice-assistedinject-4.0.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-netty-server_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/io.netty.netty-3.10.4.Final.jar:/usr/local/kafka-manager/lib/com.typesafe.netty.netty-http-pipelining-1.1.4.jar:/usr/local/kafka-manager/lib/com.google.code.findbugs.jsr305-2.0.1.jar:/usr/local/kafka-manager/lib/org.webjars.webjars-play_2.11-2.4.0-2.jar:/usr/local/kafka-manager/lib/org.webjars.requirejs-2.1.20.jar:/usr/local/kafka-manager/lib/org.webjars.webjars-locator-0.28.jar:/usr/local/kafka-manager/lib/org.webjars.webjars-locator-core-0.27.jar:/usr/local/kafka-manager/lib/org.apache.commons.commons-compress-1.9.jar:/usr/local/kafka-manager/lib/org.webjars.npm.validate.js-0.8.0.jar:/usr/local/kafka-manager/lib/org.webjars.bootstrap-3.3.5.jar:/usr/local/kafka-manager/lib/org.webjars.jquery-2.1.4.jar:/usr/local/kafka-manager/lib/org.webjars.backbonejs-1.2.3.jar:/usr/local/kafka-manager/lib/org.webjars.underscorejs-1.8.3.jar:/usr/local/kafka-manager/lib/org.webjars.dustjs-linkedin-2.6.1-1.jar:/usr/local/kafka-manager/lib/org.webjars.json-20121008-1.jar:/usr/local/kafka-manager/lib/org.apache.curator.curator-framework-2.9.1.jar:/usr/local/kaf
ubuntu 5099 1 0 Jun15 ? 00:10:24 java -Xloggc:/usr/local/cassandra/bin/../logs/gc.log -ea -XX:+UseThreadPriorities -XX:ThreadPriorityPolicy=42 -XX:+HeapDumpOnOutOfMemoryError -Xss256k -XX:StringTableSize=1000003 -XX:+AlwaysPreTouch -XX:-UseBiasedLocking -XX:+UseTLAB -XX:+ResizeTLAB -XX:+PerfDisableSharedMem -Djava.net.preferIPv4Stack=true -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio=8 -XX:MaxTenuringThreshold=1 -XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSWaitDuration=10000 -XX:+CMSParallelInitialMarkEnabled -XX:+CMSEdenChunksRecordAlways -XX:+CMSClassUnloadingEnabled -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintHeapAtGC -XX:+PrintTenuringDistribution -XX:+PrintGCApplicationStoppedTime -XX:+PrintPromotionFailure -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=10M -Xms1995M -Xmx1995M -Xmn200M -XX:+UseCondCardMark -XX:CompileCommandFile=/usr/local/cassandra/bin/../conf/hotspot_compiler -javaagent:/usr/local/cassandra/bin/../lib/jamm-0.3.0.jar -Dcassandra.jmx.local.port=7199 -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.password.file=/etc/cassandra/jmxremote.password -Djava.library.path=/usr/local/cassandra/bin/../lib/sigar-bin -Dlogback.configurationFile=logback.xml -Dcassandra.logdir=/usr/local/cassandra/bin/../logs -Dcassandra.storagedir=/usr/local/cassandra/bin/../data -cp /usr/local/cassandra/bin/../conf:/usr/local/cassandra/bin/../build/classes/main:/usr/local/cassandra/bin/../build/classes/thrift:/usr/local/cassandra/bin/../lib/ST4-4.0.8.jar:/usr/local/cassandra/bin/../lib/airline-0.6.jar:/usr/local/cassandra/bin/../lib/antlr-runtime-3.5.2.jar:/usr/local/cassandra/bin/../lib/apache-cassandra-3.6.jar:/usr/local/cassandra/bin/../lib/apache-cassandra-clientutil-3.6.jar:/usr/local/cassandra/bin/../lib/apache-cassandra-thrift-3.6.jar:/usr/local/cassandra/bin/../lib/asm-5.0.4.jar:/usr/local/cassandra/bin/../lib/caffeine-2.2.6.jar:/usr/local/cassandra/bin/../lib/cassandra-driver-core-3.0.0-shaded.jar:/usr/local/cassandra/bin/../lib/commons-cli-1.1.jar:/usr/local/cassandra/bin/../lib/commons-codec-1.2.jar:/usr/local/cassandra/bin/../lib/commons-lang3-3.1.jar:/usr/local/cassandra/bin/../lib/commons-math3-3.2.jar:/usr/local/cassandra/bin/../lib/compress-lzf-0.8.4.jar:/usr/local/cassandra/bin/../lib/concurrent-trees-2.4.0.jar:/usr/local/cassandra/bin/../lib/concurrentlinkedhashmap-lru-1.4.jar:/usr/local/cassandra/bin/../lib/disruptor-3.0.1.jar:/usr/local/cassandra/bin/../lib/ecj-4.4.2.jar:/usr/local/cassandra/bin/../lib/guava-18.0.jar:/usr/local/cassandra/bin/../lib/high-scale-lib-1.0.6.jar:/usr/local/cassandra/bin/../lib/hppc-0.5.4.jar:/usr/local/cassandra/bin/../lib/jackson-core-asl-1.9.2.jar:/usr/local/cassandra/bin/../lib/jackson-mapper-asl-1.9.2.jar:/usr/local/cassandra/bin/../lib/jamm-0.3.0.jar:/usr/local/cassandra/bin/../lib/javax.inject.jar:/usr/local/cassandra/bin/../lib/jbcrypt-0.3m.jar:/usr/local/cassandra/bin/../lib/jcl-over-slf4j-1.7.7.jar:/usr/local/cassandra/bin/../lib/jflex-1.6.0.jar:/usr/local/cassandra/bin/../lib/jna-4.0.0.jar:/usr/local/cassandra/bin/../lib/joda-time-2.4.jar:/usr/local/cassandra/bin/../lib/json-simple-1.1.jar:/usr/local/cassandra/bin/../lib/libthrift-0.9.2.jar:/usr/local/cassandra/bin/../lib/log4j-over-slf4j-1.7.7.jar:/usr/local/cassandra/bin/../lib/logback-classic-1.1.3.jar:/usr/local/cassandra/bin/../lib/logback-core-1.1.3.jar:/usr/local/cassandra/bin/../lib/lz4-1.3.0.jar:/usr/local/cassandra/bin/../lib/metrics-core-3.1.0.jar:/usr/local/cassandra/bin/../lib/metrics-logback-3.1.0.jar:/usr/local/cassandra/bin/../lib/netty-all-4.0.36.Final.jar:/usr/local/cassandra/bin/../lib/ohc-core-0.4.3.jar:/usr/local/cassandra/bin/../lib/ohc-core-j8-0.4.3.jar:/usr/local/cassandra/bin/../lib/primitive-1.0.jar:/usr/local/cassandra/bin/../lib/reporter-config-base-3.0.0.jar:/usr/local/cassandra/bin/../lib/reporter-config3-3.0.0.jar:/usr/local/cassandra/bin/../lib/sigar-1.6.4.jar:/usr/local/cassandra/bin/../lib/slf4j-api-1.7.7.jar:/usr/local/cassandra/bin/../lib/snakeyaml-1.11.jar:/usr/local/cassandra/
ubuntu 5331 4658 0 15:12 pts/6 00:00:00 grep --color=auto java
ubuntu 15241 15206 0 Jun13 pts/2 00:04:38 /usr/bin/java -server -Ddaemon.name=nimbus -Dstorm.options= -Dstorm.home=/usr/local/storm -Dstorm.log.dir=/usr/local/storm/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm/conf -Xmx1024m -Dlogfile.name=nimbus.log -DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector -Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml org.apache.storm.daemon.nimbus
ubuntu 15242 15211 0 Jun13 pts/4 00:02:26 /usr/bin/java -server -Ddaemon.name=ui -Dstorm.options= -Dstorm.home=/usr/local/storm -Dstorm.log.dir=/usr/local/storm/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm:/usr/local/storm/conf -Xmx768m -Dlogfile.name=ui.log -DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector -Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml org.apache.storm.ui.core
root 15553 15552 0 Jun13 ? 00:02:27 java -server -Ddaemon.name=ui -Dstorm.options= -Dstorm.home=/usr/local/storm -Dstorm.log.dir=/usr/local/storm/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm:/usr/local/storm/conf -Xmx768m -Dlogfile.name=ui.log -DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector -Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml org.apache.storm.ui.core
root 19520 19519 0 Jun13 ? 00:03:03 java -server -Ddaemon.name=ui -Dstorm.options= -Dstorm.home=/usr/local/storm -Dstorm.log.dir=/usr/local/storm/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm:/usr/local/storm/conf -Xmx768m -Dlogfile.name=ui.log -DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector -Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml org.apache.storm.ui.core
ubuntu 28440 1 0 Jun08 ? 00:07:35 /usr/bin/java -Xmx512M -server -XX:+UseG1GC -XX:MaxGCPauseMillis=20 -XX:InitiatingHeapOccupancyPercent=35 -XX:+DisableExplicitGC -Djava.awt.headless=true -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Dkafka.logs.dir=/usr/local/kafka/bin/../logs -Dlog4j.configuration=file:/usr/local/kafka/bin/../config/tools-log4j.properties -cp :/usr/local/kafka/bin/../libs/* kafka.tools.ConsoleConsumer --zookeeper localhost:2181 --from-beginning --topic yyyyyy
ubuntu 28945 1 0 Jun13 ? 00:04:24 /usr/bin/java -cp /usr/local/spark/conf/:/usr/local/spark/lib/spark-assembly-1.6.1-hadoop2.6.0.jar:/usr/local/spark/lib/datanucleus-rdbms-3.2.9.jar:/usr/local/spark/lib/datanucleus-api-jdo-3.2.6.jar:/usr/local/spark/lib/datanucleus-core-3.2.10.jar -Xms1g -Xmx1g org.apache.spark.deploy.master.Master --ip ip-172-31-1-5 --port 7077 --webui-port 8080

[bengecko]

OK so it definitely looks like there is not enough memory on the machine to run the java process in question. There is always a certain amount of memory used for the operating system so if the java process is asking for more memory than is available, you’ll see the error you mentioned. My conclusion is you need more RAM on the AWS instance. 16G should be fine. Basically the java process needs room to allocate more memory as needed.

On Jun 17, 2016, at 08:16, Sidi Chang notifications@github.com wrote:

Hi,
After run free -m the output is

     total       used       free     shared    buffers     cached

Mem: 7983 7096 887 0 185 1272
-/+ buffers/cache: 5638 2345
Swap: 0 0 0

After running the second command, the output is
ubuntu 2771 1 0 Jun08 ? 00:11:42 /usr/bin/java -Dzookeeper.log.dir=. -Dzookeeper.root.logger=INFO,CONSOLE -cp /usr/local/zookeeper/bin/../build/classes:/usr/local/zookeeper/bin/../build/lib/.jar:/usr/local/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/usr/local/zookeeper/bin/../lib/slf4j-api-1.6.1.jar:/usr/local/zookeeper/bin/../lib/netty-3.7.0.Final.jar:/usr/local/zookeeper/bin/../lib/log4j-1.2.16.jar:/usr/local/zookeeper/bin/../lib/jline-0.9.94.jar:/usr/local/zookeeper/bin/../zookeeper-3.4.6.jar:/usr/local/zookeeper/bin/../src/java/lib/.jar:/usr/local/zookeeper/bin/../conf: -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.local.only=false org.apache.zookeeper.server.quorum.QuorumPeerMain /usr/local/zookeeper/bin/../conf/zoo.cfg
root 3897 3896 0 Jun08 ? 01:51:14 java -Xmx1G -Xms1G -server -XX:+UseG1GC -XX:MaxGCPauseMillis=20 -XX:InitiatingHeapOccupancyPercent=35 -XX:+DisableExplicitGC -Djava.awt.headless=true -Xloggc:/usr/local/kafka/bin/../logs/kafkaServer-gc.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.port=9999 -Dkafka.logs.dir=/usr/local/kafka/bin/../logs -Dlog4j.configuration=file:/usr/local/kafka/bin/../config/log4j.properties -cp :/usr/local/kafka/bin/../libs/* kafka.Kafka /usr/local/kafka/config/server.properties
ubuntu 4426 1 0 Jun08 ? 01:05:43 /usr/bin/java -Duser.dir=/usr/local/kafka-manager -Dhttp.port=9001 -cp /usr/local/kafka-manager/lib/../conf/:/usr/local/kafka-manager/lib/kafka-manager.kafka-manager-1.3.0.8-sans-externalized.jar:/usr/local/kafka-manager/lib/org.scala-lang.scala-library-2.11.7.jar:/usr/local/kafka-manager/lib/com.typesafe.play.twirl-api_2.11-1.1.1.jar:/usr/local/kafka-manager/lib/org.apache.commons.commons-lang3-3.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-server_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.build-link-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-exceptions-2.4.4.jar:/usr/local/kafka-manager/lib/org.javassist.javassist-3.19.0-GA.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-iteratees_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/org.scala-stm.scala-stm_2.11-0.7.jar:/usr/local/kafka-manager/lib/com.typesafe.config-1.3.0.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-json_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-functional_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-datacommons_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/joda-time.joda-time-2.8.1.jar:/usr/local/kafka-manager/lib/org.joda.joda-convert-1.7.jar:/usr/local/kafka-manager/lib/org.scala-lang.scala-reflect-2.11.6.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.core.jackson-core-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.core.jackson-annotations-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.core.jackson-databind-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.datatype.jackson-datatype-jdk8-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.datatype.jackson-datatype-jsr310-2.5.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-netty-utils-2.4.4.jar:/usr/local/kafka-manager/lib/org.slf4j.slf4j-api-1.7.12.jar:/usr/local/kafka-manager/lib/org.slf4j.jul-to-slf4j-1.7.12.jar:/usr/local/kafka-manager/lib/org.slf4j.jcl-over-slf4j-1.7.12.jar:/usr/local/kafka-manager/lib/ch.qos.logback.logback-core-1.1.3.jar:/usr/local/kafka-manager/lib/ch.qos.logback.logback-classic-1.1.3.jar:/usr/local/kafka-manager/lib/com.typesafe.akka.akka-actor_2.11-2.3.14.jar:/usr/local/kafka-manager/lib/com.typesafe.akka.akka-slf4j_2.11-2.3.14.jar:/usr/local/kafka-manager/lib/commons-codec.commons-codec-1.10.jar:/usr/local/kafka-manager/lib/xerces.xercesImpl-2.11.0.jar:/usr/local/kafka-manager/lib/xml-apis.xml-apis-1.4.01.jar:/usr/local/kafka-manager/lib/javax.transaction.jta-1.1.jar:/usr/local/kafka-manager/lib/com.google.inject.guice-4.0.jar:/usr/local/kafka-manager/lib/javax.inject.javax.inject-1.jar:/usr/local/kafka-manager/lib/aopalliance.aopalliance-1.0.jar:/usr/local/kafka-manager/lib/com.google.guava.guava-16.0.1.jar:/usr/local/kafka-manager/lib/com.google.inject.extensions.guice-assistedinject-4.0.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-netty-server_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/io.netty.netty-3.10.4.Final.jar:/usr/local/kafka-manager/lib/com.typesafe.netty.netty-http-pipelining-1.1.4.jar:/usr/local/kafka-manager/lib/com.google.code.findbugs.jsr305-2.0.1.jar:/usr/local/kafka-manager/lib/org.webjars.webjars-play_2.11-2.4.0-2.jar:/usr/local/kafka-manager/lib/org.webjars.requirejs-2.1.20.jar:/usr/local/kafka-manager/lib/org.webjars.webjars-locator-0.28.jar:/usr/local/kafka-manager/lib/org.webjars.webjars-locator-core-0.27.jar:/usr/local/kafka-manager/lib/org.apache.commons.commons-compress-1.9.jar:/usr/local/kafka-manager/lib/org.webjars.npm.validate.js-0.8.0.jar:/usr/local/kafka-manager/lib/org.webjars.bootstrap-3.3.5.jar:/usr/local/kafka-manager/lib/org.webjars.jquery-2.1.4.jar:/usr/local/kafka-manager/lib/org.webjars.backbonejs-1.2.3.jar:/usr/local/kafka-manager/lib/org.webjars.underscorejs-1.8.3.jar:/usr/local/kafka-manager/lib/org.webjars.dustjs-linkedin-2.6.1-1.jar:/usr/local/kafka-manager/lib/org.webjars.json-20121008-1.jar:/usr/local/kafka-manager/lib/org.apache.curator.curator-framework-2.9.1.jar:/usr/local/kaf
ubuntu 5099 1 0 Jun15 ? 00:10:24 java -Xloggc:/usr/local/cassandra/bin/../logs/gc.log -ea -XX:+UseThreadPriorities -XX:ThreadPriorityPolicy=42 -XX:+HeapDumpOnOutOfMemoryError -Xss256k -XX:StringTableSize=1000003 -XX:+AlwaysPreTouch -XX:-UseBiasedLocking -XX:+UseTLAB -XX:+ResizeTLAB -XX:+PerfDisableSharedMem -Djava.net.preferIPv4Stack=true -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio=8 -XX:MaxTenuringThreshold=1 -XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSWaitDuration=10000 -XX:+CMSParallelInitialMarkEnabled -XX:+CMSEdenChunksRecordAlways -XX:+CMSClassUnloadingEnabled -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintHeapAtGC -XX:+PrintTenuringDistribution -XX:+PrintGCApplicationStoppedTime -XX:+PrintPromotionFailure -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=10M -Xms1995M -Xmx1995M -Xmn200M -XX:+UseCondCardMark -XX:CompileCommandFile=/usr/local/cassandra/bin/../conf/hotspot_compiler -javaagent:/usr/local/cassandra/bin/../lib/jamm-0.3.0.jar -Dcassandra.jmx.local.port=7199 -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.password.file=/etc/cassandra/jmxremote.password -Djava.library.path=/usr/local/cassandra/bin/../lib/sigar-bin -Dlogback.configurationFile=logback.xml -Dcassandra.logdir=/usr/local/cassandra/bin/../logs -Dcassandra.storagedir=/usr/local/cassandra/bin/../data -cp /usr/local/cassandra/bin/../conf:/usr/local/cassandra/bin/../build/classes/main:/usr/local/cassandra/bin/../build/classes/thrift:/usr/local/cassandra/bin/../lib/ST4-4.0.8.jar:/usr/local/cassandra/bin/../lib/airline-0.6.jar:/usr/local/cassandra/bin/../lib/antlr-runtime-3.5.2.jar:/usr/local/cassandra/bin/../lib/apache-cassandra-3.6.jar:/usr/local/cassandra/bin/../lib/apache-cassandra-clientutil-3.6.jar:/usr/local/cassandra/bin/../lib/apache-cassandra-thrift-3.6.jar:/usr/local/cassandra/bin/../lib/asm-5.0.4.jar:/usr/local/cassandra/bin/../lib/caffeine-2.2.6.jar:/usr/local/cassandra/bin/../lib/cassandra-driver-core-3.0.0-shaded.jar:/usr/local/cassandra/bin/../lib/commons-cli-1.1.jar:/usr/local/cassandra/bin/../lib/commons-codec-1.2.jar:/usr/local/cassandra/bin/../lib/commons-lang3-3.1.jar:/usr/local/cassandra/bin/../lib/commons-math3-3.2.jar:/usr/local/cassandra/bin/../lib/compress-lzf-0.8.4.jar:/usr/local/cassandra/bin/../lib/concurrent-trees-2.4.0.jar:/usr/local/cassandra/bin/../lib/concurrentlinkedhashmap-lru-1.4.jar:/usr/local/cassandra/bin/../lib/disruptor-3.0.1.jar:/usr/local/cassandra/bin/../lib/ecj-4.4.2.jar:/usr/local/cassandra/bin/../lib/guava-18.0.jar:/usr/local/cassandra/bin/../lib/high-scale-lib-1.0.6.jar:/usr/local/cassandra/bin/../lib/hppc-0.5.4.jar:/usr/local/cassandra/bin/../lib/jackson-core-asl-1.9.2.jar:/usr/local/cassandra/bin/../lib/jackson-mapper-asl-1.9.2.jar:/usr/local/cassandra/bin/../lib/jamm-0.3.0.jar:/usr/local/cassandra/bin/../lib/javax.inject.jar:/usr/local/cassandra/bin/../lib/jbcrypt-0.3m.jar:/usr/local/cassandra/bin/../lib/jcl-over-slf4j-1.7.7.jar:/usr/local/cassandra/bin/../lib/jflex-1.6.0.jar:/usr/local/cassandra/bin/../lib/jna-4.0.0.jar:/usr/local/cassandra/bin/../lib/joda-time-2.4.jar:/usr/local/cassandra/bin/../lib/json-simple-1.1.jar:/usr/local/cassandra/bin/../lib/libthrift-0.9.2.jar:/usr/local/cassandra/bin/../lib/log4j-over-slf4j-1.7.7.jar:/usr/local/cassandra/bin/../lib/logback-classic-1.1.3.jar:/usr/local/cassandra/bin/../lib/logback-core-1.1.3.jar:/usr/local/cassandra/bin/../lib/lz4-1.3.0.jar:/usr/local/cassandra/bin/../lib/metrics-core-3.1.0.jar:/usr/local/cassandra/bin/../lib/metrics-logback-3.1.0.jar:/usr/local/cassandra/bin/../lib/netty-all-4.0.36.Final.jar:/usr/local/cassandra/bin/../lib/ohc-core-0.4.3.jar:/usr/local/cassandra/bin/../lib/ohc-core-j8-0.4.3.jar:/usr/local/cassandra/bin/../lib/primitive-1.0.jar:/usr/local/cassandra/bin/../lib/reporter-config-base-3.0.0.jar:/usr/local/cassandra/bin/../lib/reporter-config3-3.0.0.jar:/usr/local/cassandra/bin/../lib/sigar-1.6.4.jar:/usr/local/cassandra/bin/../lib/slf4j-api-1.7.7.jar:/usr/local/cassandra/bin/../lib/snakeyaml-1.11.jar:/usr/local/cassandra/
ubuntu 5331 4658 0 15:12 pts/6 00:00:00 grep --color=auto java
ubuntu 15241 15206 0 Jun13 pts/2 00:04:38 /usr/bin/java -server -Ddaemon.name=nimbus -Dstorm.options= -Dstorm.home=/usr/local/storm -Dstorm.log.dir=/usr/local/storm/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm/conf -Xmx1024m -Dlogfile.name=nimbus.log -DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector -Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml org.apache.storm.daemon.nimbus
ubuntu 15242 15211 0 Jun13 pts/4 00:02:26 /usr/bin/java -server -Ddaemon.name=ui -Dstorm.options= -Dstorm.home=/usr/local/storm -Dstorm.log.dir=/usr/local/storm/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm:/usr/local/storm/conf -Xmx768m -Dlogfile.name=ui.log -DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector -Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml org.apache.storm.ui.core
root 15553 15552 0 Jun13 ? 00:02:27 java -server -Ddaemon.name=ui -Dstorm.options= -Dstorm.home=/usr/local/storm -Dstorm.log.dir=/usr/local/storm/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm:/usr/local/storm/conf -Xmx768m -Dlogfile.name=ui.log -DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector -Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml org.apache.storm.ui.core
root 19520 19519 0 Jun13 ? 00:03:03 java -server -Ddaemon.name=ui -Dstorm.options= -Dstorm.home=/usr/local/storm -Dstorm.log.dir=/usr/local/storm/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm:/usr/local/storm/conf -Xmx768m -Dlogfile.name=ui.log -DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector -Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml org.apache.storm.ui.core
ubuntu 28440 1 0 Jun08 ? 00:07:35 /usr/bin/java -Xmx512M -server -XX:+UseG1GC -XX:MaxGCPauseMillis=20 -XX:InitiatingHeapOccupancyPercent=35 -XX:+DisableExplicitGC -Djava.awt.headless=true -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Dkafka.logs.dir=/usr/local/kafka/bin/../logs -Dlog4j.configuration=file:/usr/local/kafka/bin/../config/tools-log4j.properties -cp :/usr/local/kafka/bin/../libs/* kafka.tools.ConsoleConsumer --zookeeper localhost:2181 --from-beginning --topic yyyyyy
ubuntu 28945 1 0 Jun13 ? 00:04:24 /usr/bin/java -cp /usr/local/spark/conf/:/usr/local/spark/lib/spark-assembly-1.6.1-hadoop2.6.0.jar:/usr/local/spark/lib/datanucleus-rdbms-3.2.9.jar:/usr/local/spark/lib/datanucleus-api-jdo-3.2.6.jar:/usr/local/spark/lib/datanucleus-core-3.2.10.jar -Xms1g -Xmx1g org.apache.spark.deploy.master.Master --ip ip-172-31-1-5 --port 7077 --webui-port 8080

—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub #4 (comment), or mute the thread https://github.com/notifications/unsubscribe/AIjLrn65NXM3qECbYVznLEJnK71LRYObks5qMro-gaJpZM4I3-M2.

[LouisChang]

Hi,

Thank you!

I re-ordered the AWS node and spent some time to trouble shooting with my
IP.

Finally everything is finished and works fine. I really thank you for your
help!

Best,

Sidi
On Friday, June 17, 2016, Ben Copeland <notifications@github.com
javascript:_e(%7B%7D,'cvml','notifications@github.com');> wrote:

OK so it definitely looks like there is not enough memory on the machine
to run the java process in question. There is always a certain amount of
memory used for the operating system so if the java process is asking for
more memory than is available, you’ll see the error you mentioned. My
conclusion is you need more RAM on the AWS instance. 16G should be fine.
Basically the java process needs room to allocate more memory as needed.

On Jun 17, 2016, at 08:16, Sidi Chang notifications@github.com wrote:

Hi,
After run free -m the output is

total used free shared buffers cached
Mem: 7983 7096 887 0 185 1272
-/+ buffers/cache: 5638 2345
Swap: 0 0 0

After running the second command, the output is
ubuntu 2771 1 0 Jun08 ? 00:11:42 /usr/bin/java -Dzookeeper.log.dir=.
-Dzookeeper.root.logger=INFO,CONSOLE -cp
/usr/local/zookeeper/bin/../build/classes:/usr/local/zookeeper/bin/../build/lib/.jar:/usr/local/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/usr/local/zookeeper/bin/../lib/slf4j-api-1.6.1.jar:/usr/local/zookeeper/bin/../lib/netty-3.7.0.Final.jar:/usr/local/zookeeper/bin/../lib/log4j-1.2.16.jar:/usr/local/zookeeper/bin/../lib/jline-0.9.94.jar:/usr/local/zookeeper/bin/../zookeeper-3.4.6.jar:/usr/local/zookeeper/bin/../src/java/lib/.jar:/usr/local/zookeeper/bin/../conf:
-Dcom.sun.management.jmxremote
-Dcom.sun.management.jmxremote.local.only=false
org.apache.zookeeper.server.quorum.QuorumPeerMain
/usr/local/zookeeper/bin/../conf/zoo.cfg
root 3897 3896 0 Jun08 ? 01:51:14 java -Xmx1G -Xms1G -server
-XX:+UseG1GC -XX:MaxGCPauseMillis=20 -XX:InitiatingHeapOccupancyPercent=35
-XX:+DisableExplicitGC -Djava.awt.headless=true
-Xloggc:/usr/local/kafka/bin/../logs/kafkaServer-gc.log -verbose:gc
-XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps
-Dcom.sun.management.jmxremote
-Dcom.sun.management.jmxremote.authenticate=false
-Dcom.sun.management.jmxremote.ssl=false
-Dcom.sun.management.jmxremote.port=9999
-Dkafka.logs.dir=/usr/local/kafka/bin/../logs
-Dlog4j.configuration=file:/usr/local/kafka/bin/../config/log4j.properties
-cp :/usr/local/kafka/bin/../libs/* kafka.Kafka
/usr/local/kafka/config/server.properties
ubuntu 4426 1 0 Jun08 ? 01:05:43 /usr/bin/java
-Duser.dir=/usr/local/kafka-manager -Dhttp.port=9001 -cp
/usr/local/kafka-manager/lib/../conf/:/usr/local/kafka-manager/lib/kafka-manager.kafka-manager-1.3.0.8-sans-externalized.jar:/usr/local/kafka-manager/lib/org.scala-lang.scala-library-2.11.7.jar:/usr/local/kafka-manager/lib/com.typesafe.play.twirl-api_2.11-1.1.1.jar:/usr/local/kafka-manager/lib/org.apache.commons.commons-lang3-3.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-server_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.build-link-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-exceptions-2.4.4.jar:/usr/local/kafka-manager/lib/org.javassist.javassist-3.19.0-GA.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-iteratees_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/org.scala-stm.scala-stm_2.11-0.7.jar:/usr/local/kafka-manager/lib/com.typesafe.config-1.3.0.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-json_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-functional_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-datacommons_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/joda-time.joda-time-2.8.1.jar:/usr/local/kafka-manager/lib/org.joda.joda-convert-1.7.jar:/usr/local/kafka-manager/lib/org.scala-lang.scala-reflect-2.11.6.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.core.jackson-core-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.core.jackson-annotations-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.core.jackson-databind-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.datatype.jackson-datatype-jdk8-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.datatype.jackson-datatype-jsr310-2.5.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-netty-utils-2.4.4.jar:/usr/local/kafka-manager/lib/org.slf4j.slf4j-api-1.7.12.jar:/usr/local/kafka-manager/lib/org.slf4j.jul-to-slf4j-1.7.12.jar:/usr/local/kafka-manager/lib/org.slf4j.jcl-over-slf4j-1.7.12.jar:/usr/local/kafka-manager/lib/ch.qos.logback.logback-core-1.1.3.jar:/usr/local/kafka-manager/lib/ch.qos.logback.logback-classic-1.1.3.jar:/usr/local/kafka-manager/lib/com.typesafe.akka.akka-actor_2.11-2.3.14.jar:/usr/local/kafka-manager/lib/com.typesafe.akka.akka-slf4j_2.11-2.3.14.jar:/usr/local/kafka-manager/lib/commons-codec.commons-codec-1.10.jar:/usr/local/kafka-manager/lib/xerces.xercesImpl-2.11.0.jar:/usr/local/kafka-manager/lib/xml-apis.xml-apis-1.4.01.jar:/usr/local/kafka-manager/lib/javax.transaction.jta-1.1.jar:/usr/local/kafka-manager/lib/com.google.inject.guice-4.0.jar:/usr/local/kafka-manager/lib/javax.inject.javax.inject-1.jar:/usr/local/kafka-manager/lib/aopalliance.aopalliance-1.0.jar:/usr/local/kafka-manager/lib/com.google.guava.guava-16.0.1.jar:/usr/local/kafka-manager/lib/com.google.inject.extensions.guice-assistedinject-4.0.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-netty-server_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/io.netty.netty-3.10.4.Final.jar:/usr/local/kafka-manager/lib/com.typesafe.netty.netty-http-pipelining-1.1.4.jar:/usr/local/kafka-manager/lib/com.google.code.findbugs.jsr305-2.0.1.jar:/usr/local/kafka-manager/lib/org.webjars.webjars-play_2.11-2.4.0-2.jar:/usr/local/kafka-manager/lib/org.webjars.requirejs-2.1.20.jar:/usr/local/kafka-manager/lib/org.webjars.webjars-locator-0.28.jar:/usr/local/kafka-manager/lib/org.webjars.webjars-locator-core-0.27.jar:/usr/local/kafka-manager/lib/org.apache.commons.commons-compress-1.9.jar:/usr/local/kafka-manager/lib/org.webjars.npm.validate.js-0.8.0.jar:/usr/local/kafka-manager/lib/org.webjars.bootstrap-3.3.5.jar:/usr/local/kafka-manager/lib/org.webjars.jquery-2.1.4.jar:/usr/local/kafka-manager/lib/org.webjars.backbonejs-1.2.3.jar:/usr/local/kafka-manager/lib/org.webjars.underscorejs-1.8.3.jar:/usr/local/kafka-manager/lib/org.webjars.dustjs-linkedin-2.6.1-1.jar:/usr/local/kafka-manager/lib/org.webjars.json-20121008-1.jar:/usr/local/kafka-manager/lib/org.apache.curator.curator-framework-2.9.1.jar:/usr/local/kaf
ubuntu 5099 1 0 Jun15 ? 00:10:24 java
-Xloggc:/usr/local/cassandra/bin/../logs/gc.log -ea
-XX:+UseThreadPriorities -XX:ThreadPriorityPolicy=42
-XX:+HeapDumpOnOutOfMemoryError -Xss256k -XX:StringTableSize=1000003
-XX:+AlwaysPreTouch -XX:-UseBiasedLocking -XX:+UseTLAB -XX:+ResizeTLAB
-XX:+PerfDisableSharedMem -Djava.net.preferIPv4Stack=true -XX:+UseParNewGC
-XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio=8
-XX:MaxTenuringThreshold=1 -XX:CMSInitiatingOccupancyFraction=75
-XX:+UseCMSInitiatingOccupancyOnly -XX:CMSWaitDuration=10000
-XX:+CMSParallelInitialMarkEnabled -XX:+CMSEdenChunksRecordAlways
-XX:+CMSClassUnloadingEnabled -XX:+PrintGCDetails -XX:+PrintGCDateStamps
-XX:+PrintHeapAtGC -XX:+PrintTenuringDistribution
-XX:+PrintGCApplicationStoppedTime -XX:+PrintPromotionFailure
-XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=10M
-Xms1995M -Xmx1995M -Xmn200M -XX:+UseCondCardMark
-XX:CompileCommandFile=/usr/local/cassandra/bin/../conf/hotspot_compiler
-javaagent:/usr/local/cassandra/bin/../lib/jamm-0.3.0.jar
-Dcassandra.jmx.local.port=7199
-Dcom.sun.management.jmxremote.authenticate=false
-Dcom.sun.management.jmxremote.password.file=/etc/cassandra/jmxremote.password
-Djava.library.path=/usr/local/cassandra/bin/../lib/sigar-bin
-Dlogback.configurationFile=logback.xml
-Dcassandra.logdir=/usr/local/cassandra/bin/../logs
-Dcassandra.storagedir=/usr/local/cassandra/bin/../data -cp
/usr/local/cassandra/bin/../conf:/usr/local/cassandra/bin/../build/classes/main:/usr/local/cassandra/bin/../build/classes/thrift:/usr/local/cassandra/bin/../lib/ST4-4.0.8.jar:/usr/local/cassandra/bin/../lib/airline-0.6.jar:/usr/local/cassandra/bin/../lib/antlr-runtime-3.5.2.jar:/usr/local/cassandra/bin/../lib/apache-cassandra-3.6.jar:/usr/local/cassandra/bin/../lib/apache-cassandra-clientutil-3.6.jar:/usr/local/cassandra/bin/../lib/apache-cassandra-thrift-3.6.jar:/usr/local/cassandra/bin/../lib/asm-5.0.4.jar:/usr/local/cassandra/bin/../lib/caffeine-2.2.6.jar:/usr/local/cassandra/bin/../lib/cassandra-driver-core-3.0.0-shaded.jar:/usr/local/cassandra/bin/../lib/commons-cli-1.1.jar:/usr/local/cassandra/bin/../lib/commons-codec-1.2.jar:/usr/local/cassandra/bin/../lib/commons-lang3-3.1.jar:/usr/local/cassandra/bin/../lib/commons-math3-3.2.jar:/usr/local/cassandra/bin/../lib/compress-lzf-0.8.4.jar:/usr/local/cassandra/bin/../lib/concurrent-trees-2.4.0.jar:/usr/local/cassandra/bin/../lib/concurrentlinkedhashmap-lru-1.4.jar:/usr/local/cassandra/bin/../lib/disruptor-3.0.1.jar:/usr/local/cassandra/bin/../lib/ecj-4.4.2.jar:/usr/local/cassandra/bin/../lib/guava-18.0.jar:/usr/local/cassandra/bin/../lib/high-scale-lib-1.0.6.jar:/usr/local/cassandra/bin/../lib/hppc-0.5.4.jar:/usr/local/cassandra/bin/../lib/jackson-core-asl-1.9.2.jar:/usr/local/cassandra/bin/../lib/jackson-mapper-asl-1.9.2.jar:/usr/local/cassandra/bin/../lib/jamm-0.3.0.jar:/usr/local/cassandra/bin/../lib/javax.inject.jar:/usr/local/cassandra/bin/../lib/jbcrypt-0.3m.jar:/usr/local/cassandra/bin/../lib/jcl-over-slf4j-1.7.7.jar:/usr/local/cassandra/bin/../lib/jflex-1.6.0.jar:/usr/local/cassandra/bin/../lib/jna-4.0.0.jar:/usr/local/cassandra/bin/../lib/joda-time-2.4.jar:/usr/local/cassandra/bin/../lib/json-simple-1.1.jar:/usr/local/cassandra/bin/../lib/libthrift-0.9.2.jar:/usr/local/cassandra/bin/../lib/log4j-over-slf4j-1.7.7.jar:/usr/local/cassandra/bin/../lib/logback-classic-1.1.3.jar:/usr/local/cassandra/bin/../lib/logback-core-1.1.3.jar:/usr/local/cassandra/bin/../lib/lz4-1.3.0.jar:/usr/local/cassandra/bin/../lib/metrics-core-3.1.0.jar:/usr/local/cassandra/bin/../lib/metrics-logback-3.1.0.jar:/usr/local/cassandra/bin/../lib/netty-all-4.0.36.Final.jar:/usr/local/cassandra/bin/../lib/ohc-core-0.4.3.jar:/usr/local/cassandra/bin/../lib/ohc-core-j8-0.4.3.jar:/usr/local/cassandra/bin/../lib/primitive-1.0.jar:/usr/local/cassandra/bin/../lib/reporter-config-base-3.0.0.jar:/usr/local/cassandra/bin/../lib/reporter-config3-3.0.0.jar:/usr/local/cassandra/bin/../lib/sigar-1.6.4.jar:/usr/local/cassandra/bin/../lib/slf4j-api-1.7.7.jar:/usr/local/cassandra/bin/../lib/snakeyaml-1.11.jar:/usr/local/cassandra/
ubuntu 5331 4658 0 15:12 pts/6 00:00:00 grep --color=auto java
ubuntu 15241 15206 0 Jun13 pts/2 00:04:38 /usr/bin/java -server
-Ddaemon.name=nimbus -Dstorm.options= -Dstorm.home=/usr/local/storm
-Dstorm.log.dir=/usr/local/storm/logs
-Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
-Dstorm.conf.file= -cp
/usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm/conf
-Xmx1024m -Dlogfile.name=nimbus.log
-DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector
-Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml
org.apache.storm.daemon.nimbus
ubuntu 15242 15211 0 Jun13 pts/4 00:02:26 /usr/bin/java -server
-Ddaemon.name=ui -Dstorm.options= -Dstorm.home=/usr/local/storm
-Dstorm.log.dir=/usr/local/storm/logs
-Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
-Dstorm.conf.file= -cp
/usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm:/usr/local/storm/conf
-Xmx768m -Dlogfile.name=ui.log
-DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector
-Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml
org.apache.storm.ui.core
root 15553 15552 0 Jun13 ? 00:02:27 java -server -Ddaemon.name=ui
-Dstorm.options= -Dstorm.home=/usr/local/storm
-Dstorm.log.dir=/usr/local/storm/logs
-Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
-Dstorm.conf.file= -cp
/usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm:/usr/local/storm/conf
-Xmx768m -Dlogfile.name=ui.log
-DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector
-Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml
org.apache.storm.ui.core
root 19520 19519 0 Jun13 ? 00:03:03 java -server -Ddaemon.name=ui
-Dstorm.options= -Dstorm.home=/usr/local/storm
-Dstorm.log.dir=/usr/local/storm/logs
-Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
-Dstorm.conf.file= -cp
/usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm:/usr/local/storm/conf
-Xmx768m -Dlogfile.name=ui.log
-DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector
-Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml
org.apache.storm.ui.core
ubuntu 28440 1 0 Jun08 ? 00:07:35 /usr/bin/java -Xmx512M -server
-XX:+UseG1GC -XX:MaxGCPauseMillis=20 -XX:InitiatingHeapOccupancyPercent=35
-XX:+DisableExplicitGC -Djava.awt.headless=true
-Dcom.sun.management.jmxremote
-Dcom.sun.management.jmxremote.authenticate=false
-Dcom.sun.management.jmxremote.ssl=false
-Dkafka.logs.dir=/usr/local/kafka/bin/../logs
-Dlog4j.configuration=file:/usr/local/kafka/bin/../config/tools-log4j.properties
-cp :/usr/local/kafka/bin/../libs/* kafka.tools.ConsoleConsumer --zookeeper
localhost:2181 --from-beginning --topic yyyyyy
ubuntu 28945 1 0 Jun13 ? 00:04:24 /usr/bin/java -cp
/usr/local/spark/conf/:/usr/local/spark/lib/spark-assembly-1.6.1-hadoop2.6.0.jar:/usr/local/spark/lib/datanucleus-rdbms-3.2.9.jar:/usr/local/spark/lib/datanucleus-api-jdo-3.2.6.jar:/usr/local/spark/lib/datanucleus-core-3.2.10.jar
-Xms1g -Xmx1g org.apache.spark.deploy.master.Master --ip ip-172-31-1-5
--port 7077 --webui-port 8080

—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub <
https://github.com/Interana/eventsim/issues/4#issuecomment-226797393>, or
mute the thread <
https://github.com/notifications/unsubscribe/AIjLrn65NXM3qECbYVznLEJnK71LRYObks5qMro-gaJpZM4I3-M2
.

—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
#4 (comment),
or mute the thread
https://github.com/notifications/unsubscribe/AEExOsKQyMjkCuvI5xmIZMnOXW_WBZevks5qMsFLgaJpZM4I3-M2
.

Sidi CHANG
Master in Computer Science (Computational Operations Research Track)
College of William and Mary
Williamsburg, VA, United States

[bengecko]

Sidi,

My pleasure I'm glad we got through it :)

On Friday, June 17, 2016, Sidi Chang notifications@github.com wrote:

Hi,

Thank you!

I re-ordered the AWS node and spent some time to trouble shooting with my
IP.

Finally everything is finished and works fine. I really thank you for your
help!

Best,

Sidi
On Friday, June 17, 2016, Ben Copeland <notifications@github.com
javascript:_e(%7B%7D,'cvml','notifications@github.com');
<javascript:_e(%7B%7D,'cvml','notifications@github.com
javascript:_e(%7B%7D,'cvml','notifications@github.com');');>> wrote:

OK so it definitely looks like there is not enough memory on the machine
to run the java process in question. There is always a certain amount of
memory used for the operating system so if the java process is asking for
more memory than is available, you’ll see the error you mentioned. My
conclusion is you need more RAM on the AWS instance. 16G should be fine.
Basically the java process needs room to allocate more memory as needed.

On Jun 17, 2016, at 08:16, Sidi Chang <notifications@github.com
javascript:_e(%7B%7D,'cvml','notifications@github.com');> wrote:

Hi,
After run free -m the output is

total used free shared buffers cached
Mem: 7983 7096 887 0 185 1272
-/+ buffers/cache: 5638 2345
Swap: 0 0 0

After running the second command, the output is
ubuntu 2771 1 0 Jun08 ? 00:11:42 /usr/bin/java -Dzookeeper.log.dir=.
-Dzookeeper.root.logger=INFO,CONSOLE -cp

/usr/local/zookeeper/bin/../build/classes:/usr/local/zookeeper/bin/../build/lib/.jar:/usr/local/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/usr/local/zookeeper/bin/../lib/slf4j-api-1.6.1.jar:/usr/local/zookeeper/bin/../lib/netty-3.7.0.Final.jar:/usr/local/zookeeper/bin/../lib/log4j-1.2.16.jar:/usr/local/zookeeper/bin/../lib/jline-0.9.94.jar:/usr/local/zookeeper/bin/../zookeeper-3.4.6.jar:/usr/local/zookeeper/bin/../src/java/lib/.jar:/usr/local/zookeeper/bin/../conf:
-Dcom.sun.management.jmxremote
-Dcom.sun.management.jmxremote.local.only=false
org.apache.zookeeper.server.quorum.QuorumPeerMain
/usr/local/zookeeper/bin/../conf/zoo.cfg

root 3897 3896 0 Jun08 ? 01:51:14 java -Xmx1G -Xms1G -server
-XX:+UseG1GC -XX:MaxGCPauseMillis=20
-XX:InitiatingHeapOccupancyPercent=35
-XX:+DisableExplicitGC -Djava.awt.headless=true
-Xloggc:/usr/local/kafka/bin/../logs/kafkaServer-gc.log -verbose:gc
-XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps
-Dcom.sun.management.jmxremote
-Dcom.sun.management.jmxremote.authenticate=false
-Dcom.sun.management.jmxremote.ssl=false
-Dcom.sun.management.jmxremote.port=9999
-Dkafka.logs.dir=/usr/local/kafka/bin/../logs

-Dlog4j.configuration=file:/usr/local/kafka/bin/../config/log4j.properties
-cp :/usr/local/kafka/bin/../libs/* kafka.Kafka
/usr/local/kafka/config/server.properties

ubuntu 4426 1 0 Jun08 ? 01:05:43 /usr/bin/java
-Duser.dir=/usr/local/kafka-manager -Dhttp.port=9001 -cp

/usr/local/kafka-manager/lib/../conf/:/usr/local/kafka-manager/lib/kafka-manager.kafka-manager-1.3.0.8-sans-externalized.jar:/usr/local/kafka-manager/lib/org.scala-lang.scala-library-2.11.7.jar:/usr/local/kafka-manager/lib/com.typesafe.play.twirl-api_2.11-1.1.1.jar:/usr/local/kafka-manager/lib/org.apache.commons.commons-lang3-3.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-server_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.build-link-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-exceptions-2.4.4.jar:/usr/local/kafka-manager/lib/org.javassist.javassist-3.19.0-GA.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-iteratees_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/org.scala-stm.scala-stm_2.11-0.7.jar:/usr/local/kafka-manager/lib/com.typesafe.config-1.3.0.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-json_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-functional_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-datacommons_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/joda-time.joda-time-2.8.1.jar:/usr/local/kafka-manager/lib/org.joda.joda-convert-1.7.jar:/usr/local/kafka-manager/lib/org.scala-lang.scala-reflect-2.11.6.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.core.jackson-core-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.core.jackson-annotations-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.core.jackson-databind-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.datatype.jackson-datatype-jdk8-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.datatype.jackson-datatype-jsr310-2.5.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-netty-utils-2.4.4.jar:/usr/local/kafka-manager/lib/org.slf4j.slf4j-api-1.7.12.jar:/usr/local/kafka-manager/lib/org.slf4j.jul-to-slf4j-1.7.12.jar:/usr/local/kafka-manager/lib/org.slf4j.jcl-over-slf4j-1.7.12.jar:/usr/local/kafka-manager/lib/ch.qos.logback.logback-core-1.1.3.jar:/usr/local/kafka-manager/lib/ch.qos.logback.logback-classic-1.1.3.jar:/usr/local/kafka-manager/lib/com.typesafe.akka.akka-actor_2.11-2.3.14.jar:/usr/local/kafka-manager/lib/com.typesafe.akka.akka-slf4j_2.11-2.3.14.jar:/usr/local/kafka-manager/lib/commons-codec.commons-codec-1.10.jar:/usr/local/kafka-manager/lib/xerces.xercesImpl-2.11.0.jar:/usr/local/kafka-manager/lib/xml-apis.xml-apis-1.4.01.jar:/usr/local/kafka-manager/lib/javax.transaction.jta-1.1.jar:/usr/local/kafka-manager/lib/com.google.inject.guice-4.0.jar:/usr/local/kafka-manager/lib/javax.inject.javax.inject-1.jar:/usr/local/kafka-manager/lib/aopalliance.aopalliance-1.0.jar:/usr/local/kafka-manager/lib/com.google.guava.guava-16.0.1.jar:/usr/local/kafka-manager/lib/com.google.inject.extensions.guice-assistedinject-4.0.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-netty-server_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/io.netty.netty-3.10.4.Final.jar:/usr/local/kafka-manager/lib/com.typesafe.netty.netty-http-pipelining-1.1.4.jar:/usr/local/kafka-manager/lib/com.google.code.findbugs.jsr305-2.0.1.jar:/usr/local/kafka-manager/lib/org.webjars.webjars-play_2.11-2.4.0-2.jar:/usr/local/kafka-manager/lib/org.webjars.requirejs-2.1.20.jar:/usr/local/kafka-manager/lib/org.webjars.webjars-locator-0.28.jar:/usr/local/kafka-manager/lib/org.webjars.webjars-locator-core-0.27.jar:/usr/local/kafka-manager/lib/org.apache.commons.commons-compress-1.9.jar:/usr/local/kafka-manager/lib/org.webjars.npm.validate.js-0.8.0.jar:/usr/local/kafka-manager/lib/org.webjars.bootstrap-3.3.5.jar:/usr/local/kafka-manager/lib/org.webjars.jquery-2.1.4.jar:/usr/local/kafka-manager/lib/org.webjars.backbonejs-1.2.3.jar:/usr/local/kafka-manager/lib/org.webjars.underscorejs-1.8.3.jar:/usr/local/kafka-manager/lib/org.webjars.dustjs-linkedin-2.6.1-1.jar:/usr/local/kafka-manager/lib/org.webjars.json-20121008-1.jar:/usr/local/kafka-manager/lib/org.apache.curator.curator-framework-2.9.1.jar:/usr/local/kaf

ubuntu 5099 1 0 Jun15 ? 00:10:24 java
-Xloggc:/usr/local/cassandra/bin/../logs/gc.log -ea
-XX:+UseThreadPriorities -XX:ThreadPriorityPolicy=42
-XX:+HeapDumpOnOutOfMemoryError -Xss256k -XX:StringTableSize=1000003
-XX:+AlwaysPreTouch -XX:-UseBiasedLocking -XX:+UseTLAB -XX:+ResizeTLAB
-XX:+PerfDisableSharedMem -Djava.net.preferIPv4Stack=true
-XX:+UseParNewGC
-XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio=8
-XX:MaxTenuringThreshold=1 -XX:CMSInitiatingOccupancyFraction=75
-XX:+UseCMSInitiatingOccupancyOnly -XX:CMSWaitDuration=10000
-XX:+CMSParallelInitialMarkEnabled -XX:+CMSEdenChunksRecordAlways
-XX:+CMSClassUnloadingEnabled -XX:+PrintGCDetails -XX:+PrintGCDateStamps
-XX:+PrintHeapAtGC -XX:+PrintTenuringDistribution
-XX:+PrintGCApplicationStoppedTime -XX:+PrintPromotionFailure
-XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=10M
-Xms1995M -Xmx1995M -Xmn200M -XX:+UseCondCardMark
-XX:CompileCommandFile=/usr/local/cassandra/bin/../conf/hotspot_compiler
-javaagent:/usr/local/cassandra/bin/../lib/jamm-0.3.0.jar
-Dcassandra.jmx.local.port=7199
-Dcom.sun.management.jmxremote.authenticate=false

-Dcom.sun.management.jmxremote.password.file=/etc/cassandra/jmxremote.password
-Djava.library.path=/usr/local/cassandra/bin/../lib/sigar-bin
-Dlogback.configurationFile=logback.xml
-Dcassandra.logdir=/usr/local/cassandra/bin/../logs
-Dcassandra.storagedir=/usr/local/cassandra/bin/../data -cp

/usr/local/cassandra/bin/../conf:/usr/local/cassandra/bin/../build/classes/main:/usr/local/cassandra/bin/../build/classes/thrift:/usr/local/cassandra/bin/../lib/ST4-4.0.8.jar:/usr/local/cassandra/bin/../lib/airline-0.6.jar:/usr/local/cassandra/bin/../lib/antlr-runtime-3.5.2.jar:/usr/local/cassandra/bin/../lib/apache-cassandra-3.6.jar:/usr/local/cassandra/bin/../lib/apache-cassandra-clientutil-3.6.jar:/usr/local/cassandra/bin/../lib/apache-cassandra-thrift-3.6.jar:/usr/local/cassandra/bin/../lib/asm-5.0.4.jar:/usr/local/cassandra/bin/../lib/caffeine-2.2.6.jar:/usr/local/cassandra/bin/../lib/cassandra-driver-core-3.0.0-shaded.jar:/usr/local/cassandra/bin/../lib/commons-cli-1.1.jar:/usr/local/cassandra/bin/../lib/commons-codec-1.2.jar:/usr/local/cassandra/bin/../lib/commons-lang3-3.1.jar:/usr/local/cassandra/bin/../lib/commons-math3-3.2.jar:/usr/local/cassandra/bin/../lib/compress-lzf-0.8.4.jar:/usr/local/cassandra/bin/../lib/concurrent-trees-2.4.0.jar:/usr/local/cassandra/bin/../lib/concurrentlinkedhashmap-lru-1.4.jar:/usr/local/cassandra/bin/../lib/disruptor-3.0.1.jar:/usr/local/cassandra/bin/../lib/ecj-4.4.2.jar:/usr/local/cassandra/bin/../lib/guava-18.0.jar:/usr/local/cassandra/bin/../lib/high-scale-lib-1.0.6.jar:/usr/local/cassandra/bin/../lib/hppc-0.5.4.jar:/usr/local/cassandra/bin/../lib/jackson-core-asl-1.9.2.jar:/usr/local/cassandra/bin/../lib/jackson-mapper-asl-1.9.2.jar:/usr/local/cassandra/bin/../lib/jamm-0.3.0.jar:/usr/local/cassandra/bin/../lib/javax.inject.jar:/usr/local/cassandra/bin/../lib/jbcrypt-0.3m.jar:/usr/local/cassandra/bin/../lib/jcl-over-slf4j-1.7.7.jar:/usr/local/cassandra/bin/../lib/jflex-1.6.0.jar:/usr/local/cassandra/bin/../lib/jna-4.0.0.jar:/usr/local/cassandra/bin/../lib/joda-time-2.4.jar:/usr/local/cassandra/bin/../lib/json-simple-1.1.jar:/usr/local/cassandra/bin/../lib/libthrift-0.9.2.jar:/usr/local/cassandra/bin/../lib/log4j-over-slf4j-1.7.7.jar:/usr/local/cassandra/bin/../lib/logback-classic-1.1.3.jar:/usr/local/cassandra/bin/../lib/logback-core-1.1.3.jar:/usr/local/cassandra/bin/../lib/lz4-1.3.0.jar:/usr/local/cassandra/bin/../lib/metrics-core-3.1.0.jar:/usr/local/cassandra/bin/../lib/metrics-logback-3.1.0.jar:/usr/local/cassandra/bin/../lib/netty-all-4.0.36.Final.jar:/usr/local/cassandra/bin/../lib/ohc-core-0.4.3.jar:/usr/local/cassandra/bin/../lib/ohc-core-j8-0.4.3.jar:/usr/local/cassandra/bin/../lib/primitive-1.0.jar:/usr/local/cassandra/bin/../lib/reporter-config-base-3.0.0.jar:/usr/local/cassandra/bin/../lib/reporter-config3-3.0.0.jar:/usr/local/cassandra/bin/../lib/sigar-1.6.4.jar:/usr/local/cassandra/bin/../lib/slf4j-api-1.7.7.jar:/usr/local/cassandra/bin/../lib/snakeyaml-1.11.jar:/usr/local/cassandra/

ubuntu 5331 4658 0 15:12 pts/6 00:00:00 grep --color=auto java
ubuntu 15241 15206 0 Jun13 pts/2 00:04:38 /usr/bin/java -server
-Ddaemon.name=nimbus -Dstorm.options= -Dstorm.home=/usr/local/storm
-Dstorm.log.dir=/usr/local/storm/logs
-Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
-Dstorm.conf.file= -cp

/usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm/conf
-Xmx1024m -Dlogfile.name=nimbus.log

-DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector
-Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml
org.apache.storm.daemon.nimbus

ubuntu 15242 15211 0 Jun13 pts/4 00:02:26 /usr/bin/java -server
-Ddaemon.name=ui -Dstorm.options= -Dstorm.home=/usr/local/storm
-Dstorm.log.dir=/usr/local/storm/logs
-Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
-Dstorm.conf.file= -cp

/usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm:/usr/local/storm/conf
-Xmx768m -Dlogfile.name=ui.log

-DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector
-Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml
org.apache.storm.ui.core

root 15553 15552 0 Jun13 ? 00:02:27 java -server -Ddaemon.name=ui
-Dstorm.options= -Dstorm.home=/usr/local/storm
-Dstorm.log.dir=/usr/local/storm/logs
-Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
-Dstorm.conf.file= -cp

/usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm:/usr/local/storm/conf
-Xmx768m -Dlogfile.name=ui.log

-DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector
-Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml
org.apache.storm.ui.core

root 19520 19519 0 Jun13 ? 00:03:03 java -server -Ddaemon.name=ui
-Dstorm.options= -Dstorm.home=/usr/local/storm
-Dstorm.log.dir=/usr/local/storm/logs
-Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
-Dstorm.conf.file= -cp

/usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm:/usr/local/storm/conf
-Xmx768m -Dlogfile.name=ui.log

-DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector
-Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml
org.apache.storm.ui.core

ubuntu 28440 1 0 Jun08 ? 00:07:35 /usr/bin/java -Xmx512M -server
-XX:+UseG1GC -XX:MaxGCPauseMillis=20
-XX:InitiatingHeapOccupancyPercent=35
-XX:+DisableExplicitGC -Djava.awt.headless=true
-Dcom.sun.management.jmxremote
-Dcom.sun.management.jmxremote.authenticate=false
-Dcom.sun.management.jmxremote.ssl=false
-Dkafka.logs.dir=/usr/local/kafka/bin/../logs

-Dlog4j.configuration=file:/usr/local/kafka/bin/../config/tools-log4j.properties
-cp :/usr/local/kafka/bin/../libs/* kafka.tools.ConsoleConsumer
--zookeeper
localhost:2181 --from-beginning --topic yyyyyy

ubuntu 28945 1 0 Jun13 ? 00:04:24 /usr/bin/java -cp

/usr/local/spark/conf/:/usr/local/spark/lib/spark-assembly-1.6.1-hadoop2.6.0.jar:/usr/local/spark/lib/datanucleus-rdbms-3.2.9.jar:/usr/local/spark/lib/datanucleus-api-jdo-3.2.6.jar:/usr/local/spark/lib/datanucleus-core-3.2.10.jar
-Xms1g -Xmx1g org.apache.spark.deploy.master.Master --ip ip-172-31-1-5
--port 7077 --webui-port 8080

—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub <
https://github.com/Interana/eventsim/issues/4#issuecomment-226797393>,
or
mute the thread <

https://github.com/notifications/unsubscribe/AIjLrn65NXM3qECbYVznLEJnK71LRYObks5qMro-gaJpZM4I3-M2

.

—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
#4 (comment),
or mute the thread
<
https://github.com/notifications/unsubscribe/AEExOsKQyMjkCuvI5xmIZMnOXW_WBZevks5qMsFLgaJpZM4I3-M2

.

Sidi CHANG
Master in Computer Science (Computational Operations Research Track)
College of William and Mary
Williamsburg, VA, United States

—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
#4 (comment),
or mute the thread
https://github.com/notifications/unsubscribe/AIjLrqAqJ-Ho61W_yNuYXAQ4F1O4qWqyks5qM1V9gaJpZM4I3-M2
.