akka - ActorNotFound Exception trying to run Spark 1.3.1 on windows 7 -

-

we @ road block trying understand why spark 1.3.1 doesn't work colleague of mine on windows 7 laptop. have pretty same setup , works fine me.

i searched error message still didn't find resolution.

here exception message (after running spark 1.3.1 vanilla installation prebuilt hadoop 2.4)

akka.actor.actorinitializationexception: exception during creation         @ akka.actor.actorinitializationexception$.apply(actor.scala:164)         @ akka.actor.actorcell.create(actorcell.scala:596)         @ akka.actor.actorcell.invokeall$1(actorcell.scala:456)         @ akka.actor.actorcell.systeminvoke(actorcell.scala:478)         @ akka.dispatch.mailbox.processallsystemmessages(mailbox.scala:263)         @ akka.dispatch.mailbox.run(mailbox.scala:219)         @ akka.dispatch.forkjoinexecutorconfigurator$akkaforkjointask.exec(abstractdispatcher.scala:393)         @ scala.concurrent.forkjoin.forkjointask.doexec(forkjointask.java:260)         @ scala.concurrent.forkjoin.forkjoinpool$workqueue.runtask(forkjoinpool.java:1339)         @ scala.concurrent.forkjoin.forkjoinpool.runworker(forkjoinpool.java:1979)         @ scala.concurrent.forkjoin.forkjoinworkerthread.run(forkjoinworkerthread.java:107) caused by: akka.actor.actornotfound: actor not found for: actorselection[anchor(akka://sparkdriver/deadletters), path(/) ]         @ akka.actor.actorselection$$anonfun$resolveone$1.apply(actorselection.scala:65)         @ akka.actor.actorselection$$anonfun$resolveone$1.apply(actorselection.scala:63)         @ scala.concurrent.impl.callbackrunnable.run(promise.scala:32)         @ akka.dispatch.batchingexecutor$batch$$anonfun$run$1.processbatch$1(batchingexecutor.scala:67)         @ akka.dispatch.batchingexecutor$batch$$anonfun$run$1.apply$mcv$sp(batchingexecutor.scala:82)         @ akka.dispatch.batchingexecutor$batch$$anonfun$run$1.apply(batchingexecutor.scala:59)         @ akka.dispatch.batchingexecutor$batch$$anonfun$run$1.apply(batchingexecutor.scala:59)         @ scala.concurrent.blockcontext$.withblockcontext(blockcontext.scala:72)         @ akka.dispatch.batchingexecutor$batch.run(batchingexecutor.scala:58)         @ akka.dispatch.executioncontexts$samethreadexecutioncontext$.unbatchedexecute(future.scala:74)         @ akka.dispatch.batchingexecutor$class.execute(batchingexecutor.scala:110)         @ akka.dispatch.executioncontexts$samethreadexecutioncontext$.execute(future.scala:73)         @ scala.concurrent.impl.callbackrunnable.executewithvalue(promise.scala:40)         @ scala.concurrent.impl.promise$defaultpromise.scala$concurrent$impl$promise$defaultpromise$$dispatchoraddcallb ack(promise.scala:280)         @ scala.concurrent.impl.promise$defaultpromise.oncomplete(promise.scala:270)         @ akka.actor.actorselection.resolveone(actorselection.scala:63)         @ akka.actor.actorselection.resolveone(actorselection.scala:80)         @ org.apache.spark.util.akkautils$.makedriverref(akkautils.scala:221)         @ org.apache.spark.executor.executor.startdriverheartbeater(executor.scala:393)         @ org.apache.spark.executor.executor.<init>(executor.scala:119)         @ org.apache.spark.scheduler.local.localactor.<init>(localbackend.scala:58)         @ org.apache.spark.scheduler.local.localbackend$$anonfun$start$1.apply(localbackend.scala:107)         @ org.apache.spark.scheduler.local.localbackend$$anonfun$start$1.apply(localbackend.scala:107)         @ akka.actor.typedcreatorfunctionconsumer.produce(props.scala:343)         @ akka.actor.props.newactor(props.scala:252)         @ akka.actor.actorcell.newactor(actorcell.scala:552)         @ akka.actor.actorcell.create(actorcell.scala:578)         ... 9 more

related issues:

searching issue online didn't yield lot of results, seems point rare , specific problem:

my assumption related resolving / ip conflicts etc, i'm not sure.

more details

  • jdk 1.7 64 bit, windows 7 64 bit, spark 1.3.1 prebuilt hadoop 2.4
  • we ruled out firewall related issues, looked @ blocked traffic , not there
  • we tried "run administrator" no luck.
  • we tried both spark submit , spark shell, straightforward spark "hellow world" didn't work.
  • we did ui @ localhost:4040, job marked started, waiting forever (e.g. sc.parallelize(list(1,2,3)).count() never finishes
  • no other errors found in logs
  • one difference did notice between system , friend's: when ping localhost, 127.0.0.1, when gets ::1 not sure if it's related, saw issue spark having problems ipv6, , saw resolved in 1.4, related? https://issues.apache.org/jira/browse/spark-6440

i'm sure it's network / security / permissions related issue, can't seem able pinpoint it

any ideas next?

upgrading spark 1.4.0 seems have resolved issue.

it related https://issues.apache.org/jira/browse/spark-6440 can't tell sure.


Comments

Post a Comment

Popular posts from this blog

javascript - gulp-nodemon - nodejs restart after file change - Error: listen EADDRINUSE events.js:85 -

-
i'm running nodejs 0.12.3 - gulp 3.10.8 , gulp-nodemon 2.0.3. gulpfile.js : gulp.task('serve', ['build'], function() { gulp.start('fb-flo'); nodemon({ script: paths.server, env: { 'node_env': 'development' }, // env: { 'node_env': 'production' }, execmap: { 'js': 'node_modules/babel/bin/babel-node --stage 1' //es7 cote server }, delay: '0ms', watch: ['src/shared/', 'src/server/'], ignore: ['src/shared/components'], tasks: function (changedfiles) { var tasks = []; changedfiles.foreach(function (file) { if (path.extname(file) === '.jsx' && !~tasks.indexof('bundlejs')) tasks.push('bundlejs'); if (path.extname(file) === '.less' && !~tasks.indexof('compileless')) tasks.push('compileless'); }); return tasks; } ...
Read more

Fatal Python error: Py_Initialize: unable to load the file system codec. ImportError: No module named 'encodings' -

-
i trying make simple python program opening list of webpages user manually download reports site. don't have previous experience preparing exe files.. , i'm in learning process python coding. of done on windows 7 x64 this python code: #!c:/python34/python.exe -u splinter import * import time import os import csv #---------------------------------- raporty = [] open('../raporty.csv', newline='') csvfile: contents = csv.reader(csvfile, delimiter=' ', quotechar='|') row in contents: r = ', '.join(row) r = r.replace(',','') raporty.append(r) #--not implemented yet zmienne = [] open('../zmienne.csv', newline='') csvfile: contents = csv.reader(csvfile, delimiter=' ', quotechar='|') row in contents: r = ', '.join(row) r = r.replace(',','') zmienne.append(r) print("start") browser = browser(...
Read more

javascript - oscilloscope of speaker input stops rendering after a few seconds -

-
the following script reads audio user's microphone , renders oscilloscope on html canvas. the source taken example of mozilla developer network: visualizations web audio api and here fiddle: http://jsfiddle.net/b7j8pktp/ mozgetusermedia (note: code has no fork mechanism different browsers: works firefox) it works fine few seconds , stops rendering. whereas works totally stable: http://mdn.github.io/voice-change-o-matic/ the problem can reduced following code. microphone activation icon (next the address bar in firefox) disappears after 5 seconds: navigator.mozgetusermedia({audio: true}, function() {}, function() {} ); ( http://jsfiddle.net/b7j8pktp/2/ ) this known bug in firefox. take stream getusermedia call , hook window so: navigator.mozgetusermedia({audio: true}, function(stream) { window.stream = stream; // rest of code }, function err() { // handle error }); hopefully can fixed soon. problem we're f...
Read more