Until I used a method: alesce(1).write.mode(SaveMode.Overwrite).csv(outputPath)
Can i install spark on windows install#
error: : .nativioĪfter all, our spark installation package is called spark-2.4.8-bin-hadoop2.7You have to install one anyway 2.7Of hadoop 。. Referring to two articles, there is no direct help, but I realized that the Hadoop version may be wrong: Good guy, the previous mistake is not reported, now it’s a new mistake. Go scalaIt’s downloaded from the official website scala 2.11.12Version. Method 2Go to the spark installation path to see what version Scala relies on. Method 1Open our command line（ cmdperhaps powershellAll right), input spark-shell, see our local installation sparkWhat version was used scala. I recommend two methods, both of which I have explored by myself The above article suggests that /artifact//spark-coreThe above version is compatible. Refarrayops appears when running spark”It made me realize that maybe scalaYou can try this version. I just started using it myself scalaI thought there was something wrong with the program I wrote. X with spark 2.4.8, but hehe, the error is as follows. Level 1: the small version of scala is not compatibleĪlthough we can see on spark website: Just configure Scala 2.12. Basic javaEnvironment: 1.8.0_ two hundred and one. 
It’s been a long time debugI concluded that all the errors that idea didn’t clearly indicate which line had problems in my script were due to incompatible versions. Recently, I have a job: give me an alicloud desktop（ windows 10Let me use it scala + sparkWrite something. Some pitfalls encountered in installing spark on Windows
0 kommentar(er)
