Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Local Environment Spark + SparkCLR Installer? #683

Open
kvansaders opened this issue Feb 21, 2018 · 3 comments
Open

Local Environment Spark + SparkCLR Installer? #683

kvansaders opened this issue Feb 21, 2018 · 3 comments

Comments

@kvansaders
Copy link

I've been trying to get into Spark, using Mobius as a bridge since I am primarily a .NET developer, and my company uses Microsoft products through most of the stack. Unfortunately, the process to get an environment to even run a word count is very cumbersome and error prone, as it involves much more than just adding a nuget package. Can there be an MSI installer or Chocolatey package available? Even SQL Server is a much easier process to get started in a Dev environment.

@Aaronontheweb
Copy link

You can give this a try - wrote it for Spark 1.6.2: https://github.com/petabridge/spark-installer-windows

@kvansaders
Copy link
Author

Unfortunately, this package no longer works, even in the older version once published.
`
C:\WINDOWS\system32>choco install apache-spark -version 1.6.2
Parsing -version resulted in error (converted to warning):
Cannot bundle unregistered option '-e'.
Chocolatey v0.10.5
Installing the following packages:
apache-spark
By installing you accept licenses for the packages.
apache-spark not installed. The package was not found with the source(s) listed.
If you specified a particular version and are receiving this message, it is possible that the package name exists but the version does not.
Version: "1.6.2"
Source(s): "https://chocolatey.org/api/v2/"

Chocolatey installed 0/1 packages. 1 packages failed.
See the log for details (C:\ProgramData\chocolatey\logs\chocolatey.log).

Failures

  • apache-spark - apache-spark not installed. The package was not found with the source(s) listed.
    If you specified a particular version and are receiving this message, it is possible that the package name exists but the version does not.
    Version: "1.6.2"
    Source(s): "https://chocolatey.org/api/v2/"
    `

@Aaronontheweb
Copy link

Welp, that sucks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants