- It's possible that other websites you visit could use Polynote as an attack vector. Browsing the web
   while running Polynote is unsafe.
 - It's possible that remote attackers could use Polynote as an attack vector. Running Polynote on a
   computer that's accessible from the internet is unsafe.
 - Even running Polynote inside a container doesn't guarantee safety, as there will always be
   privilege escalation and container escape vulnerabilities which an attacker could leverage.
 
 Please be diligent about checking for new releases, as they could contain fixes for critical security
 flaws.
 
 Please be mindful of the security issues that Polynote causes; consult your company's security team
 before running Polynote. You are solely responsible for any breach, loss, or damage caused by running
 this software insecurely.

Right now, we're in need of Firefox users who can provide us with bug reports (and, ideally, bug _fixes_ too!), so 
please do let us know if you run into issues using Firefox!

Please see these issues for more information: [#555](https://github.com/polynote/polynote/issues/555), [#671](https://github.com/polynote/polynote/issues/671). 

For more information about using Docker to run Polynote, see the [Polynote Docker docs](docker.md).

Currently, Polynote supports both **Spark 2.1** (with Scala 2.11) and **2.4** (with Scala 2.11 and 2.12).

_Some users have had success running Spark 3.0 with Scala 2.12. Please see [this issue](https://github.com/polynote/polynote/issues/926) for more information_

These instructions are provided as a convenience, but please note that versions and environments differ. Please
refer to the official documentation or other online resources if you run into trouble setting up Spark.

As mentioned above, Polynote just needs `spark-submit` to be working correctly and available on the `PATH` in the 
environment in which it is running. It doesn't matter how you install Spark as long as those two things are true. 

=== "Standard Spark installation"
    The "standard" way to install Spark is just to extract the distribution somewhere and then set up some environment variables.
    This method works for on both Mac and Linux. 

    You may need to modify these instructions based on your local setup. 

    === "Spark on Mac"
        Here is an example setup for Polynote on Mac. Also, check out the "Installation with Homebrew" tab above for an 
        alternative installation method. 

        Install Java (this installs Java 11)

            brew cask install adoptopenjdk11

        [Download spark](https://spark.apache.org/downloads.html) and then untar it wherever you like 

            tar -zxvf spark-2.4.7-bin-hadoop2.7.tgz

        Set up the `SPARK_HOME` and `PATH` environment variables. You probably want to put these instructions in your 
        shell configuration somewhere, i.e., `~/.bashrc` or equivalent. 

        Set `SPARK_HOME` 

            export SPARK_HOME=`pwd`/spark-2.4.7-bin-hadoop2.7/

        Set `PATH`

            export PATH="$PATH:$SPARK_HOME/bin:$SPARK_HOME/sbin"

        Check if Spark is correctly set up by running `spark-submit`, you should see usage information. 

    === "Spark on Linux"
        Here is an example setup for Polynote on Debian. If you are not using Debian or Ubuntu, you may need to 
        modify these instructions for your distribution.

        As always, start with updating your package listing. 

            apt-get update 

        Install Java (this installs Java 11 for me on Debian buster)

            apt-get install default-jdk

        [Download spark](https://spark.apache.org/downloads.html) and then untar it wherever you like 

            tar -zxvf spark-2.4.4-bin-hadoop2.7.tgz

        Set up the `JAVA_HOME`, `SPARK_HOME` and `PATH` environment variables. You probably want to put these instructions 
        in your shell configuration somewhere, i.e., `~/.bashrc` or equivalent. 

        Set `JAVA_HOME` 

            export JAVA_HOME=/usr/lib/jvm/default-java/

        Set `SPARK_HOME` 

            export SPARK_HOME=`pwd`/spark-2.4.7-bin-hadoop2.7/

        Set `PATH`

            export PATH="$PATH:$SPARK_HOME/bin:$SPARK_HOME/sbin"

        Check if Spark is correctly set up by running `spark-submit`, you should see usage information. 

=== "Installing Spark on Mac with Homebrew"
    The [Homebrew](https://brew.sh) package manager for Mac has a [formula for Spark](https://formulae.brew.sh/formula/apache-spark), 
    but unfortunately it only installs the latest version which may not be compatible with Polynote.

    Installing an older version of Spark using Homebrew can be a bit of a pain. There is a third party repository that
    has older Spark versions available for easy download. 

    !!! warning
        It is _highly_ recommended that you read through the homebrew formula before installing it - especially when using
        a third-party repository. The [entire thing](https://github.com/eddies/homebrew-spark-tap/blob/master/Formula/apache-spark%402.4.6.rb) 
        is less than 30 lines of Ruby code and quite readable. 

        You can view the available formulae here: https://github.com/eddies/homebrew-spark-tap/tree/master/Formula

    Here's an example for Spark 2.4:

    ```shell
    brew tab eddies/spark-tap
    brew install apache-spark@2.4.6
    ```

_Users have reported getting it to work with Python 3.6 and Python 3.8 (without Spark) with minimal effort._

pip install -r ./requirements.txt

./polynote.py