Apache Spark

Running Apache Spark Programs and Notebooks

There are several ways to launch Apache Spark

1. Locally, on your laptop or desktop
2. GSU ARCTIC Cluster: follow these instructions https://arcwiki.rs.gsu.edu/en/Spark
3. ARC Cluster: (currently under construction)

Spark on laptop or desktop

While Apache Spark is intended for distributed computing on clusters, it can also be installed and run on a single machine, such as your laptop or desktop. This is useful for development, testing, and learning purposes.

Guides:

• A Step-by-Step Guide to Installing Pyspark on Windows (Medium)
• Setting Up Apache Spark (macOS): A Comprehensive Guide (Medium)