Connecting to a Hadoop cluster on Google Dataproc with Jupyter Notebook

This video takes you through how to create a simple Hadoop cluster on Google Dataproc, along with all the settings needed to be able to (a) connect to the cluster using a Jupyter Notebook, (b) save the Jupyter Notebook on a Google Storage bucket, and (c) connect to the cluster Master computer through a terminal. This is part-1 of a two-part series. (In part 2, I will walk you through how to import a CSV file into your Hadoop cluster and analyze it using PySpark on Jupyter Notebook.)

[@Codible]

IMPORTANT! Don't forget to turn off your cluster after you are done, to avoid charges by Google Cloud.

[@merve4738]

Hi, I am try to create cluster include 4 worker node. When I go with the settings you made, I am getting error. Cluster don't create. How Can I create to include 4 worker nodes cluster? Is there anyone who can help ?

[@praveenyadam2617]

Wonderful