Monitoring Spark Applications
- A list of scheduler stages and tasks
- A summary of RDD sizes and memory usage
- Environmental information
- Information about the running executors
- YARN - Go to the YARN applications page in the Cloudera Manager Admin Console.
- Spark Standalone - Go to the Spark Master UI, by default at http://spark_master:18080.
For information on completed applications, go to the Managing the Spark History Server, by default at http://spark_history_server:18088.
For further information on Spark monitoring, see Monitoring and Instrumentation.