Managing Spark Applications

Describes how to view and manage Spark applications using HPE Ezmeral Unified Analytics Software.

About this task

View and manage the status of all the Spark applications and scheduled Spark applications.

Procedure

  1. To view and manage Spark applications, you can choose one of the following options:
    • Click the Analytics icon and click Spark Applications on the left navigation bar of the HPE Ezmeral Unified Analytics Software screen.
    • Click the Tools & Frameworks icon on the left navigation bar. Navigate to the Spark tile under the Analytics tab and click Open.
  2. To view actions that you can perform on the Applications and Scheduled Applications tab, click the menu icon in the Actions column.


    View Details:
    To view the details of an application, and events and logs of the pods, select View Details.
    To access the Spark History Server and view and monitor the applications, click Spark Web UI in the top right of the Application Detail screen.
    View YAML:
    To view the YAML file and see the configuration details, select View YAML.
    Edit YAML:
    To open an editor to change the application configuration using a YAML in the GUI, click Edit YAML. To apply the changes, click Update Application. To cancel the changes, click Discard Changes.
    View Logs:
    To view the Spark driver pod logs, select View Logs.
    Edit:
    To change application configurations and resubmit the application, select Edit.
    You can update all the application parameters except name, and type using Edit. Use Clone to update the parameters and create an application.
    You can update the schedule of the scheduled Spark application by using Edit.
    To open an editor to change the application configuration using YAML, click Edit YAML in the Review step. To apply the changes, click Save Changes. To cancel the changes, click Discard Changes.
    To schedule the Spark application, select Schedule or select Clone.
    NOTE
    Using Edit to resubmit an application will remove pods and logs of the previous application run.
    Clone:
    To create a new Spark application with the similar configuration as an existing Spark application, select Clone. You can update any application parameters and submit it as a new application.
    NOTE

    If you enter the same name as the current Spark application and configure the scheduling details in the Schedule Application step, it will create a new scheduled Spark application.

    Submitting an application with same name and application type as an existing application will remove pods and logs of the previous application run.

    Schedule:
    To schedule the application, click Schedule. You can view this application in the Scheduled Applications tab. To learn more about the Schedule Application step, see Creating Spark Applications.
    Suspend:
    To stop the application from running at its scheduled time, select Suspend from the Actions menu in the Scheduled Applications tab.
    Resume:
    To restart the schedule of the suspended applications, select Resume from the Actions menu in Scheduled Applications tab.
    Delete:
    To delete the Spark application, select Delete.
  3. Delete multiple Spark applications at once:


    1. To select multiple applications, click the check box besides Application Name in the table.
    2. Click Delete in the top right pane of the table.
  4. To display the Spark applications according to the status, click the Filter icon.
  5. To select the columns to display on your applications table, click the Columns icon.