Using whylogs with Ray

Describes how to use whylogs with Ray.

Prerequisites

Sign in to HPE Ezmeral Unified Analytics Software as a member.

About this task

In HPE Ezmeral Unified Analytics Software, whylogs is integrated to work with Ray in a distributed environment. You can use whylogs with Ray for logging and analyzing the distributed data or monitoring the ML models in a distributed environment.

To use whylogs with Ray, refer to the Ray example in the GitHub. The basic steps are outlined as follows:
  1. Create a notebook or import the notebook into HPE Ezmeral Unified Analytics Software. See Creating and Managing Notebook Servers.
  2. Import the required libraries and modules from whylogs.
  3. Use Ray for distributed data processing tasks.
  4. Log the data with whylogs and store the results.
  5. Once you finish running your notebook, navigate back to the HPE Ezmeral Unified Analytics Software home screen.
  6. In the left navigation bar, go to Data Engineering > Data Sources.
  7. Click Browse.
  8. Go to the /shared/<ray-whylogs> folder which is a path set in your notebook to store the logs from whylogs. You can see that the data proļ¬les and the drift summary report are stored in the shared volume in the .html and .bin formats.
  9. To download a summary report, select Download from the Actions menu.

Results

You can analyze the summary report to detect drifts and monitor your data in a distributed environment.