Importing an External S3 Object Store

Prerequisites

If Data Fabric accesses the internet via a proxy server, do the following.

Specify the proxy settings in /opt/mapr/initscripts/mapr-s3server.

export HTTPS_PROXY="http://<proxy server FQDN or proxy server IP>:8080"
export http_proxy="http://<proxy server FQDN or proxy server IP>:8080"
export HTTP_PROXY="http://<proxy server FQDN or proxy server IP>:8080"
export https_proxy="http://<proxy server FQDN or proxy server IP>:8080"

Run the following command to restart the related Data Fabric component.
```
maprcli node services -name s3server -action restart -nodes hostname -f -json
```

Data Fabric is now able to access the internet via the proxy, and able to connect to an external S3 object store.

About this task

You can import an external S3 object store into Data Fabric to be able to transfer data from Data Fabric to the external S3 object store to make it shareable across the fabrics in the global namespace.

You can import AWS S3, WEKA, Scality, VAST and other S3-compliant object stores into a global namespace to be able to consolidate your data across external S3 object stores on Data Fabric.

Follow the steps given below to import an external S3 object store into Data Fabric.

Procedure

Log on to the Data Fabric UI .
Select Fabric Manager on the home page.
Click Global namespace.
Click Import External S3.
Enter the name for the S3 object store in S3 name.
Select AWS as S3 vendor to import an Amazon S3 object store. Alternatively, select Generic to import a S3 object store such as Scality/WEKA/VAST.
If you have selected the AWS option as the S3 vendor,
1. Enter the name of AWS S3 region .
2. Enter the Access key to access the external S3 object store.
3. Enter the Secret key to access the external S3 object store.
If you have selected Generic option as the S3 vendors.
1. Enter the Access key to access the external S3 object store.
2. Enter the Secret key to access the external S3 object store.
3. Enter the IP addresses or hostnames for the external S3 object store as a comma-separated string in IP address or hostname.
4. Enter the S3 server port. The default value is 9000.
5. Select the Use TLS Encryption check box, if you wish to communicate over a secure connection. By default, TLS encryption is enabled.
6. Drag and drop the S3 server certificate for secure communication, if the generic S3 object store is not CA certified.
Click Import.

Results

The S3 object store is imported into Data Fabric and is visible as part of the global namespace. The S3 object store is visible under the list of resources in the global namespace.

Related maprcli Commands

To implement the features described on this page, the Data Fabric UI relies on the following maprcli command. The command is provided for general reference. For more information, see maprcli Commands in This Guide.

clustergroup addexternal