Navigation

Deploy a Data Lake for an HTTP Data Store

This page describes how to deploy a Data Lake for accessing data in an HTTP data store.

Note
Beta

The support for HTTP data stores is available as a Beta feature. The feature and the corresponding documentation may change at any time during the Beta stage.

Before you begin, you will need to:

  • Create a MongoDB Atlas account, if you do not have one already.
  • Format your data store using one of the supported data formats.

    Note

    If your file format is CSV or TSV, you must include a header row in your data. See Comma-Separated and Tab-Separated Value Data Files for more information.

  • Make your data store accessible over the public internet.
Important
  • If your HTTP data store is not accessible over HTTPS , you must use the JSON Editor to configure your data store. In your JSON configuration, you must set the stores.[n].allowInsecure setting to true.
  • Atlas Data Lake does not support HTTP data store URL s that require authentication.
1
2
3
  • For your first Data Lake, click Create a Data Lake.
  • For your subsequent Data Lakes, click Configure a New Data Lake.
4
  • For a guided experience, click Visual Editor.
  • To edit the raw JSON , click JSON Editor.
5

If you are using the Visual Editor:

  1. Click Connect Data to choose your data store.
  2. Click HTTP(S) to configure a data lake for data in an HTTP data store.

    Corresponds to stores.[n].provider JSON configuration setting.

  3. Enter a name for your HTTP data store into the HTTP(S) Store Name field.

    Note

    The data store's name must be unique within your Data Lake.

    Corresponds to stores.[n].name JSON configuration setting.

  4. Enter the publicly accessible URL of the file where data is stored.

    Tip

    Click Use Sample URL to add a sample HTTP data store.

    For each additional HTTP data store that you want to add, click Add Another URL, then enter the HTTP data store URLs.

    Corresponds to stores.[n].urls JSON configuration setting.

  5. Click Next.
6
  1. (Optional) Click the for the:

    • Data Lake to specify a name for your Data Lake. Defaults to Data Lake[n].
    • Database to edit the database name. Defaults to Database[n].

      Corresponds to databases.[n].name JSON configuration setting.

    • Collection to edit the collection name. Defaults to Collection[n].

      Corresponds to databases.[n].collections.name JSON configuration setting.

    You can click:

    • Create Database to add databases and collections.
    • associated with the database to add collections to the database.
    • associated with the database or collection to remove the database or collection.
  2. Drag and drop the data store to map with the collection.

    Corresponds to databases.[n].collections.[n].dataSources JSON configuration setting.

7
Give Feedback