How to use an HTTP/HTTPS POST connector to receive data from Data Stream

While configuring streams, you need to set up a specific endpoint to stream your Azion data.

You can use the Standard HTTP/HTTPS POST option to configure a stream with a third-party platform that isn’t available as a Data Stream connector that can receive data via HTTP or HTTPS POST requests.

Configuring the endpoint in Data Stream

You can find detailed steps for the entire configuration on the How to configure Data Stream main settings guide.

Follow the next steps to configure your Azion Data Stream endpoint.

In the Destination configurations:

On the Connector dropdown menu, select Standard HTTP/HTTPS POST.
On URL, add the URL of the platform that’ll receive the data. Example: http://myhost.com
On Custom Headers (optional), you can provide additional data the third-party platform accepts or requires, such as an access key.
- You can pass up to 5 headers.
Click the Save button.

In the Destination configurations:

On the Endpoint Type dropdown menu, select Standard HTTP/HTTPS POST.
On Endpoint URL, add the URL of the platform that’ll receive the data. Example: http://myhost.com
On Custom Headers (optional), you can provide additional data the third-party platform accepts or requires, such as an access key.
- You can pass up to 5 headers.
Click the Save button.

Run the following GET request in your terminal, replacing [TOKEN VALUE] with your personal token to retrieve your <data_streaming_id>:

curl --location 'https://api.azionapi.net/data_streaming/streamings' \
--header 'Accept: application/json; version=3' \
--header 'Authorization: Token [TOKEN VALUE]' \
--header 'Content-Type: application/json' \
--data '{
    "name": "HTTPS connector",
    "template_id": 2,
    "domain_ids": [1656613172],
    "endpoint": {
        "endpoint_type": "standard",
        "url": "http://myhost.com",
        "payload_format": "$dataset",
        "log_line_separator": "\n",
        "max_size": 1000024,
        "headers":{
            "access-key": "Ph7EK3b7UD2hba6"
        }
    }
}'

Key	Description
`name`	Name of the stream
`template_id`	Identifier for the template being used
`domain_ids`	Array value of the domain’s identifiers (integers) you want to associate with the stream
`endpoint`	Endpoint to which you want to stream your data

You’ll receive a response similar to this:

{
  "results": {
    "id": 1595,
    "name": "HTTPS connector",
    "template_id": 2,
    "data_source": "http",
    "active": true,
    "endpoint": {
      "endpoint_type": "standard",
      "url": "http://myhost.com",
      "log_line_separator": "\n",
      "payload_format": "$dataset",
      "max_size": 1000024,
      "headers": {
        "access-key": "Ph7EK3b7UD2hba6",
      }
    },
    "all_domains": false
  },
  "schema_version": 3
}

Wait a few minutes for the changes to propagate and your stream will be updated.

After saving the configurations, your data will be streamed to the newly configured endpoint.

You can keep track of the calls made by Data Stream to Datadog on Real-Time Events. To do so, select Data Source > Data Stream and choose the filters options as you wish.