Documentation

    HTTP

    Read the response of an HTTPS GET or POST request into a Strata flow. Oplema can't write through this connector.

    Before you start

    • An HTTPS API that answers a GET or POST request with JSON, JSON Lines, CSV or Parquet.
    • If the API needs sign-in, a token it accepts in an Authorization: Bearer header. Other sign-in methods aren't supported.
    • Requests come from Oplema's servers, not your browser, so the API must be reachable from the internet. Oplema doesn't promise a fixed IP address; contact us if you need to allowlist.

    Connect

    1. In Strata, select an Input block.
    2. Set Source to Connectors.
    3. In the connector dropdown below it, choose HTTP.
    4. Open the Connection dropdown and choose Create new connection.
    5. Enter the API's base URL in the field that shows https://api.example.com. It must start with https:// and have no query.
    6. If the API needs a token, enter it in the field that shows Bearer token (optional). Leave it empty for a public API.
    7. Set Name (optional). Without a name, the connection is labeled with the host name.
    8. Select Save connection.

    The new connection is selected. Saving only checks the format of what you typed. It doesn't send a request, so a wrong URL or token first shows up as an error when the block reads.

    A saved connection can't be edited. To change a password, token or any other field, open the Connection dropdown, choose Delete (the ×) on its row, and create the connection again. Blocks that used the deleted connection must then select the new one.

    Read

    SettingWhat it does
    PathThe path and query to request, added after the connection's URL. Encode the query yourself, for example %20 for a space.
    MethodGET (the default) or POST.
    BodyA JSON request body, sent with either method. Leave it empty to send none.
    FormatThe format of the response: JSON, JSON Lines, CSV or Parquet.

    Each read sends one request, with the token if the connection has one, and loads the whole response. Redirects aren't followed. For CSV, the separator and header row are detected automatically.

    Limits and billing

    • Reads: the first 50 MB of each download is free. After that, each download costs $0.01 per GB from your usage. Failed reads aren't charged, and a read stops when your usage runs out.
    • A read fails if the response takes longer than three minutes.

    See Billing for who pays and how usage works.

    Troubleshooting

    MessageWhat to do
    HTTP: use an https:// URL without credentials, query or fragmentThis appears when you save. Enter only the base URL, starting with https://. Put the path and query in Path.
    HTTP: the server responded with <status>The API didn't answer with 200. A 401 or 403 means it rejected the token: delete the connection and create it again. A 404 means the path is wrong. A 301 or 302 is a redirect, which isn't followed: use the final URL.
    HTTP: <host> is a private address; use a host reachable from the internetUse an API with a public address. Local and private network addresses are refused.
    The operation was aborted due to timeoutThe response took longer than three minutes. Try again, or request less data.
    This transfer exceeds the free 50 MB and the available usage creditsThe read passed 50 MB and your usage ran out. Add usage, or read less data.

    Prepare your data. Build it in Strata.

    Strata opens in your browser, with no account.