0 / 0

Working with delivery methods

Last updated: May 30, 2025
Working with delivery methods

Data Product Hub provides several options for delivering data products to the consumer. Each item in a data product can be delivered by using different methods. The connector type determines the available delivery methods.

Types of delivery methods for Data Product Hub

You can configure your data product to be delivered by the following delivery methods, depending upon the connector type:

  • Downloading directly from a URL
  • Downloading a data extract from a target connected data source
  • Opening a URL
  • Accessing a data product with Flight service
  • Access in watsonx.data
  • Deliver as a table in watsonx.data
Types of delivery methods
Name Description Notes
Download Consumers receive a URL to download a data product from a connection. Requires a data source connection that supports download.
Data extract Consumers can download a data product as a file extract from a target connection. Requires two connections: A source connection and a target connection. Also requires a default project.
Open URL Consumers receive a URL to directly access a data product. Does not require a data source connection.
Live access with Flight service Consumers receive a code snippet to connect with a data source and receive a data product. The provided code snippet can be added to notebooks and other applications.
Access in watsonx.data Consumers can access the data product created from the watsonx.data instance. Requires access to watsonx.data and a Presto engine
Deliver as a table is watsonx.data Consumers access their data product as a table in watsonx.data. Does not support FIPS enabled cluster in 5.2.0

Download

The Download delivery method generates a URL that allows consumers to download directly from a connected data source.

Open URL

The Open URL delivery method provides a URL that points to a website containing the items in a data product.

Data extract

You can extract data from a database and deliver the extract as a file to consumers. The data extract delivery method requires two connections, one for connecting to the database you are extracting from (the source) and another connection for delivering the file to the consumer (the target). To view which connectors support source and target connections for data extracts, see Delivery methods for connectors.

The data extract delivery method requires a default project. The default project is created automatically when you create a bucket in Configurations and settings>Storage.

The target connection is a file storage location that is used exclusively for storing data extracts. This connection delivers the extract to consumers through a download URL. Since data extracts can be large, a file storage location with adequate capacity is recommended. The target connections require read/write credentials.

Create two connections for the data extract delivery method:

  • Source connection: The source connection is the location where you extract data.
  • Target connection: The target connection is the location where the extracted file is stored and where consumers download a data extract from a URL.

The data extract delivery method supports these file types: Avro, CSV, Delimited text, Excel, JSON, ORC, Parquet, SAV, and XML.

Live access with Flight service

The Flight service provides real-time, read/write access to many data sources through a common open source API. The Flight service provides a single interface for accessing many different data sources. With the Flight service, Data Product Hub no longer needs a connection asset to the data source with personal credentials. The Flight service retrieves the credentials transparently. To determine if your data source supports the Flight service, see Delivery methods for connectors.

When you subscribe to a data product and select delivery by the Flight service, a Flight URL is provided. You download a code snippet in your preferred language (Python or R). The code snippet contains an asset ID and a catalog ID to connect to a data source to receive delivery of the items in a data product. The code snippet can be inserted into a notebook and other applications.

You can also access the data programmatically by using an Arrow client. Arrow libraries are available for C, C++, C#, Go, Java, JavaScript, Julia, MATLAB, Python, R and Ruby. See Apache Arrow for instructions on installing the libraries for each language.

See Flight client example for an example of how to access your data product using Python.

For more information about Arrow Flight RPC, see Arrow Flight RPC.

Access in watsonx.data

The access in watsonx.data delivery method provides you access to a data product created from the watsonx.data instance. In the My Subscriptions page, you can access the data product by selecting the watsonx.data asset details link after the delivery is completed. You will have a view of your data product and specific resources you have access to in the watsonx.data instance.

Pre-requisites for Editors or Admins to enable the access in watsonx.data delivery method:

  1. Required roles:

    1. Community roles: Editor or Administrator
  2. Create a watsonx.data Presto connection in the Data Product Hub instance. The credentials in the Presto connection will be used to:

    1. Create a watsonx.data access policy to grant the consumer access to a table.
    2. The user whose credentials are specified in the Presto connection must have Admin access on the catalog in watsonx.data.
  3. Engine access:

    1. If the producer chooses not to select any Presto engine while creating the Data Product (DP), the delivery will succeed regardless of the producer’s access to any Presto engines.
    2. If the producer chooses to grant consumers access to a specific Presto engine during DP creation:
      1. The producer must have Admin privileges on the selected Presto engine.
      2. If the producer does not have Admin access:
        • Delivery will fail if the consumer does not already have access to the specified Presto engine.
        • Delivery will succeed if the consumer already has access to the specified Presto engine.

Prequisites for Editors to use the access in watsonx.data delivery method:

  1. Required roles:

    1. Community role: Editor

On successful delivery, consumers get access to:

  • Data artifact inside data product: Specific table, schema or catalog details which can be viewed in the Data manager view in watsonx.data.
  • Producer’s engine: If the producer created the data product by enabling the option to provide access to the producers’s engines in watsonx.data.
  • Watsonx.data link: For easy access into the watsonx.data instance in order to verify and work on the delivered data.

Deliver as a table in watsonx.data

The deliver as a table in watsonx.data delivery method allows consumers to access their data product as a table within their watsonx.data instance. It works by extracting data from source catalogs using the watsonx.data Presto connection, storing the data as a CSV file in an IBM Cloud Object Storage bucket, and then using an ingest job in watsonx.data to load the CSV into the specified table. Users with the appropriate permissions can create new tables or append data to existing ones. The deliver as a table in watsonx.data delivery method requires a default project.

Pre-requisites for Editors or Admins to enable the access in watsonx.data delivery method:

The access in watsonx.data delivery method provides you access to a data product created from the watsonx.data instance. In the My Subscriptions page, you can access the data product by selecting the watsonx.data asset details link after the delivery is completed. You will have a view of your data product and specific resources you have access to in the watsonx.data instance.

  1. You must have the following accesses in watsonx.data:
    1. Access to a spark engine connected to the target catalog: User
    2. Access to a presto engine (this is only required to make the connection): User
    3. Access to a target iceberg catalog: User role to the full catalog or an access policy that gives some permission to use the catalog. For more information, see Managing data policy in the watsonx.data documentation.
    4. Access to storage used for the target catalog: Writer or above
    5. Access to Cloud Object Storage: Add as a component in the watsonx.data instance. The data extract will land here before being ingested to watsonx.data.

Pre-requisites for Editors to use the deliver as a table in watsonx.data delivery method:

  1. Required roles to complete this task

    1. Community role: Editor
  2. Create two connections:

    1. Cloud Object Storage: Add as a connection in the Data Product Hub instance, using the same connection as watsonx.data. To create a COS connection in DPH you must use HMAC credentials to configure the Access key and Secret key or the Service credentials authentication method.
    2. IBM watsonx.data Presto: Connect your Presto engine by copying the JSON snippet provided in the watsonx.data instance and pasting it when creating a new connection to the IBM watsonx.data Presto engine in the Data Product Hub instance.

Learn more

Delivery methods for connectors

Parent topic: Publishing a data product