Starburst Connector

Configure and run the Starburst connector to import metadata into DataGalaxy.

2 min read

This article describes how DataGalaxy Starburst connector works.

This connector is available in the following modes:

Desktop modeSaaS Online mode
✅✅

Connector scope

The connector allows you to import the following metadata from Starburst :

  • All Starburst catalogs are imported in the Dictionary as of their content: schemas, tables/views and columns ;
  • The Domains and Starburst Data Products are imported in the Usages module.

The extracted objects and their correspondences are detailed in the following table:

Trino ObjectDataGalaxy ModuleDataGalaxy ObjectDataGalaxy AttributesComments
CatalogDictionaryModel (Container)Technical typeThe technical type corresponds to the technology used by the Starburst catalog (mysql, hive, ...).
SchemaDictionaryModel (Container)
Table / ViewDictionaryTable / View (Structure)The comment on the table/view is brought up when it is available.
ColumnDictionaryColumnThe name, data type, comment and order are brought up when available.
DomainUsagesApplicationEach Domain regroups all its Data Products
Data ProductUsagesDatasetThe Data Product is linked to the Model in the Dictionary that represents the Starburst Catalog associated to the Data Product
DatasetUsagesDatasetThe Dataset is linked to the View in the Dictionary representing this Dataset, child of the Model associated to the Data Product it belongs to.

Step 1 : Installation

  • Extract the connector archive in the directory of your choice
  • Download the Starburst plug-in from the portal and copy it into the /lib directory of the connector

Step 2 : Run Starburst connector

  • After starting the connector, access to Dictionary or Usages connectors:
  • If it has been correctly installed, the Starburst plug-in appears in the list

The following information is requested:

ParameterMandatoryDescription
ProtocolYeshttp / https
ServerYesName or IP address of the Starburst instance
PortYesPort of Starburst instance
Root application nameYesName of the "parent" application in the DataGalaxy Usage module, which will be used to store all items of Starburst (Domains, Data Products, Datasets). If the application does not exist, it will be created during the import.
UserYesUser name
PasswordNoUser password
Advanced modeNoOption that allows you to customize the JDBC URL used in the connection
The JDBC connection string syntax allows you to specify a catalog. However, if your need is to limit the connector's retrieval scope to a given catalog, please use the field above provided for that purpose.

Technical information

The connector uses the JDBC driver provided by Starburst and the REST API layer of Starburst Enterprise.

Releases

DatePlugin VersionDataGalaxy releaseDesktop Connector version (minimum)Description
29/09/20263.0.13.423.06.2.2New internal implementation to fix security vulnerabilities
07/07/20262.0.2v3.376.05.18.2New internal implementation
23/08/20242.0.1v3.69.05.2.3Updated the logger to show more information when using verbose mode
06/08/20242.0.0v3.65.05.0.5Migrated from java 11 to java 17 + CVE fixes

Read more

Related articles

Was this page helpful?