S3 Sink Connector

Create a connector with Type: sink, Database: S3

Pre-condition: CDC service status is Healthy

Steps to create a connector:

Step 1: From the menu bar, select Data Platform > Workspace Management > Workspace name

Step 2: Under My services, select CDC service

Step 3: On the CDC service detail screen > Select the Connectors tab > Click Create a connector

Step 4: Enter the information on the Connector Information screen:

• Name (required): connector name

Note: The connector name may contain lowercase letters a-z or digits 0-9. Spaces are not allowed; use "-" instead of a space.

• Type (required): select sink
• Database (required): select S3

Step 5: Click Next in the upper-right corner of the screen to proceed to the Properties screen

• S3 Storage

Enter the S3 storage information:

• Endpoint: S3 storage access address
• Access key: access key
• Secret: access secret
• Bucket name: bucket name
• Path prefix: path to the folder in storage

Click Test Connection to verify the connection from the Workspace to the entered S3

• Converter
  • Converter key: select the key value for the converter
  • Converter key schema enable: select whether or not to use a schema in the Converter key
  • Converter value: select the value for the converter
  • Converter value schema enable: select whether or not to use a schema in the Converter value
• Kafka topic
  • Click the '+' button to retrieve topic information
  • Note: maximum of 100 topics can be retrieved

Step 6: Click Next to proceed to the Additional Properties screen

• Number of tasks: maximum number of tasks that can run in parallel
• Database type: select the type of source Database
• Timezone: select timezone
• File format: select file format
• Mode: select mode

Step 7: Click Next in the upper-right corner of the screen to proceed to the Review screen

Step 8: Review the information, then click Create to complete the connector creation