Introduction

This document provides a detailed guide on setting up the Redis target connector for the DataBrew project. The Redis connector allows for efficient and flexible storage of processed data, ensuring that your data pipeline’s output is securely persisted or cached in your Redis data store.

Redis Connector is curretly avaialble as a destination connector. It means you will not be able to stream your data from Redis

Requirements

Before setting up the Redis target connector, ensure you meet the following requirements:

  • Access to your Redis instance or Redis cloud service.
  • Necessary permissions to write data into the Redis data store.
  • Understanding of Redis data structures and best practices for data storage.

Preparing Your Redis Environment

To ensure smooth integration:

  • Data Structure Design: Understand and plan the Redis data structures (e.g., strings, hashes, lists, sets, sorted sets) to use for storing your processed data.
  • Security & Access Control: Verify that the DataBrew project’s user account or service has the required permissions to write data to the desired keys in Redis.

Cloud Setup

This section guides you through setting up the Redis target connector in the cloud for the DataBrew project.

Setting up in Cloud

  1. Access DataBrew Cloud Platform: Navigate to DataBrew Cloud App.
  2. Create a New Target Connector Instance: Follow these steps…
    • Step 1: Choose ‘Redis’ from the list of available target connectors.
    • Step 2: Provide the necessary connection details, including your Redis server URL, authentication details, and target data structure configurations.
    • Step 3: Configure additional settings like key naming conventions, expiration policies, and data serialization formats, as required.
    • (Include screenshots or code snippets if necessary)