You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
:link_manual_install: link:https://docs.confluent.io/home/connect/community.html#manually-installing-community-connectors/[Manually Installing Community Connectors]
Copy file name to clipboardExpand all lines: docs/guide/src/docs/asciidoc/quickstart.adoc
+17-58Lines changed: 17 additions & 58 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,4 +1,4 @@
1
-
[[_quick_start]]
1
+
[[_quickstart]]
2
2
= Quick Start
3
3
4
4
This section shows how to configure the {project-title} to import/export data between Redis and Apache Kafka and provides a hands-on look at the functionality of the source and sink connectors.
@@ -7,8 +7,8 @@ This section shows how to configure the {project-title} to import/export data be
This automatically creates the Kafka topic `pageviews` and produces data with a schema configuration from https://github.com/confluentinc/kafka-connect-datagen/blob/master/src/main/resources/pageviews_schema.avro
74
+
This automatically creates the Kafka topic `pageviews` and produces data with a schema configuration from {link_pageviews_avro}
72
75
73
76
[NOTE]
74
77
====
@@ -94,7 +97,7 @@ The command below adds a {project-title} sink connector configured with these pr
94
97
* The connection URI of the Redis database to which the connector writes data
95
98
* The Redis command to use for writing data (`JSONSET`)
96
99
* Key and value converters to correctly handle incoming `pageviews` data
97
-
* A https://docs.confluent.io/platform/current/connect/transforms/overview.html[Single Message Transform] to extract a key from `pageviews` messages.
100
+
* A {link_smt} to extract a key from `pageviews` messages.
98
101
99
102
[source,console]
100
103
-----
@@ -165,66 +168,22 @@ Now add a message to the `mystream` Redis stream:
165
168
Examine the topics in the Kafka UI: http://localhost:9021 or http://localhost:8000/.
166
169
The `mystream` topic should have the previously sent stream message.
167
170
171
+
== Custom Connector
168
172
169
-
== End-to-end Example
170
-
171
-
The project {project-scm}[repository] contains a script that runs all the steps shown previously.
172
-
173
-
Clone the {project-scm}[{project-name}] repository and execute `run.sh` in `docker` directory:
174
-
175
-
[source,console,subs="attributes"]
176
-
----
177
-
git clone {project-scm}
178
-
cd {project-name}
179
-
./run.sh
180
-
----
181
-
182
-
This will:
183
-
184
-
* Run `docker compose up`
185
-
* Wait for Redis, Kafka, and Kafka Connect to be ready
186
-
* Register the Confluent Datagen Connector
187
-
* Register the Redis Kafka Sink Connector
188
-
* Register the Redis Kafka Source Connector
189
-
* Publish some events to Kafka via the Datagen connector
190
-
* Write the events to Redis
191
-
* Send messages to a Redis stream
192
-
* Write the Redis stream messages back into Kafka
193
-
194
-
Once running, examine the topics in the Kafka http://localhost:9021/[control center]:
195
-
196
-
The `pageviews` topic should contain the 10 simple documents added, each similar to:
Messages added to the `mystream` stream will show up in the `mystream` topic.
213
-
214
-
215
-
== Confluent Cloud
216
-
217
-
This section describes configuration aspects that are specific to using {project-title} in Confluent Cloud.
173
+
This section describes configuration aspects that are specific to using {project-title} as a {link_custom_connector} in Confluent Cloud.
218
174
219
175
=== Egress Endpoints
220
176
221
-
It is required to specify https://docs.confluent.io/cloud/current/connectors/bring-your-connector/custom-connector-qs.html#cc-byoc-endpoints[egress endpoints] in order for the connector to reach the Redis database.
177
+
It is required to specify {link_egress_endpoints} in order for the connector to reach the Redis database.
222
178
223
179
=== Sensitive Properties
224
180
225
-
The following are https://docs.confluent.io/cloud/current/connectors/bring-your-connector/custom-connector-qs.html#sensitive[sensitive properties] that must be marked as such in Confluent Cloud UI.
181
+
The following are {link_sensitive_props} that must be marked as such in Confluent Cloud UI.
226
182
227
183
* `redis.uri`: URI of the Redis database to connect to, e.g. `redis://redis-12000.redis.com:12000`
228
184
* `redis.username`: Username to use to connect to Redis
229
185
* `redis.password`: Password to use to connect to Redis
230
186
* `redis.key.password`: Password of the private key file
0 commit comments