Confluent Platform KSQL in headless mode

ALincoln

I've read through KSQL deployment options here https://www.confluent.jp/blog/deep-dive-ksql-deployment-options/. So it is recommended to use headless KSQL for production deployment.

But I have not found any hints on how I can stop/change queries when in production (headless) mode when KSQL disables interactive access to server via REST/CLI. Does that mean that I need to shut down all KSQL servers in order to add/change one query?

Andrew Coates

You can deloy headless or interactive into Production, depending on what meets your needs.

Headless is designed to allow you to run a known set of queries in a locked down fashion. This can be a requirement for production systems with strict SLAs, where you don't want someone connecting and kicking off an expensive query or dropping something that causes SLAs to be broken.

As you correctly identify, the Headless deployment mode doesn't allow you to change the DDL of your cluster through a CLI/API. Instead, it would be more normal to have some kind of automation around updating the SQL file and bouncing the cluster. We are aware there is much room for improvement here.

Keep in mind that KSQL does not, at the time of writing, support updating an existing table or stream. However, this is something we're actively working towards. Until that is supported, in general you should only add queries to the file. Any deletions or changes to existing queries would require careful testing as there are many changes KSQL does not currently support. Always ensure changes are thoroughly testing before any prod deployment. Alternatively, some users spin up new clusters when changes need to be made, (hopefully infrequently!). Once caught up, they fail over clients and turn of the old cluster. Again, this is an area in which KSQL will see improvements.

Hope this helps and thanks for using KSQL!

この記事はインターネットから収集されたものであり、転載の際にはソースを示してください。

侵害の場合は、連絡してください[email protected]

編集
0

コメントを追加

0

関連記事

分類Dev

カスタムUDAFが機能しない(Ksql:Confluent)

分類Dev

Not able to play DRM content in Chrome headless mode

分類Dev

Headless Chrome Element is not clickable (works in browser mode)

分類Dev

Confluent Platform unable to properly send/consume message into the Kafka topic

分類Dev

Confluent 4.1.0-> KSQL:STREAM-TABLE結合->テーブルデータnull

分類Dev

Running Selenium Tests in Chrome (Headless mode) on a VSTS Hosted Agent

分類Dev

Confluent 4.1.0 KSQLの問題(プロパティ 'bootstrap.servers'をオーバーライドできません)

分類Dev

Confluent Platform Kafka接続ログを構成する方法は?

分類Dev

selenium.common.exceptions.InvalidSessionIdException using GeckoDriver Selenium Firefox in headless mode through Python

分類Dev

How do I start chromium-browser in headless mode? extension "RANDR" missing on display ":99"

分類Dev

Cannot create stream with KSQL

分類Dev

Kafka Stream Ksql Json

分類Dev

Data in ksql table not being persistent

分類Dev

Firefox headless crashing on headless redhat linux machine

分類Dev

Start headless chrome in incognito

分類Dev

KSQL Datagen-java.lang.ClassNotFoundException:MonitoringProducerInterceptor

分類Dev

Spark Streamingを使用してKafkaからバイナリシリアル化されたAvro(Confluent Platform)を読み取るにはどうすればよいですか?

分類Dev

Protractor login to gmail fails headless, and works when not headless

分類Dev

KSQL: Could I use threads in KSQL UDF functions to speed up the process?

分類Dev

Connect Confluent with already existing three kafka brokers

分類Dev

ApacheKafkaとConfluentの関係

分類Dev

Spring Cloud Stream Confluent KStream Avro Consume

分類Dev

Python Confluent-KafkaSSL構成

分類Dev

Starting the simulator in XCode 9 (not headless)

分類Dev

Headless browser in Azure functions JavaScript?

分類Dev

Linux LibreOfice Headless Conversion no Output?

分類Dev

ConfluentのDockerイメージ-Confluentハブコネクタの追加

分類Dev

KSQL-トピックを削除

分類Dev

ksqlでデータを変換する

Related 関連記事

  1. 1

    カスタムUDAFが機能しない(Ksql:Confluent)

  2. 2

    Not able to play DRM content in Chrome headless mode

  3. 3

    Headless Chrome Element is not clickable (works in browser mode)

  4. 4

    Confluent Platform unable to properly send/consume message into the Kafka topic

  5. 5

    Confluent 4.1.0-> KSQL:STREAM-TABLE結合->テーブルデータnull

  6. 6

    Running Selenium Tests in Chrome (Headless mode) on a VSTS Hosted Agent

  7. 7

    Confluent 4.1.0 KSQLの問題(プロパティ 'bootstrap.servers'をオーバーライドできません)

  8. 8

    Confluent Platform Kafka接続ログを構成する方法は?

  9. 9

    selenium.common.exceptions.InvalidSessionIdException using GeckoDriver Selenium Firefox in headless mode through Python

  10. 10

    How do I start chromium-browser in headless mode? extension "RANDR" missing on display ":99"

  11. 11

    Cannot create stream with KSQL

  12. 12

    Kafka Stream Ksql Json

  13. 13

    Data in ksql table not being persistent

  14. 14

    Firefox headless crashing on headless redhat linux machine

  15. 15

    Start headless chrome in incognito

  16. 16

    KSQL Datagen-java.lang.ClassNotFoundException:MonitoringProducerInterceptor

  17. 17

    Spark Streamingを使用してKafkaからバイナリシリアル化されたAvro(Confluent Platform)を読み取るにはどうすればよいですか?

  18. 18

    Protractor login to gmail fails headless, and works when not headless

  19. 19

    KSQL: Could I use threads in KSQL UDF functions to speed up the process?

  20. 20

    Connect Confluent with already existing three kafka brokers

  21. 21

    ApacheKafkaとConfluentの関係

  22. 22

    Spring Cloud Stream Confluent KStream Avro Consume

  23. 23

    Python Confluent-KafkaSSL構成

  24. 24

    Starting the simulator in XCode 9 (not headless)

  25. 25

    Headless browser in Azure functions JavaScript?

  26. 26

    Linux LibreOfice Headless Conversion no Output?

  27. 27

    ConfluentのDockerイメージ-Confluentハブコネクタの追加

  28. 28

    KSQL-トピックを削除

  29. 29

    ksqlでデータを変換する

ホットタグ

アーカイブ