Project Metamorphosis: Unveiling the next-gen event streaming platformLearn More

Confluent Cloud KSQL is Now Available

Today, we are excited to announce that after a highly productive period of being in private preview, Confluent Cloud KSQL is now production ready and available to all Confluent Cloud customers on usage-based billing plans. Before presenting an overview of Confluent Cloud KSQL’s features, we would like to briefly provide some background around what led us here, and why we believe KSQL is such an important technology.

Apache Kafka® is increasingly becoming the single source of truth for many organizations’ data. And as these organizations continue to prefer cloud-hosted infrastructure in order to reduce their operational burdens, Confluent Cloud provides one of the easiest ways to obtain a robust, production-ready Kafka environment in just a few minutes. As the central nervous system for your data, a fully managed Kafka environment eliminates the complexities around operating critical infrastructure. But the true value of data is derived from whatever an organization actually does with it.

Producers push events into Kafka, and consumers pull them out for downstream processing. Often this processing is done using complex application code performing very common operations: transformations, enrichment, joining events together, and aggregation are all fundamental to most data processing pipelines. Real-time processing brings an organization’s data to life by invigorating it with a certain level of autonomous intelligence. If Kafka is the central nervous system, then the stream processing layer is the brain, taking streams of events as input, applying predefined logic, and producing new streams as output.

And just as traditional databases have abstracted away common operations performed on data at rest, stream processing tools offer the same abstractions for event streaming. KSQL enables users to define this processing using largely standard SQL syntax, making it immediately accessible to most organizations. No complex application code is required—KSQL will take SQL queries and figure out how to continuously execute them efficiently atop torrents of streaming events.

KSQL’s accessibility is further amplified in Confluent Cloud, where KSQL is available as a fully managed service. In addition to providing the immense benefits of SQL queries over code, Confluent Cloud KSQL eliminates the innate complexities of operating infrastructure in production. We take care of running production-grade infrastructure at scale while you focus on solving business problems with KSQL. Transformations, stream-to-stream joins, aggregations, and data enrichment can all be accomplished using KSQL with just a few lines of SQL.

In addition to providing the core capabilities of KSQL, Confluent Cloud KSQL also layers on valuable functionality based on everything we’ve learned about how organizations are doing stream processing. In particular, Confluent Cloud KSQL’s intuitive web interface is designed to simplify your interactions with KSQL: create streams and tables with a few clicks, or submit continuous SQL queries through the query editor while browsing the schemas of the various streams and tables your queries target.

Confluent Cloud KSQL Web Interface

As you create and chain together more of these continuous queries, stream processing workloads can become complex. To help manage this complexity, Confluent Cloud KSQL includes a “Flow” view that visualizes your end-to-end workload as a topology of continuous queries. Individual queries in the processing topology can be inspected to examine messages flowing through them or to identify throughput bottlenecks in your workload. The status of each continuous query can be quickly evaluated in a single place in order to help you ensure that your topology is healthy.

Confluent Cloud KSQL "Flow" View

Your applications can also programmatically integrate with Confluent Cloud KSQL by securely connecting to your KSQL application’s REST endpoint, bypassing the web interface entirely. In fact, you have unrestricted access to the same APIs that the web interface uses, enabling you to develop deep integrations that deliver real-time intelligence to your applications and services.

Confluent Cloud KSQL also integrates seamlessly with the other components of Confluent Cloud, which are designed to work together synergistically. Your KSQL applications will be connected to Kafka and Schema Registry out of the box, and deeper integration with Kafka Connect is planned for a future release. Regardless of how you choose to use Confluent Cloud KSQL, no operational overhead is required on your part. We’ll ensure that your application runs with the highest degree of reliability in production while you focus on solving business problems.

Get started with Confluent Cloud KSQL

To start using Confluent Cloud KSQL, you can sign up for Confluent Cloud, a fully managed event streaming service based on Apache Kafka, and get $50 of free usage each month for the first three months. Once you sign in to Confluent Cloud, these links will help you get started with KSQL quickly:

Derek Nelson is a senior product manager at Confluent. He was previously the founder of PipelineDB, a database technology startup that built a SQL engine for stream processing.

Did you like this blog post? Share it now

Subscribe to the Confluent blog

More Articles Like This

Announcing ksqlDB 0.10.0

We’re excited to announce the release of ksqlDB 0.10.0, available now in the standalone distribution and on Confluent Cloud! This version includes a first-class Java client, improved Apache Kafka® key […]

Unifying Streams and State: The Seamless Path to Real-Time

More than ever before, people demand immediacy in every aspect of their lives. Expectations for how we shop, bank, and commute have completely evolved over the last decade. When you […]

Real-Time Fleet Management Using Confluent Cloud and MongoDB

Most organisations maintain fleets, a collection of vehicles put to use for day-to-day operations. Telcos use a variety of vehicles including cars, vans, and trucks for service, delivery, and maintenance. […]

Jetzt registrieren

Start your 3-month trial. Get up to $200 off on each of your first 3 Confluent Cloud monthly bills

Nur neue Registrierungen.

Wenn Sie oben auf „registrieren“ klicken, erklären Sie sich damit einverstanden, dass wir Ihre personenbezogenen Daten verarbeiten – gemäß unserer und bin damit einverstanden.

Indem Sie oben auf „Registrieren“ klicken, akzeptieren Sie die Nutzungsbedingungen und den gelegentlichen Erhalt von Marketing-E-Mails von Confluent. Zudem ist Ihnen bekannt, dass wir Ihre personenbezogenen Daten gemäß unserer und bin damit einverstanden.

Auf einem einzigen Kafka Broker unbegrenzt kostenlos verfügbar
i

Die Software ermöglicht die unbegrenzte Nutzung der kommerziellen Funktionen auf einem einzelnen Kafka Broker. Nach dem Hinzufügen eines zweiten Brokers startet automatisch ein 30-tägiger Timer für die kommerziellen Funktionen, der auch durch ein erneutes Herunterstufen auf einen einzigen Broker nicht zurückgesetzt werden kann.

Wählen Sie den Implementierungstyp aus
Manuelle Implementierung
  • tar
  • zip
  • deb
  • rpm
  • docker
oder
Automatische Implementierung
  • kubernetes
  • ansible

Wenn Sie oben auf „kostenlos herunterladen“ klicken, erklären Sie sich damit einverstanden, dass wir Ihre personenbezogenen Daten verarbeiten – gemäß unserer Datenschutzerklärung zu.

Indem Sie oben auf „kostenlos herunterladen“ klicken, akzeptieren Sie die Confluent-Lizenzvertrag und den gelegentlichen Erhalt von Marketing-E-Mails von Confluent. Zudem erklären Sie sich damit einverstanden, dass wir Ihre personenbezogenen Daten gemäß unserer Datenschutzerklärung zu.

Diese Website verwendet Cookies zwecks Verbesserung der Benutzererfahrung sowie zur Analyse der Leistung und des Datenverkehrs auf unserer Website. Des Weiteren teilen wir Informationen über Ihre Nutzung unserer Website mit unseren Social-Media-, Werbe- und Analytics-Partnern.