For more information about the 6.1.3 release, check out the release blog target to send Audit Logs. The uptime SLAs for Single-Zone clusters remain the same; 99.5% for Basic confluent.license key in your server.properties file. If you overview podcast, For more information, see. Basic authentication can now be configured for the Jolokia agent. Improvements to aggregate functions to support complex types, like Cluster management APIs for Standard and Basic clusters are now available. limit for the amount of data that can be stored on the cluster. The Confluent Cloud CLI has been promoted to general availability with features that now enable use in For more details about cloud provider availability zones: Confluent Cloud is now generally available on Microsoft Azure in: These features are not yet available for customers using VPC peering. Developers cannot access. This feature is available on AWS, GCP, and Azure. addressed in a future update release. When mutual authentication is enabled on a ksqlDB server (with the server property For more information, see Confluent Cloud Cluster Management API Quickstart. receives a notification email message, they cannot access the connector unless they
Remove the null byte prepended to messages when running, Resolve auth token refresh failure for a group of SSO users, Add the ability to disable cloud features in the event of a security incident, Return a more specific error message if resource quota limits are exceeded. ksqlDB now supports 1 CSU and 2 CSU deployments. . Non-interactive login supported via environment variables, Binaries and archives are now shipped for Alpine Linux, Fixed issue where update command may not detect new CLI versions, Infer default protocol and port number for URLs when logging in, When using local Kafka sub-commands, only check status of Kafka cluster if it is a locally-running cluster, Fix flushing of logs and log processing during CLI startup, Improve warning messages for audit log commands, Add additional logging when setting custom CA cert path, Fix KSQL path issue for CP verions older than 5.5, Support piping credentials to login commands, Fix command output bug for commands that were supposed to output to Stdout but were outputting to Stderr. Some users might receive email notifications related to Connector create operations, Adds the MetricsViewer role that grants access only to metrics for specified See the Confluent Cloud Broker and Topic Configuration Settings for more details. It contains the following changes: Confluent Terraform Provider v0.9.0 Support for push query continuation tokens in the Java API.
before the page loads as expected. structs, arrays, and maps. Machine readable JSON or YAML output through the. Row keys now support all data formats (e.g., JSON, DELIMITED, etc.). It contains the following changes: Network service quotas for the following Contact support if you have any questions about this known issue. Granular RBAC for Kafka resources is only available in Standard and Dedicated document.write(new Date().getFullYear()); Confluent Platform 5.4.x, the Confluent Server broker checks for a license during start-up. See the On-Premises Deployments providing your own API Key. PARTITION BY now supports partitioning on multiple columns. You can use Ansible Playbooks for Confluent Platform to update the Confluent Platform component configuration by re-running the provisioning When you purchase a support plan, you will retain the support plan and be charged for it for the current and potentially next billing cycle. CKUs are no longer tied to storage on GCP clusters. For more information, see Confluent Cloud Azure Private Link. Import route option is now supported with VPC Peering to Confluent Cloud Dedicated Dedicated clusters on Confluent Cloud is available in an Early Access Program to 6.1.3 is a major release of Confluent Platform that provides you with Apache Kafka 2.7.0, the latest stable version of Kafka. binding process and to enable centralized audit logging. Confluent Platform 6.1.3 includes the latest versions of the Go (confluent-kafka-go), Python (confluent-kafka-python), To trigger the certificate selection dialog, you should navigate to an endpoint on No changes relating to Confluent CLI for this version. General Availability. Confluent Platform is available for download at https://www.confluent.io/download/. Added support for Kafka topic configuration updates (, Add utility functions for working with JSON data, Add ability to use an existing Schema Registry schema when creating streams and tables, Improved readability of error messages by adding details to them, Resolved potential HTTP 429 errors by adding automatic retries with exponential backoff for HTTP requests. Confluent Terraform Provider v0.13.0 No access to ksqlDB clusters and cannot see any information related to the ksqlDB clusters. document.write(new Date().getFullYear()); Users remain signed in to the Confluent Cloud Console for a maximum of eight hours All new and existing Standard and Dedicated clusters on GCP now support infinite storage. Apache, Apache Kafka, Kafka, and associated open source project names are trademarks of the Apache Software Foundation, Building Data Pipelines with Apache Kafka and Confluent, Event Sourcing and Event Storage with Apache Kafka, Kafka REST for Confluent Cloud Developers, Encrypt a Dedicated Cluster Using Self-managed Keys, Encrypt Clusters using Self-Managed Keys AWS, Encrypt Clusters using Self-Managed Keys Google Cloud, Use the Confluent Cloud CLI with multiple credentials, Tutorial: Access Management in Confluent Cloud, Share Data Across Clusters, Regions, and Clouds, Microsoft SQL Server CDC Source (Debezium), Addressing DDL Changes in Oracle Database, Single Message Transforms for Confluent Platform, ksqlDB Connector Management in Confluent Cloud, Access Confluent Cloud Console with Private Networking, Dedicated Cluster Performance and Expansion, Marketplace Organization Suspension and Deactivation, Connecting Control Center to Confluent Cloud, Connecting Kafka Streams to Confluent Cloud, Auto-Generating Configurations for Components to Confluent Cloud.
Adds the Operator role that enables Describe-only access at the Organization, These metrics have a principal_id label to attribute usage to and establish secure connectivity to Confluent Cloud from their Azure VNet. release notes. There is no price change for clusters with infinite storage. This feature enables customers to utilize their Identity provider to centrally Fixed pagination issue for data sources (, Fixed a bug where you could successfully import a non-existent resource (, All resources and data sources have been renamed in the new. even if they are not directly related to or involved in these operations. Persistent queries that use multiple grouping columns now use a different row key format. For more information, see Confluent Cloud VPC Peering on GCP. If user is already authenticated with a username and password, Automatically refresh sessions, keeping users logged in while the CLI is in use, Fix typos in various command descriptions, Add dataplane roles to suggestion message in, Delete temporary schema directories after producing or consuming, Remove redundant log messages during API pagination, Add support for source-initiated cluster links in Confluent Cloud, Fix error message when resizing a Kafka cluster, Fix bug where locally stored API key could be cleared, Migrated to new APIs that support faster cluster provisioning, Fixed incorrect options for updating Schema Registry subject modes, Improved error messages and help examples, Show user email, organization name, and organization ID on login, Show the correct email when listing API keys for users with dataplane roles, Fix parsing of quoted flag values and arguments in, Fix error with protobuf schema references for produce and consume commands, Improved logging for produce and consume commands, and during SSO login, Added support for multiline properties in cluster link configuration files, Fixed capitalization in human-readable output, Produce and consume support for Confluent Platform, Allow colons in role binding subject resources, Improve error when logging in to a suspended org, List ACLs created with service account resource IDs in, Improve suggestion when API key is not recognized as valid, Fix potential request failures for users with large number of resources, Add support for logging into specific Confluent Cloud organizations, Dont show deactivated users (or those with expired invitations) in role binding list command, Add autocompletion support for remaining command flags (, Fix issue where CLI would not show additional information with verbosity flags set (, Return error if SSO user enters different emails in CLI prompt and their SSO provider, Check whether service account exists before attempting to create or delete a Kafka ACL, Add friendlier error messages for RBAC commands, Expand existing autocompletion functionality to include many command arguments and flags, Add built-in aliases for several long command names, Add reference support for JSON and protobuf in schema producer and consumer, Notify user when ksqlDB cluster provisioning fails, Add extra validation logic for login URLs, Warn Confluent Platform users before enabling updates, Create audit log API keys using the correct service account, Err if a process is already listening on the SSO callback port, Restore partition count field when describing a topics configuration, Show success message when deleting a service account, Fix issue with listing pending user invitations, Fix issue with logging into SSO-enabled organizations when user is not already logged in, WARNING: If you are updating from a prior Confluent CLI v1.x client, note that this version is NOT interoperable with Confluent Platform v7.0 or earlier. This version of Confluent CLI supports both Confluent Cloud and Confluent Platform management. Engineering is working to resolve this issue. All new and existing Standard and Dedicated clusters on AWS now support infinite storage. management of private dedicated clusters and networks. Kafka health checks no longer depend on the Jolokia endpoint. For more details, The Kafka broker is the default in all Debian or RHEL and CentOS packages. see Sign-in attempt. Self-Balancing Clusters in Confluent Platform 6.1 expands observability by adding an additional REST API callS to monitor Log on to Confluent Cloud, With Granular access, you can configure ACLS in the UI. Users must sign in at least once every for Standard and Dedicated Kafka clusters with Multi-Zone configurations. Confluent Cloud is a fully-managed Apache Kafka service available on all three major clouds. We are actively working to block this access. Cluster links can now be viewed on the Confluent Cloud Console in your web browser. Engineering is actively working to block this access. For more information about migrating to Confluent Server, see Migrate to Confluent Server. You must Confluent Terraform Provider v0.10.0 Basic clusters are billed for ingress, egress, and storage. Consumer lag is now available as a metric in the Confluent Cloud Metrics API. Apache, Apache Kafka, Kafka, and associated open source project names are trademarks of the Apache Software Foundation, Building Data Pipelines with Apache Kafka and Confluent, Event Sourcing and Event Storage with Apache Kafka, Quick Start for Apache Kafka using Confluent Platform (Local), Quick Start for Apache Kafka using Confluent Platform (Docker), Quick Start for Apache Kafka using Confluent Platform Community Components (Local), Quick Start for Apache Kafka using Confluent Platform Community Components (Docker), Hybrid Deployment to Confluent Cloud Tutorial, Tutorial: Introduction to Streaming Application Development, Observability for Apache Kafka Clients to Confluent Cloud, Google Kubernetes Engine to Confluent Cloud with Confluent Replicator, Azure Kubernetes Service to Confluent Cloud with Confluent Replicator, Confluent Replicator to Confluent Cloud Configurations, Confluent Platform on Google Kubernetes Engine, Confluent Platform on Azure Kubernetes Service, Clickstream Data Analysis Pipeline Using ksqlDB, DevOps for Apache Kafka with Kubernetes and GitOps, Case Study: Kafka Connect management with GitOps, Using Confluent Platform systemd Service Unit Files, Pipelining with Kafka Connect and Kafka Streams, Pull queries preview with Confluent Cloud ksqlDB, Migrate Confluent Cloud ksqlDB applications, Connect ksqlDB to Confluent Control Center, Write streaming queries using ksqlDB (local), Write streaming queries using ksqlDB and Confluent Control Center, Connect Confluent Platform Components to Confluent Cloud, Quick Start: Moving Data In and Out of Kafka with Kafka Connect, Single Message Transforms for Confluent Platform, Getting started with RBAC and Kafka Connect, Configuring Kafka Client Authentication with LDAP, Authorization using Role-Based Access Control, Configure MDS to Manage Centralized Audit Logs, Configuring Audit Logs using the Properties File, Configuring Control Center to work with Kafka ACLs, Configuring Control Center with LDAP authentication, Manage and view RBAC roles in Control Center, Log in to Control Center when RBAC enabled, Replicator for Multi-Datacenter Replication, Tutorial: Replicating Data Across Clusters, Configure Confluent Platform Components to Communicate with MDS over SSL, Configure mTLS Authentication and RBAC for Kafka Brokers, Configure Kerberos Authentication for Brokers Running MDS, Configure LDAP Group-Based Authorization for MDS, Installing and configuring Control Center, Check Control Center Version and Enable Auto-Update, Connecting Control Center to Confluent Cloud, Edit the configuration settings for topics, Configure PagerDuty email integration with Control Center alerts, Data streams monitoring (deprecated view), Java client support for DDL/DML statements, Support ALTER STREAM | TABLE ADD COLUMN, latest/earliest_by_offset now supports storing n latest/earliest values, Add utility to restore the ksqlDB command topic, CLI support for non-interactive command execution, https://my-ksqldb-server01.my-organization.net/info. user and service accounts. playbook with an updated inventory file. select multiple availability zones, data in the cluster will be spread across multiple cloud availability zones.
Self-Balancing tasks when adding a new broker. Added new resources and corresponding docs: Added new data sources and corresponding docs: Improved logging to simplify debugging process: Revised and structured logging messages to output non-sensitive attributes In the Java API and migrations tool, support for custom request headers matches their API group version For details, see Confluent Cloud SLA. is now available in public preview. supply a license string in each brokers properties file using the Granular role-based access control (RBAC) for Kafka resources is promoted to General For details, see Role limitations by resource. 1.6.2. creating, listing, describing, updating, and deleting API keys. Users can select zones for the Confluent Cloud network. Added graceful handling for resources created via Terraform but deleted via Confluent Cloud Console, Confluent CLI, or Confluent Cloud APIs. Removed friction around manual look-up of IntegerID for Service Accounts by removing the need to use a service_account_int_id TF variable. General Availability: REST APIs for Dedicated clusters and private networking are now Generally Available, commit towards usage-based consumption of Confluent Cloud. which any existing single-zone clusters will be migrated to basic, and multi-zone clusters will is now available in public preview. Avro format support has been added to Confluent Cloud. You can increase connect tasks to get a better performance and handle more partitions. Therefore, we dont recommend using the 2.7 inter broker protocol (IBP). Array and Struct types can now be used as row keys. There are no longer two log4j configs that are passed to the processes. are assigned the required roles. see ksqlDB Connector Management in Confluent Cloud. These features are expected to be available for all customers using Dedicated clusters by mid-November.
Kafka clusters starting today. clusters. Fix panic when invalid role is specified during resource-scoped rolebinding commands. Enables organizations to build end-to-end provisioning flow using the. See, If you are updating from the Confluent Cloud CLI, the client name will change to, Add support for managing brokers and partitions, Fix issues when changing directories after logging in with a custom CA cert path, Kafka ACL management via Confluent REST Proxy, Fix logout panic when removing netrc entry, Move non-interactive login/environment messages to debug-level printouts to, Fix supporting custom home directories specified via the, Increase default number of metadata key iterations from 1000 to 10000, Fix bug where update command fails to find some versions, Build and release darwin/arm64 binaries and archives, Topic management commands via Confluent REST Proxy API, CONFLUENT_MDS_URL and CONFLUENT_CA_CERT_PATH environment variable support, Fix no newline bug when auto injected configs are appended to manually added configs for, Fix case where wrong ca-cert-path might be used when logging in, Fix automatic update of auth tokens for username/email with special characters, Prompt for credentials instead of throwing error when non-interactive login fails. Customers can provision new Confluent Cloud Dedicated clusters with Azure Private Link The technical details of this release are summarized below. Try it free today. commitments through the AWS Marketplace. VPC and support advanced network topologies to connect to Confluent Cloud. fixed in a subsequent release. For details, To request a Dedicated cluster update sooner, send an email to clusterlinking@confluent.io. max.message.bytes can now be configured up to 20 MB on dedicated clusters (previously the limit was 8 MB). This is due to a delay in permission response and will be For more information, see Confluent Cloud Features and Limits by Cluster Type. User and service accounts can be granted multiple roles. After upgrading from 5.5.x to 6.1.x customers with high partition counts (greater than 100,000) may experience cluster instability. With Confluent Cloud annual commitments you can use your AWS Standard clusters are billed an hourly base price of $1.50 USD per hour, in addition to No access to the Schema Registry and cannot see any information related to the Schema Registry. New organization audit log events for management operations are promoted to Fix success and error message display bug, Improve error message handling for audit log commands, Fix parsing of credentials on Windows for login command, Update RBAC rolebinding commands to support friendly cluster names, Improve error and success messages and add suggestions for commands that dont succeed, Update macOS system requirements for Confluent Platform 6.0, Fix handling of errors from invalid RBAC rolebinding commands for Confluent Platform 6.0, Handle errors with loading CLI configuration files and ignore them when configs arent needed, Respect log output/verbosity levels when loading configuration files, Only check for updates once every 24 hours, Compatibility fix for RBAC in Confluent Platform 5.x, Restrict feedback nudges to fewer commands, Skip update check when running the update command, Update RBAC rolebinding commands to support friendly cluster names (CP 6.0), Start publishing release notes with each release, Fix panics when metadata service returns internal server errors. and the Streaming Audio podcast. You cannot configure Replicator to read from or write to an RBAC-enabled Kafka cluster. If you are using the, Add support for TIMESTAMP type in the WITH/TIMESTAMP property, Enable ROWPARTITION and ROWOFFSET pseudo columns, Enable GRACE period with new stream-stream joins semantics, Add SOURCE keyword for CREATE STREAM and CREATE TABLE statements, Improve pull query performance for primary key range scans, Support for expressions in foreign-key table-table joins, FROM_DAYS and update UNIX_DATE functions added, PARSE_DATE and FORMAT_DATE functions added, PARSE_TIME and FORMAT_TIME functions added. You can use Ansible Playbooks for Confluent Platform to configure and deploy. For more details, see Organization Auditable Events. For more information on using the Cluster Load metric, see Dedicated Cluster Performance and Expansion. For the supported versions and interoperability of Confluent Platform and its components, see Infinite Storage is now available on GCP clusters. It contains the following changes: New user session timeouts when using the Confluent Cloud Console are now promoted to MIN/MAX aggregates can now be used for Time/TS/Date types. The roll out is gradual to help ensure a consistent experience across cloud providers and regions. Better error handling for nested functions. Try it free today. roles (OrganizationAdmin, EnvironmentAdmin, CloudClusterAdmin, MetricsViewer, This page highlights significant user-facing features and updates to For more information, see Announcing the Confluent Q1 22 Launch. api.endpoints.blocklist. For example: Confluent Operator 1.7.0 allows you to deploy and manage Confluent Platform versions 6.0.x and 6.1.x on Kubernetes. Apache, Apache Kafka, Kafka, and associated open source project names are trademarks of the Apache Software Foundation, audit log support for network-related auditable events, ksqlDB Connector Management in Confluent Cloud, Use Role-Based Access Control (RBAC) in Confluent Cloud, Dedicated Cluster Performance and Expansion, Azure Cognitive Search Sink Connector for Confluent Cloud, Azure Synapse Analytics Sink Connector for Confluent Cloud, Salesforce Platform Event Sink Connector for Confluent Cloud, Salesforce SObject Sink Connector for Confluent Cloud, Azure Service Bus Source Connector for Confluent Cloud, ServiceNow Sink Connector for Confluent Cloud, ServiceNow Source Connector for Confluent Cloud, Cluster Linking on Confluent Cloud Overview page, Salesforce Platform Event Source Connector for Confluent Cloud, Azure Cosmos DB Sink Connector for Confluent Cloud, Confluent Cloud Cluster Management API Quickstart, Confluent Cloud Features and Limits by Cluster Type, Confluent Cloud Cluster Role Based Access Control (RBAC), MongoDB Atlas Sink Connector for Confluent Cloud, MongoDB Atlas Source Connector for Confluent Cloud, Microsoft SQL Server Sink (JDBC) Connector for Confluent Cloud, MySQL Sink (JDBC) Connector for Confluent Cloud, PostgreSQL Sink (JDBC) Connector for Confluent Cloud, Microsoft SQL Server CDC Source (Debezium) Connector for Confluent Cloud, MySQL CDC Source (Debezium) Connector for Confluent Cloud, PostgreSQL CDC Source Connector (Debezium) for Confluent Cloud, Salesforce CDC Source Connector for Confluent Cloud, AWS Lambda Sink Connector for Confluent Cloud, Azure Functions Sink Connector for Confluent Cloud, Google Cloud Functions Sink Connector for Confluent Cloud, Elasticsearch Service Sink Connector for Confluent Cloud, Azure Data Lake Storage Gen2 Sink Connector for Confluent Cloud, Amazon Redshift Sink Connector for Confluent Cloud, Microsoft SQL Server Source (JDBC) Connector for Confluent Cloud, Oracle Database Source Connector for Confluent Cloud, MySQL Source (JDBC) Connector for Confluent Cloud, PostgreSQL Source (JDBC) Connector for Confluent Cloud, Change cluster settings for Dedicated clusters, Datagen Source Connector for Confluent Cloud, Amazon S3 Sink Connector for Confluent Cloud, Get Started with Confluent Cloud on the AWS Marketplace with Pay As You Go, Get Started with Confluent Cloud on the AWS Marketplace with Commitments, Encrypt Confluent Cloud Clusters using Self-Managed Keys, Azure Event Hubs Source Connector for Confluent Cloud, Snowflake Sink Connector for Confluent Cloud, Get Started with Confluent Cloud on the GCP Marketplace with Commitments, Amazon Kinesis Source Connector for Confluent Cloud, Google Cloud BigQuery Sink Connector for Confluent Cloud, Google Pub/Sub Source Connector for Confluent Cloud, Expand a Dedicated Kafka Cluster in Confluent Cloud, Get Started with Confluent Cloud on the Azure Marketplace with Commitments, Google Cloud Spanner Sink Connector for Confluent Cloud, Google Cloud Dataproc Sink Connector for Confluent Cloud, Azure Blob Storage Sink Connector for Confluent Cloud, Get Started with Confluent Cloud on the Azure Marketplace with Pay As You Go, Google Cloud Storage Sink Connector for Confluent Cloud, Quick Start for Schema Management on Confluent Cloud, AWS S3 Sink Connector is available in Preview, Building Data Pipelines with Apache Kafka and Confluent, Event Sourcing and Event Storage with Apache Kafka, Kafka REST for Confluent Cloud Developers, Encrypt a Dedicated Cluster Using Self-managed Keys, Encrypt Clusters using Self-Managed Keys AWS, Encrypt Clusters using Self-Managed Keys Google Cloud, Use the Confluent Cloud CLI with multiple credentials, Tutorial: Access Management in Confluent Cloud, Share Data Across Clusters, Regions, and Clouds, Microsoft SQL Server CDC Source (Debezium), Addressing DDL Changes in Oracle Database, Single Message Transforms for Confluent Platform, Access Confluent Cloud Console with Private Networking, Marketplace Organization Suspension and Deactivation, Connecting Control Center to Confluent Cloud, Connecting Kafka Streams to Confluent Cloud, Auto-Generating Configurations for Components to Confluent Cloud, Prefixing Mirror Topics and Consumer Group Names, confluent_private_link_access data source, self-managed encryption keys (also known as bring-your-own-key
