At Ignite, Microsoft enhances its cloud database, warehouse and lake providers

As Microsoft’s Ignite digital occasion kicks off at the moment, the corporate is saying a spread of latest capabilities in its database platforms in addition to inside Azure Synapse Analytics, its mixture cloud information warehouse/information lake service. One huge announcement is the preview of a brand new model of SQL Server, which I’ve lined in a separate publish. This publish will cowl the introduced goodies in Azure Cosmos DB, Azure Database for MySQL and PostgreSQL, Azure Managed Occasion for Apache Cassandra, and Azure Synapse Analytics.

Additionally learn: Microsoft’s cloud-connected on-prem database: SQL Server 2022 rolls out in personal preview

Open supply database, the SQL

Microsoft launched its Azure Database for MySQL and PostgreSQL providers to common availability (GA) in 2018. When these providers started their preview the 12 months earlier than, the notion that Microsoft itself would assist open supply platforms that compete with its personal SQL Server platform was huge information. It made sense, although; if it is one thing Microsoft’s clients need, and it drives cloud compute and storage income, it is in Microsoft’s curiosity.

Additionally learn: Microsoft cloud to SQL Server: Let’s have an open (supply) relationship

Newsworthiness apart, although, the preliminary choices had been considerably barebones. That is typically the case with a 1.0 launch, however Microsoft has steadily improved the choices, together with including a hyperscale possibility on the Postgres aspect, made potential by the corporate’s 2019 acquisition of Citus Knowledge. From that time, it was clear that Microsoft needed to go additional than simply providing “vanilla” MySQL and Postgres.

Additionally learn: Microsoft buys Citus Knowledge

As we speak, Microsoft is enhancing the providing with a deployment possibility, which it is dubbing Versatile Server. Because the identify would suggest, the brand new possibility fills a middle-ground place between the default Single Server providing, which is entry-level, and the Hyperscale providing, which is for big scale-out purposes. Versatile Server gives high-availability choices to assist guarantee zero information loss, a burstable compute tier, and built-in capabilities for value optimization — together with the flexibility to cease the server (and billing) when not in use. Versatile Server can be made usually out there this month.

On the NoSQL aspect, in the meantime, Microsoft is transferring its Azure Managed Occasion for Apache Cassandra to GA, efficient at the moment. Cassandra is an open supply, column household retailer NoSQL database, akin to Apache HBase and Google Cloud Bigtable. The Azure Cassandra service consists of an automated synchronization characteristic that may sync information between with clients’ personal Cassandra situations, on-premises and elsewhere.

Additionally learn: Microsoft Ignite Knowledge and Analytics roundup: Platform extensions are the important thing theme

Cosmos-ic enhancements

Curiously, the Managed Occasion for Cassandra service is managed by the Cosmos DB workforce — not the Azure Database people. However contemplating Cosmos DB is itself a NoSQL database and presents the Cassandra API as one in all its many supported interfaces, it begins to make sense. For purchasers operating Cassandra on-premises who wish to transfer to the cloud, Cosmos DB could in the end be a worthy vacation spot. However the compatibility provided by real Cassandra could make the cloud journey a much less bumpy one earlier than additional migration to Cosmos DB, ought to the time for that come.

Additionally learn: Microsoft debuts Azure Cosmos DB, a superset of its DocumentDB service

Cosmos DB additionally presents an SQL interface and is saying at the moment that partial doc updates utilizing that interface — among the many most-requested options by clients, in keeping with Microsoft — is now a GA characteristic. So too are customizable provisioned throughput spending limits and cost-savings alerts in Azure Advisor. Typically, essentially the most dev-friendly options are those that forestall unintended spending.

Crossing the Synapse

In my publish on SQL Server 2022, I present particulars on Azure Synapse Hyperlink for SQL Server, which gives for replication of knowledge from SQL Server into Synapse-dedicated SQL swimming pools. In its personal proper, this is a vital advance for Azure Synapse, however Microsoft is saying different enhancements at the moment as properly.

Key amongst these is the mixing and adaptation of Azure Knowledge Explorer (ADX) — a platform for real-time evaluation of giant volumes of log/machine/telemetry and different time sequence information — into the Azure Synapse platform. Simply as Azure Knowledge Manufacturing unit capabilities had been carried out as Synapse pipelines, ADX capabilities are being built-in as Azure Synapse information explorer. 

Additionally learn: Fastly, Microsoft companion on real-time analytics with Azure Knowledge Explorer

Azure Occasion Hubs Premium, which hits GA at the moment, is one other integration in Azure Synapse. Azure Occasion Hubs is a streaming occasion information platform, conceptually much like Apache Kafka, and might even function in a Kafka API-compatible mode. Its availability as a linked service signifies that Synapse customers can carry out occasion streaming, ingestion, and evaluation proper within the platform — and accomplish that with the reserved compute, reminiscence, and retailer assets provided by the Premium degree of the service.

Microsoft can also be integrating a set of industry-specific database templates into Synapse Studio. Templates for retail, client packaged items, and monetary providers (together with banking, fund administration, property, and casualty insurance coverage) are being added as a preview characteristic, at no extra value.

And on the companion aspect, information administration juggernaut Informatica, contemporary off its IPO, is saying a partnership with Microsoft particularly round Azure Synapse. It is geared toward serving to the 2 firms’ joint clients migrate their Informatica PowerCenter ETL/on-premises information warehouses combos to Informatica’s Clever Knowledge Administration Cloud (IDMC) on Azure and Azure Synapse Analytics. In accordance with Informatica, the providing, out there on the Azure Market, consists of Migration Manufacturing unit for Informatica PowerCenter; entry to cloud information warehousing and cloud information administration consultants from each firms for gratis; monetary incentives for software program {and professional} providers; and the flexibility to amass IDMC through the Azure Market, thus retiring Azure Consumption Dedication spend with an IDMC subscription.

Additionally learn:

No sleep ’til cloud-land

The IDMC-Azure Synapse joint incentive bundle reveals essential enterprise ecosystem adoption and endorsement of the Azure Synapse platform. This reveals Synapse to be an rising {industry} customary, and it additionally reveals cloud information warehousing, analytics and information administration to be the rising new regular.

Add within the enhancements to the cloud-native Cosmos DB, the cloud elasticity options in Versatile Server, the hybrid cloud capabilities of Managed Occasion for Apache Cassandra, and SQL Server 2022’s main cloud-connected slant, and the pattern out of Ignite is crystal clear. Extra workloads are transferring to the cloud, distributors are working laborious to make these strikes smoother for purchasers, and even on-premises database implementations can be cloud-savvy.

Microsoft is a buyer of Brust’s advisory agency, Blue Badge Insights. He’s additionally a Microsoft Knowledge Platform MVP.