Modernize SQL Server with S3 Data Lake

SQL server data warehouse environments are growing rapidly with organizations seeing their relational and nonrelational data proliferate exponentially on-premises, in the cloud, at the edge, and in hybrid environments. Traditional storage infrastructure solutions cannot keep up with the required scale and can get expensive very quickly.

With SQL Server 2022, Microsoft introduces the capability to use a cloud data warehouse architecture on-prem by connect to S3-compatible object storage such as Cloudian HyperStore. HyperStore is validated to run SQL Server workloads for external tables ingesting data directly from S3 data lakes built on HyperStore. It also confirmed for use to back up native SQL Server tables for data protection purposes.

Extend Azure Stack HCI with Cloudian S3

Many organizations face the challenge of finding a hybrid cloud solution that meets their hosting needs and provides an on-ramp to cloud services—all with high performance and low cost. Enterprises need a turnkey hyper-converged solution including compute, storage, networking, and virtualization.

Azure Stack HCI is a hyper-converged infrastructure host platform from Microsoft delivered as an Azure service that provides the latest security, performance, and feature updates through an Azure subscription. Customers can consolidate all primary workloads on Azure Stack HCI and manage them centrally. Cloudian HyperStore complements this with fast, cost-effective S3 object storage ideal for data lakes of structured or unstructured data in hybrid deployments.

Modernize SQL Server with S3 Data Lake

Cloudian HyperStore running on SQL Server 2022*

Microsoft

Challenges

SQL server data warehouse environments are growing rapidly with organizations seeing their relational and nonrelational data proliferate exponentially on-premises, in the cloud, at the edge, and in hybrid environments. The current architecture based on traditional storage infrastructure solutions cannot keep up with the required scale and can get expensive very quickly. Enterprise customers are increasingly looking at the cloud data warehouse model to modernize their data warehousing environment and overcome the current challenges that range from scalability and flexibility to cost in order to gain a business advantage.

Solution

With SQL Server 2022, Microsoft introduces the capability to use a cloud data warehouse architecture on-prem. SQL Server 2022 has been enhanced with a new S3 connector which uses the S3 REST API to connect to any S3-compatible object storage. Cloudian’s HyperStore solution with native S3 for on-prem or in the cloud, provides customers a complete solution with limitless scalability, and integrates seamlessly with SQL server 2022. HyperStore is fully validated to run SQL Server workloads for external tables ingesting data directly from S3 data lakes built on HyperStore, as well as a solution to backup native SQL Server tables for data protection.

SOLUTION BENEFITS

  • Cloud-like – Modernize your data warehousing solution and get the flexibility of the cloud with scalability to exabytes
  • Disaster Recovery– Ensure uptime with fully-managed DR within HyperStore
  • S3 API- connect to any provider of S3- compatible object storage, example HyperStore
  • Performance- Accelerate query performance and tuning with no code changes required
  • Data protection – Use immutable ledger to protect data from tampering

USE CASES

  • Modern Data Warehousing with S3 Data Lake – High-performance, lowcost all-flash storage available
  • Backup / Restore SQL Server data to S3 for Data Protection

Keep Reading

Hybrid Cloud Deployments with Azure Stack HCI and Cloudian HyperStore

S3-compatible cloud storage to extend Azure Stack solution

Microsoft

Challenges

Moving to the hybrid cloud is a journey, and many organizations face the challenge of finding an infrastructure solution that both meets their specific hosting needs and provides an optional on-ramp to cloud services—all while offering excellent performance at an affordable price.

Hyper Converged Infrastructure (HCI) is rapidly becoming the predominant architecture for hybrid cloud deployments. Companies today are faced with inherent complexity, inefficient silos, forklift scaling, and painful management of legacy infrastructure. IT administrators need a new comprehensive set of software-defined platform services to enable greater efficiency of hybrid cloud assets and HCI has helped in meeting these challenges.

Solution

Azure Stack HCI is a host platform built on an Azure Arc enabled infrastructure. It is based on a hyperconverged architecture from Microsoft delivered as an Azure service that provides the latest security, performance, and feature updates through an Azure subscription. Customers can consolidate all primary workloads on Azure Stack HCI and manage them centrally. Cloudian’s HyperStore provides a cost-effective, onpremises object storage solution that integrates seamlessly with Azure Stack HCI, allowing customers to extend the Azure HCI solution seamlessly for hybrid cloud deployment. Available to run directly on the Azure Stack platform or in a standalone setting, HyperStore is designed to meet the need for large, secure, highly resilient and flexible storage environments.

Azure Stack HCI Diagram

SOLUTION BENEFITS

  • Turnkey hyperconverged solution: Compute, storage, networking, and virtualization
  • Unified view of data: A single namespace across locations eliminates management workload and complexity
  • Disaster Recovery: Ensure uptime with fully managed DR within HyperStore
  • Industry-leading security, including encryption for data at rest and in motion
  • Seamless integration: HyperStore deployed as one or more VMs and as an external cluster
  • Multi / Hybrid Cloud: Tier seamlessly to public or private cloud

Keep Reading