Leading Swiss Financial Institution Deploys Cloudian Storage for Hadoop Big Data Archive
PostFinance, a digital innovation leader in the Swiss banking world, wanted a robust data archive and state-of-the-art storage solution for its big data platform. After evaluating the top storage vendors, the company chose Cloudian’s object storage platform for its scalability and cost advantages and then quickly realized the benefits Cloudian could provide in other use cases.
The Challenge of Managing Big Data
Building on a storied 100-year history, PostFinance today provides financial services to three million personal and business customers. One of its top goals is creating an ideal customer experience across the digital and physical worlds. The company uses Hadoop/Apache Spark as the foundation for its big data analytics and found that traditional block and file storage couldn’t provide the cost-effective scalability needed for storing this data.
“We decided we needed an object storage solution,” says Andre Kocher, Senior Systems Engineer at PostFinance. “Starting with a list of major storage vendors, we conducted a thorough selection process and ultimately chose Cloudian.”
Cloudian’s limitless scalability, compelling TCO benefits, and full S3 compatibility were key differentiators.
Working with Infoniqa, a leading Swiss integrator, PostFinance deployed Cloudian’s HyperStore object storage appliances in its two data centers, along with Cloudian HyperFile to support file services from the HyperStore platform. Data protection is provided across the data centers through Cloudian’s integrated policy-based data replication.
“The installation was very smooth, and after testing the Cloudian solution with various applications, we put it into production a couple months ago,” says Kocher.
A Modern Storage Foundation for Multiple Use Cases
PostFinance’s first priority was integrating Cloudian HyperStore into the big data platform and moving data from HDFS to the Cloudian object storage. The company is already seeing the benefits.
“Cloudian’s integrated data protection means we don’t need a separate backup process and backup software licenses for the data,” reports Kocher. “This will save us money on our backup infrastructure over time.”
In addition to the big data use case, PostFinance is using Cloudian as the storage platform for a 100 million file document repository and as an important part of the archive solution.
“We wanted to move away from a traditional file-based storage system to a more modern, flexible architecture, and Cloudian is an ideal way to do so,” says Kocher.
PostFinance is also exploring other use cases, including migrating log data (Splunk) from traditional block storage to Cloudian, employing Cloudian HyperStore as the second tier Splunk data platform. In addition, the company is considering a potential Storage-as-a-Service offering for externally hosted partner applications, providing shared S3-compatible storage from the Cloudian system.
“We’ve already run proof-of-concept tests with other S3-compatible applications and been very pleased with the results,” says Kocher. “By next year, we expect to add more applications and have up to 1 PB of data under Cloudian management, making it a key enabler of our business moving forward.”
Needed scalable storage for Hadoop big data archive
- 12 Cloudian HyperStore appliances, distributed across two locations
- Cloudian HyperFile software for file connectivity
- Hadoop interoperability
- Limitless scalability
- Cost savings of up to 70% vs. traditional block and file storage
- Full S3 compatibility
- Support for file- and object-based data
- Multi-application support under a single global namespace
“We wanted to move away from a traditional file-based storage system to a more modern, flexible architecture, and Cloudian is an ideal way to do so.”
Senior Systems Engineer