Today we’re excited to announce an expansion of our partnership with Microsoft to deliver a seamless and efficient interoperability experience between Snowflake and Microsoft Fabric OneLake, in preview later this year. This will enable our joint customers to experience bidirectional data access between Snowflake and Microsoft Fabric, with a single copy of data with OneLake in Fabric. Organizations using both platforms will be able to do so more cost-effectively, rather than building pipelines or maintaining copies of data in each platform. This interoperability is possible because of Snowflake’s and Microsoft’s commitment to supporting the industry’s leading open standards for analytical storage formats — Apache Iceberg and Apache Parquet.
“Our expanding partnership with Snowflake demonstrates our commitment to ensure customers have the most complete and seamless experience to do more with their data. We are enabling this experience by accelerating our adoption of open standards, collaborating with industry leading partners, and making it easier for customers to rapidly benefit from the innovations we are bringing to the market.”
Arun Ulag, Corporate Vice President of Azure Data at Microsoft
This new integration means that organizations can make more cost-effective use of their data. For example, data from Snowflake can be more seamlessly integrated with Microsoft 365 apps, like Teams, Excel, PowerPoint and Outlook, via Fabric. And data from Fabric OneLake can be extended to Snowflake’s Data Cloud for cross-cloud AI, applications, sharing and collaboration, and advanced analytics, among many other workloads.
In order to deliver these benefits, Snowflake and Fabric will add these capabilities for customers now and later this year:
Let’s walk through an example of how this new integration works. Suppose you’re working on a customer loyalty project, but a loyalty members table is managed by a team in Snowflake while sales and support data is in Microsoft Azure. Rather than maintaining copies of data in each platform, you can use either to access a single copy of all data stored in Fabric OneLake.
First, create an external volume in Snowflake that points to your Fabric OneLake account. This is where Snowflake will store loyalty member data in Iceberg format. When you create this Iceberg table from Snowflake, you can specify to use Snowflake as the Iceberg catalog and Fabric OneLake as the external volume. As Snowflake operates on the tables and writes data, OneLake will automatically convert the Iceberg metadata to Delta Lake format, without rewriting the Parquet files, so that Fabric engines can query the same tables.
Similarly, Fabric OneLake enables Snowflake to read all OneLake data in Iceberg format, for consumption by Snowflake’s engine. This means you can create an Iceberg table from Snowflake that points to the Iceberg data in OneLake, which can then be queried. For example, you can use Snowflake Cortex AI LLM functions to calculate sentiment of support case notes or summarize call transcripts.
Snowflake and Microsoft will be developing this new integration collaboratively over the coming months. Stay tuned for more announcements at Snowflake’s Data Cloud Summit on June 3–6 in San Francisco. However, Iceberg Tables in Snowflake are currently available in public preview. If you haven’t already, you can try Iceberg Tables with this quickstart guide, or watch a demo to see how Iceberg is integrated with the Snowflake platform, like Cortex AI LLM functions.
The post Snowflake Expands Partnership with Microsoft to Improve Interoperability Through Apache Iceberg appeared first on Snowflake.
Privacy is no longer a growing requirement for doing business — it’s the new status quo. The stakes for not […]
There’s no question which technology everyone’s talking about in retail. Generative AI continues to promote incredible levels of interest with […]
Credit: Hadlee Simons / Android Authority The Personal Safety app on Android will soon get a new option to add […]
Our services help both the big and small organisations in the identification of security breaches and provide outclass solutions to prevent any potential harm.