During this post we will discuss about common data format issue. Consider the scenario during the initial phase we have agreed with business on the feed file format. As per the agreement a fixed “,” delimited file would be provided by business. Based on the defined file format we create […]
Read More
Copy AWS S3 to Gen2 to Snowflake: During the previous post we have migrated data from S3 to ADLS Gen2.Feed file from S3 are now available in Azure Storage. To continue our use case, we will load data from Gen2 to Snowflake. To start with We will use existing Gen2 […]
Read More
During this two part series we will discuss an interesting use case. We will try to Copy the data from AWS S3 to ADLS Gen2. Once the data in ADLS ingest the data into Snowflake. Now a days Multicloud architectures have become popular for enterprise applications. enterprise leverages multiple public […]
Read More
During this post we will discuss about how to troubleshoot Snowpipe data load error. As we know Snowpipe automates the process by enabling the data loading from files as soon as they’re available in a stage. But sometimes we come into the situation where Snowpipe executes successfully while records are partially […]
Read More
During this post we will talk about Configure Snowflake Storage Integration with AZURE. Currently I have started learning Snowflake in conjunction with Azure. Very first thing comes how to create secure integration between SF and Azure. As part of learning process we have established a storage integration so that we […]
Read More
During this post we will discuss about AUTO_REFRESH property on External tables. We know in an external table, the data stores in files in an external stage. External tables are read-only, therefore no DML operations can be perform on them. As per our requirement we receive feed file holds 5M […]
Read More
