Imagine a scenario where you have numerous columns across various tables that require data masking. Rather than applying a masking policy to each column separately, you can streamline the process by grouping all these sensitive columns under a common tag. This approach is commonly known as Tag-based data masking within […]
Read More
In this post, we will explore the process of splitting a large file into smaller ones based on the data count. Recently, we encountered a file in our Blob storage area that contained approximately 20 million records. The client’s requirement is to process this file in Snowflake. While it’s possible […]
Read More
In continuation of my previous Dynamic Tables post, let’s delve into the implementation of SCD2 using Dynamic Tables. I’ve come across several posts suggesting that Dynamic Tables (DT) are excellent replacements for streams and an effective way to implement SCD2. Out of curiosity, I wanted to explore how DT tables […]
Read More
In this post, we will explore a use case involving Dynamic Tables. Imagine a scenario where a customer uploads a feed file to an S3 bucket. A Snowpipe has been set up on the bucket to ingest the file into a Snowflake staging table as soon as a file upload […]
Read More
In a recent development, Snowflake has announced the general availability of a new feature i.e. “Accessibility to data in Amazon S3-compatible storage”. This exciting addition enables you to create external stages for various cloud storage services and devices that are highly and seamlessly compliant with the Amazon S3 REST API […]
Read More
In this blog post, we’ll explore a practical approach to ensure the accuracy of file counts before they’re ingested into Snowflake. In current scenario the source system sends data files to a UNIX environment, which is then utilized by downstream systems. Planning to leverage Snowflake capabilities, Business wants to develop […]
Read More
