Recently my colleague Aman and I were discussing a challenge that we were facing in our project: How can we track DDL (Data Definition Language) changes made to tables in Snowflake?. We needed a way to monitor schema modifications, not just to capture what changed but also when those changes […]
Read More
Pandas, a popular Python library, is a fantastic tool for small to moderately sized data, but it struggles with large-scale datasets. Snowpark, combined with Modin, offers a powerful alternative by enabling scalable, distributed operations directly in Snowflake’s cloud infrastructure. This blog will explore the key differences between Pandas DataFrames and […]
Read More
In this post, we’ll explore the application of masking policies on external tables in Snowflake. While masking policies are commonly implemented on permanent tables, there are scenarios where sensitive data may reside in external sources, such as files in S3, which do not need to be fully ingested into Snowflake. […]
Read More
In this use case, a financial services company has decided to migrate its data warehouse from Oracle to Snowflake. The migration involves not only migrating the data from Oracle to Snowflake but also replicating all views in Snowflake. After successfully migrating several views, the data engineering team noticed discrepancy between […]
Read More
Snowflake’s support for Python stored procedures allows data engineers and scientists to leverage Python’s vast ecosystem directly within Snowflake. This capability enables advanced analytics, custom data processing, and seamless integration of Python libraries. One particularly powerful feature is the ability to import and use Python files (.py) directly within a […]
Read More
In today’s data-driven enterprises, managing access control is critical to ensure that sensitive data remains secure while still being accessible to the right individuals. As businesses scale, the number of users, roles, and warehouses in Snowflake can grow exponentially. Hence it increasingly challenging to keep track of who has access […]
Read More
