Snowflake’s support for Python stored procedures allows data engineers and scientists to leverage Python’s vast ecosystem directly within Snowflake. This capability enables advanced analytics, custom data processing, and seamless integration of Python libraries. One particularly powerful feature is the ability to import and use Python files (.py) directly within a […]
Read More
In today’s data-driven enterprises, managing access control is critical to ensure that sensitive data remains secure while still being accessible to the right individuals. As businesses scale, the number of users, roles, and warehouses in Snowflake can grow exponentially. Hence it increasingly challenging to keep track of who has access […]
Read More
Imagine a scenario where a business needs to automatically generate and send customer invoices at the end of each month. The invoices are generated from transaction data store in Snowflake, and customer receives an email with invoice attach as a CSV file. This use case requires a solution that can […]
Read More
In our recent projects, we encountered significant issues related to data synchronization across multiple business units. Different departments, each managing their own data structures, often introduced new columns or modified existing ones in their tables. These frequent changes led to numerous challenges: Inconsistent Data Integration: The varying schemas created difficulties […]
Read More
In the modern data landscape, the common challenge is efficiently handling and integrating new data from various files into data warehouses. This blog post explores a real-world use case for a Snowflake stored procedure designed to dynamically create tables based on CSV file headers, load data, and provide insightful feedback […]
Read More
Previously, data engineers used Kinesis Firehose to transfer data into blob storage (S3) and then load it into Snowflake using either Snowpipe or batch processing. This introduced latency in the data pipeline for near real-time data processing. Now, Amazon Kinesis Data Firehose (Firehose) offers direct integration with Snowflake Snowpipe Streaming, […]
Read More
