Parallel Snowflake Jobs with Snowpark: The Challenge: Sequential Bottlenecks Imagine you’re loading sales data from multiple regions into Snowflake. Your pipeline needs to: Load North American sales data (2 minutes) Load European sales data (2 minutes) Load Asian sales data (2 minutes) Update high-value customer segments (1 minute) Update medium-value […]
Read More
In real enterprise data landscapes, we often receive feeds from multiple source systems — CRM, ERP, HR, legacy Oracle apps, APIs, Excel exports, and more. Each system records timestamps in its own way. When these systems are merged into a single CSV feed, the timestamp column becomes inconsistent. Therefore, a […]
Read More
Fetch Live Data in Snowflake with External Access — because modern data platforms no longer operate in isolation. They thrive on real-time external data that helps drive faster, smarter decisions. Whether it’s weather forecasts, market trends, or currency exchange rates, organizations today need the ability to pull live insights directly […]
Read More
Snowflake provides a rich set of features for identity management such as password policies, MFA, SSO integration, and role-based access control. However, one limitation we often face is automating password expiry notifications in Snowflake, since the platform does not natively notify users when their password is about to expire. In […]
Read More
The era of AI in the data warehouse is here — and Snowflake’s Cortex makes it easier than ever to bring Large Language Model (LLM) capabilities directly to your data without moving it outside the Snowflake ecosystem. In this blog, I want to share how I built a Streamlit-powered AI […]
Read More
dbt Tests in Snowflake: Override Failure Tables + Email Alerts: Imagine you’re running a retail analytics pipeline on Snowflake. Every night, customer orders are loaded from multiple source systems into your Orders table. On one day, business users report that the dashboard is showing negative order amounts and orders dated […]
Read More
