Snowflake integration #722

gee-senbong · 2026-01-03T05:05:40Z

This PR revises previous PR (#648) to add snowflake integration support.

Command to trigger the script to install Snowflake stored procedure:

python -m nixtla.scripts.snowflake_install_nixtla

CLAassistant · 2026-01-03T05:05:46Z

All committers have signed the CLA.

github-actions · 2026-01-03T05:08:27Z

Experiment Results

Experiment 1: air-passengers

Description:

variable	experiment
h	12
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	12.6793	11.0623	47.8333	76
mape	0.027	0.0232	0.0999	0.1425
mse	213.936	199.132	2571.33	10604.2
total_time	1.0375	1.5482	0.0044	0.0033

Plot:

Experiment 2: air-passengers

Description:

variable	experiment
h	24
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	58.1031	58.4587	71.25	115.25
mape	0.1257	0.1267	0.1552	0.2358
mse	4040.21	4110.79	5928.17	18859.2
total_time	0.7791	0.9708	0.0037	0.0032

Plot:

Experiment 3: electricity-multiple-series

Description:

variable	experiment
h	24
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	178.293	268.13	269.23	1331.02
mape	0.0234	0.0311	0.0304	0.1692
mse	121589	219485	213677	4.68961e+06
total_time	1.6286	2.4256	0.0046	0.0042

Plot:

Experiment 4: electricity-multiple-series

Description:

variable	experiment
h	168
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	465.497	346.972	398.956	1119.26
mape	0.062	0.0436	0.0512	0.1583
mse	835021	403760	656723	3.17316e+06
total_time	2.3692	1.7546	0.005	0.0044

Plot:

Experiment 5: electricity-multiple-series

Description:

variable	experiment
h	336
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	558.673	459.757	602.926	1340.95
mape	0.0697	0.0565	0.0787	0.17
mse	1.22723e+06	739114	1.61572e+06	6.04619e+06
total_time	1.4324	0.8476	0.005	0.0044

Plot:

gee-senbong · 2026-01-03T13:44:21Z

nixtla/scripts/snowflake_install_nixtla.py

+        MOD(HASH(unique_id), :MAX_BATCHES) AS gp,
+        unique_id,
+        ds,
+        OBJECT_CONSTRUCT_KEEP_NULL(*) AS data_obj


OBJECT_CONSTRUCT_KEEP_NULL is used here to handle the case when the historical exog variable has null value. Previous implementation:

nixtla/nixtla/scripts/snowflake_install_nixtla.py

Line 112 in e43d352

(SELECT MOD(HASH(unique_id), :MAX_BATCHES) AS gp, unique_id, ds, y, object_construct(*) AS obj FROM TABLE(:INPUT_DATA)) a,

gee-senbong · 2026-01-03T13:47:28Z

nixtla/scripts/snowflake_install_nixtla.py

+
+╔══════════════════════════════════════════════════════════════════════════════╗
+║                    🎉 Ready to start forecasting!                            ║
+╚══════════════════════════════════════════════════════════════════════════════╝


Sample scripts are generated to show user how to call the stored procedures using the generated sample tables.

JQGoh

Great to know that your demo video replicates the earlier behavior, a good start!

JQGoh · 2026-01-05T04:09:00Z

Makefile

+
+format:
+	@echo "Running black formatter on staged files..."
+	@git diff --cached --name-only --diff-filter=ACMR | grep '\.py$$' | xargs -r uv run black


Suggestion: Deployment execution command like
python -m nixtla.scripts.snowflake_install_nixtla can be registered as part of Makefile command.

JQGoh · 2026-01-05T04:12:09Z

nixtla/scripts/snowflake_install_nixtla.py

+CREATE OR REPLACE NETWORK RULE {ds_prefix}nixtla_network_rule
+MODE = EGRESS
+TYPE = HOST_PORT
+VALUE_LIST = ('api.nixtla.io');


Please help to make this an option that user can customize the domain name, in case we want to use a value other than 'api.nixtla.io'

JQGoh · 2026-01-05T04:24:59Z

nixtla/scripts/snowflake_install_nixtla.py

+```
+"""
+
+PACKAGES = [


Suggest that the essential packages can be read from the pyproject.toml and on top of that, we add the additional snowflake required dependencies.

The objective is that if Nixtla client has newly introduced dependency, we can automatically consider them than updating this manually for snowflake integration.

This is exactly the thing that didn't work in snowflake. Snowflake running environment is extremely picky on libraries, it doesn't support many of them, so we have to carefully pick the ones. I spent the most time to figure out this list when I worked on this. But @gee-senbong feel free to try what @JQGoh suggests. Maybe it's much easier to work with now.

goodwanghan · 2026-01-06T01:22:49Z

Makefile

+
+format:
+	@echo "Running black formatter on staged files..."
+	@git diff --cached --name-only --diff-filter=ACMR | grep '\.py$$' | xargs -r uv run black


i think we should move to uv format but these two new commands are good to add.

Will update this to use uv format.

gee-senbong added 4 commits December 28, 2025 10:05

Add snowflake_install_nixtla.py script from feat/snowflake branch

b668e99

Refactor the script & fix errors

9610e16

Add anomaly dections & update sample datasets

219b70e

Update forecast with hist exog variables support

24cd280

Cleanup

c9b61cf

gee-senbong commented Jan 3, 2026

View reviewed changes

JQGoh reviewed Jan 5, 2026

View reviewed changes

goodwanghan reviewed Jan 6, 2026

View reviewed changes

gee-senbong and others added 12 commits January 7, 2026 20:17

Update Makefile

eff9378

Store base_url as secret & customize api_host

60ab059

Update Makefile

09ba29a

Add confidence intervals & integration tests

ab8e210

Cleanup codes

f68cc4a

Fix integration tests

9a9f001

Revise snowflake integration tests

af13a60

Added Snowflake environment variables to .github/workflows/pytest.yml

8712f80

Fix integration tests

527c186

Add uuid to snowflake assets

0e58251

Use different nixtla API key

176ee90

Resolve long paths in Windows

245981b

gee-senbong force-pushed the feat/snowflake-v2 branch from af579ec to 245981b Compare January 8, 2026 12:22

gee-senbong added 2 commits January 8, 2026 22:08

Constraint narwhals>=2.11.0

0b174cd

Update pandas version constraint

5b1f7b4

Snowflake integration #722

Are you sure you want to change the base?

Snowflake integration #722

Uh oh!

Conversation

gee-senbong commented Jan 3, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

CLAassistant commented Jan 3, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Jan 3, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Experiment 1: air-passengers

Description:

Results:

Plot:

Experiment 2: air-passengers

Description:

Results:

Plot:

Experiment 3: electricity-multiple-series

Description:

Results:

Plot:

Experiment 4: electricity-multiple-series

Description:

Results:

Plot:

Experiment 5: electricity-multiple-series

Description:

Results:

Plot:

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

JQGoh left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

gee-senbong commented Jan 3, 2026 •

edited

Loading

CLAassistant commented Jan 3, 2026 •

edited

Loading

github-actions bot commented Jan 3, 2026 •

edited

Loading

JQGoh left a comment •

edited

Loading