ali-ramadhan/timescaledb-insert-benchmarks
View on GitHub ↗ ★ 18 Python
Benchmarking inserting a ~trillion rows of weather data into TimescaleDB
3 mentions on Hacker News by 1 person: 0 stories, 3 comments · first 2024-04-17 · latest 2024-04-17
20082026
-
The data is publicly available! The data is freely available from the Climate Change Service [1] which has a nice API but download speeds can be a bit slow. You'll have to sign up for this. NCAR's Research Data Archive [2] provides some of…
comment by PolarizedPoutin · 2024-04-17 · in Loading a trillion rows of weather data into TimescaleDB -
The full dataset is quite huge (~9 petabytes and growing) out of which I'm using just ~8 terabytes. The data is freely available from the Climate Change Service [1] which has a nice API but download speeds can be a bit slow. NCAR's…
comment by PolarizedPoutin · 2024-04-17 · in Loading a trillion rows of weather data into TimescaleDB -
The full dataset is quite huge (~9 petabytes and growing) out of which I'm using just ~8 terabytes. Still quite big to upload. The data is freely available from the Climate Change Service [1] which has a nice API but download speeds can be…
comment by PolarizedPoutin · 2024-04-17 · in Loading a trillion rows of weather data into TimescaleDB