Claude Code
1773531807
fix(bigquery): limit result set size to prevent browser memory crashes
...
Implement memory-aware progressive fetching in BigQuery's fetch_data
method. Large result sets (950+ MB) previously crashed Chrome by loading
everything into memory at once. The fix samples an initial batch to
estimate row size, then fetches only as many rows as fit within the
BQ_FETCH_MAX_MB config limit (default 200 MB). A warning toast is shown
to users when results are truncated.
This is always-on with no feature flag -- operators control the budget
via the BQ_FETCH_MAX_MB config constant.
Originally by @ethan-l-geotab in apache#36387.
Co-authored-by: ethan-l-geotab <ethanliong@geotab.com >
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com >
2026-03-11 13:20:26 -07:00
Elizabeth Thompson
e9b494163b
refactor(db): use Dialect instead of Engine in select_star to avoid SSH tunnels ( #35540 )
...
Co-authored-by: Claude <noreply@anthropic.com >
2026-02-02 10:26:35 -08:00
Beto Dealmeida
cb24737825
feat(bigquery): show materialized views ( #34766 )
2025-08-26 11:21:43 -04:00
Beto Dealmeida
a26e1d822a
chore: remove sqlparse ( #33564 )
2025-06-04 19:31:41 -04:00
Beto Dealmeida
e4b3ecd372
feat: push predicates into virtual datasets ( #31486 )
2025-01-08 22:11:28 -05:00
Maxime Beauchemin
e51b95ffa8
chore: enforce more ruff rules ( #31447 )
...
Co-authored-by: Elizabeth Thompson <eschutho@gmail.com >
2024-12-18 17:41:34 -08:00
Beto Dealmeida
4b59e42d3f
chore: improve mask/unmask encrypted_extra ( #29943 )
2024-08-22 16:45:32 -04:00
Beto Dealmeida
8e15d4807f
chore: s/MockFixture/MockerFixture/g ( #29160 )
2024-06-10 12:35:07 -04:00
Eyal Ezer
07b2449bd7
refactor: Unify all json.(loads|dumps) usage to utils.json ( #28702 )
...
Co-authored-by: Eyal Ezer <eyal.ezer@ge.com >
2024-05-28 14:17:41 -07:00
Beto Dealmeida
5da6d2bd88
feat: add support for catalogs ( #28416 )
2024-05-16 12:49:31 -04:00
Beto Dealmeida
6cf681df68
feat(SIP-95): new endpoint for table metadata ( #28122 )
2024-04-25 12:23:49 -04:00
Maxime Beauchemin
2d63722150
chore: set up ruff as a new linter/formatter ( #28158 )
2024-04-24 17:19:53 -07:00
Beto Dealmeida
26d8077e97
chore: improve SQL parsing ( #26767 )
2024-03-13 18:27:01 -04:00
Hugh A. Miles II
93e1db4bd9
fix: save columns reference from sqllab save datasets flow ( #24248 )
2023-06-20 13:54:19 -04:00
Ville Brofeldt
cd6fc35f60
chore(db_engine_specs): clean up column spec logic and add tests ( #22871 )
2023-01-31 15:54:07 +02:00
Antonio Rivero Martinez
60a617eaba
fix(bigquery): Properly display errors for BigQuery DBs ( #22349 )
2022-12-07 13:34:30 -05:00
EugeneTorap
7bc5f04368
chore: Bump bigquery libs ( #21466 )
2022-12-02 12:48:36 +02:00
Antonio Rivero Martinez
95b4c7b7fe
chore(bigquery): Add extra logging for BigQuery exceptions so we can have better insight on exceptions ( #22024 )
2022-11-09 22:56:08 -05:00
Elizabeth Thompson
ef78ec6b30
fix: catch error when masking encrypted extra is none ( #21570 )
2022-10-02 19:49:01 -07:00
Beto Dealmeida
34a79add04
feat: filter parameters from DB API ( #21248 )
2022-09-02 11:50:04 -07:00
Beto Dealmeida
7e501cd816
fix: BigQuery get_parameters_from_uri ( #20966 )
2022-08-03 17:27:40 -07:00
Jesse Yang
7e836e9b04
test: autouse app_context in unit tests ( #20911 )
2022-08-02 15:42:50 -07:00
Beto Dealmeida
83a2f8346e
chore: enable BQ tests ( #17017 )
2021-10-14 08:07:47 -07:00
Beto Dealmeida
c993c5845f
fix(BigQuery): explicitly quote columns in select_star ( #16822 )
...
* fix (BigQuery): explicitly quote columns in select_star
* Fix test
* Fix SELECT * in BQ
* Add unit tests
* Remove type changes
2021-10-06 07:43:32 -07:00
