Đặng Minh Dũng
5a740901d6
cleanup column_type_mappings ( #17569 )
...
Signed-off-by: Đặng Minh Dũng <dungdm93@live.com >
2022-01-14 11:07:17 +02:00
PApostol
ce92fc152b
Update docstrings in presto.py ( #17623 )
2021-12-02 08:35:25 +02:00
aniaan
5a1c68177e
fix(elasticsearch): time_zone setting does not work for cast datetime expressions ( #17048 )
...
* fix(elasticsearch): cast does not take effect for time zone settings
* test(elasticsearch): add test
* fix(test): fix typo
* docs(elasticsearch): add annotation
* docs(elasticsearch): add time_zone desc
* docs(elasticsearch): fix typo
* refactor(db_engine): change convert_dttm signature
* fix(test): fix test
* fix(es): add try catch
* fix(test): fix caplog
* fix(test): fix typo
2021-11-25 11:58:44 +02:00
Rafał Ganczarek
8da982bc7c
fix(presto): expand data with null item ( #17470 )
...
* fix(presto): expand data with null item
* Fixed pre-commit check
2021-11-21 20:10:35 +02:00
John Bodley
b9ff85d9ea
chore(engine): Translate fractional time grains—requires @superset-ui bump ( #17078 )
...
* chore(engine): Translate fractional time grains
* Bump @superset-ui
Co-authored-by: John Bodley <john.bodley@airbnb.com >
2021-10-12 21:40:48 -07:00
ofekisr
c520eb79b0
refactor: sqllab: move sqllab ralated enumns and utils to more logical place ( #16843 )
...
* refactor move QueryStatus to common
* refactor move apply_display_max_row_limit to sqllab package
* refactor move limiting_factor to sqllab package
* fix pylint issues
2021-09-26 21:15:57 +03:00
John Bodley
1669947bcd
chore(pylint): Reenable too-many-lines check ( #16287 )
...
Co-authored-by: John Bodley <john.bodley@airbnb.com >
2021-09-13 13:22:19 -07:00
Ville Brofeldt
6465ee7dbd
fix(sqla): support for date adhoc filter ( #16634 )
2021-09-09 06:41:50 +03:00
John Bodley
7e4c940314
chore(pylint): Enable useless-suppression check ( #16388 )
...
Co-authored-by: John Bodley <john.bodley@airbnb.com >
2021-08-24 03:58:41 +12:00
John Bodley
0df15bf207
chore(pylint): Reenable import-outside-toplevel check ( #16263 )
...
Co-authored-by: John Bodley <john.bodley@airbnb.com >
2021-08-17 05:20:13 +12:00
John Bodley
6d3e19d857
fix(15403): Re-enable canceling query for Hive and Presto ( #15878 )
...
Co-authored-by: John Bodley <john.bodley@airbnb.com >
2021-07-26 08:04:56 -07:00
John Bodley
ab4e3b9bf9
chore: Enforce Mypy for non-tests ( #15757 )
...
Co-authored-by: John Bodley <john.bodley@airbnb.com >
2021-07-22 06:46:43 +12:00
Beto Dealmeida
31f406a526
feat: API endpoint to validate databases using separate parameters ( #14420 )
...
* feat: new endpoint for validating database parameters
* Rebase
* Remove broken tests
2021-05-12 18:32:10 -07:00
John Bodley
d8bb2d3e62
refactor(db_engine_specs): Removing top-level import of app ( #14366 )
...
Co-authored-by: John Bodley <john.bodley@airbnb.com >
2021-04-28 15:47:32 +12:00
Beto Dealmeida
c7112d1c48
feat: error messages for Presto connections ( #14172 )
...
* chore: rename connection errors
* feat: error messages for Presto connections
* Add unit tests
* Update docs/src/pages/docs/Miscellaneous/issue_codes.mdx
Co-authored-by: AAfghahi <48933336+AAfghahi@users.noreply.github.com >
Co-authored-by: AAfghahi <48933336+AAfghahi@users.noreply.github.com >
2021-04-16 15:49:47 -04:00
Beto Dealmeida
21f973f0bd
feat: error messages when connecting to MSSQL ( #14093 )
...
* feat: error messages when connecting to MSSQL
* Address comments
2021-04-14 10:57:58 -07:00
Beto Dealmeida
c60a93db9c
feat: add extract_errors to Postgres ( #13997 )
...
* feat: add extract_errors to Postgres
* Add unit tests
* Fix lint
* Fix unit tests
2021-04-08 13:24:54 -07:00
Jesse Yang
4789074309
fix(sqla-query): order by aggregations in Presto and Hive ( #13739 )
2021-04-01 18:10:17 -07:00
Nikola Gigić
609c3594ef
feat(explore): Postgres datatype conversion ( #13294 )
...
* test
* unnecessary import
* fix lint
* changes
* fix lint
* changes
* changes
* changes
* changes
* answering comments & changes
* answering comments
* answering comments
* changes
* changes
* changes
* fix tests
* fix tests
* fix tests
* fix tests
* fix tests
* fix tests
* fix tests
* fix tests
* fix tests
* fix tests
* fix tests
* fix tests
* fix tests
* fix tests
* fix tests
* fix tests
* fix tests
* fix tests
2021-03-12 10:36:43 +02:00
rijojoseph07
efeb5a93e6
feat(presto): add support for user impersonation ( #13214 )
...
* changes to support presto impersionation with ldap
* renamed method to match 30 char limit
* import spell check
* added presto impersonation test
* refactored impersionation code to generalize for extension
* moving config_args mutation to the update_connect_args_for_impersonation
* moving config_args mutation to the update_connect_args_for_impersonation
* nits
* refactored update_impersonation_config method name to match lint rule
* reduced comment line length
* black reformats
Co-authored-by: rijojoseph01 <rijo.joseph@myntra.com >
2021-02-22 15:01:33 +02:00
Ricardo Gândara Pinto
51195af4fa
fix: Presto column_type_mappings time and timestamp ( #12861 )
...
* Fix presto column_type_mappings time and timestamp
* Added unit tests
2021-02-01 17:41:57 +02:00
Beto Dealmeida
dcef5e1381
fix: remove explicit cursor closing for BQ ( #12836 )
2021-01-29 14:32:47 -08:00
Beto Dealmeida
877b153331
feat: estimate query cost in Postgres ( #12130 )
...
* feat: estimate query cost in Postgres
* Add example in config
* Fix lint
2020-12-18 16:08:53 -08:00
Bogdan
0396c705d4
chore: Support SET & SHOW commands as read only SQL commands ( #11868 )
...
* Support SET & SHOW commands as read only SQL commands
* Move is_readonly definition into the engine spec
* Rename & use super()
Co-authored-by: bogdan kyryliuk <bogdankyryliuk@dropbox.com >
2020-12-03 10:44:11 -08:00
Jesse Yang
4cfcaebb61
feat: rename TABLE_NAMES_CACHE_CONFIG to DATA_CACHE_CONFIG ( #11509 )
...
* feat: rename TABLE_NAMES_CACHE_CONFIG to DATA_CACHE_CONFIG
The corresponding cache will now also cache the query results.
* Slice use DATA_CACHE_CONFIG CACHE_DEFAULT_TIMEOUT
* Add test for default cache timeout
* rename FAR_FUTURE to ONE_YEAR_IN_SECS
2020-11-13 22:35:10 -08:00
Erik Ritter
fa5dab85c4
feat: more specific presto error messages ( #11099 )
2020-09-29 21:50:58 -07:00
Erik Ritter
0f7e90f1f7
feat: improve presto query perf ( #11069 )
2020-09-28 08:52:00 -07:00
Kasia Kucharczyk
af1e8e8839
fix: enable several pylint rules partially in db_engines_specs module ( #11000 )
...
* Enabled mssql
* Enabling pylint rules in `mysql.py` from `db_engine_specs`:
- added variable to shorten line and enable `line-too-long`
- `import-error` seems not prompting anymore
- specified exception instead broad-except
* Refactored too long line in `oracle.py` from `db_engine_specs`. Enabled too-long-line pylint rule.
* Changed fstring into string `pinot.py` to reenable `f-string-without-interpolation` rule.
* Enabled `unused-import` rule and changed line to adjust to correct number of characters in `db_engine_specs/postgres.py`.
* Enabled unused-import pylint check in `db_engine_specs/presto.py`
* Enabled unused-import pylint check in `db_engine_specs/snowflake.py`
* Enabled unused-import pylint check in `db_engine_specs/sqlite.py`
2020-09-23 10:47:56 -07:00
Ville Brofeldt
bd140e018a
fix(presto): default unknown types to string type ( #10753 )
...
* fix(presto): default unknown types to string type
* lint
2020-09-22 13:16:54 +03:00
Bogdan
19a9bcc9c5
chore: ci Initial hive support ( #10593 )
...
* Initial hive support
* Clone hive setup
* Make hive tests work locally
* Debugging presto failure
* sleep in dataset test
* Address comments
* Address comments
* Pin ipython, exclude new pylint rules
Co-authored-by: bogdan kyryliuk <bogdankyryliuk@dropbox.com >
2020-08-27 09:49:18 -07:00
Ville Brofeldt
9461f9c1e0
fix(db_engine_specs): improve Presto column type matching ( #10658 )
...
* fix: improve Presto column type matching
* add optional callback to type map and add tests
* lint
* change private to public
2020-08-24 22:42:07 +03:00
Erik Ritter
2055ecc1ba
feat: refactor error components and add database issue code ( #10473 )
...
* feat: refactor error components and add database issue code
* Apply suggestions from code review
Co-authored-by: John Bodley <4567245+john-bodley@users.noreply.github.com >
Co-authored-by: John Bodley <4567245+john-bodley@users.noreply.github.com >
2020-08-06 13:22:24 -07:00
Beto Dealmeida
4f678272d6
fix(presto): Handle ROW data stored as string ( #10456 )
...
* Handle ROW data stored as string
* Use destringify
* Fix mypy
* Fix mypy with cast
* Bypass pylint
2020-07-28 16:05:58 -07:00
Erik Ritter
b686004294
feat: add configuration for Presto cursor poll interval ( #10191 )
2020-06-30 08:56:22 -07:00
Ville Brofeldt
b205ce32b0
feat: Add new timegrains and convert_dttm to Druid engine spec ( #10160 )
...
* feat: Add new timegrains and convert_dttm to Druid engine spec
* Add TemporalType enum and fix test case
* Remove DATETIME for athena (original spec)
2020-06-25 12:18:37 +03:00
Will Barrett
8e23d4f369
chore: Upgrade pylint to 2.5.3 and fix most new rules ( #10101 )
...
* Bump pylint version to 2.5.3
* Add a global disable for the most common new pylint error
* Fix a bunch of files containing very few errors
* More pylint tweakage, low-hanging fruit
* More easy stuff...
* Fix more erroring files
* Fix the last couple of errors, clean pylint!
* Black
* Fix mypy issue in connectors/druid/models.py
2020-06-18 14:03:42 -07:00
John Bodley
91517a56a3
style(mypy): Spit-and-polish pass ( #10001 )
...
Co-authored-by: John Bodley <john.bodley@airbnb.com >
2020-06-07 08:53:46 -07:00
Ville Brofeldt
980dd2fd41
pylint: accept specific 2 character names by default ( #9460 )
...
* lint: accept 2 letter names by default
* Address review comments
* Remove e and d from good-names
2020-04-08 20:32:26 +03:00
Ville Brofeldt
ef2ebbd570
Add option to specify type specific date truncation functions ( #9238 )
2020-03-05 07:25:50 +02:00
John Bodley
9f5f8e5d92
[mypy] Enforcing typing for db_engine_specs ( #9138 )
2020-02-17 23:08:11 -08:00
John Bodley
a7e433a512
[mypy] Disallowing implicit optional ( #9150 )
2020-02-16 22:34:15 -08:00
Craig Rueda
607cfd1f29
Moving away from using the root logger everywhere ( #9099 )
...
* Moving away from using the root logger everywhere
* self.logger -> logger
2020-02-07 23:38:48 -08:00
Erik Ritter
922eec2db2
[SQL Lab] Cache function names query ( #9019 )
2020-01-24 16:45:41 -08:00
Erik Ritter
a4b8e0b9e4
[SQL Lab] Add function names to autocomplete ( #9012 )
2020-01-24 11:08:26 -08:00
Grace Guo
93bcace20f
Revert "Make select_star work with SQL Lab views ( #8598 )" ( #8930 )
...
This reverts commit 964e6db8
2020-01-06 12:04:36 -08:00
Rob DiCiuccio
6537d5ed8c
Replace pandas.DataFrame with PyArrow.Table for nullable int typing ( #8733 )
...
* Use PyArrow Table for query result serialization
* Cleanup dev comments
* Additional cleanup
* WIP: tests
* Remove explicit dtype logic from db_engine_specs
* Remove obsolete column property
* SupersetTable column types
* Port SupersetDataFrame methods to SupersetTable
* Add test for nullable boolean columns
* Support datetime values with timezone offsets
* Black formatting
* Pylint
* More linting/formatting
* Resolve issue with timezones not appearing in results
* Types
* Enable running of tests in tests/db_engine_specs
* Resolve application context errors
* Refactor and add tests for pyodbc.Row conversion
* Appease isort, regardless of isort:skip
* Re-enable RESULTS_BACKEND_USE_MSGPACK default based on benchmarks
* Dataframe typing and nits
* Renames to reduce ambiguity
2020-01-03 11:55:39 -05:00
serenajiang
1719c4b5a3
[fix][sqllab] nullable booleans in dataframe ( #8833 )
...
* [fix] nullable booleans in dataframe
* added comment
2019-12-16 09:59:27 -08:00
michellethomas
98a82a0720
Adding error message when there's no partition for a presto table using latest_partition ( #8745 )
2019-12-04 11:03:50 -08:00
Beto Dealmeida
5f4e3adfd2
Pass full response to query_cost_formatter ( #8652 )
...
* Return full info when doing query cost estimation
* Add unit test
* Fix isort
2019-11-26 11:49:19 -08:00
Beto Dealmeida
964e6db800
Make select_star work with SQL Lab views ( #8598 )
...
* Make select_star work with SQL Lab views
* Fix mypy
2019-11-20 13:07:16 -08:00