Skip to main content

Sept 2023 (version 3.28.0)

Welcome to the latest release of Querybook 🎉.

Following are the top new features we have added during the year 2023 thus far:

  • AI assistant: Support query cell title generation, text-to-sql and query auto fix, powered by LLM.
  • Vector table search: Use natural language to search a table.
  • Data cell/table comment: Users can leave comments for data cells and tables.
  • Query optimization suggestions: Provide a tooltip of query optimization suggestions.
  • User group: Introduce user groups, which can be used as table/datadoc owner/editor.
  • Data element: Introdce a new metadata data element, which provides semantic data meaning and can be assigned to a table column.
  • Stats logging: Add support of stats logging, like number of users, number of api requests and etc.

Feature highlights​

AI Assistant​

The LLM powered AI assistant can help on

  • Query cell title generation
  • Text to SQL
  • Query error auto fix

Please check the guide for more details.

Previously table searching is only keyword based search. Now we introduced vector store plugin and added the support of searching a table by natural language.

Data Cell & Table Comment​

Users can leave comments to a data cell/table or view comments from other people.

Query Optimization Suggestions​

The query editor will provide optimization suggestions for some cases. Here are some predefined one for Presto/Trino

  • distinct count -> approx_distinct
  • like 'a' or like 'b' -> regexp_like(column, 'a|b')
  • union -> union all

You can create you own suggestions by following the example of PrestoOptimizingValidator

Check the PR for more details.

User Group​

We introduced the support of user group. Now a user in querybook can be a single user or a user group. A table could be owned by a user group, or a datadoc can be shared to a user group(haven't implemented, PR in progress).

Data element​

A data element is an atomic unit of data that has precise meaning or precise semantics, like country, age and etc. We added data element as a new metadata, which can be assigned to a table column to provide more meaningful info for the column.

Note: it can only be synced from metastore.

Stats logging​

Add support of stats logging, like number of users, number of api requests and etc. Please check the plugin for more details.

Small Feature Improvements/Bug Fixes​

  • Add username and password authentication for the trino client #1315
  • Add two new plugins: monkey patch plugin and api plugin #1266
  • Fix the display of long table names in search modal #1246
  • Allow data doc deletion from sidebar #1241
  • Ensure meta_info is updated when an exception occurs #1230
  • Add helm deployment guide #1183
  • Add more metadata support #1182
  • Enable mssql transpiling #1178
  • Add ability to cancel dead queries #1159
  • Fix json-bigint hasOwnProperty undefined issue #1129
  • Add frontend context logging #1115
  • Add drag and drop for templated variables #1112

Querybook Team
Pinterest
🚀