Skip to content

Releases: byzer-org/byzer-lang

Byzer-lang v2.3.3

08 Sep 05:15
Compare
Choose a tag to compare

Byzer-lang 2.3.3 发布声明

发布时间 2022-09-08
很高兴地宣布,今天我们正式发布了 Byzer(Byzer-lang) 2.3.3 版本,提供了更加灵活且稳定的 Byzer 引擎。

优化改进

缺陷修复

安全修复

下载使用

下载 Byzer-lang 2.3.3 安装包,请点击下方链接获取:
https://download.byzer.org/byzer/2.3.3/
安装部署指南请查看手册: Byzer引擎部署指引

反馈

如果您遇到疑问或者问题,请到 byzer-lang 项目的 Issue 里留言,
或通过邮件联系 PMC Member:[email protected]
欢迎大家积极反馈使用体验与遇到的问题,共同参与社区建设。

致谢

感谢在 Byzer-lang 2.3.3 版本中做出贡献社区小伙伴们(排名不分先后):WilliamZhu,hellozepp,jiachuan.zhu,Zhengshuai PENG,ckeys,Lindsaylin, fishcus, Admond Guo, wangcheng15, wuzhim

——————————————————————————————————————————————————

Byzer-lang 2.3.3 Release Note

Release Date: 2022-09-08
We are pleased to announce that today we officially released the Byzer(Byzer-lang) 2.3.3 version, which provides a more flexible and stable Byzer engine.

Enhancement

Bugfix

Downloads

To download the Byzer binary installation package, click the link below:
https://download.byzer.org/byzer/2.3.3/

Feedback

If you meet any problem, please submit an issue in project Byzer-lang
Or contact PMC Member:[email protected]
Welcome data developers to join and build community ecology.

Acknowledgments

Thanks to those who contributed code to Byzer-lang 2.3.3 (the following ranks are in no particular order): WilliamZhu,hellozepp,jiachuan.zhu,Zhengshuai PENG,ckeys,Lindsaylin, fishcus, Admond Guo, wangcheng15, wuzhim

Byzer-lang v2.3.2

26 Jul 14:03
Compare
Choose a tag to compare

Byzer-lang 2.3.2 发布声明

发布时间 2022-07-27
很高兴地宣布,今天我们正式发布了 Byzer(Byzer-lang) 2.3.2 版本,提供了更加灵活且稳定的 Byzer 引擎。

主要内容更新

在本次的版本中,我们对 Data Summary ET 进行了一些修复与能力扩充:

  1. 在计算 Quantile 数值的时候,支持对空值的过滤
  2. DataSummary ET 中唯一值(distinct count)比例的计算使用 approx_count_distinct 时会存在一定的误差。因此增加 approx 去计算唯一值,设置 approx 计算开关,即支持精确计算(大数据量会有数据瓶颈)。
  3. 更改 String 数据长度
  4. 增加非数据类型的列的 mode 值计算
  5. 优化了算子的聚合值的类型,对于 count 类的算子返回 int 类型
  6. 修复均值(Mean Values)的返回结果,需要根据 round_at 进行小数位数的保留
  7. 百分比展示默认保留两位小数 "xx.yy%",计算时需要保留 round_at + 2 位。
  8. 重新实现 Quantile 计算,支持精准计算 Quantile 值(Hint:使用的时候注意数据性能瓶颈的问题)
    详情见 byzer-extension/issues/31

优化改进

缺陷修复

下载使用

下载 Byzer-lang 2.3.2 安装包,请点击下方链接获取:
https://download.byzer.org/byzer/2.3.2/
安装部署指南请查看手册: Byzer引擎部署指引

反馈

如果您遇到疑问或者问题,请到 byzer-lang 项目的 Issue 里留言,
或通过邮件联系 PMC Member:[email protected]
欢迎大家积极反馈使用体验与遇到的问题,共同参与社区建设。

致谢

感谢在 Byzer-lang 2.3.2 版本中做出贡献社区小伙伴们(排名不分先后):WilliamZhu,hellozepp,jiachuan.zhu,Zhengshuai PENG,ckeys,Lindsaylin

——————————————————————————————————————————————————

Byzer-lang 2.3.2 Release Note

Release Date: 2022-07—27
We are pleased to announce that today we officially released the Byzer(Byzer-lang) 2.3.2 version, which provides a more flexible and stable Byzer engine.

Major Changes

In this version, we have made some fixes and expanded the capabilities for Data Summary ET:

  1. Support filtering null values when calculating Quantile values
  2. When the proportion of unique value (distinct count) in DataSummary ET is calculated using approx_count_distinct, there is a certain error. Therefore, set the approx calculation switch to support the precise calculation (There may exist data bottleneck for large data).
  3. Change the String data length
  4. Add the mode value calculation for columns.
  5. Optimize the type of aggregate value of the operator, returning int for the operator of "count".
  6. To restore the return result of "Mean Values", the number of decimal places should be reserved according to round_at
  7. By default, two decimals "xx.yy %" are reserved for percentage display. Round_at + 2 decimals are reserved for calculation.
  8. Optimize Quantile calculations to support precise computation of Quantile values (Hint: be aware of data performance bottlenecks when used)
    For more details please refer: [byzer - the extension/issues / 31] (byzer-org/byzer-extension#31)

Enhancement

Downloads

To download the Byzer binary installation package, click the link below:
https://download.byzer.org/byzer/2.3.2/

Feedback

If you meet any problem, please submit an issue in project Byzer-lang
Or contact PMC Member:[email protected]
Welcome data developers to join and build community ecology.

Acknowledgments

Thanks to those who contributed code to Byzer-lang 2.3.1 (the following ranks are in no particular order): WilliamZhu,hellozepp,jiachuan.zhu,Zhengshuai PENG,ckeys,Lindsaylin

What's Changed

New Contributors

Full Changelog: v2.2.2...v2.3.2

Byzer-lang v2.3.1

05 Jul 07:37
Compare
Choose a tag to compare

Byzer-lang 2.3.1 发布声明

发布时间 2022-07-06

很高兴今天我们发布了 Byzer(Byzer-lang) 2.3.1 版本,提供了更加灵活且稳定的 Byzer 引擎。

主要内容更新

  1. 在该版本中集成了由社区贡献者 Github Id:ZhemingX 主要贡献的可交互式的 Byzer-Shell ,Byzer Shell 可以允许用户在不同的操作系统中,安装 Byzer 引擎后,通过 $BYZER_HOME/bin/byzer-shell 命令直接启动一个可交互式的 Shell 命令行程序,方便用户体验和使用 Byzer 引擎,或做一些即时的运算。

优化改进

缺陷修复

下载使用

下载 Byzer-lang 2.3.1 安装包,请点击下方链接获取:

https://download.byzer.org/byzer/2.3.1/

安装部署指南请查看手册: Byzer引擎部署指引

反馈

如果您遇到疑问或者问题,请到 byzer-lang 项目的 Issue 里留言,

或通过邮件联系 PMC Member:[email protected]

欢迎大家积极反馈使用体验与遇到的问题,共同参与社区建设。

致谢

感谢在 Byzer-lang 2.3.1 版本中做出贡献社区小伙伴们(排名不分先后):ZhemingX,kaliGo-Li,WilliamZhu,hellozepp,jiachuan.zhu,Zhengshuai PENG,ckeys


Byzer-lang 2.3.1 Release Note

Release Date: 2022-07-06

We are pleased to announce that today we officially released the Byzer-lang 2.3.1 version, which provides a more flexible and stable Byzer engine.

Major Changes

  1. The interactive Byzer-Shell contributed by Github Id: ZhemingX is introduced in this release , Byzer Shell allows users to directly start an interactive shell command line process through the $BYZER_HOME/bin/byzer-shell command after installing Byzer engine in different operating systems, which is convenient for users to try Byzer engine.

Enhancement

Bugfix

Downloads

To download the Byzer binary installation package, click the link below:

https://download.byzer.org/byzer/2.3.1/

Feedback

If you meet any problem, please submit an issue in project Byzer-lang

Or contact PMC Member:[email protected]

Welcome data developers to join and build community ecology.

Acknowledgments

Thanks to those who contributed code to Byzer-lang 2.3.0 (the following ranks are in no particular order): ZhemingX,kaliGo-Li,WilliamZhu,hellozepp,jiachuan.zhu,Zhengshuai PENG,ckeys

Byzer-lang v2.3.0.1 Hotfix

30 Apr 12:56
Compare
Choose a tag to compare

发布时间 2022-05-01

今天我们发布了 Byzer(Byzer-lang) 2.3.0.1 Hotfix 版本,在 Byzer 2.3.0 的基础上修复了一个 Rest API 数据源翻页获取数据错误的问题。

缺陷修复

下载使用

下载 Byzer-lang 2.3.0.1 安装包,请点击下方链接获取:

https://download.byzer.org/byzer/2.3.0.1/

安装部署指南请查看手册: Byzer引擎部署指引

反馈

如果您遇到疑问或者问题,请到 byzer-lang 项目的 Issue 里留言,

或通过邮件联系 PMC Member:[email protected]

欢迎大家积极反馈使用体验与遇到的问题,共同参与社区建设。

致谢

感谢在 Byzer-lang 2.3.0.1 Hotfix 版本中做出贡献社区小伙伴们(排名不分先后):jiachuan.zhu


Release Date: 2022-05-01

We are pleased to announce that today we officially released the Byzer-lang 2.3.0.1 Hotfix version on top of Byzer 2.3.0, which provides a more flexible and stable Byzer engine.

Bugfix

Downloads

To download the Byzer binary installation package, click the link below:

https://download.byzer.org/byzer/2.3.0.1/

Feedback

If you meet any problem, please submit an issue in project Byzer-lang

Or contact PMC Member:[email protected]

Welcome data developers to join and build community ecology.

Acknowledgments

Thanks to those who contributed code to Byzer-lang 2.3.0.1 Hotfix (the following ranks are in no particular order): jiachuan.zhu

Byzer-lang v2.3.0

27 Apr 13:05
Compare
Choose a tag to compare

发布时间 2022-04-29

很高兴今天我们发布了 Byzer(Byzer-lang) 2.3.0 版本,提供了更加灵活且稳定的 Byzer 引擎。

主要内容更新

  1. 在该版本中,我们优化了产品的安装部署流程,将配置文件和可执行脚本分离,并在可执行脚本中引入了环境检查,并优化了终端的信息显示。用户可通过调整 ${BYZER_HOME/conf 目录下的配置文件, 然后执行 ${BYZER_HOME/bin/byzer.sh start | stop | restart} 就可以对 Byzer 引擎进行启动,停止以及重启等操作,在易用性和可维护性上得到了巨大的提升。设计详情请参考 BIP 3: Optimize Byzer lang script

  2. 2.3.0 版本中,我们优化了 Byzer 引擎的打包逻辑并修复了部分 bug(源代码可参见 byzer-org/byzer-build),统一了各产品包的项目结构以及使用方式,同时优化了官方下载站点的文件目录结构,将项目中历史遗留的 naming 问题做了统一,期望能够给社区用户带来更好的体验。

该变更可能会影响使用旧版本的用户,相关变更如下:

变更说明 Before 2.3.0 2.3.0
byzer 镜像内目录改名 /home/deploy/mlsql /home/deploy/byzer-lang
byzer 镜像中主程序 jar 路径变更 /home/deploy/mlsql/libs /home/deploy/byzer-lang/main
主程序 jar 名称变更 streamingpro-mlsql-spark_3.0_2.12-2.2.2.jar byzer-lang-3.1.1-2.12-2.3.0.jar
默认删除 Spark velocity jar spark velocity jar 可能会造成 json path 的读取问题 在 all-in-one 以及镜像中将该 jar 文件进行了删除
  1. 2.3.0 版本的开发过程中,我们对官方手册 做了大量的修订和内容增补,涵盖了部署安装,REST 数据源等重点章节,期望能够给用户更多的帮助。

  2. 2.3.0 版本的开发过程中,我们优化了 Byzer 引擎的 CICD 流程,增强了 Byzer 引擎的自动化测试能力,提高了代码的覆盖率,自动化测试环境覆盖了 Byzer 引擎支持的多种环境,设计详情可以参考 BIP 1: Support Integration testing using docker

优化改进

缺陷修复

下载使用

下载 Byzer-lang 2.3.0 安装包,请点击下方链接获取:

https://download.byzer.org/byzer/2.3.0/

安装部署指南请查看手册: Byzer引擎部署指引

反馈

如果您遇到疑问或者问题,请到 byzer-lang 项目的 Issue 里留言,

或通过邮件联系 PMC Member:[email protected]

欢迎大家积极反馈使用体验与遇到的问题,共同参与社区建设。

致谢

感谢在 Byzer-lang 2.3.0 版本中做出贡献社区小伙伴们(排名不分先后):anan0120,kaliGo-Li,AdmondGuo,WilliamZhu,hellozepp,jiachuan.zhu,Zhengshuai PENG,Yifan Chen,Qi Lin,ckeys


Release Date: 2022-04-29

We are pleased to announce that today we officially released the Byzer-lang 2.3.0 version, which provides a more flexible and stable Byzer engine.

Major Changes

  1. In this version, we have optimized the installation and deployment process of Byzer engine, separated configuration files from executable scripts, introduced environment checks, and optimized the display of terminal information. User can change the configuration by modifying the property files in ${BYZER_HOME/conf, and can start, stop, restart the Byzer engine by executing ${BYZER_HOME/bin/byzer.sh start | stop | restart}. This change brings a huge improvement in ease of use and maintainability. Details please refer to the BIP 3: Optimize Byzer lang script

  2. In the 2.3.0 version, we optimized the packaging logic of the Byzer engine and fixed some bugs (see byzer-org/byzer-build), unifies the project structure and usage of each product offer, and optimizes the file directory structure of the official download site, Fix the naming problem left over in the project, hoping to bring a better experience to community users.

This may introduce the break changes, details as following:

Change Before 2.3.0 2.3.0
byzer folder name change in image /home/deploy/mlsql /home/deploy/byzer-lang
byzer main jar path change in image /home/deploy/mlsql/libs /home/deploy/byzer-lang/main
main jar name change streamingpro-mlsql-spark_3.0_2.12-2.2.2.jar byzer-lang-3.1.1-2.12-2.3.0.jar
Remove Spark velocity jar spark velocity jar in conflict with json path parsing Remove this jar file in all-in-one package and images
  1. During the development of the 2.3.0 version, we made a lot of revisions and additions to the official manual, hoping to give users more help.

  2. During the development of the 2.3.0 version, we optimized the CICD process of the Byzer engine, enhanced the automated testing capabilities, and improved the code coverage. Details please refer to BIP 1: Support Integration testing using docker

Enhancement

Bugfix

Downloads

To download the Byzer binary installation package, click the link below:

https://download.byzer.org/byzer/2.3.0/

Feedback

If you meet any problem, please submit an issue in project Byzer-lang

Or contact PMC Member:[email protected]

Welcome data developers to join and build community ecology.

Acknowledgments

Thanks to those who contributed code to Byzer-lang 2.3.0 (the following ranks are in no particular order): anan0120, kaliGo-Li, AdmondGuo, WilliamZhu, hellozepp, jiachuan.zhu, Zhengshuai PENG, Yifan Chen, Qi Lin, ckeys

Byzer-lang v2.2.2

31 Mar 06:46
f580c01
Compare
Choose a tag to compare

Byzer-lang 2.2.2 Release Notes

Release Date: 2022-03-30

We are pleased to announce that today we officially released the Byzer-lang 2.2.2 version, which provides a more flexible and stable Byzer engine.

Update as follows

Enhancement

Bugfix

  • byzer-lang/issues/1699 [Bug] Fix a Java UDF compilation error that caused the Job in Byzer Notebook to fail to terminate correctly.
  • byzer-lang/issues/1708 [Bug] Fix the error of rest_request UDF "No content to map to Obeject due to end of input".
  • byzer-lang/pull/1721 [Bug] Fix the NoSuchElementException error when syntax hint is not matched.

Downloads

To download the Byzer binary installation package, click the link below:

  1. Byzer All In One edition currently provides adaptation for Mac/Linux/Windows (The Windows version currently does not support Byzer-python)
  1. Byzer server versions are compatible with Spark 2.4.3 and Spark 3.1.1 respectively
  1. Byzer VSCode Extension Version (Desktop Version)

Feedback

If you meet any problem, please submit an issue in project Byzer-lang
Or contact PMC Member:[email protected]
Welcome data developers to join and build community ecology.

Acknowledgments

Thanks to those who contributed code to Byzer-lang 2.2.2 (the following ranks are in no particular order): kaliGo-Li,WilliamZhu,hellozepp,jiachuan.zhu

Byzer-lang v2.2.1

17 Jan 11:19
976f49d
Compare
Choose a tag to compare

Byzer-lang 2.2.1 Release Note

Release Date: 2022-01-17

We are pleased to announce that today we officially released the Byzer-lang 2.2.1 version.

Update on v2.2.1

Bug Fix

  • #1660 Fix the error using SendMessage ET
  • #1654 Fix the problem of python daemon surge
  • #1650 Fix the issue that across-cell variables cannot be recognized
  • #1644 Fix PSExecutor fails to parse new option in Spark
  • #1642 Fix !show et; error in distribute mode
  • #1640 Enahnce SQLDiscretizer example
  • #1636 CustomFS should honor saveMode config

Downloads

Byzer-lang binary

Download the package below:

  • Spark 2.4.3 version:byzer-lang_2.4-2.2.1.tar.gz
  • Spark 3.1.1 version:byzer-lang_3.0-2.2.1.tar.gz

Byzer-lang Vscode extension

Feedback

If you meet any problem, please submit an issue in project Byzer-lang
Or contact PMC Member: [email protected]
Welcome data developers to join and build community ecology.

Acknowledgments

Thanks to those who contributed code to Byze-lang 2.2.1 (the following ranks are in no particular order): AdmondGuo,Andie Huang,PENG Zhengshuai,Wenzheng Liu,WilliamZhu,anan0120,hellozepp,jiachuan.zhu,teeyog

Byzer V2.2.0

15 Dec 10:37
31c132e
Compare
Choose a tag to compare

Release Notes

First of all, I am happy to tell you that MLSQL will be officially renamed Byzer on 2021.12.21.

After more than two months of hard work by the team, today we released the Byzer 2.2.0 version, which provides a more flexible and stable Byzer engine.

Compared with the MLSQL 2.1.0 version, the main updates are as follows:

  1. Improved and expanded ET plug-in introspection mechanism
  2. A desktop version of Windows is provided
  3. Added storage plugins (cloud storage such as Amazon S3, Azure Blob, etc.)
  4. More complete Byzer language code prompt
  5. Provides a fully functional algorithm and feature engineering components
  6. Easy-to-use and complete console interactive product Byzer Notebook

v1.2.0 Release

14 Apr 13:58
Compare
Choose a tag to compare

v1.1.7.1 Release

18 Jan 01:46
Compare
Choose a tag to compare

More details please check MLSQL v1.1.7.1 Bug Release and MLSQL v1.1.7 Release

  1. download link
  2. used in docker:
docker run -p 9003:9003 techmlsql/mlsql:spark_2.4-1.1.7.1

then vist http://127.0.0.1:9003