Skip to content

Commit d12babd

Browse files
authored
docs: upgrade 0.8.5 (#3741)
1 parent ad4eace commit d12babd

32 files changed

+155
-122
lines changed

CHANGELOG.md

Lines changed: 33 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,38 @@
11
# Changelog
22

3+
## [0.8.5] - 2024-02-27
4+
5+
### Features
6+
- Support Iceberg as an offline storage (#3737 @vagetablechicken)
7+
- Support `UNION ALL` statement (#3590 #3653 @aceforeverd)
8+
- Support `SELECT ... INTO OUTFILE` to OpenMLDB online tables (#3616 @tobegit3hub)
9+
- Support `LAST JOIN` and `WINDOW` without `ORDER BY` in offline mode (#3619 @aceforeverd)
10+
- Support `CREATE/ALTER/DROP USER` statement (#3678 #3745 #3747 @dl239, #3744 @tobegit3hub)
11+
- Support specifying Spark configurations in the SDK (#3613 @tobegit3hub)
12+
- `INSERT`returns failure if the server-side memory usage exceeds the specified limit (#3631 @dl239)
13+
- Add a new interfact for SQLs to DAG (#3630 @aceforeverd)
14+
- If the deployed SQL contains the `LEFT JOIN`, the indexs will be created automatically. (#3667 @aceforeverd)
15+
- Support automatic deletion of logs (#3704 #3736 #3706 @dl239)
16+
- Support `absandlat/absorlat` TTL type for disktable (#3716 @dl239)
17+
- Optimize error messages for insert failures (#3725 @vagetablechicken)
18+
- Improve the documents (#3617 #3519 #3690 #3699 @vagetablechicken, #3612 @dl239, #3609 #3672 #3687 @aceforeverd, #3649 #3570 #3569 @TanZiYen @Elliezza, #3665 @DrDub, #3585 #3584 #3579 #3578 #3574 #3573 #3552 #3539 #3488 #3477 #3475 #3586 #3470 #3474 #3568 #3583 #3564 #3764 @TanZiYen, #3688 #3697 #3753 #3721 #3731 #3739 #3754 #3720 #3756 #3762 #3752 #3757 #3719 @Elliezza, #3075 @Elliezza @tobegit3hub, #3710 @tobegit3hub)
19+
- Other minor features (#3623 #3636 @aceforeverd, #3651 @tobegit3hub, #3641 #3692 @vagetablechicken, #3582 #3702 @dl239, #3674 @lqy222)
20+
21+
### Bug Fixes
22+
- Executing offline tasks will consume an excessive number of ZooKeeper connections (#3642 @dl239)
23+
- There is no automatic reconnection after ZooKeeper disconnection in SDK. (#3656 #3668 @vagetablechicken)
24+
- The `FlexibleRowBuilder` will throw a `NullPointerException` if set with a null value (#3649 @dl239)
25+
- If the length of strings in the imported data exceeds 255, it may throw a `BufferOverflowException`. (#3729 @ljwh)
26+
- If a table contains a large amount of data, querying the data may still be possible after executing `TRUNCATE` (#3677 @dl239)
27+
- After deleting data, it can still be retrieved from other indexes (#3693 @dl239)
28+
- Delete dirty data when insertion fails (#3681 @dl239)
29+
- When there are no tables, getting databases using `GetAllDbs` fails. (#3742 @vagetablechicken)
30+
- Adding a deleted index fails if the index name is different from the previous name (#3635 @dl239)
31+
- Other minor bug fixes (#3638 #3654 #3717 #3726 #3743 @vagetablechicken, #3607 #3775 @dl239, #3640 @tobegit3hub, #3686 #3735 #3738 #3740 @aceforeverd, #3759 @yangwucheng)
32+
33+
### Code Refactoring
34+
#3666 @vagetablechicken
35+
336
## [0.8.4] - 2023-11-17
437

538
### Features

demo/predict-taxi-trip-duration/README.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -28,7 +28,7 @@ w2 as (PARTITION BY passenger_count ORDER BY pickup_datetime ROWS_RANGE BETWEEN
2828
2929
**Start docker**
3030
```
31-
docker run -it 4pdosc/openmldb:0.8.4 bash
31+
docker run -it 4pdosc/openmldb:0.8.5 bash
3232
```
3333
**Initialize environment**
3434
```bash
@@ -138,7 +138,7 @@ python3 predict.py
138138
**Start docker**
139139
140140
```bash
141-
docker run -it 4pdosc/openmldb:0.8.4 bash
141+
docker run -it 4pdosc/openmldb:0.8.5 bash
142142
```
143143
**Initialize environment**
144144

demo/talkingdata-adtracking-fraud-detection/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -15,7 +15,7 @@ We recommend you to use docker to run the demo. OpenMLDB and dependencies have b
1515
**Start docker**
1616

1717
```
18-
docker run -it 4pdosc/openmldb:0.8.4 bash
18+
docker run -it 4pdosc/openmldb:0.8.5 bash
1919
```
2020

2121
#### Run locally

docs/en/deploy/compile.md

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@
55
This section describes the steps to compile and use OpenMLDB inside its official docker image [hybridsql](https://hub.docker.com/r/4pdosc/hybridsql), mainly for quick start and development purposes in the docker container.
66
The docker image has packed the required tools and dependencies, so there is no need to set them up separately. To compile without the official docker image, refer to the section [Detailed Instructions for Build](#detailed-instructions-for-build) below.
77

8-
Keep in mind that you should always use the same version of both compile image and [OpenMLDB version](https://github.com/4paradigm/OpenMLDB/releases). This section demonstrates compiling for [OpenMLDB v0.8.4](https://github.com/4paradigm/OpenMLDB/releases/tag/v0.8.4) under `hybridsql:0.8.4` ,If you prefer to compile on the latest code in `main` branch, pull `hybridsql:latest` image instead.
8+
Keep in mind that you should always use the same version of both compile image and [OpenMLDB version](https://github.com/4paradigm/OpenMLDB/releases). This section demonstrates compiling for [OpenMLDB v0.8.5](https://github.com/4paradigm/OpenMLDB/releases/tag/v0.8.5) under `hybridsql:0.8.5` ,If you prefer to compile on the latest code in `main` branch, pull `hybridsql:latest` image instead.
99

1010
1. Pull the docker image
1111

@@ -19,11 +19,11 @@ Keep in mind that you should always use the same version of both compile image a
1919
docker run -it 4pdosc/hybridsql:0.8 bash
2020
```
2121

22-
3. Download the OpenMLDB source code inside the docker container, and set the branch into v0.8.4
22+
3. Download the OpenMLDB source code inside the docker container, and set the branch into v0.8.5
2323

2424
```bash
2525
cd ~
26-
git clone -b v0.8.4 https://github.com/4paradigm/OpenMLDB.git
26+
git clone -b v0.8.5 https://github.com/4paradigm/OpenMLDB.git
2727
```
2828

2929
4. Compile OpenMLDB
@@ -150,7 +150,7 @@ The built jar packages are in the `target` path of each submodule. If you want t
150150
1. Downloading the pre-built OpenMLDB Spark distribution:
151151

152152
```bash
153-
wget https://github.com/4paradigm/spark/releases/download/v3.2.1-openmldb0.8.4/spark-3.2.1-bin-openmldbspark.tgz
153+
wget https://github.com/4paradigm/spark/releases/download/v3.2.1-openmldb0.8.5/spark-3.2.1-bin-openmldbspark.tgz
154154
```
155155

156156
Alternatively, you can also download the source code and compile from scratch:
@@ -209,7 +209,7 @@ After forking the OpenMLDB repository, you can trigger the `Other OS Build` work
209209

210210
- Do not change the `Use workflow from` setting to a specific tag; it can be another branch.
211211
- Choose the desired `OS name`, which in this case is `centos6`.
212-
- If you are not compiling the main branch, provide the name of the branch, tag (e.g., v0.8.4), or SHA you want to compile in the `The branch, tag, or SHA to checkout, otherwise use the branch` field.
212+
- If you are not compiling the main branch, provide the name of the branch, tag (e.g., v0.8.5), or SHA you want to compile in the `The branch, tag, or SHA to checkout, otherwise use the branch` field.
213213
- The compilation output will be accessible in "runs", as shown in an example [here](https://github.com/4paradigm/OpenMLDB/actions/runs/6044951902).
214214
- The workflow will definitely produce the OpenMLDB binary file.
215215
- If you don't need the Java or Python SDK, you can configure `java sdk enable` or `python sdk enable` to be "OFF" to save compilation time.

docs/en/deploy/install_deploy.md

Lines changed: 34 additions & 34 deletions
Original file line numberDiff line numberDiff line change
@@ -52,17 +52,17 @@ If your operating system is not mentioned above or if you want to compile from s
5252

5353
### Linux Platform Compatibility Pre-test
5454

55-
Due to the variations among Linux platforms, the distribution package may not be entirely compatible with your machine. Therefore, it's recommended to conduct a preliminary compatibility test. Download the pre-compiled package `openmldb-0.8.4-linux.tar.gz`, and execute:
55+
Due to the variations among Linux platforms, the distribution package may not be entirely compatible with your machine. Therefore, it's recommended to conduct a preliminary compatibility test. Download the pre-compiled package `openmldb-0.8.5-linux.tar.gz`, and execute:
5656

5757
```
58-
tar -zxvf openmldb-0.8.4-linux.tar.gz
59-
./openmldb-0.8.4-linux/bin/openmldb --version
58+
tar -zxvf openmldb-0.8.5-linux.tar.gz
59+
./openmldb-0.8.5-linux/bin/openmldb --version
6060
```
6161

6262
The result should display the version number of the program, as shown below:
6363

6464
```
65-
openmldb version 0.8.4-xxxx
65+
openmldb version 0.8.5-xxxx
6666
Debug build (NDEBUG not #defined)
6767
```
6868

@@ -177,9 +177,9 @@ DataCollector and SyncTool currently do not support one-click deployment. Please
177177
### Download OpenMLDB
178178

179179
```
180-
wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.4/openmldb-0.8.4-linux.tar.gz
181-
tar -zxvf openmldb-0.8.4-linux.tar.gz
182-
cd openmldb-0.8.4-linux
180+
wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.5/openmldb-0.8.5-linux.tar.gz
181+
tar -zxvf openmldb-0.8.5-linux.tar.gz
182+
cd openmldb-0.8.5-linux
183183
```
184184

185185
### Environment Configuration
@@ -188,7 +188,7 @@ The environment variables are defined in `conf/openmldb-env.sh`, as shown in the
188188

189189
| Environment Variable | Default Value | Note |
190190
| --------------------------------- | ------------------------------------------------------- | ------------------------------------------------------------ |
191-
| OPENMLDB_VERSION | 0.8.4 | OpenMLDB version |
191+
| OPENMLDB_VERSION | 0.8.5 | OpenMLDB version |
192192
| OPENMLDB_MODE | standalone | standalone or cluster |
193193
| OPENMLDB_HOME | root directory of the release folder | openmldb root directory |
194194
| SPARK_HOME | $OPENMLDB_HOME/spark | openmldb spark root directory,If the directory does not exist, it will be downloaded automatically.|
@@ -361,10 +361,10 @@ Note that at least two TabletServer need to be deployed, otherwise errors may oc
361361
**1. Download the OpenMLDB deployment package**
362362

363363
```
364-
wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.4/openmldb-0.8.4-linux.tar.gz
365-
tar -zxvf openmldb-0.8.4-linux.tar.gz
366-
mv openmldb-0.8.4-linux openmldb-tablet-0.8.4
367-
cd openmldb-tablet-0.8.4
364+
wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.5/openmldb-0.8.5-linux.tar.gz
365+
tar -zxvf openmldb-0.8.5-linux.tar.gz
366+
mv openmldb-0.8.5-linux openmldb-tablet-0.8.5
367+
cd openmldb-tablet-0.8.5
368368
```
369369

370370
**2. Modify the configuration file `conf/tablet.flags`**
@@ -427,12 +427,12 @@ For clustered versions, the number of TabletServers must be 2 or more. If there'
427427

428428
To start the next TabletServer on a different machine, simply repeat the aforementioned steps on that machine. If starting the next TabletServer on the same machine, ensure it's in a different directory, and do not reuse a directory where the TabletServer is already running.
429429

430-
For instance, you can decompress the package again (avoid using a directory where TabletServer is already running, as files generated after startup may be affected), and name the directory `openmldb-tablet-0.8.4-2`.
430+
For instance, you can decompress the package again (avoid using a directory where TabletServer is already running, as files generated after startup may be affected), and name the directory `openmldb-tablet-0.8.5-2`.
431431

432432
```
433-
tar -zxvf openmldb-0.8.4-linux.tar.gz
434-
mv openmldb-0.8.4-linux openmldb-tablet-0.8.4-2
435-
cd openmldb-tablet-0.8.4-2
433+
tar -zxvf openmldb-0.8.5-linux.tar.gz
434+
mv openmldb-0.8.5-linux openmldb-tablet-0.8.5-2
435+
cd openmldb-tablet-0.8.5-2
436436
```
437437

438438
Modify the configuration again and start the TabletServer. Note that if all TabletServers are on the same machine, use different port numbers to avoid "Fail to listen" error in the log (`logs/tablet.WARNING`).
@@ -450,10 +450,10 @@ Please ensure that all TabletServer have been successfully started before deploy
450450
**1. Download the OpenMLDB deployment package**
451451

452452
````
453-
wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.4/openmldb-0.8.4-linux.tar.gz
454-
tar -zxvf openmldb-0.8.4-linux.tar.gz
455-
mv openmldb-0.8.4-linux openmldb-ns-0.8.4
456-
cd openmldb-ns-0.8.4
453+
wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.5/openmldb-0.8.5-linux.tar.gz
454+
tar -zxvf openmldb-0.8.5-linux.tar.gz
455+
mv openmldb-0.8.5-linux openmldb-ns-0.8.5
456+
cd openmldb-ns-0.8.5
457457
````
458458

459459
**2. Modify the configuration file conf/nameserver.flags**
@@ -498,12 +498,12 @@ You can have only one NameServer, but if you need high availability, you can dep
498498

499499
To start the next NameServer on another machine, simply repeat the above steps on that machine. If starting the next NameServer on the same machine, ensure it's in a different directory and do not reuse the directory where NameServer has already been started.
500500

501-
For instance, you can decompress the package again (avoid using the directory where NameServer is already running, as files generated after startup may be affected) and name the directory `openmldb-ns-0.8.4-2`.
501+
For instance, you can decompress the package again (avoid using the directory where NameServer is already running, as files generated after startup may be affected) and name the directory `openmldb-ns-0.8.5-2`.
502502

503503
```
504-
tar -zxvf openmldb-0.8.4-linux.tar.gz
505-
mv openmldb-0.8.4-linux openmldb-ns-0.8.4-2
506-
cd openmldb-ns-0.8.4-2
504+
tar -zxvf openmldb-0.8.5-linux.tar.gz
505+
mv openmldb-0.8.5-linux openmldb-ns-0.8.5-2
506+
cd openmldb-ns-0.8.5-2
507507
```
508508

509509
Then modify the configuration and start.
@@ -544,10 +544,10 @@ Before running APIServer, ensure that the TabletServer and NameServer processes
544544
**1. Download the OpenMLDB deployment package**
545545

546546
```
547-
wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.4/openmldb-0.8.4-linux.tar.gz
548-
tar -zxvf openmldb-0.8.4-linux.tar.gz
549-
mv openmldb-0.8.4-linux openmldb-apiserver-0.8.4
550-
cd openmldb-apiserver-0.8.4
547+
wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.5/openmldb-0.8.5-linux.tar.gz
548+
tar -zxvf openmldb-0.8.5-linux.tar.gz
549+
mv openmldb-0.8.5-linux openmldb-apiserver-0.8.5
550+
cd openmldb-apiserver-0.8.5
551551
```
552552

553553
**2. Modify the configuration file conf/apiserver.flags**
@@ -609,18 +609,18 @@ You can have only one TaskManager, but if you require high availability, you can
609609
Spark distribution:
610610

611611
```shell
612-
wget https://github.com/4paradigm/spark/releases/download/v3.2.1-openmldb0.8.4/spark-3.2.1-bin-openmldbspark.tgz
613-
# Image address (China):https://www.openmldb.com/download/v0.8.4/spark-3.2.1-bin-openmldbspark.tgz
612+
wget https://github.com/4paradigm/spark/releases/download/v3.2.1-openmldb0.8.5/spark-3.2.1-bin-openmldbspark.tgz
613+
# Image address (China):https://www.openmldb.com/download/v0.8.5/spark-3.2.1-bin-openmldbspark.tgz
614614
tar -zxvf spark-3.2.1-bin-openmldbspark.tgz
615615
export SPARK_HOME=`pwd`/spark-3.2.1-bin-openmldbspark/
616616
```
617617

618618
OpenMLDB deployment package:
619619
```
620-
wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.4/openmldb-0.8.4-linux.tar.gz
621-
tar -zxvf openmldb-0.8.4-linux.tar.gz
622-
mv openmldb-0.8.4-linux openmldb-taskmanager-0.8.4
623-
cd openmldb-taskmanager-0.8.4
620+
wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.5/openmldb-0.8.5-linux.tar.gz
621+
tar -zxvf openmldb-0.8.5-linux.tar.gz
622+
mv openmldb-0.8.5-linux openmldb-taskmanager-0.8.5
623+
cd openmldb-taskmanager-0.8.5
624624
```
625625

626626
**2. Modify the configuration file conf/taskmanager.properties**

docs/en/integration/deploy_integration/OpenMLDB_Byzer_taxi.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -13,7 +13,7 @@ This article demonstrates how to use [OpenMLDB](https://github.com/4paradigm/Ope
1313

1414
The command is as follows:
1515
```
16-
docker run --network host -dit --name openmldb -v /mlsql/admin/:/byzermnt 4pdosc/openmldb:0.8.4 bash
16+
docker run --network host -dit --name openmldb -v /mlsql/admin/:/byzermnt 4pdosc/openmldb:0.8.5 bash
1717
docker exec -it openmldb bash
1818
/work/init.sh
1919
echo "create database db1;" | /work/openmldb/bin/openmldb --zk_cluster=127.0.0.1:2181 --zk_root_path=/openmldb --role=sql_client

docs/en/integration/deploy_integration/airflow_provider_demo.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -36,7 +36,7 @@ For smooth function, we recommend starting OpenMLDB using the docker image and i
3636
Since Airflow Web requires an external port for login, the container's port must be exposed. Then map the downloaded file from the previous step to the `/work/airflow/dags` directory. This step is crucial for Airflow to load the DAGs from this folder correctly.
3737

3838
```
39-
docker run -p 8080:8080 -v `pwd`/airflow_demo_files:/work/airflow_demo_files -it 4pdosc/openmldb:0.8.4 bash
39+
docker run -p 8080:8080 -v `pwd`/airflow_demo_files:/work/airflow_demo_files -it 4pdosc/openmldb:0.8.5 bash
4040
```
4141

4242
#### Download and Install Airflow and Airflow OpenMLDB Provider

docs/en/integration/deploy_integration/dolphinscheduler_task_demo.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -31,7 +31,7 @@ In addition to SQL execution in OpenMLDB, real-time prediction also requires mod
3131

3232
The test can be executed on macOS or Linux, and we recommend running this demo within the provided OpenMLDB docker image. In this setup, both OpenMLDB and DolphinScheduler will be launched inside the container, with the port of DolphinScheduler exposed.
3333
```
34-
docker run -it -p 12345:12345 4pdosc/openmldb:0.8.4 bash
34+
docker run -it -p 12345:12345 4pdosc/openmldb:0.8.5 bash
3535
```
3636
```{attention}
3737
For proper configuration of DolphinScheduler, the tenant should be set up as a user of the operating system, and this user must have sudo permissions. It is advised to download and initiate DolphinScheduler within the OpenMLDB container. Otherwise, please ensure that the user has sudo permissions.

docs/en/integration/online_datasources/kafka_connector_demo.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -23,7 +23,7 @@ This article will use Docker mode to start OpenMLDB, so there is no need to down
2323
We recommend that you bind all three downloaded file packages to the `kafka` directory. Alternatively, you can download the file packages after starting the container. For our demonstration, we assume that the file packages are all in the `/work/kafka` directory.
2424

2525
```
26-
docker run -it -v `pwd`:/work/kafka 4pdosc/openmldb:0.8.4 bash
26+
docker run -it -v `pwd`:/work/kafka 4pdosc/openmldb:0.8.5 bash
2727
```
2828

2929
### Note

docs/en/integration/online_datasources/pulsar_connector_demo.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -43,7 +43,7 @@ Currently, only the OpenMLDB cluster version can act as the receiver of sinks, a
4343
We recommend using the 'host network' mode to run Docker and bind the file directory 'files' where the SQL script is located.
4444

4545
```
46-
docker run -dit --network host -v `pwd`/files:/work/pulsar_files --name openmldb 4pdosc/openmldb:0.8.4 bash
46+
docker run -dit --network host -v `pwd`/files:/work/pulsar_files --name openmldb 4pdosc/openmldb:0.8.5 bash
4747
docker exec -it openmldb bash
4848
```
4949

0 commit comments

Comments
 (0)