Skip to content

Commit b685e64

Browse files
authored
docs: upgrade 0.8.3 (#3496)
1 parent 1b2f945 commit b685e64

32 files changed

+156
-120
lines changed

CHANGELOG.md

Lines changed: 37 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,40 @@
11
# Changelog
22

3+
## [0.8.3] - 2023-09-15
4+
5+
### Features
6+
- Optimize the performance of Java SDK (#3445 @dl239)
7+
- Optimize the writing performance and significantly reduce the memory consumption of the Spark connector (#3443 @vagetablechicken)
8+
- Support loading data from HIVE with customized SQLs (#3380 @tobegit3hub)
9+
- Improve the output message for SDK and CLI (#3384 @vagetablechicken, #3434 #3494 @dl239)
10+
- Support new built-in functions `json_array_length` and `get_json_object` (#3414 #3429 @aceforeverd)
11+
- Add new options `RANGE_BIAS` and `ROWS_BIAS` for the `DEPLOYMENT` statement (#3456 @vagetablechicken)
12+
- Support `const` project in online mode (#3376 @aceforeverd)
13+
- Support `SHOW DEPLOYMENT` and `DROP DEPLOYMENT` with a database name (#3353 @emo-coder)
14+
- Support inheriting environment variables for Spark (#3450 @vagetablechicken)
15+
- Support deleting HDFS files when dropping tables (#3369 @tobegit3hub)
16+
- Enhance the diagnostic tool (#3330 @zhangziheng01233)
17+
- Enhance the operation tool (#3455 @dl239)
18+
- Use the timeout value set by an user only if that is greater than the default value (#3484 @vagetablechicken)
19+
- Remove the sync tool from the demo docker image (#3390 @dl239)
20+
- Improve the documents (#3383 #3392 #3410 @vagetablechicken, #3175 #3447 ##3463 @TanZiYen, #3436 @aceforeverd, #3451 @wangerry, #3453 #3462 #3498 @dl239)
21+
22+
### Bug Fixes
23+
- `CREATE TABLE LIKE HIVE` returns success even if a database is not found (#3379 @emo-coder)
24+
- If an error occurred when executing `DROP FUNCTION`, the function cannot be deleted again. (#3362 @vagetablechicken, #3441 @dl239)
25+
- The results of `SHOW JOBS` are not sorted by `id` (#3371 @emo-coder)
26+
- NameServer will crash if creating system tables fails. (#3432 @dl239)
27+
- `CREATE INDEX` may fail if the previous `CREATE INDEX` command on the same table has not finished. (#3393 @dl239)
28+
- The result of `SELECT` on the deleted index column is empty (#3426 @dl239)
29+
- Other minor bug fixes (#3391 #3408 @vagetablechicken, #3386 #3427 #3459 @dl239, #3367 #3495 @aceforeverd)
30+
31+
### Code Refactoring
32+
#3397 @emo-coder, #3411 @vagetablechicken, #3435 @aceforeverd, #3473 @lqy222
33+
34+
### Breaking Changes
35+
- The return type of `GetInternalSchema` in `SQLResultSet` changes from native Schema to `com._4paradigm.openmldb.sdk.Schema` #3445
36+
- Remove the deprecated TaskManager configuration `namenode.uri` #3369
37+
338
## [0.8.2] - 2023-07-20
439

540
### Features
@@ -16,7 +51,7 @@
1651
- The bool type is not properly packed in APIServer. (#3366 @vagetablechicken)
1752
- The table can be created successfully when there are duplicated indexs. (#3306 @dl239)
1853

19-
### Breaking Changes:
54+
### Breaking Changes
2055
- The field `Offline_deep_copy` will be replaced by `Offline_symbolic_paths` in the result of `SHOW TABLE STATUS` #3349.
2156

2257
## [0.8.1] - 2023-06-28
@@ -618,6 +653,7 @@ Removed
618653
- openmldb-0.2.0-linux.tar.gz targets on x86_64
619654
- aarch64 artifacts consider experimental
620655

656+
[0.8.3]: https://github.com/4paradigm/OpenMLDB/compare/v0.8.2...v0.8.3
621657
[0.8.2]: https://github.com/4paradigm/OpenMLDB/compare/v0.8.1...v0.8.2
622658
[0.8.1]: https://github.com/4paradigm/OpenMLDB/compare/v0.8.0...v0.8.1
623659
[0.8.0]: https://github.com/4paradigm/OpenMLDB/compare/v0.7.3...v0.8.0

demo/java_quickstart/demo/pom.xml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -29,7 +29,7 @@
2929
<dependency>
3030
<groupId>com.4paradigm.openmldb</groupId>
3131
<artifactId>openmldb-jdbc</artifactId>
32-
<version>0.8.2</version>
32+
<version>0.8.3</version>
3333
</dependency>
3434
<dependency>
3535
<groupId>org.testng</groupId>

demo/predict-taxi-trip-duration/README.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -28,7 +28,7 @@ w2 as (PARTITION BY passenger_count ORDER BY pickup_datetime ROWS_RANGE BETWEEN
2828
2929
**Start docker**
3030
```
31-
docker run -it 4pdosc/openmldb:0.8.2 bash
31+
docker run -it 4pdosc/openmldb:0.8.3 bash
3232
```
3333
**Initialize environment**
3434
```bash
@@ -138,7 +138,7 @@ python3 predict.py
138138
**Start docker**
139139
140140
```bash
141-
docker run -it 4pdosc/openmldb:0.8.2 bash
141+
docker run -it 4pdosc/openmldb:0.8.3 bash
142142
```
143143
**Initialize environment**
144144

demo/talkingdata-adtracking-fraud-detection/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -15,7 +15,7 @@ We recommend you to use docker to run the demo. OpenMLDB and dependencies have b
1515
**Start docker**
1616

1717
```
18-
docker run -it 4pdosc/openmldb:0.8.2 bash
18+
docker run -it 4pdosc/openmldb:0.8.3 bash
1919
```
2020

2121
#### Run locally

docs/en/deploy/compile.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@
77
This section describes the steps to compile and use OpenMLDB inside its official docker image [hybridsql](https://hub.docker.com/r/4pdosc/hybridsql).
88
The docker image has packed required tools and dependencies, so there is no need to set them up separately. To compile without the official docker image, refer to the section [Detailed Instructions for Build](#detailed-instructions-for-build) below.
99

10-
Keep in mind that you should always use the same version of both compile image and [OpenMLDB version](https://github.com/4paradigm/OpenMLDB/releases). This section demonstrates compiling for [OpenMLDB v0.8.2](https://github.com/4paradigm/OpenMLDB/releases/tag/v0.8.2) under `hybridsql:0.8.2` ,If you prefer to compile on the latest code in `main` branch, pull `hybridsql:latest` image instead.
10+
Keep in mind that you should always use the same version of both compile image and [OpenMLDB version](https://github.com/4paradigm/OpenMLDB/releases). This section demonstrates compiling for [OpenMLDB v0.8.3](https://github.com/4paradigm/OpenMLDB/releases/tag/v0.8.3) under `hybridsql:0.8.3` ,If you prefer to compile on the latest code in `main` branch, pull `hybridsql:latest` image instead.
1111

1212
1. Pull the docker image
1313

@@ -21,11 +21,11 @@ Keep in mind that you should always use the same version of both compile image a
2121
docker run -it 4pdosc/hybridsql:0.8 bash
2222
```
2323

24-
3. Download the OpenMLDB source code inside the docker container, and setting the branch into v0.8.2
24+
3. Download the OpenMLDB source code inside the docker container, and setting the branch into v0.8.3
2525

2626
```bash
2727
cd ~
28-
git clone -b v0.8.2 https://github.com/4paradigm/OpenMLDB.git
28+
git clone -b v0.8.3 https://github.com/4paradigm/OpenMLDB.git
2929
```
3030

3131
4. Compile OpenMLDB
@@ -151,7 +151,7 @@ The built jar packages are in the `target` path of each submodule. If you want t
151151
1. Downloading the pre-built OpenMLDB Spark distribution:
152152

153153
```bash
154-
wget https://github.com/4paradigm/spark/releases/download/v3.2.1-openmldb0.8.2/spark-3.2.1-bin-openmldbspark.tgz
154+
wget https://github.com/4paradigm/spark/releases/download/v3.2.1-openmldb0.8.3/spark-3.2.1-bin-openmldbspark.tgz
155155
```
156156

157157
Alternatively, you can also download the source code and compile from scratch:

docs/en/deploy/install_deploy.md

Lines changed: 34 additions & 34 deletions
Original file line numberDiff line numberDiff line change
@@ -52,17 +52,17 @@ If your operating system is not mentioned above or if you want to compile from s
5252

5353
### Linux Platform Compatibility pre-test
5454

55-
Due to the variations among Linux platforms, the distribution package may not be entirely compatible with your machine. Therefore, it's recommended to conduct a preliminary compatibility test. Download the pre-compiled package `openmldb-0.8.2-linux.tar.gz`, and execute:
55+
Due to the variations among Linux platforms, the distribution package may not be entirely compatible with your machine. Therefore, it's recommended to conduct a preliminary compatibility test. Download the pre-compiled package `openmldb-0.8.3-linux.tar.gz`, and execute:
5656

5757
```
58-
tar -zxvf openmldb-0.8.2-linux.tar.gz
59-
./openmldb-0.8.2-linux/bin/openmldb --version
58+
tar -zxvf openmldb-0.8.3-linux.tar.gz
59+
./openmldb-0.8.3-linux/bin/openmldb --version
6060
```
6161

6262
The result should display the version number of the program, as shown below:
6363

6464
```
65-
openmldb version 0.8.2-xxxx
65+
openmldb version 0.8.3-xxxx
6666
Debug build (NDEBUG not #defined)
6767
```
6868

@@ -177,9 +177,9 @@ DataCollector and SyncTool currently do not support one-click deployment. Please
177177
### Download OpenMLDB
178178

179179
```
180-
wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.2/openmldb-0.8.2-linux.tar.gz
181-
tar -zxvf openmldb-0.8.2-linux.tar.gz
182-
cd openmldb-0.8.2-linux
180+
wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.3/openmldb-0.8.3-linux.tar.gz
181+
tar -zxvf openmldb-0.8.3-linux.tar.gz
182+
cd openmldb-0.8.3-linux
183183
```
184184

185185
### Environment Configuration
@@ -188,7 +188,7 @@ The environment variables are defined in `conf/openmldb-env.sh`, as shown in the
188188

189189
| Environment Variable | Default Value | Note |
190190
| --------------------------------- | ------------------------------------------------------- | ------------------------------------------------------------ |
191-
| OPENMLDB_VERSION | 0.8.2 | OpenMLDB version |
191+
| OPENMLDB_VERSION | 0.8.3 | OpenMLDB version |
192192
| OPENMLDB_MODE | standalone | standalone or cluster |
193193
| OPENMLDB_HOME | root directory of the release folder | openmldb root directory |
194194
| SPARK_HOME | $OPENMLDB_HOME/spark | openmldb spark root directory,If the directory does not exist, it will be downloaded automatically.|
@@ -361,10 +361,10 @@ Note that at least two TabletServer need to be deployed, otherwise errors may oc
361361
**1. Download the OpenMLDB deployment package**
362362

363363
```
364-
wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.2/openmldb-0.8.2-linux.tar.gz
365-
tar -zxvf openmldb-0.8.2-linux.tar.gz
366-
mv openmldb-0.8.2-linux openmldb-tablet-0.8.2
367-
cd openmldb-tablet-0.8.2
364+
wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.3/openmldb-0.8.3-linux.tar.gz
365+
tar -zxvf openmldb-0.8.3-linux.tar.gz
366+
mv openmldb-0.8.3-linux openmldb-tablet-0.8.3
367+
cd openmldb-tablet-0.8.3
368368
```
369369

370370
**2. Modify the configuration file `conf/tablet.flags`**
@@ -427,12 +427,12 @@ For clustered versions, the number of TabletServers must be 2 or more. If there'
427427

428428
To start the next TabletServer on a different machine, simply repeat the aforementioned steps on that machine. If starting the next TabletServer on the same machine, ensure it's in a different directory, and do not reuse a directory where the TabletServer is already running.
429429

430-
For instance, you can decompress the package again (avoid using a directory where TabletServer is already running, as files generated after startup may be affected), and name the directory `openmldb-tablet-0.8.2-2`.
430+
For instance, you can decompress the package again (avoid using a directory where TabletServer is already running, as files generated after startup may be affected), and name the directory `openmldb-tablet-0.8.3-2`.
431431

432432
```
433-
tar -zxvf openmldb-0.8.2-linux.tar.gz
434-
mv openmldb-0.8.2-linux openmldb-tablet-0.8.2-2
435-
cd openmldb-tablet-0.8.2-2
433+
tar -zxvf openmldb-0.8.3-linux.tar.gz
434+
mv openmldb-0.8.3-linux openmldb-tablet-0.8.3-2
435+
cd openmldb-tablet-0.8.3-2
436436
```
437437

438438
Modify the configuration again and start the TabletServer. Note that if all TabletServers are on the same machine, use different port numbers to avoid "Fail to listen" error in the log (`logs/tablet.WARNING`).
@@ -450,10 +450,10 @@ Please ensure that all TabletServer have been successfully started before deploy
450450
**1. Download the OpenMLDB deployment package**
451451

452452
````
453-
wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.2/openmldb-0.8.2-linux.tar.gz
454-
tar -zxvf openmldb-0.8.2-linux.tar.gz
455-
mv openmldb-0.8.2-linux openmldb-ns-0.8.2
456-
cd openmldb-ns-0.8.2
453+
wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.3/openmldb-0.8.3-linux.tar.gz
454+
tar -zxvf openmldb-0.8.3-linux.tar.gz
455+
mv openmldb-0.8.3-linux openmldb-ns-0.8.3
456+
cd openmldb-ns-0.8.3
457457
````
458458

459459
**2. Modify the configuration file conf/nameserver.flags**
@@ -498,12 +498,12 @@ You can have only one NameServer, but if you need high availability, you can dep
498498

499499
To start the next NameServer on another machine, simply repeat the above steps on that machine. If starting the next NameServer on the same machine, ensure it's in a different directory and do not reuse the directory where NameServer has already been started.
500500

501-
For instance, you can decompress the package again (avoid using the directory where NameServer is already running, as files generated after startup may be affected) and name the directory `openmldb-ns-0.8.2-2`.
501+
For instance, you can decompress the package again (avoid using the directory where NameServer is already running, as files generated after startup may be affected) and name the directory `openmldb-ns-0.8.3-2`.
502502

503503
```
504-
tar -zxvf openmldb-0.8.2-linux.tar.gz
505-
mv openmldb-0.8.2-linux openmldb-ns-0.8.2-2
506-
cd openmldb-ns-0.8.2-2
504+
tar -zxvf openmldb-0.8.3-linux.tar.gz
505+
mv openmldb-0.8.3-linux openmldb-ns-0.8.3-2
506+
cd openmldb-ns-0.8.3-2
507507
```
508508

509509
Then modify the configuration and start.
@@ -544,10 +544,10 @@ Before running APIServer, ensure that the TabletServer and NameServer processes
544544
**1. Download the OpenMLDB deployment package**
545545

546546
```
547-
wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.2/openmldb-0.8.2-linux.tar.gz
548-
tar -zxvf openmldb-0.8.2-linux.tar.gz
549-
mv openmldb-0.8.2-linux openmldb-apiserver-0.8.2
550-
cd openmldb-apiserver-0.8.2
547+
wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.3/openmldb-0.8.3-linux.tar.gz
548+
tar -zxvf openmldb-0.8.3-linux.tar.gz
549+
mv openmldb-0.8.3-linux openmldb-apiserver-0.8.3
550+
cd openmldb-apiserver-0.8.3
551551
```
552552

553553
**2. Modify the configuration file conf/apiserver.flags**
@@ -607,18 +607,18 @@ You can have only one TaskManager, but if you require high availability, you can
607607
Spark distribution:
608608

609609
```shell
610-
wget https://github.com/4paradigm/spark/releases/download/v3.2.1-openmldb0.8.2/spark-3.2.1-bin-openmldbspark.tgz
611-
# Image address (China):http://43.138.115.238/download/v0.8.2/spark-3.2.1-bin-openmldbspark.tgz
610+
wget https://github.com/4paradigm/spark/releases/download/v3.2.1-openmldb0.8.3/spark-3.2.1-bin-openmldbspark.tgz
611+
# Image address (China):http://43.138.115.238/download/v0.8.3/spark-3.2.1-bin-openmldbspark.tgz
612612
tar -zxvf spark-3.2.1-bin-openmldbspark.tgz
613613
export SPARK_HOME=`pwd`/spark-3.2.1-bin-openmldbspark/
614614
```
615615

616616
OpenMLDB deployment package:
617617
```
618-
wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.2/openmldb-0.8.2-linux.tar.gz
619-
tar -zxvf openmldb-0.8.2-linux.tar.gz
620-
mv openmldb-0.8.2-linux openmldb-taskmanager-0.8.2
621-
cd openmldb-taskmanager-0.8.2
618+
wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.3/openmldb-0.8.3-linux.tar.gz
619+
tar -zxvf openmldb-0.8.3-linux.tar.gz
620+
mv openmldb-0.8.3-linux openmldb-taskmanager-0.8.3
621+
cd openmldb-taskmanager-0.8.3
622622
```
623623

624624
**2. Modify the configuration file conf/taskmanager.properties**

docs/en/quickstart/openmldb_quickstart.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -19,7 +19,7 @@ This article is developed and deployed based on OpenMLDB CLI, and it is necessar
1919
Execute the following command in the command line to pull the OpenMLDB image and start the Docker container:
2020

2121
```bash
22-
docker run -it 4pdosc/openmldb:0.8.2 bash
22+
docker run -it 4pdosc/openmldb:0.8.3 bash
2323
```
2424

2525
``` {note}

docs/en/quickstart/sdk/java_sdk.md

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -10,12 +10,12 @@
1010
<dependency>
1111
<groupId>com.4paradigm.openmldb</groupId>
1212
<artifactId>openmldb-jdbc</artifactId>
13-
<version>0.7.2</version>
13+
<version>0.8.3</version>
1414
</dependency>
1515
<dependency>
1616
<groupId>com.4paradigm.openmldb</groupId>
1717
<artifactId>openmldb-native</artifactId>
18-
<version>0.7.2</version>
18+
<version>0.8.3</version>
1919
</dependency>
2020
```
2121

@@ -27,16 +27,16 @@
2727
<dependency>
2828
<groupId>com.4paradigm.openmldb</groupId>
2929
<artifactId>openmldb-jdbc</artifactId>
30-
<version>0.7.2</version>
30+
<version>0.8.3</version>
3131
</dependency>
3232
<dependency>
3333
<groupId>com.4paradigm.openmldb</groupId>
3434
<artifactId>openmldb-native</artifactId>
35-
<version>0.7.2-macos</version>
35+
<version>0.8.3-macos</version>
3636
</dependency>
3737
```
3838

39-
Note: Since the openmldb-native package contains the C++ static library compiled for OpenMLDB, it is defaults to the Linux static library. For macOS, the version of openmldb-native should be changed to `0.7.2-macos`, while the version of openmldb-jdbc should remain unchanged.
39+
Note: Since the openmldb-native package contains the C++ static library compiled for OpenMLDB, it is defaults to the Linux static library. For macOS, the version of openmldb-native should be changed to `0.8.3-macos`, while the version of openmldb-jdbc should remain unchanged.
4040

4141
The macOS version of openmldb-native only supports macOS 12. To run it on macOS 11 or macOS 10.15, the openmldb-native package needs to be compiled from source code on the corresponding OS. For detailed compilation methods, please refer to [Concurrent Compilation of Java SDK](https://openmldb.ai/docs/zh/main/deploy/compile.html#java-sdk).
4242

docs/en/reference/ip_tips.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -38,12 +38,12 @@ Expose the port through `-p` when starting the container, and the client can acc
3838

3939
The stand-alone version needs to expose the ports of three components (nameserver, tabletserver, apiserver):
4040
```
41-
docker run -p 6527:6527 -p 9921:9921 -p 8080:8080 -it 4pdosc/openmldb:0.8.2 bash
41+
docker run -p 6527:6527 -p 9921:9921 -p 8080:8080 -it 4pdosc/openmldb:0.8.3 bash
4242
```
4343

4444
The cluster version needs to expose the zk port and the ports of all components:
4545
```
46-
docker run -p 2181:2181 -p 7527:7527 -p 10921:10921 -p 10922:10922 -p 8080:8080 -p 9902:9902 -it 4pdosc/openmldb:0.8.2 bash
46+
docker run -p 2181:2181 -p 7527:7527 -p 10921:10921 -p 10922:10922 -p 8080:8080 -p 9902:9902 -it 4pdosc/openmldb:0.8.3 bash
4747
```
4848

4949
```{tip}
@@ -57,7 +57,7 @@ If the OpenMLDB service process is distributed, the "port number is occupied" ap
5757
#### Host Network
5858
Or more conveniently, use host networking without port isolation, for example:
5959
```
60-
docker run --network host -it 4pdosc/openmldb:0.8.2 bash
60+
docker run --network host -it 4pdosc/openmldb:0.8.3 bash
6161
```
6262
But in this case, it is easy to find that the port is occupied by other processes in the host. If occupancy occurs, change the port number carefully.
6363

docs/en/use_case/JD_recommendation_en.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -52,7 +52,7 @@ Oneflow-serving:https://github.com/Oneflow-Inc/serving/tree/ce5d667468b6b3ba66
5252
Pull the OpenMLDB docker image and run.
5353

5454
```bash
55-
docker run -dit --name=openmldb --network=host -v $demodir:/work/oneflow_demo 4pdosc/openmldb:0.8.2 bash
55+
docker run -dit --name=openmldb --network=host -v $demodir:/work/oneflow_demo 4pdosc/openmldb:0.8.3 bash
5656
docker exec -it openmldb bash
5757
```
5858

0 commit comments

Comments
 (0)