💫 Patch v1.1.5

Release Note (1.1.5)

Release time: 2021-04-11 23:04:49

🙇 We'd like to thank all contributors for this new release! In particular,
Han Xiao, Jina Dev Bot, 🙇

🐞 Bug fixes

• [084c4300] - cicd: add submodule into docker images (Han Xiao)

🍹 Other Improvements

• [4a2fbae5] - version: the next version will be 1.1.5 (Jina Dev Bot)

💫 Patch v1.1.4

Release Note (1.1.4)

Release time: 2021-04-11 10:58:39

🙇 We'd like to thank all contributors for this new release! In particular,
Han Xiao, Jina Dev Bot, 🙇

🆕 New Features

• [d89564d7] - rest: expose reload api to rest interface (#2301) (Han Xiao)

🍹 Other Improvements

• [c6ca3c8f] - version: the next version will be 1.1.4 (Jina Dev Bot)

💫 Patch v1.1.3

Release Note (1.1.3)

Release time: 2021-04-11 08:51:28

🙇 We'd like to thank all contributors for this new release! In particular,
Han Xiao, Jina Dev Bot, Kelton Zhang, Fionn Delahunty, Wang Bo, Florian Hönicke, 🙇

🆕 New Features

• [5fbc30aa] - add link to run in colab (#2270) (Fionn Delahunty)

🐞 Bug fixes

• [103bf2f5] - client: remove sibling setting in client (#2300) (Han Xiao)

🚧 Code Refactoring

• [c8fb6b67] - merge batching decorators (#2269) (Kelton Zhang)

📗 Documentation

• [e537a928] - pod (#2282) (Florian Hönicke)

🏁 Unit Test and CICD

• [e5737589] - fix hanging tests (#2285) (Han Xiao)
• [e5f647f2] - fix slow tests in ci (#2276) (Wang Bo)

🍹 Other Improvements

• [605c090d] - contributor: update contributors (Jina Dev Bot)
• [387939b9] - fix code snippet (Han Xiao)
• [5dcaf9b0] - docs: update TOC (Jina Dev Bot)
• [d24d97ca] - version: the next version will be 1.1.3 (Jina Dev Bot)

💫 Patch v1.1.2

Release Note (1.1.2)

Release time: 2021-04-04 23:04:22

🙇 We'd like to thank all contributors for this new release! In particular,
Han Xiao, Jina Dev Bot, 🙇

🆕 New Features

• [9c9ad173] - flow: add reload api to flow (#2278) (Han Xiao)

🚧 Code Refactoring

• [1fa761f8] - proto: devices now explict rename as targets (#2280) (Han Xiao)

🍹 Other Improvements

• [88ac3a97] - contributor: update contributors (Jina Dev Bot)
• [9097bc12] - fix readme (Han Xiao)
• [f4508315] - docs: update TOC (Jina Dev Bot)
• [8a03b013] - version: the next version will be 1.1.2 (Jina Dev Bot)

💫 Patch v1.1.1

Release Note (1.1.1)

Release time: 2021-04-02 08:23:14

🙇 We'd like to thank all contributors for this new release! In particular,
Han Xiao, Florian Hönicke, Wang Bo, Yongxuan Zhang, David Buchaca Prats, Jina Dev Bot, Alex Cureton-Griffiths, Joan Fontanals, Carlos B, cristian, 🙇

🆕 New Features

• [56bdf8b5] - driver: add whoosh driver for april fool (#2273) (Han Xiao)
• [62281281] - router cancel request (#2257) (Florian Hönicke)
• [0946a46e] - pod: add reload mechanism to pod (#2261) (Han Xiao)
• [917de4bc] - all pea ids start at 0 (#2243) (cristian)

🐞 Bug fixes

• [ff2e9a5e] - remove wrong commit file (#2277) (Han Xiao)
• [d9ca73d5] - put siblings back (#2234) (Florian Hönicke)
• [6cf76246] - import warnings verbose off by default (#2271) (David Buchaca Prats)
• [226b99e5] - helper: threadpool to simple thread (#2272) (Han Xiao)
• [e7131d12] - readme: emoji table to list. fixes heading issues (#2264) (Alex Cureton-Griffiths)
• [afb3ce3b] - helper: fetching external ip is extremely slow (#2267) (Han Xiao)
• [ec55e7d1] - fix script in README (#2256) (Carlos B)

🚧 Code Refactoring

• [c8610558] - readme: simplification and content update (#2244) (Alex Cureton-Griffiths)
• [4fa7af22] - remove unnecessary code (#2258) (Joan Fontanals)

📗 Documentation

• [cb21d427] - enums (#2274) (Florian Hönicke)

🏁 Unit Test and CICD

• [2c963037] - use latest endpoint for tests (#2251) (Wang Bo)
• [6cbcc459] - document: add plot test (#2245) (Yongxuan Zhang)

🍹 Other Improvements

• [82013083] - fix readme (Han Xiao)
• [1c9e3840] - helper: revert get ip (#2275) (Han Xiao)
• [33b91e03] - contributor: update contributors (Jina Dev Bot)
• [547ad96e] - release-notes: update image (#2262) (Alex Cureton-Griffiths)
• [ed61f67a] - update readme (Han Xiao)
• [971d8c1d] - docs: update TOC (Jina Dev Bot)
• [679d58b9] - version: the next version will be 1.1.1 (Jina Dev Bot)

🎉 Jina 1.1

Jina 1.1

We are excited to release Jina 1.1 Jina is the easier way to do neural search in the cloud.

⬆️ Major Features and Improvements

Permanently delete documents from storage.

When you delete a Document, you’d er kinda expect it to disappear right? Previously in Jina we only marked those Documents as inaccessible’ and you had to completely reindex your entire dataset to actually remove them. From version 1.1 onwards, if you set the delete_on_dump value to true in your YAML files, deleted documents will be truly deleted when the flow is restarted. You can find out more about this in our CRUD documentation. Thanks to the community members who requested this feature, and to our engineers who found out that CRUD is actually kinda hard to build than expected. (Related PRs: #2046, #2102, #2150, #2144 )

Distributed Remote Peas in a single Pod.

As users of Jina will know, it is possible to have multiple Peas running inside a single Pod. As of 1.1, it is now possible to distribute these Peas across remote locations. Using JinaD, you could have two Peas running on one machine, and a third Pea running on a remote machine. The machine could be located on a sunny beach in the mediterranean drinking cocktails. sorry lost my train of thought. Anyway, load balancing will always be handled automatically by the Headpea! For information on how to implement this feature, check out Development Guide: Peas and Pods in Jina.. (Related PRs: #2143, #2241)

Support to learning-to-rank models

You’re running an e-commerce site, your user searches for black shoes, Jina finds one hundred black shoes in your database. For users who don’t have two hundred pairs of feet, how best do you display these one hundred results?

It’s common in the industry to use learning algorithms to rank these ranks based on the users' clicking behaviors. You can now use your LightGBMRanker decision tree in jina! To find out how check out the Jina Hub documentation. (Related PRs: #1953)

Support YAML IntelliSense to make writing YAML configurations easier.

Life is hard enough these days, but we at Jina are trying to make it as easy for you as possible and hopefully bring some joy into your life.
This month we made it even easier for you to write YAML files to create Jina flows. We now provide a JSON Schema for your IDE to enable code completion, syntax validation, members listing, and displaying help text. Here is a video tutorial to walk you through the setup. If you need more happiness then this, we suggest going for a walk in the sun 🌞 (Related PRs: #2059, #2066)

Better performance when applying functions recursively on Documents.

The ability to recursively break down Documents is a core feature of Jina. If you have photos containing families of cats, but want to search individual cats, you can segment and chunk on these images. Increasing accuracy for your system and making cat lovers around the world happy.

🏎️ These operations are now faster and have improved performance. Our team moved the traversing logic into the primitive types and adapted batching logic accordingly. #1950, #2145, #2196

⚠️ Breaking Changes

• Remove the CLI option --optimize-level #1975
• Remove unused pipeline encoder #2033
• Replace is_merge argument with is_update in KVSearchDriver. #1296
• Add update method to Document for updating the object. #1296
• Refactor CLI for running jina hello-world. jina hello-world is deprecated. jina hello mnist, jina hello chat-bot are added. #1985
• Remove PipeLogger #2003
• Add keyword jtype to represent YAML tag #2044, 2061
• Replace DockerKwargsAppendAction with KVAppendAction in CLI #2050
• Rename --silent-remote-logs to --quiet-remote-logs. #2122

📗 Documentation

• Improve the docstring and reach docstring coverage to 100% 🥳. #1915, #1922, #1927, #1928 #1941, #1924, #1969, #1977, #1976, #1968, #2015, #2040, #2055, #2136, #2148, #2153, #2158, #2159, #2174, #2190
• Fix the noqa issue in documentation. #1955, #1961
• Fix the precommit installation guide. #1944
• Fix the links in README and CONTRIBUTE #1965, #2021, #2125 @atibaup
• Fix the typos in README.md #2013
• Improve READMe #2030

🐞 Bug Fixes and Other Changes

Flow

• Improve the typing in sugary_io.py. #2049
• Add support to specify hosts for peas #2143 #2241

Executors

• Replace field argument in DocCache with fields to support caching with multiple fields as key. #1970, #2032
• Fix the issue of closing loggers #2019
• Refactor input_fn to inputs. #2054
• Enable the usage of dynamic workspace for indexers. #2114
• Fix the typos in the column names in BaseRanker #1973
• Refactor fill-in drivers logic. #2134
• Avoid dumping drivers when storing executors. #2133
• Fix a bug in passing metavar #2155

Drivers

• Add fields argument to RankEvaluateDriver so that one can pass multiple fields to rankers. #1953
• Add into Drivers support to match_required_keys and query_required_keys in Executors. #1947
• Add fields argument to BasePredictDriver to enable the usage of either embedding or content of Documents when doing classification #1957, #1995
• Remove the inheritance of RecursiveMixin in RecursiveMixin #1980

Types

• Add convert_buffer_image_to_blob, convert_uri_to_blob and convert_data_uri_to_blob to Document for converting data to blob. #1929, #1930, #1982
• Refactor warnings when drivers failed to read Document into Document #1930
• Move queryset from jina/drivers to jina/types #1933
• Remove the legacy traverse function from Document #2017
• Keep the mime type of the matches as the same as the reference Document instead of the query Document #2025
• Enable to extract arbitrary attributes from Document by Drivers #2110, #2192

Tests

• Refactor tests/unit/drivers/querylang/test_querylang_drivers.py to use types. #1963
• Add unit tests for JsonFormatter and ProfileFormatter #1983
• Add unit tests for request_generator in jina.clients.request.asyncio #1992
• Add more unit tests for Flow #1991
• Add unit tests for profiling #2016
• Fix doc generator in the unit tests of Flow #2008
• Add more unit tests for Document #2012
• Add more unit tests for hubio #1972
• Add more unit tests for types/score #2029
• Add unit tests for ImportChecker #2042
• Add tests for BaseMindsporeEncoder. #2058
• Add integration tests for RESTful APIs. #2104
• Refactor unit tests for RankDriver #2135
• Remove folder after unit tests for CRUD. #2162
• Add unit tests for Pods. #2164
• Add integration tests for jina hello. #2218

HubIO

• Add support to select Dockerfile #2056
• Add support to multistage Dockerfile #2037

Others

• Add pre-commit hooks for docstrings #1925, #1962
• Add logging to the HubIO #1923
• Add use_default keyword under requests to executors YAML configs. When use_default: true, we explicitly use the default setting under jina/resources; Add with keyword under each request type to avoid repeating configuration for different drivers. #1959, #1967, #2053
• Fix CI to exit elegantly when a failure generates #1990
• Add codecov for daemon #1993
• Add darglint to check docstring during CI #2007, #2035, #2048, #2045, #2199
• Add jina hello fashion as a multimodal search example #2002
• Fix the RESTful API documentation in openapi #1994
• Add JINA_LOG_CONFIG environment variable and add quite argument for JinaLogger. When setting JINA_LOG_CONFIG= QUIET, quite mode is used for logging. #2004
• Replace --hide-exc-info with --quiet-error in CLI; add --description to check show descriptions of the object in CLI #2005
• Refactor the hello-world file structure #2010
• Remove the unused codes #2041
• Fix representation for eum when dumping #2047
• Add shell checker for colab #2052
• Add deployment for cloud.jina.ai in automated release. #2099
• Add context manager for BaseFlow to solve the broken CI #2100
• Add black to make the code styling consistent #2036, #2117, #2211
• Enable pydantic-based json schema for REST APIs. #2121, #2146
• Refactor the typing in jina/clients. #2014
• Remove the deprecated NTLogger. #2138
• Refactor the NotImplementedError usage. #2147
• Improve the package importing error processing using the context manage ImportExtensions. #2204, #2237,
• Refactor the functions in Zmqlet #2208
• Add PngToDiskDriver for debugging purpose #2209
• Add unit tests for ZMQManyRuntime #2230

🙏 Thanks to our Contributors

This release contains contributions from @cristianmtr @hanxiao @JoanFM @florian-hoenicke @nan-wang @Yongxuanzhang @bwanglzu @alexcg1 @deepampatel @LukeekuL @deepankarm @davidbp @FionnD @theUnkownName @atibaup

🙏 Thanks to our Community

And thanks to all of you out there as well! Without you Jina couldn't do what we do. Your support means a lot to us.

🤝 Work with Jina

Want to work ...

💫 Patch v1.0.16

Release Note (1.0.16)

Release time: 2021-03-28 23:03:56

🙇 We'd like to thank all contributors for this new release! In particular,
Jina Dev Bot, David Buchaca Prats, cristian, Wang Bo, CatStark, 🙇

🆕 New Features

• [13ca1a80] - support for sparse arrays in documents (#2207) (David Buchaca Prats)
• [2fe2fe82] - add pngtodisk driver (#2209) (cristian)

🐞 Bug fixes

• [f2def8a4] - proper usage of importextensions (#2237) (cristian)
• [2be26c6d] - pytorch sparse ndarray constructor (#2233) (Wang Bo)
• [9b3ab472] - test expects files with contents (#2221) (cristian)

🏁 Unit Test and CICD

• [1c9949ca] - add zmq runtime test (#2230) (Wang Bo)
• [3d1b9548] - add regression for chatbot (#2218) (Wang Bo)
• [8b80cec6] - assert there are no embeddings by default (#2229) (CatStark)

🍹 Other Improvements

• [d0e4ae94] - contributor: update contributors (Jina Dev Bot)
• [72e5c838] - docs: update TOC (Jina Dev Bot)
• [576a3c86] - version: the next version will be 1.0.16 (Jina Dev Bot)

💫 Patch v1.0.15

Release Note (1.0.15)

Release time: 2021-03-23 15:21:28

🙇 We'd like to thank all contributors for this new release! In particular,
Han Xiao, Jina Dev Bot, 🙇

🏁 Unit Test and CICD

• [e0edf3bd] - fix broken tests (#2227) (Han Xiao)

🍹 Other Improvements

• [8be28cfe] - version: the next version will be 1.0.15 (Jina Dev Bot)

💫 Patch v1.0.14

Release Note (1.0.14)

Release time: 2021-03-23 10:23:21

🙇 We'd like to thank all contributors for this new release! In particular,
Deepankar Mahapatro, Rutuja Surve, Han Xiao, cristian, Jina Dev Bot, 🙇

🆕 New Features

• [e4bda7a8] - hub: jina hub build now recognizes class name (Han Xiao)

🐞 Bug fixes

• [19da13c1] - hub: raise exception for all status except 200 (#2225) (Deepankar Mahapatro)
• [0f8981ec] - rename convert driver (#2226) (Rutuja Surve)

🏁 Unit Test and CICD

• [3ce26090] - remove untested (#2222) (cristian)

🍹 Other Improvements

• [9a837294] - contributor: update contributors (Jina Dev Bot)
• [ba702b49] - docs: update TOC (Jina Dev Bot)
• [e76e888f] - version: the next version will be 1.0.14 (Jina Dev Bot)

💫 Patch v1.0.13

Release Note (1.0.13)

Release time: 2021-03-21 23:13:14

🙇 We'd like to thank all contributors for this new release! In particular,
Fionn Delahunty, Han Xiao, Wang Bo, Jina Dev Bot, 🙇

🆕 New Features

• [5c5cfefa] - docs: added link to CRUD docs (#2217) (Fionn Delahunty)
• [7c658a06] - jaml: allow loading from flatten Flow yaml (#2216) (Han Xiao)
• [3879045e] - flow: allow uses for Executor class (#2215) (Han Xiao)

🏁 Unit Test and CICD

• [8fc7b7f4] - regression test for three examples (#2205) (Wang Bo)

🍹 Other Improvements

• [27d43199] - fix issue guide (Han Xiao)
• [25905ac2] - fix requirements (Han Xiao)
• [3514bf17] - contributor: update contributors (Jina Dev Bot)
• [9584302e] - docs: update TOC (Jina Dev Bot)
• [497a026f] - version: the next version will be 1.0.13 (Jina Dev Bot)