Skip to content

Commit

Permalink
split 分かり切る
Browse files Browse the repository at this point in the history
  • Loading branch information
tshatrov committed Jul 22, 2020
1 parent 5c3e488 commit 7c2b2ee
Show file tree
Hide file tree
Showing 2 changed files with 5 additions and 0 deletions.
4 changes: 4 additions & 0 deletions dict-split.lisp
Original file line number Diff line number Diff line change
Expand Up @@ -623,6 +623,10 @@
(1896380 1)
(2728200))

(def-simple-split nil 1606530 100 (len txt) ;; わかりきる
(("分かり" 1606560) 3)
(1384830 nil t))

;; SEGMENT SPLITS (allows to expand one segment into several, e.g. "ところが" "ところ+が")

(defparameter *segsplit-map* (make-hash-table)) ;; seq -> split function
Expand Down
1 change: 1 addition & 0 deletions tests.lisp
Original file line number Diff line number Diff line change
Expand Up @@ -534,6 +534,7 @@
(assert-segment "口論のあげくに殴り合いになった" "口論" "" "あげく" "" "殴り合い" "" "なった")
(assert-segment "お手数おかけします" "お手数" "おかけします")
(assert-segment "30分後におかけ直しください" "30分" "" "" "" "かけ直し" "ください")
(assert-segment "わかりきった" "わかりきった")
)

(define-test json-consistency-test
Expand Down

0 comments on commit 7c2b2ee

Please sign in to comment.