init

Author: qinwf

.Rbuildignore

@@ -0,0 +1,2 @@
+^.*\.Rproj$
+^\.Rproj\.user$

.gitignore

@@ -0,0 +1,3 @@
+.Rproj.user
+.Rhistory
+.RData

DESCRIPTION

@@ -0,0 +1,15 @@
+Package: jiebaRD
+Type: Package
+Title: Chinese Text Segmentation Data for jiebaR Package
+Description: jiebaR is a package for Chinese text segmentation, keyword extraction
+   and speech tagging. This package provide the data files required by jiebaR.
+Version: 0.1
+Date: 2015-01-03
+Author: Qin Wenfeng
+Maintainer: Qin Wenfeng <[email protected]>
+License: MIT + file LICENSE
+Suggests:
+    jiebaR
+URL: https://github.com/qinwf/jiebaRD/
+BugReports: https://github.com/qinwf/jiebaRD/issues
+NeedsCompilation: no

LICENSE

@@ -0,0 +1,2 @@
+YEAR: 2014-2015
+COPYRIGHT HOLDER: Qin Wenfeng

NAMESPACE

@@ -0,0 +1 @@
+exportPattern("^[[:alpha:]]+")

R/jiebaRD-package.r

@@ -0,0 +1,17 @@
+#' A package for Chinese text segmentation
+#'
+#' jiebaR is a package for Chinese text segmentation, keyword extraction
+#' and speech tagging. This package provide the data files required by jiebaR.
+#' jiebaR supports four types of segmentation mode: Maximum Probability, Hidden Markov Model,
+#' Query Segment and Mix Segment.
+#'
+#' You can use custom dictionary to be included in the jiebaR default dictionary.
+#' jiebaR can also identify new words, but adding your own new words will ensure a higher
+#' accuracy.
+#'
+#' @docType package
+#' @name jiebaRD
+#' @author Qin Wenfeng <\url{http://qinwenfeng.com}>
+#' @references CppJieba \url{https://github.com/aszxqw/cppjieba};
+#' @seealso JiebaR \url{https://github.com/qinwf/jiebaR};
+NULL

inst/dict/README.md

@@ -0,0 +1,31 @@
+# CppJieba字典
+
+文件后缀名代表的是词典的编码方式。
+比如filename.utf8 是 utf8编码，filename.gbk 是 gbk编码方式。
+
+
+## 分词
+
+### jieba.dict.utf8/gbk
+
+作为最大概率法(MPSegment: Max Probability)分词所使用的词典。
+
+### hmm_model.utf8/gbk
+
+作为隐式马尔科夫模型(HMMSegment: Hidden Markov Model)分词所使用的词典。
+
+__对于MixSegment(混合MPSegment和HMMSegment两者)则同时使用以上两个词典__
+
+
+## 关键词抽取
+
+### idf.utf8
+
+IDF(Inverse Document Frequency)
+在KeywordExtractor中，使用的是经典的TF-IDF算法，所以需要这么一个词典提供IDF信息。
+
+### stop_words.utf8
+
+停用词词典
+
+