Miller 6.1.0: natural sort, true TSV, sliding-window averages, and more #978

johnkerl announced in Announcements

johnkerl
Mar 7, 2022
Maintainer

Features

Major features:

Natural sort by @johnkerl in Natural sort #932
mlr split verb by @johnkerl in mlr split verb #898
Make TSV finally true TSV by @johnkerl in Make TSV finally true TSV #923
Sliding window averages by @johnkerl in Sliding window averages #894
Implement shift-lead option for mlr step by @johnkerl in Implement shift-lead option for mlr step #893

New DSL functions:

New fmtifnum DSL function; make fmtnum/fmtifnum recursive over maps and arrays by @johnkerl in New fmtifnum DSL function; make fmtnum/fmtifnum recursive over maps and arrays #946
New unformat DSL function by @johnkerl in New unformat DSL function #871
New format DSL function by @johnkerl in New format DSL function #869
New concat DSL function for arrays by @johnkerl in New concat DSL function for arrays #868

DSL improvements:

Support more Go regex patterns, like "\d" by @johnkerl in Support more Go regex patterns, like "\d" #974
Include \U support in addition to \u for DSL Unicode string literals by @johnkerl in Include \U support in addition to \u for DSL Unicode string literals #917
Support unicode literals in the Miller DSL by @johnkerl in Support unicode literals in the Miller DSL #916
Allow 0o... octal literals in the DSL by @johnkerl in Allow 0o... octal literals in the DSL #864

New command-line flags:

Add --left-keep-fields option for mlr join by @johnkerl in Add --left-keep-fields option for mlr join #967
New --lazy-quotes flag for helping with malformed CSV by @johnkerl in New --lazy-quotes flag for helping with malformed CSV #925

REPL and on-line help:

Let :resetblocks/:rb in the REPL take optional begin/main/end by @johnkerl in Let :resetblocks/:rb in the REPL take optional begin/main/end #924
Add :resetblocks / :rb to REPL by @johnkerl in Add :resetblocks / :rb to REPL #920
?foo and ??foo for :help foo / :help find foo in the REPL by @johnkerl in ?foo and ??foo for :help foo / :help find foo in the REPL #915

Improvements and bugfixes

Support Latin-1 supplement a0-ff as DSL string literals by @johnkerl in Support Latin-1 supplement a0-ff as DSL string literals #957
Fix "%%" in strptime; more test cases for strptime by @johnkerl in Fix "%%" in strptime; more test cases for strptime #951
Support %F, %T, and more in strptime by @johnkerl in Support %F, %T, and more in strptime #944
Fix handling of mlr nest abbrevs by @johnkerl in Fix handling of mlr nest abbrevs #937
Add Inf and NaN literals to the DSL by @johnkerl in Add Inf and NaN literals to the DSL #933
Boolean inference for issue 908 by @johnkerl in Boolean inference for issue 908 #931
strptime %j format for 3-digit day in year by @johnkerl in strptime %j format for 3-digit day in year #930
Fix is_non_empty for absent case by @johnkerl in Fix is_non_empty for absent case #928
--nidx --fs x should be the same as --fs x --nidx by @johnkerl in --nidx --fs x should be the same as --fs x --nidx #912
Update default colorization by @johnkerl in Update default colorization #904
Make is_null/is_not_null DSL functions include new JSON-null type by @johnkerl in Make is_null/is_not_null DSL functions include new JSON-null type #883
Fix [mlr 6] Interaction of ANSI color sequences and quoting, for some values of OFS #853 by @johnkerl in Fix #853 #860

Documentation

New doc page: Parsing and formatting fields by @johnkerl in New doc page: Parsing and formatting fields #973
More doc material for :context in the REPL by @johnkerl in More doc material for :context in the REPL #966
Fix typo in on-line help for splitax DSL function by @johnkerl in Fix typo in on-line help for splitax DSL function #964
More doc-sites for the funct keyword by @johnkerl in More doc-sites for the funct keyword #963
Doc updates for funct keyword by @johnkerl in Doc updates for funct keyword #961
FAQ entry for DSL: how to apply math to gsub regex output? #351 by @johnkerl in FAQ entry for #351 #958
docs: add Poshi as a contributor for doc by @allcontributors in docs: add Poshi as a contributor for doc #956
docs: add schragge as a contributor for doc by @allcontributors in docs: add schragge as a contributor for doc #955
FAQ entry for Useful for a FAQ item? Apply DSL to CSV field names #285: carriage returns in field names by @johnkerl in FAQ entry for #285: carriage returns in field names #953
Add --implicit-tsv-header as alias for --implicit-csv-header, etc by @johnkerl in Add --implicit-tsv-header as alias for --implicit-csv-header, etc #952
Fix: multiple documentation tweaks by @Poshi in Fix: multiple documentation tweaks #949
fix typo in reference-verbs.md by @zachvalenta in fix typo in reference-verbs.md #945
Add on mouse over permalink anchor for titles by @aborruso in Add on mouse over permalink anchor for titles #942
Webdoc information on Unicode string literals by @johnkerl in Webdoc information on Unicode string literals #935
'mlr help function nonesuch' should not be silent by @johnkerl in 'mlr help function nonesuch' should not be silent #934
Clarify strftime on-line help by @johnkerl in Clarify strftime on-line help #929
Expand on-line help for split* DSL functions by @johnkerl in Expand on-line help for split* DSL functions #927
On-line help for -s flag by @johnkerl in On-line help for -s flag #926
Multiple on-line-help issues from Documentation of flatten and split*/join* #908 by @johnkerl in Multiple on-line-help issues from #908 #921
Multiple on-line-help issues from Documentation of flatten and split*/join* #908 by @johnkerl in Multiple on-line-help issues from #908 #913
Fix operator-precedence doc table to match DSL grammar by @johnkerl in Fix operator-precedence doc table to match DSL grammar #911
Fix multiple on-line-help issues from Documentation of operators #907 by @johnkerl in Fix multiple on-line-help issues from #907 #910
Clarify source for printf-style formatting by @johnkerl in Clarify source for printf-style formatting #895
Fix Recursive help command #891 by @johnkerl in Fix #891 #892
Improve mlr top documentation for Does it work the "-o" flag in top verb? #861 by @johnkerl in Improve mlr top documentation for #861 #875
Continue Fix typo: columnn -> column #856 by @johnkerl in Continue #856 #865
misspelling by @Gary-Armstrong in misspelling #863
fix typo by @vapniks in fix typo #862
Update installing-miller.md by @jauderho in Update installing-miller.md #859
Emit notes by @johnkerl in Emit notes #858
Conda/Docker install notes by @johnkerl in Conda/Docker install notes #857
Fix typo: columnn -> column by @vapniks in Fix typo: columnn -> column #856
Fix typo by @vapniks in Fix typo #855
Fix typo by @vapniks in Fix typo #854
A small typo by @aborruso in a small typo #846

Code quality

Code-dedupe logic for array slices and string slices by @johnkerl in Code-dedupe logic for array slices and string slices #960
Let mlr repl print empty strings by @johnkerl in Let mlr repl print empty strings #959
Neaten strptime.go by @johnkerl in Neaten strptime.go #950
More dead code removal by @skitt in More dead code removal #905
Remove unreachable code by @skitt in Remove unreachable code #903
Use int64 wherever "64-bit integer" is assumed by @skitt in Use int64 wherever "64-bit integer" is assumed #902
More of Specify constant types except with iota #884: types in enum-consts by @johnkerl in More of #884: types in enum-consts #887
Clean up file output handler error handling by @skitt in Clean up file output handler error handling #886
Use raw strings to avoid escapes by @skitt in Use raw strings to avoid escapes #885
Specify constant types except with iota by @skitt in Specify constant types except with iota #884
Mlrval arrayval from []Mlrval to []*Mlrval by @johnkerl in Mlrval arrayval from []Mlrval to []*Mlrval #880
Append slices directly instead of looping by @skitt in Append slices directly instead of looping #879
Fix mlrmap.Equals FieldCount comparison by @skitt in Fix mlrmap.Equals FieldCount comparison #878
Ensure regression-test has a binary to test by @skitt in Ensure regression-test has a binary to test #877
Avoid assuming ./mlr is the mlr to test by @skitt in Avoid assuming ./mlr is the mlr to test #876
Update release.yml by @jauderho in Update release.yml #867
Update .goreleaser.yml by @jauderho in Update .goreleaser.yml #866
Goreleaser binary names by @johnkerl in Goreleaser binary names #852
Add CodeQL support by @jauderho in Add CodeQL support #838

New Contributors

@vapniks made their first contribution in Fix typo #854
@Gary-Armstrong made their first contribution in misspelling #863
@zachvalenta made their first contribution in fix typo in reference-verbs.md #945
@Poshi made their first contribution in Fix: multiple documentation tweaks #949

Plans for 6.2.0

Extended JSON-style field accessors for verbs: How to navigate inside JSON hierarchy? #763 and Calling fields by ID #948
AWK-like exit DSL function: How to exit like awk? #341
DSL strict mode: [feature request] Strict mode #440
YAML support: Feature request for the 6 version: add YAML format support #614
Datediff: [feature request] datediff et al. #708
Rank: Rank #383

Full Changelog: v6.0.0...v6.1.0

This discussion was created from the release Natural sort, true TSV, sliding-window averages, and more.

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment