What's new in 7.0.0
====================
Merge to upstream Subversion revision 715; upstream code changelog:
- New APIs for ShortNumberInfo. The old APIs have been deprecated and will be
removed in an upcoming release.
Release 4.0.8 - 2014/11/29
--------------------------
Improvements
^^^^^^^^^^^^
* [deb] Supported Ubuntu 12.04 again because Travis-CI runs on it.
* [mruby] Supported pretty print - ``"pp"`` for debugging. And supported to
show internal objects more descriptive format when inspecting it.
* Supported full text search query without index if one column is specified
for ``--match_columns`` even though sequential search is executed
by ``--query`` and ``--match_columns`` combination.
[groonga-dev,02902] [Reported by Atsushi Shinoda]
* [experimental] :doc:`/reference/functions/in_values` supports auto sequential
search mode. There is a case that sequential search is faster than index search when
the number of narrowed down records is small enough in contrast to
the number of expected records to narrow down by ``in_values`` with
``AND`` operation which use indexes.
The value of ``GRN_IN_VALUES_TOO_MANY_INDEX_MATCH_RATIO`` is used as
threshold whether Groonga execute sequential search or search with indexes in
such a case.
* [mruby] Supported to load relative path of script.
* Supported test suite to write query optimizer test more easily with
mruby enabled build.
* Supported offline index construction for token filters.
[GitHub#239] [Patch by Naoya Murakami]
* [experimental] :doc:`/reference/functions/between` supports auto sequential search mode.
Use the value of ``GRN_BETWEEN_TOO_MANY_INDEX_MATCH_RATIO`` as threshold.
Basic concept is similar to ``GRN_IN_VALUES_TOO_MANY_INDEX_MATCH_RATIO``.
* [experimental] Supported multiple drilldowns for :doc:``/reference/command/select``
command. The syntax is extended to support this feature. The new one is
``--drilldown[LABEL1].keys COLUMN1,COLUMN2`` for keys,
``--drilldown[LABEL1].output_columns _value.COLUMN1,_value.COLUMN2,_nsubrecs`` for output columns.
In the previous versions, a client application must implement by oneself for drilldown
by multiple keys. Use ``_key[N]`` for ``--drilldown[LABEL1].output_columns`` to show
original value of key in records.
* Supported to search ``'reference_column @ "query"'`` without index.
* [experimental] Added :doc:`/reference/commands/range_filter` command. It is faster than select
command to fetch specific range of records in most cases, because it doesn't returns
the number of matched records. There are limitations which doesn't support drilldown and so on.
Thus, ``range_filter`` is suitable for extracting first ``N`` records in specific range for ranking
or something else.
* [httpd] Supported ``groonga-httpd`` on windows.
* Supported vector column for drilldown.
* [deb] Changed ``groonga-httpd`` as default HTTP server package.
``groonga-server-http`` is deprecated. Note that :doc:`/reference/executables/groonga-server-http`
functionality itself is still exists in Groonga. If you just want to use simple HTTP server
in traditional way, specify proper arguments by command line for :doc:`/reference/executables/groonga`.
* Added configuration file for Windows CI on AppVeyor.
[groonga-dev,02970,02981] [Patch by Hiroshi Hatake]
Fixes
^^^^^
* [doc] Fixed duplicated execution example path about
:doc:`/reference/commands/table_create`.
[GitHub groonga.org#14] [Reported by Masafumi Yokoyama]
* Fixed a bug that nested indexed full text search against ``X._key``
returns empty results.
* Fixed flags parameter which is strict in BSD ``mkostemp(3)``.
[GitHub#240] [Patch by Jun Kuriyama]
* Fixed a bug that select command reports invalid value type (table)
as index column value type. It was fixed to ``UInt32``.
Note that it affects only the value of response header.
The search results is not changed at all.
* Fixed a bug that compare operations such as ``<``, ``<=``, ``>``, ``>=``, ``!=`` with
Time and String type returns invalid results.
* Fixed a bug that prefix search can't be executed against single character such as
``"x*"``. [GitHub#242] [Patch by Naoya Murakami]
* Fixed a memory leak on drilldown ``ShortText`` value with ``--filter``.
* Fixed missing ``","`` for ``"DDL:set_token_filters"`` log.
[Reported by Naoya Murakami]
Thanks
^^^^^^
* Atsushi Shinoda
* Masafumi Yokoyama
* Naoya Murakami
* Jun Kuriyama
* Hiroshi Hatake
Changelog:
=======================================================================
* Major changes in release 0.45 (2013-08-21)
po4a:
* Fix usage of File::Temp::tempfile to allow using Perl >= 5.18.
Asciidoc:
* Make it a standalone format.
Docbook:
* Make <beginpage> inline.
Ini:
* Add key parameter as an automatic comment. This allows using
po4a-gettextize on ini files.
LaTeX:
* Fix handling of optional parameters in newtheorem command.
Po:
* Fix computation of timezone written into PO files.
Sgml:
* Fix failing tests with recent Docbook DTD.
=======================================================================
* Major changes in release 0.44 (2012-10-21)
translations:
* Start of Portuguese translation
=======================================================================
* Major changes in release 0.43 (2012-10-17)
po4a:
* Add --porefs option to change how file locations are written into
the POT file (and thus into the PO files also).
po4a-updatepo po4a Po:
* Extend the --porefs option, add a new 'counter' value to replace
line number by an increasing counter.
An optional ",nowrap" or ",wrap" specifier can be added to tell
whether file locations are written on a single line or wrapped on
several lines. Default is ",nowrap", it will be changed to ",wrap"
in a future release.
Man:
* Make .UR/.UE macros inline.
* Add macros used in several NetBSD man pages: %I %U Brc Bro Lp Lk
Text:
* Fix two line titles in AsciiDoc format.
* Let AsciiDoc format handle many more styles.
* Add support for automatic comments in AsciiDoc format.
=======================================================================
* Major changes in release 0.42 (2012-05-16)
po4a:
* Allow adding command-line options after config file.
Text:
* Add support for control files.
msguntypot:
* Do not remove obsolete entries from PO files.
documentation translations:
* New German translations
* Updated Spanish translations
* Updated French translations
* Updated Japanese translations
* Updated Polish translations
=======================================================================
* Major changes in release 0.41 (2010-12-01)
po4a-updatepo:
* --previous flag was not passed to msgmerge
po4a:
* Do no more generate backups for PO files.
* Fix the --srcdir option, master file was not found.
* Expand variables when reading @-prefixed addenda files.
Text:
* Remove trailing newline in titles from PO files
Packaging:
* Remove Makefile, all processing is performed by Build.PL
=======================================================================
* Major changes in release 0.40.2 (2010-11-30)
documentation:
* Improve English style (following recommendations from man(7))
translations:
* Start of Danish translation
* Removal of Arabic translation, only one string was translated
* Updated Vietnamese translation
* Updated Slovenian translation
* Updated Basque translation
* Updated French translation
* Updated Japanese translation
* Updated Czech translation
* Updated German translation
* Updated Ukrainian translation
* Updated Esperanto translation
* Updated Estonian translation
* Updated Russian translation
documentation translations:
* Updated Spanish translations
* Updated French translations
* Updated Japanese translations
* Updated Polish translations
=======================================================================
* Major changes in release 0.40.1 (2010-08-25)
Po:
* Change header entry to be consistent with xgettext when creating
POT files: replace Content-Transfer-Encoding: ENCODING" by
"Content-Transfer-Encoding: 8bit\n" and add a Language field.
documentation:
* Improve English style (proper casing, replace cvs by VCS, etc).
translations:
* Updated French translations
* Updated Spanish translations
* Updated Japanese translations
* Updated Esperanto translations
* Updated Swedish translations
* Updated Russian translations
* Updated Estonian translations
* Updated Ukrainian translations
* Updated Czech translations
* Updated Portuguese translations
* Updated German translations
Project resources:
* We migrated from CVS to SVN. All CVS history has been converted.
See http://svn.debian.org/viewsvn/po4a/
The standard SVN layout is used (with top-level /trunk, /branches
and /tags directories), and the files to generate the website
(html/, po/html.cfg and po/www) are moved into a new /web
top-level directory.
=======================================================================
* Major changes in release 0.40 (2010-07-27)
po4a-gettextize:
* When it fails, recode msgstr into current charset before
printing it.
Text:
* Fix failures "Unknown option: copyright-holder"
Man:
* Support font modifiers in the form \f(XX and \f[FONT-NAME]
=======================================================================
* Major changes in release 0.39 (2010-02-02)
po4a
* New syntax for addenda, path may be preceded by modifiers.
=======================================================================
* Major changes in release 0.38 (2010-01-14)
po4a
* Exit with an error if master file specified in a po4a configuration
file does not exist.
po4a, po4a-updatepo:
* --previous is activated by default.
* Use --no-previous to support versions of gettext earlier than 0.16.
Xml:
* Fix handling of multi-lines placeholder tags.
* New option addlang.
Pod:
* Detect the encoding based on the input's =encoding line.
=======================================================================
* Major changes in release 0.37.1 (2009-11-22)
po4a-build:
* Fix UTF8 handling and names of perl modules for section 3.
* Fix bug that caused translated manpages to be overwritten.
=======================================================================
* Major changes in release 0.37.0 (2009-11-20)
po4a-build:
* New script for one-stop generation of untranslated and translated
documentation from DocBook XML and POD sources.
translations:
* Updated Spanish translations.
===============================================================================
* Major changes in release 0.36.6 (2009-11-07)
Text:
* Added options breaks and tabs.
po4aman-display-po
* Fixed bashism.
translations:
* Added Vietnamese translation
* Updated Czech translation
* Updated Spanish translation of the documentation
===============================================================================
* Major changes in release 0.36.5 (2009-09-10)
Sgml:
* Fix detection of entities in the prolog.
translations:
* Updated German translation
* Updated Portuguese translation
===============================================================================
* Major changes in release 0.36.4 (2009-08-30)
po4a
* Added options --srcdir and --destdir. They permit to strip the base
directory for the input and output documents (in the config file and in
the references generated in the PO files).
po4a-updatepo
* Added options --msgid-bugs-address, --copyright-holder, --package-name,
--package-version to control the generation of the PO header.
translations:
* Updated Basque translation
* Updated Czech translation
* Updated Esperanto translation
* Improved Estonian translation.
* Updated French translation
* Updated Russian translation
* Updated Spanish translation.
* Updated Swedish translation.
===============================================================================
* Major changes in release 0.36.3 (2009-07-22)
Bug fix release.
po4a-gettextize's new options were rejected by the modules.
===============================================================================
* Major changes in release 0.36.2 (2009-07-21)
po4apod-display-po
* New script to display previews of POD translations.
po4a-gettextize
* Added options --msgid-bugs-address, --copyright-holder, --package-name,
--package-version to control the generation of the PO header.
Text:
* Avoid the translation of some markups: title and horizontal rules.
* Improved Markdown support.
Xml:
* New option customtag for inline tags that should not be treated as a
tag (e.g. they do not need to be closed).
Wml:
* Fix handling of non ASCII input documents.
===============================================================================
* Major changes in release 0.36.1 (2009-04-05)
TeX:
* Fix support for inline customization of separators.
* Fix support for double escapes, which should not introduce commands.
LaTeX:
* Added support for the tabularx environment.
Xml:
* Do not include commented out external entities (when includeexternal is
used).
Pod:
* Do not add an =encoding header if the encoding is empty.
===============================================================================
* Major changes in release 0.36 (2009-03-15)
general:
* The "type:" comments in the PO files are now tagged as extracted
comments (starting with #.). This changes all the PO files generated by
po4a. Maintainers should just let these changes pass through.
Translator may want to remove the comment lines starting with '# type:'
as they will be duplicates with the '#. type:' comments.
Xml:
* Placeholders are presented with a type and have a more valid XML
representation. This changes the PO files, but translations could be
updated automatically.
* Do not fail when the doctype does not match the expected one. Only
issue a warning.
* The tags and tagsonly options are deprecated. Use the
translated/untranslated and break/inline/placeholder options instead.
* Added foldattributes option. Useful to simplify strings and avoid typos
when attributes shall not be translated.
Man:
* Better handling of spaces in command arguments.
TeX:
* Included files are searched with kpsewhich instead of using TEXINPUTS
directly.
===============================================================================
* Major changes in release 0.35 (2009-02-10)
po4a
* Added support for the [po_directory] command in the configuration file.
It permits to avoid listing the supported languages. Simply dropping a
new PO file should be sufficient. It should be preferred over the
po4a_langs and po4a_paths commands.
po4a-normalize:
* Added option -b, --blank to check which parts of a document are not
translated.
po4a-gettextize:
* Improved conflict handling: indicate the reference of the alternatives
when the same string has different translations.
general:
* Added support for a nowrapi18n option in Locale::Po4a::Common in
order to use Locale::Po4a programatically.
packaging:
* Manpages are generated in utf-8. This requires a recent Pod::Man with
support for the utf8 option.
Docbook:
* Improved support for Docbook 5 and Docbook 4, based on the official
documentation of the Docbook tags.
Pod:
* Announce the encoding in the POD header.
Sgml:
* Add support for recursive inclusion.
Text:
* Added option asciidoc
Xhtml:
* Improvements for the <u> tag.
xml:
* Fix the nodefault option. Derivative modules should use _default_tags
and _default_inline to define the default behavior of their
module-specific tags (instead of tags and inline).
* Speed improvements.
* Added support for placeholders.
===============================================================================
* Major changes in release 0.34 (2008-07-20)
** New features
general:
* Do not end re-wrapped lines with a space.
halibut:
* Added support for the Halibut format.
sgml:
* Fix failures with big sgml documents ("broken pipe" received from
nsgmls -p).
text:
* Added support for the Markdown format, as used with Ikiwiki.
* Make sure files are not mixed together when gettextized at the same
time.
packaging:
* Fix build failures with old versions of Module::Build.
===============================================================================
* Major changes in release 0.33.3 (2008-04-02)
po4a:
* Add options --package-name and --package-version (similar to xgettext's
options).
translations:
* Actually ship Japanese translations.
===============================================================================
* Major changes in release 0.33.2 (2008-04-01)
text:
* Added support for the fortunes format.
translations:
* New Japanese translation.
* The manpages are generated in UTF-8.
===============================================================================
* Major changes in release 0.33.1 (2008-03-16)
This is a bug fix release.
man:
* Do not translate - to \- inside \*[...], \(.., \H'...', or \Z'...'.
xml:
* Do not translate SSI comments by default.
packaging:
* Fix the installation path of manpages and .mo files.
===============================================================================
* Major changes in release 0.33 (2008-03-03)
Notes to packagers: Since 0.31, some tests in the sgml testsuite require
the docbook sgml DTD. If you run the testsuite at build time you must have
these DTD in your build dependencies or you must disable these tests
cases in the testsuite.
** New features
general: Support for PO files with plural forms.
Po4a does not generate such PO files, but it can receive one in
input. In such case, po4a cannot choose between the (singular
and) plural forms. It will consider that msgstr[0] is the
translation of msgid and msgstr[1] is the translation of
msgid_plural, which may be wrong. Thus, a warning will be
issued if po4a is asked to translate the singular or plural
form of a message with plural forms.
texinfo: Major changes. Tested on the elisp documentation.
sgml: Fail if nsgmls cannot validate the input file. This can be turned
off with the "force" option.
xml: New option "cpp" to support C preprocessor directives (this avoids
re-wrapping lines with preprocessor directives).
xml: New options "translated" and "untranslated" that should allow an
easier configuration of Xml (and derivative module)
xml: Avoid duplicated newlines at the end of lines of multi-lines
comments.
xml: Paragraphs which only consist in an inline tag are now extracted.
This makes a lot of string to available for translation in the PO
file.
docbook: Tested on the Docbook testsuite. Lots of tag added.
po4a: Fix failures with perl 5.10. Thanks to Roderich Schupp
<roderich.schupp@googlemail.com>
msguntypot: Fix handling of the comment of the PO header.
===============================================================================
* Major changes in release 0.32 (2007-08-15)
** Security fix
Fix a symlink attack caused by the /tmp/gettextization.failed.po
temporary file.
(CVE-2007-4462)
** Bug fixes
sgml: The handling of newlines was broken in no-wrap sections in 0.31
xhtml: The module is now distributed as the other modules.
texinfo: Fix infinite loop when a command parameter ends with \
(as in @samp{\})
** New features
xml: New option includeexternal to support external entities.
texinfo: Added support for many commands and environment (see
changelog).
xhtml: New option includessi, which adds supports for Server Side
Includes include element (<!--#include virtual="/foo/bar.html" -->).
xml: New option ontagerror to control the behavior of the module in case
of error. This permits to support files that the module would
consider invalid otherwise.
** Translations
New translations (Bengali, Estonian, Croatian, Indonesian, Kannada,
Korean, Occitan, Uzbek, Simplified Chinese, Chinese from Hong Kong) and
many updates.
===============================================================================
* Major changes in release 0.31 (2007-05-07)
** Dependencies
po4a,
po4a-updatepo: New option --previous requires gettext 0.16.
** Bug fixes
general: Don't hang when running in background with redirected stdout.
Thanks to Jim Meyering.
** New features
general: po4a now uses timestamps to avoid re-generating a translation
if no changes are expected: if a translation is more recent
than its associated PO, master document, addenda or
configuration file, then there is no need to update it. For the
documents which do not pass the translation threshold, a
--stamp option was added to tell po4a to create files with a
.po4a-stamp extension (you can also create them manually).
This can save a lot of time when po4a knows that the
translation will not be generated because there were no changes
since the last po4a run.
general: Beginning of a C extension. This provides speedup. Testers are
welcomed.
po4a: New options: --msgid-bugs-address and --copyright-holder.
po4a: Add new tag: [options] to set global options (i.e. for every
documents in the configuration file).
po4a: Update translations based on modification times. Use timestamp to
avoid retrying generate uncompleted translations.
man: New 'unknown_macros' option to specify the behavior of po4a with
unknown groff macros.
man: Reset the configuration between two runs. This permits to define
different options for different files in a config file with the
opt:"..." parameters.
===============================================================================
* Major changes in release 0.30 (2007-01-05)
** Bug fixes
man: Recode the text which is skipped, like comments.
This kind of issue may also appear on other modules.
A better solution would be to always use UTF-8 internally.
distribution: Some unit tests were missing.
Also, the dependencies have been simplified.
Locale::gettext, Text::WrapI18N, Term::ReadKey and SGMLS
are still recommended, but no more required.
The BibTex module is now distributed.
sgml: The module should be more friendly with XML files.
po4a: When po4a creates a new PO file, it now uses msginit. This may
change the header of created PO files.
guide: Major update of the tag definitions. Thanks to Azamat H.
Hackimov.
Po: use strftime instead of date because date is not available on
every platform.
tests: rename the XML testsuite to SGML, since it was testing the Sgml
module, and add a new testsuite for the Xml module (it currently
tests the Guide module).
** Translations
Updated Russian translation.
===============================================================================
* Major changes in release 0.29 (2006-10-15)
** New features
** Bug fixes
sgml: Remove the tags from the default categories when they are defined
by the user. This changes the behavior of the Sgml module's options.
sgml: Better line references in the generated PO.
sgml: Support for '/>' (empty XML tag closure) when an xml prologue is
found (<?xml ...?>).
po4a: When po4a create new PO files, it now uses msginit instead of
copying the POT file.
===============================================================================
* Major changes in release 0.29 (2006-10-15)
** New features
New module for .INI files. Thanks to Costin Stroie.
New module for BibTeX bibliographies.
man: New mdoc option for stricter support of mdoc pages (NAME section
not translated).
text: Support for underlined text.
text: Support for bulleted paragraphs (can be deactivated with
-o nobullets).
** Bug fixes
man: Keep empty commented lines.
man: Do not add spaces at the end of lines.
man: Languages without non breaking space could not use question marks.
sgml: Better support for verbatim sections, and consider <cmdsynopsis>
as verbatim. <arg> and <option> are now in the ignore category.
general: Length calculation algorithm changed for wrapping lines in the
output document or in the PO. This should improve output when files are
encoded in UTF-8.
===============================================================================
* Major changes in release 0.28 (2006-08-17)
** Bug fixes
man: Fix for .I " " and other minor bug fixes.
tex/latex: Documentation and usability improvements.
** Speed improvement
po4a: The POs are now only read once. This will speed the processing
when many documents are specified in a configuration file.
** Translations
Updated French translation.
Changelog:
* Noteworthy changes in release 2.21 (2014-11-23) [stable]
** Improvements
Performance has been greatly improved for searching files containing
holes, on platforms where lseek's SEEK_DATA flag works efficiently.
Performance has improved for rejecting data that cannot match even
the first part of a nontrivial pattern.
Performance has improved for very long strings in patterns.
If a file contains data improperly encoded for the current locale,
and this is discovered before any of the file's contents are output,
grep now treats the file as binary.
grep -P no longer reports an error and exits when given invalid UTF-8 data.
Instead, it considers the data to be non-matching.
** Bug fixes
grep no longer mishandles patterns that contain \w or \W in multibyte
locales.
grep would fail to count newlines internally when operating in non-UTF8
multibyte locales, leading it to print potentially many lines that did
not match. E.g., the command, "seq 10 | env LC_ALL=zh_CN src/grep -n .."
would print this:
1:1
2
3
4
5
6
7
8
9
10
implying that the match, "10" was on line 1.
[bug introduced in grep-2.19]
grep -F -x -o no longer prints an extra newline for each match.
[bug introduced in grep-2.19]
grep in a non-UTF8 multibyte locale could mistakenly match in the middle
of a multibyte character when using a '^'-anchored alternate in a pattern,
leading it to print non-matching lines. [bug present since "the beginning"]
grep -F Y no longer fails to match in non-UTF8 multibyte locales like
Shift-JIS, when the input contains a 2-byte character, XY, followed by
the single-byte search pattern, Y. grep would find the first, middle-
of-multibyte matching "Y", and then mistakenly advance an internal
pointer one byte too far, skipping over the target "Y" just after that.
[bug introduced in grep-2.19]
grep -E rejected unmatched ')', instead of treating it like '\)'.
[bug present since "the beginning"]
On NetBSD, grep -r no longer reports "Inappropriate file type or format"
when refusing to follow a symbolic link.
[bug introduced in grep-2.12]
** Changes in behavior
The GREP_OPTIONS environment variable is now obsolescent, and grep
now warns if it is used. Please use an alias or script instead.
In locales with multibyte character encodings other than UTF-8,
grep -P now reports an error and exits instead of misbehaving.
When searching binary data, grep now may treat non-text bytes as
line terminators. This can boost performance significantly.
grep -z no longer automatically treats the byte '\200' as binary data.
* Noteworthy changes in release 2.20 (2014-06-03) [stable]
** Bug fixes
grep --max-count=N FILE would no longer stop reading after the Nth match.
I.e., while grep would still print the correct output, it would continue
reading until end of input, and hence, potentially forever.
[bug introduced in grep-2.19]
A command like echo aa|grep -E 'a(b$|c$)' would mistakenly
report the input as a matched line.
[bug introduced in grep-2.19]
** Changes in behavior
grep --exclude-dir='FOO/' now excludes the directory FOO.
Previously, the trailing slash meant the option was ineffective.
3.4.1 (2014-11-20)
==================
Features added
--------------
* New ``htmlfile`` HTML generator to accompany the incremental ``xmlfile``
serialisation API. Patch by Burak Arslan.
Bugs fixed
----------
* ``lxml.sax.ElementTreeContentHandler`` did not initialise its superclass.
- Added textile command-line tool submitted by Amir Karger.
- Applied a patch submitted by Serap Kadam for issues with parsing
whitespace around '!' characters.
- Applied a patch submitted by Andy Yacomink for handling mixed-case
HTML entity names.
- Applied a patch submitted by Andy Yacomink for running some of
the inline modifier code as a separate method to allow for a
subclass to override/prevent them.
* Add field number to error_diag
* Fixed non-IO parsing multi-byte EOL
* Fixed a possible missed multi-byte EOL
* Allow hashref for csv ()'s headers attribute
* Allow encoding on all output handles in csv ()
* Include doc changes as ticketed in the Text::CSV queue
* Fix parallel testing issue
* Allow csv as method call (not using the object)
* Rename quote_null to escape_null
* Give meaning to keep_meta_info on output
Version 2.0
-----------
(released Nov 9, 2014)
- Default lexer encoding is now "guess", i.e. UTF-8 / Locale / Latin1 is
tried in that order.
- Major update to Swift lexer (pull request #410).
- Multiple fixes to lexer guessing in conflicting cases:
* recognize HTML5 by doctype
* recognize XML by XML declaration
* don't recognize C/C++ as SystemVerilog
- Simplified regexes and builtin lists.
Version 2.0rc1
--------------
(released Oct 16, 2014)
- Dropped Python 2.4 and 2.5 compatibility. This is in favor of single-source
compatibility between Python 2.6, 2.7 and 3.3+.
- New website and documentation based on Sphinx (finally!)
- Lexers added:
* APL (#969)
* Agda and Literate Agda (pull request #203)
* Alloy (pull request #355)
* AmbientTalk
* BlitzBasic (pull request #197)
* ChaiScript (pull request #24)
* Chapel (pull request #256)
* Cirru (pull request #275)
* Clay (pull request #184)
* ColdFusion CFC (pull request #283)
* Cryptol and Literate Cryptol (pull request #344)
* Cypher (pull request #257)
* Docker config files
* EBNF (pull request #193)
* Eiffel (pull request #273)
* GAP (pull request #311)
* Golo (pull request #309)
* Handlebars (pull request #186)
* Hy (pull request #238)
* Idris and Literate Idris (pull request #210)
* Igor Pro (pull request #172)
* Inform 6/7 (pull request #281)
* Intel objdump (pull request #279)
* Isabelle (pull request #386)
* Jasmin (pull request #349)
* JSON-LD (pull request #289)
* Kal (pull request #233)
* Lean (pull request #399)
* LSL (pull request #296)
* Limbo (pull request #291)
* Liquid (#977)
* MQL (pull request #285)
* MaskJS (pull request #280)
* Mozilla preprocessors
* Mathematica (pull request #245)
* NesC (pull request #166)
* Nit (pull request #375)
* Nix (pull request #267)
* Pan
* Pawn (pull request #211)
* Perl 6 (pull request #181)
* Pig (pull request #304)
* Pike (pull request #237)
* QBasic (pull request #182)
* Red (pull request #341)
* ResourceBundle (#1038)
* Rexx (pull request #199)
* Rql (pull request #251)
* Rsl
* SPARQL (pull request #78)
* Slim (pull request #366)
* Swift (pull request #371)
* Swig (pull request #168)
* TADS 3 (pull request #407)
* Todo.txt todo lists
* Twig (pull request #404)
- Added a helper to "optimize" regular expressions that match one of many
literal words; this can save 20% and more lexing time with lexers that
highlight many keywords or builtins.
- New styles: "xcode" and "igor", similar to the default highlighting of
the respective IDEs.
- The command-line "pygmentize" tool now tries a little harder to find the
correct encoding for files and the terminal (#979).
- Added "inencoding" option for lexers to override "encoding" analogous
to "outencoding" (#800).
- Added line-by-line "streaming" mode for pygmentize with the "-s" option.
(pull request #165) Only fully works for lexers that have no constructs spanning
lines!
- Added an "envname" option to the LaTeX formatter to select a replacement
verbatim environment (pull request #235).
- Updated the Makefile lexer to yield a little more useful highlighting.
- Lexer aliases passed to ``get_lexer_by_name()`` are now case-insensitive.
- File name matching in lexers and formatters will now use a regex cache
for speed (pull request #205).
- Pygments will now recognize "vim" modelines when guessing the lexer for
a file based on content (pull request #118).
- Major restructure of the ``pygments.lexers`` module namespace. There are now
many more modules with less lexers per module. Old modules are still around
and re-export the lexers they previously contained.
- The NameHighlightFilter now works with any Name.* token type (#790).
- Python 3 lexer: add new exceptions from PEP 3151.
- Opa lexer: add new keywords (pull request #170).
- Julia lexer: add keywords and underscore-separated number
literals (pull request #176).
- Lasso lexer: fix method highlighting, update builtins. Fix
guessing so that plain XML isn't always taken as Lasso (pull request #163).
- Objective C/C++ lexers: allow "@" prefixing any expression (#871).
- Ruby lexer: fix lexing of Name::Space tokens (#860) and of symbols
in hashes (#873).
- Stan lexer: update for version 2.4.0 of the language (pull request #162, PR#255, PR#377).
- JavaScript lexer: add the "yield" keyword (pull request #196).
- HTTP lexer: support for PATCH method (pull request #190).
- Koka lexer: update to newest language spec (pull request #201).
- Haxe lexer: rewrite and support for Haxe 3 (pull request #174).
- Prolog lexer: add different kinds of numeric literals (#864).
- F# lexer: rewrite with newest spec for F# 3.0 (#842), fix a bug with
dotted chains (#948).
- Kotlin lexer: general update (pull request #271).
- Rebol lexer: fix comment detection and analyse_text (pull request #261).
- LLVM lexer: update keywords to v3.4 (pull request #258).
- PHP lexer: add new keywords and binary literals (pull request #222).
- external/markdown-processor.py updated to newest python-markdown (pull request #221).
- CSS lexer: some highlighting order fixes (pull request #231).
- Ceylon lexer: fix parsing of nested multiline comments (#915).
- C family lexers: fix parsing of indented preprocessor directives (#944).
- Rust lexer: update to 0.9 language version (pull request #270, PR#388).
- Elixir lexer: update to 0.15 language version (pull request #392).
- Fix swallowing incomplete tracebacks in Python console lexer (#874).
[Changes contributed by Dmitry Karasik]
- Fix deliberate leaks in QueryParser::add_valuerangeprocessor() and
QueryParser::set_stopper() by tracking object ownership properly.
(ticket#647)
[Changes contributed by Olly Betts]
- Fix deliberate leaks in TermGenerator::set_stopper() and Enquire
methods which allow specifying a Sorter object similarly.
API:
* Xapian::BM5Weight:
+ Improve BM25 upper bound in the case when our wdf upper bound > our
document length lower bound. Thanks to Craig Macdonald for pointing out
this trick.
+ Pre-multiply termweight by (param_k1 + 1) rather than doing it for
every weighted term in every document considered.
testsuite:
* Don't report apparent leaks of fds opened on /dev/urandom - at least on
Linux, something in the C library seems to lazily open it, and the report of
a possible leak followed by assurance that it's OK really is just noise we
can do without.
matcher:
* Fix false matches reported for non-exact phrases in some cases. Fixes the
reduced testcase in #657, reported by Jean-Francois Dockes.
brass backend:
* Only full sync after writing the final base file (only affects Max OS X).
chert backend:
* Only full sync after writing the final base file (only affects Max OS X).
flint backend:
* Only full sync after writing the final base file (only affects Max OS X).
build system:
* For Sun's C++ compiler, pass -library=Crun separately since libtool looks for
" -library=stlport4 " (with the spaces). (fixes#650)
* Remove .replicatmp (created by the test suite) upon "make clean".
documentation:
* include/xapian/compactor.h: Fix formatting of doxygen comment.
* HACKING: freecode no longer accepts updates, so drop that item from the
release checklist.
* docs/overview.rst: Add missing database path to example of using
xapian-progsrv in a stub database file.
portability:
* Suppress unused typedef warnings from debugging logging macros, which occur
in functions which always exit via throwing an exception when compiling with
recent versions of GCC or clang.
* Fix debug logging code to compile with clang. (fixes#657, reported by
Germán M. Bravo)
debug code:
* Add missing RETURN() markup for debug logging in a few places, highlighted by
warnings from recent GCC.
* Fix incorrect return types in debug logging annotations so that code compiles
when configured with --enable-log.
Changes, apart from bugfixes,
include:
* Add `Xml_print.Utf8` to encode html elements to utf8 properly.
* Add signature functors to ease export of module created with the functorial interface.
See the manual for more details.
* Fix variance for Svg.attrib.
* Fix export of Xml.list_wrap for Html5.M and Svg.M. Should fix syntax extension with those.
* Remove Xhtml.
* Remove plus elements.
For example, table doesn't enforce non-emptyness anymore.
* Add various types that were not exported (img, dl, figure, rp, rt and ruby types).
* Expose `string_of_number`, the better stringifier introduced in 3.1.0.
* Functorial interface breaking changes:
* Modify the functorized interface to export typed events.
You can now specify different handlers for keyboard and mouse events.
There are two new types and functions (keyboard and mous events) in the Xml signature.
* Add a wrapping type for lists of nodes. See reactiveData and new eliom wrapping.
* Replace fake booleans (`\`True | \`False`) by actual booleans. Breaking change.
* Camlp4 is now an optional dependency. The syntax extension is build only when the syntax flag is enabled (true by default).
* Use a better stringifier for float values (copied from js_of_ocaml).
* Add attributes `muted`, `crossorigin` and `mediagroup` for `<audio>` and `<video>`.
* In the functorial interface, allow to wrap xml nodes inside a monad by provi
ding an additionnal wrapping module. Used by reactive nodes in eliom.
* Use oasis as build systems
* Adding module Unsafe for inserting missing nodes or attributes
* In the functorial interface, allow to wrap xml nodes inside a monad by provi
ding an additionnal wrapping module. Used by reactive nodes in eliom.
* Use oasis as build systems
* Adding module Unsafe for inserting missing nodes or attributes
Also that there is no new distfile, and that upstream was sent the
usual "lack of distfile considered harmful" message.
This package is a candidate for removal.
News
====
.. _release-4-0-7:
Release 4.0.7 - 2014/10/29
--------------------------
Improvements
^^^^^^^^^^^^
* [windows] Supported Groonga with mruby on Windows.
* Added token filter plugin API.
* Added :ref:`token-filter-stop-word` token filter plugin.
It treats records of ``is_stop_word`` column as actual stop words.
* [doc] Added :doc:`/client` section which introduces link to client libraries.
[GitHub#210] [Patch by Naoya Murakami]
* [doc] Reconstructed documentation. :doc:`/reference/suggest` and
:doc:`/reference/operations/geolocation_search` are grouped under :doc:`/reference`.
[GitHub#206] [Patch by Naoya Murakami]
* [dump] Supports to dump TABLE_NO_KEY for token_flters.
[GitHub#215] [Patch by Naoya Murakami]
* [deb] Added stop word token filter plugin.
[GitHub#216] [Patch by Hiroshi Hatake]
* [deb] Clarified licenses about used/bundled files in debian/copyright.
* Dropped LZO compression support.
* Added LZ4 compression support. [GitHub#223] [Patch by Naoya Murakami]
* Added :doc:`/reference/function/in_values`. We recommends to use it
instead of ``==`` and ``OR`` combinations ( ``((COLUMN == "a") OR
(COLUMN == "b") OR (COLUMN == "c"))`` ) because of better
performance.
* [load] Supported to update existing record in ``TABLE_NO_KEY`` by
specifying a record by ``_id``.
* Added :ref:`token-filter-stem` token filter plugin. It provides
stemming feature. To use this token filter, you need to install
`libstemmer <http://http://snowball.tartarus.org/>`_ library.
* [doc] Added :doc:`/reference/token_filters` documentation.
[GitHub#227] [Patch by Naoya Murakami]
Fixes
^^^^^
* [doc] Fixed link of the Ranguba project. [GitHub#212] [Patch by Naoya Murakami]
* [httpd] Updated bundled nginx version to 1.7.6.
[GitHub#208] [Patch by Hiroshi Hatake]
* [power8] Fixed build failure. See
http://lists.askmonty.org/pipermail/commits/2014-October/006752.html
[Patch by Sergey Vojtovich]
* Fixed a bug that URL encoding fails if ``char`` type is build as
``unsigned char`` type. [GitHub#217]
* Fixed a bug that a ``TABLE_DAT_KEY`` table returns empty results for
:doc:`/reference/commands/select`. [GitHub#220]
* Fixed a memory leak about inspecting vector column. It occurs when
something error reports about vector column.
* Fixed memory leaks in zlib/LZO compressed column [GitHub#221] [Patch
by Naoya Murakami]
* Fixed a bug that the value of ``Int8`` column which is less than 100 may
return true in ``--filter``. By this issue, not intended records may
be included as search results.
* Fixed to handle binary operation for vector column as an error.
* Fixed a bug that ``!XXX`` may return inverted result on big endian
environment.
* Fixed a memory leak on converting weight vector to text.
Thanks
^^^^^^
* Naoya Murakami
* Hiroshi Hatake
* Sergey Vojtovich
.. _release-4-0-6:
Release 4.0.6 - 2014/09/29
--------------------------
Improvements
^^^^^^^^^^^^
* [deb] Updated to follow the rule about machine-readable
debian/copyright file. [Reported by Hideki Yamane]
* [deb][rpm] Changed to use signal instead of HTTP to control nginx.
This way meets nginx style init script.
* [doc] Updated English documentation about [ :doc:`/reference/executables` ].
[GitHub#196] [Patch by Masafumi Yokoyama]
* [OS X] Added missing sphinx error message for Homebrew users.
[GitHub#198] [Patch by cosmo0920]
* [mruby] Query optimizer by mruby became a practical for some range select query.
For example, mruby optimizer overhead is negligible enough for query such as
"between(X, 0, 'exclude', 100, 'include')" - "X > 0 && X <= 100".
* [doc] Changed to recommend GitHub for reporting issues.
Until now, Redmine account must be approved by administrator, so you can not
report at feel free. [GitHub#202] [Patch by cosmo0920]
* [doc] Translated C API document. [GitHub#203] [Patch by NOKUBI Takatsugu]
* Supported to customize similarity threshold by ``'*S10"..."'`` syntax.
* Added source column validation to
:doc:`/reference/commands/column_create`. If source column doesn't
exist, :doc:`/reference/commands/column_create` returns ``false`` and
column isn't created.
* [debian] Dropped Debian jessie and sid support.
Fixes
^^^^^
* Fixed a bug that similar search doesn't use IDF (Inverse Document Frequency)
for choosing target tokens.
In the previous versions, it used token ID instead of IDF.
[groonga-dev,02731] [groonga-dev,02754] [Reported by Satoshi Mitani, warp kawada]
* Fixed a crash bug when deleting a record.
If the table of the record has ``_key`` and ``_key`` is
indexed from two or more index columns, deleting causes a crash.
* Fixed compiler warning about unused variable 'e'. [GitHub#197] [Patch by cosmo0920]
* [fedora][httpd] Fixed service start failure without log directory.
* [mruby] Fixed build error with ``--disable-mruby``.
[GitHub#200] [Patch by cosmo0920]
* Fixed build warning about CMP0014 for MariaDB bundled Mroonga package.
[GitHub#201] [Patch by cosmo0920]
* Fixed a bug that "*" is parsed as prefix search with empty string.
[groonga-dev,02796] [Reported by Kazuhiko]
* [httpd] Updated bundled nginx version to the latest mainline (1.7.5).
This update contains vulnerability fix (CVE-2014-3616).
Thanks
^^^^^^
* Hideki Yamane
* Masafumi Yokoyama
* cosmo0920
* NOKUBI Takatsugu
* Satoshi Mitani
* warp kawada
* Kazuhiko
:: Release 0.26.0
Fixes for ignores
Add markdown filetype
Add filetype completion for bash completion
:: Release 0.25.0
--vimgrep option added
Add less filetype
Add --null option to provide input to 'xargs -0'
Case insensitive matching is now the default
Add swift filetype
