some patches that have been migrated upstream.
Changes (bug numbers removed so they don't trigger our system) include:
(Changes that can break existing programs are marked with a "*")
### Language features:
- Support GADT equations on non-local abstract types
(Jacques Garrigue)
- Local opening of modules in a pattern.
Syntax: "M.(p)", "M.[p]","M.[| p |]", "M.{p}"
(Florian Angeletti, Jacques Garrigue, review by Alain Frisch)
- local exception declarations "let exception ... in"
(Alain Frisch)
- Allow shortcut for extension on semicolons: ;%foo
(Jeremie Dimino)
- optimized representation for immutable records with a single
field, and concrete types with a single constructor with a single argument.
This is triggered with a [@@unboxed] attribute on the type definition.
Currently mutually recursive datatypes are not well supported, this
limitation should be lifted in the future (see M).
(Damien Doligez)
### Compiler user-interface and warnings:
* interpret all command-line options before compiling any
files, changes (improves) the semantics of repeated -o options or -o
combined with -c see the super-detailed commit message at
da56cf6dfd
(whitequark)
- clarify the wording of Warning 38
(Unused exception or extension constructor)
(Gabriel Scherer)
* add colors when reporting errors generated by ppx rewriters.
Remove the `Location.errorf_prefixed` function which is no longer relevant
(Simon Cruanes, Jérémie Dimino)
- clarify the wording of Warning 8
(Non-exhaustivity warning for pattern matching)
(Florian Angeletti, review and report by Gabriel Scherer)
* Improve support for OCAMLPARAM: (i) do not use objects
files with -a, -pack, -shared; (ii) use "before" objects in the toplevel
(but not "after" objects); (iii) use -I dirs in the toplevel,
(iv) fix bug where -I dirs were ignored when using threads
(Marc Lasson, review by Damien Doligez and Alain Frisch)
- New -plugin option for ocamlc and ocamlopt, to dynamically extend
the compilers at runtime.
(Fabrice Le Fessant)
- Detect unused module declarations
(Alain Frisch)
- Add a settable Env.Persistent_signature.load function so
that cmi files can be loaded from other sources. This can be used to
create self-contained toplevels.
(Jérémie Dimino)
### Standard library:
- Provide `Sys.backend_type` so that user can write backend-specific
code in some cases (for example, code generator).
(Hongbo Zhang)
- implement Set.map
(Gabriel Scherer)
- Add Obj.reachable_words to compute the
"transitive" heap size of a value
(Alain Frisch, review by Mark Shinwell and Damien Doligez)
- Add a non-allocating function to recover the number of
allocated minor words.
(Pierre Chambart, review by Damien Doligez and Gabriel Scherer)
- String.split_on_char
(Alain Frisch)
- Filename.extension and Filename.remove_extension
(Alain Frisch, request by Edgar Aroutiounian, review by Daniel Bunzli
and Damien Doligez)
### Code generation and optimizations:
- Optimize Hashtbl by using in-place updates of its
internal bucket lists. All operations run in constant stack size
and are usually faster, except Hashtbl.copy which can be much
slower
(Alain Frisch)
* Optimize performance of record update:
no more performance cliff when { foo with t1 = ..; t2 = ...; ... }
hits 6 updated fields
(Olivier Nicole, review by Thomas Braibant and Pierre Chambart)
- Better unboxing strategy
(Alain Frisch, Pierre Chambart)
- Ocamlopt + flambda requires a lot of memory
to compile large array literal expressions
(Pierre Chambart, review by Mark Shinwell)
- Handle specialisation of recursive function that does
not always preserve the arguments
(Pierre Chambart, Mark Shinwell, report by Simon Cruanes)
- Obj.is_block is now an inlined OCaml function instead of a
C external. This should be faster.
(Demi Obenour)
- Optimize immutable float records
(Pierre Chambart, review by Mark Shinwell)
- Do not generate dummy code to force module linking
(Pierre Chambart, reviewed by Jacques Garrigue)
- Do not eliminate boxed int divisions by zero and
avoid checking twice if divisor is zero with flambda.
(Pierre Chambart, report by Jeremy Yallop)
- Optimize some constant string operations when the "-safe-string"
configure time option is enabled.
(Pierre Chambart)
- Load cross module information during a meet
(Pierre Chambart, report by Leo White, review by Mark Shinwell)
- Share a few more equal switch branches
(Pierre Chambart, review by Gabriel Scherer)
- Small improvements to type-based optimizations for array
and lazy
(Alain Frisch, review by Pierre Chambart)
- Prevent warning 59 from triggering on Lazy of constants
(Pierre Chambart, review by Leo White)
- Sort emitted functions according to source location
(Pierre Chambart, review by Mark Shinwell)
- Lack of type normalization lead to missing simple compilation for "lazy x"
(Alain Frisch)
### Runtime system:
- Allows to register finalisation function that are
called only when a value will never be reachable anymore. The
drawbacks compared to the existing one is that the finalisation
function is not called with the value as argument. These finalisers
are registered with `GC.finalise_last`
(François Bobot reviewed by Damien Doligez and Leo White)
- Do not perform compaction if the real overhead is less than expected
(Thomas Braibant)
### Tools:
- toplevel #show, follow chains of module aliases
(Gabriel Scherer, report by Daniel Bünzli, review by Thomas Refis)
- have ocamldep interpret -open arguments in left-to-right order
(Gabriel Scherer, report by Anton Bachin)
- ocamldoc, missing line breaks in type_*.html files
(Florian Angeletti)
- ocamldoc, improved support for inline records
(Florian Angeletti)
- ensure "ocamllex -ml" works with -safe-string
(Hongbo Zhang)
- ocamldoc, add viewport metadata to generated html pages
(Florian Angeletti, request by Daniel Bünzli)
- Make the output of ocamldep more stable
(Alain Frisch)
- empty documentation comments
(Florian Angeletti)
- Add the -no-version option to the toplevel
(Sébastien Hinderer)
- Add a --strict option to ocamlyacc treat conflicts as errors
(this option is now used for the compiler's parser)
(Jeremy Yallop)
- make ocamldoc use -open arguments
(Florian Angeletti)
- ocamldoc, fix order of extensible variant constructors
(Florian Angeletti)
### Debugging and profiling:
- Spacetime, a new memory profiler (Mark Shinwell, Leo White)
### Runtime system:
- Add a new primitive caml_alloc_float_array to allocate an
array of floats
(Thomas Braibant)
### Manual and documentation:
- document the existence of OCAMLPARAM and
ocaml_compiler_internal_params
(Damien Doligez, reports by Wim Lewis and Gabriel Scherer)
- warn users against using WinZip to unpack the source archive
(Damien Doligez, report by Shayne Fletcher)
- clarification to the wording and documentation
of Warning 52 (fragile constant pattern)
(Gabriel Scherer, William, Adrien Nader, Jacques Garrigue)
- Restore 4.02.3 behaviour of Unix.fstat, if the
file descriptor doesn't wrap a regular file (win32unix only)
(Andreas Hauptmann, review by David Allsopp)
- flatten : Avoid confusion
(Damien Doligez, report by user 'tormen')
- Gc.finalise and lazy values
(Jeremy Yallop)
- Document that [Store_field] must not be used to populate
arrays of values declared using [CAMLlocalN] (Mark Shinwell)
### Build system:
- Compiler developers: Adding new primitives to the
standard runtime doesn't require anymore to run `make bootstrap`
(François Bobot)
- Fix compilation using old Microsoft C Compilers not
supporting secure CRT functions (SDK Visual Studio 2005 compiler and
earlier) and standard 64-bit integer literals (Visual Studio .NET
2002 and earlier)
(David Allsopp)
- More sharing between Unix and Windows makefiles
(whitequark, review by Alain Frisch)
* Installed `ocamlc`, `ocamlopt`, and `ocamllex` are
now the native-code versions of the tools, if those versions were
built.
(Demi Obenour)
- "./configure -safe-string" to get a system where
"-unsafe-string" is not allowed, thus giving stronger non-local
guarantees about immutability of strings
(Alain Frisch, review by Hezekiah M. Carty)
### Bug fixes:
* Missed Type-error leads to a segfault upon record access.
(Jacques Garrigue, extra report by Stephen Dolan)
Proper fix required a more restrictive approach to recursive types:
mutually recursive types are seen as abstract types (i.e. non-contractive)
when checking the well-foundedness of the recursion.
* Nominal types and scope escaping.
Revert to strict scope for non-generalizable type variables, cf. Mantis.
Note that this is actually stricter than the behavior before 4.03,
cf. , meaning that you may sometimes need to add type annotations
to explicitly instantiate non-generalizable type variables.
(Jacques Garrigue, following discussion with Jeremy Yallop,
Nicolas Ojeda Bar and Alain Frisch)
- Aliased arguments ignored for equality of module types
(Jacques Garrigue, report by Leo White)
- compiler forcing aliases it shouldn't while reporting type errors
(Jacques Garrigue, report and suggestion by sliquister)
- document that Unix.SOCK_SEQPACKET is not really usable.
- uncaught exception on invalid lexer directive
(Gabriel Scherer, report by KC Sivaramakrishnan using afl-fuzz)
- revert a 4.03 change of behavior on (Unix.sleep 0.),
it now calls (nano)sleep for 0 seconds as in (< 4.03) versions.
(Hannes Mehnert, review by Damien Doligez)
- GADT + subtyping compile time crash
(Jacques Garrigue, report by Nicolas Ojeda Bar)
- Segfault from conjunctive constraints in GADT
(Jacques Garrigue, report by Stephen Dolan)
- Support more than FD_SETSIZE sockets in Windows' emulation
of select
(David Scott, review by Alain Frisch)
* Prevent private inline records from being mutated
(Alain Frisch, report by Pierre Chambart)
- Bug in mcomp_fields leads to segfault
(Jacques Garrigue, report by Leo White)
- Relaxed value restriction broken with principal
(Jacques Garrigue, report by Leo White)
- -strict-sequence turns off Warning 21
(Jacques Garrigue, report by Valentin Gatien-Baron)
- remove access to OCaml heap inside blocking section in win32unix
(David Allsopp, report by Andreas Hauptmann)
- remove access to OCaml heap inside blocking in Unix.sleep on Windows
(David Allsopp)
- -principal causes loop in type checker when compiling
(Jacques Garrigue, report by Anil Madhavapeddy, analysis by Leo White)
- Missing exhaustivity check for extensible variant
(Jacques Garrigue, report by Elarnon *)
- Contractiveness check unsound with constraints
(Jacques Garrigue, report by Leo White)
- GADT constructors can be re-exposed with an incompatible type
(Jacques Garrigue, report by Alain Frisch)
- Unsoundness in GADT exhaustiveness with existential variables
(Jacques Garrigue, report by Stephen Dolan)
* Thread library: fixed [Thread.wait_signal] so that it
converts back the signal number returned by [sigwait] to an
OS-independent number
(Jérémie Dimino)
- (similar to ) ensure that register typing constraints are
respected at N-way join points in the control flow graph
(Mark Shinwell)
- Fix float_of_hex parser to correctly reject some invalid forms
(Bogdan Tătăroiu, review by Thomas Braibant and Alain Frisch)
- Fix maximum weak bucket size
(Nicolas Ojeda Bar, review by François Bobot)
- Allow more module aliases in strengthening (Leo White)
- Fix wrong code generation involving lazy values in Flambda
mode
(Mark Shinwell, review by Pierre Chambart and Alain Frisch)
- Fix infinite loop in flambda due to [@@specialise] annotations
- Building native runtime on Windows could fail when bootstrapping
FlexDLL if there was also a system-installed flexlink
(David Allsopp, report Michael Soegtrop)
- check for integer overflow in String.concat
(Jeremy Yallop,
review by Damien Doligez, Alain Frisch, Daniel Bünzli, Fabrice Le Fessant)
- check for integer overflow in Array.concat
(Jeremy Yallop)
- fix the Buffer.add_substring bounds check to handle overflow
(Jeremy Yallop)
- Fix [@@inline] with default parameters in flambda (Leo White)
- fix build on OpenIndiana
(Sergey Avseyev, review by Damien Doligez)
### Internal/compiler-libs changes:
- Improve, fix, and add test for parsing/pprintast.ml
(Runhang Li, David Sheets, Alain Frisch)
- make driver/pparse.ml functions type-safe
(Gabriel Scherer, Dmitrii Kosarev, review by Jérémie Dimino)
- Improve Texp_record constructor representation, and
propagate updated record type information
(Pierre Chambart, review by Alain Frisch)
- Graphics.close_graph crashes 64-bit Windows ports (re-implementation
of )
(David Allsopp)
- delay registration of docstring after the mapper is applied
(Hugo Heuzard, review by Leo White)
- don't attach (**/**) comments to any particular node
(Thomas Refis, review by Leo White)
distinfo from cvs: trusted to convey hashes
patches from same cvs: untrusted thus require hashes to verify
absurdness: Any intruder that can modify the patch in cvs can also modify
the distinfo file.
Only externally hosted patches require hashes. Hopefully some day
thousands of future commits to distinfo files everywhere can be avoided by
making the framework smarter. </rant>
unneeded patches.
The list of changes is a thousand lines long, so I'm not including it
here: details can be found in the Changes file in the top directory of the
package after extraction.
include:
Bug fixes:
- Top-level custom printing for GADTs: interface change in 4.02.2
(Grégoire Henry, report by Jeremy Yallop)
- corrupted final_table (ygrek)
- R#6926: Regression: ocamldoc lost unattached comment
(Damien Doligez, report by François Bobot)
- Aliased result type of GADT constructor results in assertion failure
(Jacques Garrigue)
Feature wishes:
- PR#6691: install .cmt[i] files for stdlib and compiler-libs
(David Sheets, request by Gabriel Radanne)
- New primitive: caml_alloc_dummy_function
(Hugo Heuzard)
include:
- #6583: add a new class of binary operators with the same syntactic
precedence as method calls; these operators start with # followed
by a non-empty sequence of operator symbols (for instance #+, #!?).
It is also possible to use '#' as part of these extra symbols
(for instance ##, or #+#); this is rejected by the type-checker,
but can be used e.g. by ppx rewriters.
* #6016: add a "nonrec" keyword for type declarations
- #6600: make -short-paths faster by building the printing map
incrementally
- #6642: replace $CAMLORIGIN in -ccopt with the path to cma or cmxa
to output an object file with included runtime and autolink libraries
- #6845: -no-check-prims to tell ocamlc not to check primitives in runtime
- G#149: Attach documentation comments to parse tree
- G#159: Better locations for structure/signature items
- #5958: generalized polymorphic #install_printer
- #6237: explicit "infer" tag to control or disable menhir --infer
- #6625: pass -linkpkg to files built with -output-obj.
- #6712: Ignore common VCS directories
- #6720: pass -g to C compilers when tag 'debug' is set
- #6733: add .byte.so and .native.so targets to pass
-output-obj -cclib -shared.
- #6733: "runtime_variant(X)" to pass -runtime-variant X option.
- #6774: new menhir-specific flags "only_tokens" and "external_tokens(Foo)"
- #6285: Add support for nanosecond precision in Unix.stat()
- #6781: Add higher baud rates to Unix termios
- #6834: Add Obj.{first,last}_non_constant_constructor_tag
- #6078: Release the runtime system when calling caml_dlopen
- #6675: GC hooks
- #5418 (comments) : generate dependencies with $(CC) instead of gcc
- #6266: Cross compilation for iOs, Android etc
- Update instructions for x86-64 PIC mode and POWER architecture builds
- #6452, G#140: add internal suport for custom printing formats
- #6641: add -g, -ocamlcflags, -ocamloptflags options to ocamlmklib
- #6693: also build libasmrun_shared.so and lib{asm,caml}run_pic.a
- #6842: export Typemod.modtype_of_package
- G#139: more versatile specification of locations of .annot
- G#157: store the path of cmos inside debug section at link time
- G#191: Making gc.h and some part of memory.h public
ocaml has a twisty maze of ifdefs to define signal handler types and
obtain the faulting address. NetBSD no longer has sigcontext
(available to user space) and instead the more POSIXy ucontext; this
commit changes the patch to use that.
Fixes build on i386, and the resulting package can run unison. In
theory !i386 is unchanged.
a new patch to include a -pkgsrc-runtime compilation option. This option is
needed to compile devel/pcre-ocaml due to buildlink shenanigans
(see http://mail-index.netbsd.org/pkgsrc-users/2014/12/18/msg020800.html )
Changes:
(Changes that can break existing programs are marked with a "*")
Standard library:
* Add optional argument ?limit to Arg.align.
- Bug in Makefile.nt: won't stop on error
- Improve MSVC build
- Configure doesn't detect features correctly on Haiku
- Non-exhaustive matching warning message for open types is confusing
- fix quadratic-time algorithm in Consistbl.extract.
- Add stack overflow handling for native code (OpenBSD i386 and amd64)
- broken semantics of %(%) when substitued by a box
- legacy support for %.10s
- better documentation of flag # in format strings
- Bytes and CamlinternalFormat missing from threads stdlib.cma
- -dsource omits parens for `List ((`String "A")::[]) in patterns
- __MODULE__ aborts the compiler if the module name cannot be inferred
- Debug section is sometimes not readable when using -pack
- Missing command line options for ocamldoc
- fix race condition when retrieving backtraces
- String.sub throws Invalid_argument("Bytes.sub")
- Fix ocamldebug module source lookup
- Inclusion of packs failing to run module initializers
- infinite loop in Mtype.remove_aliases
- compilation fails with Env.Error(_)
- -short-paths and signature inclusion errors
- Fatal error with recursive modules
- Recursive module containing alias causes Segmentation fault
- Some bugs in generative functors
- ocamldep support for "-open M"
- Code generation errors for ARM
- Improve Windows (MSVC and mingw) build
- ocamlbuild: add -bin-annot when using -pack
- Fatal error when tracing a function with abstract type
- ocamlbuild: add an -ocamlmklib option to change the ocamlmklib command
also upstream changelog):
Language features:
- Attributes and extension nodes
- Generative functors
- Module aliases
* Alternative syntax for string literals {id|...|id} (can break comments)
- Separation between read-only strings (type string) and read-write byte
sequences (type bytes). Activated by command-line option -safe-string.
Build system for the OCaml distribution:
- Use -bin-annot when building.
- Use GNU make instead of portable makefiles.
- Updated build instructions for 32-bit Mac OS X on Intel hardware.
Shedding weight:
* Removed Camlp4 from the distribution, now available as third-party software.
* Removed Labltk from the distribution, now available as a third-party library.
Type system:
* Keep typing of pattern cases independent in principal mode
- Allow opening a first-class module or applying a generative functor
in the body of a generative functor. Allow it also in the body of
an applicative functor if no types are created
* Module aliases are now typed in a specific way, which remembers their
identity. In particular this changes the signature inferred by
"module type of"
- Slight change in the criterion to distinguish private
abbreviations and private row types: create a private abbreviation for
closed objects and fixed polymorphic variants.
* Compare first class module types structurally rather than
nominally. Value subtyping allows module subtyping as long as the internal
representation is unchanged.
Compilers:
- More aggressive constant propagation, including float and
int32/int64/nativeint arithmetic. Constant propagation for floats
can be turned off with option -no-float-const-prop, for codes that
change FP rounding modes at run-time.
- New back-end optimization pass: common subexpression elimination (CSE).
(Reuses results of previous computations instead of recomputing them.)
- New back-end optimization pass: dead code elimination.
(Removes arithmetic and load instructions whose results are unused.)
- Optimization of sequences of string patterns
- Experimental native code generator for AArch64 (ARM 64 bits)
- Optimization of integer division and modulus by constant divisors
- Add "-open" command line flag for opening a single module before typing
* "-o" now sets module name to the output file name up to the first "."
(it also applies when "-o" is not given, i.e. the module name is then
the input file name up to the first ".")
* better sharing of structured constants
- new flag to keep locations in cmi files
- issue warning 3 when referring to a value marked with
the [@@ocaml.deprecated] attribute
- a new format implementation based on GADTs
* Constant exception constructors no longer allocate
- avoid unnecessary boxing in let
- Better compilation of optional arguments with default values
- ocamlopt -opaque option for incremental native compilation
Toplevel interactive system:
- New "#show_*" directives
Runtime system:
- New configure option "-no-naked-pointers" to improve performance by
avoiding page table tests during block darkening and the marking phase
of the major GC. In this mode, all out-of-heap pointers must point at
things that look like OCaml values: in particular they must have a valid
header. The colour of said headers should be black.
- Fixed bug in native code version of [caml_raise_with_string] that could
potentially lead to heap corruption.
- Blocks initialized by [CAMLlocal*] and [caml_alloc] are now filled with
[Val_unit] rather than zero.
- Fixed a major performance problem on large heaps (~1GB) by making heap
increments proportional to heap size by default
- Structural equality treats exception specifically
- efficient comparison/indexing of exceptions
- avoid using unsafe C library functions (strcpy, strcat, sprintf)
- An ISO C99-compliant C compiler and standard library is now assumed.
(Plus special exceptions for MSVC.) In particular, emulation code for
64-bit integer arithmetic was removed, the C compiler must support a
64-bit integer type.
Standard library:
* Add new modules Bytes and BytesLabels for mutable byte sequences.
- add List.sort_uniq and Set.of_list
- a faster version of "raise" which does not maintain the backtrace
- support "Unix.kill pid Sys.sigkill" under Windows
- speed improvement for Buffer
- efficient creation of uninitialized float arrays
- Improve documentation regarding finalisers and multithreading
- Trigger warning 3 for all values marked as deprecated in the documentation.
