PERL593DELTA(1)

NAME
perl593delta - what is new for perl v5.9.3

DESCRIPTION
This document describes differences between the 5.9.2 and the 5.9.3 development releases. See perl590delta, perl591delta and perl592delta for the differences between 5.8.0 and 5.9.2.

Incompatible Changes

  Parsing of "-f _"
The identifier "_" is now forced to be a bareword after a filetest operator. This solves a number of misparsing issues when a global "_" subroutine is defined.

  "mkdir()"
"mkdir()" without arguments now defaults to $_.

  Magic goto and eval
The construct "eval { goto &foo }" is now disallowed. (Note that the similar construct, but with "eval("")" instead, was already forbidden.)

  $# has been removed
The deprecated $# variable (output format for numbers) has been removed. A new warning, "$# is no longer supported", has been added.

  ":unique"
The ":unique" attribute has been made a no-op, since its current implementation was fundamentally flawed and not threadsafe.

  Scoping of the "sort" pragma
The "sort" pragma is now lexically scoped. Its effect used to be global.

Core Enhancements

  The "feature" pragma
The "feature" pragma is used to enable new syntax that would break Perl's backwards-compatibility with older releases of the language. It's a lexical pragma, like "strict" or "warnings".

Currently the following new features are available: "switch" (adds a switch statement), "~~" (adds a Perl 6-like smart match operator), "say" (adds a "say" built-in function), and "err" (adds an "err" keyword). Those features are described below.

Note that "err" low-precedence defined-or operator used to be enabled by default (although as a weak keyword, meaning that any function would override it). It's now only recognized when explicitly turned on (and is then a regular keyword).

Those features, and the "feature" pragma itself, have been contributed by Robin Houston.

  Switch and Smart Match operator
Perl 5 now has a switch statement. It's available when "use feature 'switch'" is in effect. This feature introduces three new keywords, "given", "when", and "default":

    given ($foo) {
        when (/^abc/) { $abc = 1; }
        when (/^def/) { $def = 1; }
        when (/^xyz/) { $xyz = 1; }
        default { $nothing = 1; }
    }

A more complete description of how Perl matches the switch variable against the "when" conditions is given in "Switch statements" in perlsyn.

This kind of match is called smart match, and it's also possible to use it outside of switch statements, via the new "~~" operator (enabled via the "use feature '~~'" directive). See "Smart matching in detail" in perlsyn.

  "say()"
say() is a new built-in, only available when "use feature 'say'" is in effect, that is similar to print(), but that implicitly appends a newline to the printed string. See "say" in perlfunc.

  "CLONE_SKIP()"
Perl has now support for the "CLONE_SKIP" special subroutine. Like "CLONE", "CLONE_SKIP" is called once per package; however, it is called just before cloning starts, and in the context of the parent thread. If it returns a true value, then no objects of that class will be cloned. See perlmod for details. (Contributed by Dave Mitchell.)

  "${^CHILD_ERROR_NATIVE}"
A new internal variable, "${^CHILD_ERROR_NATIVE}", gives the native status returned by the last pipe close, backtick command, successful call to wait() or waitpid(), or from the system() operator. See perlrun for details. (Contributed by Gisle Aas.)

  Assertions
The support for assertions, introduced in perl 5.9.0, has been improved. The syntax for the "-A" command-line switch has changed; it now accepts an optional module name, defaulting to "assertions::activate". See assertions and perlrun. (Contributed by Salvador Fandin~o Garcia.)

  Unicode Character Database 4.1.0
The copy of the Unicode Character Database included in Perl 5.9 has been updated to 4.1.0.

  "no VERSION"
You can now use "no" followed by a version number to specify that you want to use a version of perl older than the specified one.

  Recursive sort subs
You can now use recursive subroutines with sort(), thanks to Robin Houston.

  Effect of pragmas in eval
The compile-time value of the "%^H" hint variable can now propagate into eval("")uated code. This makes it more useful to implement lexical pragmas.

As a side-effect of this, the overloaded-ness of constants now propagates into eval("").

  New -E command-line switch
-E is equivalent to -e, but it implicitly enables all optional features (like "use feature ":5.10"").

  "chdir", "chmod" and "chown" on filehandles
"chdir", "chmod" and "chown" can now work on filehandles as well as filenames, if the system supports respectively "fchdir", "fchmod" and "fchown", thanks to a patch provided by Gisle Aas.

  OS groups
$( and $) now return groups in the order where the OS returns them, thanks to Gisle Aas. This wasn't previously the case.

Modules and Pragmata

  New Core Modules

•   A new pragma, "feature", has been added; see above in "Core Enhancements".

•   "assertions::compat", also available on CPAN, allows the use of assertions on perl versions prior to 5.9.0 (that is the first one to natively support them).

•   "Math::BigInt::FastCalc" is an XS-enabled, and thus faster, version of "Math::BigInt::Calc".

•   "Compress::Zlib" is an interface to the zlib compression library. It comes with a bundled version of zlib, so having a working zlib is not a prerequisite to install it. It's used by "Archive::Tar" (see below).

•   "IO::Zlib" is an "IO::"-style interface to "Compress::Zlib".

•   "Archive::Tar" is a module to manipulate "tar" archives.

•   "Digest::SHA" is a module used to calculate many types of SHA digests, has been included for SHA support in the CPAN module.

•   "ExtUtils::CBuilder" and "ExtUtils::ParseXS" have been added.

Utility Changes

  "ptar"
"ptar" is a pure perl implementation of "tar", that comes with "Archive::Tar".

  "ptardiff"
"ptardiff" is a small script used to generate a diff between the contents of a tar archive and a directory tree. Like "ptar", it comes with "Archive::Tar".

  "shasum"
This command-line utility, used to print or to check SHA digests, comes with the new "Digest::SHA" module.

  "h2xs" enhancements
"h2xs" implements a new option "--use-xsloader" to force use of "XSLoader" even in backwards compatible modules.

The handling of authors' names that had apostrophes has been fixed.

Any enums with negative values are now skipped.

  "perlivp" enhancements
"perlivp" no longer checks for *.ph files by default. Use the new "-a" option to run all tests.

Documentation

  Perl Glossary
The perlglossary manpage is a glossary of terms used in the Perl documentation, technical and otherwise, kindly provided by O'Reilly Media, Inc.

perltodo now lists a rough roadmap to Perl 5.10.

Performance Enhancements

  XS-assisted SWASHGET
Some pure-perl code that perl was using to retrieve Unicode properties and transliteration mappings has been reimplemented in XS.

  Constant subroutines
The interpreter internals now support a far more memory efficient form of inlineable constants. Storing a reference to a constant value in a symbol table is equivalent to a full typeglob referencing a constant subroutine, but using about 400 bytes less memory. This proxy constant subroutine is automatically upgraded to a real typeglob with subroutine if necessary. The approach taken is analogous to the existing space optimisation for subroutine stub declarations, which are stored as plain scalars in place of the full typeglob.

Several of the core modules have been converted to use this feature for their system dependent constants - as a result "use POSIX;" now takes about 200K less memory.

  "PERL_DONT_CREATE_GVSV"
The new compilation flag "PERL_DONT_CREATE_GVSV", introduced as an option in perl 5.8.8, is turned on by default in perl 5.9.3. It prevents perl from creating an empty scalar with every new typeglob. See perl589delta for details.

  Weak references are cheaper
Weak reference creation is now O(1) rather than O(n), courtesy of Nicholas Clark. Weak reference deletion remains O(n), but if deletion only happens at program exit, it may be skipped completely.

  sort() enhancements
Salvador Fandin~o provided improvements to reduce the memory usage of "sort" and to speed up some cases.

Installation and Configuration Improvements

  Compilation improvements
Parallel makes should work properly now, although there may still be problems if "make test" is instructed to run in parallel.

Building with Borland's compilers on Win32 should work more smoothly. In particular Steve Hay has worked to side step many warnings emitted by their compilers and at least one C compiler internal error.

Perl extensions on Windows now can be statically built into the Perl DLL, thanks to a work by Vadim Konovalov.

  New Or Improved Platforms
Perl is being ported to Symbian OS. See perlsymbian for more information.

The VMS port has been improved. See perlvms.

DynaLoader::dl_unload_file() now works on Windows.

Portability of Perl on various recent compilers on Windows has been improved (Borland C++, Visual C++ 7.0).

  New probes
"Configure" will now detect "clearenv" and "unsetenv", thanks to a patch from Alan Burlison. It will also probe for "futimes" (and use it internally if available), and whether "sprintf" correctly returns the length of the formatted string.

  Module auxiliary files
README files and changelogs for CPAN modules bundled with perl are no longer installed.

Selected Bug Fixes

  "defined $$x"
"use strict "refs"" was ignoring taking a hard reference in an argument to defined(), as in :

    use strict "refs";
    my $x = "foo";
    if (defined $$x) {...}

This now correctly produces the run-time error "Can't use string as a SCALAR ref while "strict refs" in use". (However, "defined @$foo" and "defined %$foo" are still allowed. Those constructs are discouraged anyway.)

  Calling CORE::require()
CORE::require() and CORE::do() were always parsed as require() and do() when they were overridden. This is now fixed.

  Subscripts of slices
You can now use a non-arrowed form for chained subscripts after a list slice, like in:

    ({foo => "bar"})[0]{foo}

This used to be a syntax error; a "->" was required.

  Remove over-optimisation
Perl 5.9.2 introduced a change so that assignments of "undef" to a scalar, or of an empty list to an array or a hash, were optimised out. As this could cause problems when "goto" jumps were involved, this change was backed out.

  sprintf() fixes
Using the sprintf() function with some formats could lead to a buffer overflow in some specific cases. This has been fixed, along with several other bugs, notably in bounds checking.

In related fixes, it was possible for badly written code that did not follow the documentation of "Sys::Syslog" to have formatting vulnerabilities. "Sys::Syslog" has been changed to protect people from poor quality third party code.

  no warnings 'category' works correctly with -w
Previously when running with warnings enabled globally via "-w", selective disabling of specific warning categories would actually turn off all warnings. This is now fixed; now "no warnings 'io';" will only turn off warnings in the "io" class. Previously it would erroneously turn off all warnings.

  Smaller fixes

•   "FindBin" now works better with directories where access rights are more restrictive than usual.

•   Several memory leaks in ithreads were closed. Also, ithreads were made less memory-intensive.

•   Trailing spaces are now trimmed from $! and $^E.

•   Operations that require perl to read a process' list of groups, such as reads of $( and $), now dynamically allocate memory rather than using a fixed sized array. The fixed size array could cause C stack exhaustion on systems configured to use large numbers of groups.

•   "PerlIO::scalar" now works better with non-default $/ settings.

•   The "x" repetition operator is now able to operate on "qw//" lists. This used to raise a syntax error.

•   The debugger now traces correctly execution in eval("")uated code that contains #line directives.

•   The value of the "open" pragma is no longer ignored for three-argument opens.

•   Perl will now use the C library calls "unsetenv" and "clearenv" if present to delete keys from %ENV and delete %ENV entirely, thanks to a patch from Alan Burlison.

  More Unicode Fixes

•   chr() on a negative value now gives "\x{FFFD}", the Unicode replacement character, unless when the "bytes" pragma is in effect, where the low eight bytes of the value are used.

•   Some case insensitive matches between UTF-8 encoded data and 8 bit regexps, and vice versa, could give malformed character warnings. These have been fixed by Dave Mitchell and Yves Orton.

•   "lcfirst" and "ucfirst" could corrupt the string for certain cases where the length UTF-8 encoding of the string in lower case, upper case or title case differed. This was fixed by Nicholas Clark.

New or Changed Diagnostics

  Attempt to set length of freed array
This is a new warning, produced in situations like the following one:

    $r = do {my @a; \$#a};
    $$r = 503;

  Non-string passed as bitmask
This is a new warning, produced when number has been passed as a argument to select(), instead of a bitmask.

    # Wrong, will now warn
    $rin = fileno(STDIN);
    ($nfound,$timeleft) = select($rout=$rin, undef, undef, $timeout);

    # Should be
    $rin = '';
    vec($rin,fileno(STDIN),1) = 1;
    ($nfound,$timeleft) = select($rout=$rin, undef, undef, $timeout);

  Search pattern not terminated or ternary operator parsed as search pattern
This syntax error indicates that the lexer couldn't find the final delimiter of a "?PATTERN?" construct. Mentioning the ternary operator in this error message makes syntax diagnostic easier.

  "%s" variable %s masks earlier declaration
This warning is now emitted in more consistent cases; in short, when one of the declarations involved is a "my" variable:

    my $x;   my $x;     # warns
    my $x;  our $x;     # warns
    our $x;  my $x;     # warns

On the other hand, the following:

    our $x; our $x;

now gives a ""our" variable %s redeclared" warning.

  readdir()/closedir()/etc. attempted on invalid dirhandle
These new warnings are now emitted when a dirhandle is used but is either closed or not really a dirhandle.

Changed Internals
In general, the source code of perl has been refactored, tied up, and optimized in many places. Also, memory management and allocation has been improved in a couple of points.

Andy Lester supplied many improvements to determine which function parameters and local variables could actually be declared "const" to the C compiler. Steve Peters provided new *_set macros and reworked the core to use these rather than assigning to macros in LVALUE context.

Dave Mitchell improved the lexer debugging output under "-DT".

A new file, mathoms.c, has been added. It contains functions that are no longer used in the perl core, but that remain available for binary or source compatibility reasons. However, those functions will not be compiled in if you add "-DNO_MATHOMS" in the compiler flags.

The "AvFLAGS" macro has been removed.

The "av_*()" functions, used to manipulate arrays, no longer accept null "AV*" parameters.

  B:: modules inheritance changed
The inheritance hierarchy of "B::" modules has changed; "B::NV" now inherits from "B::SV" (it used to inherit from "B::IV").

Reporting Bugs
If you find what you think is a bug, you might check the articles recently posted to the comp.lang.perl.misc newsgroup and the perl bug database at http://bugs.perl.org/ . There may also be information at http://www.perl.org/ , the Perl Home Page.

If you believe you have an unreported bug, please run the perlbug program included with your release. Be sure to trim your bug down to a tiny but sufficient test case. Your bug report, along with the output of "perl -V", will be sent off to perlbug@perl.org to be analysed by the Perl porting team.

SEE ALSO
The Changes file for exhaustive details on what changed.

The INSTALL file for how to build Perl.

The README file for general stuff.

The Artistic and Copying files for copyright information.