NAME

MCE::Shared::Condvar - Condvar helper class

VERSION

This document describes MCE::Shared::Condvar version 1.893

DESCRIPTION

This helper class for MCE::Shared provides a "Scalar", "Mutex", and primitives for conditional locking.

SYNOPSIS

 use MCE::Shared;
 my $cv = MCE::Shared->condvar( 0 );
 # OO interface
 $val = $cv->set( $val );
 $val = $cv->get();
 $len = $cv->len();
 # conditional locking primitives
 $cv->lock();
 $cv->unlock();
 $cv->broadcast(0.05);     # delay before broadcasting
 $cv->broadcast();
 $cv->signal(0.05);        # delay before signaling
 $cv->signal();
 $cv->timedwait(2.5);
 $cv->wait();
 # included, sugar methods without having to call set/get explicitly
 $val = $cv->append( $string );     #   $val .= $string
 $val = $cv->decr();                # --$val
 $val = $cv->decrby( $number );     #   $val -= $number
 $val = $cv->getdecr();             #   $val--
 $val = $cv->getincr();             #   $val++
 $val = $cv->incr();                # ++$val
 $val = $cv->incrby( $number );     #   $val += $number
 $old = $cv->getset( $new );        #   $o = $v, $v = $n, $o

EXAMPLE

The following example demonstrates barrier synchronization.

 use MCE;
 use MCE::Shared;
 use Time::HiRes qw(usleep);
 my $num_workers = 8;
 my $count = MCE::Shared->condvar(0);
 my $state = MCE::Shared->scalar('ready');
 my $microsecs = ( $^O =~ /mswin|mingw|msys|cygwin/i ) ? 0 : 200;
 # The lock is released upon entering ->broadcast, ->signal, ->timedwait,
 # and ->wait. For performance reasons, the condition variable is *not*
 # re-locked prior to exiting the call. Therefore, obtain the lock when
 # synchronization is desired subsequently.
 sub barrier_sync {
    usleep($microsecs) while $state->get eq 'down';
    $count->lock;
    $state->set('up'), $count->incr;
    if ($count->get == $num_workers) {
       $count->decr, $state->set('down');
       $count->broadcast;
    }
    else {
       $count->wait while $state->get eq 'up';
       $count->lock;
       $state->set('ready') if $count->decr == 0;
       $count->unlock;
    }
 }
 sub user_func {
    my $id = MCE->wid;
    for (1 .. 400) {
       MCE->print("$_: $id\n");
       barrier_sync();  # made possible by MCE::Shared::Condvar
     # MCE->sync();     # same thing via the MCE-Core API
    }
 }
 my $mce = MCE->new(
    max_workers => $num_workers,
    user_func   => \&user_func
 )->run;
 # Time taken from a 2.6 GHz machine running Mac OS X.
 # threads::shared:   0.207s  Perl threads
 #   forks::shared:  36.426s  child processes
 #     MCE::Shared:   0.353s  child processes
 #        MCE Sync:   0.062s  child processes

API DOCUMENTATION

 use MCE::Shared;
 $cv = MCE::Shared->condvar( 100 );
 $cv = MCE::Shared->condvar;

 $val = $cv->set( 10 );
 $cv->set( 10 );

 $val = $cv->get;

 $len = $var->len;

 $cv->lock;

 $cv->unlock;

 $count->signal;
 $count->signal( 0.5 );

 $count->broadcast;
 $count->broadcast( 0.5 );

 $count->wait() while $state->get() eq "bar";

 $count->timedwait( 10 ) while $state->get() eq "foo";

SUGAR METHODS

This module is equipped with sugar methods to not have to call "set" and "get" explicitly. In shared context, the benefit is atomicity and reduction in inter-process communication.

The API resembles a subset of the Redis primitives <https://redis.io/commands#strings> without the key argument.

 $len = $cv->append( "foo" );

 $num = $cv->decr;

 $num = $cv->decrby( 2 );

 $old = $cv->getdecr;

 $old = $cv->getincr;

 $old = $cv->getset( "baz" );

 $num = $cv->incr;

 $num = $cv->incrby( 2 );

CHAMENEOS DEMONSTRATION

The MCE example <https://github.com/marioroy/mce-examples/tree/master/chameneos> is derived from the chameneos example <http://benchmarksgame.alioth.debian.org/u64q/program.php?test=chameneosredux&lang=perl&id=4> by Jonathan DePeri and Andrew Rodland.

 use 5.010;
 use strict;
 use warnings;
 use MCE::Hobo;
 use MCE::Shared;
 use Time::HiRes 'time';
 die 'No argument given' if not @ARGV;
 my $start = time;
 my %color = ( blue => 1, red => 2, yellow => 4 );
 my ( @colors, @complement );
 @colors[values %color] = keys %color;
 for my $triple (
   [qw(blue blue blue)],
   [qw(red red red)],
   [qw(yellow yellow yellow)],
   [qw(blue red yellow)],
   [qw(blue yellow red)],
   [qw(red blue yellow)],
   [qw(red yellow blue)],
   [qw(yellow red blue)],
   [qw(yellow blue red)],
 ) {
   $complement[ $color{$triple->[0]} | $color{$triple->[1]} ] =
     $color{$triple->[2]};
 }
 my @numbers = qw(zero one two three four five six seven eight nine);
 sub display_complements
 {
   for my $i (1, 2, 4) {
     for my $j (1, 2, 4) {
       print "$colors[$i] + $colors[$j] -> $colors[ $complement[$i | $j] ]\n";
     }
   }
   print "\n";
 }
 sub num2words
 {
   join ' ', '', map $numbers[$_], split //, shift;
 }
 # Construct condvars and queues first before other shared objects or in
 # any order when IO::FDPass is installed, used by MCE::Shared::Server.
 my $meetings = MCE::Shared->condvar();
 tie my @creatures, 'MCE::Shared';
 tie my $first, 'MCE::Shared', undef;
 tie my @met, 'MCE::Shared';
 tie my @met_self, 'MCE::Shared';
 sub chameneos
 {
   my $id = shift;
   while (1) {
     $meetings->lock();
     unless ($meetings->get()) {
       $meetings->unlock();
       last;
     }
     if (defined $first) {
       $creatures[$first] = $creatures[$id] =
         $complement[$creatures[$first] | $creatures[$id]];
       $met_self[$first]++ if ($first == $id);
       $met[$first]++;  $met[$id]++;
       $meetings->decr();
       $first = undef;
       # Unlike threads::shared (condvar) which retains the lock
       # while in the scope, MCE::Shared signal and wait methods
       # must be called prior to leaving the block, due to lock
       # being released upon return.
       $meetings->signal();
     }
     else {
       $first = $id;
       $meetings->wait();  # ditto ^^
     }
   }
 }
 sub pall_mall
 {
   my $N = shift;
   @creatures = map $color{$_}, @_;
   my @threads;
   print " ", join(" ", @_);
   $meetings->set($N);
   for (0 .. $#creatures) {
     $met[$_] = $met_self[$_] = 0;
     push @threads, MCE::Hobo->create(\&chameneos, $_);
   }
   for (@threads) {
     $_->join();
   }
   $meetings->set(0);
   for (0 .. $#creatures) {
     print "\n$met[$_]", num2words($met_self[$_]);
     $meetings->incrby($met[$_]);
   }
   print "\n", num2words($meetings->get()), "\n\n";
 }
 display_complements();
 pall_mall($ARGV[0], qw(blue red yellow));
 pall_mall($ARGV[0], qw(blue red yellow red yellow blue red yellow red blue));
 printf "duration: %0.03f\n", time - $start;

CREDITS

The conditional locking feature is inspired by threads::shared.

LIMITATIONS

Perl must have IO::FDPass for constructing a shared "condvar" or "queue" while the shared-manager process is running. For platforms where IO::FDPass isn't possible, construct "condvar" and "queue" before other classes. On systems without "IO::FDPass", the manager process is delayed until sharing other classes or started explicitly.

 use MCE::Shared;
 my $has_IO_FDPass = $INC{'IO/FDPass.pm'} ? 1 : 0;
 my $cv  = MCE::Shared->condvar();
 my $que = MCE::Shared->queue();
 MCE::Shared->start() unless $has_IO_FDPass;

Regarding mce_open, "IO::FDPass" is needed for constructing a shared-handle from a non-shared handle not yet available inside the shared-manager process. The workaround is to have the non-shared handle made before the shared-manager is started. Passing a file by reference is fine for the three STD* handles.

 # The shared-manager knows of \*STDIN, \*STDOUT, \*STDERR.
 mce_open my $shared_in,  "<",  \*STDIN;   # ok
 mce_open my $shared_out, ">>", \*STDOUT;  # ok
 mce_open my $shared_err, ">>", \*STDERR;  # ok
 mce_open my $shared_fh1, "<",  "/path/to/sequence.fasta";  # ok
 mce_open my $shared_fh2, ">>", "/path/to/results.log";     # ok
 mce_open my $shared_fh, ">>", \*NON_SHARED_FH;  # requires IO::FDPass

The IO::FDPass module is known to work reliably on most platforms. Install 1.1 or later to rid of limitations described above.

 perl -MIO::FDPass -le "print 'Cheers! Perl has IO::FDPass.'"

INDEX

MCE, MCE::Hobo, MCE::Shared

AUTHOR

Mario E. Roy, <marioeroy AT gmail DOT com>