Postscript for P/G/O one-sided proposal

• Messages sorted by: [ date ][ thread ][ subject ][ author ]
• Next message: Marc Snir: "possible race condition in post-wait-start-complete"
• Previous message: David C. DiNucci: "New version of P/G/O proposal"

%%EndSetup
%%Page: 0 1
0 0 bop 799 911 a Fo(D)25 b(R)g(A)g(F)g(T)225 1002 y
Fn(Do)r(cumen)n(t)20 b(for)i(a)f(Standard)g(Message-P)n(assing)f(In)n
(terface)621 1196 y Fm(Message)c(P)o(assing)h(In)o(terface)e(F)l(orum)
802 1323 y(August)i(17,)f(1996)77 1381 y(This)h(w)o(ork)f(w)o(as)h
(supp)q(orted)g(in)f(part)h(b)o(y)e(ARP)l(A)h(and)h(NSF)e(under)h(gran)
o(t)h(ASC-9310330,)i(the)192 1439 y(National)d(Science)f(F)l(oundation)
i(Science)e(and)i(T)l(ec)o(hnology)f(Cen)o(ter)f(Co)q(op)q(erativ)o(e)
76 1497 y(Agreemen)o(t)e(No.)22 b(CCR-8809615,)d(and)e(b)o(y)e(the)h
(Commission)e(of)j(the)f(Europ)q(ean)i(Comm)o(unit)n(y)654
1555 y(through)f(Esprit)f(pro)s(ject)g(P6643.)p eop
%%Page: 1 2
1 1 bop 166 49 a Fl(This)20 b(is)h(the)f(result)g(of)f(a)h(LaT)l(eX)g
(run)g(of)g(a)f(draft)g(of)h(a)f(single)j(c)o(hapter)d(of)h(the)g(MPIF)
f(Final)75 106 y(Rep)q(ort)d(do)q(cumen)o(t.)969 2828
y(i)p eop
%%Page: 1 3
1 2 bop 75 361 a Fk(Chapter)31 b(1)75 568 y Fj(One)39
b(Sided)e(Comm)m(unications)f({)75 693 y(P/G/O)k(Alternativ)m(e)75
933 y Fi(1.1)59 b(Intro)r(duction)75 1076 y Fh(Discussion:)34
b Fg(This)14 b(alternativ)o(e)f(prop)q(osal)h(di\013ers)h(from)d(the)i
(main)e(prop)q(osal)i(primarily)d(in)i(the)i(follo)o(wing:)134
1146 y(1.)22 b(No)13 b(RMA)p 356 1146 13 2 v 15 w(INIT,)h(RMA)p
588 1146 V 14 w(POST,)g(RMA)p 841 1146 V 15 w(W)-5 b(AIT,)13
b(RMA)p 1095 1146 V 15 w(LOCK,)h(or)g(RMA)p 1407 1146
V 14 w(UNLOCK)134 1217 y(2.)22 b(Addition)13 b(of)g(OFFER)h(and)g
(IOFFER)g(op)q(erations)g(to)g(replace)h(ab)q(o)o(v)o(e)134
1287 y(3.)22 b(Additional)13 b("com)o(bine")g(argumen)o(t)h(on)h(GET)f
(and)h(PUT)g(com)o(bine)f(sync)o(hronization)h(with)f(comm)o(uni-)189
1337 y(cation)134 1408 y(4.)22 b(No)13 b(alteration)h(to)f(traditional)
g(MPI)h(comm)o(unicators)d(\(i.e.)18 b(no)c(additional)e("windo)o(w")g
(construct\))134 1478 y(5.)22 b(No)13 b(additions)g(to)h(traditional)f
(seman)o(tics)g(of)g(MPI)h(BARRIER)134 1549 y(6.)22 b(Addition)13
b(of)g(collectiv)o(e)h(op)q(erations,)g(OFFER)o(C)g(and)f(IOFFER)o(C,)h
(to)f(replace)i(BARRIER)134 1619 y(7.)22 b(Additional)12
b(tag)i(argumen)o(t)e(to)i(allo)o(w)e(concurren)o(t)k(one-sided)e(op)q
(erations)g(on)g(a)g(single)f(comm)o(unicator)189 1781
y Ff(R)n(ationale.)37 b Fl(In)12 b(general,)h(this)f(prop)q(osal)f
(treats)g(one-sided)i(comm)o(unication)f(in)h(a)e(manner)g(sim-)189
1838 y(ilar)18 b(to)e(standard)h(message-passing,)h(based)f(on)g(the)h
(observ)m(ation)f(that)g(the)g(goal)g(is)h(to)f(mo)o(v)o(e)189
1894 y(data)e(b)q(et)o(w)o(een)i(pro)q(cesses,)g(just)f(as)g
(message-passing)g(do)q(es.)24 b(It)16 b(also)g(uni\014es)i(comm)o
(unication)189 1951 y(with)c(sync)o(hronization)h(for)e(the)i(same)e
(reasons)h(that)f(message-passing)h(do)q(es)h(so)e({)h(to)f(decrease)
189 2007 y(the)e(n)o(um)o(b)q(er)g(of)g(round)g(trips)g(necessary)h(to)
e(accomplish)j(the)e(task.)17 b(The)12 b(resulting)g(mo)q(del)g
(o\013ers)189 2064 y(the)i(same)g(p)q(o)o(w)o(er)h(as)f(separate)g
(sync)o(hronization)h(functions,)g(but)g(pro)o(vides)g(greater)e
(e\016ciency)189 2120 y(b)o(y)g(minimizing)k(the)c(n)o(um)o(b)q(er)i
(of)e(calls)i(necessary)f(to)f(p)q(erform)g(op)q(erations,)h(and)g(b)o
(y)g(alw)o(a)o(ys)e(al-)189 2177 y(lo)o(wing)j(the)g(implemen)o(tation)
h(to)e(piggy-bac)o(k)h(sync)o(hronization)g(on)o(to)f(comm)o
(unication.)21 b(\()p Ff(End)189 2233 y(of)16 b(r)n(ationale.)p
Fl(\))166 2374 y Fh(Missing:)i Fg(This)c(c)o(hapter)h(con)o(tains)g
(only)e(the)i(imp)q(ortan)o(t)e(information)f(ab)q(out)i(the)h(syn)o
(tax,)f(seman)o(tics,)75 2431 y(and)e(di\013erences)i(in)d(implemen)o
(tatio)o(n)e(b)q(et)o(w)o(een)k(this)f(prop)q(osal)g(and)f(others.)19
b(If)11 b(these)i(meet)f(with)f(the)h(appro)o(v)n(al)75
2487 y(of)j(the)i(forum,)d(further)j(applicable)f(examples)f(and/or)g
(discussion)i(can)f(hop)q(efully)f(b)q(e)i(included)f(from)e(other)75
2543 y(prop)q(osals)g(if)f(necessary)m(.)166 2647 y Fl(F)l(or)e(the)h
(purp)q(oses)g(of)g(this)g(c)o(hapter,)g(1-sided)h(comm)o(unication)g
(is)f(de\014ned)h(as)f(comm)o(unication)g(in)75 2704
y(whic)o(h)h(one)f(pro)q(cess)g(sp)q(eci\014es)i(b)q(oth)e(the)g
(source)f(and)i(destination)f(of)g(the)g(data)f(to)g(b)q(e)i(comm)o
(unicated.)964 2828 y(1)p eop
%%Page: 2 4
2 3 bop 75 -100 a Fl(2)196 b Fe(CHAPTER)15 b(1.)35 b(ONE)15
b(SIDED)h(COMMUNICA)l(TIONS)g({)f(P/G/O)f(AL)l(TERNA)l(TIVE)75
49 y Fl(In)23 b(general,)h(1-sided)f(comm)o(unication)f(can)h(o\013er)e
(more)g(e\016cien)o(t)i(utilization)h(of)e(hardw)o(are)f(than)75
106 y(traditional)g(message)f(passing)h(in)g(some)f(cases,)h(and)g(ma)o
(y)f(o\013er)f(a)h(more)g(natural)h(framew)o(ork)e(for)75
162 y(programming)i(some)g(applications,)j(but)d(it)h(do)q(es)f(not)g
(tec)o(hnically)j(o\013er)c(an)o(y)h(more)g(p)q(o)o(w)o(er)g(than)75
219 y(message)15 b(passing.)166 275 y(In)20 b(1-sided)h(comm)o
(unication,)f(the)g(pro)q(cess)g(whic)o(h)g(sp)q(eci\014es)h(the)f
(source)f(and)h(destination)g(of)75 332 y(the)15 b(comm)o(unication)h
(will)h(b)q(e)f(called)h(the)e(originator,)g(and)g(m)o(ust)g(con)o
(tain)g(either)h(the)g(source)f(or)g(the)75 388 y(destination)k(of)f
(the)h(data.)29 b(The)18 b(other)g(pro)q(cess)h(\(i.e.)29
b(the)19 b(one)f(other)g(than)h(the)f(originator)g(whic)o(h)75
444 y(holds)12 b(either)f(the)g(source)g(or)g(destination)h(of)e(the)h
(data\))f(will)j(b)q(e)f(called)g(the)f(target.)18 b(If)11
b(b)q(oth)g(the)g(source)75 501 y(and)j(destination)h(are)f(in)h(the)f
(same)f(pro)q(cess,)h(that)g(pro)q(cess)g(will)i(b)q(e)e(called)i(b)q
(oth)e(the)g(originator)g(and)75 557 y(target.)166 614
y(The)h(originator)f(can)h(p)q(erform)g(t)o(w)o(o)e(general)j(op)q
(erations:)k Fd(MPI)p 1289 614 14 2 v 15 w(PUT)p Fl(,)15
b(in)h(whic)o(h)f(the)g(originator)75 670 y(con)o(tains)22
b(the)f(source)h(of)f(the)h(comm)o(unication)h(and)e(the)h(target)f
(con)o(tains)g(the)h(destination,)i(and)75 727 y Fd(MPI)p
160 727 V 16 w(GET)p Fl(,)14 b(in)h(whic)o(h)g(the)f(target)f(con)o
(tains)h(the)h(source)f(of)g(the)g(comm)o(unication)h(and)f(the)g
(originator)75 783 y(con)o(tains)h(the)h(destination.)166
840 y(The)j(target)f(has)h(some)g(con)o(trol)g(o)o(v)o(er)f(the)h(comm)
o(unication.)33 b(Sp)q(eci\014cally)l(,)23 b(it)c(sp)q(eci\014es)i
(when)75 896 y(an)c(originator)g(is)h(allo)o(w)o(ed)f(to)g(p)q(erform)g
(1-sided)h(op)q(erations)f(to)g(its)g(address)g(space,)h(whic)o(h)g(p)q
(ortion)75 953 y(of)f(that)g(address)h(space)f(is)i(a)o(v)m(ailable)g
(as)e(the)h(source)f(or)g(destination)i(of)e(1-sided)i(comm)o
(unications,)75 1009 y(and)13 b(whic)o(h)h(op)q(erations)f(\(i.e.)19
b Fd(MPI)p 688 1009 V 16 w(PUT)13 b Fl(or)g Fd(MPI)p
944 1009 V 15 w(GET)p Fl(\))g(ma)o(y)g(b)q(e)g(p)q(erformed)g(to)g
(that)f(address)h(space.)75 1065 y(The)i(target)f(sp)q(eci\014es)j
(these)f(b)o(y)f(executing)h(an)f Fd(MPI)p 1009 1065
V 16 w(OFFER)h Fl(op)q(eration.)166 1122 y(Sync)o(hronization)g(b)q(et)
o(w)o(een)e(the)h(originator)f(and)h(target)e(is)i(pro)o(vided)g(b)o(y)
f(matc)o(hing,)h(in)g(a)f(man-)75 1178 y(ner)21 b(similar)i(to)d(that)g
(p)q(erformed)i(b)o(y)f Fd(MPI)p 858 1178 V 16 w(ISSEND)g
Fl(and)g Fd(MPI)p 1226 1178 V 16 w(RECV)p Fl(.)h(Sp)q(eci\014cally)l(,)
j(a)c Fd(MPI)p 1771 1178 V 16 w(PUT)75 1235 y Fl(or)f
Fd(MPI)p 221 1235 V 16 w(GET)h Fl(op)q(eration)g(on)g(the)g(originator)
g(issues)g(an)g(ev)o(en)o(t)g(whic)o(h)h(m)o(ust)e(b)q(e)h(matc)o(hed)g
(b)o(y)g(an)75 1291 y Fd(MPI)p 160 1291 V 16 w(OFFER)d
Fl(op)q(eration)h(on)f(the)g(target)e(pro)q(cess.)29
b(When)18 b(the)g(matc)o(h)g(o)q(ccurs,)g(a)g(transfer)f(of)h(data)75
1348 y(b)q(et)o(w)o(een)f(the)g(originating)g(pro)q(cess)g(and)g(the)f
(target)g(pro)q(cess)h(will)h(tak)o(e)e(place,)h(as)g(sp)q(eci\014ed)h
(b)o(y)f(the)75 1404 y Fd(PUT)j Fl(or)f Fd(GET)i Fl(ev)o(en)o(t.)33
b Fd(MPI)p 591 1404 V 16 w(PUT)20 b Fl(and)g Fd(MPI)p
893 1404 V 16 w(GET)g Fl(op)q(erations)g(con)o(tain)g
Fd(communicato)o(r)p Fl(,)f Fd(tag)p Fl(,)i(and)75 1461
y Fd(ta)o(rget)p 190 1461 V 16 w(rank)e Fl(argumen)o(ts)f(\(lik)o(e)h
Fd(MPI)p 719 1461 V 16 w(ISSEND)p Fl(\))g(and)g(the)f
Fd(OFFER)i Fl(m)o(ust)e(con)o(tain)h(a)f(matc)o(hing)h
Fd(com-)75 1517 y(municato)o(r)h Fl(and)h Fd(tag)g Fl(\(lik)o(e)h
Fd(MPI)p 653 1517 V 16 w(RECV)p Fl(\).)f(Unlik)o(e)h(their)g
(message-passing)f(coun)o(terparts,)g(a)g(single)75 1574
y Fd(MPI)p 160 1574 V 16 w(OFFER)e Fl(on)f(the)h(target)e(can)h(matc)o
(h)g(m)o(ultiple)j Fd(PUT)d Fl(and)h Fd(GET)f Fl(ev)o(en)o(ts)h(from)e
(the)i(originator,)75 1630 y(since)f(the)f(ev)o(en)o(ts)f(con)o(tain)h
(most)f(of)g(the)h(information)g(ab)q(out)g(the)g(data)f(transfer.)23
b(A)17 b(non-blo)q(c)o(king)75 1686 y(v)o(ersion)e(of)g
Fd(MPI)p 366 1686 V 16 w(OFFER)p Fl(,)g Fd(MPI)p 633
1686 V 16 w(IOFFER)p Fl(,)g(is)h(also)f(pro)o(vided.)166
1743 y(Tw)o(o)h(forms)g(of)g(this)h(p)q(oin)o(t-to-p)q(oin)o(t)g
(1-sided)h(mo)q(del)g(are)e(pro)o(vided,)i(whic)o(h)f(di\013er)g(only)g
(in)h(the)75 1799 y(progress)10 b(prop)q(erties)h(of)f
Fd(MPI)p 589 1799 V 16 w(IOFFER)p Fl(.)g(In)h(the)g(\014rst)f(form,)g
(called)i(non-progressiv)o(e,)f(an)g Fd(MPI)p 1708 1799
V 16 w(IOFFER)75 1856 y Fl(will)17 b(not)e(necessarily)i(satisfy)e(a)g
Fd(PUT)h Fl(or)f Fd(GET)h Fl(ev)o(en)o(t)f(un)o(til)i(or)e(unless)h
(the)g Fd(MPI)p 1498 1856 V 16 w(IOFFER)f Fl(completes)75
1912 y(or)h(attempts)f(to)g(complete.)24 b(In)16 b(the)h(second)f
(form,)g(called)h(progressiv)o(e,)f(a)g Fd(PUT)g Fl(or)g
Fd(GET)g Fl(ev)o(en)o(t)g(will)75 1969 y(alw)o(a)o(ys)10
b(b)q(e)h(satis\014ed)g(b)o(y)f(a)g(matc)o(hing)g Fd(MPI)p
812 1969 V 16 w(IOFFER)p Fl(,)g(ev)o(en)h(if)g(the)f
Fd(MPI)p 1296 1969 V 16 w(IOFFER)h Fl(do)q(es)f(not)g(complete)h(or)75
2025 y(attempt)g(to)h(complete.)19 b(This)13 b(latter)f(progress)g
(rule)h(is)f(similar)i(to)d(the)i(progress)e(rule)i(for)f(non)o(blo)q
(c)o(king)75 2082 y(op)q(erations)17 b(de\014ned)h(in)g(Section)f
(3.7.4)e(of)i(the)f(MPI-1)h(standard.)24 b(The)17 b(user)g(is)g
(advised)h(to)e(use)h(the)75 2138 y(non-progressiv)o(e)d(forms)f(of)g
(1-sided)i(comm)o(unication)f(whenev)o(er)h(p)q(ossible,)g(b)q(ecause)g
(enforcemen)o(t)e(of)75 2195 y(the)j(more)f(stringen)o(t)g(progress)g
(prop)q(ert)o(y)g(can)g(incur)i(signi\014can)o(t)f(o)o(v)o(erhead)g(on)
f(some)g(arc)o(hitectures.)75 2251 y(It)e(is)g(p)q(ossible)i(to)d
(implemen)o(t)i(an)o(y)e(program)g(without)h(using)g(the)g(progressiv)o
(e)g(forms,)f(though)h(it)g(ma)o(y)75 2307 y(require)j(initiating)h(a)e
(separate)g(pro)q(cess)g(or)g(thread)g(to)f(serv)o(e)h(as)g(an)g(agen)o
(t)g(in)h(some)f(rare)f(cases.)166 2364 y(In)23 b(addition)h(to)d(the)i
(p)q(oin)o(t-to-p)q(oin)o(t)g(1-sided)h(mo)q(dels,)h(a)d(collectiv)o(e)
i(mo)q(del)f(of)g(these)f(same)75 2420 y(op)q(erations)12
b(is)h(also)f(pro)o(vided)h(for)e(the)h(b)q(ene\014t)h(of)f(those)g
(who)g(desire)h(\(or)e(are)h(familiar)h(with\))f(the)g(Bulk)75
2477 y(Sync)o(hronous)j(P)o(arallel)h(mo)q(del,)g(or)e(the)h
(BARRIER-st)o(yle)j(o\013ered)c(b)o(y)h(some)g(computer)g(v)o(endors.)k
(In)75 2533 y(the)12 b(collectiv)o(e)i(1-sided)f(mo)q(del,)h(all)f(pro)
q(cesses)f(within)i(a)e(comm)o(unicator)f(p)q(erform)h(zero)g(or)g
(more)g Fd(GET)75 2590 y Fl(and/or)i Fd(PUT)h Fl(op)q(erations,)g
(after)f(\(or)g(during\))h(whic)o(h)h(all)g(pro)q(cesses)f(p)q(erform)f
(an)h Fd(OFFER)h Fl(op)q(eration)75 2646 y(whic)o(h)g(satis\014es)f
(all)i(p)q(ending)g Fd(GET)e Fl(and/or)g Fd(PUT)g Fl(ev)o(en)o(ts.)1967
46 y Fc(1)1967 103 y(2)1967 159 y(3)1967 215 y(4)1967
272 y(5)1967 328 y(6)1967 385 y(7)1967 441 y(8)1967 498
y(9)1959 554 y(10)1959 611 y(11)1959 667 y(12)1959 724
y(13)1959 780 y(14)1959 836 y(15)1959 893 y(16)1959 949
y(17)1959 1006 y(18)1959 1062 y(19)1959 1119 y(20)1959
1175 y(21)1959 1232 y(22)1959 1288 y(23)1959 1345 y(24)1959
1401 y(25)1959 1457 y(26)1959 1514 y(27)1959 1570 y(28)1959
1627 y(29)1959 1683 y(30)1959 1740 y(31)1959 1796 y(32)1959
1853 y(33)1959 1909 y(34)1959 1966 y(35)1959 2022 y(36)1959
2078 y(37)1959 2135 y(38)1959 2191 y(39)1959 2248 y(40)1959
2304 y(41)1959 2361 y(42)1959 2417 y(43)1959 2474 y(44)1959
2530 y(45)1959 2587 y(46)1959 2643 y(47)1959 2699 y(48)p
eop
%%Page: 3 5
3 4 bop 75 -100 a Fe(1.2.)34 b(NON-PR)o(OGRESSIVE)17
b(POINT)f(TO)f(POINT)810 b Fl(3)166 49 y Fh(Discussion:)48
b Fg(This)17 b(prop)q(osal)g(can)g(easily)g(b)q(e)h(extended)h(in)e(a)g
(natural)g(w)o(a)o(y)f(to)h(include)h Fb(RPUT)e Fg(and)75
106 y Fb(RGET)e Fg(functions,)g(whic)o(h)g(assume)f(that)i(the)f
Fb(OFFER)f Fg(has)h(b)q(een)i(p)q(erformed)d(on)h(the)h(target)g(in)f
(the)g(same)g(w)o(a)o(y)75 162 y(that)g Fb(IRSEND)f Fg(assumes)h(that)g
(a)g(receiv)o(e)h(has)f(b)q(een)h(p)q(osted)g(on)e(its)h(target.)75
353 y Fi(1.2)59 b(Non-Progressive)21 b(P)n(oint)f(to)g(P)n(oint)75
454 y Fd(MPI)p 160 454 14 2 v 16 w(PUT)11 b Fl(is)h(used)g(to)f(issue)h
(a)f Fd(PUT)h Fl(ev)o(en)o(t,)f(whic)o(h)h(\(when)g(serviced\))g
(transfers)f(data)f(from)h(the)g(calling)75 511 y(pro)q(cess)k(to)g(a)g
(target)f(pro)q(cess.)75 661 y Fd(MPI)p 160 661 V 16
w(PUT\(combine,)26 b(o)o(rigin)p 587 661 V 15 w(addr,)h(o)o(rigin)p
832 661 V 15 w(count,)g(o)o(rigin)p 1098 661 V 16 w(datat)o(yp)q(e,)g
(ta)o(rget)p 1429 661 V 17 w(rank,)f(ta)o(rget)p 1680
661 V 16 w(disp,)h(ta)o(r-)75 718 y(get)p 137 718 V 17
w(count,)16 b(ta)o(rget)p 400 718 V 16 w(datat)o(yp)q(e,)g(tag,)f
(comm\))117 795 y Fg(IN)155 b Fd(combine)430 b Fg(Com)o(bine)12
b(next)j(op)e(with)h(this)g(one)g(\(b)q(o)q(olean\))117
870 y(IN)155 b Fd(o)o(rigin)p 427 870 V 16 w(addr)381
b Fg(Data)13 b(to)h(b)q(e)h(put)f(\(c)o(hoice\))117 945
y(IN)155 b Fd(o)o(rigin)p 427 945 V 16 w(count)360 b
Fg(Num)o(b)q(er)14 b(of)f(data)g(elemen)o(ts)h(at)g Fb(o)o(rigin)p
1526 945 13 2 v 15 w(addr)h Fg(\(in)o(teger\))117 1021
y(IN)155 b Fd(o)o(rigin)p 427 1021 14 2 v 16 w(datat)o(yp)q(e)302
b Fg(Datat)o(yp)q(e)14 b(of)f(eac)o(h)i(elemen)o(t)e(at)h
Fb(o)o(rigin)p 1531 1021 13 2 v 15 w(addr)g Fg(\(handle\))117
1096 y(IN)155 b Fd(ta)o(rget)p 433 1096 14 2 v 17 w(rank)375
b Fg(Rank)13 b(of)h(target)g(\(in)o(teger\))117 1171
y(IN)155 b Fd(ta)o(rget)p 433 1171 V 17 w(disp)384 b
Fg(Relativ)o(e)13 b(displacemen)o(t)g(in)h(target)g(\(in)o(teger\))117
1246 y(IN)155 b Fd(ta)o(rget)p 433 1246 V 17 w(count)353
b Fg(Num)o(b)q(er)14 b(of)f(elemen)o(ts)h(in)f(target)h(\(in)o(teger\))
117 1321 y(IN)155 b Fd(ta)o(rget)p 433 1321 V 17 w(datat)o(yp)q(e)295
b Fg(Datat)o(yp)q(e)14 b(of)f(elemen)o(ts)h(in)f(target)117
1396 y(IN)155 b Fd(tag)526 b Fg(T)m(ag)13 b(\(in)o(teger\))117
1471 y(IN)155 b Fd(comm)470 b Fg(Comm)o(unicator)11 b(\(handle\))75
1596 y Fa(int)47 b(MPI)p 269 1596 15 2 v 17 w(put\()23
b(int)h(combine,)f(void)g(*origin)p 1003 1596 V 16 w(addr,)g(int)h
(origin)p 1402 1596 V 16 w(count,)f(MPI)p 1657 1596 V
17 w(Datatype)393 1652 y(origin)p 540 1652 V 17 w(datatype,)f(int)i
(target)p 1035 1652 V 16 w(rank,)f(int)h(target)p 1434
1652 V 16 w(disp,)f(int)393 1709 y(target)p 540 1709
V 17 w(count,)g(MPI)p 796 1709 V 16 w(Datatype)g(target)p
1171 1709 V 16 w(datatype,)g(int)h(tag,)f(MPI)p 1713
1709 V 17 w(Comm)393 1765 y(comm\))75 1852 y(MPI)p 150
1852 V 17 w(PUT\()g(COMBINE,)g(ORIGIN)p 645 1852 V 16
w(ADDR,)g(ORIGIN)p 948 1852 V 17 w(COUNT,)g(ORIGIN)p
1276 1852 V 16 w(DATATYPE,)g(TARGET)p 1675 1852 V 16
w(RANK,)393 1908 y(TARGET)p 540 1908 V 17 w(DISP,)g(TARGET)p
844 1908 V 16 w(COUNT,)g(TARGET)p 1171 1908 V 16 w(DATATYPE,)g(TAG,)g
(COMM,)h(IERROR\))170 1965 y(<type>)f(ORIGIN)p 484 1965
V 17 w(ADDR\(*\))170 2021 y(LOGICAL)g(COMBINE)170 2077
y(INTEGER)g(ORIGIN)p 508 2077 V 17 w(COUNT,)g(ORIGIN)p
836 2077 V 16 w(DATATYPE,)g(TARGET)p 1235 2077 V 16 w(RANK,)g(TARGET)p
1538 2077 V 17 w(DISP,)170 2134 y(TARGET)p 317 2134 V
17 w(COUNT,)g(TARGET)p 645 2134 V 16 w(DATATYPE,)g(TAG,)g(COMM,)g
(IERROR)166 2220 y Fd(MPI)p 251 2220 14 2 v 16 w(GET)18
b Fl(is)h(used)g(to)e(issue)i(a)f Fd(GET)g Fl(ev)o(en)o(t,)h(whic)o(h)g
(\(when)f(serviced\))h(transfers)e(data)h(from)f(a)75
2277 y(target)d(pro)q(cess)h(to)g(the)g(calling)i(pro)q(cess.)-32
46 y Fc(1)-32 103 y(2)-32 159 y(3)-32 215 y(4)-32 272
y(5)-32 328 y(6)-32 385 y(7)-32 441 y(8)-32 498 y(9)-40
554 y(10)-40 611 y(11)-40 667 y(12)-40 724 y(13)-40 780
y(14)-40 836 y(15)-40 893 y(16)-40 949 y(17)-40 1006
y(18)-40 1062 y(19)-40 1119 y(20)-40 1175 y(21)-40 1232
y(22)-40 1288 y(23)-40 1345 y(24)-40 1401 y(25)-40 1457
y(26)-40 1514 y(27)-40 1570 y(28)-40 1627 y(29)-40 1683
y(30)-40 1740 y(31)-40 1796 y(32)-40 1853 y(33)-40 1909
y(34)-40 1966 y(35)-40 2022 y(36)-40 2078 y(37)-40 2135
y(38)-40 2191 y(39)-40 2248 y(40)-40 2304 y(41)-40 2361
y(42)-40 2417 y(43)-40 2474 y(44)-40 2530 y(45)-40 2587
y(46)-40 2643 y(47)-40 2699 y(48)p eop
%%Page: 4 6
4 5 bop 75 -100 a Fl(4)196 b Fe(CHAPTER)15 b(1.)35 b(ONE)15
b(SIDED)h(COMMUNICA)l(TIONS)g({)f(P/G/O)f(AL)l(TERNA)l(TIVE)75
49 y Fd(MPI)p 160 49 14 2 v 16 w(GET\(combine,)27 b(o)o(rigin)p
585 49 V 15 w(addr,)g(o)o(rigin)p 830 49 V 15 w(count,)h(o)o(rigin)p
1097 49 V 15 w(datat)o(yp)q(e,)g(ta)o(rget)p 1428 49
V 17 w(rank,)e(ta)o(rget)p 1679 49 V 17 w(disp,)h(ta)o(r-)75
106 y(get)p 137 106 V 17 w(count,)16 b(ta)o(rget)p 400
106 V 16 w(datat)o(yp)q(e,)g(tag,)f(comm\))117 183 y
Fg(IN)155 b Fd(combine)430 b Fg(Com)o(bine)12 b(next)j(op)e(with)h
(this)g(one)g(\(b)q(o)q(olean\))117 258 y(OUT)108 b Fd(o)o(rigin)p
427 258 V 16 w(addr)381 b Fg(Data)13 b(to)h(b)q(e)h(retriev)o(ed)g(\(c)
o(hoice\))117 333 y(IN)155 b Fd(o)o(rigin)p 427 333 V
16 w(count)360 b Fg(Num)o(b)q(er)14 b(of)f(data)g(elemen)o(ts)h(at)g
Fb(o)o(rigin)p 1526 333 13 2 v 15 w(addr)h Fg(\(in)o(teger\))117
408 y(IN)155 b Fd(o)o(rigin)p 427 408 14 2 v 16 w(datat)o(yp)q(e)302
b Fg(Datat)o(yp)q(e)14 b(of)f(eac)o(h)i(elemen)o(t)e(at)h
Fb(o)o(rigin)p 1531 408 13 2 v 15 w(addr)g Fg(\(handle\))117
483 y(IN)155 b Fd(ta)o(rget)p 433 483 14 2 v 17 w(rank)375
b Fg(Rank)13 b(of)h(target)117 559 y(IN)155 b Fd(ta)o(rget)p
433 559 V 17 w(disp)384 b Fg(Relativ)o(e)13 b(displacemen)o(t)g(in)h
(target)g(\(in)o(teger\))117 634 y(IN)155 b Fd(ta)o(rget)p
433 634 V 17 w(count)353 b Fg(Num)o(b)q(er)14 b(of)f(elemen)o(ts)h(in)f
(target)h(\(in)o(teger\))117 709 y(IN)155 b Fd(ta)o(rget)p
433 709 V 17 w(datat)o(yp)q(e)295 b Fg(Datat)o(yp)q(e)14
b(of)f(elemen)o(ts)h(in)f(target)i(\(handle\))117 784
y(IN)155 b Fd(tag)526 b Fg(T)m(ag)13 b(\(in)o(teger\))117
859 y(IN)155 b Fd(comm)470 b Fg(Comm)o(unicator)11 b(\(handle\))75
984 y Fa(int)47 b(MPI)p 269 984 15 2 v 17 w(get\()23
b(int)h(combine,)f(void)g(*origin)p 1003 984 V 16 w(addr,)g(int)h
(origin)p 1402 984 V 16 w(count,)f(MPI)p 1657 984 V 17
w(Datatype)393 1040 y(origin)p 540 1040 V 17 w(datatype,)f(int)i
(target)p 1035 1040 V 16 w(rank,)f(int)h(target)p 1434
1040 V 16 w(disp,)f(int)393 1096 y(target)p 540 1096
V 17 w(count,)g(MPI)p 796 1096 V 16 w(Datatype)g(target)p
1171 1096 V 16 w(datatype,)g(int)h(tag,)f(MPI)p 1713
1096 V 17 w(Comm)393 1153 y(comm\))75 1239 y(MPI)p 150
1239 V 17 w(GET\()g(COMBINE,)g(ORIGIN)p 645 1239 V 16
w(ADDR,)g(ORIGIN)p 948 1239 V 17 w(COUNT,)g(ORIGIN)p
1276 1239 V 16 w(DATATYPE,)g(TARGET)p 1675 1239 V 16
w(RANK,)393 1296 y(TARGET)p 540 1296 V 17 w(DISP,)g(TARGET)p
844 1296 V 16 w(COUNT,)g(TARGET)p 1171 1296 V 16 w(DATATYPE,)g(TAG,)g
(COMM,)h(IERROR\))170 1352 y(<type>)f(ORIGIN)p 484 1352
V 17 w(ADDR\(*\))170 1409 y(LOGICAL)g(COMBINE)170 1465
y(INTEGER)g(ORIGIN)p 508 1465 V 17 w(COUNT,)g(ORIGIN)p
836 1465 V 16 w(DATATYPE,)g(TARGET)p 1235 1465 V 16 w(RANK,)g(TARGET)p
1538 1465 V 17 w(DISP,)170 1522 y(TARGET)p 317 1522 V
17 w(COUNT,)g(TARGET)p 645 1522 V 16 w(DATATYPE,)g(TAG,)g(COMM,)g
(IERROR)98 1658 y Fl(Requesting:)e(An)16 b Fd(MPI)p 510
1658 14 2 v 15 w(PUT)g Fl(or)f Fd(MPI)p 770 1658 V 15
w(GET)h Fl(op)q(eration)g(will)g(alw)o(a)o(ys)f(complete,)h(and)f
(results)h(in)g(the)189 1714 y(issuance)k(of)f(a)g Fd(PUT)h
Fl(or)e Fd(GET)i Fl(ev)o(en)o(t.)32 b(F)l(or)19 b(brevit)o(y)h(of)e
(description,)k(the)d(argumen)o(ts)g(of)g(the)189 1771
y(op)q(eration)g(issuing)i(a)e Fd(PUT)h Fl(or)f Fd(GET)h
Fl(ev)o(en)o(t)f(will)j(b)q(e)e(describ)q(ed)h(as)e(b)q(elonging)j(to)d
(the)g(ev)o(en)o(t)189 1827 y(itself.)98 1921 y(Com)o(bining:)33
b(If)22 b(the)f Fd(combine)g Fl(argumen)o(t)g(of)g(a)g
Fd(PUT)h Fl(\()p Fd(GET)p Fl(\))f(ev)o(en)o(t)g(is)h
Fb(true)p Fl(,)i(the)d(ev)o(en)o(t)g(will)i(b)q(e)189
1978 y(com)o(bined)12 b(with)g(the)g(next)g Fd(PUT)g
Fl(\()p Fd(GET)p Fl(\))f(ev)o(en)o(t)g(issued)i(from)e(the)h(same)f
(pro)q(cess)h(\(or,)f(if)h(m)o(ultiple)189 2034 y(threads,)21
b(the)f(same)g(thread)h(within)g(the)g(pro)q(cess\))f(whic)o(h)h(has)g
(the)f(same)g Fd(tag)p Fl(,)h Fd(comm)p Fl(,)f(and)189
2090 y Fd(ta)o(rget)p 304 2090 V 16 w(rank)13 b Fl(argumen)o(ts,)f(to)h
(form)f(a)h(single)i(ev)o(en)o(t.)k(An)o(y)13 b(n)o(um)o(b)q(er)g(of)g
(ev)o(en)o(ts)g(can)g(b)q(e)h(com)o(bined)189 2147 y(in)i(this)f(w)o(a)
o(y)l(.)98 2241 y(Matc)o(hing:)j(Eac)o(h)13 b Fd(PUT)g
Fl(\()p Fd(GET)p Fl(\))f(ev)o(en)o(t)h(will)h(b)q(e)g(serviced)g(at)e
(most)g(once,)h(and)g(only)h(b)o(y)e(an)h Fd(OFFER)g
Fl(or)189 2297 y Fd(IOFFER)k Fl(op)q(eration)h(executing)g(in)h(the)e
(pro)q(cess)h(designated)g(b)o(y)f(the)h Fd(comm)d Fl(and)j
Fd(ta)o(rget)p 1779 2297 V 16 w(rank)189 2354 y Fl(argumen)o(ts)11
b(of)g(the)h Fd(PUT)g Fl(\()p Fd(GET)p Fl(\))g(ev)o(en)o(t,)g(and)g
(whic)o(h)h(has)f(matc)o(hing)g Fd(comm)e Fl(and)i Fd(tag)g
Fl(argumen)o(ts)189 2410 y(and)j(an)g Fd(events)i Fl(argumen)o(t)e
(whic)o(h)h(equals)g Fb(MPI)p 1023 2410 13 2 v 14 w(PUTS)p
1144 2410 V 15 w(OK)e Fl(\()p Fb(MPI)p 1326 2410 V 14
w(GETS)p 1444 2410 V 15 w(OK)p Fl(\))g(or)h Fb(MPI)p
1682 2410 V 14 w(PUTS)p 1803 2410 V 15 w(OK)189 2467
y Fl(+)g Fb(MPI)p 316 2467 V 14 w(GETS)p 434 2467 V 15
w(OK)p Fl(.)98 2560 y(Non-Ov)o(ertaking:)27 b(If)20 b(a)e
Fd(PUT)i Fl(or)e Fd(GET)h Fl(ev)o(en)o(t)g(is)h(serviced,)g(all)g
(other)f Fd(PUT)g Fl(and)g Fd(GET)h Fl(ev)o(en)o(ts)e(is-)189
2617 y(sued)d(from)f(the)h(same)g(pro)q(cess)g(\(thread\))f(and)h(ha)o
(ving)g(iden)o(tical)i Fd(comm)p Fl(,)12 b Fd(tag)p Fl(,)j(and)g
Fd(ta)o(rget)p 1779 2617 14 2 v 16 w(rank)189 2673 y
Fl(argumen)o(ts)f(will)j(already)e(ha)o(v)o(e)g(b)q(een)h(serviced.)
1967 46 y Fc(1)1967 103 y(2)1967 159 y(3)1967 215 y(4)1967
272 y(5)1967 328 y(6)1967 385 y(7)1967 441 y(8)1967 498
y(9)1959 554 y(10)1959 611 y(11)1959 667 y(12)1959 724
y(13)1959 780 y(14)1959 836 y(15)1959 893 y(16)1959 949
y(17)1959 1006 y(18)1959 1062 y(19)1959 1119 y(20)1959
1175 y(21)1959 1232 y(22)1959 1288 y(23)1959 1345 y(24)1959
1401 y(25)1959 1457 y(26)1959 1514 y(27)1959 1570 y(28)1959
1627 y(29)1959 1683 y(30)1959 1740 y(31)1959 1796 y(32)1959
1853 y(33)1959 1909 y(34)1959 1966 y(35)1959 2022 y(36)1959
2078 y(37)1959 2135 y(38)1959 2191 y(39)1959 2248 y(40)1959
2304 y(41)1959 2361 y(42)1959 2417 y(43)1959 2474 y(44)1959
2530 y(45)1959 2587 y(46)1959 2643 y(47)1959 2699 y(48)p
eop
%%Page: 5 7
5 6 bop 75 -100 a Fe(1.2.)34 b(NON-PR)o(OGRESSIVE)17
b(POINT)f(TO)f(POINT)810 b Fl(5)98 49 y(Servicing:)26
b(When)18 b(a)f(giv)o(en)h Fd(PUT)f Fl(\()p Fd(GET)p
Fl(\))h(ev)o(en)o(t)f(is)h(serviced)g(b)o(y)g(a)f(giv)o(en)h
Fd(OFFER)g Fl(op)q(eration,)g Fd(o)o(ri-)189 106 y(gin)p
249 106 14 2 v 16 w(count)c Fl(data)e(items)i(of)e(datat)o(yp)q(e)h
Fd(o)o(rigin)p 949 106 V 15 w(datat)o(yp)q(e)p Fl(,)h(starting)f(at)f
(lo)q(cation)i Fd(o)o(rigin)p 1652 106 V 15 w(addr)f
Fl(in)h(the)189 162 y(pro)q(cess)f(from)g(whic)o(h)i(the)e
Fd(PUT)h Fl(\()p Fd(GET)p Fl(\))f(ev)o(en)o(t)h(w)o(as)e(issued,)j(is)f
(transferred)f(to)g(\(from\))f(the)i(pro-)189 219 y(cess)h(on)g(whic)o
(h)h(the)g Fd(OFFER)g Fl(op)q(eration)f(executes)h(in)g(the)g(lo)q
(cation)g(obtained)g(b)o(y)f(m)o(ultiplying)189 275 y
Fd(ta)o(rget)p 304 275 V 16 w(disp)20 b Fl(from)d(the)i
Fd(PUT)g Fl(\()p Fd(GET)p Fl(\))f(ev)o(en)o(t)g(with)h
Fd(disp)p 1162 275 V 18 w(unit)g Fl(of)g(the)f Fd(OFFER)h
Fl(op)q(eration,)h(then)189 332 y(in)o(terpreting)d(this)g(lo)q(cation)
h(to)e(b)q(e)h(the)g(b)q(eginning)i(of)d Fd(ta)o(rget)p
1282 332 V 16 w(count)i Fl(data)e(items)h(of)f(datat)o(yp)q(e)189
388 y Fd(ta)o(rget)p 304 388 V 16 w(datat)o(yp)q(e)p
Fl(.)21 b(If)15 b(m)o(ultiple)h(ev)o(en)o(ts)e(are)g(com)o(bined)h(in)o
(to)f(a)g(single)i(ev)o(en)o(t)e(using)h(the)f Fd(combine)189
444 y Fl(argumen)o(t,)j(eac)o(h)g(p)q(ortion)h(of)g(the)f(ev)o(en)o(t)h
(is)g(handled)h(in)f(this)h(w)o(a)o(y)l(.)26 b([Note:)e(In)18
b(the)g(end,)h(this)189 501 y(should)d(w)o(ork)e(the)h(same)g(as)g(in)h
(Marc's)e(original)i(prop)q(osal].)98 590 y(Non-Conformance:)j(Lo)q
(cal)e(references)f(to)e(addresses)i(in)g(the)f(range)g(sp)q(eci\014ed)
j(b)o(y)d(the)g Fd(o)o(rigin)p 1767 590 V 15 w(base)p
Fl(,)189 646 y Fd(o)o(rigin)p 298 646 V 15 w(datat)o(yp)q(e)p
Fl(,)k(and)e Fd(o)o(rigin)p 704 646 V 16 w(count)h Fl(argumen)o(ts)f
(of)f(a)h Fd(PUT)h Fl(or)e Fd(GET)i Fl(op)q(eration)g(are)e(not)h(p)q
(er-)189 703 y(mitted)k(b)q(et)o(w)o(een)h(that)f(op)q(eration)g(and)h
(follo)o(wing)g(completion)g(of)f(an)h Fd(OFFER)g Fl(or)f
Fd(IOFFER)189 759 y Fl(op)q(eration)15 b(ha)o(ving)h(the)f(same)g
Fd(tag)g Fl(and)g Fd(comm)f Fl(argumen)o(ts.)166 851
y Fd(MPI)p 251 851 V 16 w(OFFER)g Fl(is)h(used)f(to)f(sp)q(ecify)i
(that)e(the)h(calling)i(pro)q(cess)e(is)g(willing)j(to)c(service)h
Fd(PUT)h Fl(and/or)75 907 y Fd(GET)h Fl(ev)o(en)o(ts)e(issued)j(b)o(y)e
(other)g(pro)q(cesses.)75 1058 y Fd(MPI)p 160 1058 V
16 w(OFFER\(events,)i(base,)e(size,)g(disp)p 762 1058
V 18 w(unit,)h(tag,)f(comm,)e(count\))117 1136 y Fg(IN)155
b Fd(events)470 b Fg(Ev)o(en)o(ts)15 b(to)f(b)q(e)g(serviced)h(\()p
Fb(PUT)p Fg(,)e Fb(GET)p Fg(,)g(or)h(b)q(oth\))g(\(in)o(teger\))117
1208 y(INOUT)62 b Fd(base)505 b Fg(Bu\013er)23 b(made)e(a)o(v)n
(ailable)e(to)i(PUT)h(and/or)g(GET)f(ev)o(en)o(ts)905
1265 y(\(c)o(hoice\))117 1338 y(IN)155 b Fd(size)519
b Fg(Size)15 b(of)e Fb(base)h Fg(in)g(b)o(ytes)g(\(in)o(teger\))117
1410 y(IN)155 b Fd(disp)p 395 1410 V 18 w(unit)422 b
Fg(Scale)14 b(factor)g(for)g Fb(ta)o(rget)p 1298 1410
13 2 v 15 w(disp)g Fg(in)g(ev)o(en)o(ts)117 1483 y(IN)155
b Fd(tag)526 b Fg(T)m(ag)13 b(\(in)o(teger\))117 1556
y(IN)155 b Fd(comm)470 b Fg(Comm)o(unicator)11 b(\(handle\))117
1628 y(IN)155 b Fd(count)482 b Fg(Num)o(b)q(er)14 b(of)f(ev)o(en)o(ts)i
(to)f(service)h(\(in)o(teger\))75 1753 y Fa(int)23 b(MPI)p
245 1753 15 2 v 17 w(offer\(int)g(events,)g(void*)g(base,)g(int)h
(size,)f(int)g(disp)p 1408 1753 V 17 w(unit,)g(int)g(tag,)393
1809 y(MPI)p 468 1809 V 17 w(Comm)g(comm,)g(int)h(count\))75
1896 y(MPI)p 150 1896 V 17 w(OFFER\(EVENTS,)e(BASE,)h(SIZE,)g(DISP)p
883 1896 V 17 w(UNIT,)g(TAG,)g(COMM,)h(COUNT,)f(IERROR\))170
1952 y(<type>)g(BASE\(*\))170 2009 y(INTEGER)g(EVENTS,)g(SIZE,)g(DISP)p
794 2009 V 17 w(UNIT,)g(TAG,)h(COMM,)f(COUNT,)g(IERROR)98
2130 y Fl(Ev)o(en)o(ts:)g(If)17 b Fd(count)i Fl(is)f(non-zero,)f(the)g
Fd(events)i Fl(argumen)o(t)e(m)o(ust)f(ha)o(v)o(e)h(one)g(of)g(the)g
(follo)o(wing)h(v)m(alues:)189 2187 y Fb(MPI)p 266 2187
13 2 v 14 w(PUTS)p 387 2187 V 14 w(OK)p Fl(,)k Fb(MPI)p
571 2187 V 14 w(GETS)p 689 2187 V 15 w(OK)p Fl(,)f(or)h
Fb(MPI)p 936 2187 V 14 w(PUTS)p 1057 2187 V 14 w(OK)g
Fl(+)h Fb(MPI)p 1286 2187 V 14 w(GETS)p 1404 2187 V 15
w(OK)p Fl(,)e(in)i(whic)o(h)h(case)e(the)189 2243 y Fd(MPI)p
274 2243 14 2 v 15 w(OFFER)17 b Fl(op)q(eration)e(will)j(matc)o(h)d
Fd(PUT)g Fl(ev)o(en)o(ts,)g Fd(GET)h Fl(ev)o(en)o(ts,)f(or)g
Fd(PUT)h Fl(and)g Fd(GET)g Fl(ev)o(en)o(ts,)189 2300
y(resp)q(ectiv)o(ely)l(.)98 2389 y(Completion:)j(An)12
b Fd(MPI)p 515 2389 V 16 w(OFFER)h Fl(op)q(eration)f(will)i(complete)f
(if)g(and)f(only)h(if)g(all)g(of)f(the)g Fd(PUT)g Fl(and)h
Fd(GET)189 2445 y Fl(ev)o(en)o(ts)h(issued)h(b)o(y)f(the)h(pro)q(cess)g
(executing)g(the)f Fd(MPI)p 1121 2445 V 16 w(OFFER)p
Fl(,)h(and)f(ha)o(ving)h(the)f(same)g Fd(tag)h Fl(and)189
2502 y Fd(comm)p Fl(,)h(ha)o(v)o(e)h(b)q(een)h(fully)h(serviced,)g
(\(*\))e(and)h(the)f Fd(MPI)p 1178 2502 V 16 w(OFFER)i
Fl(has)e(serviced)i(exactly)f Fd(count)189 2558 y(PUT)d
Fl(and/or)g Fd(GET)g Fl(ev)o(en)o(ts)g(\(eac)o(h)g(of)g(whic)o(h)h(ma)o
(y)e(b)q(e)i(a)f(com)o(bined)h(ev)o(en)o(t\).)98 2647
y(Progress:)29 b(If)21 b(an)f Fd(MPI)p 513 2647 V 16
w(OFFER)h Fl(op)q(eration)g(is)g(con)o(tin)o(uously)g(capable)h(of)e
(\014nishing,)j(then)e(it)f(will)189 2704 y(\014nish)c(within)h(a)d
(\014nite)j(time.)-32 46 y Fc(1)-32 103 y(2)-32 159 y(3)-32
215 y(4)-32 272 y(5)-32 328 y(6)-32 385 y(7)-32 441 y(8)-32
498 y(9)-40 554 y(10)-40 611 y(11)-40 667 y(12)-40 724
y(13)-40 780 y(14)-40 836 y(15)-40 893 y(16)-40 949 y(17)-40
1006 y(18)-40 1062 y(19)-40 1119 y(20)-40 1175 y(21)-40
1232 y(22)-40 1288 y(23)-40 1345 y(24)-40 1401 y(25)-40
1457 y(26)-40 1514 y(27)-40 1570 y(28)-40 1627 y(29)-40
1683 y(30)-40 1740 y(31)-40 1796 y(32)-40 1853 y(33)-40
1909 y(34)-40 1966 y(35)-40 2022 y(36)-40 2078 y(37)-40
2135 y(38)-40 2191 y(39)-40 2248 y(40)-40 2304 y(41)-40
2361 y(42)-40 2417 y(43)-40 2474 y(44)-40 2530 y(45)-40
2587 y(46)-40 2643 y(47)-40 2699 y(48)p eop
%%Page: 6 8
6 7 bop 75 -100 a Fl(6)196 b Fe(CHAPTER)15 b(1.)35 b(ONE)15
b(SIDED)h(COMMUNICA)l(TIONS)g({)f(P/G/O)f(AL)l(TERNA)l(TIVE)98
49 y Fl(Non-conformance:)29 b(Lo)q(cal)20 b(references)h(to)e
(addresses)h(in)g(the)g(range)g(sp)q(eci\014ed)i(b)o(y)d(the)h
Fd(base)h Fl(and)189 106 y Fd(size)d Fl(argumen)o(ts)f(of)g(an)h
Fd(MPI)p 704 106 14 2 v 16 w(OFFER)h Fl(op)q(eration)f(are)g(not)f(p)q
(ermitted)i(during)g(the)f(execution)189 162 y(of)c(that)f(op)q
(eration.)20 b(Multiple)d(references)e(to)f(a)g(single)h(address)g
(within)h(that)d(range)h(b)o(y)h(one)f(or)189 219 y(more)g
Fd(GET)i Fl(and/or)f Fd(PUT)g Fl(ev)o(en)o(ts)g(serviced)h(b)o(y)f(the)
h Fd(MPI)p 1202 219 V 15 w(OFFER)g Fl(are)f(also)g(not)g(p)q(ermitted.)
166 365 y Fh(Discussion:)33 b Fg(OFFER)14 b(could)f(b)q(e)h(giv)o(en)f
Fb(o)o(rigin)p 964 365 13 2 v 15 w(rank)h Fg(and)f Fb(status)h
Fg(argumen)o(ts)e(with)h(the)h(same)f(purp)q(ose)75 422
y(and)18 b(general)h(meaning)e(as)h(the)h(same)f(argumen)o(ts)g(in)g
Fb(MPI)p 1056 422 V 14 w(RECV)p Fg(.)f(Ho)o(w)o(ev)o(er,)j(since)f
(these)h(op)q(erations)f(can)75 478 y(service)c(m)o(ultiple)d(ev)o(en)o
(ts,)i(these)i(argumen)o(ts)d(seem)g(less)i(useful)f(than)g(for)f
Fb(MPI)p 1353 478 V 15 w(RECV)p Fg(.)189 625 y Ff(R)n(ationale.)38
b Fd(MPI)p 514 625 14 2 v 15 w(OFFER)13 b Fl(pla)o(ys)f(a)g(dual)h
(role)f({)g(i.e.)19 b(servicing)14 b(ev)o(en)o(ts)d(and)i(w)o(aiting)f
(for)f(ev)o(en)o(ts)189 682 y(issued)j(lo)q(cally)g(to)f(complete)g({)g
(partially)h(for)e(simplicit)o(y)k(and)d(partially)h(to)e(handle)i
(those)f(cases)189 738 y(where)21 b(pro)q(cesses)h(are)f(p)q(erforming)
h(PUT)g(and)f(GET)g(op)q(erations)h(to)f(eac)o(h)g(other.)38
b(In)23 b(this)189 795 y(latter)c(case,)g(to)g(a)o(v)o(oid)g(deadlo)q
(c)o(k,)i(eac)o(h)e(pro)q(cess)h(m)o(ust)e(p)q(erform)h(b)q(oth)h(of)e
(these)i(op)q(erations)189 851 y(concurren)o(tly)l(.)g(\()p
Ff(End)c(of)g(r)n(ationale.)p Fl(\))189 951 y Ff(A)n(dvic)n(e)c(to)h
(implementors.)37 b Fl(On)13 b(non-cac)o(he-coheren)o(t)f
(shared-memory)g(arc)o(hitectures,)g(where)189 1007 y(remote)k(op)q
(erations)h(access)h(main)f(memory)g(but)g(not)g(cac)o(he,)g(an)g
(OFFER)g(op)q(eration)h(with)f(a)189 1063 y(non-zero)d
Fd(count)i Fl(argumen)o(t)e(can)h(b)q(egin)h(b)o(y)e(p)q(erforming)h(a)
f(cac)o(he)h(\015ush)g(of)g(the)f(memory)g(range)189
1120 y(\(to)g(ensure)j(that)e(remote)g(pro)q(cesses)h(will)i(see)e(or)f
(up)q(date)h(the)g(freshest)g(v)m(alues\).)22 b(Conforming)189
1176 y(programs)12 b(will)k(not)e(bring)g(an)o(y)g(addresses)g(in)o
(ternal)h(to)e(this)i(range)f(in)o(to)g(cac)o(he)g(b)o(y)g(referencing)
189 1233 y(them)h(for)h(the)g(duration)g(of)f(the)h(op)q(eration.)22
b(Ho)o(w)o(ev)o(er,)15 b(if)h(false)g(sharing)h(exists,)f(where)g(cac)o
(he)189 1289 y(lines)i(ma)o(y)e(con)o(tain)h(data)g(from)f(b)q(oth)h
(inside)h(and)f(outside)h(the)f(public)i(region,)e(b)o(ytes)g(within)
189 1346 y(shared)e(cac)o(he)h(lines)g(ma)o(y)f(need)h(to)f(b)q(e)h
(sen)o(t)f(to)f(their)i(destination)g(explicitly)l(.)23
b(\()p Ff(End)16 b(of)g(advic)n(e)189 1402 y(to)g(implementors.)p
Fl(\))166 1502 y(MPI)p 258 1502 V 16 w(IOFFER)g(is)g(a)f(non-blo)q(c)o
(king)h(v)o(ersion)g(of)f(MPI)p 1113 1502 V 16 w(OFFER.)75
1653 y Fd(MPI)p 160 1653 V 16 w(IOFFER\(events,)h(base,)g(size,)f(disp)
p 775 1653 V 18 w(unit,)h(tag,)e(comm,)f(count,)j(request\))117
1730 y Fg(IN)155 b Fd(events)470 b Fg(Ev)o(en)o(ts)15
b(to)f(b)q(e)g(serviced)h(\()p Fb(PUT)p Fg(,)e Fb(GET)p
Fg(,)g(or)h(b)q(oth\))g(\(in)o(teger\))117 1804 y(INOUT)62
b Fd(base)505 b Fg(Bu\013er)23 b(made)e(a)o(v)n(ailable)e(to)i(PUT)h
(and/or)g(GET)f(ev)o(en)o(ts)905 1860 y(\(c)o(hoice\))117
1934 y(IN)155 b Fd(size)519 b Fg(Size)15 b(of)e Fb(base)h
Fg(in)g(b)o(ytes)g(\(in)o(teger\))117 2008 y(IN)155 b
Fd(disp)p 395 2008 V 18 w(unit)422 b Fg(Scale)14 b(factor)g(for)g
Fb(ta)o(rget)p 1298 2008 13 2 v 15 w(disp)g Fg(in)g(ev)o(en)o(ts)h
(\(in)o(teger\))117 2083 y(IN)155 b Fd(tag)526 b Fg(T)m(ag)13
b(\(in)o(teger\))117 2157 y(IN)155 b Fd(comm)470 b Fg(Comm)o(unicator)
11 b(\(handle\))117 2231 y(IN)155 b Fd(count)482 b Fg(Num)o(b)q(er)14
b(of)f(ev)o(en)o(ts)i(to)f(service)h(\(in)o(teger\))75
2355 y Fa(int)23 b(MPI)p 245 2355 15 2 v 17 w(ioffer\(int)g(events,)g
(void*)g(base,)g(int)g(size,)h(int)f(disp)p 1432 2355
V 17 w(unit,)g(int)g(tag,)393 2411 y(MPI)p 468 2411 V
17 w(Comm)g(comm,)g(int)h(count,)f(MPI)p 1082 2411 V
17 w(request)g(request\))75 2498 y(MPI)p 150 2498 V 17
w(IOFFER\(EVENTS,)f(BASE,)h(SIZE,)g(DISP)p 907 2498 V
17 w(UNIT,)g(TAG,)g(COMM,)g(COUNT,)g(REQUEST,)393 2554
y(IERROR\))170 2611 y(<type>)g(BASE\(*\))170 2667 y(INTEGER)g(EVENTS,)g
(SIZE,)g(DISP)p 794 2667 V 17 w(UNIT,)g(TAG,)h(COMM,)f(COUNT,)g
(REQUEST,)g(IERROR)1967 46 y Fc(1)1967 103 y(2)1967 159
y(3)1967 215 y(4)1967 272 y(5)1967 328 y(6)1967 385 y(7)1967
441 y(8)1967 498 y(9)1959 554 y(10)1959 611 y(11)1959
667 y(12)1959 724 y(13)1959 780 y(14)1959 836 y(15)1959
893 y(16)1959 949 y(17)1959 1006 y(18)1959 1062 y(19)1959
1119 y(20)1959 1175 y(21)1959 1232 y(22)1959 1288 y(23)1959
1345 y(24)1959 1401 y(25)1959 1457 y(26)1959 1514 y(27)1959
1570 y(28)1959 1627 y(29)1959 1683 y(30)1959 1740 y(31)1959
1796 y(32)1959 1853 y(33)1959 1909 y(34)1959 1966 y(35)1959
2022 y(36)1959 2078 y(37)1959 2135 y(38)1959 2191 y(39)1959
2248 y(40)1959 2304 y(41)1959 2361 y(42)1959 2417 y(43)1959
2474 y(44)1959 2530 y(45)1959 2587 y(46)1959 2643 y(47)1959
2699 y(48)p eop
%%Page: 7 9
7 8 bop 75 -100 a Fe(1.3.)34 b(PR)o(OGRESSIVE)17 b(OPERA)l(TIONS)1022
b Fl(7)98 49 y(Progress:)18 b(If)d Fd(MPI)p 428 49 14
2 v 16 w(W)l(AIT)g Fl(is)g(called)i(on)e(the)f Fd(request)j
Fl(returned)e(b)o(y)g Fd(MPI)p 1367 49 V 16 w(IOFFER)p
Fl(,)f(then)i(the)e(com)o(bi-)189 106 y(nation)i(will)h(ha)o(v)o(e)f
(the)g(same)g(progress)f(seman)o(tics)h(as)g(a)f(call)i(to)f
Fd(MPI)p 1423 106 V 15 w(OFFER)h Fl(with)f(the)g(same)189
162 y(argumen)o(ts.)k(Ho)o(w)o(ev)o(er,)15 b(an)g Fd(MPI)p
774 162 V 16 w(IOFFER)h Fl(op)q(eration)g(is)g(not)g(guaran)o(teed)f
(to)g(service)i Fd(PUT)e Fl(or)189 219 y Fd(GET)i Fl(ev)o(en)o(ts)g(un)
o(til)h(the)f Fd(MPI)p 708 219 V 16 w(IOFFER)g Fl(op)q(eration)g
(completes)h(or)f(attempts)f(to)g(complete.)26 b(In)189
275 y(this)19 b(sense,)i Fd(MPI)p 501 275 V 15 w(IOFFER)f
Fl(do)q(es)f(not)g(follo)o(w)h(the)f(standard)g(progress)f(rule)i(asso)
q(ciated)g(with)189 332 y(non)o(blo)q(c)o(king)e(comm)o(unication.)27
b(Ho)o(w)o(ev)o(er,)16 b(if)i(an)f Fd(MPI)p 1176 332
V 15 w(GET)h Fl(or)f Fd(MPI)p 1437 332 V 15 w(PUT)h Fl(op)q(eration)f
(issues)189 388 y(a)d Fd(GET)g Fl(or)g Fd(PUT)h Fl(ev)o(en)o(t)f(whic)o
(h)h(matc)o(hes)f(an)g Fd(MPI)p 1059 388 V 16 w(IOFFER)g
Fl(curren)o(tly)h(executing)h(on)e(the)g(same)189 444
y(pro)q(cess)22 b(according)g(to)g(the)g(matc)o(hing)g(rules)g(ab)q(o)o
(v)o(e,)h(then)f(the)g(matc)o(h)g(will)h(alw)o(a)o(ys)f(o)q(ccur)189
501 y(and)16 b(the)h(data)f(will)i(alw)o(a)o(ys)e(b)q(e)i(transferred)e
(immediately)l(,)i(b)q(efore)f(the)g(issuing)h Fd(MPI)p
1717 501 V 16 w(GET)e Fl(or)189 557 y Fd(MPI)p 274 557
V 15 w(PUT)g Fl(op)q(eration)f(returns)g(execution)i(to)d(its)i
(caller.)98 651 y(Indeterminate)22 b(Coun)o(ts:)33 b(If)21
b(the)h Fd(count)h Fl(argumen)o(t)e(of)g Fd(MPI)p 1202
651 V 16 w(IOFFER)h Fl(op)q(eration)g(has)f(the)h(v)m(alue)189
708 y Fb(MPI)p 266 708 13 2 v 14 w(COUNT)p 424 708 V
14 w(ANY)p Fl(,)13 b(then)i(the)f(op)q(eration)g(will)h(con)o(tin)o(ue)
g(to)e(service)i Fd(PUT)f Fl(and/or)f Fd(GET)h Fl(ev)o(en)o(ts)189
764 y(un)o(til)h(an)f Fd(MPI)p 442 764 14 2 v 16 w(W)l(AIT)g
Fl(is)h(issued)h(on)e(the)h Fd(request)p Fl(,)g(at)f(whic)o(h)h(time)g
(the)f(op)q(eration)h(will)h(attempt)189 821 y(to)22
b(complete.)43 b Fb(MPI)p 561 821 13 2 v 14 w(COUNT)p
719 821 V 15 w(ANY)22 b Fl(is)h(not)g(a)f(legal)i(v)m(alue)g(for)e(the)
h Fd(count)h Fl(argumen)o(t)e(of)g(an)189 877 y Fd(MPI)p
274 877 14 2 v 15 w(OFFER)16 b Fl(op)q(eration.)189 983
y Ff(R)n(ationale.)42 b Fl(The)16 b(last)g(sen)o(tence)g(in)g(the)g
(Progress)f(clause)h(is)g(to)f(allo)o(w)h(pro)q(cesses)g(to)f(p)q
(erform)189 1040 y(one-sided)22 b(op)q(erations)f(to)e(themselv)o(es.)
37 b(Without)21 b(it,)g(they)g(w)o(ould)g(need)h(to)e(complete)h(the)
189 1096 y(IOFFER)f(b)q(efore)h(they)f(could)h(b)q(e)g(ensured)g(that)f
(a)g Fd(MPI)p 1230 1096 V 16 w(GET)g Fl(or)g Fd(MPI)p
1497 1096 V 16 w(PUT)g Fl(to)g(their)g(o)o(wn)189 1153
y(pro)q(cess)e(w)o(ould)g(complete,)g(making)g(the)g(op)q(eration)g
(useless.)28 b(This)18 b(is)g(esp)q(ecially)i(imp)q(ortan)o(t)189
1209 y(b)q(elo)o(w)15 b(for)g(third-part)o(y)g(op)q(eration,)g(as)g
(describ)q(ed)i(b)q(elo)o(w.)k(\()p Ff(End)15 b(of)i(r)n(ationale.)p
Fl(\))75 1352 y Fi(1.3)59 b(Progressive)21 b(Op)r(erations)75
1454 y Fl(The)10 b(op)q(erations)h(in)g(this)f(section)h(\(i.e.)18
b Fd(MPI)p 837 1454 V 16 w(PUTP)p Fl(,)10 b Fd(MPI)p
1078 1454 V 16 w(GETP)p Fl(,)g Fd(MPI)p 1316 1454 V 16
w(OFFERP)p Fl(,)g(and)h Fd(MPI)p 1691 1454 V 15 w(IOFFERP)p
Fl(\))75 1510 y(are)g(completely)h(analogous)f(to)g(the)g(op)q
(erations)h(in)g(the)f(previous)h(section)g(\(i.e.)18
b Fd(MPI)p 1548 1510 V 16 w(PUT)p Fl(,)11 b Fd(MPI)p
1761 1510 V 16 w(GET)p Fl(,)75 1567 y Fd(MPI)p 160 1567
V 16 w(OFFER)p Fl(,)j(and)g Fd(MPI)p 513 1567 V 16 w(IOFFER)p
Fl(\).)f(They)h(tak)o(e)f(the)h(same)g(argumen)o(ts,)f(and)h(ha)o(v)o
(e)f(the)h(same)g(e\013ects,)75 1623 y(except)f(that)f(\(1\))g
Fd(PUTP)h Fl(and)h Fd(GETP)f Fl(ev)o(en)o(ts)f(will)j(b)q(e)e(serviced)
h(ev)o(en)g(if)f(the)g(matc)o(hing)g Fd(MPI)p 1679 1623
V 16 w(IOFFERP)75 1680 y Fl(op)q(eration)18 b(do)q(es)g(not)f
(complete,)i(and)e(\(2\))g(m)o(ultiple)j Fd(PUTP)d Fl(and)h
Fd(GETP)g Fl(op)q(erations)g(serviced)h(b)o(y)e(a)75
1736 y(single)g Fd(MPI)p 287 1736 V 15 w(OFFERP)f Fl(or)f
Fd(MPI)p 626 1736 V 16 w(IOFFERP)g Fl(op)q(eration)h(ma)o(y)e(access)i
(the)f(same)g(target)f(address.)166 1792 y(Users)i(ma)o(y)g(\014nd)h
(these)f(op)q(erations)h(useful)g(for)f(p)q(erforming)g(so-called)i
(third-part)o(y)e(comm)o(uni-)75 1849 y(cation.)j(Here,)14
b(a)f(\014rst)g(pro)q(cess)g(PUTs)g(data)g(to)f(a)h(third)h(pro)q
(cess,)f(and)h(a)f(second)h(pro)q(cess)f(GETs)g(data)75
1905 y(from)e(the)g(third)h(pro)q(cess,)g(but)g(the)f(third)i(pro)q
(cess)e(is)h(not)f(explicitly)j(in)o(v)o(olv)o(ed)f(in)f(the)g(comm)o
(unication.)75 1962 y(Using)i(progressiv)o(e)f(op)q(erations,)g(this)h
(functionalit)o(y)g(can)g(b)q(e)g(ac)o(heiv)o(ed)g(b)o(y)f(ha)o(ving)h
(the)f(third)h(pro)q(cess)75 2018 y(b)q(egin)i(an)e Fd(MPI)p
344 2018 V 16 w(IOFFERP)h Fl(op)q(eration)f(\(probably)h(with)g(a)f
Fd(count)h Fl(of)f Fb(MPI)p 1353 2018 13 2 v 15 w(COUNT)p
1512 2018 V 14 w(ANY)p Fl(\),)f(after)h(whic)o(h)75 2075
y(it)e(can)g(go)f(ab)q(out)h(other)g(pro)q(cessing.)19
b(Note,)12 b(ho)o(w)o(ev)o(er,)f(that)h(in)g(order)g(for)f(the)h(third)
g(pro)q(cess)h(to)e(access)75 2131 y(the)16 b(region)g(o\013ered)f(in)h
(the)g Fd(MPI)p 656 2131 14 2 v 16 w(IOFFERP)g Fl(in)g(a)g(p)q(ortable)
g(w)o(a)o(y)l(,)e(it)i(m)o(ust)f(still)i(either)g(complete)f(the)75
2188 y Fd(MPI)p 160 2188 V 16 w(IOFFERP)i Fl(\(b)o(y)f(calling)j
Fd(MPI)p 689 2188 V 16 w(W)l(AIT)p Fl(\))d(or)h(p)q(erform)f
Fd(MPI)p 1168 2188 V 16 w(GETP)h Fl(or)g Fd(MPI)p 1460
2188 V 16 w(PUTP)g Fl(op)q(erations)g(to)75 2244 y(the)d(region.)166
2301 y(The)j(user)g(is)g(advised)h(to)e(use)h(these)h(op)q(erations)e
(only)i(when)f(the)g(non-progressiv)o(e)g(forms)f(are)75
2357 y(insu\016cien)o(t,)k(since)g(the)e(progressiv)o(e)g(forms)g(ma)o
(y)f(incur)j(signi\014can)o(t)f(o)o(v)o(erhead)f(on)g(some)g(systems.)
75 2413 y(Ev)o(en)14 b(applications)i(requiring)f(third-part)o(y)f
(comm)o(unication)g(can)g(b)q(e)h(implemen)o(ted)h(using)f(the)f(non-)
75 2470 y(progressiv)o(e)21 b(op)q(erations)h(in)g(the)g(previous)g
(sections)g(b)o(y)g(initiating)h(a)e(separate)g(\(fourth\))g(pro)q
(cess)75 2526 y(whic)o(h)14 b(lo)q(ops)f(on)f(an)h Fd(MPI)p
524 2526 V 16 w(OFFER)g Fl(op)q(eration.)19 b(In)14 b(this)f(case,)g
(the)g(\014rst,)f(second,)h(and)g(third)h(pro)q(cesses)75
2583 y(in)f(the)f(third-part)o(y)g(scenario)g(can)h(p)q(erform)f
(non-progressiv)o(e)g(PUT)g(and)g(GET)f(op)q(erations)i(targeting)75
2639 y(the)i(fourth)g(pro)q(cess.)-32 46 y Fc(1)-32 103
y(2)-32 159 y(3)-32 215 y(4)-32 272 y(5)-32 328 y(6)-32
385 y(7)-32 441 y(8)-32 498 y(9)-40 554 y(10)-40 611
y(11)-40 667 y(12)-40 724 y(13)-40 780 y(14)-40 836 y(15)-40
893 y(16)-40 949 y(17)-40 1006 y(18)-40 1062 y(19)-40
1119 y(20)-40 1175 y(21)-40 1232 y(22)-40 1288 y(23)-40
1345 y(24)-40 1401 y(25)-40 1457 y(26)-40 1514 y(27)-40
1570 y(28)-40 1627 y(29)-40 1683 y(30)-40 1740 y(31)-40
1796 y(32)-40 1853 y(33)-40 1909 y(34)-40 1966 y(35)-40
2022 y(36)-40 2078 y(37)-40 2135 y(38)-40 2191 y(39)-40
2248 y(40)-40 2304 y(41)-40 2361 y(42)-40 2417 y(43)-40
2474 y(44)-40 2530 y(45)-40 2587 y(46)-40 2643 y(47)-40
2699 y(48)p eop
%%Page: 8 10
8 9 bop 75 -100 a Fl(8)196 b Fe(CHAPTER)15 b(1.)35 b(ONE)15
b(SIDED)h(COMMUNICA)l(TIONS)g({)f(P/G/O)f(AL)l(TERNA)l(TIVE)189
49 y Ff(R)n(ationale.)75 b Fl(A)21 b(pro)q(cess)h(m)o(ust)e(p)q(erform)
h(some)g(MPI)g(op)q(eration)h(b)q(efore)f(it)g(is)h(allo)o(w)o(ed)g(to)
189 106 y(access)e(a)h(lo)q(cal)g(region)g(whic)o(h)g(it)g(has)g
(o\013ered)f(via)h Fd(MPI)p 1217 106 14 2 v 15 w(IOFFERP)g
Fl(to)f(other)g(pro)q(cesses,)i(so)189 162 y(that)17
b(remote)h(accesses)h(will)h(not)e(in)o(terfere)h(with)g(lo)q(cal)g
(ones.)30 b(While)20 b(other)e(prop)q(osals)g(ha)o(v)o(e)189
219 y(included)h(functions)e(lik)o(e)g Fd(MPI)p 738 219
V 16 w(LOCK)f Fl(and)g Fd(MPI)p 1060 219 V 16 w(UNLOCK)h
Fl(for)e(this)i(purp)q(ose,)g(this)g(prop)q(osal)189
275 y(is)j(based)g(on)g(the)g(observ)m(ation)g(that)f(these)i(are)e
(functionally)j(iden)o(tical)g(to)d(completing)i(the)189
332 y Fd(MPI)p 274 332 V 15 w(IOFFERP)16 b Fl(op)q(eration)f(and)h
(then)f(starting)g(another,)f(resp)q(ectiv)o(ely)l(.)189
407 y(MPI)e(w)o(ould)h(probably)h(not)e(lose)h(an)o(y)g(signi\014can)o
(t)g(functionalit)o(y)h(if)g(this)f(progressiv)o(e)f(one-sided)189
463 y(w)o(as)g(dropp)q(ed)i(completely)l(.)21 b(The)14
b(requiremen)o(t)g(to)e(supp)q(ort)i(third-part)o(y)f(comm)o(unication)
h(w)o(as)189 520 y(demonstrated)g(b)o(y)i(a)e(stra)o(w)g(v)o(ote)h(at)f
(the)i(July)g(MPIF)f(meeting.)20 b(\()p Ff(End)c(of)g(r)n(ationale.)p
Fl(\))166 626 y(MPI)p 258 626 V 16 w(PUTP)f(is)h(the)f(progressiv)o(e)g
(form)g(of)g(MPI)p 1024 626 V 16 w(PUT.)75 777 y Fd(MPI)p
160 777 V 16 w(PUTP\(combine,)21 b(o)o(rigin)p 611 777
V 15 w(addr,)h(o)o(rigin)p 851 777 V 15 w(count,)h(o)o(rigin)p
1113 777 V 15 w(datat)o(yp)q(e,)g(ta)o(rget)p 1439 777
V 16 w(rank,)f(ta)o(rget)p 1685 777 V 16 w(disp,)g(ta)o(r-)75
833 y(get)p 137 833 V 17 w(count,)16 b(ta)o(rget)p 400
833 V 16 w(datat)o(yp)q(e,)g(tag,)f(comm\))117 910 y
Fg(IN)155 b Fd(combine)430 b Fg(Com)o(bine)12 b(next)j(op)e(with)h
(this)g(one)g(\(Bo)q(olean\))117 986 y(IN)155 b Fd(o)o(rigin)p
427 986 V 16 w(addr)381 b Fg(Data)13 b(to)h(b)q(e)h(put)117
1061 y(IN)155 b Fd(o)o(rigin)p 427 1061 V 16 w(count)360
b Fg(Num)o(b)q(er)14 b(of)f(data)g(elemen)o(ts)h(at)g(origin)p
1535 1061 13 2 v 14 w(addr)117 1136 y(IN)155 b Fd(o)o(rigin)p
427 1136 14 2 v 16 w(datat)o(yp)q(e)302 b Fg(Datat)o(yp)q(e)14
b(of)f(eac)o(h)i(elemen)o(t)e(at)h(origin)p 1540 1136
13 2 v 14 w(addr)117 1211 y(IN)155 b Fd(ta)o(rget)p 433
1211 14 2 v 17 w(rank)375 b Fg(Rank)13 b(of)h(target)117
1286 y(IN)155 b Fd(ta)o(rget)p 433 1286 V 17 w(disp)384
b Fg(Relativ)o(e)13 b(displacemen)o(t)g(in)h(target)117
1361 y(IN)155 b Fd(ta)o(rget)p 433 1361 V 17 w(count)353
b Fg(Num)o(b)q(er)14 b(of)f(elemen)o(ts)h(in)f(target)117
1436 y(IN)155 b Fd(ta)o(rget)p 433 1436 V 17 w(datat)o(yp)q(e)295
b Fg(Datat)o(yp)q(e)14 b(of)f(elemen)o(ts)h(in)f(target)117
1512 y(IN)155 b Fd(tag)526 b Fg(T)m(ag)117 1587 y(IN)155
b Fd(comm)470 b Fg(Comm)o(unicator)75 1711 y Fa(int)47
b(MPI)p 269 1711 15 2 v 17 w(putp\()23 b(int)h(combine,)e(void)i
(*origin)p 1027 1711 V 16 w(addr,)f(int)h(origin)p 1426
1711 V 16 w(count,)393 1768 y(MPI)p 468 1768 V 17 w(Datatype)f(origin)p
844 1768 V 16 w(datatype,)g(int)g(target)p 1338 1768
V 17 w(rank,)g(int)g(target)p 1737 1768 V 17 w(disp,)393
1824 y(int)h(target)p 636 1824 V 16 w(count,)f(MPI)p
891 1824 V 17 w(Datatype)g(target)p 1267 1824 V 16 w(datatype,)g(int)g
(tag,)393 1880 y(MPI)p 468 1880 V 17 w(Comm)g(comm\))75
1967 y(MPI)p 150 1967 V 17 w(PUTP\()g(COMBINE,)g(ORIGIN)p
669 1967 V 16 w(ADDR,)g(ORIGIN)p 972 1967 V 17 w(COUNT,)g(ORIGIN)p
1300 1967 V 16 w(DATATYPE,)g(TARGET)p 1699 1967 V 16
w(RANK,)393 2023 y(TARGET)p 540 2023 V 17 w(DISP,)g(TARGET)p
844 2023 V 16 w(COUNT,)g(TARGET)p 1171 2023 V 16 w(DATATYPE,)g(TAG,)g
(COMM,)h(IERROR\))170 2080 y(<type>)f(ORIGIN)p 484 2080
V 17 w(ADDR\(*\))170 2136 y(LOGICAL)g(COMBINE)170 2193
y(INTEGER)g(ORIGIN)p 508 2193 V 17 w(COUNT,)g(ORIGIN)p
836 2193 V 16 w(DATATYPE,)g(TARGET)p 1235 2193 V 16 w(RANK,)g(TARGET)p
1538 2193 V 17 w(DISP,)170 2249 y(TARGET)p 317 2249 V
17 w(COUNT,)g(TARGET)p 645 2249 V 16 w(DATATYPE,)g(TAG,)g(COMM,)g
(IERROR)166 2336 y Fl(MPI)p 258 2336 14 2 v 16 w(GETP)15
b(is)h(the)f(progressiv)o(e)g(form)f(of)h(MPI)p 1025
2336 V 16 w(GET.)1967 46 y Fc(1)1967 103 y(2)1967 159
y(3)1967 215 y(4)1967 272 y(5)1967 328 y(6)1967 385 y(7)1967
441 y(8)1967 498 y(9)1959 554 y(10)1959 611 y(11)1959
667 y(12)1959 724 y(13)1959 780 y(14)1959 836 y(15)1959
893 y(16)1959 949 y(17)1959 1006 y(18)1959 1062 y(19)1959
1119 y(20)1959 1175 y(21)1959 1232 y(22)1959 1288 y(23)1959
1345 y(24)1959 1401 y(25)1959 1457 y(26)1959 1514 y(27)1959
1570 y(28)1959 1627 y(29)1959 1683 y(30)1959 1740 y(31)1959
1796 y(32)1959 1853 y(33)1959 1909 y(34)1959 1966 y(35)1959
2022 y(36)1959 2078 y(37)1959 2135 y(38)1959 2191 y(39)1959
2248 y(40)1959 2304 y(41)1959 2361 y(42)1959 2417 y(43)1959
2474 y(44)1959 2530 y(45)1959 2587 y(46)1959 2643 y(47)1959
2699 y(48)p eop
%%Page: 9 11
9 10 bop 75 -100 a Fe(1.3.)34 b(PR)o(OGRESSIVE)17 b(OPERA)l(TIONS)1022
b Fl(9)75 49 y Fd(MPI)p 160 49 14 2 v 16 w(GETP\(combine,)22
b(o)o(rigin)p 609 49 V 15 w(addr,)g(o)o(rigin)p 849 49
V 15 w(count,)h(o)o(rigin)p 1111 49 V 16 w(datat)o(yp)q(e,)g(ta)o(rget)
p 1438 49 V 16 w(rank,)f(ta)o(rget)p 1684 49 V 16 w(disp,)h(ta)o(r-)75
106 y(get)p 137 106 V 17 w(count,)16 b(ta)o(rget)p 400
106 V 16 w(datat)o(yp)q(e,)g(tag,)f(comm\))117 183 y
Fg(IN)155 b Fd(combine)430 b Fg(Com)o(bine)12 b(next)j(op)e(with)h
(this)g(one)g(\(Bo)q(olean\))117 258 y(OUT)108 b Fd(o)o(rigin)p
427 258 V 16 w(addr)381 b Fg(Data)13 b(to)h(b)q(e)h(retriev)o(ed)117
333 y(IN)155 b Fd(o)o(rigin)p 427 333 V 16 w(count)360
b Fg(Num)o(b)q(er)14 b(of)f(data)g(elemen)o(ts)h(at)g(origin)p
1535 333 13 2 v 14 w(addr)117 408 y(IN)155 b Fd(o)o(rigin)p
427 408 14 2 v 16 w(datat)o(yp)q(e)302 b Fg(Datat)o(yp)q(e)14
b(of)f(eac)o(h)i(elemen)o(t)e(at)h(origin)p 1540 408
13 2 v 14 w(addr)117 483 y(IN)155 b Fd(ta)o(rget)p 433
483 14 2 v 17 w(rank)375 b Fg(Rank)13 b(of)h(target)117
559 y(IN)155 b Fd(ta)o(rget)p 433 559 V 17 w(disp)384
b Fg(Relativ)o(e)13 b(displacemen)o(t)g(in)h(target)117
634 y(IN)155 b Fd(ta)o(rget)p 433 634 V 17 w(count)353
b Fg(Num)o(b)q(er)14 b(of)f(elemen)o(ts)h(in)f(target)117
709 y(IN)155 b Fd(ta)o(rget)p 433 709 V 17 w(datat)o(yp)q(e)295
b Fg(Datat)o(yp)q(e)14 b(of)f(elemen)o(ts)h(in)f(target)117
784 y(IN)155 b Fd(tag)526 b Fg(T)m(ag)117 859 y(IN)155
b Fd(comm)470 b Fg(Comm)o(unicator)75 984 y Fa(int)47
b(MPI)p 269 984 15 2 v 17 w(getp\()23 b(int)h(combine,)e(void)i
(*origin)p 1027 984 V 16 w(addr,)f(int)h(origin)p 1426
984 V 16 w(count,)393 1040 y(MPI)p 468 1040 V 17 w(Datatype)f(origin)p
844 1040 V 16 w(datatype,)g(int)g(target)p 1338 1040
V 17 w(rank,)g(int)g(target)p 1737 1040 V 17 w(disp,)393
1096 y(int)h(target)p 636 1096 V 16 w(count,)f(MPI)p
891 1096 V 17 w(Datatype)g(target)p 1267 1096 V 16 w(datatype,)g(int)g
(tag,)393 1153 y(MPI)p 468 1153 V 17 w(Comm)g(comm\))75
1239 y(MPI)p 150 1239 V 17 w(GETP\()g(COMBINE,)g(ORIGIN)p
669 1239 V 16 w(ADDR,)g(ORIGIN)p 972 1239 V 17 w(COUNT,)g(ORIGIN)p
1300 1239 V 16 w(DATATYPE,)g(TARGET)p 1699 1239 V 16
w(RANK,)393 1296 y(TARGET)p 540 1296 V 17 w(DISP,)g(TARGET)p
844 1296 V 16 w(COUNT,)g(TARGET)p 1171 1296 V 16 w(DATATYPE,)g(TAG,)g
(COMM,)h(IERROR\))170 1352 y(<type>)f(ORIGIN)p 484 1352
V 17 w(ADDR\(*\))170 1409 y(LOGICAL)g(COMBINE)170 1465
y(INTEGER)g(ORIGIN)p 508 1465 V 17 w(COUNT,)g(ORIGIN)p
836 1465 V 16 w(DATATYPE,)g(TARGET)p 1235 1465 V 16 w(RANK,)g(TARGET)p
1538 1465 V 17 w(DISP,)170 1522 y(TARGET)p 317 1522 V
17 w(COUNT,)g(TARGET)p 645 1522 V 16 w(DATATYPE,)g(TAG,)g(COMM,)g
(IERROR)166 1608 y Fd(MPI)p 251 1608 14 2 v 16 w(OFFERP)16
b Fl(is)f(the)h(progressiv)o(e)f(form)f(of)h Fd(MPI)p
1051 1608 V 16 w(OFFER)p Fl(.)75 1759 y Fd(MPI)p 160
1759 V 16 w(OFFERP\(events,)i(base,)e(size,)g(disp)p
791 1759 V 18 w(unit,)h(tag,)f(comm,)e(count\))117 1836
y Fg(IN)155 b Fd(events)470 b Fg(Ev)o(en)o(ts)15 b(to)f(b)q(e)g
(serviced)h(\()p Fb(PUT)p Fg(,)e Fb(GET)p Fg(,)g(or)h(b)q(oth\))117
1911 y(INOUT)62 b Fd(base)505 b Fg(Bu\013er)15 b(made)d(a)o(v)n
(ailable)g(to)h(PUTP)h(and/or)f(GETP)h(ev)o(en)o(ts)117
1986 y(IN)155 b Fd(size)519 b Fg(Size)15 b(of)e(base)h(in)g(b)o(ytes)
117 2062 y(IN)155 b Fd(disp)p 395 2062 V 18 w(unit)422
b Fg(Scale)14 b(factor)g(for)g(target)p 1304 2062 13
2 v 15 w(disp)g(in)f(ev)o(en)o(ts)117 2137 y(IN)155 b
Fd(tag)526 b Fg(T)m(ag)117 2212 y(IN)155 b Fd(comm)470
b Fg(Comm)o(unicator)117 2287 y(IN)155 b Fd(count)482
b Fg(Num)o(b)q(er)14 b(of)f(ev)o(en)o(ts)i(to)f(service)75
2411 y Fa(int)23 b(MPI)p 245 2411 15 2 v 17 w(offerp\(int)g(events,)g
(void*)g(base,)g(int)g(size,)h(int)f(disp)p 1432 2411
V 17 w(unit,)g(int)g(tag,)393 2468 y(MPI)p 468 2468 V
17 w(Comm)g(comm,)g(int)h(count\))75 2554 y(MPI)p 150
2554 V 17 w(OFFERP\(EVENTS,)e(BASE,)h(SIZE,)g(DISP)p
907 2554 V 17 w(UNIT,)g(TAG,)g(COMM,)g(COUNT,)g(IERROR\))170
2611 y(<type>)g(BASE\(*\))170 2667 y(INTEGER)g(EVENTS,)g(SIZE,)g(DISP)p
794 2667 V 17 w(UNIT,)g(TAG,)h(COMM,)f(COUNT,)g(IERROR)-32
46 y Fc(1)-32 103 y(2)-32 159 y(3)-32 215 y(4)-32 272
y(5)-32 328 y(6)-32 385 y(7)-32 441 y(8)-32 498 y(9)-40
554 y(10)-40 611 y(11)-40 667 y(12)-40 724 y(13)-40 780
y(14)-40 836 y(15)-40 893 y(16)-40 949 y(17)-40 1006
y(18)-40 1062 y(19)-40 1119 y(20)-40 1175 y(21)-40 1232
y(22)-40 1288 y(23)-40 1345 y(24)-40 1401 y(25)-40 1457
y(26)-40 1514 y(27)-40 1570 y(28)-40 1627 y(29)-40 1683
y(30)-40 1740 y(31)-40 1796 y(32)-40 1853 y(33)-40 1909
y(34)-40 1966 y(35)-40 2022 y(36)-40 2078 y(37)-40 2135
y(38)-40 2191 y(39)-40 2248 y(40)-40 2304 y(41)-40 2361
y(42)-40 2417 y(43)-40 2474 y(44)-40 2530 y(45)-40 2587
y(46)-40 2643 y(47)-40 2699 y(48)p eop
%%Page: 10 12
10 11 bop 75 -100 a Fl(10)173 b Fe(CHAPTER)15 b(1.)35
b(ONE)15 b(SIDED)h(COMMUNICA)l(TIONS)g({)f(P/G/O)f(AL)l(TERNA)l(TIVE)98
49 y Fl(A)o(tomicit)o(y:)19 b(The)13 b(servicing)i(of)e(a)g
Fd(PUTP)h Fl(or)e Fd(GETP)i Fl(ev)o(en)o(t)f(is)h(alw)o(a)o(ys)f
(atomic)g(with)h(resp)q(ect)g(to)e(other)189 106 y Fd(PUTP)h
Fl(and)h Fd(GETP)g Fl(ev)o(en)o(ts,)f(ev)o(en)h(if)g(the)f(ev)o(en)o(t)
g(is)h(constructed)g(from)f(man)o(y)g(individual)j(ev)o(en)o(ts)189
162 y(using)c(the)h Fd(combine)f Fl(argumen)o(t,)f(but)i(it)f(ma)o(y)f
(not)h(b)q(e)h(atomic)f(with)g(resp)q(ect)h(to)e(lo)q(cal)j(load/store)
189 219 y(op)q(erations.)98 309 y(Progress:)19 b(If)d(an)g
Fd(MPI)p 494 309 14 2 v 16 w(OFFERP)g Fl(op)q(eration)g(is)g(capable)g
(of)g(servicing)g(a)g Fd(PUTP)g Fl(or)f Fd(GETP)h Fl(ev)o(en)o(t,)f(it)
189 365 y(will)h(service)h(that)d(ev)o(en)o(t)h(\(or)f(another\))h
(within)h(a)f(\014nite)h(time.)98 456 y(Non-Conformance:)i(The)12
b(\014nal)g(conformance)g(constrain)o(t)f(asso)q(ciated)h(with)g
Fd(MPI)p 1544 456 V 16 w(OFFER)g Fl(do)q(es)g(not)189
512 y(apply)f(to)e Fd(MPI)p 444 512 V 16 w(OFFERP)i Fl(or)e
Fd(MPI)p 773 512 V 16 w(IOFFERP)p Fl(.)h(That)g(is,)h(a)f(single)h
Fd(MPI)p 1394 512 V 16 w(OFFERP)g Fl(or)f Fd(MPI)p 1724
512 V 16 w(IOFFERP)189 569 y Fl(op)q(eration)j(ma)o(y)g(service)h(m)o
(ultiple)h Fd(GETP)e Fl(or)g Fd(PUTP)h Fl(op)q(erations)f(with)g(iden)o
(tical)j(addresses)d(on)189 625 y(the)i(target.)166 721
y Fd(MPI)p 251 721 V 16 w(IOFFERP)g Fl(is)h(the)f(non-blo)q(c)o(king)i
(form)e(of)f Fd(MPI)p 1099 721 V 16 w(OFFERP)p Fl(.)75
872 y Fd(MPI)p 160 872 V 16 w(IOFFERP\(events,)i(base,)g(size,)f(disp)p
804 872 V 18 w(unit,)h(tag,)e(comm,)f(count,)k(request\))117
949 y Fg(IN)155 b Fd(events)470 b Fg(Ev)o(en)o(ts)15
b(to)f(b)q(e)g(serviced)h(\()p Fb(PUT)p Fg(,)e Fb(GET)p
Fg(,)g(or)h(b)q(oth\))117 1023 y(INOUT)62 b Fd(base)505
b Fg(Bu\013er)15 b(made)d(a)o(v)n(ailable)g(to)h(PUTP)h(and/or)f(GETP)h
(ev)o(en)o(ts)117 1096 y(IN)155 b Fd(size)519 b Fg(Size)15
b(of)e(base)h(in)g(b)o(ytes)117 1170 y(IN)155 b Fd(disp)p
395 1170 V 18 w(unit)422 b Fg(Scale)14 b(factor)g(for)g(target)p
1304 1170 13 2 v 15 w(disp)g(in)f(ev)o(en)o(ts)117 1243
y(IN)155 b Fd(tag)526 b Fg(T)m(ag)117 1316 y(IN)155 b
Fd(comm)470 b Fg(Comm)o(unicator)117 1390 y(IN)155 b
Fd(count)482 b Fg(Num)o(b)q(er)14 b(of)f(ev)o(en)o(ts)i(to)f(service)75
1514 y Fa(int)23 b(MPI)p 245 1514 15 2 v 17 w(iofferp\(int)g(events,)f
(void*)i(base,)f(int)g(size,)g(int)h(disp)p 1456 1514
V 17 w(unit,)f(int)g(tag,)393 1571 y(MPI)p 468 1571 V
17 w(Comm)g(comm,)g(int)h(count,)f(MPI)p 1082 1571 V
17 w(request)g(request\))75 1657 y(MPI)p 150 1657 V 17
w(IOFFERP\(EVENTS,)f(BASE,)h(SIZE,)g(DISP)p 931 1657
V 17 w(UNIT,)g(TAG,)g(COMM,)g(COUNT,)g(REQUEST,)393 1714
y(IERROR\))170 1770 y(<type>)g(BASE\(*\))170 1826 y(INTEGER)g(EVENTS,)g
(SIZE,)g(DISP)p 794 1826 V 17 w(UNIT,)g(TAG,)h(COMM,)f(COUNT,)g
(REQUEST,)g(IERROR)189 1952 y Ff(A)n(dvic)n(e)d(to)h(implementors.)71
b Fl(Arc)o(hitectures)21 b(in)h(whic)o(h)f(separate)f(pro)q(cesses)h
(do)f(not)g(share)189 2009 y(access)15 b(to)g(eac)o(h)h(others)f
(address)g(spaces)h(ma)o(y)f(need)h(to)f(execute)h(a)f(separate)g(agen)
o(t)g(\(daemon\))189 2065 y(to)f(service)h Fd(PUTP)g
Fl(and)g Fd(GETP)g Fl(ev)o(en)o(ts)g(whenev)o(er)g(an)f
Fd(MPI)p 1230 2065 14 2 v 16 w(IOFFERP)h Fl(op)q(eration)g(is)g
(executed.)189 2122 y(\(This)h(ma)o(y)e(not)i(b)q(e)g(necessary)g(if)g
(the)g Fd(base)g Fl(and)g Fd(size)g Fl(argumen)o(ts)f(of)g(the)h
Fd(MPI)p 1585 2122 V 15 w(IOFFERP)g Fl(des-)189 2178
y(ignate)h(a)f(memory)g(range)g(allo)q(cated)i(with)f
Fd(MPI)p 1053 2178 V 16 w(RMA)p 1168 2178 V 17 w(MALLOC)p
Fl(.\))f(Since)i Fd(PUTP)f Fl(and)g Fd(GETP)189 2235
y Fl(op)q(erations)i(can)g(legally)i(b)q(e)f(issued)g(b)q(efore)g(the)f
(matc)o(hing)g Fd(MPI)p 1362 2235 V 16 w(IOFFERP)h Fl(is)g(initiated,)h
(an)189 2291 y(agen)o(t)12 b(m)o(ust)g(b)q(e)h(prepared)g(to)f(handle)i
(p)q(ending)g(ev)o(en)o(ts)e(when)i(the)e Fd(MPI)p 1444
2291 V 16 w(IOFFERP)h Fl(starts.)18 b(The)189 2348 y(agen)o(t)12
b(can)h(b)q(e)h(put)g(to)e(sleep)j(or)d(terminated)i(when)g(the)f
Fd(MPI)p 1257 2348 V 16 w(IOFFERP)g Fl(op)q(eration)h(completes.)189
2404 y(\()p Ff(End)h(of)i(advic)n(e)f(to)g(implementors.)p
Fl(\))75 2546 y Fi(1.4)59 b(Collective)75 2647 y Fl(The)10
b(collectiv)o(e)i(op)q(erations)f(describ)q(ed)h(in)f(this)f(section)h
(\(i.e.)18 b Fd(MPI)p 1225 2647 V 16 w(PUTC)p Fl(,)10
b Fd(MPI)p 1466 2647 V 16 w(GETC)p Fl(,)g Fd(MPI)p 1704
2647 V 16 w(OFFERC)p Fl(,)75 2704 y(and)16 b Fd(MPI)p
249 2704 V 16 w(IOFFERC)p Fl(\))h(are)f(completely)h(analogous)f(to)g
(the)g(non-progressiv)o(e)h(p)q(oin)o(t-to-p)q(oin)o(t)g(op)q(era-)1967
46 y Fc(1)1967 103 y(2)1967 159 y(3)1967 215 y(4)1967
272 y(5)1967 328 y(6)1967 385 y(7)1967 441 y(8)1967 498
y(9)1959 554 y(10)1959 611 y(11)1959 667 y(12)1959 724
y(13)1959 780 y(14)1959 836 y(15)1959 893 y(16)1959 949
y(17)1959 1006 y(18)1959 1062 y(19)1959 1119 y(20)1959
1175 y(21)1959 1232 y(22)1959 1288 y(23)1959 1345 y(24)1959
1401 y(25)1959 1457 y(26)1959 1514 y(27)1959 1570 y(28)1959
1627 y(29)1959 1683 y(30)1959 1740 y(31)1959 1796 y(32)1959
1853 y(33)1959 1909 y(34)1959 1966 y(35)1959 2022 y(36)1959
2078 y(37)1959 2135 y(38)1959 2191 y(39)1959 2248 y(40)1959
2304 y(41)1959 2361 y(42)1959 2417 y(43)1959 2474 y(44)1959
2530 y(45)1959 2587 y(46)1959 2643 y(47)1959 2699 y(48)p
eop
%%Page: 11 13
11 12 bop 75 -100 a Fe(1.4.)34 b(COLLECTIVE)1347 b Fl(11)75
49 y(tions)17 b(in)g(the)g(\014rst)f(section)h(\(i.e.)24
b Fd(MPI)p 755 49 14 2 v 15 w(PUT)p Fl(,)17 b Fd(MPI)p
973 49 V 15 w(GET)p Fl(,)g Fd(MPI)p 1188 49 V 16 w(OFFER)p
Fl(,)g(and)f Fd(MPI)p 1546 49 V 16 w(IOFFER)p Fl(\))g(except)75
106 y(that)f Fd(MPI)p 259 106 V 16 w(OFFERC)h Fl(and)f
Fd(MPI)p 631 106 V 16 w(IOFFERC)h Fl(are)f(collectiv)o(e)i(op)q
(erations.)k(The)16 b(argumen)o(ts)e(are)h(iden)o(ti-)75
162 y(cal,)f(except)f(that)g(there)g(is)h(no)f(need)h(for)f(a)g
Fd(combine)g Fl(argumen)o(t)f(in)i Fd(MPI)p 1328 162
V 16 w(GETC)g Fl(and)f Fd(MPI)p 1643 162 V 16 w(PUTC)p
Fl(,)g(and)75 219 y(no)18 b(need)h(for)f(a)g Fd(count)h
Fl(argumen)o(t)f(in)h Fd(MPI)p 836 219 V 15 w(OFFERC)g
Fl(and)g Fd(MPI)p 1214 219 V 16 w(IOFFERC)p Fl(,)f(b)q(ecause)h(the)f
(collectiv)o(e)75 275 y(execution)i(of)e(these)h(op)q(erations)g(is)h
(alw)o(a)o(ys)e(guaran)o(teed)g(to)g(satisfy)h(all)g(of)g(the)g
Fd(GETC)g Fl(and)g Fd(PUTC)75 332 y Fl(ev)o(en)o(ts)e(whic)o(h)g(w)o
(ere)g(issued)h(with)f(the)g(same)g Fd(comm)e Fl(and)i
Fd(tag)f Fl(argumen)o(ts)g(since)i(the)f(last)g(collectiv)o(e)75
388 y Fd(MPI)p 160 388 V 16 w(OFFERC)f Fl(or)e Fd(MPI)p
499 388 V 16 w(IOFFERC)i Fl(op)q(eration)f(on)g(that)g(comm)o
(unicator.)166 444 y(Ev)o(en)k(when)g(all)h(pro)q(cesses)f(in)g(a)g
(comm)o(unicator)f(need)i(to)e(p)q(erform)h(1-sided)g(op)q(erations,)h
(the)75 501 y(collectiv)o(e)14 b(calls)f(are)f(not)g(necessarily)i(the)
e(b)q(est)g(c)o(hoice.)20 b(Collectiv)o(e)14 b(1-sided)f(op)q(erations)
f(are)g(v)m(aluable)75 557 y(primarily)18 b(in)g(those)e(cases)h(where)
g(one)f(or)h(more)f(pro)q(cesses)h(cannot)f(easily)i(determine)g(the)f
(n)o(um)o(b)q(er)75 614 y(of)h(originators)g(whic)o(h)h(will)i(use)d
(it)h(as)f(a)g(target.)29 b(Ho)o(w)o(ev)o(er,)18 b(since)i(MPI)e(m)o
(ust)g(still)i(ascertain)f(this)75 670 y(information)e(in)o(ternally)i
(on)e(most)f(arc)o(hitectures,)i(the)f(collectiv)o(e)i(op)q(erations)e
(are)g(exp)q(ected)h(to)f(in-)75 727 y(cur)h(some)f(additional)i(o)o(v)
o(erhead)e(o)o(v)o(er)f(the)i(p)q(oin)o(t-to-p)q(oin)o(t)g(op)q
(erations)f(where)h(the)g(user)f(explicitly)75 783 y(supplies)j(this)e
(information)g(in)g(the)g(function)g(call.)29 b(The)18
b(collectiv)o(e)h(op)q(erations)f(ma)o(y)f(also)g(pro)o(vide)75
840 y(a)e(simpler)h(con)o(v)o(ersion)g(path)f(for)g(existing)h(co)q
(des)g(whic)o(h)g(use)f(barrier-based)h(approac)o(hes)f(o\013ered)g(b)o
(y)75 896 y(some)j(parallel)j(v)o(endors,)e(or)f(those)g(whic)o(h)i
(utilize)h(a)d(Bulk)i(Sync)o(hronous)f(P)o(arallel)h(computational)75
953 y(mo)q(del.)75 1103 y Fd(MPI)p 160 1103 V 16 w(PUTC\(o)o(rigin)p
420 1103 V 15 w(addr,)k(o)o(rigin)p 662 1103 V 15 w(count,)h(o)o(rigin)
p 926 1103 V 16 w(datat)o(yp)q(e,)g(ta)o(rget)p 1255
1103 V 16 w(rank,)f(ta)o(rget)p 1503 1103 V 16 w(disp,)h(ta)o(rget)p
1743 1103 V 16 w(count,)75 1160 y(ta)o(rget)p 190 1160
V 16 w(datat)o(yp)q(e,)17 b(tag,)d(comm\))117 1237 y
Fg(IN)155 b Fd(o)o(rigin)p 427 1237 V 16 w(addr)381 b
Fg(Data)13 b(to)h(b)q(e)h(put)117 1312 y(IN)155 b Fd(o)o(rigin)p
427 1312 V 16 w(count)360 b Fg(Num)o(b)q(er)14 b(of)f(data)g(elemen)o
(ts)h(at)g(origin)p 1535 1312 13 2 v 14 w(addr)117 1387
y(IN)155 b Fd(o)o(rigin)p 427 1387 14 2 v 16 w(datat)o(yp)q(e)302
b Fg(Datat)o(yp)q(e)14 b(of)f(eac)o(h)i(elemen)o(t)e(at)h(origin)p
1540 1387 13 2 v 14 w(addr)117 1463 y(IN)155 b Fd(ta)o(rget)p
433 1463 14 2 v 17 w(rank)375 b Fg(Rank)13 b(of)h(target)117
1538 y(IN)155 b Fd(ta)o(rget)p 433 1538 V 17 w(disp)384
b Fg(Relativ)o(e)13 b(displacemen)o(t)g(in)h(target)117
1613 y(IN)155 b Fd(ta)o(rget)p 433 1613 V 17 w(count)353
b Fg(Num)o(b)q(er)14 b(of)f(elemen)o(ts)h(in)f(target)117
1688 y(IN)155 b Fd(ta)o(rget)p 433 1688 V 17 w(datat)o(yp)q(e)295
b Fg(Datat)o(yp)q(e)14 b(of)f(elemen)o(ts)h(in)f(target)117
1763 y(IN)155 b Fd(tag)526 b Fg(T)m(ag)117 1838 y(IN)155
b Fd(comm)470 b Fg(Comm)o(unicator)75 1963 y Fa(int)47
b(MPI)p 269 1963 15 2 v 17 w(putc\()23 b(void)h(*origin)p
717 1963 V 16 w(addr,)f(int)g(origin)p 1115 1963 V 17
w(count,)g(MPI)p 1371 1963 V 17 w(Datatype)393 2019 y(origin)p
540 2019 V 17 w(datatype,)f(int)i(target)p 1035 2019
V 16 w(rank,)f(int)h(target)p 1434 2019 V 16 w(disp,)f(int)393
2076 y(target)p 540 2076 V 17 w(count,)g(MPI)p 796 2076
V 16 w(Datatype)g(target)p 1171 2076 V 16 w(datatype,)g(int)h(tag,)f
(MPI)p 1713 2076 V 17 w(Comm)393 2132 y(comm\))75 2218
y(MPI)p 150 2218 V 17 w(PUTC\()g(ORIGIN)p 454 2218 V
16 w(ADDR,)g(ORIGIN)p 757 2218 V 17 w(COUNT,)g(ORIGIN)p
1085 2218 V 16 w(DATATYPE,)g(TARGET)p 1484 2218 V 16
w(RANK,)393 2275 y(TARGET)p 540 2275 V 17 w(DISP,)g(TARGET)p
844 2275 V 16 w(COUNT,)g(TARGET)p 1171 2275 V 16 w(DATATYPE,)g(TAG,)g
(COMM,)h(IERROR\))170 2331 y(<type>)f(ORIGIN)p 484 2331
V 17 w(ADDR\(*\))170 2388 y(INTEGER)g(ORIGIN)p 508 2388
V 17 w(COUNT,)g(ORIGIN)p 836 2388 V 16 w(DATATYPE,)g(TARGET)p
1235 2388 V 16 w(RANK,)g(TARGET)p 1538 2388 V 17 w(DISP,)170
2444 y(TARGET)p 317 2444 V 17 w(COUNT,)g(TARGET)p 645
2444 V 16 w(DATATYPE,)g(TAG,)g(COMM,)g(IERROR)166 2531
y Fl(MPI)p 258 2531 14 2 v 16 w(GETC)c(is)h(iden)o(tical)i(to)d(MPI)p
813 2531 V 16 w(GET,)g(but)h(matc)o(hes)f(an)h(MPI)p
1386 2531 V 16 w(OFFER)o(C)f(instead)i(of)e(an)75 2587
y(MPI)p 167 2587 V 16 w(OFFER.)-32 46 y Fc(1)-32 103
y(2)-32 159 y(3)-32 215 y(4)-32 272 y(5)-32 328 y(6)-32
385 y(7)-32 441 y(8)-32 498 y(9)-40 554 y(10)-40 611
y(11)-40 667 y(12)-40 724 y(13)-40 780 y(14)-40 836 y(15)-40
893 y(16)-40 949 y(17)-40 1006 y(18)-40 1062 y(19)-40
1119 y(20)-40 1175 y(21)-40 1232 y(22)-40 1288 y(23)-40
1345 y(24)-40 1401 y(25)-40 1457 y(26)-40 1514 y(27)-40
1570 y(28)-40 1627 y(29)-40 1683 y(30)-40 1740 y(31)-40
1796 y(32)-40 1853 y(33)-40 1909 y(34)-40 1966 y(35)-40
2022 y(36)-40 2078 y(37)-40 2135 y(38)-40 2191 y(39)-40
2248 y(40)-40 2304 y(41)-40 2361 y(42)-40 2417 y(43)-40
2474 y(44)-40 2530 y(45)-40 2587 y(46)-40 2643 y(47)-40
2699 y(48)p eop
%%Page: 12 14
12 13 bop 75 -100 a Fl(12)173 b Fe(CHAPTER)15 b(1.)35
b(ONE)15 b(SIDED)h(COMMUNICA)l(TIONS)g({)f(P/G/O)f(AL)l(TERNA)l(TIVE)75
49 y Fd(MPI)p 160 49 14 2 v 16 w(GETC\(o)o(rigin)p 417
49 V 15 w(addr,)25 b(o)o(rigin)p 660 49 V 15 w(count,)h(o)o(rigin)p
925 49 V 15 w(datat)o(yp)q(e,)g(ta)o(rget)p 1254 49 V
16 w(rank,)e(ta)o(rget)p 1502 49 V 16 w(disp,)i(ta)o(rget)p
1743 49 V 16 w(count,)75 106 y(ta)o(rget)p 190 106 V
16 w(datat)o(yp)q(e,)17 b(tag,)d(comm\))117 183 y Fg(OUT)108
b Fd(o)o(rigin)p 427 183 V 16 w(addr)381 b Fg(Data)13
b(to)h(b)q(e)h(retriev)o(ed)117 258 y(IN)155 b Fd(o)o(rigin)p
427 258 V 16 w(count)360 b Fg(Num)o(b)q(er)14 b(of)f(data)g(elemen)o
(ts)h(at)g(origin)p 1535 258 13 2 v 14 w(addr)117 333
y(IN)155 b Fd(o)o(rigin)p 427 333 14 2 v 16 w(datat)o(yp)q(e)302
b Fg(Datat)o(yp)q(e)14 b(of)f(eac)o(h)i(elemen)o(t)e(at)h(origin)p
1540 333 13 2 v 14 w(addr)117 408 y(IN)155 b Fd(ta)o(rget)p
433 408 14 2 v 17 w(rank)375 b Fg(Rank)13 b(of)h(target)117
483 y(IN)155 b Fd(ta)o(rget)p 433 483 V 17 w(disp)384
b Fg(Relativ)o(e)13 b(displacemen)o(t)g(in)h(target)117
559 y(IN)155 b Fd(ta)o(rget)p 433 559 V 17 w(count)353
b Fg(Num)o(b)q(er)14 b(of)f(elemen)o(ts)h(in)f(target)117
634 y(IN)155 b Fd(ta)o(rget)p 433 634 V 17 w(datat)o(yp)q(e)295
b Fg(Datat)o(yp)q(e)14 b(of)f(elemen)o(ts)h(in)f(target)117
709 y(IN)155 b Fd(tag)526 b Fg(T)m(ag)117 784 y(IN)155
b Fd(comm)470 b Fg(Comm)o(unicator)75 908 y Fa(int)47
b(MPI)p 269 908 15 2 v 17 w(getc\()23 b(void)h(*origin)p
717 908 V 16 w(addr,)f(int)g(origin)p 1115 908 V 17 w(count,)g(MPI)p
1371 908 V 17 w(Datatype)393 965 y(origin)p 540 965 V
17 w(datatype,)f(int)i(target)p 1035 965 V 16 w(rank,)f(int)h(target)p
1434 965 V 16 w(disp,)f(int)393 1021 y(target)p 540 1021
V 17 w(count,)g(MPI)p 796 1021 V 16 w(Datatype)g(target)p
1171 1021 V 16 w(datatype,)g(int)h(tag,)f(MPI)p 1713
1021 V 17 w(Comm)393 1078 y(comm\))75 1164 y(MPI)p 150
1164 V 17 w(GETC\()g(ORIGIN)p 454 1164 V 16 w(ADDR,)g(ORIGIN)p
757 1164 V 17 w(COUNT,)g(ORIGIN)p 1085 1164 V 16 w(DATATYPE,)g(TARGET)p
1484 1164 V 16 w(RANK,)393 1221 y(TARGET)p 540 1221 V
17 w(DISP,)g(TARGET)p 844 1221 V 16 w(COUNT,)g(TARGET)p
1171 1221 V 16 w(DATATYPE,)g(TAG,)g(COMM,)h(IERROR\))170
1277 y(<type>)f(ORIGIN)p 484 1277 V 17 w(ADDR\(*\))170
1334 y(INTEGER)g(ORIGIN)p 508 1334 V 17 w(COUNT,)g(ORIGIN)p
836 1334 V 16 w(DATATYPE,)g(TARGET)p 1235 1334 V 16 w(RANK,)g(TARGET)p
1538 1334 V 17 w(DISP,)170 1390 y(TARGET)p 317 1390 V
17 w(COUNT,)g(TARGET)p 645 1390 V 16 w(DATATYPE,)g(TAG,)g(COMM,)g
(IERROR)166 1477 y Fd(MPI)p 251 1477 14 2 v 16 w(OFFERC)17
b Fl(is)h(iden)o(tical)h(to)d(MPI)p 833 1477 V 16 w(OFFER,)h(but)g(it)g
(is)h(collectiv)o(e)g({)f(i.e.)25 b(it)17 b(m)o(ust)g(b)q(e)g(called)75
1533 y(b)o(y)d(ev)o(ery)g(pro)q(cess)h({)f(and)g(requires)h(no)f
Fd(count)i Fl(argumen)o(t,)d(b)q(ecause)i(all)h Fd(GETC)e
Fl(and/or)g Fd(PUTC)g Fl(ev)o(en)o(ts)75 1589 y(since)i(the)g(last)f
(call)h(to)f(this)g(op)q(eration)h(will)h(b)q(e)e(pro)q(cessed.)75
1740 y Fd(MPI)p 160 1740 V 16 w(OFFERC\(events,)i(base,)e(size,)g(disp)
p 791 1740 V 18 w(unit,)h(tag,)f(comm\))117 1818 y Fg(IN)155
b Fd(events)470 b Fg(Ev)o(en)o(ts)15 b(to)f(b)q(e)g(serviced)h(\()p
Fb(PUT)p Fg(,)e Fb(GET)p Fg(,)g(or)h(b)q(oth\))117 1893
y(INOUT)62 b Fd(base)505 b Fg(Bu\013er)15 b(made)c(a)o(v)n(ailable)g
(to)i(PUTC)g(and/or)g(GETC)g(ev)o(en)o(ts)117 1968 y(IN)155
b Fd(size)519 b Fg(Size)15 b(of)e(base)h(in)g(b)o(ytes)117
2043 y(IN)155 b Fd(disp)p 395 2043 V 18 w(unit)422 b
Fg(Scale)14 b(factor)g(for)g(target)p 1304 2043 13 2
v 15 w(disp)g(in)f(ev)o(en)o(ts)117 2118 y(IN)155 b Fd(tag)526
b Fg(T)m(ag)117 2193 y(IN)155 b Fd(comm)470 b Fg(Comm)o(unicator)75
2318 y Fa(int)23 b(MPI)p 245 2318 15 2 v 17 w(offerc\(int)g(events,)g
(void*)g(base,)g(int)g(size,)h(int)f(disp)p 1432 2318
V 17 w(unit,)g(int)g(tag,)393 2374 y(MPI)p 468 2374 V
17 w(Comm)g(comm\))75 2461 y(MPI)p 150 2461 V 17 w(OFFERC\(EVENTS,)f
(BASE,)h(SIZE,)g(DISP)p 907 2461 V 17 w(UNIT,)g(TAG,)g(COMM,)g
(IERROR\))170 2517 y(<type>)g(BASE\(*\))170 2574 y(INTEGER)g(EVENTS,)g
(SIZE,)g(DISP)p 794 2574 V 17 w(UNIT,)g(TAG,)h(COMM,)f(IERROR)1967
46 y Fc(1)1967 103 y(2)1967 159 y(3)1967 215 y(4)1967
272 y(5)1967 328 y(6)1967 385 y(7)1967 441 y(8)1967 498
y(9)1959 554 y(10)1959 611 y(11)1959 667 y(12)1959 724
y(13)1959 780 y(14)1959 836 y(15)1959 893 y(16)1959 949
y(17)1959 1006 y(18)1959 1062 y(19)1959 1119 y(20)1959
1175 y(21)1959 1232 y(22)1959 1288 y(23)1959 1345 y(24)1959
1401 y(25)1959 1457 y(26)1959 1514 y(27)1959 1570 y(28)1959
1627 y(29)1959 1683 y(30)1959 1740 y(31)1959 1796 y(32)1959
1853 y(33)1959 1909 y(34)1959 1966 y(35)1959 2022 y(36)1959
2078 y(37)1959 2135 y(38)1959 2191 y(39)1959 2248 y(40)1959
2304 y(41)1959 2361 y(42)1959 2417 y(43)1959 2474 y(44)1959
2530 y(45)1959 2587 y(46)1959 2643 y(47)1959 2699 y(48)p
eop
%%Page: 13 15
13 14 bop 75 -100 a Fe(1.4.)34 b(COLLECTIVE)1347 b Fl(13)98
49 y(Completion:)29 b(The)19 b(seman)o(tics)h(for)f Fd(MPI)p
836 49 14 2 v 15 w(OFFERC)p Fl(,)h(and)g Fd(MPI)p 1229
49 V 15 w(IOFFERC)g Fl(are)f(iden)o(tical)i(to)e(those)189
106 y(for)12 b(the)h(non-progressiv)o(e)g(1-sided)h(op)q(erations,)f
(after)f(deleting)j(the)e("Com)o(bining")g(paragraph,)189
162 y(replacing)18 b(all)g Fd(PUT)f Fl(with)g Fd(PUTC)g
Fl(and)g Fd(GET)g Fl(with)g Fd(GETC)p Fl(,)g(and)g(replacing)i(the)e
(last)f(clause)i(in)189 219 y(the)d("Completion")g(paragraph,)f(mark)o
(ed)h(with)h(a)f("\(*\)",)e(with)i(the)h(follo)o(wing:)189
291 y(if)i Fb(m)d(-)i(1)g Fl(total)h Fd(OFFERC)g Fl(and)h
Fd(IOFFERC)f Fl(op)q(erations)g(with)g(this)h Fd(tag)f
Fl(and)g Fd(comm)e Fl(argumen)o(ts)189 348 y(ha)o(v)o(e)g(executed)i
(in)g(this)f(pro)q(cess)g(prior)g(to)f(this)i(one,)f(then)g
Fb(m)f Fl(total)g Fd(OFFERC)i Fl(and)f Fd(IOFFERC)189
404 y Fl(op)q(erations)c(with)h(the)f(same)g(tag)f(and)i(comm)o
(unicator)f(ha)o(v)o(e)g(completed)h(\(or)e(will)j(complete\))f(in)189
461 y(eac)o(h)h(of)g(the)g(other)g(pro)q(cesses)g(b)q(elonging)i(to)e
(the)g(comm)o(unicator.)166 552 y(MPI)p 258 552 V 16
w(IOFFER)o(C)h(is)f(a)g(non-blo)q(c)o(king)i(v)o(ersion)e(of)g(MPI)p
1144 552 V 17 w(OFFER)o(C.)75 703 y Fd(MPI)p 160 703
V 16 w(IOFFERC\(events,)h(base,)g(size,)f(disp)p 804
703 V 18 w(unit,)h(tag,)e(comm,)f(request\))117 780 y
Fg(IN)155 b Fd(events)470 b Fg(Ev)o(en)o(ts)15 b(to)f(b)q(e)g(serviced)
h(\()p Fb(PUT)p Fg(,)e Fb(GET)p Fg(,)g(or)h(b)q(oth\))117
853 y(INOUT)62 b Fd(base)505 b Fg(Bu\013er)15 b(made)e(a)o(v)n(ailable)
f(to)i(PUT)g(and/or)f(GET)h(ev)o(en)o(ts)117 926 y(IN)155
b Fd(size)519 b Fg(Size)15 b(of)e(base)h(in)g(b)o(ytes)117
998 y(IN)155 b Fd(disp)p 395 998 V 18 w(unit)422 b Fg(Scale)14
b(factor)g(for)g(target)p 1304 998 13 2 v 15 w(disp)g(in)f(ev)o(en)o
(ts)117 1071 y(IN)155 b Fd(tag)526 b Fg(T)m(ag)117 1144
y(IN)155 b Fd(comm)470 b Fg(Comm)o(unicator)75 1268 y
Fa(int)23 b(MPI)p 245 1268 15 2 v 17 w(iofferc\(int)g(events,)f(void*)i
(base,)f(int)g(size,)g(int)h(disp)p 1456 1268 V 17 w(unit,)f(int)g
(tag,)393 1325 y(MPI)p 468 1325 V 17 w(Comm)g(comm,)g(MPI)p
819 1325 V 17 w(request)g(request\))75 1411 y(MPI)p 150
1411 V 17 w(IOFFERC\(EVENTS,)f(BASE,)h(SIZE,)g(DISP)p
931 1411 V 17 w(UNIT,)g(TAG,)g(COMM,)g(REQUEST,)g(IERROR\))170
1467 y(<type>)g(BASE\(*\))170 1524 y(INTEGER)g(EVENTS,)g(SIZE,)g(DISP)p
794 1524 V 17 w(UNIT,)g(TAG,)h(COMM,)f(REQUEST,)g(IERROR)189
1645 y Ff(A)n(dvic)n(e)17 b(to)i(implementors.)56 b Fl(Eac)o(h)18
b(pro)q(cess)g(participating)h(in)f(an)g(OFFER)o(C)g(or)f(IOFFER)o(C)
189 1702 y(m)o(ust)10 b(determine)i(whether)f(or)g(not)f(it)h(has)g
(serviced)h(all)g(of)f(the)g(outstanding)g(PUTC)g(and)g(GETC)189
1758 y(ev)o(en)o(ts)j(targetting)f(it)h(b)q(efore)h(it)f(can)g
(complete.)21 b(The)14 b(most)f(e\016cien)o(t)i(metho)q(d)g(of)e
(determining)189 1815 y(this)i(is)g(probably)h(for)e(eac)o(h)h(pro)q
(cess)g(to)f(k)o(eep)i(a)e(coun)o(t)h(of)f(the)h(n)o(um)o(b)q(er)h(of)e
(PUTC)h(and)g(GETC)189 1871 y(ev)o(en)o(ts)h(it)g(has)h(issued)g(to)f
(eac)o(h)g(pro)q(cess)h(since)h(the)e(previous)h(OFFER)o(C)f(or)g
(IOFFER)o(C.)g(This)189 1928 y(will)g(tak)o(e)e(the)h(form)e(of)i(a)f
(v)o(ector)g(\(con)o(taining)h(one)g(elemen)o(t)g(p)q(er)g(pro)q(cess)g
(in)h(the)e(comm)o(unica-)189 1984 y(tor\))h(on)i(eac)o(h)g(pro)q(cess)
g(in)h(the)f(comm)o(unicator.)25 b(The)17 b(collectiv)o(e)i(op)q
(eration)e(then)g(consists)g(of)189 2041 y(p)q(erforming)e(a)f(v)o
(ector)g(sum)g(reduction)i(to)e(pro)q(duce)h(a)g(v)o(ector)e(of)i(the)f
(total)g(n)o(um)o(b)q(er)h(of)f(PUTC)189 2097 y(and)e(GETC)g(op)q
(erations)g(whic)o(h)i(w)o(ere)e(p)q(erformed)g(to)g(eac)o(h)g(pro)q
(cess,)h(then)g(a)f(broadcast)g(of)g(that)189 2153 y(sum)k(v)o(ector)g
(to)h(all)g(pro)q(cesses.)25 b(Eac)o(h)17 b(pro)q(cess)g(can)g(then)g
(individuall)q(y)i(\014nish)f(the)f(OFFER)o(C)189 2210
y(op)q(eration)e(when)h(they)g(ha)o(v)o(e)f(matc)o(hed)h(the)f
(appropriate)h(n)o(um)o(b)q(er)g(of)f(PUTC)g(and/or)g(GETC)189
2266 y(op)q(erations.)189 2339 y(Because)20 b(of)f(the)g(o)q(dd)h
(completion)g(condition)h(for)e(an)g(OFFER)o(C,)g(TEST)g(is)h(free)f
(to)g(alw)o(a)o(ys)189 2396 y(return)g("notcompleted")g(for)f(an)o(y)h
(request)g(returned)g(b)o(y)g(an)g(IOFFER)o(C.)g(T)l(o)g(do)g
(otherwise)189 2452 y(ma)o(y)d(require)h(TEST)f(to)g(engage)h(in)g(exp)
q(ensiv)o(e)h(comm)o(unication.)25 b(\()p Ff(End)17 b(of)h(advic)n(e)f
(to)h(imple-)189 2508 y(mentors.)p Fl(\))166 2647 y Fh(Discussion:)55
b Fg(It)19 b(seems)g(p)q(erfectly)i(reasonable)e(to)g(pro)o(vide)g(p)q
(ersisten)o(t)i(requests)g(for)e(the)h(OFFER)75 2704
y(op)q(erations,)14 b(esp)q(ecially)g(OFFER)o(C)g({)f(i.e.)18
b(MPI)p 853 2704 13 2 v 15 w(OFFER)o(C)p 1042 2704 V
15 w(INIT.)-32 46 y Fc(1)-32 103 y(2)-32 159 y(3)-32
215 y(4)-32 272 y(5)-32 328 y(6)-32 385 y(7)-32 441 y(8)-32
498 y(9)-40 554 y(10)-40 611 y(11)-40 667 y(12)-40 724
y(13)-40 780 y(14)-40 836 y(15)-40 893 y(16)-40 949 y(17)-40
1006 y(18)-40 1062 y(19)-40 1119 y(20)-40 1175 y(21)-40
1232 y(22)-40 1288 y(23)-40 1345 y(24)-40 1401 y(25)-40
1457 y(26)-40 1514 y(27)-40 1570 y(28)-40 1627 y(29)-40
1683 y(30)-40 1740 y(31)-40 1796 y(32)-40 1853 y(33)-40
1909 y(34)-40 1966 y(35)-40 2022 y(36)-40 2078 y(37)-40
2135 y(38)-40 2191 y(39)-40 2248 y(40)-40 2304 y(41)-40
2361 y(42)-40 2417 y(43)-40 2474 y(44)-40 2530 y(45)-40
2587 y(46)-40 2643 y(47)-40 2699 y(48)p eop
%%Page: 14 16
14 15 bop 75 -100 a Fl(14)173 b Fe(CHAPTER)15 b(1.)35
b(ONE)15 b(SIDED)h(COMMUNICA)l(TIONS)g({)f(P/G/O)f(AL)l(TERNA)l(TIVE)75
49 y Fi(1.5)59 b(Miscellaneous)20 b(F)n(unctions)75 151
y Fl(Within)11 b(message-passing)g(or)e(1-sided)i(routines,)h(the)e
(use)g(of)g(regions)g(allo)q(cated)i(using)e(the)h(MPI)p
1748 151 14 2 v 16 w(RMA)p 1873 151 V 17 w(MALLOC)75
207 y(function)16 b(ma)o(y)f(pro)o(vide)g(more)g(e\016cien)o(t)h
(execution)g(on)f(some)g(arc)o(hitectures.)75 358 y Fd(MPI)p
160 358 V 16 w(RMA)p 275 358 V 17 w(MALLOC\(base,)g(size\))117
435 y Fg(OUT)108 b Fd(base)505 b Fg(Address)16 b(of)d(allo)q(cated)g
(bu\013er)117 510 y(IN)155 b Fd(size)519 b Fg(Size)15
b(of)e(bu\013er)i(to)e(allo)q(cate,)g(in)h(b)o(ytes)166
682 y Fh(Missing:)35 b Fg(Descriptiv)o(e)15 b(text)f(written)g(b)o(y)g
(others)h(for)e(this)h(function)g(is)g(b)q(etter)h(than)f(I)g(could)g
(m)o(uster.)1967 46 y Fc(1)1967 103 y(2)1967 159 y(3)1967
215 y(4)1967 272 y(5)1967 328 y(6)1967 385 y(7)1967 441
y(8)1967 498 y(9)1959 554 y(10)1959 611 y(11)1959 667
y(12)1959 724 y(13)1959 780 y(14)1959 836 y(15)1959 893
y(16)1959 949 y(17)1959 1006 y(18)1959 1062 y(19)1959
1119 y(20)1959 1175 y(21)1959 1232 y(22)1959 1288 y(23)1959
1345 y(24)1959 1401 y(25)1959 1457 y(26)1959 1514 y(27)1959
1570 y(28)1959 1627 y(29)1959 1683 y(30)1959 1740 y(31)1959
1796 y(32)1959 1853 y(33)1959 1909 y(34)1959 1966 y(35)1959
2022 y(36)1959 2078 y(37)1959 2135 y(38)1959 2191 y(39)1959
2248 y(40)1959 2304 y(41)1959 2361 y(42)1959 2417 y(43)1959
2474 y(44)1959 2530 y(45)1959 2587 y(46)1959 2643 y(47)1959
2699 y(48)p eop
%%Trailer
end
userdict /end-hook known{end-hook}if
%%EOF
===============================================================================
David C. DiNucci | MRJ, Inc., Rsrch Scntst |USMail: NASA Ames Rsrch Ctr
dinucci@nas.nasa.gov| NAS (Num. Aerospace Sim.)| M/S T27A-2
(415)604-4430 | Parallel Tools Group | Moffett Field, CA 94035

• Next message: Marc Snir: "possible race condition in post-wait-start-complete"
• Previous message: David C. DiNucci: "New version of P/G/O proposal"