Charm++/Converse License

University of Illinois

University of Illinois Charm++/Converse Parallel Programming System Software Non-Exclusive, Non-Commercial Use License

Upon execution of this Agreement by the party identified below ("Licensee"), The Board of Trustees of the University of Illinois ("Illinois"), on behalf of The Parallel Programming Laboratory ("PPL") in the Department of Computer Science, will provide the Charm++/Converse Parallel Programming System software ("Charm++") in Binary Code and/or Source Code form ("Software") to Licensee, subject to the following terms and conditions. For purposes of this Agreement, Binary Code is the compiled code, which is ready to run on Licensee's computer. Source code consists of a set of files which contain the actual program commands that are compiled to form the Binary Code.

1. The Software is intellectual property owned by Illinois, and all right, title and interest, including copyright, remain with Illinois. Illinois grants, and Licensee hereby accepts, a restricted, non-exclusive, non-transferable license to use the Software for academic, research and internal business purposes only, e.g. not for commercial use (see Clause 7 below), without a fee.
2. Licensee may, at its own expense, create and freely distribute complimentary works that interoperate with the Software, directing others to the PPL server (http://charm.cs.uiuc.edu) to license and obtain the Software itself. Licensee may, at its own expense, modify the Software to make derivative works. Except as explicitly provided below, this License shall apply to any derivative work as it does to the original Software distributed by Illinois. Any derivative work should be clearly marked and renamed to notify users that it is a modified version and not the original Software distributed by Illinois. Licensee agrees to reproduce the copyright notice and other proprietary markings on any derivative work and to include in the documentation of such work the acknowledgement:

   "This software includes code developed by the Parallel Programming Laboratory in the Department of Computer Science at the University of Illinois at Urbana-Champaign."

   Licensee may redistribute without restriction works with up to 1/2 of their non-comment source code derived from at most 1/10 of the non-comment source code developed by Illinois and contained in the Software, provided that the above directions for notice and acknowledgement are observed. Any other distribution of the Software or any derivative work requires a separate license with Illinois. Licensee may contact Illinois (kale@cs.uiuc.edu) to negotiate an appropriate license for such distribution.

3. Except as expressly set forth in this Agreement, THIS SOFTWARE IS PROVIDED "AS IS" AND ILLINOIS MAKES NO REPRESENTATIONS AND EXTENDS NO WARRANTIES OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO WARRANTIES OR MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE, OR THAT THE USE OF THE SOFTWARE WILL NOT INFRINGE ANY PATENT, TRADEMARK, OR OTHER RIGHTS. LICENSEE ASSUMES THE ENTIRE RISK AS TO THE RESULTS AND PERFORMANCE OF THE SOFTWARE AND/OR ASSOCIATED MATERIALS. LICENSEE AGREES THAT UNIVERSITY SHALL NOT BE HELD LIABLE FOR ANY DIRECT, INDIRECT, CONSEQUENTIAL, OR INCIDENTAL DAMAGES WITH RESPECT TO ANY CLAIM BY LICENSEE OR ANY THIRD PARTY ON ACCOUNT OF OR ARISING FROM THIS AGREEMENT OR USE OF THE SOFTWARE AND/OR ASSOCIATED MATERIALS.
4. Licensee understands the Software is proprietary to Illinois. Licensee agrees to take all reasonable steps to insure that the Software is protected and secured from unauthorized disclosure, use, or release and will treat it with at least the same level of care as Licensee would use to protect and secure its own proprietary computer programs and/or information, but using no less than a reasonable standard of care. Licensee agrees to provide the Software only to any other person or entity who has registered with Illinois. If licensee is not registering as an individual but as an institution or corporation each member of the institution or corporation who has access to or uses Software must agree to and abide by the terms of this license. If Licensee becomes aware of any unauthorized licensing, copying or use of the Software, Licensee shall promptly notify Illinois in writing. Licensee expressly agrees to use the Software only in the manner and for the specific uses authorized in this Agreement.
5. By using or copying this Software, Licensee agrees to abide by the copyright law and all other applicable laws of the U.S. including, but not limited to, export control laws and the terms of this license. Illinois shall have the right to terminate this license immediately by written notice upon Licensee's breach of, or non-compliance with, any terms of the license. Licensee may be held legally responsible for any copyright infringement that is caused or encouraged by its failure to abide by the terms of this license. Upon termination, Licensee agrees to destroy all copies of the Software in its possession and to verify such destruction in writing.
6. The user agrees that any reports or published results obtained with the Software will acknowledge its use by the appropriate citation as follows:

   "Charm++/Converse was developed by the Parallel Programming Laboratory in the Department of Computer Science at the University of Illinois at Urbana-Champaign."

   Any published work which utilizes Charm++ shall include the following reference:

   "L. V. Kale and S. Krishnan. Charm++: Parallel Programming with Message-Driven Objects. In 'Parallel Programming using C++' (Eds. Gregory V. Wilson and Paul Lu), pp 175-213, MIT Press, 1996."

   Any published work which utilizes Converse shall include the following reference:

   "L. V. Kale, Milind Bhandarkar, Narain Jagathesan, Sanjeev Krishnan and Joshua Yelon. Converse: An Interoperable Framework for Parallel Programming. Proceedings of the 10th International Parallel Processing Symposium, pp 212-217, April 1996."

   Electronic documents will include a direct link to the official Charm++ page at http://charm.cs.uiuc.edu/

7. Commercial use of the Software, or derivative works based thereon, REQUIRES A COMMERCIAL LICENSE. Should Licensee wish to make commercial use of the Software, Licensee will contact Illinois (kale@cs.uiuc.edu) to negotiate an appropriate license for such use. Commercial use includes:
   1. integration of all or part of the Software into a product for sale, lease or license by or on behalf of Licensee to third parties, or
   2. distribution of the Software to third parties that need it to commercialize product sold or licensed by or on behalf of Licensee.
8. Government Rights. Because substantial governmental funds have been used in the development of Charm++/Converse, any possession, use or sublicense of the Software by or to the United States government shall be subject to such required restrictions.
9. Charm++/Converse is being distributed as a research and teaching tool and as such, PPL encourages contributions from users of the code that might, at Illinois' sole discretion, be used or incorporated to make the basic operating framework of the Software a more stable, flexible, and/or useful product. Licensees who contribute their code to become an internal portion of the Software agree that such code may be distributed by Illinois under the terms of this License and may be required to sign an "Agreement Regarding Contributory Code for Charm++/Converse Software" before Illinois can accept it (contact kale@cs.uiuc.edu for a copy).

UNDERSTOOD AND AGREED.

Contact Information:

The best contact path for licensing issues is by e-mail to kale@cs.uiuc.edu or send correspondence to:

Prof. L. V. Kale
Dept. of Computer Science
University of Illinois
1304 W. Springfield Ave
Urbana, Illinois 61801 USA
FAX: (217) 333-3501

What's New in 6.2

New Supported Platforms:

• POWER7 for BlueWaters development systems (new in 6.2.1)
• 64-bit MIPS, such as SiCortex, using mpi-linux-mips64
• Windows HPC cluster, using mpi-win32/mpi-win64
• Mac OSX 10.6, Snow Leopard (32-bit and 64-bit)

General Changes

• Runtime support
  • (new in 6.2.1) Topology information gathering has been optimized
  • (new in 6.2.1) Converse (seed) load balancers have many new optimizations applied
  • (new in 6.2.1) CPU affinity can be set more easily using +pemap and +commap options instead of the older +coremap
  • Smarter build/configure scripts
  • A new interface for model-based load balancing
  • new CPU topology API
  • a general implementation of CmiMemoryUsage()
  • Bug fix: Quiescence detection (QD) works with immediate messages
  • New reduction functions implemented in Converse
  • CCS (Converse Client-Server) can deliver message to more than one processor
  • Added a memory-aware adaptive scheduler, which can be optionally compiled in to charm
  • Added preliminary support for automatic message prioritization (disabled by default)
• Charm++
  • (new in 6.2.1) Better support for multicasts on groups
  • (new in 6.2.1) HybridLB (hierarchical balancing for very large core-count systems) has been substantially improved
  • (new in 6.2.1) Load balancing infrastructure has further optimizations and bug fixes
  • Cross-array and cross-group sections
  • Structured Dagger (SDAG): Support templated arguments properly
  • Plain chares support checkpoint/restart (both in-memory and disk-based)
  • Conditional packing of messages and parameters in SMP scenario
  • Changes to the CkArrayIndex class hierarchy
    • sizeof() all CkArrayIndex* classes is now the same
    • Codes using custom array indices have to use placement-new to construct their custom index. Refer example code: examples/charm++/hello/fancyarray/
    • Backward Incompatibility: CkArrayIndex[4D/5D/6D]::index are now of type int (instead of short) However the data is stored as shorts. Access by casting CkArrayIndexND::data() appropriately
    • Deprecation: The direct use of public data member CkArrayIndexND::index (N=1..6) is deprecated. We reserve the right to change/remove this variable in future releases of Charm++. Instead, please access the indices via member function: int CkArrayIndexND::data()
• Adaptive MPI (AMPI)
  • (new in 6.2.1) AMPI now implements MPI_Issend
  • (new in 6.2.1) AMPI's MPI_Alltoall uses a flooding algorithm more agressively, versus pairwise exchange
  • Compilers renamed to avoid collision with host MPI (ampicc, ampiCC, ampif77, ampif90)
  • Improved MPI standard conformance, and documentation of non-conformance:
    • Bug fixes in: MPI_Ssend, MPI_Cart_shift, MPI_Get_count
    • Support MPI_IN_PLACE in MPI_(All)Reduce
    • Define various missing constants
  • Return the received message's tag in response to a non-blocking wildcard receive, to support SuperLU
  • Improved tracing for BigSim
• Multiphase Shared Arrays (MSA)
  • Typed handles to enforce phases
  • Split-phase synchronization to enable message-driven execution
  • 3D arrays
• TCharm:
  • (new in 6.2.1) Object mappings can be read from a file, to allow offline topology-aware placement
  • Automatic tracing of API calls for simulation and analysis
• Debugging
  • Wider support for architectures other than net- (in particular MPI layers)
  • Improved support for large scale debugging (better scalability)
  • Enhanced record/replay stability to handle various events, and to signal unexpected messages
  • New detailed record/replay: The full content of messages can be recorded, and a single processor can be re-executed outside of the parallel application
• Performance analysis:
  • Tracing of nested entry methods
  • (new in 6.2.1) Projections logs can be spread across multiple directories, speeding up output when dealing with thousands of cores (+trace-subdirs N will divide log files evenly among N subdirectories of the trace root, named PROGNAME.projdir.K)
• Automatic Performance Tuning: Created an automatic tuning framework [still for experimental use only]
• CkMulticast: Network-topology / node aware spanning trees used internally for and lower bytes on the network and improved performance in multicasts and reductions delegated to this library
• Comlib: Improved OneTimeMulticastStrategy classes
• BigSim
  • Out-of-core support, with prefetching capability
  • Detailed tracing of MPI calls
  • Detailed record/replay support at emulation time, capable of replaying any emulated processor after obtained recorded logs.
• (new in 6.2.1) Virtualized ARMCI support has been extended to cover the functions needed by Coarray Fortran (CAF)

Architecture-specific changes

• Net-*: Can run jobs with more than 1024 PEs
• Net-* (new in 6.2.1): Can use clusters' mpiexec systems for job launch, via the ++mpiexec option to charmrun. Tested to work with no additional effort on Abe, and some small scripting on Ranger and Lonestar.
• Net-Linux: New charmrun option ++no-va-randomization to disable address space randomization (ASLR). This is most useful for running AMPI with isomalloc
• MPI: Default to using ampicxx instead of mpiCC
• MPI-SMP: The +p option now has the same semantics as in other smp builds
• Power 7: Support for VSX in SIMD abstraction API
• Blue Gene/L: Compilers and options have been updated to the latest ones
• Blue Gene/P
  • Added routines for measuring performance counters on BG/P.
  • Updated to support latest DCMF driver version. On ANL's Intrepid, you may need to set BGP_INSTALL=/bgsys/drivers/V1R4M1_460_2009-091110P/ppc in your environment. This is the default on ANL's Surveyor.
• Cray XT: cputopology information is now available on XT3/4/5
• Infiniband (ibverbs):
  • Bug fix: plug memory leaks that caused failures in long runs
  • Optimized to reduce startup delays
• LAPI: Support for SMP (experimental in 6.2.0, refined in 6.2.1)
• LAPI: Builds on Linux as well as AIX

Releases in the 6.2 series

• 6.2.0 (2010-04-06): First in release series
• 6.2.1 (2010-07-04): Bugfix and improvement patch release