Darshan 2.0.1 release

by

Changelog:

  • bug fix to variance/minimum calculations on shared files
  • switch to automatic generation of all MPI compiler scripts using darshan-gen-* tools
  • new run time environment variable: DARSHAN_INTERNAL_TIMING. If set at job execution time, it will cause Darshan to time its own internal data aggregation routines and print the results to stdout at rank 0.

Darshan 2.0.0 release

by

The Darshan 2.0.0 release is now available for download.  From a user’s perspective, the biggest difference is that you no longer have to run darshan-parser before darshan-job-summary.pl if you just want to see the summary report for a job.  The darshan-job-summary.pl script operates directly on the binary .gz files now.  We also introduced new characterization counters as well as some additional tables in the summary view.  Here is the full change log:
Changelog:

  • new output file format that is portable across architectures (NOTE: Darshan 1.x output files are incompatible with the tools in this release unless they were generated on a ppc32 architecture (Blue Gene))
  • 8 new counters that record the rank of the fastest and slowest process that opened each shared file, along with the number of seconds and number of bytes consumed by those processes.  It also reports the variance in both time and amount of data.
  • new –with-jobid-env configure argument to support recording job identifiers from different schedulers
  • job ID is now recorded within the Darshan log in addition to in the file name
  • darshan-job-summary.pl:
    • opens output files directly without using intermediate darshan-parser output
    • table showing data usage per file system
    • table showing I/O variance in shared files
  • fixes for bugs reported by Noah Watkins:
    • avoid name collision in hashing function
    • divide by zero error in darshan-job-summary.pl
Darshan 2.0.0 is now available on the download page.

Mailing list and Trac page

by

The Darshan project now has a dedicated mailing list and Trac page.  You can find more information in the “bug reports” tab at the top of the Darshan web site.

Darshan 1.1.15 release

by

Changelog:

  • bug fixes to darshan-gen-cc.pl and darshan-gen-cxx.pl
  • basic testing of darshan-gen-cc.pl with mpich/pgi
  • update autoconf so that –with-mpi argument overrides mpicc in path
  • fix warnings on 64 bit machines

Darshan 1.1.15 is now available on the download page.

Darshan 1.1.12 release

by

Changelog:

  • improved mapping of file records to mount points
  • new page in darshan-job-summary.pl output showing timelines of file access
  • bug fix to “fast” mpif90 script
  • checkpoint/restart ability in parallel fsstats script

Darshan 1.1.12 is now available on the download page.

Darshan 1.1.11 release

by

Changelog:

  • Bug fix for lseek, pread, and pwrite when used in 32 applications without large file support
  • Improved experimental darshan-gen-cc.pl script
  • Added new experimental darshan-gen-cxx.pl script

Darshan 1.1.11 is now available on the download page.

Darshan 1.1.10 release

by

Changelog:

  • Bug fix for files that are accessed with stat() but never opened
  • Work around zlib problems with 64 bit offsets on 32 bit architectures

Darshan 1.1.10 is now available on the download page.

Production deployment updates

by

Darshan has been successfully deployed on both the Surveyor and Intrepid BG/P systems at Argonne National Laboratory as of January 14, 2010!  This means that all newly compiled applications are using Darshan by default on those systems.
Upcoming development work will be focused on how to mine the Darshan data to learn more about how users perform I/O at leadership scale.