Please join us for the next Mochi quarterly meeting on Thursday, October 31, 2024, at 10am CT. Mochi quarterly meetings are a great opportunity to learn about community activities, share best practices, get help with problems, and find out what’s new in Mochi.
Please suggest agenda items on the Mochi slack space or the [email protected] mailing list.
Microsoft Teams meeting
Join on your computer or mobile app
Click here to join the meeting
Mochi updates and agenda items
- Events at SC24 (November 17-22, Atlanta GA): Look for the Mochi team at the following events at SC24:
- Workshop: 9th International Parallel Data Systems Workshop (PDSW 2024), 9am-5:30pm Sunday Nov. 17
- Many Mochi team member will be in attendance, and several workshop presentations will feature Mochi technology, including “Copper: Cooperative Caching Layer for Scalable Data Loading in Exascale Supercomputers” and multiple presentations on work that leverages the DAOS storage system.
- Panel: Advancing the State of the Art in Distributed Services for HPC, 10:30am-12pm Thursday Nov. 21
- Mochi team members Matthieu Dorier and Rob Ross will be participating as panelist and moderator respectively.
- Paper: CARP: Range Query-Optimized Indexing for Streaming Data, 11:30am-12pm Thursday Nov 21
- Ankush Jain will be presenting his research work on a Mochi service for dynamic data partitioning.
- Workshop: 9th International Parallel Data Systems Workshop (PDSW 2024), 9am-5:30pm Sunday Nov. 17
- Platform updates:
- Most HPE Slingshot equipped systems (including Aurora@ALCF, Perlmutter@NERSC, and Frontier@OLCF) have now been updated to Libfabric version 1.20.1. We’ve updated our example installation recipes accordingly, see the platform-configurations repo for updates. You must use Mercury version 2.4.0rc3 or higher for compatibility with this update.
- The same repository now also includes an example of how to install Mochi in an Apptainer image so that it can still leverage the native host networking stack.
- We (and HPE) are aware of an issue in the Libfabric CXI provider that causes processes using Libfabric (and Mercury and Mochi) to consume 100% CPU at all times when waiting for network events. We expect this to be resolved in a future HPE software release.
- Software updates:
- Mercury version 2.4.0 was released in October 2024. It includes a variety of new features, bug fixes, and performance optimizations, and is compatible with the Libfabric 1.20.1 CXI provider on HPE platforms.
- Margo version 0.18.2 was released in October 2024. It includes a variety of minor bug fixes and enhancements. It also introduces a new polling mode with a configurable “spindown” parameter to control how long Margo waits before idling after servicing requests. It is enabled by default and significantly speeds up bursty or sequential workloads.
- Mofka version 0.3.3 was released in October 2024. Mofka is a distributed event streaming service for HPC systems. Recent releases include a variety of performance optimizations and features, including support for access to Kafka via the Mofka API.
- Bedrock version 0.15.1 was released in October 2024. Bedrock provides bootstrapping and configuration management capabilities for Mochi services. Recent releases include significant refactoring and API revisions to help simplify service configurations.