The HDF Group's Call the Doctor

 The HDF Group's John Readey used his Call the Doctor session to talk about  SWMR (single writer multiple reader) and FancySelections for h5pyd with HSDS.  

Example notebooks referenced by John during this session: 

• https://github.com/HDFGroup/h5pyd/blob/master/examples/notebooks/swmr_example.ipynb
• https://github.com/HDFGroup/h5pyd/blob/master/examples/notebooks/fancy_selection.ipynb

This session was record...

The HDF Group's Director of Engineering Dana Robinson provided some general updates. Dana talked about upcoming releases of HDF5, HDF4, and HDFView. Communications Coordinator Lori Cooper announced the availability of the 2024 HDF5 User Group Meeting video recordings and talked briefly about The HDF Group's new support site (still a work in progress) at https://support.hdfgroup.org.

Links mentioned during this se...

In addition to answering community questions, we will examine the latest PureHDF release(s). PureHDF v1.0.0 and v2.0.0 were released on June 24 (2024), and there have been subsequent minor releases (see Releases · Apollo3zehn/PureHDF · GitHub). We will examine what has changed since v1.0.0-beta.2 and use this opportunity to update the HDF5 tutorial (GitHub - HDFGroup/hdf5-tutorial: A tutorial for new and intermediate HDF5 users (of...

The HDF Group's Scot Breitenfeld ended up using this session to discuss topics including subfiling, support of multidimensional arrays by various languages, the future of Fortran and more with community members and The HDF Group co-workers. 

In this session, we mentioned Aleksandar Jelenak's Call the Doctor session last week where he discussed Hidefix, a Rust package for multithreaded read-only access to local H...

The HDF Group’s Aleksandar Jelenak will talk about a Hidefix, a Rust package for multithreaded read-only access to local HDF5/netCDF4 files. https://github.com/gauteh/hidefix It can also be imported as a Python package and used as an xarray backend engine. Aleksandar will also be available for user questions–he has a background as a scientist working with geospatial and geoscience data, and now works at The HDF Group to make HDF5 a...

The HDF Group's senior informatics architect, Aleksandar Jelenak talked about some hdf5lib changes in the pipeline that will bring improvements for Cloud Optimized HDF5 files.

This session was recorded on July 16, 2024. You can also watch this episode online.

Call the Doctor is a series of weekly, unscripted, live events! The HDF Group’s staff members will answer attendee questions and, for example, go over the previou...

The HDF Group's John Readey used his Call the Doctor session to talk about performance enhancements using the h5pyd MultiManager.

For a use case where MultiManager came in clutch, check out this recent forum thread.

This session was recorded on July 9, 2024. 

Call the Doctor is a series of weekly, unscripted, live events! The HDF Group’s staff members will answer attendee questions and, for example, go over th...

The HDF Group's Engineering Director Dana Robinson hosted the first Call the Doctor of the month and used his time to talk about upcoming releases and some activities and thoughts we’ve been working through on versioning. Then he talked about plans for a community proposal or HDF5 improvement system similar to the Python Improvement Process.

This session was recorded on June 25, 2024. You can watch this episode onlin...

In this episode of Call the Doctor, The HDF Group's Gerd Heber discusses the evolution of HDF documentation, highlighting challenges and past approaches and describes our shift towards treating documentation like code, citing the adoption of tools like Doxygen and plans to streamline documentation under a unified support platform. He previews upcoming updates to enhance readability and functionality, aiming for a rollout by th...

Aleksandar Jelenak of The HDF Group hosted Call the Doctor and shared his experiences with the s5cmd command-line tool that makes working with S3 object stores much easier and faster. He likes it and thinks you will too! 

This session was recorded on June 18, 2024. You can also watch this episode online.

Call the Doctor is a series of weekly, unscripted, live events! The HDF Group’s staff members will answer attendee questi...

In this episode of Call the Doctor, John Readey introduced GitHub Codespaces and demonstrates their use with the h5pyd repository. Codespaces allow running a repository in the cloud without local setup. The speaker sets up a Codespace for the h5pyd repository, demonstrating its integration with VS Code, terminal access, and execution of h5pyd commands like hsinfo and python test. They showcase practical examples such as reading and...

Call the Doctor is a series of weekly, unscripted, live events! The HDF Group’s staff members will answer attendee questions and, for exa...

In this episode of Call the Doctor, Scot Breitenfeld went over recent benchmarks comparing all versions of HDF5, and talked through some of the development that caused changes in those benchmarks. Scot was also available for community questions.

This session was recorded on May 28, 2024. You can also watch this episode online.

Call the Doctor is a series of weekly, unscripted, live events! The HDF Group’s staff me...

The HDF Group's John Readey walked through using Github Codespaces with HSDS.

This session was recorded on May 14, 2024. You can also watch this episode online.

Call the Doctor is a series of weekly, unscripted, live events! The HDF Group’s staff members will answer attendee questions and, for example, go over the previous week’s HDF Forum posts. The HDF Clinics are free sessions intended to help users tackle real-worl...

In this "Call the Doctor" session hosted by Aleksander Jelenak, the agenda was opened for questions regarding h5py or Cloud optimization of HDF files. The discussion delveed into understanding the applicability of techniques used in h5py to the VOL connector for HSDS, emphasizing the nuances between Python and C approaches. Additionally, considerations are made regarding read-only implementations, the trade-offs of networ...

The HDF Group’s Director of Engineering Dana Robinson hosted Call the Doctor on Tuesday, May 7. He talked about recent CVEs (more info) and some plans for 1.14.5.

This session was recorded on May 7, 2024. You can also watch this episode online.

Call the Doctor is a series of weekly, unscripted, live events! The HDF Group’s staff members will answer attendee questions and, for example, go over the previous week’s HDF Forum p...

This Call the Doctor, presented by The HDF Group's executive director, Gerd Heber, presents the Zettelkasten (“slip-box”) is a method of note-taking and knowledge management for writers that was (re-)invented many times and more recently developed by the German sociologist Niklas Luhmann. The Zettelkasten is a collection of notes stored on separate index cards. The notes are linked in a network of references, forming a knowled...

Scot Breitenfeld hosted Call the Doctor on Tuesday, April 16, 2024. Scot answered some community questions about subfiling in HDF5. 

Director of Engineering Dana Robinson talked briefly about the recent HDF5 1.14.4 release.

Communications Coordinator Lori Cooper talked about some upcoming community events: 

• 2024 HDF5 User Group Meeting, August 5-7 in Chicago.
• Upcoming webinar: h5rdmtoolbox – A Python Research Da...

Aleksandar Jelenak hosted Call the Doctor on Tuesday, April 16, 2024. He talked about last week’s h5py 3.11 release and current interesting issues and PRs. Aleksandar has a background as a scientist working with geospatial and geoscience data, and now works at The HDF Group to make HDF5 and related tools more effective for other scientists.

This session happened on April 16, 2024. You can also watch this episode online.

Cal...