Parallel I/O (cont'd)

• I/O Specification
  • Scientist-programmer sees: High-level scientific I/O library
    • "Function calls" express global view of data, local ownership of pieces, type of data

    • Highest level: field in space

    • Self-describing, machine--independent "files"

    • Examples: HDF, NetCDF (none general enough!)

  • Systems programmer sees: Parallel I/O library
    • Takes multiple streams of bytes
      • Maybe gathered/strided from memory

    • Outputs (multiple) streams of bytes in global-view to disk
      • Maybe not programming-language storage order

      • Maybe not single traditional file

      • Examples: MPI-IO, Vesta

...None of this really exists

• Kim Yates working on MPI-IO for the T3D

Generated with CERN WebMaker