|
Published Articles >> Table of Contents >> Abstract
2003 International Conference on Parallel Processing (ICPP'03)
p. 125
PVFS over InfiniBand: Design and Performance Evaluation
Jiesheng Wu, The Ohio State University
Pete Wyckoff, Ohio Supercomputer Center
Dhabaleswar Pandac, The Ohio State University
Full Article Text:
  
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/ICPP.2003.1240573
Send link to a friend
| Abstract |
|
I/O is quickly emerging as the main bottleneck limiting performance in modern day clusters. The need for scalable parallel I/O and file systems is becoming more and more urgent. In this paper, we examine the feasibility of leveraging InfiniBand technology to improve I/O performance and scalability of cluster file systems. We use Parallel Virtual File System (PVFS) as a basis for exploring these features. In this paper, we design and implement a PVFS version on InfiniBand by taking advantage of InfiniBand features and resolving many challenging issues. We design the following: a transport layer customized for PVFS by trading transparency and generality for performance; buffer management for flow control, dynamic and fair buffer sharing, and efficient memory registration and deregistration. Compared to a PVFS implementation over standard TCP/IP on the same InfiniBand network, our implementation offers three times the bandwidth if workloads are not disk-bound and 40% improvement in bandwidth in the disk-bound case. Client CPU utilization is reduced to 1.5% from 91% on TCP/IP. To the best of our knowledge, this is the first design, implementation and evaluation of PVFS over InfiniBand. The research results demonstrate how to design high performance parallel file systems on next generation clusters with InfiniBand.
|
 Additional Information
|
Citation:
Jiesheng Wu, Pete Wyckoff, Dhabaleswar Pandac,
"PVFS over InfiniBand: Design and Performance Evaluation,"
icpp,
p. 125,
2003 International Conference on Parallel Processing (ICPP'03),
2003
|
|
