This book provides the first comprehensive overview of the history over the past two decades, current trends, and future directions of the TOP500 list in particular and of high performance computing in general. The authors reflect on trends in computer architecture, parallelism, processor technology, interconnect technology and operating systems that have shaped the field.