From the Back Cover

"Tom Clark gives us a clear, readable guide to this emerging technology. He explains how it works, what problems it solves, and where it fits in an evolving IT infrastructure."

—Milan Merhar

"Tom Clark gives us a strong overview of contemporary storage technology with storage virtualization as the central theme—a valuable work for all those seeking a broad understanding of storage in an IT infrastructure."

—David Thiel, HP Fellow and Chair of the SNIA Technical Council

"Storage virtualization technology holds immense promise for streamlining data storage operations and making the unmanageable manageable. In this work, Tom Clark provides a comprehensive overview of virtualization concepts and the practical benefits customers can realize. Storage Virtualization is recommended reading for anyone wanting to understand this next wave of innovative networked storage technology."

—John Webster, Founder and Senior Analyst, Data Mobility Group

Evaluating, Planning, and Implementing High-Value Storage Virtualization Solutions

Storage virtualization has come of age, offering IT professionals powerful new ways to simplify infrastructure, streamline management, improve utilization, and reduce costs. Now, the author of the best-selling storage books IP SANs and Designing Storage Area Networks presents an up-to-the-minute, vendor-neutral overview of storage virtualization in all its forms.

Writing for IT managers, administrators, architects, analysts, consultants, and vendors, Tom Clark explains everything from the basics to the latest emerging standards. Storage Virtualization uses realistic examples and diagrams to explain each key concept, concluding with case studies that demonstrate real-world implementation and help you assess the technology's business value. Coverage includes

The current state of both storage virtualization technologies and the marketplace

Relationships among files, records, data on disk, and storage interconnections

Virtualization standards, including the Fabric Application Interface Standard

How multiple storage systems are abstracted into virtual storage pools

Host-based virtualization, array-based virtualization, and virtualization appliances

Virtualization services for high availability and heterogeneous storage applications

Virtualized SAN file systems that simplify file management and support distributed computing

Virtualized tape backup, including Redundant Array of Independent Tape (RAIT) devices

Policy-based storage management, application-sensitive virtualization intelligence, and other high-level automation and virtualization services

The future of storage virtualization and storage utilities

Extensive resource listings: vendors, industry organizations, and standards initiatives

© Copyright Pearson Education. All rights reserved.

About the Author

Tom Clark has held technical director positions at McDATA Corporation and other storage networking companies, conducts SAN seminars and tutorials worldwide, and serves as customer liaison. A noted storage industry author and advocate, he is a former board member of the Storage Networking Industry Association (SNIA) and has held chair positions for SNIA customer initiatives and the SNIA Interoperability Committee. His previous Addison-Wesley books include Designing Storage Area Networks, Second Edition (ISBN 0-321-13650-0) and IP SANs: A Guide to iSCSI, iFCP, and FCIP Protocols for Storage Area Networks (ISBN 0-201-75277-8).

© Copyright Pearson Education. All rights reserved.

Excerpt. © Reprinted by permission. All rights reserved.
Preface

The following work provides an overview of storage virtualization technology and its myriad manifestations. Like any emerging technical trend, the vague outlines of virtual storage concepts have only begun to sharpen as the technology has matured to productive applications in the real world. Today, there is a diversity of storage virtualization solutions, often tailored to meet specific storage needs. This book attempts to explain the background for that diversity, how different solutions function, and the essential value that is driving storage virtualization towards higher levels of utility.

Chapter 1 (Introduction), discusses the current state of storage virtualization in the market, and provides core concepts for understanding the hierarchy of virtualization-enabled storage operations.

The following three chapters provide foundation knowledge for understanding the relationship between what the user sees and what is done behind the scenes. Chapter 2 (Files and Records) begins with data in its more familiar format, as objects manipulated by applications for persistent storage. Chapter 3 (Data on Disk) provides the link between upper layer file/record structures and lower layer block data storage. Ultimately, all data must reside somewhere, and at some point the content of a file or record will be transformed into data blocks. Chapter 4 (The Storage Interconnect) reviews the connectivity required to link servers with their storage assets, whether by direct-attached SCSI, Fibre Channel or iSCSI.

The next five chapters discuss storage virtualization proper and the various means that have been engineered to support it. Chapter 5 (Abstracting Physical Storage) examines the process of aggregating multiple storage systems into a virtual storage pool. The secret recipe behind this is the mapping of logical block addresses presented by each system to virtual block addresses that are in turn presented to servers. This may be done in various ways. Chapter 6 (Virtualization at the Host) discusses software virtualization that runs on individual servers. Chapter 7 (Virtualization at the Storage Target) discusses array-based virtualization techniques that are offered in some form by nearly all storage vendors. Chapter 8 (Fabric-based Virtualization) reviews the integration of virtualization technology with fabric switches and initiatives such as the Fabric Application Interface Standard that promise interoperable solutions. Chapter 9 (Virtualization Appliances) examines fabric-attached solutions and the innies/outties dispute between in-band and out-of-band methods. Collectively, these chapters address the "where it is done" category of the SNIA storage virtualization taxonomy.

Chapter 10 (Virtualization Services) discusses the practical application of virtual storage to real problems such as high availability and heterogeneous storage use. Storage virtualization in general is a foundation for higher level storage services such as hierarchical storage management.

Chapter 11 (Virtualized SAN File Systems) reviews another use of virtualization technology to streamline file system management and to enable distributed computing environments.

Chapter 12 (Virtualized Tape) provides an overview of the application of virtualization and system aggregation concepts to classic tape backup operations. New technologies such as RAIT (Redundant Array of Independent Tape devices) are breathing new life into an established fixture of data center environments.

Chapter 13 (Storage Automation and Virtualization) discusses the higher level services that are enabled by storage virtualization. Policy-based storage management, application-sensitive virtualization intelligence and the ability of applications themselves to leverage underlying virtualized services are new areas of development that hold great promise for simplifying storage operations.

In conclusion, Chapter 14 (The Storage Utility) examines the wide range of technical dependencies that have been setting the pace of development of storage virtualization technology. As is typical for a final chapter, Chapter 14 also provides wild speculations on the future of storage virtualization and the benefits it may yet provide as an enabling technology for a storage utility.

I have included a bibliography, which unfortunately seems to be an endangered species in technical works these days. Although there are few works on storage virtualization, there are many fine references on SAN technology that the serious reader can pursue. There is also a glossary of storage virtualization terminology as well as general SAN concepts.

The Appendix section at the end of the book includes additional reference material that hopefully will be of interest. Appendix A (Industry Resources) provides web links to industry and standards organizations. Appendix B (Vendor Resources) provides web links to storage virtualization and storage networking vendors, grouped by product type. Appendix C (Observations & Speculations) is an opportunity for industry observers, analysts, experts and customers to express their opinions on what this technology is and where it might be going. Intended Audience

The following work should be useful for anyone who wants to understand the higher functions of storage networking. Storage managers, administrators, SAN architects, storage engineers, analysts, vendors, students and anyone involved in data storage technology should appreciate the new opportunities that storage virtualization provides. This book is therefore intended for a fairly diverse audience, from readers who already have experience with SANs to those who are just learning the benefits of shared storage solutions.

It is always difficult, however, to write a technical work with a specific reader in mind. Some readers will want more technical content; others less. Some will appreciate a broader overview, while others will want to get immediately to the point. This book attempts to provide both sufficient technical detail to be meaningful for a technical audience, and sufficient overview to provide an understanding of the subject by a less technical reader. For both types of readers, feel free to fast forward through sections that discuss concepts already well-understood, or simply of less interest.

Throughout the text I have attempted to avoid mention of specific products or vendors. This is done both to preserve objectivity in discussing technical matters as well as to extend the useful shelf life of the work despite the inevitable innovations that will be introduced. Hopefully, the concepts and relationships explained in the following chapters will provide a useful framework for understanding where we are in the space-time continuum of virtualization's maturation into more sophisticated products. Acknowledgments

Technology is a collective enterprise, both within companies and among the companies that comprise an industry. I have had the good fortune of meeting and working with hundreds of technologists, engineers, system architects and administrators in the storage networking industry over the past eight years. In that time, networked storage has evolved into a successful mainstream technology and transformed data storage processes. Although market competition sometimes throws the storage family into dysfunction, the industry as a whole continues to spawn new solutions and new companies while attracting new talent to further technical innovation. The embodiment of the shared storage family is the Storage Networking Industry Association (SNIA), which should be credited for its contributions to standards, interoperability, education and technology advancement, and for bringing order from the chaos of vendor conflict. In the area of storage virtualization specifically, the SNIA has helped to clarify concepts and relationships within a still emerging and often confusing subject area.

Publishing is also a very collective effort. From the initial idea for a book to its appearance on a shelf, a work passes through many hands. For a technical work in particular, peer review is required to ensure technical accuracy and objectivity of content. I would like to thank Steve Blumenau, Mark Carlson, Milan Merhar and David Thiel for subjecting themselves to the review of the manuscript and for their many useful suggestions and observations. I also am indebted to Mary Franz and Catherine Nolan, my editors, and Lori Lyons, Noreen Regina and many others at Addison Wesley for overseeing this project and accommodating my sporadic output due to my heavy travel schedule.

As always, my wife Lou bears the brunt of personal sacrifice that accompanies a writing project. Although she does not share my interest in logical block address mapping algorithms, she understands that this is something I will probably outgrow at some point. In the meantime, she patiently waits for me to emerge from my study, back into multi-faceted reality to share a stroll through the garden or perhaps to help spread another ton of compose on it.

Due to my position at McDATA Corporation, I've traveled extensively over the past year, meeting customers and technologists throughout the US as well as Europe, Australia, New Zealand, India and Asia. My thanks to the many users of storage networking technology for their profound insight into the challenges of aligning technology to diverse application requirements and for affirming the global value of a technology that still has far more to offer in the future.

Tom Clark
Seattle, Washington

© Copyright Pearson Education. All rights reserved.

FROM THE PUBLISHER