|
Published Articles >> Table of Contents >> Abstract
37th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN'07)
pp. 612-617
Web Services Wind Tunnel: On Performance Testing Large-Scale Stateful Web Services
Marcelo De Barros, Microsoft Corporation
Jing Shiau, Microsoft Corporation
Chen Shang, Microsoft Corporation
Kenton Gidewall, Microsoft Corporation
Hui Shi, Microsoft Corporation
Joe Forsmann, Microsoft Corporation
Full Article Text:
  
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/DSN.2007.102
Send link to a friend
| Abstract |
|
New versions of existing large-scale web services such as Passport.com© have to go through rigorous performance evaluations in order to ensure a high degree of availability. Performance testing (such as benchmarking, scalability, and capacity tests) of large-scale stateful systems in managed test environments has many different challenges, mainly related to the reproducibility of production conditions in live data centers. One of these challenges is creating a dataset in a test environment that mimics the actual dataset in production. Other challenges involve the characterization of load patterns in production based on log analysis and proper load simulation via reutilization of data from the existing dataset. The intent of this paper is to describe practical approaches to address some of the aforementioned challenges through the use of various novel techniques. For example, this paper discusses data sanitization, which is the alteration of large datasets in a controlled manner to obfuscate sensitive information, preserving data integrity, relationships, and data equivalence classes. This paper also provides techniques for load pattern characterization via the application of Markov Chains to custom and generic logs, as well as general guidelines for the development of cache-based load simulation tools tailored for the performance evaluation of stateful systems.
|
 Additional Information
|
Citation:
Marcelo De Barros, Jing Shiau, Chen Shang, Kenton Gidewall, Hui Shi, Joe Forsmann,
"Web Services Wind Tunnel: On Performance Testing Large-Scale Stateful Web Services,"
dsn,
pp. 612-617,
37th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN'07),
2007
|
|
