Managing energy and server resources in hosting centers
J. ChaseDarrell C. AndersonP. N. ThakarAmin VahdatRonald P. Doyle
Proposes an economic resource management architecture for hosting centers that dynamically allocates servers and routes traffic based on service performance bids, cutting server energy consumption by nearly 30% while honoring service-level agreements.
Shared Internet hosting centers face severe challenges from rapid traffic fluctuations, high electricity costs, and operational risks such as cooling failures or power disruptions. Because standard servers consume more than 60% of their peak power even when idle, traditional static overprovisioning for peak demand wastes significant capital and operating expenditures. Modern facilities require operating policies that can dynamically balance computing capacity, service quality, and energy consumption in real time.
The main objective of the article is to design, implement, and evaluate Muse, an adaptive resource management architecture that treats energy and computing resources within a hosting center as variable commodities managed through an economic framework.
The authors designed a hosting center operating system that combines reconfigurable network switches, continuous performance monitors, and a centralized policy controller termed the executive. The system applies a greedy optimization algorithm called Maximize Service Revenue and Profit alongside a smoothing filter called flop-flip to continuously adjust server allotments. To validate this approach, the authors built a physical testbed using FreeBSD servers running Apache and evaluated it under synthetic bursty Web workloads and a 43-million-request trace from IBM's commercial website.
The evaluation revealed several key findings. First, energy-conscious server management reduced energy consumption by 29% on the representative IBM Web workload, with simulated projections indicating savings up to 38% for enterprise loads and up to 78% for highly variable workloads such as the 1998 World Cup trace. Second, power measurements across multiple server architectures confirmed that idle servers draw substantial baseload power, making whole-server deactivation and power transitions far more effective than processor-only frequency adjustments. Third, during induced resource constraints and power "browndown" events, the economic allocation mechanism reliably prioritized high-value services and preserved revenue according to contract terms while degrading lower-value services gracefully.
These findings demonstrate that hosting centers can transition away from costly worst-case overprovisioning to a dynamic model that lowers operational expenses, reduces cooling infrastructure strain, and enables differentiated service level agreements based on performance and price trade-offs. Additionally, the ability to selectively scale down power consumption mitigates thermal risks and allows centers to operate safely on backup power during grid failures.
Based on these results, hosting facility operators should implement energy-aware load redirection and dynamic server power cycling for large server clusters. Organizations should also structure flexible service level agreements that incorporate utility- and penalty-based terms to monetize service quality tradeoffs. Before broad enterprise deployment, administrators should conduct pilot testing to determine appropriate load smoothing thresholds and establish warm low-power machine states that minimize wake-up delays.
The findings are supported by solid physical and trace-driven experiments, though readers should note certain limitations. The prototype primarily manages central processing unit resources rather than complex combinations of storage and memory bandwidth, and the architecture relies on a centralized controller that could become a single point of failure. Nevertheless, the evidence provides high confidence that whole-server energy management yields immediate and meaningful cost reductions in scaled hosting environments.
No sufficiently relevant recommendations were found.
- Paper: Power provisioning for a warehouse-sized computer, Xiaobo Fan et al. (2007). This paper builds on dynamic hosting center energy management by analyzing aggregate power provisioning and cluster-wide capacity limits across warehouse-scale datacenter environments.
- Paper: Live migration of virtual machines, Christopher J. Clark et al. (2005). This work advances dynamic cluster resource and server management by introducing live virtual machine migration to seamlessly rebalance workloads across physical hosts without service disruption.
- Paper: Mesos: A Platform for Fine-Grained Resource Sharing in the Data Center, Benjamin Hindman et al. (2011). Mesos extends dynamic cluster resource allocation concepts to multi-tenant datacenters by proposing a fine-grained two-level resource offer framework for diverse computing frameworks.
- Paper: Dark silicon and the end of multicore scaling, Hadi Esmaeilzadeh et al. (2011). This article extends the focus on energy as a primary computing constraint by analyzing device-level power limitations and dark silicon bottlenecks in multicore architectures.
