The Role of Responsive Pricing in the Internet

Jeffrey K. MacKie-Masongif Liam Murphygif John Murphygif

Abstract:

The Internet continues to evolve as it reaches out to a wider user population. The recent introduction of user-friendly navigation and retrieval tools for the World Wide Web has triggered an unprecedented level of interest in the Internet among the media and the general public, as well as in the technical community. It seems inevitable that some changes or additions are needed in the control mechanisms used to allocate usage of Internet resources. In this paper, we argue that a feedback signal in the form of a variable price for network service is a workable tool to aid network operators in controlling Internet traffic. We suggest that these prices should vary dynamically based on the current utilization of network resources. We show how this responsive pricing puts control of network service back where it belongs: with the users.

Introduction

 

A communications network is as good, or as bad, as its users perceive it to be. Network performance should therefore be measured in terms of overall user satisfaction with the service they receive. However network performance is usually expressed in terms of network engineering measures such as average packet delay or loss rate. These engineering measures are an imperfect reflection of overall user satisfaction because user requirements vary widely, in every service dimension and over time.

Accounting for individual QOS requirements makes network operation and control considerably more complicated. In practice, user objectives are averaged across all users and over time. These averaged objectives are reduced to engineering measures and then are used to drive the network control process (see Figure 1): the users are not in the loop when making operational decisions.

  
Figure 1: Network design and control loops (a)

In an effort to reflect variations in QOS requirements, many researchers divide usage into classes according to application requirements and traffic characteristics; for example, real-time video, real-time audio, one-way video playback, or off-line file transfer. Each class is then regarded as having a single representative user for analytical and control purposes. However, this approach ignores substantial heterogeneity within application classes and across users.

Therefore we think it is increasingly important for network operators to develop flexible tools that can support heterogeneity in usage types and user valuations.

One such tool is the ever-increasing intelligence located within the users' end-stations. It is already feasible for many traffic sources and sinks to do some basic processing on the transmitted data; for example, TCP congestion control schemes [5] respond to network feedback by adjusting the traffic inputs. And as technology advances, these capabilities will continue to expand. This intelligence represents a network resource that, if properly managed, could enable a ``tighter" network control loop than before.gif

As a natural extension of existing network feedback control mechanisms, we propose bringing users back into the loop and thereby ensuring that performance measures are user-oriented (see Figure 2). We propose a form of feedback which we call responsive pricing and argue that it represents a particularly useful mechanism for maximizing network value. Users would gain by obtaining service more closely matched to their needs; network operators would gain through improved network utilization and increased user satisfaction with the service they receive. In particular, responsive pricing helps network operators by its ``value discovery'' function: it reveals how the valuations for QOS differ across time, users and applications. Summary network engineering measures will continue to be important, but we believe that user preferences should be the primary consideration driving resource allocation and congestion control schemes.

  
Figure 2: Network design and control loops (b)

Two definitions of efficiency

 

In focusing on user preferences, we need to distinguish two very different notions of efficiency:

If a network can maintain a target level of service while minimizing the resources needed to provide this service, we say that its operation is network efficient. For example, by statistically multiplexing bursty transmissions, the bandwidth required can often be reduced from that of a pure circuit-switched approach while still meeting the delay requirements of the applications.

If no user currently receiving a particular QOS values it less than another user who is being denied that QOS, we say that operation is economically efficient. For example, if one user is willing to pay x per second for undelayed access to a 1 Mbps link, and a second user is willing to pay only , and if only one of them can be accommodated, then in an economically efficient network the bandwidth will be allocated to the first user (whether or not they actually pay anything).

An obvious question is, why will either type of efficiency continue to be important? Some observers have suggested that the widespread deployment of fiber optic lines, and continuing exponential decreases in processor and memory costs, will result in these network resources becoming essentially ``free" so that efficiency in their use will not be important in the future, and all users can always be accommodated. We do not believe these arguments apply in the short or medium terms, if indeed they will ever apply. User demands are increasing exponentially, so that it is not clear when---if ever---network resources will be ``free''. We share the dream of ubiquitous, two-way broadband connectivity at low or zero cost, but believe we must wait at least a few decades to achieve it, despite astonishing technological advances. Consider the cost of providing gigabit bandwidth not just to every home in the industrialized world, but for the other three-quarters of the planet's population as well. Add to that the cost of gigabit mobile communication that will follow each person around town, country and world. And experience suggests that application developers will have little difficulty in designing new services that use up all the available resources.

For the foreseeable future, we will continue to live in a world characterized by network resource scarcity. We will move most quickly towards ``free'' service if we use our scarce network resources --- whether public or private --- efficiently in economic terms.

Meanwhile, if commercial providers are not responsive to user valuations, they will not succeed in a competitive market. The same considerations apply even to private-access networks: the ultimate goal is to maximize some human measure of the value of using the network, such as profits, sales, shareholder value, and so on.

Feedback and adaptive users

 

Feedback is a well-established method of improving network efficiency. Users of current data networks respond to multiple forms of feedback, on various timescales. On the longest timescale users decide whether or not to use a particular network, perhaps based on the network's charging structure, or their previous experience with it. At the connection level, if a user observes that the network is usually heavily loaded at certain times of the day and lightly loaded at others, she may schedule her network usage accordingly. On these longer timescales, user responses are usually determined on economic grounds (although not always explicitly). For example, deciding whether or not to set up a connection involves weighing the expected value of using the network against the cost (in money, time, and/or degraded quality) of doing so. Most people are familiar with the decision that it is not ``worthwhile" to use a network during busy periods, but instead to do something else and defer their network usage, without necessarily recognizing this process as economic decision-making.

During a connection, adaptive users can adjust their traffic inputs or QOS demands to respond to feedback signals from the network about the current state of network resources. TCP applications use various congestion control algorithms such as slow-start [5] to adjust their input rates to the currently available bandwidth. The ATM Forum is developing an Available Bit Rate (ABR) service in which users who respond ``appropriately" to dynamic feedback get loss guarantees from the ATM network [14]. Since it is already accepted that user responses can be automated using pre-programmed network interfaces, fairly sophisticated user behavior can be envisaged, and feedback strategies need not be limited by human user response times. The issue becomes one of choosing a feedback signal to modify user behavior in some desired manner.

Adaptive users can help to increase network efficiency if they are given appropriate feedback signals. When the network load is high, the feedback should discourage adaptive users from inputting traffic; when the load is low, the feedback should encourage these users to send any traffic they have ready to transmit. In this way many of the congestion problems that occur if the offered load is regarded as fixed can be avoided. One possible feedback signal is a price based on the level of network load: when the load is high, the price is high, and vice-versa. Similarly, by associating a cost measure with network loading, all users can be signalled with the prices necessary to recover the cost of the current network load. Price-sensitive users---those willing and able to respond to dynamic prices---increase economic efficiency by choosing whether or not to input traffic according to their individual willingness to pay the current price. Users who value network service more will choose to transmit, while those who value it less will wait for a lower price. When the network is lightly loaded then the price will be close to zero, and all users can input traffic.

Price signals thus have the potential to increase both network and economic efficiency, though whether a particular pricing scheme increases either notion of efficiency depends on the implementation (see Section 5). In a public network, where the users cannot be assumed to be cooperative, the more traditional feedback schemes as currently used in TCP/IP networks are not robust to user manipulation: it is relatively easy to program a host to ignore the feedback signals. Of course it would be just as easy to ignore price signals; but since users would be liable for charges they incurred, there is some incentive to respond.

Price as a form of feedback

 

Congestion control and feedback control are difficult problems in network operations. Perhaps because of the technical challenges involved, most researchers have ignored two key issues (or relegated them to ``policy issues") which are nevertheless crucial:

Charges to an Internet user could have several components, such as a connection fee, a charge per unit time or per unit of bandwidth, premium charges for certain services, and so on. In this paper, we focus attention on only one type of pricing: a responsive component which varies with the state of network congestion. By responsive pricing we do not mean a charge which counts the number of bytes or packets regardless of the network conditions.gif On the contrary, we propose charging only when network congestion indicates that some users may be experiencing QOS degradation, with the size of the charges related to the degree of congestion. If the network is lightly loaded and all users are getting acceptable QOS, the responsive prices would be zero.

Proposing a scheme to allocate network resources and service priorities is not a radical departure: allocation occurs today in the Internet. However, the current allocation is implemented on a first-come, first-served basis, without any consideration for whether some users value immediate access more highly than others.

Given the heterogeneity of user requirements for network performance, responsive pricing would improve economic efficiency by inducing users with low priority traffic to delay it until a burst of congestion eases. Such time-smoothing would not upset users who can tolerate high latency, while it would improve the network's value to users who get the greatest benefits from immediate access.

Let us clarify one point: when most people think of prices, they think in monetary terms, e.g. dollars and cents. However, there is nothing inherently monetary in applying pricing principles to communication networks. As long as the appropriate cost and valuation functions can be defined, a pricing mechanism can be applied even if money is not directly involved. For example, in a private network where one organization controls all the users, the ``prices" would be control signals which summarize the state of network resources. In this case the users (or their applications) are cooperative and can be programmed to obtain a desirable traffic mix.gif

We recognize that many people are concerned about the use of pricing in network operations. Concerns range from questions about the feasibility and overhead of usage-sensitive pricing, to more philosophical issues such as profit opportunities and fairness. While some of these concerns may or may not be borne out by future developments, others are based on misconceptions of what is being proposed or on other non-technical grounds. We do not expect that decisions on pricing will be made solely on technical grounds, but we do believe that a clear understanding of the nature of what is being proposed is necessary on all sides. Therefore we first describe a framework for responsive pricing, and some of our work on analyzing and simulating various implementations. We then address some of the objections often raised in discussions of dynamic network pricing.

Modeling User Adaptation to Feedback

Our focus is on the interaction between user behavior and the efficiency of the network. Therefore, we want to model traffic types that a user can adapt to the state of the network. In this section we discuss the nature of such adaptive applications.

There are several ways in which a user can adapt her traffic load to the network state. Not all of these are equally obvious to the network. For example, a user may have a constant bit-rate (CBR) application that cannot tolerate either delay or loss. If the user does not like the service offered by the network, she may adapt by connecting to a different network, so the original network never sees the load at all.

Alternatively, the user may decide to make a connection, and use it for a CBR and delay-intolerant application. However, depending on the state of the network and the service guarantees it offers, the user may adapt the traffic at source. For example, the user could reduce the number of packets transmitted, by accepting lower fidelity or precision.

Or the user could delay making the connection to a different time. In these cases, the network merely sees a CBR source; it does not directly observe that the user has adapted.

In another case, a user may offer a load to the network, but accept a best efforts service quality. In this case, the user is abdicating the adaptation to the network. If the network accepts all best efforts traffic, then the offered load is not adapted to the network state. Rather, the burden the traffic imposes is adapted through varying the delay and packet loss. This form of adaptation can be quite costly if a higher layer protocol is resending lost packets: congestion breeds congestion.

Even without pricing, users obviously adapt their network usage in several ways. We propose taking advantage of this natural adaptability to improve efficiency over a short time horizon. We have elsewhere [8], [11] described several different types of adaptive users. So far we have modelled inelastic and elastic user types:

With these two types we have heterogeneity across applications, and thus are modeling an integrated services network. Further, we are able to model within-type heterogeneity by specifying users of a given type who value their QOS differently.

Responsive Pricing Schemes

 

In our simulations we have been comparing three different schemes for allocating a simple network's resources. The first is a conventional approach that makes no use of feedback and user adaptation to the network state. The second is a closed-loop form of feedback and adaptation; the third is a closed-loop variation we call ``tight loop'' because it shortens the delay in the control loop.

No feedback

Our proposal to improve network efficiency through involving the users in session control is somewhat novel, and certainly controversial. Most in the network engineering community seem to assume that a network will (and should?) be tuned for efficiency given a set of admitted user connections. The only room for interaction with the users in this setting is through the connection setup negotiation. Therefore, as a baseline, we simulate a network that does not provide feedback: users do not adapt to the network state.

A fixed number of inelastic sources are always admitted and active. In addition, a number of elastic applications are active at any given time. To simplify, the number of new elastic connections each period is held constant, but the number of packets to be delivered by each connection is random, so the number of active connections in any given period after the first will be random (as varying numbers of connections are completed). The distribution of elastic message sizes is chosen so that the average load being added to the network in each period is within the tolerance for a reasonable call admission algorithm. However, sometimes the amount of active elastic traffic will be large, and the network will suffer some performance difficulties (packet delays and losses).

Closed-loop feedback

Our first feedback network uses a simple scheme [9], [12]. The network state is measured by buffer occupancy at the gateway. This occupancy is converted into a price per packet, which is then transmitted back to each active adaptive application. The applications then decide on how many packets to send during the next interval, as described above.

In this network, users send some packets in period t, and network performance is affected by the aggregate number of packets received during an interval. At the end of period t the network sends a signal back to users based on the network utilization in period t. Users then decide how many packets to send in period t+1, based on their observed period t performance and their application requirements. This is a closed-loop feedback system with at least a one-period lag between the state of the network and the effect on the user inputs.

Smart market pricing

A ``smart market'' approach to adaptation has been proposed in [6]. A user sends packets to the network interface which include in each header a token indicating how much the user is willing to pay to get that packet onto the network in the current interval. Then, during the pricing interval, the network gateway sorts the ``bids'' on the incoming packets, and admits to the network only as many as it can accomodate without degrading performance below some bound.gif The gateway admits packets in descending order of their bid. Users are charged not the amount that they declared they were willing to pay, but the value of the minimum bid on a packet that is admitted to the network. Thus, users pay just the congestion cost (the amount that the highest-value denied packet would have paid for immediate transport) but they get to keep all of the excess value that they attribute to delivery above the cutoff bid. This form of pricing by auction has several nice properties, described in [6].

We call this mechanism a tight-loop because the user sends willingness to pay along with the packet, and the network admission and pricing is determined based on those reports and the current state of network congestion, without creating a feedback delay. In practice, there might be a one-period delay to allow the gateway to determine the approximate cutoff bid from packets presented in the prior interval.

Preliminary simulation results

To give a sense of the gains that are possible with responsive pricing, we offer some preliminary results that compare no feedback to the closed-loop pricing scheme.

  
Figure 3: Performance and Economic Gains from User Feedback (preliminary)

In the simulations we have generated 20 video sources with random frame sizes to represent the inelastic traffic, and between 1 and 39 elastic data sources with random frame sizes, with the number of active flows at a given moment chosen randomly. Under these conditions our network capacity has experienced an average of 80% utilization. When closed-loop pricing is implemented packet loss drops from 19% to under 2%, while the net benefits perceived by the users increase by nearly 15%.

Objections to responsive pricing

 

We explore some common arguments against responsive pricing in network operations in this Section, and provide some counterpoints. Some previous work along these lines is contained in [7] and [10].

Conclusions

 

Many proposals have been made to incorporate feedback into network control and resource allocation schemes, such as TCP congestion control and avoidance algorithms or ABR service in ATM networks. We suggest taking these proposals one step further by explicitly defining how that feedback is generated by the network, and what form it takes. In responsive pricing, the network announces a price which is based on the cost of using network resources, and price-sensitive users adjust their traffic inputs based on this price and their own specification of how valuable network service is to them.

What we propose is to give users incentives to consider the effects of their usage on other users. While users may or may not behave ``considerately" in a privately-owned network, it appears that some incentives will always be necessary in commercial networks. We also address the issue of user valuation of the service, and allow for some sources to have more demanding traffic than others regardless of the type of applications involved. Simulations show that it is possible to gain both network efficiency and economic efficiency by using pricing. In other words, the network actually carries more traffic and carries more important traffic from the users' point of view.

Acknowledgements

We would like to thank the contributors to the com-priv Internet mailing list, and some of the attendees of the MIT Internet Economics Workshop, for their vigorous objections to usage-based pricing.

References

1
ATM Forum, `ATM User-Network Interface Specification', Prentice Hall, 1993.

2
R. Bohn, H.-W. Braun, K. Claffy, and S. Wolff, `Mitigating the coming Internet crunch: Multiple service levels via precedence.' Tech. rep., UCSD, San Diego Supercomputer Center, and NSF. 1993.

3
D. Clark, Paper presented at Conference on Internet Economics, MIT, March 1995.

4
M. de Prycker, Asynchronous Transfer Mode : Solution for Broadband ISDN, 2nd Ed., Ellis Horwood, 1993.

5
V. Jacobson, `Congestion Avoidance and Control', Proc. ACM SIGCOMM '88 Symp., Sept. 1988.

6
J. MacKie-Mason and H. Varian, `Pricing the Internet,' in Public Access to the Internet, B. Kahin and J. Keller, eds., Prentice-Hall, Englewood Cliffs, NJ, 1995. Available from URL ftp://www-personal.umich.edu/~jmm/papers/Pricing_Internet/Pricing_the_Internet.ps.Z

7
J. MacKie-Mason and H. Varian, `Some FAQs about Usage-Based Pricing', in Filling the Pipeline and Paying the Piper: Scholarly Publishing on the Electronic Network'', Association of Research Libraries Conference Proceedings. Also forthcoming, Computer Networks and ISDN Systems, 1995. Available from URL http://www-personal.umich.edu/~jmm/useFAQs/useFAQs.html

8
J. MacKie-Mason, J. Murphy and L. Murphy, `ATM Efficiency Under Various Pricing Schemes,' presented at 3rd International Conference on Telecommunications Systems Modelling and Analysis, Nashville, TN, March 1995.

9
J. Murphy and L. Murphy, `Bandwidth Allocation By Pricing In ATM Networks', IFIP Transactions C : Communication Systems, No. C-24, 1994, p. 333-351. Available from URL http://www.eeng.dcu.ie/ murphyj/band-price/band-price.html

10
L. Murphy and J. Murphy, `Feedback and Pricing in ATM Networks', Proc. IFIP TC6 Third Workshop on Performance Modelling and Evaluation of ATM Networks, Ilkley, England, July 1995, p. 68/1-68/12. Available from URL http://www.eeng.dcu.ie/ murphyj/brad-price/brad-price.html

11
L. Murphy and J. Murphy, `Pricing for ATM Network Efficiency', Proc. 3rd International Conference on Telecommunication Systems Modelling and Analysis, Nashville, TN, March 1995, p. 349-356. Available from URL http://www.eeng.dcu.ie/ murphyj/atm-price/atm-price.html

12
J. Murphy, L. Murphy and E. C. Posner, `Distributed Pricing For Embedded ATM Networks', Proc. International Teletraffic Congress ITC-14, Antibes, France, June 1994, p. 1053-1063. Available from URL http://www.eeng.dcu.ie/ murphyj/dist-price/dist-price.html

13
J. Murphy and J. Teahan, `Video Source Models for ATM Networks', Eleventh UK IEE Teletraffic Symp., Cambridge, UK, 23-25 March 1994. Available from URL http://www.eeng.dcu.ie/ murphyj/video/video.html

14
P. Newman, `Traffic Management for ATM Local Area Networks', IEEE Communications Magazine, pp 44-50, August 1994.

15
SES, SES/workbench Reference Manual, Release 2.1, Feb. 1992.

16
`Redundancy Reduction Techniques for Coding of Video Signals in Multi-Media Services', COST 211ter, Compendium ATM, Coding Procedures, Simulation Subgroup, pp 1-83, May 1993.

About this document ...

The Role of Responsive Pricing in the Internet

This document was generated using the LaTeX2HTML translator Version 95.1 (Fri Jan 20 1995) Copyright © 1993, 1994, Nikos Drakos, Computer Based Learning Unit, University of Leeds.

The command line arguments were:
latex2html -split 0 respons.tex.

The translation was initiated by Jeffrey K. MacKie-Mason on Mon Sep 4 11:19:59 EDT 1995

...MacKie-Mason
Dept. of Economics and School of Public Policy, University of Michigan, Ann Arbor, MI 48109-1220, USA (also NBER, Cambridge, MA); [email protected]

  

...Murphy
Department of Computer Science and Engineering, Auburn University, AL 36849, USA; [email protected]

  

...Murphy
School of Electronic Engineering, Dublin City University, Glasnevin, Dublin 9, Ireland; [email protected]

  

...before.
Our emphasis on increasingly controlling network congestion at the periphery echoes the views expressed by Dave Clark in his contribution to this volume [3].

  

...conditions.
We use ``packet" in a generic sense to mean a unit of data transmitted by a user.

  

...mix.
Control theorists will recognize ``prices'' as the costate variables or shadow values which provide the correct signals to optimize the allocation of resources in the network: in this case, optimize a function of user valuations of network performance.

  

...bound.
In practice, the gateway would probably estimate the cutoff bid that would admit the number of packets that can be accomodated, using recent information on the bid distribution and perhaps a sample of newly arriving packets. Then the gateway would merely route incoming packets into two (or more) queues --- one for immediate handling, and one for buffering and re-entry in the next bid period. When the number of packets being held back exceeded buffer capacity, some would be dropped.

  

...authority?
It is interesting to note that for a while in 1995 the EUNet backbone in Europe administratively forbade unrestricted use of the CU-SeeMe videoconferencing software, requiring that users apply in writing, in advance, for permission to establish a session.

  

...lifetime.
This assumes that the flat fees are set to recover some function of the usage cost, as they would be in a competitive market for service provision.

  

...society.
We do not mean to dismiss income distribution problems as unimportant, but rather to say that network pricing (or non-pricing) is not the right venue for solving them.

  



Jeffrey K. MacKie-Mason
Mon Sep 4 11:19:59 EDT 1995