From: Subject: United States Patent: 6888457 Date: Wed, 23 May 2007 17:05:05 +0100 MIME-Version: 1.0 Content-Type: multipart/related; type="text/html"; boundary="----=_NextPart_000_00A4_01C79D5C.82526B20" X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.3028 This is a multi-part message in MIME format. ------=_NextPart_000_00A4_01C79D5C.82526B20 Content-Type: text/html; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable Content-Location: http://patft.uspto.gov/netacgi/nph-Parser?Sect1=PTO2&Sect2=HITOFF&p=1&u=%2Fnetahtml%2FPTO%2Fsearch-bool.html&r=2&f=G&l=50&co1=AND&d=PTXT&s1=cliff.INNM.&s2=hewlett.ASNM.&OS=IN/cliff+AND+AN/hewlett&RS=IN/cliff+AND+AN/hewlett United States Patent: 6888457

3D"[Boolean 3D[Help]=20
3D[Image]
  (=20 2 of 6 )
United States Patent 6,888,457
Wilkinson ,   et al. = May 3, 2005 =
Monitoring of user response to performances =

Abstract

A portable apparatus for monitoring the reaction of a user to a = performance=20 contains one or more sensors for detecting an indirect user response to = the=20 performance and a user interface enabling the user to provide a direct = user=20 response to the performance. A processor in the portable apparatus is = programmed=20 to provide a user reaction signal comprising a combination of the = indirect user=20 response and the direct user response to the performance. This user = reaction=20 signal may be transmitted to to remote apparatus. A monitoring system = using such=20 portable apparatus, and a music playing system using such a monitoring = system,=20 are also described.

Inventors: Wilkinson; Timothy Alan Heath = (Bristol,=20 GB), Cliff;=20 David Trevor (Bristol, GB)
Assignee: Hewlett-Packard=20 Development Company, L.P. (Houston, TX)
Appl. No.: 10/206,836
Filed: July 29, = 2002
Foreign Application Priority Data
Jul 27, 2001 [GB] 0118447

Current U.S. = Class: 340/540 ; = 340/323R;=20 340/539.1; 340/573.1; 455/100; 702/182; 725/16
Current International = Class:=20 A61B = 5/00 (20060101); A61B=20 5/16 (20060101); G06F 1/16 (20060101); G09B=20 19/00 (20060101); G09B 15/00 (20060101); G06F=20 3/00 (20060101); H04H 9/00 (20060101); A61B=20 5/024 (20060101); A61B 5/11 (20060101); G08B=20 021/00 ()
Field of Search: = 84/609,615,633,634 = 434/219,307A,319=20 = 340/540,539.1,539.11,539.12,539.13,539.14,539.15,539.17,539.23,539.24,539= .25,539.26,539.27,573.1,573.4,825.49,286.07,566,323R=20 342/357.08 455/100,503 725/11-13,16,24 702/127,182 =

References Cited [Referenced=20 By]
U.S. Patent Documents
4377870 March 1983 Anderson et al.
4739400 April 1988 Veitch
4961575 October 1990 Perry
5310962 May 1994 Kimpara et al.
5436444 July 1995 Rawson
5483276 January 1996 Brooks et al.
5629981 May 1997 Nerlikar
5771001 June 1998 Cobb
5848398 December 1998 Martin et al.
5877675 March 1999 Rebstock et al.
6320112 November 2001 Lotze
6467089 October 2002 Aust et al.
6617970 September 2003 Makiyama et al.
6701271 March 2004 Willner et al.
Foreign Patent Documents
0 685 825 Dec., 1995 EP
0 843 432 May., 1998 EP
0 893 760 Jan., 1999 EP
1 130 570 Sep., 2001 EP
2 269 670 Feb., 1994 GB
2001-67482 Mar., 2001 JP
2001-266148 Sep., 2001 JP
1011226 Aug., 2000 NL
WO 97/40745 Nov., 1997 WO
WO 01/39070 May., 2001 WO
WO 01/39103 May., 2001 WO
Primary Examiner: = Goins; Davetta=20 W.
Claims


What is claimed is:

1. A portable apparatus for = monitoring the=20 reaction of a user to a performance, the apparatus comprising: one or = more=20 sensors adapted to detect one or more sensor signals together = constituting an=20 indirect user response to the performance; a user interface adapted for = the user=20 to provide a direct user response signal to the performance; a processor = adapted=20 to provide a user reaction signal comprising a combination of the = indirect user=20 response and the direct user response signal to the performance; and a=20 transmitter, whereby the processor is adapted to control the transmitter = to=20 transmit the user reaction signal to remote apparatus.

2. = Apparatus=20 according to claim 1 in which the processor is arranged to combine one = or more=20 of the sensor signals and the direct user response to produce a user = reaction=20 signal from which the individual input values cannot be extracted. =

3.=20 Apparatus according to claim 1 in which the processor is arranged to = apply a set=20 of logical rules to the sensor signals and the direct user response in = order to=20 provide an overall reaction measurement as the user reaction signal. =

4.=20 Apparatus according to claim 3 in which the logical rules define which = of the=20 separate sensor signals and the direct user response take preference = over others=20 of the separate sensor signals and the direct user response.

5.=20 Apparatus according to claim 1 wherein the user interface includes a = display=20 adapted to display under the control of the processor prompts to the = user to=20 input information using the user interface.

6. Apparatus = according to=20 claim 1 in which each of the one or more sensors is arranged to sense a=20 parameter of the user's state of well being or physical behaviour = indicative of=20 the user's response to the performance.

7. Apparatus according = to claim=20 6 in which at least one of the sensors is a biometric sensor.

8. = Apparatus according to claim 6 in which at least one of the sensors is a = microphone.

9. Apparatus according to claim 6 in which at least = one of=20 the sensors is an inclinometer.

10. Apparatus according to claim = 1 in=20 which the user reaction signal output by the transmitter uniquely = identifies the=20 portable apparatus.

11. Apparatus according to claim 1 in which = the=20 transmitter is a radio-frequency transmitter adapted to transmit an = encoded=20 radio-frequency signal.

12. Apparatus according to claim 1 = wherein the=20 apparatus further comprises a receiver.

13. Apparatus according = to claim=20 12 in which the apparatus is adapted only to transmit the user reaction = signal=20 in response to a request received through the receiver.

14. A = system for=20 monitoring the response of users to a performance, comprising: two or = more=20 portable apparatuses, each for montoring the reaction of a user to a=20 performance, each each apparatus comprising one or more input devices = each for=20 obtaining an indirect user response signal to the performance, a = processor=20 adapted to provide a user reaction signal from the user responses or = each user=20 response, and a transmitter, whereby the processor is adapted to control = the=20 transmitter to transmit the user reaction signal to a central monitoring = apparatus; and a central monitoring apparatus having a receiver and a = processor=20 adapted to receive user reaction signals from the receivers and to = combine them=20 into an audience reaction signal.

15. A performance generating = system,=20 comprising: two or more portable apparatuses, each for monitoring the = reaction=20 of a user to a performance, each such apparatus comprising an input = device for=20 obtaining a reaction signal to the preformance, and a transmitter = adapted to=20 transmit the user reaction signal to a central performance generator; = and a=20 central monitoring apparatus having a receiver, a memory including a = plurality=20 of performance elements, and processor adapted to receive user reaction = signals=20 from the receiver and to generate a performance comprising at least one=20 performance element selected from the memory in response to the user = reaction=20 signals.

16. A performance generating system according to claim = 15=20 wherein the performance comprise a musical performance, and wherein the=20 performance elements comprise song elements.

17. A method of = monitoring=20 the reaction of a person at a performance to the performance, the method = comprising: detecting an indirect reaction of the person to the = performance;=20 instructing the person to make a direct reaction to the performance; the = person=20 reacting to the instruction by making a direct reaction to the = performance; and=20 deriving an indication of the reaction of the person to the performance = by=20 combining the direct and indirect reactions.

18. The method of = claim 17=20 further comprising detecting plural indirect reactions of the person to = the=20 performance, and deriving the indication of the reaction of the person = to the=20 performance by combining the direct and plural indirect reactions. =

19.=20 The method of claim 17 wherein the person is instructed to make the = direct=20 reaction to the performance by supplying a visual signal to the person.=20

20. The method of claim 17 wherein the indication is derived at = the site=20 of the person, and further including transmitting the indication from = the site=20 of the person to a location remote from the site of the person. =

21. The=20 method of claim 17 wherein each of the steps of the method is performed = by=20 plural persons, and deriving an indication of the combined reactions of = the=20 plural persons to the performance by combining the direct an indirect = reactions=20 of the plural persons.

22. The method of claim 21 wherein the = indication=20 for each of the persons is derived at the site of the particular person, = and=20 further including transmitting the indications from the site of each of = the=20 plural persons to a location remote from the sites of the plural = persons.=20

23. A performance generating system according to claim 14 = wherein each=20 of the one or more input devices is arranged for also obtaining a direct = user=20 response signal to the performance, and the processor is adapted to = provide the=20 user reaction signal from the direct and indirect user responses.
=20
Description


BACKGROUND OF INVENTION

1. Field of Invention =

This=20 invention relates to apparatus for monitoring the reaction of = individuals and=20 collections of individuals to a performance, and also to apparatus for = producing=20 performances modified in response to user reactions. Embodiments are=20 particularly relevant to the choice of songs played at an event. =

2.=20 Description of Related Art

While the present invention is = relevant to=20 monitoring of various types of performance, it has particular relevance = to=20 reactions to and automatic generation of dance music. Terms relevant to = dance=20 music will therefore be used here--to help the reader to interpret this = text, it=20 is to be understood that the term "song" is intended to cover any piece = of music=20 that may or may not include a vocal element. It in particular covers = dance music=20 which is best characterised by a repetitive beat, but also covers other = types of=20 music including rock and pop music. An individual song, is referred to=20 hereinafter as a "track", whilst a selection of individual songs played = one=20 after another in a (usually) continuous sequence is referred to as a = "mix". The=20 term "event" used herein may comprise a dance held in a nightclub or at = a=20 private party or function room, or perhaps an outdoor event such as a = garden=20 party or festival.

The dance culture is increasing in popularity = both in=20 the United Kingdom and overseas. Perhaps the most important element in = the=20 success of the dance culture is the DJ--the person who selects the = tracks, and=20 the order in which the tracks are played in the mix. In some case the = DJ's are=20 becoming as famous as the recording artists themselves. Nightclubs often = establish their reputations on the basis of their choice of DJ, and = popular DJs=20 often have their own devout following of loyal supporters.

The = DJ builds=20 his or her reputation both on their musical taste and as importantly on = their=20 ability to change the tracks they are playing in response to the = reaction of the=20 crowd. For instance, if a fast tempo record is played and the crowd = react=20 favourably the DJ may follow the track with another fast tempo track. If = a slow=20 tempo track is played and the DJ sees that a large number of members of = the=20 crowd leave the dance floor then the DJ may return to playing fast tempo = tracks.=20 Of course, this is a very simplistic view and the DJ needs to rely on an = innate=20 ability both to monitor the behaviour of the crowd in order to react to = their=20 demand but also to select tracks which directly influence the behaviour = of the=20 crowd.

At present, if a person at an event wants to influence = the DJ=20 they must leave the dance floor to approach the DJ and ask if they will = take=20 requests for tracks. This is possible at smaller events such as a = private party=20 or wedding. In larger events this is impractical and the DJ will choose = tracks=20 by looking at the overall reaction of a crowd. Only the people nearest = the DJ or=20 within line of sight will generally have a real influence. A person who = wishes=20 to dance out of sight of the DJ or listen from a part of the event away = from the=20 dance floor will therefore have little ability to influence the choice = of tracks=20 played.

BRIEF SUMMARY OF INVENTION

In accordance with a = first=20 aspect the invention provides a portable apparatus for monitoring the = reaction=20 of a user to a performance, the apparatus comprising: one or more = sensors=20 adapted to detect one or more sensor signals together constituting an = indirect=20 user response to the performance; a user interface adapted for the user = to=20 provide a direct user response to the performance; a processor adapted = to=20 provide a user reaction signal comprising a combination of the indirect = user=20 response and the direct user response to the performance; and a = transmitter,=20 whereby the processor is adapted to control the transmitter to transmit = the user=20 reaction signal to remote apparatus.

The portable apparatus of = the=20 invention therefore monitors the reaction of a user to the music played = at an=20 event and communicates this reaction to a remote apparatus so providing = the user=20 with the ability easily to communicate his or her reaction during the = event.=20

By portable we mean a device which can be worn or carried by the = user,=20 which is typically battery powered. It may be a wearable device, perhaps = comprising a pendant which can be worn on a chain around the neck of a = user. It=20 is also envisaged that in a most preferred arrangement it may comprise a = device=20 which is attached to the wrist of a user. It may form a part of a = wristwatch.=20

According to a second aspect the invention provides a system for = monitoring the response of users to a performance, comprising: two or = more=20 portable apparatuses for monitoring the reaction of a user to a = performance,=20 each such apparatus comprising one or more input devices each for = obtaining a=20 direct or indirect user response to the performance, a processor adapted = to=20 provide a user reaction signal from the user responses, and a = transmitter,=20 whereby the processor is adapted to control the transmitter to transmit = the user=20 reaction signal to a central monitoring apparatus; and a central = monitoring=20 apparatus having a receiver and a processor adapted to receive user = reaction=20 signals from the receiver and to combine them into an audience reaction = signal.=20

The apparatus is suitable for installation at an event, such as=20 installation within a nightclub. The monitoring apparatus preferably = includes a=20 plurality of portable devices, perhaps tens or hundreds of devices = depending on=20 the size of the crowd.

In accordance with a third aspect the = invention=20 provides a music playing system comprising: a plurality of inputs to = receive=20 input signals containing information indicating the reaction of a user = to a=20 song; memory storing a plurality of song elements; and selection means = adapted=20 to select at least one song element or combination of song elements from = the=20 memory to be played, in which the selection means is adapted to select = the song=20 element from memory in response to the input signals.

In = accordance with=20 a fourth aspect the invention provides a data carrier having encoded = therein a=20 computer program comprising a set of instructions adapted to program the = processor of a handheld computing device to monitor the reaction of a = user to a=20 performance, the programmed processor being adapted to provide: a user = interface=20 adapted for the user to provide a direct user response to the = performance; a=20 user reaction signal derived from the direct user response to the = performance;=20 and a transmission of the user reaction signal through a communications=20 interface of the handheld computing device to specified remote = apparatus.=20

A wide variety of handheld computing devices, particularly = handheld=20 personal computers and personal digital assistants (PDAs) are known in = the art=20 which may be adapted through the use of a suitable set of program = instructions=20 to provide a portable device that monitors users reactions. The HP = Jornada is an=20 example of a handheld personal computer, whereas the Palm Pilot family = of=20 devices are examples of PDAs.

BRIEF DESCRIPTION OF THE DRAWINGS=20

There will now be described, by way of example only, one = embodiment of=20 the present invention with reference to the accompanying drawings of = which:=20

FIG. 1 is a perspective view of a portable device in accordance = with the=20 present invention;

FIG. 2 is a schematic illustration of the = functional=20 components of the device of FIG. 1;

FIG. 3 is a schematic = overview of a=20 monitoring apparatus installed at an event which includes a remote = device that=20 receives signals from the portable device of FIG. 1; and

FIG. 4 = is a=20 schematic overview of an automatic DJ apparatus using a monitoring = apparatus of=20 the kind shown in FIG. 3 together with additional ambient sensor = devices.=20

DETAILED DESCRIPTION OF THE INVENTION

Embodiments will = now be=20 described of portable devices for monitoring audience member reactions = to=20 performances, of monitoring systems for receiving audience reactions = both=20 directly (from, for example, interactively through such portable = devices) and=20 indirectly (by monitoring of the environment, or by monitoring = parameters of=20 individual or multiple audience members), and of automatic performance=20 generating apparatus (specifically automatic DJ apparatus) using the = results of=20 such monitoring. Although the embodiments here are focussed upon dance = music and=20 the role of the DJ, it will be appreciated that the principles described = here=20 can readily be employed in connection with other types of performance.=20

The portable device 1 illustrated in FIG. 1 of the accompanying = drawings=20 comprises a main body 2 that is generally rectangular. Two halves 3,4 of = a strap=20 extend from opposing sides of the main body 2. One half of the strap is = provided=20 with a buckle 5 whilst the other half includes a series of holes 6a, 6b = that=20 pass through the strap. The buckle 5 permits the two halves of the strap = 3,4 to=20 be securely joined so that the device can be strapped to the wrist of a = user. In=20 an alternative construction not shown in the drawings, the main body may = be=20 supported by a length of chain which permits it to be worn around the = neck of a=20 user.

The main body 2 carries on its front face a display panel = 7 which=20 comprises a rectangular liquid crystal display panel. The panel = comprises a=20 matrix of liquid crystal elements which can be selectively controlled to = display=20 a range of alphanumeric characters on the display. It is also configured = to=20 display a range of predefined icons (not shown). It may be backlit for = use in=20 low levels of ambient light.

The device 1 can be used to provide = a=20 direct audience member response to the music currently or recently = playing.=20 Alongside the display panel 7 the main body carries two input buttons = 8,9 (an=20 alternative would be for display panel 7 to be touch-sensitive, and for = buttons=20 8,9 or similar inputs to be provided as virtual buttons through the = display=20 panel in known fashion for touch-sensitive displays). The buttons 8,9 = can=20 individually be operated by the user to input a response to the device = 1. In=20 use, the display 7 prompts the user for an input and displays the = function of=20 each button. Changing the display permits the function of each button to = be=20 varied. The display 7 tells the user the function of each button at any = moment=20 in time. A shown in FIG. 1, the display shows a letter "P" next to a = first one=20 of the buttons and a letter "N" next to the other. This indicates the = user=20 should press the first button 8 if they are enjoying an event (positive=20 reaction) and the second button 9 if they dislike the event (negative = reaction).=20 The exact letter or words displayed for a given function will depend to = a large=20 extent on the target audience of users for the device.

As well = as or in=20 an alternative to a simple button, an input device may be provided which = can be=20 set to any one of a range of positions by the user, each position = corresponding=20 to a different reaction of the user. For instance, a rotary dial or = linear=20 slider may be provided. The position of the dial or slider at one = extreme of its=20 range of positions may correspond to most positive (very happy). As the = dial or=20 slider is moved to the other extreme of its range of positions it may = move=20 through slightly positive (less happy) to slightly negative reaction = (unhappy)=20 and at the other extreme indicate a very negative reaction (very = unhappy) of the=20 user.

A positive reaction is indicative that the user is = enjoying the=20 song and a negative reaction indicates that they dislike the song. Of = course,=20 the reaction is relative and it may be that a user experiences a = negative=20 reaction to their favourite song simply because it is played at the = wrong time=20 at the event or because they are not in the mood to listen to that song. =

The display 7 also shows contextual information to the user. As = shown in=20 FIG. 1 the device is telling the user the time in the top half of the = display 7=20 and so functions as a wristwatch. A button 10 on the side of the main = body=20 allows the user to adjust the settings of the device.

The = display may=20 prompt the user to input information using the or each input device. = This allows=20 the function of an input device to be varied, with the display telling = the user=20 the function of the input device at any given instant. For example, the = display=20 may prompt the user to press a particular button if they like a song, or = to=20 press it twice in succession if they want to hear a faster song or press = a=20 different button to hear a slower song. Later in an event, the display = may=20 prompt the user to press the button twice for a slower song, thus = altering its=20 use. Such change in function can be triggered by the DJ, for example, if = the=20 device 1 contains not only a transmitter but also a receiver that allows = it to=20 receive instructions as well as provide user reaction signals. =

Device 1=20 need not be specially constructed for use as a monitoring device. A = particularly=20 effective solution may be to program an existing handheld computing = device, such=20 as a handheld personal computer, a personal digital assistant (PDA) or a = cellular telephone. In such cases, the user interface choices will be = those=20 appopriate to the computing device concerned--for a PDA, for example, = which will=20 normally have a touch-sensitve screen, it may be advantageous to use = virtual=20 buttons of the kind described above.

A direct user response to = the=20 performance can thus be provided through the user interface of device 1. = However, device 1 can also be used to provide an indirect user response = by=20 monitoring the users state of well being or physical behaviour. Device 1 = therefore further comprises one or more sensors which each sense a = parameter of=20 the users state of well being or physical behaviour, the parameter being = indicative of the reaction of the user to a song.

The main body = of the=20 device also includes a small microphone (not shown) which receives = acoustic=20 signals through a small grille opening 11 in the front face of the main = body 2.=20 This microphone can therefore sense sounds provided by the user. This = microphone=20 can be used for direct user input (essentially a speech user interface = for=20 device 1) but can also be used for indirect user input--detecting = particular=20 sounds, or words, produced by the user or in his or her vicinity. =

Where=20 speech is to be evaluated the device 1 should include a = voice-recognition=20 circuit. This may, for example, be adapted to detect one or more = keywords spoken=20 by the user. A negative response signal may be produced for one keyword = and a=20 positive signal for a different keyword. The voice recognition circuit = may be=20 trained to identify the user's voice and may have stored in memory = examples of=20 the or each keyword as spoken by the user. These may be entered into the = memory=20 in a training mode before the device can be used. The voice recognition = circuit=20 then looks for the presence of parts of the signal produced by the = microphone=20 which match the keywords stored in memory. Voice recognition is already = known in=20 the art and the reader is directed to the teachings of the voice = recognition=20 circuit used in prior art mobile phones as an example of the = implementation of=20 such a circuit. Voice recognition is of course implementable in software = once=20 the voice has been translated into an appropriate digital signal. =

A=20 number of sensors (not visible) are also fitted to an under side of the = main=20 body 2 in contact with the skin of the user. Where the device 1 is a = programmed=20 computing device, these may, for example, communicate with the device 1 = in=20 accordance with its normal arrangements for use of peripheral devices. = Specific=20 types of sensor device and their significance are described below. =

A=20 temperature sensor may be included--if an audience member is dancing=20 enthusiastically, their temperature is likely to be raised.

A=20 perspiration sensor sensitive to the conductivity of an area or point on = the=20 users skin may be included. This can provide an indication of how hard = the user=20 is perspiring. A heavy rate of perspiration may be used to indicate = vigorous=20 dancing indicative of a positive response to a song.

A pulse = rate sensor=20 may also be included--again, a high pulse rate is likely to indicate = energetic=20 dancing and a positive reaction.

It will be appreciated that = monitoring=20 of these features can also in appropriate arrangements allow central=20 determination of whether audience members are at risk of endangering = their=20 health (dangerously high temperatures or pulse rates). There are thus = reasons to=20 make such sensor results centrally available in the reaction signal = provided=20 from device 1 (to provide information centrally that may safeguard user = health)=20 but also not to make such sensor results centrally available (protecting = the=20 privacy of individual users).

Another sensor that may be used is = an=20 inclinometer or an accelerometer which is adapted to produce an output=20 indicative of movement of the portable device. The movement of the = device can be=20 used to measure the reaction of the user. If the user is dancing = vigorously the=20 device will move around a lot which will indicate the user is reacting=20 positively to a song. If the user is still the output may be interpreted = as=20 indicating that the user is reacting in a less positive way to a song.=20

The device 1 contains a microprocessor and a memory. The = microprocessor=20 receives the user reaction signals (whether from the user interface or = from=20 sensors) and provide a user reaction signal or signals as output. The=20 microprocessor has access to an area of memory where program instruction = s and=20 data are stored.

As discussed above, the output signal may = contain=20 sufficient information for the value of each reaction signal to be = extracted.=20 Thus, the reading of a pulse sensor and the reading of a temperature = sensor may=20 be individually extracted from the output signal.

Alternatively, = the=20 processor may be adapted to combine one or more reaction signals to = produce a=20 combined output signal from which the individual values of the reaction = signals=20 cannot be extracted. The combined output signal may encode a single = overall=20 reaction value, which may be equal to an average reaction of the user = when=20 considering the average of the reaction signals. The combined reaction = value may=20 be displayed on the display of the portable device if a display is = provided. The=20 user may indicate whether or not they agree with the displayed value.=20

The amount of processing performed by the processor to produce = the=20 output signal will vary from application to application and will depend = on the=20 amount of post-processing that is performed by any central device to = which the=20 output signal is transmitted and on the type of monitoring included in = the=20 device.

If a number of sensors are provided, the processor may = apply a=20 set of logical rules to the output of each sensor in order to provide an = overall=20 reaction measurement that can be encoded in the output signal. =

For=20 instance, if an inclinometer or accelerometer is provided it may produce = an=20 output signal indicating that the user is not moving. If no other = sensors or=20 inputs are available this may be interpreted as representing a negative = reaction=20 of the user (they are not dancing so probably dislike a song). If, on = the other=20 hand, an input device is operated by the user and produces an output = indicating=20 that the user likes the song then the output of the accelerometer may be = overridden and ignored. The user may simply be tired or just standing = still=20 while listening to the song.

The logical rules may define the = way in=20 which the reaction signals provided are combined, and which take = preference over=20 others.

FIG. 2 of the accompanying drawings is a schematic = illustration=20 of the circuitry and components located within the main body of the = device=20 illustrated in FIG. 1 of the accompanying drawings.

The main = body 2=20 houses a printed circuit board 20 which carries tracks defining an = electronic=20 circuit. One of the tracks 21 is connected to the positive side of a = battery 22=20 whilst another track 23 is connected to the negative side of the battery = 22.=20 This provides the power that is drawn by the circuitry.

The = buttons=20 8,9,10 on the main body 2 are also connected to tracks on the circuit = board and=20 the display panel 7 is connected to a multi-pin socket 24 which is = soldered to=20 one face of the board 20. The sensors (represented by block 27) are also = connected to the processor.

The tracks connected to the buttons = 8,9,10=20 are connected to the input terminals of a processor 25. The processor 25 = has=20 access to a memory (not shown). An output terminal of the processor is = connected=20 through additional tracks on the circuit board 20 to a display driver = device=20 (not shown) which is in turn connected to the display socket 24. Another = output=20 from the processor is connected to a wireless radio transmitter 26. The=20 transmitter 26 sends encoded signals from the device to a remote device = located=20 at the event. The processor encodes the transmitted signal with = information=20 obtained by the sensors and the buttons. An identification code to = identify the=20 originating device 1 may also be included. The transmitter may use any=20 appropriate technology--radio-frequency communication is a particularly=20 appropriate technology, and infra-red communication is a possible = alternative.=20

Different approaches may be adopted to providing information = from=20 audience members. The device 1 may continuously transmit a current = reaction=20 signal, or may transmit a signal at spaced time intervals. For example, = a signal=20 may be transmitted as a packet of encoded data at 1 second, or perhaps 1 = minute=20 or perhaps 5-minute intervals.

In an alternative arrangement, = the=20 portable device may only transmit a signal to the remote apparatus in = response=20 to a request from the remote apparatus. This helps to preserve the = battery life=20 of the portable device. It also allows a user to wear or carry the = device at all=20 times, signals only being transmitted when it is used at an event where = an=20 appropriate remote device is located. A further advantage of this mode = of=20 operation is that the user does not need to remember to switch the = device on at=20 the start of an event and off again at the end of the event.

The = memory=20 may also be used to store the response of the user between the = transmission of=20 signals to the remote device. The stored responses may be displayed by = the user=20 on an appropriate display provided on the portable device.

The = output=20 signal sent to the remote device may encode the response of the user in = a number=20 of ways. In one arrangement, the signal may encode a simple digital or = analogue=20 response value which may vary between an upper and a lower limit, one of = the=20 limits indicating a positive reaction and the other a negative reaction. = The=20 value may vary linearly between the extremes of the range to indicate = any degree=20 of reaction between very positive and very negative.

A positive = reaction=20 is indicative that the audience member is enjoying the song or mix of = songs=20 played at the event and a negative reaction indicates that he or she = dislikes=20 the song or mix of songs. Of course, the reaction is relative and it may = be that=20 an audience member (or as will be discussed below, a crowd) experiences = a=20 negative reaction to their favourite song simply because it is played at = the=20 wrong time at the event or because they are not in the mood to listen to = that=20 song. The reaction may indicate the member's preferences for the choice = of songs=20 subsequently to be played at the event. A positive reaction may also = indicate=20 that a person at the event likes the change from one song to the next at = the=20 event.

In a further refinement it is envisaged that the user may = operate=20 an input device, such as button, to indicate that they want to = "bookmark" a song=20 that is playing, the portable device storing in memory data representing = a=20 feature of the song. This may comprise a short recording of the song = obtained by=20 a microphone built into the device, or a time-stamp which allows the = user to=20 identify the song at a later time from a playlist of the event. =

The=20 portable device 1 is intended to be used in combination with a remote = detection=20 apparatus located at the event. FIG. 3 of the accompanying drawings = illustrates=20 schematically a simple system suitable for installation in a night club = which=20 hosts a dance event. The remote apparatus comprises a central processing = unit 30=20 which will usually be fixed on site and provided by the host of the = event or the=20 DJ to help gather information from people at the event. Connected to the = central=20 processing unit by electrical cables are two remote devices 31,32 which = monitor=20 and detect signals transmitted by portable devices 1 within the club. In = fact,=20 the monitoring apparatus receives signals from every device present at = the=20 event.

Each detection unit 31,32 comprises a radio frequency = detector=20 which detects the signal emitted by any portable devices 1 within its = detection=20 range. An amplifier increases the amplitude of the detected signals and = passes=20 the signals to a processor. The processor extracts the information = encoded in=20 each signal and produces an output signal which is passed down the = electrical=20 cable to the main processing unit 30.

One of the remote devices = 31 is=20 located in a part of the nightclub containing a dance floor 33 within = range of=20 any portable devices worn by users on the dance floor. The other device = 32 is=20 located in a different area of the nightclub, such as in a "chill-out" = room or=20 eating area 34. This device only detects signals from portable devices = worn by=20 occupants of the room.

The main processing unit 30 receives = signals=20 along the two cables from each of the detectors 31,32. The signals = provide the=20 processor with information about the location of the wearer of a = portable device=20 and also the reaction of the wearer to the music that is played. The = amount and=20 type of data received depends on the content of the signals transmitted = by the=20 portable devices. It is envisaged that some devices may transmit more = types of=20 information than others, i.e. some may have increased functionality = compared=20 with other devices.

The device 1 may be adapted to receive, as = well as=20 to transmit, information. The device 1 may also include a detector which = is=20 adapted to receive a signal transmitted by a remote device. The = information=20 encoded in the signal may be processed by the processor. It may be used = to=20 change the function of any input devices on the portable device, or to = display=20 messages or instructions on the display (where provided).

The = remote=20 device could, for example, send a request by a DJ or club owner to each = or an=20 individual portable device to ask the user for a specific reaction to a = song.=20 For example, the user may be asked if the tempo of the song playing is = too fast=20 or too slow, or if the music is too loud or quite. This provides a full=20 interaction between the DJ and a user of a portable device.

A = display=20 may be provided at the event upon which information can be presented by = the user=20 of the portable device. A DJ could, for example, ask the user a question = such as=20 "Do you like this song?" The reaction of the user to the question can = then be=20 monitored.

The portable apparatus thus monitors the reaction of = the user=20 and transmits a signal to a remote device which can be adapted to select = the=20 next or any other subsequent track to be played in dependence upon the = users=20 response. This allows the user to interact with the tracks played and = influence=20 the course of the event.

The data received by the processing = unit 30 is=20 stored in a memory 35 and can subsequently be used to produce a control = signal=20 which is used either by a human DJ or an automatic DJ apparatus 36 to = influence=20 the next or subsequent tracks that are played at the event. For example, = if a=20 number of signals are received from portable devices asking for the = track to be=20 changed then the track may be changed by the DJ before it would normally = end. If=20 a large number of requests for a faster tempo track are received then = the music=20 may be changed accordingly.

By choosing which song to play in = response=20 to the crowd reaction, the mix can automatically be tailored in order to = follow=20 the wishes of the crowd. In effect, control of the mix is at least = partially=20 handed over to the people in the crowd and it is the reaction of the = crowd that=20 determines which tracks are played. Every event may therefore be unique = to the=20 crowd's preferences.

Such monitoring apparatus can thus be used = as a=20 tool to assist a DJ by selecting tracks from the memory but leaving the = DJ to=20 confirm whether or not to play the selected track. For instance, this = gives the=20 DJ extra feedback about the crowd reaction and can assist both skilled = and=20 inexperienced DJs alike in pleasing the crowd. However, this type of = monitoring=20 apparatus is especially useful in providing a quantified audience = reaction to an=20 automatic DJ adapted to reproduce the function of a human DJ. =

The=20 apparatus illustrated in FIG. 4 shows the integration of user devices as = shown=20 in FIGS. 1 and 2 with environmental monitoring to provide a = comprehensive=20 monitoring system used to provide user input to an automatic DJ system. = The=20 system is installed in a hypothetical small nightclub 101 having a = single dance=20 floor 102 and a chill-out room/bar area 103. The apparatus monitors the = reaction=20 of people in the club to the songs that are being played. It = automatically=20 selects songs to be played in response to the monitored reactions of the = people,=20 replacing the traditional human DJ at the club.

The apparatus = comprises=20 a centrally located automatic DJ 104 which is partially housed within a = secure=20 booth adjacent the dance floor 102 inside the nightclub 101. The = automatic DJ=20 104 comprises a selection apparatus 105 and a monitoring apparatus (part = of=20 which is housed in the booth). The selection apparatus 105 selects the = songs,=20 which are played in response to crowd reaction signals supplied to the = selection=20 apparatus by the monitoring apparatus.

The monitoring apparatus=20 comprises a centrally located processing unit 106 located within the = secure=20 booth. This may be provided by a microprocessor, which forms a part of a = personal computer, or may be a dedicated processing device. The = monitoring=20 apparatus is here shown as separate from the automatic DJ 104, but it = will be=20 appreciated that these can be integrated together, and may operate under = the=20 control of a common processor.

Connected to the processing unit = 106 by=20 electrical cables 107 are a range of sensing devices which are spaced = around the=20 nightclub. If preferred, a wireless link may be provided between each = sensing=20 device and the processor.

Many differing types of sensing device = can be=20 employed, as there are many types of behaviour which may be monitored to = indicate the reaction of a crowd. These may include, but are not limited = to:=20

Sensors that monitor the number of people dancing to a song,=20

Sensors that monitor the number of people on a dance floor,=20

Sensors that monitor the temperature at the event, =

Sensors that=20 monitor sound or gestures made by people at the event,

Sensors = that=20 directly receive answers to questions asked to people at the event, i.e. = "is=20 this too slow/fast, are you tired etc"

The more sensors and the = more=20 parameters monitored the more reliable an estimate of the reaction of = the crowd=20 to the event can be produced.

Each sensing device produces an = electrical=20 output signal which can be used to estimate the reaction of people = present in=20 the club to the songs that are being played. These raw output signals = are=20 encoded in signals sent along the cables to the central processor. The = processor=20 106 extracts the information encoded in each signal and produces one or = more=20 crowd reaction signals.

In the example shown in FIG. 4 several = different=20 sensing devices are located in a part of the nightclub containing a = dance floor.=20 Other devices are located in a different area of the nightclub, such as = in a=20 "chill-out" room or eating area.

Different types of sensing = device used=20 or usable in the FIG. 4 embodiment will now be discussed.

A = dance floor=20 sensor is adapted to monitor people on a dance floor at the event. Such = a dance=20 floor sensor may generate an output signal dependent upon the presence = of or the=20 behaviour of the people on the dance floor. One such sensor is the array = of=20 independent pressure sensors 108 which may be located on, within or = below the=20 surface of the dance floor, covering the whole of or a portion of the = dance=20 floor. For example, an array of 6-inch square pressure sensors may be = provided=20 which cover an entire area of the dance floor.

The pressure = sensors may=20 produce a binary output signal having a first value if a person stands = or sits=20 or lies on the sensor and a second value otherwise. Alternatively, the = pressure=20 sensors may produce an output signal which indicates the actual pressure = applied=20 to a sensor at any time. This permits more sophisticated monitoring.=20

Where a number of dance floors are provided at an event, such as = in a=20 large nightclub, each floor or a subset of the total number of floors = may be=20 provided with at least one dance floor sensor.

A digital video = camera=20 109 is adapted to capture a digital image of at least a portion of a = dance=20 floor, and has associated with it an image processor adapted to process = the=20 digital image to identify the number of people present in the captured = image=20 and/or the behaviour of those people. This is preferably a thermal = imaging=20 camera but may alternatively or additionally comprise a video camera. =

At=20 many events, in order to create the correct ambience the dance floor may = be=20 poorly lit. This makes it difficult for a video camera to capture a = satisfactory=20 image and also makes it difficult to process the image. A thermal = imaging camera=20 may be preferred in such an environment.

The number of people on = the=20 dance floor may be estimated from the average temperature of an entire = image or=20 by identifying individual people from the features of the image. An = estimate=20 based on an average may prove reasonably accurate as the larger the = number of=20 people the greater the temperature of the crowd/room is likely to be.=20

Where a video camera is provided, a laser may be provided which = emits a=20 pattern of light towards the dance floor captured in the video image, = the image=20 processing means monitoring the pattern of the light from the laser in = the image=20 to detect the presence of people in the image.

A microphone 110 = or other=20 acoustic sensor is adapted to detect sounds which are produced by people = at the=20 event. The sound of the song which is being played at the time of = measurement=20 may be subtracted from the output signal from the or each microphone to = isolate=20 the sound made from the people at the event from the music.

This = sensor=20 may enable production of a crowd reaction signal which has a value = dependent=20 upon the amplitude of the sound made by the people in the crowd. For = example,=20 the crowd reaction signal may indicate a positive crowd reaction if the = crowd=20 are making a lot of noise and a negative reaction if the crowd are = silent. The=20 louder the crowd the more positive a crowd reaction signal may be = produced.=20

In a more sophisticated embodiment, the type of sound produced = by the=20 crowd may be used to determine the reaction of the crowd. The type of = sound may=20 be monitored by appropriate signal processing of the output of the or = each or=20 selected ones of the acoustic sensors/microphones.

A crowd = reaction=20 signal indicative of a positive crowd reaction may be generated if the = output of=20 the microphone has a large high frequency content relative to its low = frequency=20 content. This type of sound corresponds to whistling and screaming.=20

Similarly, a crowd reaction signal indicative of a negative = reaction may=20 be generated if the output of the microphone has a small high frequency = content=20 relative to its low frequency content. This corresponds to a crowd = booing or=20 shouting.

A temperature sensor 111 is adapted to monitor the = temperature=20 at the event. The more people who are on a dance floor the higher the=20 temperature. Similarly, the more people enjoy a track the more energetic = their=20 dancing will become.

The temperature sensor may, for example, = comprise=20 an infrared sensor or a thermal imaging camera. The images captured by a = thermal=20 imaging camera may be analysed by an image processor to determine the = body=20 temperature of one or more people at an event, and especially of one or = more=20 people on a dance floor. Alternatively, as suggested hereinbefore an = average=20 temperature for a whole or portion of a captured thermal image may be = used.=20

A crowd reaction signal may be produced which is indicative of a = positive crowd reaction if the temperature is increasing or exceeds a = predefined=20 threshold, and indicate of a negative reaction if the temperature drops = or is=20 below the threshold.

In a sophisticated system, the output of = the=20 temperature sensor may be cross-correlated with a measurement of the = number of=20 people on the dance floor and/or the type of song that is being played.=20

A humidity sensor may be provided which is adapted to monitor = the amount=20 of moisture in the air. This may be located inside or in front of a duct = through=20 which an air conditioning unit extracts air from around a dance floor. = It is=20 expected that the humidity will be higher when lots of people are = dancing=20 vigorously and this can indicate a positive crowd reaction.

Of = course,=20 in other embodiments a smaller range of sensors may be provided whilst = in larger=20 nightclubs more sensors may be desirable. A digital video camera 112 is = also=20 provided in the chill out room which captures images of the room. =

Of=20 course, the presence of a large number of people on a dance floor does = not=20 necessarily provide a complete picture of crowd reaction. The behaviour = of the=20 people on the dance floor is also an indication of whether or not they = are=20 enjoying the event.

The dance floor sensors may be adapted to = monitor at=20 least one aspect of the behaviour of the portion of the crowd. This may = be=20 adapted to monitor how vigorously the people are dancing by monitoring a = pattern=20 of movement of an individual or a crowd.

Where pressure sensors = are=20 provided, the rate of change of the output signal from the or each = sensor may be=20 used to provided an indication of the movement of the people on the = dance floor.=20 For example, if everyone is stood still the sensors will detect the = presence of=20 the people but the output of the sensors will remain reasonably = constant. If=20 everyone is jumping in time to a track, the output of the sensors will = vary in=20 time with the jumping of the crowd.

The variation in the output = of the=20 pressure sensors over time may be detected and used. For example, this = may be=20 used to distinguish between vigorous dancing and a mass exodus of the = dance=20 floor. It is expected that these two different types of movement will = have=20 unique time-signature patterns allowing them to be distinguished. A = neural=20 network algorithm that is trained to distinguish positive reaction = movement=20 patterns from negative patterns of movement may be used in association = with main=20 processor 106.

The main processor 106 also receives signals from = a=20 number of remote devices which are worn or carried by people 112 in the=20 nightclub. These devices, which may be of the type shown in FIGS. 1 and = 2,=20 monitor the users reaction and transmit information wirelessly to = receivers 113=20 located next to the dance floor or a receiver in the chill out room. The = receiver sends the received signals back to the processor 106. =

The data=20 received by the processor 106 is stored in an area of electrical memory=20 connected to the processor.

The processor produces one or more = crowd=20 reaction signals from the information contained in the output signals = produced=20 by each of the sensing devices. For the sensors provided in the example, = the=20 processor initially generates a crowd reaction signal for each received = signal.=20

Simple examples of logical rules for producing reaction signals = that can=20 be applied are as follows:

If the pressure sensors and/or the = camera=20 indicate a large number of people are present on the dance floor then = the=20 reaction to the currently playing song can be considered positive--they = like the=20 song;

If the pressure sensors and/or the camera indicate that a = large=20 percentage of the people on the dance floor are dancing then the = reaction may be=20 considered to be positive;

If the sensors indicate that the = ratio of=20 people on the dance floor to people in the chill-out room is low then = the=20 reaction may be considered negative;

If the sensors indicate an = increase=20 in the number of people on the dance floor over time then the reaction = may be=20 considered positive;

If the sensors indicate a decrease in the = number of=20 people on the dance floor over time the reaction may be considered to be = negative;

A positive reaction may be generated if the number of = people=20 on the dance floor exceeds a predetermined threshold. Conversely, if the = number=20 of people falls below the threshold the crowd reaction signal may = indicate a=20 negative reaction. The value of the threshold may be varied as a = function of a=20 parameter of the event. For instance, if the event is a dance at a = nightclub a=20 different threshold may be used for different nights of the week. For = regular=20 events, the value of the threshold may be adjusted by monitoring the = number of=20 people on the dance floor over a number of events and calculating an = average=20 value, the threshold corresponding to the calculated average value. The=20 threshold may also be adjusted as a function of the total number of = people at=20 the event.

If the temperature on the dance floor is increasing = this may=20 be used to indicate a positive reaction (more heat equals more people or = more=20 vigorous dancing).

The value of the crowd reaction signal may be = scaled=20 by a scaling factor to take into account parameters such as the time of = day, day=20 of the week, or the time since the start of the event. For instance, a = greater=20 percentage should be on the dance floor at the middle of an event than = at the=20 start of the event. Other context information such as the time of = day/night, day=20 of the week etc. can be employed.

Having produced a number of = crowd=20 reaction signals, the processor then applies a number of logical rules = to the=20 individual crowd reaction signals to produce an overall crowd reaction = signal.=20 For example:--

If the number of people on the dance floor is = high=20 (indicated by the pressure sensors) but they are not moving much = (indicated by a=20 low temperature) the reaction is considered slightly positive. If they = are=20 moving a lot then a very positive overall reaction signal is generated.=20

If the number of people on the dance floor is high and they are = moving a=20 lot but the crowd reaction signal produced from the output of a = microphone is=20 negative (perhaps because the crowd are booing or hissing) then the = microphone=20 reaction signal will dominate and a negative overall reaction signal = value will=20 be produced.

Having produced an overall crowd reaction signal = the=20 processor passes the signal to the selection means. The selection means = (most=20 obviously implemented as a processor operating under appropriate program = control) is adapted to select a song to play in the nightclub from a = large=20 collection of tracks stored in the memory. An index list is also stored = in the=20 memory which comprises at least one classification value for each stored = track.=20 For instance, the index for a track may indicate the tempo of the track, = how the=20 tempo changes during the duration of the track etc.

The = selection means=20 may generate a selection value from the one or more control signals and = select a=20 track to play from the memory by comparing the selection value with the = index=20 for a stored track. For example, the selection value may comprise a = tempo value,=20 and a track having an index representing that tempo may be selected. If = a number=20 of tracks are stored in memory which match the criteria of the selection = value=20 then the track may be selected at random from all the possible matches.=20

The selection means processes the crowd reaction signal together = with=20 historical data corresponding to the current playing song and previously = played=20 songs. In this simple example, the historical data indicates the tempo = of the=20 current playing song and the tempo of the song prior to it. Logical = rules are=20 then applied to the historical data and the crowd reaction signal value = to=20 determine the tempo of the next song that should be played.

The = logical=20 rules may include the following: If, when the automatic DJ increases the = tempo=20 of the songs by cross-fading to a new song faster than the previous song = a=20 positive crowd reaction is identified then the automatic DJ should = ensure that=20 the tempo continues to increase by selection of a faster tempo track or = stays=20 the same; If, when the automatic DJ increases the tempo of the songs by = cross=20 fading to a new song faster than the previous song a negative crowd = reaction is=20 identified then the automatic DJ should ensure that the tempo decreases = by=20 selection of a slower tempo track; If, when the automatic DJ deceases = the tempo=20 of the songs by cross-fading to a new song slower than the previous song = a=20 positive crowd reaction is identified then the automatic DJ should = ensure that=20 the tempo continues to decease by selection of a slower tempo track or = stays the=20 same; If, when the automatic DJ decreases the tempo of the songs by = cross-fading=20 to a new song slower than the previous song a negative crowd reaction is = identified then the automatic DJ should ensure that the tempo is = increased by=20 selection of a faster tempo track.

Having determined the tempo = of the=20 next song to play the selection means chooses a song from the memory = using the=20 index list to ensure it has the required tempo. If more than one track = meets the=20 criteria a track may be picked at random from all the matches. =

The=20 selection means also writes to the memory a set of reaction marker = values, each=20 value being associated with a played track and indicating whether or not = it=20 generated a positive or a negative crowd reaction. When subsequently = choosing=20 between tracks that meet the tempo criteria, the track with the most = positive=20 reaction marker value associated with it may be selected.

The = marker=20 values may be updated each time a track is played and the reaction of = the crowd=20 is monitored. For example, the marker value may comprise an average = reaction=20 value determined once the track has been played a number of times at an = event.=20

The apparatus may be adapted to delete a track from the memory = if the=20 marker value associated with the track is indicative of a very unpopular = track.=20 A marker may indicate such a low popularity if it corresponds to a track = that=20 has been played a predefined number of times and has a popularity below = a=20 predefined threshold.

The selection apparatus may also be = arranged to=20 control other aspects of the event such as the volume of the songs that = are=20 played and the pattern and intensity of lighting used at the event, = smoke=20 machines or foam/bubble generators etc.

The discussion aboves = relates=20 essentially to musical performance, but it will be appreciated that = other forms=20 of performance can be modified in the same way. For example, visual art = can be=20 created according to rules and modified according to user reaction to = the=20 current form of the art--this could apply to static or video images. =

In=20 a modification (again most obviously applicable to music but potentially = applicable to other forms of performance), the remote device may not = affect the=20 tracks being played or to be played but instead store the users = reactions during=20 at least a portion of the event together with information about the = tracks=20 played in that portion of the event. The remote device may select the = tracks=20 which generated the most positive reactions from the user, and copy the = selected=20 tracks to a storage medium. This medium may be a web page or a compact = disc or=20 minidisc. The site can then be viewed by anyone after the event, or the = CD may=20 be sold to the crowd at the end of an event.

* * * * *
3D[Image]=20
3D[Home]=20=20 3D[Help]=20=20
------=_NextPart_000_00A4_01C79D5C.82526B20 Content-Type: image/gif Content-Transfer-Encoding: base64 Content-Location: http://patft.uspto.gov/netaicon/PTO/patfthdr.gif R0lGODlh9AEeAPcAAAAAAAAAMwAAZgAAmQAAzAAA/zMAADMAMzMAZjMAmTMAzDMA/2YAAGYAM2YA ZmYAmWYAzGYA/5kAAJkAM5kAZpkAmZkAzJkA/8wAAMwAM8wAZswAmcwAzMwA//8AAP8AM/8AZv8A mf8AzP8A/wAzAAAzMwAzZgAzmQAzzAAz/zMzADMzMzMzZjMzmTMzzDMz/2YzAGYzM2YzZmYzmWYz zGYz/5kzAJkzM5kzZpkzmZkzzJkz/8wzAMwzM8wzZswzmcwzzMwz//8zAP8zM/8zZv8zmf8zzP8z /wBmAABmMwBmZgBmmQBmzABm/zNmADNmMzNmZjNmmTNmzDNm/2ZmAGZmM2ZmZmZmmWZmzGZm/5lm AJlmM5lmZplmmZlmzJlm/8xmAMxmM8xmZsxmmcxmzMxm//9mAP9mM/9mZv9mmf9mzP9m/wCZAACZ MwCZZgCZmQCZzACZ/zOZADOZMzOZZjOZmTOZzDOZ/2aZAGaZM2aZZmaZmWaZzGaZ/5mZAJmZM5mZ ZpmZmZmZzJmZ/8yZAMyZM8yZZsyZmcyZzMyZ//+ZAP+ZM/+ZZv+Zmf+ZzP+Z/wDMAADMMwDMZgDM mQDMzADM/zPMADPMMzPMZjPMmTPMzDPM/2bMAGbMM2bMZmbMmWbMzGbM/5nMAJnMM5nMZpnMmZnM zJnM/8zMAMzMM8zMZszMmczMzMzM///MAP/MM//MZv/Mmf/MzP/M/wD/AAD/MwD/ZgD/mQD/zAD/ /zP/ADP/MzP/ZjP/mTP/zDP//2b/AGb/M2b/Zmb/mWb/zGb//5n/AJn/M5n/Zpn/mZn/zJn//8z/ AMz/M8z/Zsz/mcz/zMz/////AP//M///Zv//mf//zP///wAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACH5BAEAANcALAAAAAD0AR4A AAj+AK8JHEiwoMGDCBMqXMiwocOHECNKnEixosWLGDNq3Mixo8ePIEOKHEmypMmTKFOqXMmypcuX MGPKnEmzps2bOHPq3Mmzp8+fQIMKHUq0qNGjSJMqXcq0qdOnUKNKnVp0AEOrVDliNbk1YdesYMNe HUDWINmyBM+eLai2LdprbuN2dbtQ7tqqdt+WzKs2a9+efMVm1Jt2bt6BgeHyRXvYa2Oiibku/hqV 8M7IgilaFvj2buHPZst+JWz1L2fPoQ+iVkg5rdeHrRGnVo1y9OjXV1nP3Awz9ubVunHrjA3b91be hhH+bo2ceHO2qyfbPa237+LZjjvfNV2Yt3LKh9v+Upf+3TL3v9MdI+Y+vrtz8e7pqjYemnRk9orl 1jcePX3F59SN9d182BFoYIEBxhdXfvLlB914+j3IloTrgXagQ8steFp3DEY4H3P2KQhcheuBCF5z HvpHIYIOighfgtB5WOKHDao4EYAQApfhhRuqxyOM7blGImeKmVVicnBZmGSMDfY4ZJEDQrSckSRu pyR/JiLpJJBX9mffjl1SyeKTDE745HEjmmebmiuadxGOR5732Ipbjtlhkxt6x6Zs8ZFZ534v1lnd exFNyaeCUdZV2omeDWrnoKixJ9qah2q5ZKIITupjansqWWSIrM01GH2KoikjnVBi6uKeI6YaZ4j+ 24GoqJiCWopqmbdqyOSmPvbXoqO3uqppnkhGahh8uv54JlatGuolnoxBGuidxElJ6qx/YutpsN5R CGeOtgVoKK+qAqssfhnih6uy3obroLl+bhktlObCWyOewQqLpqpOfpmsdky+mOx/117abqGysutq dvguLGy7aVbrcKa2bqvtlYAWTGOg2hn7aLHomXqvkKlWFyqmNv6pYqf+MXrmqC7PyGG2J+/nHrnl NdxppccmjHN9Mqss9M9uJhhxqU1K62mzWjYqMsdqMgsevy2CO+6rHkOcNHZFWzQnZt2yO6ed2+rI 6Mgz50vzqmxT2226yMIbr59Ox9j2hSZXGbOs1R037HbWaZMZNdaxAv333W9Oi+jNGLZ6J9Kh+ss4 31IrPbnNYz1L19iX/72o5UFifuS6uKY8+rpPPyviqln+q/rppJfZmKROy3lqZjZJnFO1usOGu0q9 /06k8MQXb/zxLUmn/PLMN+/889BHL/301Fdv/fXYZ6/99txz3nj34Icv/vjkl2/++einr766yLfv /vvwxy///PTXb//9+Oev//789+///wAMoP8CAgA7 ------=_NextPart_000_00A4_01C79D5C.82526B20 Content-Type: image/gif Content-Transfer-Encoding: base64 Content-Location: http://patft.uspto.gov/netaicon/PTO/home.gif R0lGODlhUAAeAPcAAAAAAAAAMwAAZgAAmQAAzAAA/zMAADMAMzMAZjMAmTMAzDMA/2YAAGYAM2YA ZmYAmWYAzGYA/5kAAJkAM5kAZpkAmZkAzJkA/8wAAMwAM8wAZswAmcwAzMwA//8AAP8AM/8AZv8A mf8AzP8A/wAzAAAzMwAzZgAzmQAzzAAz/zMzADMzMzMzZjMzmTMzzDMz/2YzAGYzM2YzZmYzmWYz zGYz/5kzAJkzM5kzZpkzmZkzzJkz/8wzAMwzM8wzZswzmcwzzMwz//8zAP8zM/8zZv8zmf8zzP8z /wBmAABmMwBmZgBmmQBmzABm/zNmADNmMzNmZjNmmTNmzDNm/2ZmAGZmM2ZmZmZmmWZmzGZm/5lm AJlmM5lmZplmmZlmzJlm/8xmAMxmM8xmZsxmmcxmzMxm//9mAP9mM/9mZv9mmf9mzP9m/wCZAACZ MwCZZgCZmQCZzACZ/zOZADOZMzOZZjOZmTOZzDOZ/2aZAGaZM2aZZmaZmWaZzGaZ/5mZAJmZM5mZ ZpmZmZmZzJmZ/8yZAMyZM8yZZsyZmcyZzMyZ//+ZAP+ZM/+ZZv+Zmf+ZzP+Z/wDMAADMMwDMZgDM mQDMzADM/zPMADPMMzPMZjPMmTPMzDPM/2bMAGbMM2bMZmbMmWbMzGbM/5nMAJnMM5nMZpnMmZnM zJnM/8zMAMzMM8zMZszMmczMzMzM///MAP/MM//MZv/Mmf/MzP/M/wD/AAD/MwD/ZgD/mQD/zAD/ /zP/ADP/MzP/ZjP/mTP/zDP//2b/AGb/M2b/Zmb/mWb/zGb//5n/AJn/M5n/Zpn/mZn/zJn//8z/ AMz/M8z/Zsz/mcz/zMz/////AP//M///Zv//mf//zP///wAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACH5BAEAANcALAAAAABQAB4A AAjaAK9d80CwoMGDCBMqXMiwIUOBAz1AnEixosWLGDNq1Egw4saPIEOKrFhwpMmTKCd2TMmyJUeJ LmPKFLhyps2UNW/qFJlzp8+XJ3v2/Llx6EehMImCNFo0Kc2kByF2LBnRaVSTTIGqhFlzJdWvXKE6 XTqWbMKnUsOmXesR7cisGZG6bdtV7NOrPMseHevVbtu/fVvCxSgXsNq5geeGHHyxcNW6bA1TfatX qWXGJB1q3jyZrOXPFDGDnil6dMzSpgVXTn0TNWuUrl9jjS3bM+3accVy3s27t0KBAQEAOw== ------=_NextPart_000_00A4_01C79D5C.82526B20 Content-Type: image/gif Content-Transfer-Encoding: base64 Content-Location: http://patft.uspto.gov/netaicon/PTO/boolean.gif R0lGODlhUAAeAPcAAAAAAAAAMwAAZgAAmQAAzAAA/zMAADMAMzMAZjMAmTMAzDMA/2YAAGYAM2YA ZmYAmWYAzGYA/5kAAJkAM5kAZpkAmZkAzJkA/8wAAMwAM8wAZswAmcwAzMwA//8AAP8AM/8AZv8A mf8AzP8A/wAzAAAzMwAzZgAzmQAzzAAz/zMzADMzMzMzZjMzmTMzzDMz/2YzAGYzM2YzZmYzmWYz zGYz/5kzAJkzM5kzZpkzmZkzzJkz/8wzAMwzM8wzZswzmcwzzMwz//8zAP8zM/8zZv8zmf8zzP8z /wBmAABmMwBmZgBmmQBmzABm/zNmADNmMzNmZjNmmTNmzDNm/2ZmAGZmM2ZmZmZmmWZmzGZm/5lm AJlmM5lmZplmmZlmzJlm/8xmAMxmM8xmZsxmmcxmzMxm//9mAP9mM/9mZv9mmf9mzP9m/wCZAACZ MwCZZgCZmQCZzACZ/zOZADOZMzOZZjOZmTOZzDOZ/2aZAGaZM2aZZmaZmWaZzGaZ/5mZAJmZM5mZ ZpmZmZmZzJmZ/8yZAMyZM8yZZsyZmcyZzMyZ//+ZAP+ZM/+ZZv+Zmf+ZzP+Z/wDMAADMMwDMZgDM mQDMzADM/zPMADPMMzPMZjPMmTPMzDPM/2bMAGbMM2bMZmbMmWbMzGbM/5nMAJnMM5nMZpnMmZnM zJnM/8zMAMzMM8zMZszMmczMzMzM///MAP/MM//MZv/Mmf/MzP/M/wD/AAD/MwD/ZgD/mQD/zAD/ /zP/ADP/MzP/ZjP/mTP/zDP//2b/AGb/M2b/Zmb/mWb/zGb//5n/AJn/M5n/Zpn/mZn/zJn//8z/ AMz/M8z/Zsz/mcz/zMz/////AP//M///Zv//mf//zP///wAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACH5BAEAANcALAAAAABQAB4A AAjeAK9d80CwoMGDCBMqXMiwIUOBAz1AnEixosWLGDNq1Egw4saPIEOKrFhwpMmTKCd2TMmyJUeJ LmPKFLhyps2UNW/qFJlzp8+XP0nCvNgTZdGQBz8ehbh0ZFOgNIfilDr1ZM+VNbEOTeqxq1WqIK/C zDq2LFOJHZ9uVEuUqtazUeNSNNiSrUWxcru+nVuSpV2hfPPuLZoWLE/DSrcqjmrWa+G8Jv/epavy sWPKZI0iPhw08maMDkOL/pxRcmebpk/LTK3aJevWfknDRi179urXtjnjzr1W8ejfwIMrFBgQADs= ------=_NextPart_000_00A4_01C79D5C.82526B20 Content-Type: image/gif Content-Transfer-Encoding: base64 Content-Location: http://patft.uspto.gov/netaicon/PTO/manual.gif R0lGODlhUAAeAPcAAAAAAAAAMwAAZgAAmQAAzAAA/zMAADMAMzMAZjMAmTMAzDMA/2YAAGYAM2YA ZmYAmWYAzGYA/5kAAJkAM5kAZpkAmZkAzJkA/8wAAMwAM8wAZswAmcwAzMwA//8AAP8AM/8AZv8A mf8AzP8A/wAzAAAzMwAzZgAzmQAzzAAz/zMzADMzMzMzZjMzmTMzzDMz/2YzAGYzM2YzZmYzmWYz zGYz/5kzAJkzM5kzZpkzmZkzzJkz/8wzAMwzM8wzZswzmcwzzMwz//8zAP8zM/8zZv8zmf8zzP8z /wBmAABmMwBmZgBmmQBmzABm/zNmADNmMzNmZjNmmTNmzDNm/2ZmAGZmM2ZmZmZmmWZmzGZm/5lm AJlmM5lmZplmmZlmzJlm/8xmAMxmM8xmZsxmmcxmzMxm//9mAP9mM/9mZv9mmf9mzP9m/wCZAACZ MwCZZgCZmQCZzACZ/zOZADOZMzOZZjOZmTOZzDOZ/2aZAGaZM2aZZmaZmWaZzGaZ/5mZAJmZM5mZ ZpmZmZmZzJmZ/8yZAMyZM8yZZsyZmcyZzMyZ//+ZAP+ZM/+ZZv+Zmf+ZzP+Z/wDMAADMMwDMZgDM mQDMzADM/zPMADPMMzPMZjPMmTPMzDPM/2bMAGbMM2bMZmbMmWbMzGbM/5nMAJnMM5nMZpnMmZnM zJnM/8zMAMzMM8zMZszMmczMzMzM///MAP/MM//MZv/Mmf/MzP/M/wD/AAD/MwD/ZgD/mQD/zAD/ /zP/ADP/MzP/ZjP/mTP/zDP//2b/AGb/M2b/Zmb/mWb/zGb//5n/AJn/M5n/Zpn/mZn/zJn//8z/ AMz/M8z/Zsz/mcz/zMz/////AP//M///Zv//mf//zP///wAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACH5BAEAANcALAAAAABQAB4A AAjxAK9d80CwoMGDCBMqXMiwIUOBAz1AnEixosWLGDNq1Egw4saPIEOKrFhwpMmTKCd2TMmyJUeJ LmPKFLhyps2UNW/qFJlzp8+XJ3v+/JhTqEeMRodmLAqTYlKaTZUSjSrUoNODUCHWxJq1pFarUL2G FXtUJdmtMNFaXOmVbdOOassyvZq17tG4EcHGrfo2bV+zdOX+7Tr47mC+XPGWzZu4MFzHfr/alUyy 8OK5hqliNkxZ7V6/mgFTznu5J0K7aMVyDVtaquvAjB3Knk179ujXrp/i1ql7t83evmUCD+5yOHGW ZI//lmhcecjUtaNLn+41IAA7 ------=_NextPart_000_00A4_01C79D5C.82526B20 Content-Type: image/gif Content-Transfer-Encoding: base64 Content-Location: http://patft.uspto.gov/netaicon/PTO/number.gif R0lGODlhUAAeAPcAAAAAAAAAMwAAZgAAmQAAzAAA/zMAADMAMzMAZjMAmTMAzDMA/2YAAGYAM2YA ZmYAmWYAzGYA/5kAAJkAM5kAZpkAmZkAzJkA/8wAAMwAM8wAZswAmcwAzMwA//8AAP8AM/8AZv8A mf8AzP8A/wAzAAAzMwAzZgAzmQAzzAAz/zMzADMzMzMzZjMzmTMzzDMz/2YzAGYzM2YzZmYzmWYz zGYz/5kzAJkzM5kzZpkzmZkzzJkz/8wzAMwzM8wzZswzmcwzzMwz//8zAP8zM/8zZv8zmf8zzP8z /wBmAABmMwBmZgBmmQBmzABm/zNmADNmMzNmZjNmmTNmzDNm/2ZmAGZmM2ZmZmZmmWZmzGZm/5lm AJlmM5lmZplmmZlmzJlm/8xmAMxmM8xmZsxmmcxmzMxm//9mAP9mM/9mZv9mmf9mzP9m/wCZAACZ MwCZZgCZmQCZzACZ/zOZADOZMzOZZjOZmTOZzDOZ/2aZAGaZM2aZZmaZmWaZzGaZ/5mZAJmZM5mZ ZpmZmZmZzJmZ/8yZAMyZM8yZZsyZmcyZzMyZ//+ZAP+ZM/+ZZv+Zmf+ZzP+Z/wDMAADMMwDMZgDM mQDMzADM/zPMADPMMzPMZjPMmTPMzDPM/2bMAGbMM2bMZmbMmWbMzGbM/5nMAJnMM5nMZpnMmZnM zJnM/8zMAMzMM8zMZszMmczMzMzM///MAP/MM//MZv/Mmf/MzP/M/wD/AAD/MwD/ZgD/mQD/zAD/ /zP/ADP/MzP/ZjP/mTP/zDP//2b/AGb/M2b/Zmb/mWb/zGb//5n/AJn/M5n/Zpn/mZn/zJn//8z/ AMz/M8z/Zsz/mcz/zMz/////AP//M///Zv//mf//zP///wAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACH5BAEAANcALAAAAABQAB4A AAjuAK9d80CwoMGDCBMqXMiwIUOBAz1AnEixosWLGDNq1Egw4saPIEOKrFhwpMmTKCd2TMmyJUeJ LmPKFLhyps2UNW/qFJlzp8+XP4MCvYhwY0+IJZH+PIoUpseMTCM6Hbh0KsWaWA3S1Hr1KVWvKzsm TYoxKlirW9NalIhV7dOxYdGqlOs2K9eoMMPWzes0K1S6Usn69do1Ld+mexGXBcx0MF7Eh9UOJkyS sVzHdKfC3Rr57N/FRA82RavZ7tu+qD8LXV05tMPXsGOLDs26tmLbrM3ivql798zevmMCD96SLHHe bAEfR2lXtvPn0JMGBAA7 ------=_NextPart_000_00A4_01C79D5C.82526B20 Content-Type: image/gif Content-Transfer-Encoding: base64 Content-Location: http://patft.uspto.gov/netaicon/PTO/help.gif R0lGODlhUAAeAPcAAAAAAAAAMwAAZgAAmQAAzAAA/zMAADMAMzMAZjMAmTMAzDMA/2YAAGYAM2YA ZmYAmWYAzGYA/5kAAJkAM5kAZpkAmZkAzJkA/8wAAMwAM8wAZswAmcwAzMwA//8AAP8AM/8AZv8A mf8AzP8A/wAzAAAzMwAzZgAzmQAzzAAz/zMzADMzMzMzZjMzmTMzzDMz/2YzAGYzM2YzZmYzmWYz zGYz/5kzAJkzM5kzZpkzmZkzzJkz/8wzAMwzM8wzZswzmcwzzMwz//8zAP8zM/8zZv8zmf8zzP8z /wBmAABmMwBmZgBmmQBmzABm/zNmADNmMzNmZjNmmTNmzDNm/2ZmAGZmM2ZmZmZmmWZmzGZm/5lm AJlmM5lmZplmmZlmzJlm/8xmAMxmM8xmZsxmmcxmzMxm//9mAP9mM/9mZv9mmf9mzP9m/wCZAACZ MwCZZgCZmQCZzACZ/zOZADOZMzOZZjOZmTOZzDOZ/2aZAGaZM2aZZmaZmWaZzGaZ/5mZAJmZM5mZ ZpmZmZmZzJmZ/8yZAMyZM8yZZsyZmcyZzMyZ//+ZAP+ZM/+ZZv+Zmf+ZzP+Z/wDMAADMMwDMZgDM mQDMzADM/zPMADPMMzPMZjPMmTPMzDPM/2bMAGbMM2bMZmbMmWbMzGbM/5nMAJnMM5nMZpnMmZnM zJnM/8zMAMzMM8zMZszMmczMzMzM///MAP/MM//MZv/Mmf/MzP/M/wD/AAD/MwD/ZgD/mQD/zAD/ /zP/ADP/MzP/ZjP/mTP/zDP//2b/AGb/M2b/Zmb/mWb/zGb//5n/AJn/M5n/Zpn/mZn/zJn//8z/ AMz/M8z/Zsz/mcz/zMz/////AP//M///Zv//mf//zP///wAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACH5BAEAANcALAAAAABQAB4A AAjSAK9d80CwoMGDCBMqXMiwIUOBAz1AnEixosWLGDNq1Egw4saPIEOKrFhwpMmTKCd2TMmyJUeJ LmPKFLhyps2UNW/qFJlzp8+XP4Hu7HmyJ1GKR2Mm5QkT4lKaTW8+BWm06UGnMDuWbDn1Y1WoWMFG zBq1aFmzCcV6XFuzq1CWX8caFNv27Ei3b+naXVmXq927ZflaJasWL0bDhwMP3sr2qt+gVP+iRGzR oWWFcCVDVqnZJOXNSjuD1vl5dGbTpkujRrsaslbRrScvvky7tu2GAgMCADs= ------=_NextPart_000_00A4_01C79D5C.82526B20 Content-Type: image/gif Content-Transfer-Encoding: base64 Content-Location: http://patft.uspto.gov/netaicon/PTO/hitlist.gif R0lGODlhUAAeAPcAAAAAAAAAMwAAZgAAmQAAzAAA/zMAADMAMzMAZjMAmTMAzDMA/2YAAGYAM2YA ZmYAmWYAzGYA/5kAAJkAM5kAZpkAmZkAzJkA/8wAAMwAM8wAZswAmcwAzMwA//8AAP8AM/8AZv8A mf8AzP8A/wAzAAAzMwAzZgAzmQAzzAAz/zMzADMzMzMzZjMzmTMzzDMz/2YzAGYzM2YzZmYzmWYz zGYz/5kzAJkzM5kzZpkzmZkzzJkz/8wzAMwzM8wzZswzmcwzzMwz//8zAP8zM/8zZv8zmf8zzP8z /wBmAABmMwBmZgBmmQBmzABm/zNmADNmMzNmZjNmmTNmzDNm/2ZmAGZmM2ZmZmZmmWZmzGZm/5lm AJlmM5lmZplmmZlmzJlm/8xmAMxmM8xmZsxmmcxmzMxm//9mAP9mM/9mZv9mmf9mzP9m/wCZAACZ MwCZZgCZmQCZzACZ/zOZADOZMzOZZjOZmTOZzDOZ/2aZAGaZM2aZZmaZmWaZzGaZ/5mZAJmZM5mZ ZpmZmZmZzJmZ/8yZAMyZM8yZZsyZmcyZzMyZ//+ZAP+ZM/+ZZv+Zmf+ZzP+Z/wDMAADMMwDMZgDM mQDMzADM/zPMADPMMzPMZjPMmTPMzDPM/2bMAGbMM2bMZmbMmWbMzGbM/5nMAJnMM5nMZpnMmZnM zJnM/8zMAMzMM8zMZszMmczMzMzM///MAP/MM//MZv/Mmf/MzP/M/wD/AAD/MwD/ZgD/mQD/zAD/ /zP/ADP/MzP/ZjP/mTP/zDP//2b/AGb/M2b/Zmb/mWb/zGb//5n/AJn/M5n/Zpn/mZn/zJn//8z/ AMz/M8z/Zsz/mcz/zMz/////AP//M///Zv//mf//zP///wAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACH5BAEAANcALAAAAABQAB4A AAjlAK9d80CwoMGDCBMqXMiwIUOBAz1AnEixosWLGDNq1Egw4saPIEOKrFhwpMmTKCd2TMmyJUeJ LmPKFLhyps2UNW/qFJlzp8+XMnuGFMqS6MWeK5PCJLkUolGaTTc+ZUpRqNGpR6MCBYkUZseDVKsu BQv2I1aVUZVCzRrWqtaMZ50qXOvRoluoad9ijEtXLt2rWmsa9DtUr928f/XeRevV8OHCYhOzjUyZ b1+piOtGDIywblm8XB3/HK35pcPTqB9iJs36cevXl2GTtiy7Je3aOEXjjllyt8+vun2bFJy6uPHj CwUGBAA7 ------=_NextPart_000_00A4_01C79D5C.82526B20 Content-Type: image/gif Content-Transfer-Encoding: base64 Content-Location: http://patft.uspto.gov/netaicon/PTO/prevdoc.gif R0lGODlhUAAeAPcAAAAAAAAAMwAAZgAAmQAAzAAA/zMAADMAMzMAZjMAmTMAzDMA/2YAAGYAM2YA ZmYAmWYAzGYA/5kAAJkAM5kAZpkAmZkAzJkA/8wAAMwAM8wAZswAmcwAzMwA//8AAP8AM/8AZv8A mf8AzP8A/wAzAAAzMwAzZgAzmQAzzAAz/zMzADMzMzMzZjMzmTMzzDMz/2YzAGYzM2YzZmYzmWYz zGYz/5kzAJkzM5kzZpkzmZkzzJkz/8wzAMwzM8wzZswzmcwzzMwz//8zAP8zM/8zZv8zmf8zzP8z /wBmAABmMwBmZgBmmQBmzABm/zNmADNmMzNmZjNmmTNmzDNm/2ZmAGZmM2ZmZmZmmWZmzGZm/5lm AJlmM5lmZplmmZlmzJlm/8xmAMxmM8xmZsxmmcxmzMxm//9mAP9mM/9mZv9mmf9mzP9m/wCZAACZ MwCZZgCZmQCZzACZ/zOZADOZMzOZZjOZmTOZzDOZ/2aZAGaZM2aZZmaZmWaZzGaZ/5mZAJmZM5mZ ZpmZmZmZzJmZ/8yZAMyZM8yZZsyZmcyZzMyZ//+ZAP+ZM/+ZZv+Zmf+ZzP+Z/wDMAADMMwDMZgDM mQDMzADM/zPMADPMMzPMZjPMmTPMzDPM/2bMAGbMM2bMZmbMmWbMzGbM/5nMAJnMM5nMZpnMmZnM zJnM/8zMAMzMM8zMZszMmczMzMzM///MAP/MM//MZv/Mmf/MzP/M/wD/AAD/MwD/ZgD/mQD/zAD/ /zP/ADP/MzP/ZjP/mTP/zDP//2b/AGb/M2b/Zmb/mWb/zGb//5n/AJn/M5n/Zpn/mZn/zJn//8z/ AMz/M8z/Zsz/mcz/zMz/////AP//M///Zv//mf//zP///wAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACH5BAEAANcALAAAAABQAB4A AAjoAK9d80CwoMGDCBMqXMiwIUOBAz1AnEixosWLGDNq1Egw4saPIEOKrFhwpMmTKCd2TMmyJUeJ LmPKFLhyps2UNW/qFJlzp8+XPy/21DmU5sGZRW0mrZk0KE6YJKGu7DjVIESmMLGWNHpVqlWhUCli NVpyrEeuZ82qDYtxqVe0cKt2Rbt2bkS2Ft1+PUt2L9W3fOXG3Qq2cFSVeLnWpQu4a2K4YhPnNEsW 8WDGeJu6zcv2KOKwWif/7fsYstPTdiM7XM26dULDqGPzlX26Ke2btm8jLa17d2+nhH/jlphbuMnQ rpMrX74yIAA7 ------=_NextPart_000_00A4_01C79D5C.82526B20 Content-Type: image/gif Content-Transfer-Encoding: base64 Content-Location: http://patft.uspto.gov/netaicon/PTO/nextdoc.gif R0lGODlhUAAeAPcAAAAAAAAAMwAAZgAAmQAAzAAA/zMAADMAMzMAZjMAmTMAzDMA/2YAAGYAM2YA ZmYAmWYAzGYA/5kAAJkAM5kAZpkAmZkAzJkA/8wAAMwAM8wAZswAmcwAzMwA//8AAP8AM/8AZv8A mf8AzP8A/wAzAAAzMwAzZgAzmQAzzAAz/zMzADMzMzMzZjMzmTMzzDMz/2YzAGYzM2YzZmYzmWYz zGYz/5kzAJkzM5kzZpkzmZkzzJkz/8wzAMwzM8wzZswzmcwzzMwz//8zAP8zM/8zZv8zmf8zzP8z /wBmAABmMwBmZgBmmQBmzABm/zNmADNmMzNmZjNmmTNmzDNm/2ZmAGZmM2ZmZmZmmWZmzGZm/5lm AJlmM5lmZplmmZlmzJlm/8xmAMxmM8xmZsxmmcxmzMxm//9mAP9mM/9mZv9mmf9mzP9m/wCZAACZ MwCZZgCZmQCZzACZ/zOZADOZMzOZZjOZmTOZzDOZ/2aZAGaZM2aZZmaZmWaZzGaZ/5mZAJmZM5mZ ZpmZmZmZzJmZ/8yZAMyZM8yZZsyZmcyZzMyZ//+ZAP+ZM/+ZZv+Zmf+ZzP+Z/wDMAADMMwDMZgDM mQDMzADM/zPMADPMMzPMZjPMmTPMzDPM/2bMAGbMM2bMZmbMmWbMzGbM/5nMAJnMM5nMZpnMmZnM zJnM/8zMAMzMM8zMZszMmczMzMzM///MAP/MM//MZv/Mmf/MzP/M/wD/AAD/MwD/ZgD/mQD/zAD/ /zP/ADP/MzP/ZjP/mTP/zDP//2b/AGb/M2b/Zmb/mWb/zGb//5n/AJn/M5n/Zpn/mZn/zJn//8z/ AMz/M8z/Zsz/mcz/zMz/////AP//M///Zv//mf//zP///wAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACH5BAEAANcALAAAAABQAB4A AAjTAK9d80CwoMGDCBMqXMiwIUOBAz1AnEixosWLGDNq1Egw4saPIEOKrFhwpMmTKCd2TMmyJUeJ LmPKFLhyps2UNW/qFJlzp8+XP4MCZVkSIkyTPVEmHVmUptKjRKGelFjz6EGjVqkabLmUp0enX79W hdmVqVSkNMmmxcp2bMyyILMOTHsVK1S4IfFulEv27Fq3LvVyVLkSsGG/SBHnJZy1KeCIiuNGFvpT MEaHmBdGpcyZouXOMj+DDjx59EzRpnGWTk16NeunYV+fbpy5tu3bDQUGBAA7 ------=_NextPart_000_00A4_01C79D5C.82526B20 Content-Type: image/gif Content-Transfer-Encoding: base64 Content-Location: http://patft.uspto.gov/netaicon/PTO/bottom.gif R0lGODlhUAAeAPcAAAAAAAAAMwAAZgAAmQAAzAAA/zMAADMAMzMAZjMAmTMAzDMA/2YAAGYAM2YA ZmYAmWYAzGYA/5kAAJkAM5kAZpkAmZkAzJkA/8wAAMwAM8wAZswAmcwAzMwA//8AAP8AM/8AZv8A mf8AzP8A/wAzAAAzMwAzZgAzmQAzzAAz/zMzADMzMzMzZjMzmTMzzDMz/2YzAGYzM2YzZmYzmWYz zGYz/5kzAJkzM5kzZpkzmZkzzJkz/8wzAMwzM8wzZswzmcwzzMwz//8zAP8zM/8zZv8zmf8zzP8z /wBmAABmMwBmZgBmmQBmzABm/zNmADNmMzNmZjNmmTNmzDNm/2ZmAGZmM2ZmZmZmmWZmzGZm/5lm AJlmM5lmZplmmZlmzJlm/8xmAMxmM8xmZsxmmcxmzMxm//9mAP9mM/9mZv9mmf9mzP9m/wCZAACZ MwCZZgCZmQCZzACZ/zOZADOZMzOZZjOZmTOZzDOZ/2aZAGaZM2aZZmaZmWaZzGaZ/5mZAJmZM5mZ ZpmZmZmZzJmZ/8yZAMyZM8yZZsyZmcyZzMyZ//+ZAP+ZM/+ZZv+Zmf+ZzP+Z/wDMAADMMwDMZgDM mQDMzADM/zPMADPMMzPMZjPMmTPMzDPM/2bMAGbMM2bMZmbMmWbMzGbM/5nMAJnMM5nMZpnMmZnM zJnM/8zMAMzMM8zMZszMmczMzMzM///MAP/MM//MZv/Mmf/MzP/M/wD/AAD/MwD/ZgD/mQD/zAD/ /zP/ADP/MzP/ZjP/mTP/zDP//2b/AGb/M2b/Zmb/mWb/zGb//5n/AJn/M5n/Zpn/mZn/zJn//8z/ AMz/M8z/Zsz/mcz/zMz/////AP//M///Zv//mf//zP///wAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACH5BAEAANcALAAAAABQAB4A AAjlAK9d80CwoMGDCBMqXMiwIUOBAz1AnEixosWLGDNq1Egw4saPIEOKrFhwpMmTKCd2TMmyJUeJ LmPKFLhyps2UNW/qFJlzp8+XGxF+zNnzp0egNGFmJKrUaNKgSpmWjFjyIESrT6dOHdr0Ys2vUWEy VRk2qdiVRb12tZjwatmjT93KhQsWZFqKY+meJcs3bt24UAPP/ZsXMNq3cJEubXp4MOPHjucmXgwV q1mpbsNu/TsZ412nTj9fdki6dEOuoFPjXavaqOjWN1/Dnil7dszatlvizo1zN++RHX3/Rj3atPHj yLEGBAA7 ------=_NextPart_000_00A4_01C79D5C.82526B20 Content-Type: image/gif Content-Transfer-Encoding: base64 Content-Location: http://patft.uspto.gov/netaicon/PTO/cart.gif R0lGODlhUAAeAPcAAAAAAAAAMwAAZgAAmQAAzAAA/zMAADMAMzMAZjMAmTMAzDMA/2YAAGYAM2YA ZmYAmWYAzGYA/5kAAJkAM5kAZpkAmZkAzJkA/8wAAMwAM8wAZswAmcwAzMwA//8AAP8AM/8AZv8A mf8AzP8A/wAzAAAzMwAzZgAzmQAzzAAz/zMzADMzMzMzZjMzmTMzzDMz/2YzAGYzM2YzZmYzmWYz zGYz/5kzAJkzM5kzZpkzmZkzzJkz/8wzAMwzM8wzZswzmcwzzMwz//8zAP8zM/8zZv8zmf8zzP8z /wBmAABmMwBmZgBmmQBmzABm/zNmADNmMzNmZjNmmTNmzDNm/2ZmAGZmM2ZmZmZmmWZmzGZm/5lm AJlmM5lmZplmmZlmzJlm/8xmAMxmM8xmZsxmmcxmzMxm//9mAP9mM/9mZv9mmf9mzP9m/wCZAACZ MwCZZgCZmQCZzACZ/zOZADOZMzOZZjOZmTOZzDOZ/2aZAGaZM2aZZmaZmWaZzGaZ/5mZAJmZM5mZ ZpmZmZmZzJmZ/8yZAMyZM8yZZsyZmcyZzMyZ//+ZAP+ZM/+ZZv+Zmf+ZzP+Z/wDMAADMMwDMZgDM mQDMzADM/zPMADPMMzPMZjPMmTPMzDPM/2bMAGbMM2bMZmbMmWbMzGbM/5nMAJnMM5nMZpnMmZnM zJnM/8zMAMzMM8zMZszMmczMzMzM///MAP/MM//MZv/Mmf/MzP/M/wD/AAD/MwD/ZgD/mQD/zAD/ /zP/ADP/MzP/ZjP/mTP/zDP//2b/AGb/M2b/Zmb/mWb/zGb//5n/AJn/M5n/Zpn/mZn/zJn//8z/ AMz/M8z/Zsz/mcz/zMz/////AP//M///Zv//mf//zP///wAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACH5BAEAANcALAAAAABQAB4A AAjuAK9d80CwoMGDCBMqXMiwIUOBAz1AnEixosWLGDNq1Egw4saPIEOKrFhwpMmTKCd2TMmyJUeJ LmPKFLhyps2UNW/qFJlzp8+XIXv+bNkz50qhRA2aRFoUJk2nN2sizcgUqkeIR50exAozK0moUpU+ jbhVpdWrYceq9XrV7MesJat+VYtWa9e7dLliRJhX7lejd8t27NpWr8W0hf1SFLv27NPAh8Hibex2 buTFk9sCvoi4s+TLoA2T3Sz6L2CxTa1OHco6scPXsGPHrty6dmnbrVfj1ql7t83evmUCD+6yJHGf gx0fT8pVtvPn0MUGBAA7 ------=_NextPart_000_00A4_01C79D5C.82526B20 Content-Type: image/gif Content-Transfer-Encoding: base64 Content-Location: http://patft.uspto.gov/netaicon/PTO/order.gif R0lGODlhUAAeAPcAAAAAAAAAMwAAZgAAmQAAzAAA/zMAADMAMzMAZjMAmTMAzDMA/2YAAGYAM2YA ZmYAmWYAzGYA/5kAAJkAM5kAZpkAmZkAzJkA/8wAAMwAM8wAZswAmcwAzMwA//8AAP8AM/8AZv8A mf8AzP8A/wAzAAAzMwAzZgAzmQAzzAAz/zMzADMzMzMzZjMzmTMzzDMz/2YzAGYzM2YzZmYzmWYz zGYz/5kzAJkzM5kzZpkzmZkzzJkz/8wzAMwzM8wzZswzmcwzzMwz//8zAP8zM/8zZv8zmf8zzP8z /wBmAABmMwBmZgBmmQBmzABm/zNmADNmMzNmZjNmmTNmzDNm/2ZmAGZmM2ZmZmZmmWZmzGZm/5lm AJlmM5lmZplmmZlmzJlm/8xmAMxmM8xmZsxmmcxmzMxm//9mAP9mM/9mZv9mmf9mzP9m/wCZAACZ MwCZZgCZmQCZzACZ/zOZADOZMzOZZjOZmTOZzDOZ/2aZAGaZM2aZZmaZmWaZzGaZ/5mZAJmZM5mZ ZpmZmZmZzJmZ/8yZAMyZM8yZZsyZmcyZzMyZ//+ZAP+ZM/+ZZv+Zmf+ZzP+Z/wDMAADMMwDMZgDM mQDMzADM/zPMADPMMzPMZjPMmTPMzDPM/2bMAGbMM2bMZmbMmWbMzGbM/5nMAJnMM5nMZpnMmZnM zJnM/8zMAMzMM8zMZszMmczMzMzM///MAP/MM//MZv/Mmf/MzP/M/wD/AAD/MwD/ZgD/mQD/zAD/ /zP/ADP/MzP/ZjP/mTP/zDP//2b/AGb/M2b/Zmb/mWb/zGb//5n/AJn/M5n/Zpn/mZn/zJn//8z/ AMz/M8z/Zsz/mcz/zMz/////AP//M///Zv//mf//zP///wAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACH5BAEAANcALAAAAABQAB4A AAj1AK9d80CwoMGDCBMqXMiwIUOBAz1AnEixosWLGDNq1Egw4saPIEOKrFhwpMmTKCd2TMmyJUeJ LmPKFLhyps2UNW/qFJlzp8+XPGGqFPozKMWSFnt6PEr0o8GROXsiJdl06VCjNLHSJNox6tOtU8Gu /Mr0ItmuCLderTkWZluqEN+Wzdi2pNe1QuXKvarWatyqYt1yHYz3b9+9hg9XVboU8d3AegX35dt4 MeDIlK2ylVx5cuLOcLOCfjx589+pB5PWBSx2KFKpiIvKnuuwtu3buL8yni17N++fvn/vDC78JvHi M48jjxl2uU60zofnzU29unWYAQEAOw== ------=_NextPart_000_00A4_01C79D5C.82526B20 Content-Type: image/gif Content-Transfer-Encoding: base64 Content-Location: http://patft.uspto.gov/netaicon/PTO/image.gif R0lGODlhUAAeAPcAAAAAAAAAMwAAZgAAmQAAzAAA/zMAADMAMzMAZjMAmTMAzDMA/2YAAGYAM2YA ZmYAmWYAzGYA/5kAAJkAM5kAZpkAmZkAzJkA/8wAAMwAM8wAZswAmcwAzMwA//8AAP8AM/8AZv8A mf8AzP8A/wAzAAAzMwAzZgAzmQAzzAAz/zMzADMzMzMzZjMzmTMzzDMz/2YzAGYzM2YzZmYzmWYz zGYz/5kzAJkzM5kzZpkzmZkzzJkz/8wzAMwzM8wzZswzmcwzzMwz//8zAP8zM/8zZv8zmf8zzP8z /wBmAABmMwBmZgBmmQBmzABm/zNmADNmMzNmZjNmmTNmzDNm/2ZmAGZmM2ZmZmZmmWZmzGZm/5lm AJlmM5lmZplmmZlmzJlm/8xmAMxmM8xmZsxmmcxmzMxm//9mAP9mM/9mZv9mmf9mzP9m/wCZAACZ MwCZZgCZmQCZzACZ/zOZADOZMzOZZjOZmTOZzDOZ/2aZAGaZM2aZZmaZmWaZzGaZ/5mZAJmZM5mZ ZpmZmZmZzJmZ/8yZAMyZM8yZZsyZmcyZzMyZ//+ZAP+ZM/+ZZv+Zmf+ZzP+Z/wDMAADMMwDMZgDM mQDMzADM/zPMADPMMzPMZjPMmTPMzDPM/2bMAGbMM2bMZmbMmWbMzGbM/5nMAJnMM5nMZpnMmZnM zJnM/8zMAMzMM8zMZszMmczMzMzM///MAP/MM//MZv/Mmf/MzP/M/wD/AAD/MwD/ZgD/mQD/zAD/ /zP/ADP/MzP/ZjP/mTP/zDP//2b/AGb/M2b/Zmb/mWb/zGb//5n/AJn/M5n/Zpn/mZn/zJn//8z/ AMz/M8z/Zsz/mcz/zMz/////AP//M///Zv//mf//zP///wAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACH5BAEAANcALAAAAABQAB4A AAjjAK9d80CwoMGDCBMqXMiwIUOBAz1AnEixosWLGDNq1Egw4saPIEOKrFhwpMmTKCd2TMmyJUeJ LmPKFLhyps2UNW/qFJlzp8+XIA3+nNkzY9GhOGF+rNmxZESlT3MihHhQpVCjUIHSXOn0KFelX6nC PHqRrEWmYNOKvYp2q9itWTGaJanWrd22Hu9OhRuXbki8efPiHdx3rdaldQOH1QvXbuC3WIN2TYz2 6lPFlqseRhqZaGGKDkOLHv35MWerTj2fXg2Z9em5rm3Cji1zNm2Xtm+zTK37ZtPSvU9WJk28uHGn AQEAOw== ------=_NextPart_000_00A4_01C79D5C.82526B20 Content-Type: image/gif Content-Transfer-Encoding: base64 Content-Location: http://patft.uspto.gov/netaicon/PTO/top.gif R0lGODlhUAAeAPcAAAAAAAAAMwAAZgAAmQAAzAAA/zMAADMAMzMAZjMAmTMAzDMA/2YAAGYAM2YA ZmYAmWYAzGYA/5kAAJkAM5kAZpkAmZkAzJkA/8wAAMwAM8wAZswAmcwAzMwA//8AAP8AM/8AZv8A mf8AzP8A/wAzAAAzMwAzZgAzmQAzzAAz/zMzADMzMzMzZjMzmTMzzDMz/2YzAGYzM2YzZmYzmWYz zGYz/5kzAJkzM5kzZpkzmZkzzJkz/8wzAMwzM8wzZswzmcwzzMwz//8zAP8zM/8zZv8zmf8zzP8z /wBmAABmMwBmZgBmmQBmzABm/zNmADNmMzNmZjNmmTNmzDNm/2ZmAGZmM2ZmZmZmmWZmzGZm/5lm AJlmM5lmZplmmZlmzJlm/8xmAMxmM8xmZsxmmcxmzMxm//9mAP9mM/9mZv9mmf9mzP9m/wCZAACZ MwCZZgCZmQCZzACZ/zOZADOZMzOZZjOZmTOZzDOZ/2aZAGaZM2aZZmaZmWaZzGaZ/5mZAJmZM5mZ ZpmZmZmZzJmZ/8yZAMyZM8yZZsyZmcyZzMyZ//+ZAP+ZM/+ZZv+Zmf+ZzP+Z/wDMAADMMwDMZgDM mQDMzADM/zPMADPMMzPMZjPMmTPMzDPM/2bMAGbMM2bMZmbMmWbMzGbM/5nMAJnMM5nMZpnMmZnM zJnM/8zMAMzMM8zMZszMmczMzMzM///MAP/MM//MZv/Mmf/MzP/M/wD/AAD/MwD/ZgD/mQD/zAD/ /zP/ADP/MzP/ZjP/mTP/zDP//2b/AGb/M2b/Zmb/mWb/zGb//5n/AJn/M5n/Zpn/mZn/zJn//8z/ AMz/M8z/Zsz/mcz/zMz/////AP//M///Zv//mf//zP///wAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACH5BAEAANcALAAAAABQAB4A AAjAAK9d80CwoMGDCBMqXMiwIUOBAz1AnEixosWLGDNq1Egw4saPIEOKrFhwpMmTKCd2TMmyJUeJ LmPKFLhyps2UNW/qFJlzp8+XMRX+3NizZdGhF4/ihAnxYFOJJW0qRZmz5sqoU09mNVmV6VWvTIOG ddn1KU2wUscaDWsVZtu0cM2enUtX5taRPZ2eNXjz7k6/VNVqdUh4JuC+gu0mRor0MGPDix/7dCyZ bOTKiDFLjqr5Z0fKnUO2JUy6tGnTAgMCADs= ------=_NextPart_000_00A4_01C79D5C.82526B20--