Musical improvisation (also known as musical extemporization) is the creative activity of immediate ("in the moment") musical composition, which combines performance with communication of emotions and instrumental technique as well as spontaneous response to other musicians. Sometimes musical ideas in improvisation are spontaneous, but may be based on chord changes in classical music, and many other kinds of music. One definition is a "performance given extempore without planning or preparation." Another definition is to "play or sing (music) extemporaneously, by inventing variations on a melody or creating new melodies, rhythms and harmonies." Encyclopædia Britannica defines it as "the extemporaneous composition or free performance of a musical passage, usually in a manner conforming to certain stylistic norms but unfettered by the prescriptive features of a specific musical text. Improvisation is often done within (or based on) a pre-existing harmonic framework or chord progression. Improvisation is a major part of some types of 20th-century music, such as blues, jazz, and jazz fusion, in which instrumental performers improvise solos, melody lines and accompaniment parts.
Throughout the eras of the Western art music tradition, including the Medieval, Renaissance, Baroque, Classical, and Romantic periods, improvisation was a valued skill. J.S. Bach, Handel, Mozart, Beethoven, Chopin, Liszt, and many other famous composers and musicians were known especially for their improvisational skills. Improvisation might have played an important role in the monophonic period. The earliest treatises on polyphony, such as the Musica enchiriadis (ninth century), indicate that added parts were improvised for centuries before the first notated examples. However, it was only in the fifteenth century that theorists began making a hard distinction between improvised and written music.
Some classical music forms contained sections for improvisation, such as the cadenza in solo concertos, or the preludes to some keyboard suites by Bach and Handel, which consist of elaborations of a progression of chords, which performers are to use as the basis for their improvisation. Handel, Scarlatti, and Bach all belonged to a tradition of solo keyboard improvisation, in which they improvised on the harpsichord or pipe organ. In the Baroque era, performers improvised ornaments and basso continuo keyboard players improvised chord voicings based on figured bass notation. However, in the 20th and early 21st century, as "common practice" Western art music performance became institutionalized in symphony orchestras, opera houses and ballets, improvisation has played a smaller role. At the same time, some contemporary composers from the 20th and 21st century have increasingly included improvisation in their creative work.
In Indian classical music, improvisation is a core component and an essential criterion of performances. In Indian, Afghani, Pakistani, and Bangladeshi classical music, raga is the "tonal framework for composition and improvisation." The Encyclopædia Britannica defines a raga as "a melodic framework for improvisation and composition.
Although melodic improvisation was an important factor in European music from the earliest times, the first detailed information on improvisation technique appears in ninth-century treatises instructing singers on how to add another melody to a pre-existent liturgical chant, in a style called organum. Throughout the Middle Ages and Renaissance, improvised counterpoint over a cantus firmus (a practice found both in church music and in popular dance music) constituted a part of every musician's education, and is regarded as the most important kind of unwritten music before the Baroque period.
Following the invention of music printing at the beginning of the sixteenth century, there is more detailed documentation of improvisational practice, in the form of published instruction manuals, mainly in Italy. In addition to improvising counterpoint over a cantus firmus, singers and instrumentalists improvised melodies over ostinato chord patterns, made elaborate embellishments of melodic lines, and invented music extemporaneously without any predetermined schemata. Keyboard players likewise performed extempore, freely formed pieces.
The kinds of improvisation practised during the Renaissance—principally either the embellishing of an existing part or the creation of an entirely new part or parts—continued into the early Baroque, though important modifications were introduced. Ornamentation began to be brought more under the control of composers, in some cases by writing out embellishments, and more broadly by introducing symbols or abbreviations for certain ornamental patterns. Two of the earliest important sources for vocal ornamentation of this sort are Giovanni Battista Bovicelli’s Regole, passaggi di musica (1594), and the preface to Giulio Caccini’s collection, Le nuove musiche (1601/2)
Eighteenth-century manuals make it clear that performers on the flute, oboe, violin, and other melodic instruments were expected not only to ornament previously composed pieces, but also spontaneously to improvise preludes.
The pattern of chords in many baroque preludes, for example, can be played on keyboard and guitar over a pedal tone or repeated bass notes. Such progressions can be used in many other structures and contexts, and are still found in Mozart, but most preludes begin with the treble supported by a simple bass. J.S. Bach, for example, was particularly fond of the sound produced by the dominant seventh harmony played over, i.e., suspended against, the tonic pedal tone.
There is little or no Alberti bass in baroque keyboard music, and instead the accompanying hand supports the moving lines mostly by contrasting them with longer note values, which themselves have a melodic shape and are mostly placed in consonant harmony. This polarity can be reversed—another useful technique for improvisation—by changing the longer note values to the right hand and playing moving lines in the left at intervals—or with moving lines in both hands, occasionally. This shift of roles between treble and bass is another definitive characteristic. Finally, in keeping with this polarity, the kind of question and answer which appears in baroque music has the appearance of fugue or canon. This method was a favorite in compositions by Scarlatti and Handel especially at the beginning of a piece, even when not forming a fugue.
According to Encyclopædia Britannica, the "monodic textures that originated about 1600 … were ready-made, indeed in large measure intended, for improvisational enhancement, not only of the treble parts but also, almost by definition, of the bass, which was figured to suggest no more than a minimal chordal outline." Improvised accompaniment over a figured bass was a common practice during the Baroque era, and to some extent the following periods. Improvisation remains a feature of organ playing in some church services and are regularly also performed at concerts.
Dietrich Buxtehude and Johann Sebastian Bach were regarded in the Baroque period as highly skilled organ improvisers. Maurice Duruflé, a great improviser himself, transcribed improvisations by Louis Vierne and Charles Tournemire. Olivier Latry later wrote his improvisations as a compositions, for example Salve Regina.
Classical music departs from baroque style in that sometimes several voices may move together as chords involving both hands, to form brief phrases without any passing tones. Though such motifs were used sparingly by Mozart, they were taken up much more liberally by Beethoven and Schubert. Such chords also appeared to some extent in baroque keyboard music, such as the 3rd movement theme in Bach's Italian Concerto. But at that time such a chord often appeared only in one clef at a time, (or one hand on the keyboard) and did not form the independent phrases found more in later music. Adorno mentions this movement of the Italian Concerto as a more flexible, improvisatory form, in comparison to Mozart, suggesting the gradual diminishment of improvisation well before its decline became obvious.
The introductory gesture of "tonic, subdominant, dominant, tonic," however, much like its baroque form, continues to appear at the beginning of high-classical and romantic piano pieces (and much other music) as in Haydn's sonata Hob.16/No. 52 and Beethoven's sonata opus 78.
Beethoven and Mozart cultivated mood markings such as con amore, appassionato, cantabile, and expressivo. In fact, it is perhaps because improvisation is spontaneous that it is akin to the communication of love.
Beethoven and Mozart left excellent examples of what their improvisations were like, in the sets of variations and the sonatas which they published, and in their written out cadenzas (which illustrate what their improvisations would have sounded like). As a keyboard player, Mozart competed at least once in improvisation, with Muzio Clementi. Beethoven won many tough improvisatory battles over such rivals as Johann Nepomuk Hummel, Daniel Steibelt, and Joseph Woelfl.
Extemporization, both in the form of introductions to pieces, and links between pieces, continued to be a feature of keyboard concertising until the early 20th-century. Amongst those who practised such improvisation were Franz Liszt, Felix Mendelssohn, Anton Rubinstein, Paderewski, Percy Grainger and Pachmann. Improvisation in the area of 'art music' seems to have declined with the growth of recording.
After studying over 1,200 early Verdi recordings, Will Crutchfield concludes that "The solo cavatina was the most obvious and enduring locus of soloistic discretion in nineteenth-century opera". He goes on to identify seven main types of vocal improvisation used by opera singers in this repertory:
Toward the end of the section of Aesthetic Theory entitled "Art Beauty" (in the English edition), Theodor Adorno included a brief argument on improvisation's aesthetic value. Claiming that artworks must have a "thing-character" through which their spiritual content breaks, Adorno pointed out that the thing-character is in question in the improvised, yet present. It may be assumed Adorno meant classical improvisation, not jazz, which he mostly excoriated. He held jazz, for example, to be antithetical to Beethoven. There is more extensive treatment, essentially about traditional jazz, in Prisms and The Jargon of Authenticity.
Improvisation is one of the basic elements that sets jazz apart from other types of music. The unifying moments in improvisation that take place in live performance are understood to encompass the performer, the listener, and the physical space that the performance takes place in. Even if improvisation is also found outside of jazz, it may be that no other music relies so much on the art of "composing in the moment", demanding that every musician rise to a certain level of creativity that may put the performer in touch with his or her unconscious as well as conscious states. The educational use of improvised jazz recordings is widely acknowledged. They offer a clear value as documentation of performances despite their perceived limitations. With these available, generations of jazz musicians are able to implicate styles and influences in their performed new improvisations. Many varied scales and their modes can be used in improvisation. They are often not written down in the process, but they help musicians practice the jazz idiom.
A common view of what a jazz soloist does could be expressed thus: as the harmonies go by, he selects notes from each chord, out of which he fashions a melody. He is free to embellish by means of passing and neighbor tones, and he may add extensions to the chords, but at all times a good improviser must follow the changes. ... [However], a jazz musician really has several options: he may reflect the chord progression exactly, he may "skim over" the progression and simply elaborate the background harmony, or he may fashion his own voice-leading which may clash at some points with the chords the rhythm section is playing.
With the notable exception of liturgical improvisation on the organ, the first half of the twentieth century is marked by an almost total absence of actual improvisation in art music. Since the 1950s, some contemporary composers have placed fewer restrictions on the improvising performer, using techniques such as vague notation (for example, indicating only that a certain number of notes must sound within a defined period of time). New Music ensembles formed around improvisation were founded, such as the Scratch Orchestra in England; Musica Elettronica Viva in Italy; Lukas Foss Improvisation Chamber Ensemble at the University of California, Los Angeles; Larry Austin's New Music Ensemble at the University of California, Davis; the ONCE Group at Ann Arbor; the Sonic Arts Group; and Sonics, the latter three funding themselves through concerts, tours, and grants. Significant pieces include Foss Time Cycles (1960) and Echoi (1963).
Other composers working with improvisation include Richard Barrett, Benjamin Boretz, Pierre Boulez, Joseph Brent, Sylvano Bussotti, Cornelius Cardew, Jani Christou, Douglas J. Cuomo, Alvin Curran, Stuart Dempster, Hugh Davies, Karlheinz Essl, Mohammed Fairouz, Rolf Gehlhaar, Vinko Globokar, Richard Grayson, Hans-Joachim Hespos, Barton McLean, Priscilla McLean, Stephen Nachmanovitch, Pauline Oliveros, Henri Pousseur, Todd Reynolds, Terry Riley, Frederic Rzewski, William O. Smith, Manfred Stahnke, Karlheinz Stockhausen, Toru Takemitsu, Richard Teitelbaum, Vangelis, Michael Vetter, Christian Wolff, Iannis Xenakis, Yitzhak Yedid, La Monte Young, Frank Zappa, Hans Zender, and John Zorn.
In the 1960s The Grateful Dead gained popularity and bestowed a name on the "jam" genre. Since the 1980s, bands like Phish, Widespread Panic, moe., Umphrey's McGee, Max Creek, and The String Cheese Incident have used musical improvisation extensively; indeed, for the more devoted followers of any band, these extended improvisational segments—jams—are a large part of what makes a live show so special. The jam band scene has also seen the rise of "jamgrass" with bands like Hot Buttered Rum, Cornmeal and Yonder Mountain String Band, along with the rise of Livetronica with bands like The Disco Biscuits, Lotus, The New Deal, and STS9 (Sound Tribe Sector 9), most of whom feature improvisation in their music.
British psychedelic rock acts of the 1960s and 1970s used improvisations to express their dazed state of mind under the influence of psychedelic drugs in a musical language. The progressive rock genre also began exploring improvisation as a musical expression, e.g. Henry Cow.
In the realm of silent film-music performance, there were musicians (theatre organ players and piano players) whose improvised performances accompanying these film has been recognized as exceptional by critics, scholars, and audiences alike. Neil Brand was a composer who also performed improvisationally. Brand, along with Guenter A. Buchwald, Philip Carli, Stephen Horne, Donald Sosin, John Sweeney, and Gabriel Thibaudeau, all performed at the annual conference on silent film in Pordenone, Italy, "Le Giornate del Cinema Muto." In improvising for silent film, performers have to play music that matches the mood, style and pacing of the films they accompany. In some cases, musicians had to accompany films at first sight, without preparation. Improvisers needed to know a wide range of musical styles and have the stamina to play for sequences of films which occasionally ran over three hours. In addition to the performances, some pianists also taught master classes for those who wanted to develop their skill in improvising for films. When talkies–motion pictures with sound–were introduced, these talented improvising musicians had to find other jobs. In the 2010s, there are a small number of film societies which present vintage silent films, using live improvising musicians to accompany the film.
Worldwide there are many venues dedicated to supporting live improvisation. In Melbourne since 1998, the Make It Up Club (held every Tuesday evening at Bar Open on Brunswick Street, Melbourne) has been presenting a weekly concert series dedicated to promoting avant-garde improvised music and sound performance of the highest conceptual and performative standards (regardless of idiom, genre, or instrumentation). The Make It Up Club has become an institution in Australian improvised music and consistently features artists from all over the world.
A number of approaches to teaching improvisation have emerged in jazz pedagogy, popular music pedagogy, the Dalcroze method, Orff-Schulwerk, and Satis Coleman's creative music. Current research in music education includes investigating how often improvisation is taught, how confident music majors and teachers are at teaching improvisation, neuroscience and psychological aspects of improvisation, and free-improvisation as a pedagogical approach.
A raga is one of the melodic modes used in Indian classical music. Joep Bor of the Rotterdam Conservatory of Music has defined Raga as "tonal framework for composition and improvisation." Nazir Jairazbhoy, chairman of UCLA's department of ethnomusicology, characterized ragas as separated by scale, line of ascent and descent, transilience, emphasized notes and register, and intonation and ornaments. A raga uses a series of five or more musical notes upon which a melody is constructed. However, the way the notes are approached and rendered in musical phrases and the mood they convey are more important in defining a raga than the notes themselves. In the Indian musical tradition, rāgas are associated with different times of the day, or with seasons. Indian classical music is always set in a rāga. Non-classical music such as popular Indian film songs and ghazals sometimes use rāgas in their compositions.
According to the Encyclopædia Britannica, a "raga, also spelled rag (in northern India) or ragam (in southern India), (from Sanskrit, meaning "colour" or "passion"), in the classical music of India, Bangladesh, and Pakistan" is "a melodic framework for improvisation and composition. A raga is based on a scale with a given set of notes, a typical order in which they appear in melodies, and characteristic musical motifs. The basic components of a raga can be written down in the form of a scale (in some cases differing in ascent and descent). By using only these notes, by emphasizing certain degrees of the scale, and by going from note to note in ways characteristic to the raga, the performer sets out to create a mood or atmosphere (rasa) that is unique to the raga in question. There are several hundred ragas in present use, and thousands are possible in theory."
Alapa, ( Sanskrit: "conversation") are "improvised melody structures that reveal the musical characteristics of a raga."  "Alapa ordinarily constitutes the first section of the performance of a raga. Vocal or instrumental, it is accompanied by a drone (sustained-tone) instrument and often also by a melodic instrument that repeats the soloist’s phrases after a lag of a few seconds. The principal portion of alapa is not metric but rhythmically free; in Hindustani music it moves gradually to a section known as jor, which uses a rhythmic pulse though no tala (metric cycle). The performer of the alapa gradually introduces the essential notes and melodic turns of the raga to be performed. Only when the soloist is satisfied that he has set forth the full range of melodic possibilities of the raga and has established its unique mood and personality will he proceed, without interruption, to the metrically organized section of the piece. If a drummer is present, as is usual in formal concert, his first beats serve as a signal to the listener that the alapa is concluded."