BioNotes.Org

ML, vim, biology, math, and more

What Can A.I. Art Teach Us About the Real Thing?

  • Published: March 1, 2023

Main ideas

  • Types of image generators
  • Havanese and Avedon
  • is it a lightbulb or is it a lava lamp? But good art is probably more about lava lamps than lightbulbs.
  • systems like DALL-E 2 don’t operate on light and shadow; they operate on art history

Quotes

  • Quote from Gopnik’s NYer piece. “Instead, it proposes a recombinant approach to popular imagery as a means of making art. (The dialogue of popular imagery and modern art was, as it happens, the topic of that abandoned Ph.D. thesis.)”
  • “In effect, it exploits, and has installed in it as a premise, an idea specific to a particular heritage of image-making, the heritage of Symbolism, and then of the Surrealism that Symbolism engendered. Appropriately enough, the system takes its punning name from a Surrealist painter, since DALL-E 2 is ideally trimmed to make soft watches and derby hats on dogs and trains racing out of fireplaces.”
  • “The reason that DALL-E 2 is a machine for making Surrealist images is that the essence of such art is to be a dialogue between the prompter and the prompted. That’s why so much of the best Surrealist art is not terribly accomplished in itself as optical painting. Instead, it approximates and appropriates the slick styles of illustration, or subjects popular imagery to sudden dislocations. Max Ernst collages are the type of this kind, made from many common sources—cheap advertisements in the back of the newspaper or department-store catalogue—scissored together into a new appearance of meaning. “
  • “So, lava lamp or electric light? Surely a lava lamp, for now—a diversion of the moment. But then there is something to be said for the idea that art should always be more lava lamp than electric light. The light bulb, after all, is a supreme specimen of imitative technology, a mechanized candle. The lava lamp is a combination of things never before seen, curious and worth looking at for its own sweet sake.”
  • “The new visual A.I. is really a pictorial collider, the image-making equivalent of a particle accelerator that hurls subatomic bits together at high speeds to see what they will reveal as they slam into and fracture each other. In making images collide, we reveal the traces of our table of artistic elements.”
  • “That’s why the images that dall-e 2 makes are far more interesting than the texts that A.I. chatbots make. To be persuasive, a text demands a point; in contrast, looking at pictures, we can be fascinated by atmospheres and uncertainties.
  • “Even images made to persuade—such as propaganda posters or altarpieces—are only communicative through the intercession of our outside knowledge of the narratives that they illuminate. When you don’t know the story, even tutelary religious pictures become enigmatic.
  • “This happens to every student of Renaissance art who encounters a picture of an unfamiliar saint: In Leonardo da Vinci’s “The Last Supper,” the agitated language of hands would mean nothing—who’s pointing at what, and why?—without our knowing the story in advance. The same thing occurs with ancient ..Athenian vases, whenever the specific story is lost. Surrealism is the default condition of the narrative image. It takes an extraordinary scaffolding of wit to explicate a single image of wonder.
  • That’s not a weakness of images as a language of communication but a strength, and we’ve evolved a set of words that expresses their peculiar power to cast a spell without making a point. We don’t talk about pictures being persuasive, convincing, pointed. We talk about them being haunting, entrancing, unforgettable.
  • “Surely this helps explain why A.I. pictures tend, for now, to be more compelling than A.I. prose. When you ask for a song about Paris in the manner of Cole Porter, you’ll invariably get a skillful string of clichés: “Oh Paris, city of love and delight, / Where the Seine flows, so elegant and bright.”
  • It’s astonishing that such a thing gets conjured up at all, but it isn’t remotely Porter. On the other hand, asked to make a watercolor of a Paris street in the style of Porter’s great contemporary and friend Charles Demuth, dall-e 2 generates something that’s weirdly credible.
  • “The dall-e 2 system, by setting images free from neat, argumentative intentions, reducing them to responses to “prompts,” reminds us that pictures exist in a different world of meaning from prose. Something similar happens when we prompt ChatGPT to write a Beatles song about René Magritte. That it produces anything at all is impressive, but what it produces is not Beatlesesque. (My results: “Rene Magritte, oh can’t you see? / Your art is like a mystery. / With apples and pipes, and a bird in a cage / You bring us to another age.”) Yet, asked to make an album cover in Magritte’s manner, dall-e 2 responds in ways that are often arresting, even witty.
  • “For instance, we typically talk about artistic style as a function or feature separate from the subjects of art: the Impressionist style is a way of painting, and the objects it attaches to—haystacks, or picnics, or Paris boulevards—are just instances of what the style can act on. Then one realizes that, for an art-making machine, style is inextricable from the subject matter that it usually superintends.
  • “Ask for a Constable interior, and one may get cows or sheep in a library. Ask for a Constable of Times Square and one is likely to get—well, confusion, almost the aesthetic equivalent of a program spitting out an “undefined value” error.
  • “What Constable would have made of a New York City space is in a sense an unanswerable question. Constable’s style is not a habit of brushstrokes applied to a particular kind of English landscape; it is bound up in a particular kind of English landscape. Prompted to do a pointillist painting of a wedding in the manner of Seurat, in turn, dall-e 2 draws on top hats and pyramidal shapes and high-waisted dresses with long skirts. But asked to do a pointillist painting of Times Square, it produces something unstructured and primitive-seeming, as helpless as Seurat would have been at this task.”
  • “But it is also a reminder. Seurat is his people, as van Gogh is his cypresses. The people on the Grande Jatte cannot have friezelike gravity without their already sober costumes.
  • “We pass by subject matter on our way to syntax, since, in our critical establishment, still forged in the aftermath of abstraction, style tends to be highly valued and subject matter regarded as a bit banal.
  • “Yet a giveaway, a tell to the secrets and potential of the program does eventually appear. It lies in the frequent suggestions that the program makes to the prompter. “Make improbable images,” it urges. “Ask for something never seen before.” And it offers, as you wait for your own image, instances of success, chimerical creatures and impossible worlds. This is not a machine to draw the world. Instead, it proposes a recombinant approach to popular imagery as a means of making art.
  • “the heritage of Symbolism, and then of the Surrealism that Symbolism engendered. Appropriately enough, the system takes its punning name from a Surrealist painter, since dall-e 2 is ideally trimmed to make soft watches and derby hats on dogs and trains racing out of fireplaces.
  • “So, lava lamp or electric light? Surely a lava lamp, for now—a diversion of the moment. But then there is something to be said for the idea that art should always be more lava lamp than electric light. The light bulb, after all, is a supreme specimen of imitative technology, a mechanized candle. The lava lamp is a combination of things never before seen, curious and worth looking at for its own sweet sake.