SEVERE WX : Severe Thunderstorm Watch - Severe Thunderstorm Warning View Alerts

Can Google replace photographers with an algorithm?

Like all mediocre photographers, Google's Clips camera occasionally lucks into some good pictures.The new $249...

Posted: Mar 31, 2018 11:30 PM
Updated: Mar 31, 2018 11:30 PM

Like all mediocre photographers, Google's Clips camera occasionally lucks into some good pictures.

The new $249 gadget, released in February, automates much of the job of a certain kind of photographer. You place the 2-inch high white square on a surface, preferably someplace frequented by children or pets. It automatically captures any "candid" scenes it determines are worthwhile with its wide-angle lens.

I spent a week with the camera, planting it on countertops, floors and shelves. Unfortunately my cat and bunny both passed away last year, so Clips only had children to work with. Luckily, my children are extremely good looking.

Even so, the resulting photos and videos had a common, soulless look to them. The wide-angle meant they were busy, with too much in focus and no appealing composition.

Essentially, Clips combines the hands-off approach of a surveillance camera with the visual style of a surveillance camera.

And yet, for a camera that silently watches you, Clips doesn't feel creepy. Google has been careful to avoid raising any privacy red flags. It stores all images and videos on the device. You preview photos using the Clips Android or iOS app over a one-to-one WiFI connection, and manually choose which ones to save to your smartphone.

While it might not succeed as a camera, it does raise interesting questions about what makes a photograph "good," and if you can ever program an algorithm to make art.

"The act of photography is the act of expression," said photographer Ben Long, author of "The Complete Digital Photography." "The [Clips] algorithm would just be the expression of the photographic ideas of whoever wrote that algorithm, minus the knowledge of what makes the scene around them interesting."

To come up with its special sauce, the Clips team asked professional photographers working at the company what they believe makes a good photo.

The software looks for children, animals, and faces, preferably within three-to-eight feet of the lens. Clips likes movement, but tries to avoid blurry photos and can tell when something is blocking the lens, like the hand of a curious child. It learns the faces of the people you save the most and takes more pictures of them. It is programmed to have a preference for happy, smiling faces.

Related: Google unveils new Pixel phones, speakers, futuristic headphones

Even when Clips follows the rules, the resulting photographs are mostly un-Instagrammable. Current trends favor highly stylized, painstakingly staged shots for social media. While cameras have gotten better at capturing reality, people have grown sophisticated enough to appreciate more abstraction in photography.

But the problem with Clips isn't just the execution or quality of photos. It's the underlying assumption that you can program a device to replicate the decisions that go into making a good picture.

"You can try to come up with all the rules you want for photography, and you can try to follow them perfectly and still come up with some very crappy photos," said Long after reviewing my test shots.

Rules can't predict the many small decisions a photographer makes in the moment, like where to stand, what moment to press the shutter button, or what part of an image to expose or keep in shadows. The mere presence of a photographer also has an influence on the picture. Taking pictures is an inherently social experience, says Long. The subject is always reacting to the photographer in some way.

Clips might not take off, but it is a sign of what could be next for photography. Companies are forging ahead with technologies that will automate and change the field. They're driven in part by the desire to improve smartphone photography without having to make giant phones. For example, cameras like the newer Pixel and iPhones use software to convincingly fake a shallow depth-of-field effects. The Light L16 camera uses 16 separate cameras to create one detailed image file that can be edited after the fact.

Related: Google wants you to experiment with its new photo apps

Clips builds on years of Google's own work by automating parts of photography. Google Photos has an "Assistant" option that handles some of the duller parts of managing a massive amount of photos, like choosing and editing the best shots, and making movies from videos.

Google doesn't see Clips as a replacement for photographers, but as another tool they can use.

"We see the importance of a human being in this," said Google's Juston Payne, the Clips product lead. "It can't move itself or compose a shot or get a good angle. The person is still exerting creative control, AI is just pressing the shutter button ... We think of it as a collaboration between people and AI and they are both completely necessary."

Minnesota Coronavirus Cases

Data is updated nightly.

Confirmed Cases: 26273

Reported Deaths: 1126
CountyConfirmedDeaths
Hennepin8867641
Ramsey3252140
Stearns205014
Nobles15625
Anoka148878
Dakota141464
Washington68034
Olmsted67211
Kandiyohi5111
Rice4833
Scott4602
Clay44129
Mower4062
Wright3392
Todd3361
Sherburne2482
Carver2322
Benton1823
Steele1670
Blue Earth1480
Freeborn1420
Martin1325
St. Louis11814
Pine930
Nicollet8811
Lyon811
Winona8015
Cottonwood790
Watonwan780
Crow Wing774
Unassigned7511
Carlton750
Otter Tail730
Goodhue715
Chisago641
Polk612
Itasca5610
Dodge530
Chippewa521
Morrison480
Le Sueur461
Meeker460
Douglas450
Becker430
Jackson420
Murray400
McLeod390
Isanti360
Waseca270
Pennington230
Rock230
Mille Lacs231
Faribault200
Swift190
Beltrami180
Wabasha180
Fillmore171
Sibley160
Brown162
Norman150
Pipestone120
Marshall120
Kanabec121
Wilkin113
Cass112
Aitkin110
Wadena100
Pope100
Koochiching90
Big Stone80
Redwood70
Renville70
Mahnomen61
Lincoln60
Yellow Medicine60
Grant40
Traverse40
Red Lake40
Lac qui Parle30
Clearwater30
Roseau30
Hubbard30
Houston20
Kittson10
Lake10
Stevens10

Iowa Coronavirus Cases

Data is updated nightly.

Confirmed Cases: 20767

Reported Deaths: 583
CountyConfirmedDeaths
Polk4541137
Woodbury283737
Black Hawk177548
Buena Vista9971
Linn97179
Dallas94025
Marshall91218
Wapello62814
Johnson6189
Muscatine56541
Crawford5472
Tama41029
Scott38010
Dubuque35521
Louisa34911
Pottawattamie31110
Sioux2980
Jasper26917
Wright2120
Washington1958
Warren1661
Plymouth1462
Story1261
Allamakee1204
Mahaska9912
Poweshiek928
Henry722
Bremer706
Boone700
Des Moines671
Clarke660
Clinton651
Taylor640
Webster621
Hamilton610
Guthrie543
Cedar491
Benton431
Monroe415
Shelby370
Cherokee370
Jones370
Jefferson350
Marion350
Osceola340
Clayton343
Cerro Gordo331
Iowa330
Dickinson330
Buchanan330
Madison292
Lee290
Fayette280
Sac280
Davis280
Harrison260
Monona250
Clay250
Lyon240
Winneshiek240
Emmet240
Lucas222
Hardin210
Grundy200
Mills200
Delaware191
Humboldt191
Floyd191
Franklin170
Appanoose173
Hancock160
Butler161
Ida150
Greene150
Pocahontas150
Page140
Kossuth140
Keokuk140
Audubon131
Jackson130
Carroll130
Chickasaw130
Howard120
Cass120
Winnebago110
Montgomery91
Adair90
Union90
Van Buren90
Adams70
Palo Alto70
Calhoun60
Ringgold40
Mitchell40
Fremont40
Worth30
Wayne10
Decatur10
Unassigned00
Rochester
Clear
69° wxIcon
Hi: 87° Lo: 64°
Feels Like: 69°
Mason City
Overcast
67° wxIcon
Hi: 91° Lo: 66°
Feels Like: 67°
Albert Lea
Overcast
68° wxIcon
Hi: 87° Lo: 64°
Feels Like: 68°
Austin
Overcast
70° wxIcon
Hi: 89° Lo: 66°
Feels Like: 70°
Charles City
Overcast
68° wxIcon
Hi: 89° Lo: 66°
Feels Like: 68°
Another round of severe weather tonight
KIMT Radar
KIMT Eye in the sky

Latest Video

Image

Covid-19 Cases on the Rise

Image

Becoming a better ally

Image

Giving your best

Image

Coronavirus attacking your blood vessels?

Image

Young Protester's impact on police reform

Image

How important are school resource officers?

Image

bri first at 4

Image

Graffiti on Rochester trail

Image

Expedited breast cancer treatment

Image

Stock market makes a comeback

Community Events