SEVERE WX : Winter Weather Advisory View Alerts
CLOSINGS: View Closings

Can Google replace photographers with an algorithm?

Like all mediocre photographers, Google's Clips camera occasionally lucks into some good pictures.The new $249...

Posted: Mar 31, 2018 11:30 PM
Updated: Mar 31, 2018 11:30 PM

Like all mediocre photographers, Google's Clips camera occasionally lucks into some good pictures.

The new $249 gadget, released in February, automates much of the job of a certain kind of photographer. You place the 2-inch high white square on a surface, preferably someplace frequented by children or pets. It automatically captures any "candid" scenes it determines are worthwhile with its wide-angle lens.

I spent a week with the camera, planting it on countertops, floors and shelves. Unfortunately my cat and bunny both passed away last year, so Clips only had children to work with. Luckily, my children are extremely good looking.

Even so, the resulting photos and videos had a common, soulless look to them. The wide-angle meant they were busy, with too much in focus and no appealing composition.

Essentially, Clips combines the hands-off approach of a surveillance camera with the visual style of a surveillance camera.

And yet, for a camera that silently watches you, Clips doesn't feel creepy. Google has been careful to avoid raising any privacy red flags. It stores all images and videos on the device. You preview photos using the Clips Android or iOS app over a one-to-one WiFI connection, and manually choose which ones to save to your smartphone.

While it might not succeed as a camera, it does raise interesting questions about what makes a photograph "good," and if you can ever program an algorithm to make art.

"The act of photography is the act of expression," said photographer Ben Long, author of "The Complete Digital Photography." "The [Clips] algorithm would just be the expression of the photographic ideas of whoever wrote that algorithm, minus the knowledge of what makes the scene around them interesting."

To come up with its special sauce, the Clips team asked professional photographers working at the company what they believe makes a good photo.

The software looks for children, animals, and faces, preferably within three-to-eight feet of the lens. Clips likes movement, but tries to avoid blurry photos and can tell when something is blocking the lens, like the hand of a curious child. It learns the faces of the people you save the most and takes more pictures of them. It is programmed to have a preference for happy, smiling faces.

Related: Google unveils new Pixel phones, speakers, futuristic headphones

Even when Clips follows the rules, the resulting photographs are mostly un-Instagrammable. Current trends favor highly stylized, painstakingly staged shots for social media. While cameras have gotten better at capturing reality, people have grown sophisticated enough to appreciate more abstraction in photography.

But the problem with Clips isn't just the execution or quality of photos. It's the underlying assumption that you can program a device to replicate the decisions that go into making a good picture.

"You can try to come up with all the rules you want for photography, and you can try to follow them perfectly and still come up with some very crappy photos," said Long after reviewing my test shots.

Rules can't predict the many small decisions a photographer makes in the moment, like where to stand, what moment to press the shutter button, or what part of an image to expose or keep in shadows. The mere presence of a photographer also has an influence on the picture. Taking pictures is an inherently social experience, says Long. The subject is always reacting to the photographer in some way.

Clips might not take off, but it is a sign of what could be next for photography. Companies are forging ahead with technologies that will automate and change the field. They're driven in part by the desire to improve smartphone photography without having to make giant phones. For example, cameras like the newer Pixel and iPhones use software to convincingly fake a shallow depth-of-field effects. The Light L16 camera uses 16 separate cameras to create one detailed image file that can be edited after the fact.

Related: Google wants you to experiment with its new photo apps

Clips builds on years of Google's own work by automating parts of photography. Google Photos has an "Assistant" option that handles some of the duller parts of managing a massive amount of photos, like choosing and editing the best shots, and making movies from videos.

Google doesn't see Clips as a replacement for photographers, but as another tool they can use.

"We see the importance of a human being in this," said Google's Juston Payne, the Clips product lead. "It can't move itself or compose a shot or get a good angle. The person is still exerting creative control, AI is just pressing the shutter button ... We think of it as a collaboration between people and AI and they are both completely necessary."

Minnesota Coronavirus Cases

Data is updated nightly.

Cases: 276500

Reported Deaths: 3321
CountyCasesDeaths
Hennepin590031089
Ramsey24988472
Anoka19724213
Dakota19215176
Washington12538106
Stearns1226689
Scott753854
St. Louis740897
Wright663436
Olmsted610130
Sherburne512539
Clay445155
Carver409712
Blue Earth373511
Rice361431
Kandiyohi348215
Crow Wing316130
Nobles296028
Chisago28398
Otter Tail266615
Benton261940
Winona246128
Mower236722
Polk228621
Douglas219829
Morrison211621
Lyon193711
McLeod18879
Beltrami184615
Goodhue177626
Becker17559
Itasca168924
Steele16756
Todd165312
Isanti165015
Carlton153610
Nicollet146523
Freeborn13935
Mille Lacs132830
Le Sueur13219
Waseca129710
Cass12018
Pine11926
Brown117510
Meeker10797
Roseau9923
Martin98220
Hubbard97022
Wabasha9121
Dodge7850
Redwood78018
Watonwan7754
Chippewa7697
Sibley7094
Renville70818
Cottonwood7060
Wadena7006
Aitkin68923
Pipestone67018
Rock6439
Houston6152
Fillmore6050
Yellow Medicine56611
Pennington5356
Kanabec52911
Murray5283
Swift4976
Pope4820
Faribault4750
Stevens4442
Clearwater4356
Marshall4277
Jackson4091
Lake3584
Unassigned34356
Koochiching3325
Wilkin3275
Lac qui Parle3203
Lincoln3141
Norman3096
Big Stone2771
Mahnomen2494
Grant2346
Red Lake1903
Kittson1856
Traverse1330
Lake of the Woods871
Cook580

Iowa Coronavirus Cases

Data is updated nightly.

Cases: 213603

Reported Deaths: 2193
CountyCasesDeaths
Polk31707324
Linn13442161
Scott1040375
Black Hawk10393127
Woodbury9932114
Johnson911635
Dubuque879290
Story647619
Dallas602856
Pottawattamie585166
Sioux351925
Webster335930
Marshall332942
Cerro Gordo326541
Clinton307737
Buena Vista291114
Muscatine270366
Des Moines270116
Plymouth259537
Warren258510
Wapello242871
Jones222212
Jasper206639
Marion194418
Carroll190920
Lee190315
Bremer182612
Henry17087
Crawford170615
Benton160315
Tama146340
Jackson13758
Delaware136221
Washington131313
Boone128811
Dickinson127510
Mahaska121327
Wright11625
Buchanan11009
Page10834
Hardin107510
Clay10624
Clayton10234
Harrison102328
Hamilton10157
Cedar101413
Calhoun10047
Mills9886
Fayette9768
Floyd96914
Lyon9668
Kossuth9464
Poweshiek93712
Butler9134
Winneshiek90310
Iowa88011
Winnebago87523
Louisa81316
Hancock8067
Grundy79710
Chickasaw7893
Sac7817
Cherokee7624
Cass75419
Appanoose7426
Shelby7265
Allamakee72411
Mitchell7184
Union7096
Guthrie70815
Emmet70623
Franklin68419
Humboldt6645
Madison6474
Jefferson6351
Palo Alto6064
Unassigned5950
Keokuk5397
Pocahontas5192
Howard5069
Greene4980
Osceola4941
Clarke4614
Davis4405
Ida43910
Montgomery43210
Taylor4312
Monroe42912
Adair4157
Monona3932
Fremont3463
Van Buren3364
Worth3360
Lucas3076
Decatur3000
Wayne2876
Audubon2831
Ringgold1892
Adams1551
Rochester
Overcast
32° wxIcon
Hi: 34° Lo: 31°
Feels Like: 25°
Mason City
Overcast
36° wxIcon
Hi: 36° Lo: 32°
Feels Like: 31°
Albert Lea
36° wxIcon
Hi: 36° Lo: 32°
Feels Like: 36°
Austin
36° wxIcon
Hi: 36° Lo: 32°
Feels Like: 36°
Charles City
Overcast
36° wxIcon
Hi: 37° Lo: 33°
Feels Like: 29°
Drier Conditions For Thanksgiving Day
KIMT Radar
KIMT Eye in the sky

Latest Video

Image

Sean's Weather 11/24

Image

Coat and Face mask distribution at United Way Freeborn County

Image

Rochester International Airport prepares for Thanksgiving travel

Image

Aaron's Monday Night Forecast

Image

TIC preseason projections

Image

Austin Bruins announce weekend plans

Image

Teams begin to navigate the pause on sports

Image

Rochester to create liquor license fee relief program

Image

A "Thank You" to health care workers

Image

Business operators react to Governor's latest plans

Community Events