Shepherd: High-Scale, Low-Latency Machine Learning with Flink at Stripe

schedule

Tuesday, October 15, 1:10pm - 1:30pm (EDT)

south_america expand_more Time shown in-05:00 America, New York
search
close

Time zone

am/pm

24h

  • (GMT-11:00)Pacific, Midway
  • (GMT-11:00)Pacific, Niue
  • (GMT-11:00)Pacific, Pago Pago
  • (GMT-10:00)America, Adak
  • (GMT-10:00)Pacific, Honolulu
  • (GMT-10:00)Pacific, Rarotonga
  • (GMT-10:00)Pacific, Tahiti
  • (GMT-09:30)Pacific, Marquesas
  • (GMT-09:00)America, Anchorage
  • (GMT-09:00)America, Juneau
  • (GMT-09:00)America, Metlakatla
  • (GMT-09:00)America, Nome
  • (GMT-09:00)America, Sitka
  • (GMT-09:00)America, Yakutat
  • (GMT-09:00)Pacific, Gambier
  • (GMT-08:00)America, Los Angeles
  • (GMT-08:00)America, Tijuana
  • (GMT-08:00)America, Vancouver
  • (GMT-08:00)Pacific, Pitcairn
  • (GMT-07:00)America, Boise
  • (GMT-07:00)America, Cambridge Bay
  • (GMT-07:00)America, Ciudad Juarez
  • (GMT-07:00)America, Creston
  • (GMT-07:00)America, Dawson
  • (GMT-07:00)America, Dawson Creek
  • (GMT-07:00)America, Denver
  • (GMT-07:00)America, Edmonton
  • (GMT-07:00)America, Fort Nelson
  • (GMT-07:00)America, Hermosillo
  • (GMT-07:00)America, Inuvik
  • (GMT-07:00)America, Mazatlan
  • (GMT-07:00)America, Phoenix
  • (GMT-07:00)America, Whitehorse
  • (GMT-06:00)America, Bahia Banderas
  • (GMT-06:00)America, Belize
  • (GMT-06:00)America, Chicago
  • (GMT-06:00)America, Chihuahua
  • (GMT-06:00)America, Costa Rica
  • (GMT-06:00)America, El Salvador
  • (GMT-06:00)America, Guatemala
  • (GMT-06:00)America, Indiana, Knox
  • (GMT-06:00)America, Indiana, Tell City
  • (GMT-06:00)America, Managua
  • (GMT-06:00)America, Matamoros
  • (GMT-06:00)America, Menominee
  • (GMT-06:00)America, Merida
  • (GMT-06:00)America, Mexico City
  • (GMT-06:00)America, Monterrey
  • (GMT-06:00)America, North Dakota, Beulah
  • (GMT-06:00)America, North Dakota, Center
  • (GMT-06:00)America, North Dakota, New Salem
  • (GMT-06:00)America, Ojinaga
  • (GMT-06:00)America, Rankin Inlet
  • (GMT-06:00)America, Regina
  • (GMT-06:00)America, Resolute
  • (GMT-06:00)America, Swift Current
  • (GMT-06:00)America, Tegucigalpa
  • (GMT-06:00)America, Winnipeg
  • (GMT-06:00)Pacific, Galapagos
  • (GMT-05:00)America, Atikokan
  • (GMT-05:00)America, Bogota
  • (GMT-05:00)America, Cancun
  • (GMT-05:00)America, Cayman
  • (GMT-05:00)America, Detroit
  • (GMT-05:00)America, Eirunepe
  • (GMT-05:00)America, Grand Turk
  • (GMT-05:00)America, Guayaquil
  • (GMT-05:00)America, Havana
  • (GMT-05:00)America, Indiana, Indianapolis
  • (GMT-05:00)America, Indiana, Marengo
  • (GMT-05:00)America, Indiana, Petersburg
  • (GMT-05:00)America, Indiana, Vevay
  • (GMT-05:00)America, Indiana, Vincennes
  • (GMT-05:00)America, Indiana, Winamac
  • (GMT-05:00)America, Iqaluit
  • (GMT-05:00)America, Jamaica
  • (GMT-05:00)America, Kentucky, Louisville
  • (GMT-05:00)America, Kentucky, Monticello
  • (GMT-05:00)America, Lima
  • (GMT-05:00)America, Nassau
  • (GMT-05:00)America, New York
  • (GMT-05:00)America, Panama
  • (GMT-05:00)America, Port-au-Prince
  • (GMT-05:00)America, Rio Branco
  • (GMT-05:00)America, Toronto
  • (GMT-05:00)Pacific, Easter
  • (GMT-04:00)America, Anguilla
  • (GMT-04:00)America, Antigua
  • (GMT-04:00)America, Aruba
  • (GMT-04:00)America, Barbados
  • (GMT-04:00)America, Blanc-Sablon
  • (GMT-04:00)America, Boa Vista
  • (GMT-04:00)America, Campo Grande
  • (GMT-04:00)America, Caracas
  • (GMT-04:00)America, Cuiaba
  • (GMT-04:00)America, Curacao
  • (GMT-04:00)America, Dominica
  • (GMT-04:00)America, Glace Bay
  • (GMT-04:00)America, Goose Bay
  • (GMT-04:00)America, Grenada
  • (GMT-04:00)America, Guadeloupe
  • (GMT-04:00)America, Guyana
  • (GMT-04:00)America, Halifax
  • (GMT-04:00)America, Kralendijk
  • (GMT-04:00)America, La Paz
  • (GMT-04:00)America, Lower Princes
  • (GMT-04:00)America, Manaus
  • (GMT-04:00)America, Marigot
  • (GMT-04:00)America, Martinique
  • (GMT-04:00)America, Moncton
  • (GMT-04:00)America, Montserrat
  • (GMT-04:00)America, Port of Spain
  • (GMT-04:00)America, Porto Velho
  • (GMT-04:00)America, Puerto Rico
  • (GMT-04:00)America, Santo Domingo
  • (GMT-04:00)America, St Barthelemy
  • (GMT-04:00)America, St Kitts
  • (GMT-04:00)America, St Lucia
  • (GMT-04:00)America, St Thomas
  • (GMT-04:00)America, St Vincent
  • (GMT-04:00)America, Thule
  • (GMT-04:00)America, Tortola
  • (GMT-04:00)Atlantic, Bermuda
  • (GMT-03:30)America, St Johns
  • (GMT-03:00)America, Araguaina
  • (GMT-03:00)America, Argentina, Buenos Aires
  • (GMT-03:00)America, Argentina, Catamarca
  • (GMT-03:00)America, Argentina, Cordoba
  • (GMT-03:00)America, Argentina, Jujuy
  • (GMT-03:00)America, Argentina, La Rioja
  • (GMT-03:00)America, Argentina, Mendoza
  • (GMT-03:00)America, Argentina, Rio Gallegos
  • (GMT-03:00)America, Argentina, Salta
  • (GMT-03:00)America, Argentina, San Juan
  • (GMT-03:00)America, Argentina, San Luis
  • (GMT-03:00)America, Argentina, Tucuman
  • (GMT-03:00)America, Argentina, Ushuaia
  • (GMT-03:00)America, Asuncion
  • (GMT-03:00)America, Bahia
  • (GMT-03:00)America, Belem
  • (GMT-03:00)America, Cayenne
  • (GMT-03:00)America, Fortaleza
  • (GMT-03:00)America, Maceio
  • (GMT-03:00)America, Miquelon
  • (GMT-03:00)America, Montevideo
  • (GMT-03:00)America, Paramaribo
  • (GMT-03:00)America, Punta Arenas
  • (GMT-03:00)America, Recife
  • (GMT-03:00)America, Santarem
  • (GMT-03:00)America, Santiago
  • (GMT-03:00)America, Sao Paulo
  • (GMT-03:00)Antarctica, Palmer
  • (GMT-03:00)Antarctica, Rothera
  • (GMT-03:00)Atlantic, Stanley
  • (GMT-02:00)America, Noronha
  • (GMT-02:00)America, Nuuk
  • (GMT-02:00)America, Scoresbysund
  • (GMT-02:00)Atlantic, South Georgia
  • (GMT-01:00)Atlantic, Azores
  • (GMT-01:00)Atlantic, Cape Verde
  • (GMT+00:00)Africa, Abidjan
  • (GMT+00:00)Africa, Accra
  • (GMT+00:00)Africa, Bamako
  • (GMT+00:00)Africa, Banjul
  • (GMT+00:00)Africa, Bissau
  • (GMT+00:00)Africa, Conakry
  • (GMT+00:00)Africa, Dakar
  • (GMT+00:00)Africa, Freetown
  • (GMT+00:00)Africa, Lome
  • (GMT+00:00)Africa, Monrovia
  • (GMT+00:00)Africa, Nouakchott
  • (GMT+00:00)Africa, Ouagadougou
  • (GMT+00:00)Africa, Sao Tome
  • (GMT+00:00)America, Danmarkshavn
  • (GMT+00:00)Antarctica, Troll
  • (GMT+00:00)Atlantic, Canary
  • (GMT+00:00)Atlantic, Faroe
  • (GMT+00:00)Atlantic, Madeira
  • (GMT+00:00)Atlantic, Reykjavik
  • (GMT+00:00)Atlantic, St Helena
  • (GMT+00:00)Europe, Dublin
  • (GMT+00:00)Europe, Guernsey
  • (GMT+00:00)Europe, Isle of Man
  • (GMT+00:00)Europe, Jersey
  • (GMT+00:00)Europe, Lisbon
  • (GMT+00:00)Europe, London
  • (GMT+00:00)UTC
  • (GMT+01:00)Africa, Algiers
  • (GMT+01:00)Africa, Bangui
  • (GMT+01:00)Africa, Brazzaville
  • (GMT+01:00)Africa, Casablanca
  • (GMT+01:00)Africa, Ceuta
  • (GMT+01:00)Africa, Douala
  • (GMT+01:00)Africa, El Aaiun
  • (GMT+01:00)Africa, Kinshasa
  • (GMT+01:00)Africa, Lagos
  • (GMT+01:00)Africa, Libreville
  • (GMT+01:00)Africa, Luanda
  • (GMT+01:00)Africa, Malabo
  • (GMT+01:00)Africa, Ndjamena
  • (GMT+01:00)Africa, Niamey
  • (GMT+01:00)Africa, Porto-Novo
  • (GMT+01:00)Africa, Tunis
  • (GMT+01:00)Arctic, Longyearbyen
  • (GMT+01:00)Europe, Amsterdam
  • (GMT+01:00)Europe, Andorra
  • (GMT+01:00)Europe, Belgrade
  • (GMT+01:00)Europe, Berlin
  • (GMT+01:00)Europe, Bratislava
  • (GMT+01:00)Europe, Brussels
  • (GMT+01:00)Europe, Budapest
  • (GMT+01:00)Europe, Busingen
  • (GMT+01:00)Europe, Copenhagen
  • (GMT+01:00)Europe, Gibraltar
  • (GMT+01:00)Europe, Ljubljana
  • (GMT+01:00)Europe, Luxembourg
  • (GMT+01:00)Europe, Madrid
  • (GMT+01:00)Europe, Malta
  • (GMT+01:00)Europe, Monaco
  • (GMT+01:00)Europe, Oslo
  • (GMT+01:00)Europe, Paris
  • (GMT+01:00)Europe, Podgorica
  • (GMT+01:00)Europe, Prague
  • (GMT+01:00)Europe, Rome
  • (GMT+01:00)Europe, San Marino
  • (GMT+01:00)Europe, Sarajevo
  • (GMT+01:00)Europe, Skopje
  • (GMT+01:00)Europe, Stockholm
  • (GMT+01:00)Europe, Tirane
  • (GMT+01:00)Europe, Vaduz
  • (GMT+01:00)Europe, Vatican
  • (GMT+01:00)Europe, Vienna
  • (GMT+01:00)Europe, Warsaw
  • (GMT+01:00)Europe, Zagreb
  • (GMT+01:00)Europe, Zurich
  • (GMT+02:00)Africa, Blantyre
  • (GMT+02:00)Africa, Bujumbura
  • (GMT+02:00)Africa, Cairo
  • (GMT+02:00)Africa, Gaborone
  • (GMT+02:00)Africa, Harare
  • (GMT+02:00)Africa, Johannesburg
  • (GMT+02:00)Africa, Juba
  • (GMT+02:00)Africa, Khartoum
  • (GMT+02:00)Africa, Kigali
  • (GMT+02:00)Africa, Lubumbashi
  • (GMT+02:00)Africa, Lusaka
  • (GMT+02:00)Africa, Maputo
  • (GMT+02:00)Africa, Maseru
  • (GMT+02:00)Africa, Mbabane
  • (GMT+02:00)Africa, Tripoli
  • (GMT+02:00)Africa, Windhoek
  • (GMT+02:00)Asia, Beirut
  • (GMT+02:00)Asia, Famagusta
  • (GMT+02:00)Asia, Gaza
  • (GMT+02:00)Asia, Hebron
  • (GMT+02:00)Asia, Jerusalem
  • (GMT+02:00)Asia, Nicosia
  • (GMT+02:00)Europe, Athens
  • (GMT+02:00)Europe, Bucharest
  • (GMT+02:00)Europe, Chisinau
  • (GMT+02:00)Europe, Helsinki
  • (GMT+02:00)Europe, Kaliningrad
  • (GMT+02:00)Europe, Kyiv
  • (GMT+02:00)Europe, Mariehamn
  • (GMT+02:00)Europe, Riga
  • (GMT+02:00)Europe, Sofia
  • (GMT+02:00)Europe, Tallinn
  • (GMT+02:00)Europe, Vilnius
  • (GMT+03:00)Africa, Addis Ababa
  • (GMT+03:00)Africa, Asmara
  • (GMT+03:00)Africa, Dar es Salaam
  • (GMT+03:00)Africa, Djibouti
  • (GMT+03:00)Africa, Kampala
  • (GMT+03:00)Africa, Mogadishu
  • (GMT+03:00)Africa, Nairobi
  • (GMT+03:00)Antarctica, Syowa
  • (GMT+03:00)Asia, Aden
  • (GMT+03:00)Asia, Amman
  • (GMT+03:00)Asia, Baghdad
  • (GMT+03:00)Asia, Bahrain
  • (GMT+03:00)Asia, Damascus
  • (GMT+03:00)Asia, Kuwait
  • (GMT+03:00)Asia, Qatar
  • (GMT+03:00)Asia, Riyadh
  • (GMT+03:00)Europe, Istanbul
  • (GMT+03:00)Europe, Kirov
  • (GMT+03:00)Europe, Minsk
  • (GMT+03:00)Europe, Moscow
  • (GMT+03:00)Europe, Simferopol
  • (GMT+03:00)Europe, Volgograd
  • (GMT+03:00)Indian, Antananarivo
  • (GMT+03:00)Indian, Comoro
  • (GMT+03:00)Indian, Mayotte
  • (GMT+03:30)Asia, Tehran
  • (GMT+04:00)Asia, Baku
  • (GMT+04:00)Asia, Dubai
  • (GMT+04:00)Asia, Muscat
  • (GMT+04:00)Asia, Tbilisi
  • (GMT+04:00)Asia, Yerevan
  • (GMT+04:00)Europe, Astrakhan
  • (GMT+04:00)Europe, Samara
  • (GMT+04:00)Europe, Saratov
  • (GMT+04:00)Europe, Ulyanovsk
  • (GMT+04:00)Indian, Mahe
  • (GMT+04:00)Indian, Mauritius
  • (GMT+04:00)Indian, Reunion
  • (GMT+04:30)Asia, Kabul
  • (GMT+05:00)Antarctica, Mawson
  • (GMT+05:00)Antarctica, Vostok
  • (GMT+05:00)Asia, Almaty
  • (GMT+05:00)Asia, Aqtau
  • (GMT+05:00)Asia, Aqtobe
  • (GMT+05:00)Asia, Ashgabat
  • (GMT+05:00)Asia, Atyrau
  • (GMT+05:00)Asia, Dushanbe
  • (GMT+05:00)Asia, Karachi
  • (GMT+05:00)Asia, Oral
  • (GMT+05:00)Asia, Qostanay
  • (GMT+05:00)Asia, Qyzylorda
  • (GMT+05:00)Asia, Samarkand
  • (GMT+05:00)Asia, Tashkent
  • (GMT+05:00)Asia, Yekaterinburg
  • (GMT+05:00)Indian, Kerguelen
  • (GMT+05:00)Indian, Maldives
  • (GMT+05:30)Asia, Colombo
  • (GMT+05:30)Asia, Kolkata
  • (GMT+05:45)Asia, Kathmandu
  • (GMT+06:00)Asia, Bishkek
  • (GMT+06:00)Asia, Dhaka
  • (GMT+06:00)Asia, Omsk
  • (GMT+06:00)Asia, Thimphu
  • (GMT+06:00)Asia, Urumqi
  • (GMT+06:00)Indian, Chagos
  • (GMT+06:30)Asia, Yangon
  • (GMT+06:30)Indian, Cocos
  • (GMT+07:00)Antarctica, Davis
  • (GMT+07:00)Asia, Bangkok
  • (GMT+07:00)Asia, Barnaul
  • (GMT+07:00)Asia, Ho Chi Minh
  • (GMT+07:00)Asia, Hovd
  • (GMT+07:00)Asia, Jakarta
  • (GMT+07:00)Asia, Krasnoyarsk
  • (GMT+07:00)Asia, Novokuznetsk
  • (GMT+07:00)Asia, Novosibirsk
  • (GMT+07:00)Asia, Phnom Penh
  • (GMT+07:00)Asia, Pontianak
  • (GMT+07:00)Asia, Tomsk
  • (GMT+07:00)Asia, Vientiane
  • (GMT+07:00)Indian, Christmas
  • (GMT+08:00)Antarctica, Casey
  • (GMT+08:00)Asia, Brunei
  • (GMT+08:00)Asia, Hong Kong
  • (GMT+08:00)Asia, Irkutsk
  • (GMT+08:00)Asia, Kuala Lumpur
  • (GMT+08:00)Asia, Kuching
  • (GMT+08:00)Asia, Macau
  • (GMT+08:00)Asia, Makassar
  • (GMT+08:00)Asia, Manila
  • (GMT+08:00)Asia, Shanghai
  • (GMT+08:00)Asia, Singapore
  • (GMT+08:00)Asia, Taipei
  • (GMT+08:00)Asia, Ulaanbaatar
  • (GMT+08:00)Australia, Perth
  • (GMT+08:45)Australia, Eucla
  • (GMT+09:00)Asia, Chita
  • (GMT+09:00)Asia, Dili
  • (GMT+09:00)Asia, Jayapura
  • (GMT+09:00)Asia, Khandyga
  • (GMT+09:00)Asia, Pyongyang
  • (GMT+09:00)Asia, Seoul
  • (GMT+09:00)Asia, Tokyo
  • (GMT+09:00)Asia, Yakutsk
  • (GMT+09:00)Pacific, Palau
  • (GMT+09:30)Australia, Darwin
  • (GMT+10:00)Antarctica, DumontDUrville
  • (GMT+10:00)Asia, Ust-Nera
  • (GMT+10:00)Asia, Vladivostok
  • (GMT+10:00)Australia, Brisbane
  • (GMT+10:00)Australia, Lindeman
  • (GMT+10:00)Pacific, Chuuk
  • (GMT+10:00)Pacific, Guam
  • (GMT+10:00)Pacific, Port Moresby
  • (GMT+10:00)Pacific, Saipan
  • (GMT+10:30)Australia, Adelaide
  • (GMT+10:30)Australia, Broken Hill
  • (GMT+11:00)Antarctica, Macquarie
  • (GMT+11:00)Asia, Magadan
  • (GMT+11:00)Asia, Sakhalin
  • (GMT+11:00)Asia, Srednekolymsk
  • (GMT+11:00)Australia, Hobart
  • (GMT+11:00)Australia, Lord Howe
  • (GMT+11:00)Australia, Melbourne
  • (GMT+11:00)Australia, Sydney
  • (GMT+11:00)Pacific, Bougainville
  • (GMT+11:00)Pacific, Efate
  • (GMT+11:00)Pacific, Guadalcanal
  • (GMT+11:00)Pacific, Kosrae
  • (GMT+11:00)Pacific, Noumea
  • (GMT+11:00)Pacific, Pohnpei
  • (GMT+12:00)Asia, Anadyr
  • (GMT+12:00)Asia, Kamchatka
  • (GMT+12:00)Pacific, Fiji
  • (GMT+12:00)Pacific, Funafuti
  • (GMT+12:00)Pacific, Kwajalein
  • (GMT+12:00)Pacific, Majuro
  • (GMT+12:00)Pacific, Nauru
  • (GMT+12:00)Pacific, Norfolk
  • (GMT+12:00)Pacific, Tarawa
  • (GMT+12:00)Pacific, Wake
  • (GMT+12:00)Pacific, Wallis
  • (GMT+13:00)Antarctica, McMurdo
  • (GMT+13:00)Pacific, Apia
  • (GMT+13:00)Pacific, Auckland
  • (GMT+13:00)Pacific, Fakaofo
  • (GMT+13:00)Pacific, Kanton
  • (GMT+13:00)Pacific, Tongatapu
  • (GMT+13:45)Pacific, Chatham
  • (GMT+14:00)Pacific, Kiritimati

Suggestions

Your search did not return any results.

    Speakers: Caio Camatta, Divya Manohar

    Stripe, a leading financial infrastructure platform, extensively utilizes ML in its products for use cases such as fraud prevention and Radar. To support ML engineering, we developed Shepherd, a low-latency, real-time ML feature computation and serving platform built on the open-source Chronon project. Shepherd processes 10,000s of events per second in <150ms at p99, serves feature values in <30ms (p95), and has an uptime of >99.9%. This talk will delve into Shepherd's online architecture, including its usage of Flink, its tiled data storage strategy, and the control plane built to automate infrastructure provisioning and accelerate feature development.

    Add to Calendar 2024/10/15 10:10:00 2024/10/15 10:30:00 America/Los_Angeles Shepherd: High-Scale, Low-Latency Machine Learning with Flink at Stripe Speakers: Caio Camatta, Divya Manohar

    Stripe, a leading financial infrastructure platform, extensively utilizes ML in its products for use cases such as fraud prevention and Radar. To support ML engineering, we developed Shepherd, a low-latency, real-time ML feature computation and serving platform built on the open-source Chronon project. Shepherd processes 10,000s of events per second in <150ms at p99, serves feature values in <30ms (p95), and has an uptime of >99.9%. This talk will delve into Shepherd's online architecture, including its usage of Flink, its tiled data storage strategy, and the control plane built to automate infrastructure provisioning and accelerate feature development.

    Online false MM/DD/YYYY 30 OPAQUE apQfLtmRnzOiFbgoNmal132273
    location_on

    Online

    person

    Feature Store Summit 2024