INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) (19) World Intellectual Property C.--.` MD HIM 011101011M 01 11010101111111111011110011101101110111 OEN Organization International Bureau (10) International Publication Number 03 (43) International Publication Date ......P' WO 2018/081640 Al 03 May 2018 (03.05.2018) WIP0 I PCT (51) International Patent Classification: Sciences LLC, 269 East Grand Ave., South San Francis- GOOF 19/00 (2011.01) GOOK 9/62 (2006.01) co, California 94080 (US). KRISHNAN, Dilip; c/o Verily GOOK 9 / 4 6 (2006.01) G06T 7/00 (2017.01) Life Sciences LLC, 269 East Grand Ave., South San Fran- GOOK 9 / 5 2 (2006.01) cisco, California 94080 (US). L1VNI, Josh; c/o Verily Life Sciences LLC, 269 East Grand Ave., South San Francis- (21) International Application Number: PCT/US2017/058872 co, California 94080 (US). DESNOYER, Mark; c/o Verily Life Sciences LLC, 269 East Grand Ave., South San Fran- (22) International Filing Date: cisco, California 94080 (US). 27 October 2017 (27.10.2017) (74) Agent: MCALLISTER, Tyler et al.; Kilpatrick Townsend (25) Filing Language: English & Stockton LLP, Mailstop: IP Docketing - 22, 1100 Peachtree Street, N.E., Suite 2800, Atlanta, Georgia 30309 (26) Publication Language: English (US). (30) Priority Data: (81) Designated States (unless otherwise indicated, for every 62/414,597 28 October 2016 (28.10.2016) US kind of national protection available): AE, AG, AL, AM, (71) Applicant: VERILY LIFE SCIENCES LLC [US/US]; AO, AT, AU, AZ, BA, BB, BG, BH, BN, BR, BW, BY, BZ, 269 East Grand Ave., South San Francisco, California CA, CH, CL, CN, CO, CR, CU, CZ, DE, DJ, DK, DM, DO, 94080 (US). DZ, EC, EE, EG, ES, FI, GB, GD, GE, GH, GM, GT, HN, HR, HU, ID, IL, IN, IR, IS, JO, JP, KE, KG, KH, KN, KP, (72) Inventors: ZHA, Tiantian; c/o Verily Life Sciences LLC, KR, KW, KZ, LA, LC, LK, LR, LS, LU, LY, MA, MD, ME, — 269 East Grand Ave., South San Francisco, California MG, MK, MN, MW, MX, MY, MZ, NA, NG, NI, NO, NZ, 94080 (US). OVADIA, Yaniv; c/o Verily Life Sciences OM, PA, PE, PG, PH, PL, PT, QA, RO, RS, RU, RW, SA, = LLC, 269 East Grand Ave., South San Francisco, Califor- nia 94080 (US). NEWBURGER, Daniel; c/o Verily Life = = (54) Title: PREDICTIVE MODELS FOR VISUALLY CLASSIFYING INSECTS = = = 102 1, 1 . 104 - 1 6 — _.I _ 108 ACCESS 114 AN WAGE DEPICTING PLURALITY OF INSECTS 112 — = = 1208 I-120N 1145 114N .._ _. • IDEN1IFY PATCH FROM MAT DEPICTS INSECT= AN IMAGE THE IMAGE AN = = = 106 = USE A PREILTAIE - i = PREDICTIVE MODE JIQ MOOEL TO EVALUATE IMAGE PATCH TO „)[ACRE INSECT(S). CLASSTY INSECT(S), AND/OR COUNT 106 iNsEcr(s)j22 11 .4 © 71' V; JJ 06 OUTPUT INSECT IN FROM THE PREDICTIVE MODEL CORRESPOIOING 10 THE EVALUATION OF THE IMAGE PATCH 124 11 GC FIG. 1 © . --- - GC (57) : Insects can be localized and classified using a predictive model. To begin, image data is obtained that corresponds to the 1 -1 insects.. Using a predictive model, samples of the image data are evaluated to determine whether the image portions include an insect 0 and, if so, into what category the insect should be classified (e.g., male/female, species A/species B, etc.). ei o [Continued on next page] WO 2018/081640 Al MIDEDIMOMMIDIRERIONEHOHINHOIHMEEN SC, SD, SE, SG, SK, SL, SM, ST, SV, SY, TH, TJ, TM, TN, TR, TT, TZ, UA, UG, US, UZ, VC, VN, ZA, ZM, ZW. (84) Designated States (unless otherwise indicated, for every kind of regional protection available): ARIPO (BW, GH, GM, KE, LR, LS, MW, MZ, NA, RW, SD, SL, ST, SZ, TZ, UG, ZM, ZW), Eurasian (AM, AZ, BY, KG, KZ, RU, TJ, TM), European (AL, AT, BE, BG, CH, CY, CZ, DE, DK, EE, ES, FI, FR, GB, GR, HR, HU, IE, IS, IT, LT, LU, LV, MC, MK, MT, NL, NO, PL, PT, RO, RS, SE, SI, SK, SM, TR), OAPI (BF, BJ, CF, CG, CI, CM, GA, GN, GQ, GW, KM, ML, MR, NE, SN, TD, TG). Published: — with international search report (Art. 21(3))
PREDICTIVE MODELS FOR VISUALLY CLASSIFYING INSECTS