20250190459. Systems Methods Develo (DataRobot, .)
SYSTEMS AND METHODS FOR DEVELOPMENT, ASSESSMENT, AND/OR MONITORING OF A GENERATIVE AI SYSTEM
Abstract: a method for developing a generative ai system may include constructing a plurality of generative ai systems, wherein constructing the generative ai systems includes executing at least one modeling blueprint; providing a plurality of queries to each of the generative ai systems, the queries being part of an evaluation dataset; during processing of the queries by each generative ai system, monitoring values of one or more quantitative metrics; providing, for display by a user device, data indicating the values of the quantitative metrics for each generative ai system; and providing, for display by the user device, a recommendation regarding use or non-use of at least one generative ai system included in the plurality of generative ai systems.
Inventor(s): Alexander Jason Conway, Stefan Hackman, Michael Schmidt, Debanjan Saha, Jay Schuren, Mark L. Steadman, Venkatesh Veeraraghavan, Mikalai Valynets, Achraf Hamrit, Jillian Schwiep, Marcus Braun, Asli Sabanci Demiroz, Mykola Novik, Brian Bell, Marshall Krassenstein
CPC Classification: G06F16/3329 ({Natural language query formulation or dialogue systems})
Search for rejections for patent application number 20250190459
- Patent Applications
- DataRobot, Inc.
- CPC G06F16/3329
- Alexander Jason Conway of Boston MA US
- Stefan Hackman of Schliersee DE
- Michael Schmidt of Washington DC US
- Debanjan Saha of Los Altos CA US
- Jay Schuren of Lunenberg MA US
- Mark L. Steadman of Watertown MA US
- Venkatesh Veeraraghavan of Seattle WA US
- Mikalai Valynets of Munich DE
- Achraf Hamrit of Dubai AE
- Jillian Schwiep of San Francisco MA US
- Marcus Braun of Minneapolis MN US
- Asli Sabanci Demiroz of Campbell CA US
- Mykola Novik of Melrose MA US
- Brian Bell of Copenhagen DK
- Marshall Krassenstein of Pittsburgh PA US