View source for 20250218428. Framework (Oracle International)

= FRAMEWORK FOR FOCUSED TRAINING OF LANGUAGE MODELS AND TECHNIQUES FOR END-TO-END HYPERTUNING OF THE FRAMEWORK =

'''Abstract''':
techniques are disclosed herein for focused training of language models and end-to-end hypertuning of the framework. in one aspect, a method is provided that includes obtaining a machine learning model pre-trained for language modeling, and post-training the machine learning model for various tasks to generate a focused machine learning model. the post-training includes: (i) training the machine learning model on an unlabeled set of training data pertaining to a task that the machine learning model was pre-trained for as part of the language modeling, and the unlabeled set of training data is obtained with respect to a target domain, a target task, or a target language, and (ii) training the machine learning model on a labeled set of training data that pertains to another task that is an auxiliary task related to a downstream task to be performed using the machine learning model or output from the machine learning model.

'''Inventor(s)''': [[:Category:Poorya Zaremoodi of Melbourne  AU|Poorya Zaremoodi]], [[:Category:Cong Duy Vu Hoang of Wantirna South  AU|Cong Duy Vu Hoang]], [[:Category:Duy Vu of Melbourne  AU|Duy Vu]], [[:Category:Dai Hoang Tran of Sydney  AU|Dai Hoang Tran]], [[:Category:Budhaditya Saha of Sydney  AU|Budhaditya Saha]], [[:Category:Nagaraj N. Bhat of Bengaluru  IN|Nagaraj N. Bhat]], [[:Category:Thanh Tien Vu of Herston  AU|Thanh Tien Vu]], [[:Category:Tuyen Quang Pham of Springvale  AU|Tuyen Quang Pham]], [[:Category:Adam Craig Pocock of Burlington MA US|Adam Craig Pocock]], [[:Category:Katherine Silverstein of Somerville MA US|Katherine Silverstein]], [[:Category:Srinivasa Phani Kumar Gadde of Fremont CA US|Srinivasa Phani Kumar Gadde]], [[:Category:Vishal Vishnoi of Redwood City CA US|Vishal Vishnoi]], [[:Category:Mark Edward Johnson of Sydney  AU|Mark Edward Johnson]], [[:Category:Thanh Long Duong of Melbourne  AU|Thanh Long Duong]]

'''CPC Classification''': [[:Category:CPC_G10L15/063|G10L15/063]] (SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING)


[[Category:Patent Applications]]
[[Category:Oracle International Corporation]]
[[Category:CPC_G10L15/063]]
[[Category:Poorya Zaremoodi of Melbourne  AU]]
[[Category:Cong Duy Vu Hoang of Wantirna South  AU]]
[[Category:Duy Vu of Melbourne  AU]]
[[Category:Dai Hoang Tran of Sydney  AU]]
[[Category:Budhaditya Saha of Sydney  AU]]
[[Category:Nagaraj N. Bhat of Bengaluru  IN]]
[[Category:Thanh Tien Vu of Herston  AU]]
[[Category:Tuyen Quang Pham of Springvale  AU]]
[[Category:Adam Craig Pocock of Burlington MA US]]
[[Category:Katherine Silverstein of Somerville MA US]]
[[Category:Srinivasa Phani Kumar Gadde of Fremont CA US]]
[[Category:Vishal Vishnoi of Redwood City CA US]]
[[Category:Mark Edward Johnson of Sydney  AU]]
[[Category:Thanh Long Duong of Melbourne  AU]]

[https://wikipatents.org/index.php?search=20250218428+rejection&title=Special%3ASearch&wprov=acrw1_-1 Search for rejections for patent application number 20250218428]


<!-- JSON-LD markup for search engines:
{"@context":"https://schema.org","@type":"TechArticle","headline":"20250218428. Framework (Oracle International)","name":"20250218428. Framework (Oracle International)","description":"Patent application abstract and classification for 20250218428 - Framework For","datePublished":"2025-07-03","mainEntity":{"@type":"GovernmentPermit","permitType":"Patent Application","identifier":"20250218428","name":"Framework For","additionalProperty":[{"@type":"PropertyValue","name":"Organization","value":"Oracle International Corporation"}]}}
-->