{"id":22889,"date":"2021-04-22T20:03:52","date_gmt":"2021-04-22T20:03:52","guid":{"rendered":"https:\/\/www.experfy.com\/blog\/all-about-the-gpt-3-hype\/"},"modified":"2023-08-24T13:24:07","modified_gmt":"2023-08-24T13:24:07","slug":"all-about-the-gpt-3-hype","status":"publish","type":"post","link":"https:\/\/www.experfy.com\/blog\/ai-ml\/all-about-the-gpt-3-hype\/","title":{"rendered":"All About The GPT-3 Hype"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-post\" data-elementor-id=\"22889\" class=\"elementor elementor-22889\" data-elementor-post-type=\"post\">\n\t\t\t\t\t\t<section class=\"has_eae_slider elementor-section elementor-top-section elementor-element elementor-element-2f00284 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"2f00284\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"has_eae_slider elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-57907a3\" data-id=\"57907a3\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-2dfbeec elementor-widget elementor-widget-heading\" data-id=\"2dfbeec\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Language models in NLP(Natural Language Processing) Systems are Machine Learning based models which are trained to learn and understand Natural Languages like how humans do. A simple example of a trained language model will predict the occurrence of the next word in a sentence<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-6406f50 elementor-widget elementor-widget-text-editor\" data-id=\"6406f50\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<img fetchpriority=\"high\" decoding=\"async\" alt=\"language model\" src=\"http:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2021\/05\/clH1RkcQpEcWnN5N4FMHG4K5mhOSIu7JNvnD9gZ-9UUtBsFKXl3wLQtvhOdwCd6B0z5pK5508z7Jp6lPbP3iCq7tg2WFoaLF27Ig84I7CPGEi2kGHualVBpGcPMLmg_N9HatbVA.jpeg\" width=\"624\" height=\"167\">\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-bc7ff3b elementor-widget elementor-widget-text-editor\" data-id=\"bc7ff3b\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<img decoding=\"async\" src=\"http:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2021\/05\/image-2.png\" width=\"625\" height=\"29\">\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-cacd59c elementor-widget elementor-widget-text-editor\" data-id=\"cacd59c\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>Mainframe Modernization entails the process of migrating or improving the IT operations to reduce IT spending efficiently.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-05d0081 elementor-widget elementor-widget-text-editor\" data-id=\"05d0081\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<ul><li>Language Translation<\/li><li>Text Classification<\/li><li>Sentiment Extraction<\/li><li>Reading Comprehension<\/li><li>Named Entity Recognition<\/li><li>Question Answer Systems<\/li><li>News Article Generation, etc<\/li><\/ul>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-aec9729 elementor-widget elementor-widget-text-editor\" data-id=\"aec9729\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>Traditionally there have been 2 major Language models, which are statistical and Neural network based Language models .<\/p>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-087773b elementor-widget elementor-widget-text-editor\" data-id=\"087773b\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"http:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2021\/05\/image-3.png\" alt=\"All About The GPT-3 Hype\"\/><\/figure>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-a7cc6bd elementor-widget elementor-widget-text-editor\" data-id=\"a7cc6bd\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p><em>Figure 2 Language Model Techniques<\/em><\/p>\n<p>Statistical Language models typically predict based on probabilistic distribution of a word given preceding ones using techniques such as N-Gram, Hidden Markov model etc.<\/p>\n<p>Neural Net based models are little more sophisticated than statistical, as they use neural nets to model the language.&nbsp;<\/p>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-8f17c88 elementor-widget elementor-widget-heading\" data-id=\"8f17c88\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">The challenges<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-9aa47e7 elementor-widget elementor-widget-text-editor\" data-id=\"9aa47e7\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>&nbsp;&nbsp;&nbsp;The challenge with both these traditional models are<\/p>\n<p><strong>Lack of Agility :<\/strong> The time and effort required to collect vast amount of data, pre-process, creating sequence , encoding the sequence , splitting the data for training and validation, deploying the model and inferencing it is so huge<\/p>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-ea26e0e elementor-widget elementor-widget-text-editor\" data-id=\"ea26e0e\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"http:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2021\/05\/image-4.png\" alt=\"All About The GPT-3 Hype\"\/><\/figure>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-2884f17 elementor-widget elementor-widget-text-editor\" data-id=\"2884f17\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p><em>Figure 3 Stages of Language Model training<\/em><\/p>\n<p><strong>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Domain specific :<\/strong>&nbsp; Models trained against data from one domain cannot predict the data from another domain. Ex. Cloud based Q&amp;A , chatbot applications are trained to answer questions from set of pre-defined document collection. If you rephrase the question it might give you a diff answer. If you train the Language model by feeding it with the Reuters financial news feed , then the prediction of the next word is as follows<\/p>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-205c35e elementor-widget elementor-widget-text-editor\" data-id=\"205c35e\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"http:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2021\/05\/oseQBgwMnXAlCPe4XcBXd-Eaf5GIULgKQmS9KoP7DuNVnXjt6gja3OMMNR-Tefm03KiHn0X_p1e2kXNFzQM9d5ZV6sjIKWJMsMnzgQIn4s1wh8qf0uLeeysqPS1Da9DVcFQKa-M.png\" alt=\"language model\"\/><\/figure>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-d937019 elementor-widget elementor-widget-text-editor\" data-id=\"d937019\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p><em>Figure 4 Model trained against finance news feeds data<\/em><\/p>\n<p><a href=\"https:\/\/en.wikipedia.org\/wiki\/Transfer_learning\" target=\"_blank\" rel=\"noreferrer noopener\">Transfer Learning<\/a> is a Machine learning technique by storing knowledge gained while solving one problem and applying it to a different but related problem.\u00a0<\/p>\n<p>In 2018 the concept of pre-trained transformer models became popular after\u00a0 <a href=\"https:\/\/ai.googleblog.com\/2018\/11\/open-sourcing-bert-state-of-art-pre.html\" target=\"_blank\" rel=\"noreferrer noopener\">Google\u2019s BERT<\/a> (Bidirectional\u00a0Encoder\u00a0Representations from\u00a0<a href=\"https:\/\/ai.googleblog.com\/2017\/08\/transformer-novel-neural-network.html\" target=\"_blank\" rel=\"noreferrer noopener\">Transformers<\/a>\u00a0) paper , which falls into the above mentioned <a href=\"http:\/\/www.experfy.com\/blog\/bigdata-cloud\/transfer-learning\/\" target=\"_blank\" rel=\"noreferrer noopener\">Transfer Learning<\/a> technique which is basically pre-training the model against vast amount of data and transferring the model\u2019s learning to do relevant tasks.<\/p>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-bfd6d98 elementor-widget elementor-widget-text-editor\" data-id=\"bfd6d98\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<img decoding=\"async\" alt=\"language model\" src=\"http:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2021\/05\/oseQBgwMnXAlCPe4XcBXd-Eaf5GIULgKQmS9KoP7DuNVnXjt6gja3OMMNR-Tefm03KiHn0X_p1e2kXNFzQM9d5ZV6sjIKWJMsMnzgQIn4s1wh8qf0uLeeysqPS1Da9DVcFQKa-M.png\" width=\"365\" height=\"339\">\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-c341d2e elementor-widget elementor-widget-text-editor\" data-id=\"c341d2e\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"http:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2021\/05\/rqu5SL5xY61TakdvyIRucwiiBvclRVXqgVcckQAlhzDYS_9Z8kUuhbR6c5J9HH09975LiRyTJiwyj-rxQqtpSQpzo_SiYuHO6vgXwuZv21c_QGPDA614gycMJe34OL_zDLp4Snk.png\" alt=\"All About The GPT-3 Hype\"\/><\/figure>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-5eebdc7 elementor-widget elementor-widget-text-editor\" data-id=\"5eebdc7\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p><em>Figure 5 Evolution of Language Models<\/em><\/p>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-249af4c elementor-widget elementor-widget-text-editor\" data-id=\"249af4c\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>Google\u2019s BERT model was originally trained with 340 million parameters against Wikipedia and millions of book corpus data to build\u00a0 simple Q&amp;A application, the model accuracy was by far the best at that time. Facebook and microsoft also created BERT based models such as\u00a0 <a href=\"https:\/\/ai.facebook.com\/blog\/roberta-an-optimized-method-for-pretraining-self-supervised-nlp-systems\/\" target=\"_blank\" rel=\"noreferrer noopener\" class=\"broken_link\">RoBERTa<\/a> and <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/codebert-a-pre-trained-model-for-programming-and-natural-languages\/\" target=\"_blank\" rel=\"noreferrer noopener\">codeBERT<\/a>( NL-PL conversion) respectively . Following the trend that larger natural language models lead to better results,\u00a0Microsoft\u00a0<a href=\"http:\/\/msturing.org\/\" target=\"_blank\" rel=\"noreferrer noopener\">Project Turing<\/a>\u00a0introduced Turing Natural Language Generation (T-NLG), the largest model ever trained using 17 billion parameters as of Jan\u20192020 .\u00a0 NLP tasks such as Writing news articles, generating code etc. became lot simpler with these transformer models without needing to have much processing headache for NLP engineers.<\/p>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-2109e8d elementor-widget elementor-widget-text-editor\" data-id=\"2109e8d\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>Around Jun\u20192020 OpenAI released their Beta version of GPT-3 model, which was trained against 175 billion parameters, which is almost all of the internet is the most sophisticated Language model ever built with such large parameter set. More parameters the model is trained against, better the predictions would be.<\/p>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-c3225ef elementor-widget elementor-widget-text-editor\" data-id=\"c3225ef\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p><strong>OpenAI <\/strong>: GPT-3( Generative Pre-Trained Transformer model 3<sup>rd<\/sup> version) released by San Francisco based AI research company called OpenAI , which was founded in 2015 by Sam Altman and Elon Musk , Microsoft invested $1bn in 2019 became an exclusive Cloud provider and the GPT-3 models are trained against the Microsoft\u2019s AI super computer.&nbsp;<\/p>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-a59d733 elementor-widget elementor-widget-text-editor\" data-id=\"a59d733\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"http:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2021\/05\/9r_yQTkoCcRcfT_nYiJ5yl1YFHZnruj5bvDLJL_6ZD2y0d3ElNlITuahzrULPfYclGuf2RSc9TeB5nXIUxz5o87JWsSsB4CfNOxyjeyfnz7ntB4aiPAMY2H2Mo8yk-braf2RVWM.png\" alt=\"OpenAI\"\/><\/figure>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-26c694a elementor-widget elementor-widget-text-editor\" data-id=\"26c694a\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p><em>Figure 6 Stats about the data used to train GPT-3<\/em><\/p>\n<p><strong>Working with GPT-3<\/strong><\/p>\n<p>Before start working with GPT-3 API, lets first understand some key concepts.<\/p>\n<p><strong>Prompt<\/strong>: The text input given to the API<\/p>\n<p><strong>Completion<\/strong>: The resultant text that the API generates as a result of processing text input prompt<\/p>\n<p><strong>Token<\/strong>: The number of <a href=\"https:\/\/nlp.stanford.edu\/IR-book\/html\/htmledition\/tokenization-1.html#:~:text=A%20token%20is%20an%20instance,containing%20the%20same%20character%20sequence.\" target=\"_blank\" rel=\"noreferrer noopener\">tokens<\/a>( chopped sentence into pieces)<\/p>\n<p>Let\u2019s look at how powerful the model is at some NLP tasks<\/p>\n<p><strong>Example 1:&nbsp; SQL Generator<\/strong> prompt is a simple English sentence to get the count of total employees in HR department<\/p>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-334e1da elementor-widget elementor-widget-text-editor\" data-id=\"334e1da\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"http:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2021\/05\/yfxfolwArVjHk3f8bVh6lG_s7LkAkcJ03My7_T1FBF6BZDL4aDYRjZOaZEsHsZU30dJoYnCMaNBjhTR6YSVdJGDVOo2ByU-XKgfv-d3SGVhdPM78VpuERtIWgVHpsEHod2UWDzc.png\" alt=\"SQL Generator\"\/><\/figure>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-15640fb elementor-widget elementor-widget-text-editor\" data-id=\"15640fb\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p><em>Figure 7 GPT-3 model converting&nbsp; Natural language to SQL<\/em><\/p>\n<p>With couple of examples to prime the model, the GPT-3 model is able to produce the SQL statements accurately.<\/p>\n<p><strong>Example 2: Email message generator \u2013 <\/strong>I prompted the model to generate email message for a typical hotel booking<strong>&nbsp;<\/strong><\/p>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-a62acc2 elementor-widget elementor-widget-text-editor\" data-id=\"a62acc2\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"http:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2021\/05\/1f5TOztaokkPaitCiPBhdlHBCjRL44kFoFDNRI_JC2W2TGj6nxA9z0In1b_X1-IeVWbKjcT_G_dv1Wl2i1G-4V01AsTZKgD9pzm1CDdttgJBO4s2ykEnfF7AALrij_HFs18LVKA.png\" alt=\"Email Message Generator\"\/><\/figure>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-62488db elementor-widget elementor-widget-text-editor\" data-id=\"62488db\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p><em>Figure 8 GPT-3 model able to write email message on my behalf \ud83d\ude42<\/em><\/p><p>Sample code for both the above examples can be found <a href=\"https:\/\/github.com\/shreyashankar\/gpt3-sandbox\/\" target=\"_blank\" rel=\"noreferrer noopener\">here<\/a><\/p><p>There are a lot of examples provided by OpenAI in their playground.<\/p>\n<p><a href=\"https:\/\/beta.openai.com\/playground\" target=\"_blank\" rel=\"noreferrer noopener\" class=\"broken_link\">Playground &#8211; OpenAI API<\/a><\/p>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-c638fac elementor-widget elementor-widget-video\" data-id=\"c638fac\" data-element_type=\"widget\" data-e-type=\"widget\" data-settings=\"{&quot;video_type&quot;:&quot;hosted&quot;,&quot;autoplay&quot;:&quot;yes&quot;,&quot;play_on_mobile&quot;:&quot;yes&quot;,&quot;controls&quot;:&quot;yes&quot;}\" data-widget_type=\"video.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<div class=\"e-hosted-video elementor-wrapper elementor-open-inline\">\n\t\t\t\t\t<video class=\"elementor-video\" src=\"http:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2021\/05\/GPT-3_playground.mp4-1.mp4\" autoplay=\"\" controls=\"\" playsinline=\"\" controlsList=\"nodownload\"><\/video>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-67c539c elementor-widget elementor-widget-text-editor\" data-id=\"67c539c\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>Though the model performs to a greater extent, researchers fear it&nbsp;can&nbsp;heavily pose a threat to disinformation, where it&nbsp;can&nbsp;be used by bad actors to create an endless amount of fake news, spread misinformation etc. Here is the tweet by the Sam Altman , the CEO of OpenAI<\/p>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-83ea58c elementor-widget elementor-widget-text-editor\" data-id=\"83ea58c\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2021\/05\/KZidqyEMAjAn2MoKjRBUgIwwoXD71Wtn4eT6su-z5YqH-0VjzUvxAdCF1RX2RGdMOm3KE2g4gBfrMdTXhsVtIy_9zyT-SDAbH470lVKByfA8Y533kcK3bPu2bAXZDWOkOm7RJnw.png\" width=\"624\" height=\"155\">\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-7e45bb1 elementor-widget elementor-widget-text-editor\" data-id=\"7e45bb1\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>Based on my years of experience dealing with Financial Services Industries customers, I certainly believe there are some valuable use cases which are best suited for GPT-3 model.<\/p>\n<p>FSI Use Cases<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-4ddd61c elementor-widget elementor-widget-text-editor\" data-id=\"4ddd61c\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<ul><li>Automated Named Entity Extraction&nbsp;<\/li><li>Sales trader- Client Meeting notes summarization<\/li><li>Financial statement summarization<\/li><li>Financial sentiment analyzer<\/li><li>Domain specific speech to text translators, robotic form filling based on user voice inputs<\/li><\/ul>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-cb5cfca elementor-widget elementor-widget-heading\" data-id=\"cb5cfca\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">References:<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-0e948fd elementor-widget elementor-widget-text-editor\" data-id=\"0e948fd\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<ul><li>FinBERT : <a href=\"https:\/\/www.ijcai.org\/Proceedings\/2020\/0622.pdf\" target=\"_blank\" rel=\"noreferrer noopener\">FinBERT: A Pre-trained Financial Language Representation Model for Financial Text Mining (ijcai.org)<\/a><\/li><li>Cool Projects built on GPT-3 : <a href=\"https:\/\/analyticsindiamag.com\/openai-gpt-3-model-machine-learning-products\/\" target=\"_blank\" rel=\"noreferrer noopener\">15 Interesting Ways OpenAI&#8217;s GPT-3 Has Been Put To Use (analyticsindiamag.com)<\/a><\/li><li>OpenAI\u2019s Beta playground : <a href=\"https:\/\/beta.openai.com\/docs\/examples\" target=\"_blank\" rel=\"noreferrer noopener\" class=\"broken_link\">OpenAI API<\/a><\/li><\/ul>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-1abd906 elementor-widget elementor-widget-heading\" data-id=\"1abd906\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Disclaimer:<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-c21d632 elementor-widget elementor-widget-text-editor\" data-id=\"c21d632\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>This is completely my personal view on GPT-3 model, The opinions expressed here represent my own and not those of my employer. In addition, my thoughts and opinions change from time to time I consider this a necessary consequence of having an open mind.\u00a0<\/p>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p>Language models in NLP(Natural Language Processing) Systems are Machine Learning based models which are trained to learn and understand Natural Languages like how humans do. A simple example of a trained language model will predict the occurrence of the next word in a sentence Mainframe Modernization entails the process of migrating or improving the IT<\/p>\n","protected":false},"author":1141,"featured_media":23568,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"content-type":"","footnotes":""},"categories":[183],"tags":[122,95,850],"ppma_author":[3217],"class_list":["post-22889","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai-ml","tag-big-data","tag-big-data-amp-technology","tag-machine-learning-models"],"authors":[{"term_id":3217,"user_id":1141,"is_guest":0,"slug":"suresh-sethuramaswamy","display_name":"Suresh Sethuramaswamy","avatar_url":"https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2021\/04\/1569944117023-150x150.jpg","user_url":"","last_name":"Sethuramaswamy","first_name":"Suresh","job_title":"","description":"Suresh Sethuramaswamy is a Senior Architect at Microsoft\u2019s Azure global team. Helping FSI customers succeed in their Big Data &amp; Artificial Intelligence journey on best-in-class Azure public cloud. He is also a Senior Member of the IEEE Computer Society Princeton Chapter. Suresh is a technology evangelist focused on building scalable Machine learning and Artificial Intelligence platforms. He can be found jamming percussion instruments in his spare time."}],"_links":{"self":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts\/22889","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/users\/1141"}],"replies":[{"embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/comments?post=22889"}],"version-history":[{"count":8,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts\/22889\/revisions"}],"predecessor-version":[{"id":31451,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts\/22889\/revisions\/31451"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/media\/23568"}],"wp:attachment":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/media?parent=22889"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/categories?post=22889"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/tags?post=22889"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/ppma_author?post=22889"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}