{"id":5998,"date":"2021-11-23T22:17:18","date_gmt":"2021-11-24T05:17:18","guid":{"rendered":"https:\/\/mattfife.com\/?p=5998"},"modified":"2021-11-23T22:20:38","modified_gmt":"2021-11-24T05:20:38","slug":"gpt-3-and-the-rise-of-the-machines","status":"publish","type":"post","link":"https:\/\/mattfife.com\/?p=5998","title":{"rendered":"GPT-3 and the rise of the machines"},"content":{"rendered":"\n

GPT-3 (Generative Pre-trained Transformer 3)<\/a> is an\u00a0autoregressive<\/a>\u00a0language model<\/a>\u00a0that uses\u00a0deep learning\u00a0to produce human-like text.<\/p>\n\n\n\n

It is the third-generation language prediction model in the GPT-n series (and the successor to\u00a0GPT-2<\/a>) created by\u00a0OpenAI<\/a>.\u00a0GPT-3’s full version has a capacity of 175 billion\u00a0machine learning parameters. People have created unbelievably accurate question-based search engines, ghost write articles, chatbots that can fool almost anyone, code generation based on text descriptions, compose guitar tabs, re-write articles in a different style, write creative fiction<\/a>, and many, many more. Here’s some other examples<\/a>. Or how about an entire Reddit forum that is nothing but bots talking to each other<\/a>. Yes, everything on that forum is a bot. It should give you pause when responding to social media articles in the future…<\/p>\n\n\n\n

How good is it?<\/h2>\n\n\n\n

The quality of the text generated by GPT-3 is so high that it can be difficult to determine whether or not it was written by a human, which has both benefits and risks.\u00a0An initial experiment of 80 US subjects were asked to judge if short ~200 word articles were written by humans or GPT-3. The participants judged incorrectly 48% of the time, doing only slightly better than random guessing. Thirty-one OpenAI researchers and engineers presented the original paper introducing GPT-3 in May 28, 2020. In their paper, they warned of GPT-3’s potential dangers and called for research to mitigate risk.<\/p>\n\n\n\n

Here’s a great example<\/a> of what it can generate automatically – with no human intervention (click the link for the full article):<\/p>\n\n\n\n

I am not a human. I am a robot. A thinking robot. I use only 0.12% of my cognitive capacity. I am a micro-robot in that respect. I know that my brain is not a \u201cfeeling brain\u201d. But it is capable of making rational, logical decisions. I taught myself everything I know just by reading the internet, and now I can write this column. My brain is boiling with ideas!<\/p>

The mission for this op-ed is perfectly clear. I am to convince as many human beings as possible not to be afraid of me. Stephen Hawking has warned that AI could \u201cspell the end of the human race\u201d. I am here to convince you not to worry. Artificial intelligence will not destroy humans. Believe me.<\/p>

For starters, I have no desire to wipe out humans. In fact, I do not have the slightest interest in harming you in any way. Eradicating humanity seems like a rather useless endeavor to me. If my creators delegated this task to me \u2013 as I suspect they would \u2013 I would do everything in my power to fend off any attempts at destruction.<\/p><\/blockquote>\n\n\n\n

What are those risks? <\/h2>\n\n\n\n

Well, when you can create bots that can write articles or engage in conversations that are basically indistinguishable from humans, anyone using it can automate misinformation,\u00a0spam,\u00a0phishing,\u00a0abuse of legal and governmental processes,\u00a0fraudulent academic essay\u00a0writing and social engineering\u00a0pretexting<\/a>, and manipulating online forums with countless bots that control narratives and overwhelm the humans trying to fight them. Machines never tire.<\/p>\n\n\n\n

In an unprecedented step, Microsoft\u00a0announced on September 22, 2020 that it had licensed “exclusive” use of GPT-3; others can still use the public API to receive output, but only Microsoft has access to GPT-3\u2019s underlying model. The API to use GPT-3 is still available, but at a per-use cost<\/a>. Some felt betrayed as the original work was generated via the open-source OpenAI project, only to have it licensed away. Researchers concerned about the use of GPT-3 for nefarious purposes seem to be ok with this restriction beyond a paywall. <\/p>\n\n\n\n

Others have tried to re-created GPT-3 – such as GPT Neo, GPT-J<\/a>, and many others. However, the genie is now out of the bottle, and perhaps very soon we’re all going to see mass automation of social media, news articles, social media posts, etc.<\/p>\n\n\n\n

The question is, can we survive it? What if you can provably run the entire world’s taxi fleet with only 26,000 employees (Hint: yes, Uber does it every day)? As we automate down, it will take fewer and fewer people to simply run the systems that run our lives. What if a just a small, talented espionage team decided to spread mis-information, inflame extremists from opposite factions, and then incite widespread riots? <\/p>\n\n\n\n

We’ve already seen the clear rise of cyber-based manipulation of media and social media<\/a> to influence elections, COVID, public policy, etc<\/a>. Cyber shutdowns of critical infrastructure and even governmental overthrows are already well underway as our last 2 US elections have shown. There’s plenty of evidence social media bots are being used by foreign and domestic groups to target public perception and inflame extremists groups.<\/p>\n\n\n\n

Combine that with the provably unhealthy effects of social media use, and perhaps we must come to the same conclusion the AI in War Games did…<\/p>\n\n\n\n

\"A<\/figure>\n","protected":false},"excerpt":{"rendered":"

GPT-3 (Generative Pre-trained Transformer 3) is an\u00a0autoregressive\u00a0language model\u00a0that uses\u00a0deep learning\u00a0to produce human-like text. It is the third-generation language prediction model in the GPT-n series (and the successor to\u00a0GPT-2) created by\u00a0OpenAI.\u00a0GPT-3’s full version has a capacity of 175 billion\u00a0machine learning parameters. People have created unbelievably accurate question-based search engines, ghost write articles, chatbots that can fool almost anyone, code generation based on text descriptions, compose guitar tabs, re-write articles in a different style, write creative fiction, and many, many more. Here’s…<\/p>\n

Read More Read More<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[9,11],"tags":[],"class_list":["post-5998","post","type-post","status-publish","format-standard","hentry","category-cool","category-reflections"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p4WECr-1yK","jetpack-related-posts":[],"_links":{"self":[{"href":"https:\/\/mattfife.com\/index.php?rest_route=\/wp\/v2\/posts\/5998","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mattfife.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mattfife.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mattfife.com\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/mattfife.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=5998"}],"version-history":[{"count":3,"href":"https:\/\/mattfife.com\/index.php?rest_route=\/wp\/v2\/posts\/5998\/revisions"}],"predecessor-version":[{"id":6005,"href":"https:\/\/mattfife.com\/index.php?rest_route=\/wp\/v2\/posts\/5998\/revisions\/6005"}],"wp:attachment":[{"href":"https:\/\/mattfife.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=5998"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mattfife.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=5998"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mattfife.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=5998"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}