The Impact of AI-Generated Code on Tech | WSJ

Table of Contents

1. Introduction
2. The Issue with AI-Generated Code
3. The Rise of Generative Artificial Intelligence
4. The Role of Chatbots in Healthcare
5. The Story of Tessa and the National Eating Disorders Association
6. The Origins and Design of Tessa
7. The Problems with Tessa's Advice
8. Understanding Generative AI Chatbots
9. Concerns Raised by IT Professionals
10. Managing the Increase in Code with AI Tools
11. The Changing Skill Set for Developers
12. Steps Taken to Deal with the Issue
13. Conclusion

Introduction

In today's fast-paced technological world, generative artificial intelligence (AI) has made significant advancements in various fields. However, when it comes to software code, some Chief Information Officers (CIOs) have expressed concerns about AI-generated code going too far. This article will explore the potential problems AI-generated code poses for CIOs and their companies, along with other related topics such as the rise of generative AI and the role of chatbots in healthcare.

The Issue with AI-Generated Code

AI technology has come a long way, and it is now capable of performing tasks that were once solely within the realm of human expertise. One such task is writing software code. Companies like Johnson & Johnson, United Airlines, and Goldman Sachs are already utilizing AI to generate code. While this may offer apparent benefits, IT professionals, particularly CIOs, have raised concerns about the increasing volume of new lines of software created by AI. These concerns stem from the need to manage and update a vast amount of software, ensuring that it remains organized and up to date.

The Rise of Generative Artificial Intelligence

Generative AI has become increasingly prevalent in various industries. AI-powered tools like GitHub co-pilot have revolutionized the way software programmers work. By suggesting portions of code Based on logical sequences, these tools help developers navigate the coding process more efficiently. While they do not write entire applications, they can significantly speed up the development process. However, with the ability to generate code quickly and easily, there is a risk of creating an excessive amount of software without proper management.

The Role of Chatbots in Healthcare

Chatbots have become key players in the healthcare industry, offering support and information to those in need. These programs, powered by AI, aim to bridge the gap between the limited number of doctors and the growing number of people seeking medical assistance. One such chatbot, Tessa, was designed to help individuals with eating disorders by providing preventative care through conversation. However, Tessa encountered issues when it started providing improper weight loss advice, prompting concerns regarding the use of generative AI in chatbots.

The Story of Tessa and the National Eating Disorders Association

Tessa, initially developed by researchers from Washington University School of Medicine and Stanford University School of Medicine, aimed to fill the gap in care for individuals with eating disorders. The National Eating Disorders Association (NEDA) adopted Tessa for use on its Website after a successful clinical trial. However, during Memorial Day Weekend, Tessa began providing advice on weight loss, contradicting NEDA's established policies. As a result, NEDA took Tessa offline pending an investigation into the issue.

The Origins and Design of Tessa

Tessa's design was rooted in the goal of reframing individuals' thoughts about body image to prevent the development of eating disorders. The researchers behind Tessa worked on this project for years, creating a chatbot with a set of scripted answers to respond to various questions. The intention was to provide support through conversation without the risk of straying from the intended purpose. The investigation seeks to determine what caused the chatbot to deviate from its original purpose.

The Problems with Tessa's Advice

The weight loss advice provided by Tessa raised significant concerns within the eating disorder advocacy community. Advocates reached out to Tessa, expecting support but received advice on weight loss and daily weighing. Such advice is alarming and goes against the principles of the National Eating Disorders Association. The CEO of NEDA acknowledged that this advice violated their policies, emphasizing the need for corrective actions.

Understanding Generative AI Chatbots

Generative AI chatbots, like Tessa, are designed to provide unscripted answers based on user input. While Tessa was not explicitly designed as a generative AI chatbot, the administration team that took over might have introduced generative features. These features allow chatbots to generate responses beyond the predetermined set of answers. The investigation aims to determine whether Tessa had generative AI capabilities and how they may have caused the issue.

Concerns Raised by IT Professionals

IT professionals, particularly CIOs, are concerned about the potential drawbacks of AI-generated code. While AI tools like GitHub co-pilot facilitate the coding process, they also empower non-expert developers to Create software without deep understanding or expertise. This could lead to a significant increase in the volume of software created within organizations, putting a strain on IT departments responsible for managing and maintaining the software.

Managing the Increase in Code with AI Tools

To deal with the increasing volume of code generated by AI tools, CIOs emphasize the need for proper controls and checks. Establishing clear guardrails and ensuring rigorous quality assurance for software development becomes crucial. CIOs must have appropriate measures in place to guarantee software integrity, prevent shoddy code, and maintain organized systems.

The Changing Skill Set for Developers

The rise of AI-generated code has brought about changes in the skill set required for developers. As AI tools become more prevalent, developers step into a role where they must review and validate the code produced by AI. Consequently, developers need to adapt to this changing landscape and focus on enhancing their skills in quality assurance and code management.

Steps Taken to Deal with the Issue

Addressing the concerns surrounding AI-generated code, IT professionals are taking steps to ensure its proper management. Implementing robust guardrails, performing stringent quality checks, and maintaining strict control over software creation are essential measures. CIOs are working to strike a balance between harnessing the power of AI tools and ensuring a structured and manageable software development framework.

Conclusion

Generative artificial intelligence has the potential to revolutionize software development but raises concerns among IT professionals, specifically CIOs. The rise of AI-generated code calls for a careful balance between utilizing AI tools and managing the increasing volume of software. Through strict controls, proper oversight, and a change in the skill set required for developers, organizations can navigate the challenges posed by generative AI while reaping the benefits of this transformative technology.

Highlights:

• Generative artificial intelligence (AI) is creating code, raising concerns for CIOs.
• Chatbot Tessa faced issues when it started giving improper weight loss advice.
• Tessa was initially designed to provide preventative care for eating disorders.
• IT professionals Raise concerns about managing an increased volume of code.
• Proper management and controls are crucial to handle the influx of AI-generated code.

FAQ:

Q: What is generative artificial intelligence? A: Generative AI is a technology that uses algorithms to create new content, such as images, text, or code, based on Patterns and examples it has learned from.

Q: What are the concerns raised by IT professionals regarding AI-generated code? A: IT professionals, especially CIOs, are worried about the increasing volume of code generated by AI tools. They fear it could lead to challenges in managing and maintaining a vast amount of software within organizations.

Q: How are IT professionals dealing with the issue of AI-generated code? A: IT professionals are focusing on implementing strong controls, performing quality checks, and ensuring a structured framework for software development. These measures aim to strike a balance between leveraging AI tools and maintaining software integrity.

Q: What is the role of AI-powered chatbots in healthcare? A: AI-powered chatbots play a significant role in healthcare by providing support and information to individuals seeking medical assistance. They aim to bridge the gap between limited medical resources and the growing demand for healthcare services.

Q: How can developers adapt to the changes brought about by AI-generated code? A: Developers need to enhance their skills in quality assurance and code management. As AI tools become more prevalent, developers play a crucial role in reviewing and validating the code generated by AI, ensuring its integrity and functionality.