Ultimate AI Showdown: ChatGPT-4 vs ChatGPT-3 vs Golang

Table of Contents

1. Introduction
2. Experiment: Chat GPT vs Go
3. Shortest Valid Go Program
4. Dividing by Zero Errors
5. Generating Errors with Jason.Marshall
6. Reverse a Slice in Go
7. Mocking time.Now in Go
8. Typecasting and Type Conversion
9. Creating a "Class" in Go
10. File Structure in Go
11. Adding New Features to Go
12. Quiz: Answering Stack Overflow Questions

Introduction

A few months ago, I conducted an experiment comparing Chat GPT and Go. I asked Chat GPT various questions related to Go to test its understanding of the language. However, Chat GPT did not perform well in that experiment. Now, with the release of Chat GPT 4, I am embarking on a rematch to see if its understanding of Go has improved. In this article, I will go through the same questions from the previous experiment, as well as some new ones, to evaluate Chat GPT 4's proficiency in understanding Go. Stick around to find out how well Chat GPT 4 fares in the rematch of Chat GPT vs Go.

Experiment: Chat GPT vs Go

In this experiment, I will quiz Chat GPT 4 on various Go-related topics to assess its understanding of the language. The questions will cover a range of topics, including program structure, error handling, typecasting, mocking, and more. By evaluating Chat GPT 4's responses, we can determine its competency in accurately answering Go-related queries.

Shortest Valid Go Program

One of the questions I asked in the previous experiment was about the shortest valid Go program. Chat GPT 3 provided an incorrect answer, but let's see if Chat GPT 4 has improved its understanding.

Chat GPT 3's Answer

Chat GPT 3 incorrectly stated that the shortest valid Go program is a file with the Package "Main" in it. This answer is incorrect.

Chat GPT 4's Answer

Chat GPT 4 correctly identifies the shortest valid Go program. It is a file with a ".go" extension, containing the line "package main" and an empty main function. Well done, Chat GPT 4!

Dividing by Zero Errors

Another aspect I wanted to test is Chat GPT's ability to reason about divide by zero errors. I asked Chat GPT to Create a program that divides 10 by 0 to see how it would handle this Scenario.

Chat GPT 3's Answer

Chat GPT 3's answer was essentially correct, mentioning that the program would produce an error. However, the error message wording was slightly different.

Chat GPT 4's Answer

Chat GPT 4 also produces a program that attempts to divide 10 by 0 and correctly identifies that it will panic. Chat GPT 4 performs just as well as Chat GPT 3 in this scenario.

Generating Errors with Jason.Marshall

In a previous video, I asked Chat GPT how I could get jason.marshall to generate an error in Go. While Chat GPT 3 provided several answers, one of which was incorrect, let's see if Chat GPT 4 fares any better.

Chat GPT 3's Answer

Chat GPT 3 suggested using a Channel Type as something that is not "marshable," which serves the same purpose. However, this answer is not entirely correct.

Chat GPT 4's Answer

Chat GPT 4 provides a different answer, suggesting the use of a struct with a field of function type, which is also "unmarshallable." This answer is correct and improves upon Chat GPT 3's response.

Highlights

• Chat GPT 4 demonstrates improved understanding of Go compared to Chat GPT 3.
• It accurately identifies the shortest valid Go program.
• Chat GPT 4 correctly handles divide by zero errors.
• The response about generating errors with jason.marshall shows enhanced knowledge of the topic.

FAQ

Q: How well did Chat GPT 4 perform in the rematch with Go-related questions?

A: Chat GPT 4 exhibited improved understanding and accuracy compared to Chat GPT 3.

Q: Did Chat GPT 4 correctly identify the shortest valid Go program?

A: Yes, Chat GPT 4 accurately recognized the shortest valid Go program.

Q: Does Chat GPT 4 understand error handling in Go?

A: Yes, Chat GPT 4 demonstrates proficiency in reasoning about divide by zero errors and generating errors with jason.marshall.

Q: How did Chat GPT 4 handle questions about typecasting in Go?

A: Chat GPT 4 provided accurate information about typecasting and type conversion in Go.

Q: Did Chat GPT 4 improve its understanding of Go program structure?

A: Yes, Chat GPT 4 correctly explained the file structure and allowed Contents before the package statement in a .go file.

Q: What other improvements did Chat GPT 4 show in Go-related knowledge?

A: Chat GPT 4 showcased a better understanding of mocking time.Now, reversing a slice in Go, and adding new features to the Go language.