AlphaCode's pre-training dataset included 715 GB of code from files taken from GitHub repositories written in C++, C#, Go, Java, JavaScript/TypeScript, Lua, Python, PHP, Ruby, Rust, and Scala.

ChatGPT can write code. Now researchers say it's good at fixing bugs, too ... ChatGPT solved 19 of the 40 Python bugs, putting it on par with CoCoNut (19) and Codex (21).