CodeTF

salesforce really seems to invest a lot of resources into coding focused applications for LLMs, which is of course great, especially as they seem very transparent, sharing both papers and usable implementations[0]. However, I feel that I am really starting to lose track over the differences in their releases (T5 vs T5+ vs Gen vs this), especially as they come so fast. Perhaps this reflects poorly on me, but I find it hard to really stay up to date with the consistent stream of preprints and releases (not just from salesforce) as it tends to take me a while before fully internalizing what makes the newest developments so special, so I was very happy to find that they added an overview that compares different supported models (including their releases) to the newest repo[1]. Of course, size does not correlate with performance, but it still

Link to the github repo: https://github.com/salesforce/CodeTF It would be helpful to see some Colab notebook examples of how I could use this or incorporate my own codebase with these open source coding models. The examples show some smaller interesting prediction task & translation between csharp and java, but probably easier to try it out in Colab than having to install locally. I would also want to be able to compare Github Copilot's autocomplete with what CodeT5 would return as a prediction.