notebooks

> Also can we train this same model on regular language data so we can converse about the genomes? Yes! That is what has been done in ChatNT [1] where you can ask natural language questions like "Determine the degradation rate of the human RNA sequence @myseq.fna on a scale from -5 to 5." and the ChatNT will answer with "The degradation rate for this sequence is 1.83." > My biggest point of confusion is what type of practical things these models can do. See for example this notebook [2] where the Nucleotide Transformer is finetuned to classify genomic sequences as two of the most basic genomic motifs: promoters and enhancers types. Disclaimer: I work at InstaDeep but was not involved in either of the above projects. [1] https://www.biorxiv.org/content/10.1101/2024.04.30.591835v2 [2] https://github.com/huggingface/notebooks/blob/main/exam

I'd recommend to look at the FastAi NLP course[1]. The relevant lessons are videos 8, 9 and crucially - 10. (the first minutes is about an ethics conference, then the lecture starts in earnest). Basically, you can then do similar things using HuggingFace, as indeed many have (you can explore the models in their hub)[2] [1] https://www.youtube.com/playlist?list=PLtmWHNX-gukKocXQOkQju... [2] https://github.com/huggingface/notebooks/blob/main/examples/...