present

University of Toronto researchers present scGPT: a basic model for single cell biology based on a generative transformer pre-trained in a repository of more than 33 million cells

by
University of Toronto researchers present scGPT: a basic model for single cell biology based on a generative transformer pre-trained in a repository of more than 33 million cells

https://www.biorxiv.org/content/biorxiv/early/2023/07/02/2023.04.30.538439.full.pdf Natural language processing and computer vision are just examples of the fields where pre-trained generative models have been incredibly successful. In particular, a viable strategy for building foundation models is to combine various large-scale datasets with pre-trained transformers. The study investigates the feasibility of basic models for further research in cell biology and genetics … Read more

Stanford researchers present HyenaDNA: A long-range genomic basis model with context lengths up to 1 million tokens at single nucleotide resolution

by
Stanford researchers present HyenaDNA: A long-range genomic basis model with context lengths up to 1 million tokens at single nucleotide resolution

https://hazyresearch.stanford.edu/blog/2023-06-29-hyena-dna In recent years, there have been rapid advances in Artificial Intelligence (AI) that have the potential to completely transform industries and push the boundaries of what is possible. One area that has garnered significant attention from researchers is the development of more robust and efficient models for natural language tasks. Against this backdrop, researchers … Read more