Courses: CS 551, BME 598 & BIOM 505
This course, tailored for PhD students, explore AI and scientific research, with a focus on biomedical applications. The spring semester will concentrate on multi-modal data AI models, covering seven key areas:
Autoencoders and Variational Autoencoders
Data Fusion
Graph Neural Networks
Transformers and Other Attention Models
Cross-modal Attention, Contrastive Learning, and other Multi-modal Approaches
Q-learning
Application of Transformers in Biology Special emphasis is on Foundation Models.
The aim is to provide students with an understanding of these AI technologies and their practical use.
MEETING TIMES
Wednesday 12:00 to 2:00 PM MST Online via ZOOM
Passcode: 285110
Meeting ID: 927 4587 5372
Week 1
Date: Jan 17th
Papers Covered:
Transformers in Vision: A Survey
Presenter: Shane McQueen
Zoom Recording: Video Link (Passcode: kj703+ev )
Week 2
Date: Jan 24th
Paper Covered:
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Presenter: Kushal Virupakshappa
Zoom Recording: Video Link (Passcode: 1$F=dp6o )
Week 3
Date: Jan 31st
Paper Covered: ChemBERTa: Large-Scale Self-Supervised Pre-training for Molecular Property Prediction
Presenter: Mikaela E Dicome
Zoom Recording: To be uploaded
Week 4
Date: Feb 14th
Paper Covered: ProteinBERT: a universal deep-learning model of protein sequence and function
Presenter: David A Arredondo
Zoom Recording: To be uploaded
Week 5
Date: Feb 21st
Paper Covered: Hard negative examples are hard, but useful.
Presenter: Micheal Serivilla
Zoom Recording: To be uploaded
Week 6
Date: Feb 27th
Paper Covered: Variational Auto Encoder
Presenter: Macaulay
Zoom Recording: To be uploaded
Week 7
Date: Mar 6th
Paper Covered: Machine learning to detect the SINEs of cancer
Presenter: Olufunmilola M Oyebamiji
Zoom Recording: video (Passcode: nss.mj1g)
Week 8
Date: Mar 13th
Paper Covered: TBD
Presenter: Yue
Zoom Recording: To be uploaded
Token quanitzation
Date: July 17
Paper Covered: VQ-VAE : https://arxiv.org/pdf/1711.00937
VQGAN:https://arxiv.org/abs/2012.09841
MaskGIT : https://arxiv.org/abs/2202.04200
TiTok : https://arxiv.org/pdf/2406.07550
Presenter: Avi
Zoom Recording: https://hsc-unm.zoom.us/rec/share/rFXJhnpBQeaDVfREskVrsyuU80e8BU-WOvEa2miD-Y9H1qmNID4CiDZ5QvUW9bdw.Gu_VzZLp5FxYh9U1