W가 only parameter, nx dim vector. b는 real number loss func - single training example에 대한 error cost func - cost of your params (전체 데이터에 대해, Parameter W, b의 평균 에러를 의미) Gradient Descent slope of the function Derivatives 직선이라면 (1차 함수) a의 값에 무관하게, 함수의 증가량은 변수 증가량의 3배 즉 3으로 미분값이 일정하다 Computation Graph Derivatives with a Computation Graph Logistic Regression Gradient Descent Gradient Descent on m Exam..

Neural Networks and Deep Learning 1. Introduction to Deep Learning Supervised Learning with Neural Networks Why is Deep Learning taking off? + 생각보다 영어 퀴즈가 굉장히 까다롭다 . . .

Swin Transformer Hierarchical Vision Transformer using Shifted Windows Abstract This paper presents a new vision Transformer, called Swin Transformer, that capably serves as a general-purpose backbone for computer vision. Challenges in adapting Transformer from language to vision arise from differences between the two domains, such as large variations in the scale of visual entities and the high..

Transformers for image recognition Model overview. We split an image into fixed-size patches, linearly embed each of them, add position embeddings, and feed the resulting sequence of vectors to a standard Transformer encoder. In order to perform classification, we use the standard approach of adding an extra learnable “classification token” to the sequence. Abstract While the Transformer archite..

2023. 08. 15 Tuesday Apple developer academy @POSTECH Open Day 🍎 사실 저는 아카데미 오픈 데이가, 1기 러너들 포스텍에서 모이는 자리인 줄 알고 신청했는데, 알고 보니 3기 지원 희망하시는 분들이 아카데미와서 세션 듣고, 체험하는 날이더라구요 . . 🌞 👩‍💻 많은 준비는 하지 못했지만 , , 그래도 3기 지원자 분들 Q&A 통해서 작년 아카데미 생활도 돌아볼 수 있었고, 한 동안 잊고 지냈는데, 옛날 추억도 새록새록 떠올릴 수 있었던 시간이었습니다. 멘토 분들도 오랜만에 만날 수 있었답! :) 🛤️ 조금 더 놀다 가고 싶었는데, 다음날 일정이 있어서 바로 올라왔습니다. 🥲 다음 번에는 도라와 오래오래 이야기하고, 또 포항 구경도 제대로 하고 가고 싶어..

UMC Demoday 2023. 08. 24 Thursday 🥳 # 문래, 올댓마인드 2F https://github.com/DeveloperAcademy-POSTECH/MC2-Team9-MUSE GitHub - DeveloperAcademy-POSTECH/MC2-Team9-MUSE: Apple Developer Academy 1기 MC2 프로젝트 Apple Developer Academy 1기 MC2 프로젝트. Contribute to DeveloperAcademy-POSTECH/MC2-Team9-MUSE development by creating an account on GitHub. github.com Muse 프로젝트 기획할 때, 다채로운 음악 앨범 커버 색상 때문에 배경이나 메인 컬러 잡을 때 ..

Transformer Abstract The dominant sequence transduction models are based on complex recurrent or convolutional neural networks that include an encoder and a decoder. The best performing models also connect the encoder and decoder through an attention mechanism. We propose a new simple network architecture, the Transformer, based solely on attention mechanisms, dispensing with recurrence and conv..

DenseNet Abstract Recent work has shown that convolutional networks can be substantially deeper, more accurate, and efficient to train if they contain shorter connections between layers close to the input and those close to the output. In this paper, we embrace this observation and introduce the Dense Convolutional Network (DenseNet), which connects each layer to every other layer in a feed-forw..

Inception Module The fundamental way of solving both issues would be by ultimately moving from fully connected to sparsely connected architectures, even inside the convolutions. adding an alternative parallel pooling path As these “Inception modules” are stacked on top of each other, their output correlation statistics are bound to vary; as features of higher abstraction are captured by higher l..