BITAmin winter session 2

 In this session, we inquired into backpropagation.

The Korean Youtuber '혁펜하임'(@hyukppen)'s videos were very useful, and comprehensive. So although things about SGD, Batch GD, and Mnibatch GD are written referring to other sources, the part for the principle of Backpropagation is actually just a lecture note for the video.


Download PDF

댓글

댓글 쓰기

이 블로그의 인기 게시물

Paper review: migration? just studying?

 International Student Mobility: Growth and Dispersion by Neeraj Kaushal & Mauro Lanati, 2019. NBER Working Papers Personally, I found the paper difficult to read. This was because the paper didn't use identification strategy such as IV and DiD. Also, the main purpose of this paper was not to identify rigorous causal effects. Rather, the author tried to assess which of two competing models was more plausible. The paper felt unfamiliar to me, as well as theoretically heavy in its derivation of the regression equations. The process to connect the theory to the variable choice was a little bit uncomfortable for me. But, very fun! If I do my own research, I think I can refer the way the paper constructs regression equations. The paper proposes two competitive models. One is 'migration model', representing permanent migration through the tertiary education, and the other one is the 'human capital model', representing  skills acquisition through studying abroad. The p...
자세한 내용 보기

Review of 'Introduction to Statistics' (2024 Spring)

이미지
My university set all of the students majoring in economics to take this course. This course deals with not only basic stats knowledge like conditional probability, binomial/discrete/continuous distribution, and Poisson / exponential distribution but also hypothesis tests, like fundamental concepts of the test, t-test, paired t-test, variance estimation using Chi-square distribution, and F-distribution. Unfortunately, the opportunity to conduct real statistical analysis as it was a very large lecture. But the contents were pretty dense. So it was very helpful when I studied linear regression and ANOVA myself.
자세한 내용 보기

BITAmin Winter Session 3

I tried to understand the CNN in terms of math, but it was not easy to organize its concept explicitly, especially because of the concept 'convolution'. However, thankfully I could seize its intuitive understanding with 3B1B's video . Attention was pretty not easy to analyze mathematically, so I had to skip the math-hard comprehension. But still Hyukpenheim's video  is surprisingly useful. So I only organized the notes about RNN and LSTM. Download PDF
자세한 내용 보기