[GoogleML] Python and Vectorization

2023. 9. 7. 16:46ใ†ArtificialIntelligence/2023GoogleMLBootcamp

 

 

 

Python and Vectorization

๋ฒกํ„ฐํ™”, ํ–‰๋ ฌ๋กœ ํ•œ๋ฒˆ์— ํ‘œํ˜„ ๊ฐ€๋Šฅ

 

 

 

๋ฒกํ„ฐํ™”๋œ ํ‘œํ˜„ ์ฝ”๋“œ (๋น ๋ฅด๋‹ค)

 

 

 

for loop๊ฐ€ ํ›จ์”ฌ ๋Š๋ฆฌ๋‹ค

 

 

 

More Vectorization Examples

์šฐ์ธก๊ณผ ๊ฐ™์ด .dot์œผ๋กœ ๋ฒกํ„ฐํ™”ํ•˜์—ฌ ํ‘œ๊ธฐํ•˜์ž

 

 

 

numpy built in func์„ ํ™œ์šฉํ•˜์ž

 

 

 

for loop๋ฅผ ์ œ๊ฑฐํ•ด๋ณด์ž!

 

 

 

์œ„์˜ ๊ฐ€์žฅ ํฐ for loop ํ•˜๋‚˜๋งŒ ๋‚จ๊ฒจ๋‘๊ณ , ์‚ญ์ œ ๊ฐ€๋Šฅ (๋‚ด๋ถ€ loop๋ฌธ์„ ์ œ๊ฑฐํ•˜์ž)

 

 

 

Vectorizing Logistic Regression

 

 

 

ํŒŒ์ด์ฌ์œผ๋กœ๋Š” dot ํ•œ ์ค„๋กœ ๊ตฌํ˜„ ๊ฐ€๋Šฅ (b๋ฅผ ๋ฐฐ์—ด๋กœ ๋ณ€๊ฒฝํ•˜์—ฌ ๋”ํ•œ๋‹ค = ๋ธŒ๋กœ๋“œ์บ์ŠคํŒ…)

 

 

 

stacking horizontally

X์˜ ์ฐจ์›์€ (nx, m)

nx dim vector๊ฐ€ m(sample)๊ฐœ ์žˆ๋‹ค! :) 

์™œ๋ƒํ•˜๋ฉด x ๋ฐ์ดํ„ฐ 1๊ฐœ๋ฅผ ์—ด๋ฒกํ„ฐ๋กœ, ์„ธ๋กœ๋กœ stacking ํ–ˆ์œผ๋ฏ€๋กœ, ์„ธ๋กœ ๋ฐฉํ–ฅ์œผ๋กœ๋Š” ์„ฑ๋ถ„๋“ค (dim), ๊ฐ€๋กœ ๋ฐฉํ–ฅ์œผ๋กœ๋Š” m๊ฐœ์˜ ์ƒ˜ํ”Œ๋“ค์ด ์ง„ํ–‰

 

 

 

Vectorizing Logistic Regression's Gradient Output

Z(error vector)๋ฅผ ๋‹ค์Œ๊ณผ ๊ฐ™์ด for loop๋กœ ๋Œ๋ ค์„œ ๊ตฌํ•  ์ˆ˜ ์žˆ๋‹ค. (๋‹ค ๋”ํ•˜๊ณ  m์œผ๋กœ ๋‚˜๋ˆˆ๋‹ค)

 

 

 

ํ•œ๋ฒˆ์— ํ‘œํ˜„ํ•˜๋Š” ๋ฐฉ๋ฒ• (๋ณด๋ผ์ƒ‰)

 

 

 

gradient descent๋ฅผ ๋ฒกํ„ฐํ™”ํ•˜์—ฌ ๊ตฌํ˜„ํ•˜๊ธฐ (์šฐ์ธก)

๋ฒกํ„ฐํ™” ํ•˜๋”๋ผ๋„, iteration loop๋Š” ํ•ญ์ƒ ํ•„์š”ํ•˜๋‹ค. 

 

 

 

Broadcasting in Python

๊ฐ ์Œ์‹ 100g ์† ๊ตฌ์„ฑ์„ฑ๋ถ„์„ ํ†ตํ•ด ์นผ๋กœ๋ฆฌ๋ฅผ ๊ณ„์‚ฐํ•˜์ž

 

 

 

Can you do this without explicit for-loop?

 

 

 

 

 

 

 

 

 

๋ถ€์กฑํ•œ ์ฐจ์›์„, ๋ฐ˜๋ณตํ•ด์„œ m,n์œผ๋กœ ์ฑ„์›Œ์ค€๋‹ค

 

 

 

๋” ๊ถ๊ธˆํ•˜๋‹ค๋ฉด numpy ๋ฌธ์„œ๋ฅผ ์ฝ์–ด๋ณด๋ผ์•„

 

 

 

A Note on Python/Numpy Vectors

5, ์ด๋ ‡๊ฒŒ ์“ฐ์ง€ ๋ง์•„๋ผ

 

 

 

์ด๋ ‡๊ฒŒ 2์ฐจ์› ๋ฒกํ„ฐ์ฒ˜๋Ÿผ ํ‘œํ˜„๋˜๋„๋ก ์ž๋ฃŒ ๊ตฌ์กฐ๋ฅผ ์‚ฌ์šฉํ•˜์ž

 

 

 

randn ์“ฐ์ง€ ๋ง๊ธฐ + reshape ํ™œ์šฉํ•ด์„œ double check

 

 

 

Quick tour of Jupyter/iPython Notebooks

์ฃผํ”ผํ„ฐ ๋…ธํŠธ๋ถ ์‹คํ–‰์— ๋Œ€ํ•œ ๊ฐ„๊ฒฐํ•œ ์‚ฌ์šฉ ๋ฐฉ๋ฒ• ์„ค๋ช…

 

 

 

Explanation of Logistic Regression Cost Function (Optional)

 

 

 

์™œ ์ด๋Ÿฌํ•œ ํ˜•ํƒœ๊ฐ€ ๋˜๋Š”๊ฐ€์— ๋Œ€ํ•œ ์„ค๋ช…

 

 

 

cost func์— ๋Œ€ํ•œ ์„ค๋ช…, Log๋ฅผ ์ทจํ•˜์—ฌ ํ•ฉ์˜ ๋ฌธ์ œ๋กœ ๋ณ€ํ™˜