From a07bd3efd5608fdb58c67bc859f053e57553470f Mon Sep 17 00:00:00 2001 From: chiragbharadwaj Date: Wed, 25 Dec 2024 19:18:30 -0500 Subject: [PATCH] feat(blogs): added tons of new links and landing pages for the various blogs --- _assets/css/styles.css | 30 ++++++----------- _layouts/default.html | 58 ++++++++++++++++++------------- _layouts/landing.html | 29 ---------------- blogs/art/index.md | 12 +++++++ blogs/chinese/index.md | 12 +++++++ blogs/finance/index.md | 12 +++++++ blogs/index.md | 31 +++++++++++++++++ blogs/piano/index.md | 12 +++++++ blogs/shogi/index.md | 12 +++++++ index.md | 30 +++++++++++------ lectures/books/index.md | 64 ++++++++++++++++++++++------------- lectures/index.md | 24 +++++++++++++ lectures/math/index.md | 58 +++++++++++++++++++++++++++++++ lectures/ml/index.md | 75 +++++++++++++++++++++++++++++++++++++++++ 14 files changed, 354 insertions(+), 105 deletions(-) delete mode 100644 _layouts/landing.html create mode 100644 blogs/art/index.md create mode 100644 blogs/chinese/index.md create mode 100644 blogs/finance/index.md create mode 100644 blogs/piano/index.md create mode 100644 blogs/shogi/index.md create mode 100644 lectures/index.md create mode 100644 lectures/math/index.md create mode 100644 lectures/ml/index.md diff --git a/_assets/css/styles.css b/_assets/css/styles.css index cc4bd7e..08c8178 100644 --- a/_assets/css/styles.css +++ b/_assets/css/styles.css @@ -151,8 +151,15 @@ /* html: for overall page formatting */ html { background: white; - margin-top: 80px; - margin-bottom: 80px; + margin-top: 1em; + margin-bottom: 1em; + padding: 0em; + padding-bottom: 1em; +} +@media (min-width: 56em) { + html { + margin-top: 4em; + } } /* body: for the actual text found in pages by default */ @@ -163,7 +170,7 @@ body { line-height: 1.5em; margin: auto; - max-width: 68em; + max-width: 56em; width: 100%; } @@ -255,23 +262,6 @@ img.resize { margin-bottom: 1em; } -/* sidebar: for navigating back to the home page */ -.sidebar { - padding-bottom: 1em; - padding-right: 1em; -} -@media (max-width: 480px) { - html { - margin: 1em; - padding: 0em; - } -} -@media (min-width: 68em) { - .sidebar { - padding-top: 3em; - } -} - /* katex: for rendering equations dynamically on posts */ .katex { font-size: 1.1em !important; diff --git a/_layouts/default.html b/_layouts/default.html index 37e39fb..b4f7822 100644 --- a/_layouts/default.html +++ b/_layouts/default.html @@ -43,31 +43,43 @@
-
-
- - {% unless page.hide_nav %} - [Home] - {% endunless %} -
- -
- - {{content}} - - - {% unless page.hide_footer %} -
-
- This page was generated using Jekyll, Markdown, and KaTeX. -
+ + {% unless page.hide_nav %} +
+ {% endfor %} + ] + + {% endunless %} + + + {{content}} -
- -
-
+ + {% unless page.hide_footer %} +
+
+ This page was generated using Jekyll, Markdown, and KaTeX. +
+ {% endunless %}
{% if page.katex %} diff --git a/_layouts/landing.html b/_layouts/landing.html deleted file mode 100644 index a9f8692..0000000 --- a/_layouts/landing.html +++ /dev/null @@ -1,29 +0,0 @@ ---- -layout: default ---- - - - -{{content}} \ No newline at end of file diff --git a/blogs/art/index.md b/blogs/art/index.md new file mode 100644 index 0000000..7ed4859 --- /dev/null +++ b/blogs/art/index.md @@ -0,0 +1,12 @@ +--- +layout: default +title: blogs | art +--- + +# Drawings and paintings + +---- + +![construction][] + +[construction]: {{site.baseurl}}/_data/images/construction.png diff --git a/blogs/chinese/index.md b/blogs/chinese/index.md new file mode 100644 index 0000000..f155ba0 --- /dev/null +++ b/blogs/chinese/index.md @@ -0,0 +1,12 @@ +--- +layout: default +title: blogs | chinese +--- + +# Chinese language and literature + +---- + +![construction][] + +[construction]: {{site.baseurl}}/_data/images/construction.png diff --git a/blogs/finance/index.md b/blogs/finance/index.md new file mode 100644 index 0000000..1b8eb29 --- /dev/null +++ b/blogs/finance/index.md @@ -0,0 +1,12 @@ +--- +layout: default +title: blogs | finance +--- + +# Personal finance and early retirement + +---- + +![construction][] + +[construction]: {{site.baseurl}}/_data/images/construction.png diff --git a/blogs/index.md b/blogs/index.md index e69de29..6ef056b 100644 --- a/blogs/index.md +++ b/blogs/index.md @@ -0,0 +1,31 @@ +--- +layout: default +title: blogs +--- + +# Blogs + +---- + +Here are some of my personal blogs. They focus on my hobbies and interests as of now; if I develop any new avocations (e.g. pottery), then I'll be sure to add it to the list below. My goal with these blogs is to track my progress and skillset in a variety of areas. + +Please join me on my journey to the modern Renaissance! + +|Page|Title|Description| +|---|---|---| +|||| +|[[link]][finance]|*Personal finance*|Some koans around managing one's finances effectively towards early retirement.| +|||| +|[[link]][shogi]|*Shogi tactics*|Lessons on shogi strategies: openings, josekis, attacks, defenses, drops, endings.| +|||| +|[[link]][chinese]|*Chinese language*|Documenting proficiency in a foreign language. Focus on writing and speaking.| +|||| +|[[link]][piano]|*Piano performances*|Trying to re-teach myself piano from scratch. Recordings and analyses.| +|||| +|[[link]][art]|*Drawings and paintings*|A loose collection of my artwork. Mostly just tracking progress.| + +[finance]: {{site.baseurl}}/blogs/finance/ +[shogi]: {{site.baseurl}}/blogs/shogi/ +[chinese]: {{site.baseurl}}/blogs/chinese/ +[piano]: {{site.baseurl}}/blogs/piano/ +[art]: {{site.baseurl}}/blogs/art/ diff --git a/blogs/piano/index.md b/blogs/piano/index.md new file mode 100644 index 0000000..08b6074 --- /dev/null +++ b/blogs/piano/index.md @@ -0,0 +1,12 @@ +--- +layout: default +title: blogs | piano +--- + +# Piano performances and analyses + +---- + +![construction][] + +[construction]: {{site.baseurl}}/_data/images/construction.png diff --git a/blogs/shogi/index.md b/blogs/shogi/index.md new file mode 100644 index 0000000..ec4800d --- /dev/null +++ b/blogs/shogi/index.md @@ -0,0 +1,12 @@ +--- +layout: default +title: blogs | shogi +--- + +# Shogi tactics + +---- + +![construction][] + +[construction]: {{site.baseurl}}/_data/images/construction.png diff --git a/index.md b/index.md index 4cbe22c..8daad02 100644 --- a/index.md +++ b/index.md @@ -39,21 +39,31 @@ I work in machine learning, primarily in the recommendations space. A lot of my ## Various writings -This site exists primarily to document my thoughts about mathematics, machine learning, and data engineering. My hope is that these musings and treatises can also serve as a valuable pedagogical tool for other ML practitioners. +This site exists primarily to document my thoughts about mathematics, statistics, and machine learning. My hope is that these musings and treatises can also serve as a valuable pedagogical tool for other ML practitioners. ### Pedagogical expositions -- Axiomatic motivation of calculus -- Machine learning from scratch -- Practical lessons in ML -- Some solution sketches +- [[link]][calculus]   Axiomatic motivation of calculus +- [[link]][ml]   Machine learning from scratch +- [[link]][sketches]   Some solution sketches I also track my progress with my hobbies and interests on some associated blogs. ### Personal blogs -- Personal finance -- Shogi tactics -- Chinese language/literature -- Piano performances -- Drawings and paintings +- [[link]][finance]   Personal finance +- [[link]][shogi]   Shogi tactics +- [[link]][chinese]   Chinese language/literature +- [[link]][piano]   Piano performances +- [[link]][art]   Drawings and paintings + + +[calculus]: {{site.baseurl}}/lectures/math/ +[ml]: {{site.baseurl}}/lectures/ml/ +[sketches]: {{site.baseurl}}/lectures/books/ + +[finance]: {{site.baseurl}}/blogs/finance/ +[shogi]: {{site.baseurl}}/blogs/shogi/ +[chinese]: {{site.baseurl}}/blogs/chinese/ +[piano]: {{site.baseurl}}/blogs/piano/ +[art]: {{site.baseurl}}/blogs/art/ diff --git a/lectures/books/index.md b/lectures/books/index.md index 5134a0a..57dd558 100644 --- a/lectures/books/index.md +++ b/lectures/books/index.md @@ -1,5 +1,6 @@ --- -layout: landing +layout: default +title: books --- # Solution sketches to various texts @@ -12,44 +13,61 @@ Here are some solutions to selected problems from several foundational texts in ||Name of work|Author|Solution sketches| |---|---|---| -|![][pugh]{:.resize}|_Real Mathematical Analysis_|Charles Pugh|Forthcoming| -|![][rudin]{:.resize}|_Principles of Mathematical Analysis_|Walter Rudin|Forthcoming| -|![][spivak]{:.resize}|_Calculus on Manifolds_|Michael Spivak|Forthcoming| -|![][sheldon]{:.resize}|_Measure, Integration, and Real Analysis_|Sheldon Axler|Forthcoming| +|![][pugh]{:.resize}|_Real Mathematical Analysis_|Charles Pugh|[[link]][pugh-book]| +|![][rudin]{:.resize}|_Principles of Mathematical Analysis_|Walter Rudin|[[link]][rudin-book]| +|![][spivak]{:.resize}|_Calculus on Manifolds_|Michael Spivak|[[link]][spivak-book]| +|![][sheldon]{:.resize}|_Measure, Integration, and Real Analysis_|Sheldon Axler|[[link]][sheldon-book]| ## Abstract and linear algebra ||Name of work|Author|Solution sketches| |---|---|---| -|![][artin]{:.resize}|_Algebra_|Michael Artin|Forthcoming| -|![][axler]{:.resize}|_Linear Algebra Done Right_|Sheldon Axler|Forthcoming| -|![][cookbook]{:.resize}|_The Matrix Cookbook_|Kaare Petersen, Michael Pedersen|Forthcoming| +|![][artin]{:.resize}|_Algebra_|Michael Artin|[[link]][artin-book]| +|![][axler]{:.resize}|_Linear Algebra Done Right_|Sheldon Axler|[[link]][axler-book]| +|![][cookbook]{:.resize}|_The Matrix Cookbook_|K. Petersen, M. Pedersen|[[link]][cookbook-book]| ## Probability and statistics ||Name of work|Author|Solution sketches| |---|---|---| -|![][statsci]{:.resize}|_Probability and Statistics_|Ronald Walpole, Raymond Myers|Forthcoming| -|![][esl]{:.resize}|_Elements of Statistical Learning_|Trevor Hastie, Robert Tibshirani,
Jerome Friedman|Forthcoming| +|![][statsci]{:.resize}|_Probability and Statistics_|R. Walpole, R. Myers|[[link]][statsci-book]| +|![][esl]{:.resize}|_Elements of Statistical Learning_|T. Hastie, R. Tibshirani, J. Friedman|[[link]][esl-book]| ## Machine learning ||Name of work|Author|Solution sketches| |---|---|---| -|![][mlapp]{:.resize}|_Machine Learning: A Probabilistic Perspective_|Kevin Murphy|Forthcoming| -|![][bishop]{:.resize}|_Deep Learning: Foundations and Concepts_|Christopher Bishop|Forthcoming| +|![][mlapp]{:.resize}|_Machine Learning: A Probabilistic Perspective_|Kevin Murphy|[[link]][mlapp-book]| +|![][bishop]{:.resize}|_Deep Learning: Foundations and Concepts_|Christopher Bishop|[[link]][bishop-book]| -[pugh]: {{site.baseurl}}/_data/books/pugh/cover.jpg -[rudin]: {{site.baseurl}}/_data/books/rudin/cover.jpg -[spivak]: {{site.baseurl}}/_data/books/spivak/cover.jpg -[sheldon]: {{site.baseurl}}/_data/books/sheldon/cover.jpg -[artin]: {{site.baseurl}}/_data/books/artin/cover.jpg -[axler]: {{site.baseurl}}/_data/books/axler/cover.jpg -[cookbook]: {{site.baseurl}}/_data/books/cookbook/cover.png +[pugh]: {{site.baseurl}}/_data/books/pugh/cover.jpg +[rudin]: {{site.baseurl}}/_data/books/rudin/cover.jpg +[spivak]: {{site.baseurl}}/_data/books/spivak/cover.jpg +[sheldon]: {{site.baseurl}}/_data/books/sheldon/cover.jpg -[statsci]: {{site.baseurl}}/_data/books/statsci/cover.jpg -[esl]: {{site.baseurl}}/_data/books/esl/cover.jpg +[artin]: {{site.baseurl}}/_data/books/artin/cover.jpg +[axler]: {{site.baseurl}}/_data/books/axler/cover.jpg +[cookbook]: {{site.baseurl}}/_data/books/cookbook/cover.png -[mlapp]: {{site.baseurl}}/_data/books/mlapp/cover.jpg -[bishop]: {{site.baseurl}}/_data/books/bishop/cover.jpg \ No newline at end of file +[statsci]: {{site.baseurl}}/_data/books/statsci/cover.jpg +[esl]: {{site.baseurl}}/_data/books/esl/cover.jpg + +[mlapp]: {{site.baseurl}}/_data/books/mlapp/cover.jpg +[bishop]: {{site.baseurl}}/_data/books/bishop/cover.jpg + + +[pugh-book]: {{site.baseurl}}/lectures/books/pugh/ +[rudin-book]: {{site.baseurl}}/lectures/books/rudin/ +[spivak-book]: {{site.baseurl}}/lectures/books/spivak/ +[sheldon-book]: {{site.baseurl}}/lectures/books/sheldon/ + +[artin-book]: {{site.baseurl}}/lectures/books/artin/ +[axler-book]: {{site.baseurl}}/lectures/books/axler/ +[cookbook-book]: {{site.baseurl}}/lectures/books/cookbook/ + +[statsci-book]: {{site.baseurl}}/lectures/books/statsci/ +[esl-book]: {{site.baseurl}}/lectures/books/esl/ + +[mlapp-book]: {{site.baseurl}}/lectures/books/mlapp/ +[bishop-book]: {{site.baseurl}}/lectures/books/bishop/ \ No newline at end of file diff --git a/lectures/index.md b/lectures/index.md new file mode 100644 index 0000000..9fc5c04 --- /dev/null +++ b/lectures/index.md @@ -0,0 +1,24 @@ +--- +layout: default +title: lectures +--- + +# Pedagogical expositions + +---- + +Here are some of my treatises on various topics. They include both lecture-style notes on relevant topics in machine learning as well as solution-style sketches on problems drawn from various textbooks that I fancy. + +|Page|Title|Description| +|---|---|---| +|||| +|[[link]][calculus]|*Axiomatic calculus*|A collection of notes on deriving vector calculus theory from first principles.| +|||| +|[[link]][ml]|*ML from scratch*|Expositions on probability theory, statistical interpretations, ML, and deep learning.| +|||| +|[[link]][sketches]|*Solution sketches*|Worked-out answers to selected problems from math and ML textbooks.| + +[calculus]: {{site.baseurl}}/lectures/math/ +[ml]: {{site.baseurl}}/lectures/ml/ +[sketches]: {{site.baseurl}}/lectures/books/ + diff --git a/lectures/math/index.md b/lectures/math/index.md new file mode 100644 index 0000000..9ae56dd --- /dev/null +++ b/lectures/math/index.md @@ -0,0 +1,58 @@ +--- +layout: default +title: math +katex: true +--- + +# Axiomatic motivation of calculus + +---- + +## Author's note + +In this series of lectures, I present a full derivation of 19th- and 20th-century results in vector calculus. The exposition is done entirely from first principles; in other words, the only prerequisite is the usual demand for mathematical maturity. With any luck, these notes will provide a sturdy foundation of calculus atop which we can later rigorously develop [probability theory][prob]. + +Note that by "first principles", I really do mean _first_ principles, not third principles as some authors assume. Please see the list of modules below for a clearer picture of the presentation. We will follow the natural order that generations of students have used. + +## List of modules + +In keeping with the Commonwealth nomenclature, each module comprises several lectures. Please click on the associated links to see a detailed breakdown of lectures per module. The topics listed below survey broadly what each module aims to cover. + +### [[link]][single]   Single variable calculus + +|---|---|---|---| +|model theory|rational numbers|limits and functions|Riemann integration| +|propositional logic|real numbers|continuity|convergence| +|first-order logic|point-set topology|derivatives|Stone-Weierstrauss theorem| +|axiomatic set theory|sequences and series|Taylor's theorem|some special functions| + +### [[link]][linalg]   Linear algebra + +|---|---|---|---| +|vector spaces|matrices|eigenspaces|operators| +|subspaces|product spaces|inner products|multilinear algebra| +|span and basis|dual spaces|spectral theorem|bilinear forms| +|linear maps|polynomials|factorizations|determinants| + +### [[link]][multi]   Multivariable calculus + +|---|---|---|---| +|multivariate functions|implicit functions|change of variable|manifold integration| +|partial derivatives|integrable functions|chain integration|Stokes' theorem| +|inverse functions|Fubini's theorem|fundamental theorems|classical theorems| + +### [[link]][lebesgue]   Lebesgue theory + +|---|---|---|---| +|Non-Riemann integration|Lebesgue convergence|Lebesgue in $$R^n$$|Hilbert spaces| +|measure theory|Lebesgue integration|Banach spaces|orthogonality| +|measurable spaces|generalized differentation|Baire's theorem|linear maps| +|Lebesgue measure|product measures|$$L^p$$ spaces|Fourier analysis| + + +[prob]: {{site.baseurl}}/lectures/ml/prob/ + +[single]: {{site.baseurl}}/lectures/math/single/ +[linalg]: {{site.baseurl}}/lectures/math/linalg/ +[multi]: {{site.baseurl}}/lectures/math/multi/ +[lebesgue]: {{site.baseurl}}/lectures/math/lebesgue/ diff --git a/lectures/ml/index.md b/lectures/ml/index.md new file mode 100644 index 0000000..2fff7fe --- /dev/null +++ b/lectures/ml/index.md @@ -0,0 +1,75 @@ +--- +layout: default +title: ml +katex: true +--- + +# Machine learning from scratch + +---- + +## Author's note + +I've always wanted to have a centralized repository of lecture-style posts that covers the basics of modern ML theory. Although not all results developed here will harbor use in practical implementations (indeed, at the time of this writing much of ML is dominated by deep learning), the goal is to provide a strong foundation in classical interpretations of statistics as well as a rigorous treatment of the flavor of machine learning that "dominated the scene" for decades. Finally, there will be a significant module at the end dedicated towards more modern materials, including various probabilistic theories drawn from deep learning. + +It is highly recommended to read through the [axiomatic treatment][calculus] of calculus prior to revising these modules. I will freely assume familiarity with concepts such as $$\sigma$$-algebras and results from basic topology in the exposition on probability theory, for example. + +## List of modules + +In keeping with the Commonwealth nomenclature, each module comprises several lectures. Please click on the associated links to see a detailed breakdown of lectures per module. The topics listed below survey broadly what each module aims to cover. + +### [[link]][prob]   Probability theory + +|---|---|---|---| +|probability measures|independence|moments|multivariate analogues| +|sample spaces|random variables|conditional probability|discrete analogues| +|random events|expectation|Bayes' theorem|large number laws| +|probability spaces|variance|probability distributions|central limit theorem| + +### [[link]][info]   Information theory + +|---|---|---|---| +|Shannon entropy|conditional entropy|chain rules|maximum entropy| +|joint entropy|mutual information|differential entropy|Fisher information| + +### [[link]][freq]   Frequentist interpretation of statistics + +|---|---|---|---| +|discrete distributions|descriptive statistics|point estimates|regression problems| +|continuous distributions|estimation problems|confidence intervals|classification problems| +|transformations|sufficient statistics|hypothesis testing|factorial experiments| +|sampling distributions|likelihood estimators|correlation|non-parametrics| + +### [[link]][basic]   Classical machine learning techniques + +|---|---|---|---| +|linear regression|perceptrons|model inference|support vectors| +|least squares|regularization|tree-based models|random forests| +|shrinkage|kernel methods|bootstrap methods|bagging and sampling| +|logistic regression|model selection|gradient boosting|ensemble techniques| + +### [[link]][bayes]   Probabilistic machine learning + +|---|---|---|---| +|generative models|hierarchical models|generalized linear models|kernel techniques| +|conjugate priors|decision theory|Gaussian mixtures|Gaussian processes| +|Gaussian models|linear regression|latent linear models|adaptive basis functions| +|posterior distributions|logistic regression|sparse linear models|Markov models| + +### [[link]][deep]   Deep neural networks + +|---|---|---|---| +|multi-layer networks|backpropagation|transformer models|latent variables| +|deep networks|regularization|multi-modal methods|autoencoders| +|error functions|structured distributions|graph neural networks|diffusion models| +|gradient descent|attention mechanism|sampling techniques|large-language models| + + +[calculus]: {{site.baseurl}}/lectures/math/ + +[prob]: {{site.baseurl}}/lectures/ml/prob/ +[freq]: {{site.baseurl}}/lectures/ml/freq/ +[info]: {{site.baseurl}}/lectures/ml/info/ +[bayes]: {{site.baseurl}}/lectures/ml/bayes/ +[basic]: {{site.baseurl}}/lectures/ml/basic/ +[deep]: {{site.baseurl}}/lectures/ml/deep/