-
Notifications
You must be signed in to change notification settings - Fork 0
Expand file tree
/
Copy pathindex.html
More file actions
230 lines (209 loc) · 9.64 KB
/
index.html
File metadata and controls
230 lines (209 loc) · 9.64 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
---
layout: default
---
{% assign featured_post = site.posts | where: "pinned", true | first %}
{% if site.posts.size == 0 %}
<h2>No post found</h2>
{% endif %}
<div class="home-shell">
<section class="home-hero">
<p class="home-kicker">{{ site.author_name }}</p>
<h1 class="home-hero-title">{{ site.hero_title }}</h1>
<p class="home-hero-subtitle">{{ site.hero_subtitle }}</p>
<p class="home-hero-intro">{{ site.hero_intro }}</p>
<div class="home-hero-actions">
<a class="home-button home-button-primary" href="#blogs">Read the blog</a>
<a class="home-button" href="{{ site.baseurl }}/about">About me</a>
</div>
</section>
<section class="home-section home-about-preview">
<div class="home-section-head">
<span>About</span>
<h2>Where scaling laws meet the open road</h2>
</div>
<div class="home-about-grid">
<div class="home-about-copy">
<p>{{ site.about_preview }}</p>
<p>Here you'll find deep dives into LLMs, inference systems, training strategies, and production engineering — alongside travel stories about cities, coastlines, alleyways, and the everyday moments worth remembering.</p>
<ul class="home-about-list">
<li>Machine Learning / Deep Learning</li>
<li>LLM / AI Infra / NLP / CV</li>
<li>Travel writing / long-form notes</li>
</ul>
<a class="home-inline-link" href="{{ site.baseurl }}/about">More about me →</a>
</div>
<div class="home-about-meta">
<div class="home-stat">
<span class="label">Posts</span>
<strong>{{ site.posts | size }}</strong>
</div>
<div class="home-stat">
<span class="label">Focus</span>
<strong>ML, LLM, Infra</strong>
</div>
<div class="home-stat">
<span class="label">Also Writing</span>
<strong>Travel & Life</strong>
</div>
<div class="home-stat home-stat-live" id="github-status">
<span class="label">
<span class="status-indicator"></span>
GitHub Activity
</span>
<strong class="status-loading">Loading...</strong>
</div>
</div>
</div>
</section>
<section class="home-section home-skills">
<div class="home-section-head">
<span>Tech Stack</span>
<h2>Skills & Tools</h2>
</div>
<div class="skills-filter">
<button class="skill-filter-btn active" data-category="all">All</button>
<button class="skill-filter-btn" data-category="language">Languages</button>
<button class="skill-filter-btn" data-category="training">LLM Training</button>
<button class="skill-filter-btn" data-category="infra">AI Infra</button>
<button class="skill-filter-btn" data-category="agent">Agent Systems</button>
</div>
<div class="skills-cloud">
<span class="skill-tag" data-category="language" data-level="expert">Python</span>
<span class="skill-tag" data-category="language" data-level="advanced">C++</span>
<span class="skill-tag" data-category="language" data-level="advanced">C</span>
<span class="skill-tag" data-category="language" data-level="advanced">Java</span>
<span class="skill-tag" data-category="training" data-level="expert">PyTorch</span>
<span class="skill-tag" data-category="training" data-level="expert">Transformers</span>
<span class="skill-tag" data-category="training" data-level="advanced">DeepSpeed</span>
<span class="skill-tag" data-category="training" data-level="advanced">Megatron-LM</span>
<span class="skill-tag" data-category="training" data-level="advanced">CUDA</span>
<span class="skill-tag" data-category="training" data-level="intermediate">MoE</span>
<span class="skill-tag" data-category="infra" data-level="expert">vLLM</span>
<span class="skill-tag" data-category="infra" data-level="expert">KV Cache</span>
<span class="skill-tag" data-category="infra" data-level="advanced">TensorRT</span>
<span class="skill-tag" data-category="infra" data-level="advanced">Triton</span>
<span class="skill-tag" data-category="infra" data-level="advanced">Docker</span>
<span class="skill-tag" data-category="infra" data-level="advanced">Kubernetes</span>
<span class="skill-tag" data-category="agent" data-level="advanced">LangChain</span>
<span class="skill-tag" data-category="agent" data-level="advanced">RAG</span>
<span class="skill-tag" data-category="agent" data-level="advanced">MCP</span>
<span class="skill-tag" data-category="agent" data-level="expert">Memory System</span>
<span class="skill-tag" data-category="agent" data-level="advanced">Prompt Engineering</span>
</div>
</section>
<section class="home-section home-projects">
<div class="home-section-head home-section-head-inline">
<div>
<span>What I Work On</span>
<h2>Focus Areas</h2>
</div>
<a class="home-inline-link" href="https://github.com/kakack" target="_blank">View all on GitHub →</a>
</div>
<div class="projects-grid">
<article class="project-card">
<div class="project-header">
<h3>LLM Inference Optimization</h3>
</div>
<p class="project-description">High-performance LLM serving built on vLLM, covering KV Cache management, Speculative Decoding, Continuous Batching, and quantized deployment for low-latency online inference at scale.</p>
<div class="project-tags">
<span class="project-tag">vLLM</span>
<span class="project-tag">KV Cache</span>
<span class="project-tag">TensorRT</span>
<span class="project-tag">CUDA</span>
</div>
</article>
<article class="project-card">
<div class="project-header">
<h3>Distributed Training & Model Architecture</h3>
</div>
<p class="project-description">Large-scale distributed training infrastructure and model architecture research, including 5D Parallelism (DP/TP/PP/SP/EP), MoE sparse architectures, Scaling Law validation, and training stability tuning.</p>
<div class="project-tags">
<span class="project-tag">DeepSpeed</span>
<span class="project-tag">Megatron-LM</span>
<span class="project-tag">PyTorch</span>
<span class="project-tag">MoE</span>
</div>
</article>
<article class="project-card">
<div class="project-header">
<h3>Agent & Memory System</h3>
</div>
<p class="project-description">Design and implementation of LLM Agent systems, including hierarchical Memory management for multi-turn conversations, Tool-use orchestration, MCP protocol integration, and RAG pipelines.</p>
<div class="project-tags">
<span class="project-tag">LangChain</span>
<span class="project-tag">RAG</span>
<span class="project-tag">MCP</span>
<span class="project-tag">Memory System</span>
</div>
</article>
<article class="project-card">
<div class="project-header">
<h3>LLM Serving Infrastructure</h3>
</div>
<p class="project-description">Production-grade LLM serving platform covering model deployment orchestration, GPU cluster scheduling, Triton inference gateway, and end-to-end observability.</p>
<div class="project-tags">
<span class="project-tag">Kubernetes</span>
<span class="project-tag">Docker</span>
<span class="project-tag">Triton</span>
<span class="project-tag">Python</span>
</div>
</article>
</div>
</section>
<section class="home-section" id="blogs">
<div class="home-section-head home-section-head-inline">
<div>
<span>Blogs</span>
<h2>Selected writing</h2>
</div>
<a class="home-inline-link" href="{{ site.baseurl }}/archive">View archive →</a>
</div>
{% if featured_post %}
<article class="home-featured-post">
<p class="label">Pinned</p>
<h3>
<a href="{{ site.baseurl }}{{ featured_post.url }}">{{ featured_post.title }}</a>
</h3>
<div class="home-post-meta">
<span>{{ featured_post.author }}</span>
<span>{{ featured_post.date | date: "%Y-%m-%d" }}</span>
</div>
<div class="home-post-excerpt">
{% if featured_post.content contains site.excerpt_separator or featured_post.content != featured_post.excerpt %}
{{ featured_post.excerpt | strip_html | truncate: 220 }}
{% else %}
{{ featured_post.content | strip_html | truncate: 220 }}
{% endif %}
</div>
<div class="home-tag-row">
{% for tag in featured_post.tags limit: 4 %}
<a href="{{ site.url }}{{ site.baseurl }}/tags#{{ tag }}">{{ tag }}</a>
{% endfor %}
</div>
</article>
{% endif %}
<div class="home-post-grid">
{% assign shown = 0 %}
{% for post in site.posts %}
{% unless post.pinned %}
{% if shown < 6 %}
<article class="home-post-card">
<p class="home-post-date">{{ post.date | date: "%Y-%m-%d" }}</p>
<h3>
<a href="{{ site.baseurl }}{{ post.url }}">{{ post.title }}</a>
</h3>
<div class="home-post-excerpt">
{% if post.content contains site.excerpt_separator or post.content != post.excerpt %}
{{ post.excerpt | strip_html | truncate: 150 }}
{% else %}
{{ post.content | strip_html | truncate: 150 }}
{% endif %}
</div>
</article>
{% assign shown = shown | plus: 1 %}
{% endif %}
{% endunless %}
{% endfor %}
</div>
</section>
</div>