CJ

@w3cj.com

3888 Followers 1635 Following

Full Stack Dev, Explainer of Things Senior Creator at @syntax.fm / @sentry.io Host of coding.garden on Twitch and YouTube

The output of a transformer (LLM) is a score (logit) for every possible next token. We then use temperature, softmax, top-p and sampling to choose the next token, excerpt from my video "I Built an LLM From Scratch"
The transformer architecture that powers modern LLMs explained, excerpt from my video "I Built an LLM From Scratch"
Token embeddings explained, excerpt from my video "I Built an LLM From Scratch"
Tokenization explained, excerpt from my video "I Built an LLM From Scratch"
A brief history of neural networks, excerpt from my video "I Built an LLM From Scratch"
What happens when you type a prompt into ChatGPT and press enter?
A photo of all the things you can win if you win the MadCSS bracket challenge. $1500 worth of stuff for first prize including one of every single thing from the syntax store, one of all the MadCSS exclusive merch AND a $69 taco bell gift card.
The last car on The Denver International Airport Automated Guideway Transit System at night with no passengers. The ceiling lights are orange and blue. The train tunnel can be seen out of the window.
example devcontainer.json with claude code and firewall
intro from malcolm in the middle season 3 episode 6 where hal replaces a light bulb
Experts are still needed to validate AI output. As a beginner if you depend on and trust AI output too much you'll never learn the skills required to validate it.
Asking why we trust AI output
A seagull standing on a guard rail on a dock with the NYC skyline in the background.
The clouds and the wing of an airplane.
Dock of boats in fishermans wharf in san francisco. The boats from left to right are outlined in blue, red, yellow green and turquoise.
pictures of an empty tokyo shimbashi and shiodome stations.
Zojo-ji Temple with Tokyo Tower behind it.
Trees in the foreground. A large ventilation pipe on the left. Tall buildings that go on in the distance.
Photos taken in Bear Creek Greenbelt in Lakewood Colorado.
Picture of my desk. Durgod keyboard. Perixx Vertical left handed mouse. LG UltraGear QHD 34 inch monitor. PreSonus 3.5" monitors. Sony FX30 with YONGNUO YN11MM F1.8S lens. Sure MV7 Mic. Vanilla Soylent nutrition shake.
CJ standing at a podium giving his talk.
// example web component that uses tailwind import tailwind from "./index.css?inline"; export class MyComponent extends HTMLElement { constructor() { super(); const styles = document.createElement("style"); styles.innerHTML = tailwind; this.append(styles); // rest of the codes } }
Shirt with the phrase "Webmaster" in big letters on top of vintage beige computers and keyboards.
A photo montage of sights in New York City taken by a Sony Mavica MVC-FD73. The video starts with photos showcasing the Sony Mavica MVC-FD73 - a digital camera from 2001. The montage of photos includes: Washington Square Park, The New York Public Libary, The New York Times building, Times Square, Subway stations, the city skyline as seen from within central park facing south, the Bethesda Fountain in Central Park, the clock in Grand Central station with an american flag behind it, the Brooklyn Bridge, the statue of liberty, the World Trade Center memorial fountain
A photo of 2 New York City Policemen standing and staring at a burning trash can in front of a CVS. Picture taken from across the street.
Man sings this song while playing ukulele: Well there's a ghost in the machine Yes it would seem My code didn't work And now it does And I didn't change a thing
Empty shelves in a grocery store. The shelves have a blue backing with scattered white clouds. There is a butterfly in the bottom left.
A saint Bernard dog running through the snow and then stopping to lay down and push his face into the snow.
A saint bernard dog staring up. He is wearing a barrel around his neck and a red plaid bandana.