layer4down

@layer4down.bsky.social

243 Followers 350 Following

Cloud and Network Engineer. <heart> PowerShell, Python, Terraform, Rust, Go, NodeJs... + nuclear fusion energy. Be your own hero.

Side‑by‑side pair of line charts comparing how GPT‑5 (left, in blue) and an RLM system built on GPT‑5 (right, in orange) handle extremely long input prompts on three evaluation tasks: S‑NIAH, OOLONG, and OOLONG‑Pairs. Both charts share the same vertical axis “Score (%)” from 0 to 100 and the same horizontal axis “Input Context Length (log scale)” with labels 8k, 16k, 33k, 66k, 131k, 262k and then very long ranges 524k and 1M tokens.[arxiv] In the left GPT‑5 panel, three blue lines show performance dropping as context grows. The S‑NIAH line with circles starts near 100% and stays flat until about 131k tokens, then enters a pink shaded region beyond the model’s native window where it is no longer plotted. The OOLONG line with triangles begins around the 80–90% range but steadily declines toward roughly the mid‑40% range by 131k. The OOLONG‑Pairs line with squares starts lower and falls close to 0% well before the longest lengths, illustrating that pairwise long‑context reasoning collapses even when the text still fits in the context window.[arxiv] In the right RLM(GPT‑5) panel, the layout is the same but curves are orange and extend into a green shaded region covering 262k to 1M tokens, emphasizing ultra‑long contexts. The S‑NIAH line with circles remains essentially flat at or near 100% across the entire range out to 1M tokens, showing robust “needle‑in‑a‑haystack” retrieval at any length. The OOLONG and OOLONG‑Pairs lines, drawn with different orange markers, still decline somewhat but stay in a moderate accuracy band instead of crashing, indicating that the recursive setup substantially mitigates the degradation seen in the plain GPT‑5 chart.
A photo of Secretary of Defense Pete Hegseth with caption “D.U.I. Hire”.
A photo of a black man spanking a Klansman in broad day light ca. 1980’s. Caption reads: “Let us never forget Willie ‘Whoop Ass’ Johnson, the first Black man to whoop a Klansman on camera and not give a fuck. Happy Black History Month!”
Meme of two men. Man 1 says :"Why do billionaires care if they lose all their money? They'll just pull themselves up by their bootstraps and make it all back with their unbelievable work ethic." Man 2 responds: "Plus if they're poor, all the money will trickle back down to them, making them rich again."
Caption reads: "D U I Hire" with a picture of Fox Entertainment stories weekend host Pete Hegseth, seated with a bottle of Jack Daniels whiskey on a table before him.