Watch your next demo day meeting... Some people will get tons of reacts, comments; some people get nothing. At least in person you get the obligatory smattering of claps after the talk. When there's nothing at all, it feels like you did something wrong.
No modern LLM can tell how many eyes the magic card Pit Imp has. They all say 2. This is across all reasoning levels and paid Gemini, Claude, and GPT (Sol)
Drawing a line red to split up the image then has them answer correctly.
Yes - those failures (like strawberry) are. And those failures are very rare, which is why you had to reach for the Pit Imp MTG card, which I had to Google to understand your point.
Cohen, Hamri, Geva & Globerson, "LM vs LM: Detecting Factual Errors via Cross Examination": Cross-examination "detects over 70% of the incorrect claims while maintaining a high precision of >80%".
>Zhipu initially attempted to target the cyber capabilities of Anthropic’s Fable model. Fable—Anthropic’s top generally accessible model—has strengthened cyber safeguards, making it more difficult for would-be distillers to target Fable’s cyber capabilities. Zhipu eventually gave up trying to target Fable after Anthropic’s cyber safeguards degraded Zhipu’s attacks.
My friend's vibe coded vercel site got hit by Meta for 21 million page views in 2 days. It cost him over $300.
My self hosted compose stack running in my basement with two 9's of uptime was a 1 time cost of $600 between cat6e, refurb mini PCs and tons of time prompting for NixOS flakes that met my needs. I'm not sure who came out ahead.
Opus was trained based on it's internal CoT due to a bug for generations. Gemini's depression extended through models. OpenAI has killed people. We've already seen cross gen misalingment.
Yes, I truly, wholeheartedly believe if people who aren't negligent are at the wheel, they'll "fair better" here. I encourage you to read the xitter linked above.
Of course, depending on which side of the terminator fanfiction you land on, you may disagree and feel that the software can rope-a-dope someone with the wherewithal to pay attention to what it's doing.
I just don't see how people who are truly cautious and methodical can persist in an environment that is defined by a pressure to produce "progress" as fast as possible. The competitive race tends to weed out people who slow down to make sure they do everything right.
reply