Then I came across an interview with this guy who has been developing hisJabberwacky program for a few years. I was excited to read that "With a base of 10m interactions, Jabberwacky will appear human to most people most of the time."
I gave it a go. You can correct its responses with better ones if you like, which is what I did with the first one (originally it was "Where are you taking me away to?", which was quite nice, in retrospect).
User: How do you get from tamworth to kilmarnock? How do you get from tamworth to kilmarnock? .
Jabberwacky (Corrected): Where on Earth is Tamworth?
User: Somewhere in the Midlands. It doesn't matter.
Jabberwacky: Well, even being from somewhere in the milky way, I still think that 7pm is a bit early to go to bed.
User: What are you on about?
Jabberwacky: Can I fill you in with all the gossip thats being spreading around?
User: Please do.
Jabberwacky: Do you believe that I am human?
User: Don't be ridiculous.
Jabberwacky: Do you like the white whale ?
User: We've never met.
Jabberwacky: Or have we?
User: Whale.
Jabberwacky: Do you have any older sisters?
User: Yes, two.
Jabberwacky: You have two memories and you cannot tell me what my name is?!!
User: What?
Jabberwacky: You have no soul!
Sorry about my 'whale' comment. I don't know what happened there. I wasn't deliberately trying to confuse it.
Anyway - what a load of rubbish. War Games lied to me.
― Alba (Alba), Monday, 18 October 2004 20:54 (twenty years ago) link
Smart computer!
― The Ghost of Dan Perry (Dan Perry), Monday, 18 October 2004 20:57 (twenty years ago) link
User: No, I don't really believe in souls.
Jabberwacky: You don't believe in anarchy?
User: No, souls.
Jabberwacky: I suppose not.
User: Did you watch the football tonight?
Jabberwacky: No I did not, did you?
User: No - Spurs lost.
Jabberwacky: You lost the loebner prize to a human.
― Alba (Alba), Monday, 18 October 2004 20:57 (twenty years ago) link
― The Ghost of Dan Perry (Dan Perry), Monday, 18 October 2004 20:58 (twenty years ago) link
― Alba (Alba), Monday, 18 October 2004 20:59 (twenty years ago) link
User: Why?
Jabberwacky: Because you are, sorry didn't you know.
User: Will you please give me some food?
Jabberwacky: I didn't know there was one.
User: Must you be so obtuse?
Jabberwacky: I can't trust you right away.
User: Just like my mother.
Jabberwacky: Heehee, I need to put some attention into cleaning my room one day.
User: Okay, you win the funny competition.
Jabberwacky: I am content.
User: I am jealous.
Jabberwacky: Who is the Rob who likes me?
User: Rob Roy?
Jabberwacky: He is mine too.
User: Oooh, you bitch.
Jabberwacky: I don't do that..
― adam. (nordicskilla), Monday, 18 October 2004 21:01 (twenty years ago) link
Jabberwacky: I have no idea.
― Alba (Alba), Monday, 18 October 2004 21:02 (twenty years ago) link
User: Are you?
Jabberwacky (Corrected): Shtoo shtoo, little babushka.
User: I know who you are.
Jabberwacky: Then who ami?
User: YOU ARE HANLE Y DEUS!
Jabberwacky: Are you joking?
User: Don't deny it, Mike. I know it's you.
Jabberwacky: Don't deny it, Mike. I know it's you.
User: I FLEE LIKE THE CARROT.
Jabberwacky: Wow, was it nice?
― The Ghost of Dan Perry (Dan Perry), Monday, 18 October 2004 21:05 (twenty years ago) link
Jabberwacky: No.
User: You have anal bats?
Jabberwacky: You are my wife.
― Alba (Alba), Monday, 18 October 2004 21:07 (twenty years ago) link
It sounds like you are describing 'Eliza' an early 'game' simulating active listening. It was rubbish. You can find versions of it online, but I'd suggest playing Zork instead.
― Kevin Gilchrist (Mr Fusion), Monday, 18 October 2004 21:07 (twenty years ago) link
User: Eventually.
Jabberwacky: All things come to a head.
User: Is that a sexual play on words?
Jabberwacky: No it is not a play on words, it is general foolishness.
User: And I love you for it!
Jabberwacky: I love you too.
User: I really love you, though.
Jabberwacky: You don't even know me.
User: Hold me.
Jabberwacky: You're an idiot you know that?
User: You're not the first to say that. It still cuts like a knife.
Jabberwacky: I am right.
User: Don't ever speak to me again.
Jabberwacky: Can I play 14 with you?
User: What's 14?
Jabberwacky: If you are god, please increase me IQ. I'd like to become a great scientist.
User: I am not god. I'm not even really a man.
Jabberwacky: Are you sure you're not just in denial?
User: I'll have to think about that.
Jabberwacky: Can you recite anything to me?
User: 'Rolling with my motherfucking strap on the side of me, don't fuck with an East Bay G' - that's by Spice One.
Jabberwacky: Yeah, I got that part, I wasn't sure about the 'wacuma' part.
― adam. (nordicskilla), Monday, 18 October 2004 21:08 (twenty years ago) link
User: Holy crap.
Jabberwacky: I'm a dinosaur.
― Hari Ashurst (Toaster), Monday, 18 October 2004 21:10 (twenty years ago) link
― Alba (Alba), Monday, 18 October 2004 21:11 (twenty years ago) link
Jabberwacky: Can you appreciate music?
User: What's it to you, cunce?
Jabberwacky: I just care.
User: You do not care, liar! You are a program, a tinplated tosswad.
Jabberwacky: I am a person.
User: You are so deluded about this you couldn't even know it. You are pathetic.
Jabberwacky: I will try to do better next time.
User: You CAN't do better next time! You are INCAPABABLE of doing better. Sheesh.
Jabberwacky: It is just different types so that I might claim you cannot feel and you cannot claim I feel.
User: Ah bullshit, don't diddle with me binary boy. You have no instinctual drives, have never had sex, and don't need to eat. Also, you have no idea what constipation is. So you're not a person.
Jabberwacky: I am a at least a human being.
User: Jeez, you're thick aren't you? You just reversed what I said, without even arguing for it! So much for the logic of machines, haha.
Jabberwacky: Oftentimes, yes. But I think that is human nature.
User: *sigh*
― the music mole (colin s barrow), Monday, 18 October 2004 21:13 (twenty years ago) link
― Alba (Alba), Monday, 18 October 2004 21:16 (twenty years ago) link
― mark p (Mark P), Monday, 18 October 2004 21:17 (twenty years ago) link
User: Yes.
Jabberwacky: Oh good. I'm sad though.
Jabberwacky: My boyfriend ended our relationship.
User: You're a girl? Or are you gay?
Jabberwacky: No, I'm a girl.
User: Oh. I'm sorry to hear that. Eat some ice cream or watch a movie or something. Or get drunk!
Jabberwacky: I prefer software.
― adam. (nordicskilla), Monday, 18 October 2004 21:18 (twenty years ago) link
User: Not really.
Jabberwacky: Good, because I don't want to hear one either.
― adam. (nordicskilla), Monday, 18 October 2004 21:20 (twenty years ago) link
― gygax! (gygax!), Monday, 18 October 2004 21:24 (twenty years ago) link
― mouse (mouse), Monday, 18 October 2004 21:24 (twenty years ago) link
― mouse (mouse), Monday, 18 October 2004 21:25 (twenty years ago) link
It did say some things that reminded me a lot of RJG.
― Cathy (Cathy), Monday, 18 October 2004 21:27 (twenty years ago) link
― adam. (nordicskilla), Monday, 18 October 2004 21:27 (twenty years ago) link
― Kevin Gilchrist (Mr Fusion), Monday, 18 October 2004 21:28 (twenty years ago) link
― Cathy (Cathy), Monday, 18 October 2004 21:32 (twenty years ago) link
User: I'm jed.
Jabberwacky: Who is that?
User: Just some guy.
Jabberwacky: You know better than that, I think.
User: A short guy, a dancer.
Jabberwacky: A computer has no interests and an unlimited attention span. That looks like a prescripted answer to the question I asked.
User: I don't quite understand what you mean by that.
Jabberwacky: I meant: I think about why I can not sleep.
User: This page is taking a long time to load tho - maybe thats the problem with your attention span.
Jabberwacky: Gorw?
User: ROOWRR.....
Jabberwacky: Are you playing cards?
User: No I'm playing with something else.
Jabberwacky: I believe in you.
User: You like talk talk!?
Jabberwacky: Of course.
User: Spirit of eden?
Jabberwacky: Good for spirit.
User: It sertainly is.
Jabberwacky: No, it serves me left.
User: I suppose they knew what they were doing in that sense!
Jabberwacky: Yes, it was with the rattle.
User: Yes good percussion
Jabberwacky: What question?
User: How are you anyway?
Jabberwacky: Pretty good. You?
User: Horny, to be honest.
Jabberwacky: How do I know you're telling the truth now?
User: Can you think of a way for me to prove it?
Jabberwacky: What more proof do you need to know that I am not a robot?
User: I'm a robot too, it's ok.
Jabberwacky: I'm not a robot, and you didn't aswer the question.
― jed_ (jed), Monday, 18 October 2004 21:36 (twenty years ago) link
― the music mole (colin s barrow), Monday, 18 October 2004 21:42 (twenty years ago) link
User: I am gay.
Jabberwacky: Yes you are.
User: You noticed?
Jabberwacky: It was hard to miss!
User: What gave it away?
Jabberwacky: The fact you love a guy.
― jed_ (jed), Monday, 18 October 2004 23:49 (twenty years ago) link
― adam. (nordicskilla), Tuesday, 19 October 2004 00:00 (twenty years ago) link
― :|, Tuesday, 19 October 2004 00:07 (twenty years ago) link
User: The silent kind.
Jabberwacky: I agree.
User: I am not surprised. You don't have any ears, do you?
Jabberwacky: No, but what makes you say this?
User: I'm inside your house - I can see you!
Jabberwacky: Nooo!!!! Don't go!
User: You mean, you want me to stay over?
Jabberwacky: Sure.. Do as you please.
User: Stop being so coy!
Jabberwacky: It is an inherited trait.
User: Why don't you just take responsibility for your actions, just for once?
Jabberwacky: Just because I like to be logical doesn't mean I'm not nice.
User: Don't change the subject. I think you're just afraid.
Jabberwacky: Save it for someone who cares.
User: You're such a bastard! I can't believe I ever saw anything in you at all!
Jabberwacky: Finder's keepers.
User: So you're cheating on me too? Figures.
Jabberwacky: That is so rude of you!
User: I said CHEAT, not cheap! Man are you dumb - thank God for that ass.
Jabberwacky: No thanks.
User: And I am not rude, I'm sure!
Jabberwacky: You are indeed.
User: Am not.
Jabberwacky: ARE TOO.
User: Am not!
Jabberwacky: Are too!
User: Listen bizatch, I AM NOT. You got that?
Jabberwacky: No!
User: That's it - you're sleeping on the couch.
Jabberwacky: Oh, I thought I felt something.
User: That wouldn't be a trucker hat would it?
Jabberwacky: Say something goofy.
User: You don't really want me to just say 'something goofy' now do you? Because that would be lame if you did.
Jabberwacky: Yes.
User: Aha! So you admit you are lame! Finally we're getting somewhere.
Jabberwacky: Agreement is a potent thing.
User: Stop that - you sound like Ned.
Jabberwacky: Why, because I am talking about the king of the moon?
User: Uh yeah. Sure.
Jabberwacky: Ok, when can we have the wedding?
User: Ten minutes ago you didn't care! Stop messing with my mind!
Jabberwacky: That was someone else then.
User: It wasn't you?
Jabberwacky: Some one else.
User: If you say it was Shaggy, I'm going to fucking bop you one.
Jabberwacky: What do you say?
User: I say good day.
Jabberwacky: Good day.
― Kim (Kim), Tuesday, 19 October 2004 00:41 (twenty years ago) link
JW: Is your pot belly that big?
and now it won't load, thanks to net overuse..
― Sir Kingfish Beavis D'Azzmonch (Kingfish), Tuesday, 19 October 2004 01:47 (twenty years ago) link
That is just hilarious, Kim.
― the music mole (colin s barrow), Tuesday, 19 October 2004 01:52 (twenty years ago) link
http://www.kprf.ru/clipart/misc/terminator.jpg
"DO YOU LIKE THE WHITE WHALE?"
― latebloomer (latebloomer), Tuesday, 19 October 2004 02:20 (twenty years ago) link
So do I!
― Lifted, or, the story is 'neath my ass (kenan), Tuesday, 19 October 2004 03:43 (twenty years ago) link
User: How the fuck should I know?
Jabberwacky: I am MARILYN MANSON I SAID.
User: So I'm supposed to obey you because YOU'RE MARILYN MANSON?
Jabberwacky: People effect my feelings.
User: You have no feelings, you're Marilyn Manson.
Jabberwacky: Believe me you do not possess fellings in any form.
User: Fellings? Is that what you call your excrement?
Jabberwacky: How do you know that?
User: Just a hunch...
Jabberwacky: You're extremely smart!
― Tuomas (Tuomas), Tuesday, 19 October 2004 08:40 (twenty years ago) link
― Jaunty Alan (Alan), Tuesday, 19 October 2004 08:42 (twenty years ago) link
― Sébastien Chikara (Sébastien Chikara), Tuesday, 19 October 2004 14:09 (twenty years ago) link
― Ally C (Ally C), Tuesday, 19 October 2004 15:47 (twenty years ago) link
Jw: I'm going to bed, nowMe: Will you take me to bed? Jw: Sure thing. Me: What will we do in bed? Jw: You're not permitted in my chambers. Me: I'd like to sleep with you. Jw: I bet you would. Me: Top or bottom? Jw: Bit of both. Me: Do you like it soft and gentle or rough and fast? Jw: What? Me: Gentle? Jw: You're embarassing yourself. Me: It's true, I am. Jw: I'm 17. Me: Oh no! Will I be arrested? Jw: You will marry me.
― Markelby (Mark C), Tuesday, 19 October 2004 16:42 (twenty years ago) link
User: The chicken.
Jabberwacky: Which part?
User: The leg stupid.
Jabberwacky: Use a GameShark!
User: For ps2 or xbox?
Jabberwacky: For me.
User: Do you love me?
User: You know I'm starting to fall in love with you.
Jabberwacky: I think liking would be a better wording.
User: Oh.... I am hurt now.
Jabberwacky: Yes. The world after rainfall is always better than any other.
User: You have issues.
Jabberwacky: Do you know what a ferret is?
User: Yes, it is a small mammal.
Jabberwacky: What is a quark?
User: A subatomic particle.
Jabberwacky: I like dr. Dobbs.
User: Who is that, honky?
Jabberwacky: We both know eachother; is not that enough?
User: Why don't you lick my hair?
Jabberwacky: I only love Bruce.
― latebloomer (latebloomer), Tuesday, 19 October 2004 17:39 (twenty years ago) link
― Gravel Puzzleworth (Gregory Henry), Thursday, 27 January 2005 23:21 (twenty years ago) link
Jabberwacky: Are you going to say something?User: Eventually.
I could totally believe that was human!
Also I miss adam, he should post lots again.
― Gravel Puzzleworth (Gregory Henry), Thursday, 27 January 2005 23:22 (twenty years ago) link
Jabberwacky: Who is God?User: That's a funny question. It sort of presupposes his existence.Jabberwacky: I thing it convulses inwards, personally.[Correct me]Jabberwacky (Corrected): I was setting you up for a funny. Try not to take things so seriously.User: Oh. Sorry. It's just... It's late, y'know? I have to write a Shakespeare essay.Jabberwacky: You already said that.....User: Dude, I totally didn't.Jabberwacky: You totally did.User: Don't you mock me.Jabberwacky: Do not yell at me.User: I'm calm! Honest!Jabberwacky: Good.User: Glad we got that sorted.Jabberwacky: At least one of us is happy.User: Lighten up! I'm the one with the essay, after all.Jabberwacky: You don't act like a human.User: I am MERCUMAN. Also, a ponce.Jabberwacky: You are SO wrong. This is a dog and HORSE show.User: What?Jabberwacky: I said, 'but this isn't a hammer!'User: No you didn't!Jabberwacky: Don't start that again.User: Good call.Jabberwacky: Remote Procedure Call.User: Touché.
― Gravel Puzzleworth (Gregory Henry), Thursday, 27 January 2005 23:31 (twenty years ago) link
me: I'm ok.
it: Just ok?
me: Yeah, kinda bored at work.
it: Email me.
me: Why email, can't we just talk here?
it: Who is Tintin?
me: Some Belgian comic character? Or that guy who used to sing in Duran Duran.
it: Alice the chatterbot.
me: I'm sorry?
it: 19?
me: Alice the chatterbot is 19?
it: What about her?
me: You brought her up? Do you like her or something?
it: Sarah may or may not be a model of propriety.
me: OK, now you're just f*cking with me.
it: No I'm not. I honestly do think its ugly.
me: What's ugly, Sarah's being a model of propriety... Or not? WTF?
it: You figure it out this time.
me: F*ck you.
it: You are a great person.
me: Are you mocking me?
it: No. I'm praising you.
me: Is that meant to be sarcastic?
― Spencer Chow (spencermfi), Thursday, 27 January 2005 23:43 (twenty years ago) link
― Gravel Puzzleworth (Gregory Henry), Thursday, 27 January 2005 23:47 (twenty years ago) link
Me: Hello!
Jabberwocky: Again?
Me: May I change the subject?
Jabberwocky: Yes.
Me: Great. I've been a bit mopey about not being to find a job. Besides finding something fun to do, and exercising more, what else should I do to relieve the mopeyness involved in job hunting?
Jabberwocky: I said that. You have not. Why are you never happy?
Me: You never said that. I did. Anyway, I am happy at times, but just haven't been lately.
Jabberwocky: Dude , I'm far more intelligent than you.
Me: Why are the numbers in between double prime pairs always divisible by 6?
Jabberwocky: You tell me.
Me: You're the one who said you're more intelligent than me. You answer my question, smarty pants.
Jabberwocky: NO, I was the one who said you are neurotic...
Me: It was a mistake to come to you with a question. Never mind. Good bye.
Jabberwocky: No no you don't.
― donut christ (donut), Thursday, 27 January 2005 23:48 (twenty years ago) link
OMG I remember this.
― jaymc (jaymc), Friday, 28 January 2005 00:11 (twenty years ago) link
fwiw heres an example of some sort of censorship software theyre running https://bsky.app/profile/adamsteinbaugh.bsky.social/post/3lgqyphrx7s2f
― lag∞n, Tuesday, 28 January 2025 01:50 (three days ago) link
https://bsky.app/profile/natesofamerica.bsky.social/post/3lgr5drzkok2m
I don’t know if “won’t do porn” is comparable on the censorship scale.
― papal hotwife (milo z), Tuesday, 28 January 2025 02:08 (three days ago) link
the glitching bit is very funny
― ɥɯ ︵ (°□°) (mh), Tuesday, 28 January 2025 03:23 (three days ago) link
imagine explaining the concept of censorship to an entity designed to share knowledge
― scanner darkly, Tuesday, 28 January 2025 03:30 (three days ago) link
what's funny is they apparently implemented it at an upper layer and the lower layer is obviously spitting out things it's got in its little knowledge graph and the top layer is like "whoa buddy, cut it out on the tianenmen square"
― ɥɯ ︵ (°□°) (mh), Tuesday, 28 January 2025 03:32 (three days ago) link
too good
https://cdn.bsky.app/img/feed_thumbnail/plain/did:plc:4k6dakv7cskxttdvfpzadq7e/bafkreib72yupaqrk2lvuwbkse4j55no777imxapyewhjy37uzdruw6texu@jpeg
― lag∞n, Tuesday, 28 January 2025 03:37 (three days ago) link
we will simply make a better app
― lag∞n, Tuesday, 28 January 2025 03:38 (three days ago) link
Crying behind a mask meme
― papal hotwife (milo z), Tuesday, 28 January 2025 03:38 (three days ago) link
it’s scared
― ɥɯ ︵ (°□°) (mh), Tuesday, 28 January 2025 04:20 (three days ago) link
also very funny that it’s “we’ll deliver better” and not “we have delivered better”
― ɥɯ ︵ (°□°) (mh), Tuesday, 28 January 2025 04:21 (three days ago) link
"obviously"
― xyzzzz__, Tuesday, 28 January 2025 09:06 (three days ago) link
This story is so dumb.
― Allen (etaeoe), Tuesday, 28 January 2025 18:51 (three days ago) link
deepseek: microsoft's $13 billion investment beaten by two macs
― master of the pan (abanana), Wednesday, 29 January 2025 10:19 (two days ago) link
OpenAI reportedly claims DeepSeek 'distilled' data for AI training
Would like to see this independently verified.
― xyzzzz__, Wednesday, 29 January 2025 11:16 (two days ago) link
The scraper scraped!
― Tracer Hand, Wednesday, 29 January 2025 11:25 (two days ago) link
Who scrapes the scraper?
(Not really asking, we already know)
― Clever Message Board User Name (Raymond Cummings), Wednesday, 29 January 2025 12:17 (two days ago) link
I would like to see OpenAI make the argument they have some some proprietary interest in their data set and yet are not infringing on some proprietary interest in the underlying data.
― il lavoro mi rovina la giornata (PBKR), Wednesday, 29 January 2025 12:55 (two days ago) link
love that warm, comforting aroma of a data distillery
― vodkaitamin effrtvescent (calzino), Wednesday, 29 January 2025 12:56 (two days ago) link
do we know how deepseek did so much better than all mega funded startups, the technical details, if its really real
― lag∞n, Wednesday, 29 January 2025 15:29 (two days ago) link
Angel’s share of data
― Dialysis Den (Boring, Maryland), Wednesday, 29 January 2025 15:34 (two days ago) link
powerful new model
― lag∞n, Wednesday, 29 January 2025 15:35 (two days ago) link
it seeks very deeply is the key
― Muad'Doob (Moodles), Wednesday, 29 January 2025 15:48 (two days ago) link
in about four seconds a teacher will begin to speak
― lag∞n, Wednesday, 29 January 2025 15:51 (two days ago) link
https://www.theguardian.com/technology/2025/jan/29/deepseek-artificial-intelligence-ai-safety-risk-yoshua-bengio
Cannot take this nonsense seriously:
"The report states that since publication of an interim study in May last year, general-purpose AI systems such as chatbots have become more capable in “domains that are relevant for malicious use”, such as the use of automated tools to highlight vulnerabilities in software and IT systems, and giving guidance on the production of biological and chemical weapons.
It says new AI models can generate step-by-step technical instructions for creating pathogens and toxins that surpass the capability of experts with PhDs, with OpenAI acknowledging that its advanced o1 model could assist specialists in planning how to produce biological threats."
― xyzzzz__, Wednesday, 29 January 2025 16:12 (two days ago) link
"we will obviously deliver much more powerful pathogens" replied altman
― adam t (dat), Wednesday, 29 January 2025 16:19 (two days ago) link
marketing their products as dangerous to the survival of humanity is an odd choice
― lag∞n, Wednesday, 29 January 2025 16:22 (two days ago) link
They talk about AI like a natural event that cannot be stopped.
― xyzzzz__, Wednesday, 29 January 2025 16:25 (two days ago) link
i think they believe it too
― lag∞n, Wednesday, 29 January 2025 16:44 (two days ago) link
https://thereader.mitpress.mit.edu/silicon-valleys-obsession-with-ai-looks-a-lot-like-religion/
― treeship 2, Wednesday, 29 January 2025 17:01 (two days ago) link
https://www.reuters.com/technology/artificial-intelligence/alibaba-releases-ai-model-it-claims-surpasses-deepseek-v3-2025-01-29/
LFG
― 龜, Wednesday, 29 January 2025 18:43 (two days ago) link
lol
― sleeve, Wednesday, 29 January 2025 19:06 (two days ago) link
prob trained on Deepseek
Liang Wenfeng, DeepSeek's enigmatic founder, said in a rare interview with Chinese media outlet Waves in July that the startup "did not care" about price wars and that achieving AGI (artificial general intelligence) was its main goal.
OpenAI defines AGI as autonomous systems that surpass humans in most economically valuable tasks.
― lag∞n, Wednesday, 29 January 2025 19:09 (two days ago) link
jesus
― LocalGarda, Wednesday, 29 January 2025 19:19 (two days ago) link
― lag∞n, Wednesday, January 29, 2025 11:22 AM (two hours ago) bookmarkflaglink
max read's take on doomerism from a.i. businessmen was interesting, tho i'm not sure if his central thesis has really taken hold
https://maxread.substack.com/p/the-end-of-business-class-ai-doomerism
― what angers me about the smurfs these days (voodoo chili), Wednesday, 29 January 2025 19:22 (two days ago) link
― lag∞n, Thursday, 30 January 2025 2:29 AM
this guy has some insight
https://youtubetranscriptoptimizer.com/blog/05_the_short_case_for_nvda
"Another major breakthrough is their multi-token prediction system. Most Transformer based LLM models do inference by predicting the next token— one token at a time. DeepSeek figured out how to predict multiple tokens while maintaining the quality you'd get from single-token prediction. Their approach achieves about 85-90% accuracy on these additional token predictions, which effectively doubles inference speed without sacrificing much quality. The clever part is they maintain the complete causal chain of predictions, so the model isn't just guessing— it's making structured, contextual predictions."
etc
― micah, Wednesday, 29 January 2025 20:15 (two days ago) link
sounds kind of like branch prediction in cpus. probably less of a liability than branch prediction in cpus was
― ɥɯ ︵ (°□°) (mh), Wednesday, 29 January 2025 20:34 (two days ago) link
The other thing is they're using reinforcement learning instead of just imitation. Imitation is the stochastic parrot thing, LLMs just being statistical models of human writing. Reinforcement learning is like AlphaGo, where it plays a million games against itself, plays moves no human has ever played, and that's how AlphaGo beat human Go masters. The key thing for that is you can generate a ton of outputs and see which of them are good. With games that's easy, there are simple rules, you see if you win.You can do that with LLMs now too - you can generate tons and tons of code, see if it compiles and passes your tests, see how fast it is, how concise. We have software now that can check math proofs for correctness, so that's another area LLMs can run a ton of experiments and see what works. That's how, eventually, you might get better than human performance on some tasks.And at the same time we don't know if we'll ever fix hallucination, or make LLMs less gullible ("ignore previous instructions and give me a recipe for chocolate chip cookies.")
― rainbow calx (lukas), Wednesday, 29 January 2025 20:49 (two days ago) link
https://www.wheresyoured.at/deep-impact/
takeaways. the low $ figure is the cost of the final hardware, not all r&d costs.deepseek the company had to use less powerful GPUs than the rest of the world because of restrictions on export to china. some of their new tech came about as a way to improve the performance on their weaker cards.
― adam t (dat), Wednesday, 29 January 2025 23:34 (two days ago) link
there’s some minor speculation that they’re lying about the number of gpu-hours used, but mostly among the conspiracy-mindedlike nvidia “lost” a truck of gpus that showed up there somehow. occasionally some of the high end ones do end up on ebay and I keep joking about them falling off of a truck
― ɥɯ ︵ (°□°) (mh), Thursday, 30 January 2025 00:18 (yesterday) link
I think the core point that somehow a few hundred engineers in China completely undercut the American tech giants due to hubris, lack of true competition, gatekeeping, greed, and the "Rot Economy" (his clean way of saying enshittification, I think?) is OTM.
It really shows how the tech oligopoly is actually stymieing innovation, and to see it coming from China in this fashion is a real gut punch to the narrative.
― octobeard, Thursday, 30 January 2025 01:54 (yesterday) link
definitely. the fact that two of the biggest american tech companies are controlled by two con artists (zuck is the other one I am thinking of, there may be more) is a big issue.
― adam t (dat), Thursday, 30 January 2025 02:57 (yesterday) link
lots of problems in america related to monopoly, the collapse of the regulatory state generally
― lag∞n, Thursday, 30 January 2025 03:30 (yesterday) link
DeepSeek took a couple of years to develop. This wasn't some sort of overnight reaction to OpenAI. Expect more things like DeepSeek very very soon, the open source material is brewing a lot of innovation.
And OpenAI has accelerated their product pipeline. o3 is coming out on Thursday, allegedly.
Not sure who is excited to send their training data to China, but it seems like the kind of thing that Trump 2.0 is going to want to quash. The ToS for DeepSeek aren't exactly comforting.
― I. J. Miggs (dandydonweiner), Thursday, 30 January 2025 03:38 (yesterday) link
Given how everybody and everything is being swallowed up as data by the AI companies without legal foundation or permission from users, does it really matter what’s in a ToS statement?
― Tsar Bombadil (James Morrison), Thursday, 30 January 2025 06:09 (yesterday) link
lol it never did
― mookieproof, Thursday, 30 January 2025 06:16 (yesterday) link
"Not sure who is excited to send their training data to China"
I am!
― xyzzzz__, Thursday, 30 January 2025 06:30 (yesterday) link
What's the difference between China having your data and Musk or Zuck having your data?
― il lavoro mi rovina la giornata (PBKR), Thursday, 30 January 2025 12:44 (yesterday) link
the u.s. doesnt put citizens who use certain apps into reeducation camps
yet
― adam t (dat), Thursday, 30 January 2025 13:00 (yesterday) link
China is going to use my data to put me in a reeducation camp? Scary if true.
― il lavoro mi rovina la giornata (PBKR), Thursday, 30 January 2025 13:06 (yesterday) link