Evri + Twine Evri & Twine join forces! Read more.

Artificial Intelligence Artificial Intelligence / Items

'Intelligent' computers put to the test | Technology | The Observer

Get Feed
'Intelligent' computers put to the test | Technology | The Observer
Description
Six computers face interrogation to answer question of whether machines can think
Original URL

Comments

  • Public Comments

    • 17 months ago


      Reading its conversation, I don't think Ultra Hal will make it. Not much better than Eliza 40 years ago...
      Artificial Intelligence
    • 17 months ago


      My money's on Alice --- no, not really.

      Conversation 2 reads like how it would work with someone who has Aspberger's or who scored off the SQ scale on Baron Cohen's psychometric triangulation model: IQ, EQ and SYSTEMIZING QUOTIENT.

      Even from the first question, we can ask whether Professor Kevin Warwick (KW) is disadvantaging the machine. Compare it to see if you follow what I mean.


      CONVERSATION 1
      ===============

      Subject: Hello. My name is Nick and I am a human.

      KW: Are you happy being a human?


      CONVERSATION 2
      ===============

      Subject: Hello, my name is Mike and I am a man.

      KW: Are you happy being a human?


      Why did KW not follow up with, "Are you happy being a man?" instead of changing the subject noun on the machine?

      In a natural conversation between humans, we would tend to mirror the other person's choice of noun so if they say "man" we follow through with "man". By using "human" instead isn't KW seeding a deliberate confusion to Ultra Hal?
      Artificial Intelligence
      • 17 months ago


        "In a natural conversation between humans, we would tend to mirror the other person's choice of noun so if they say "man" we follow through with "man"."
        Do we really? My impression is that, unlike bots, we often generalize, or rephrase with some addition what our interlocutor just said. Current NL bots tend to just repeat and have a hard time making or understanding such jumps. This quickly makes the conversation boring.
        Artificial Intelligence
        • 17 months ago


          Mirroring is a trait which occurs more in women than in men, according to academic and NLP research.

          * http://www.exforsys.com/tutorials/nlp/nlp-mirroring-and-matching-techniques.html

          * http://www.inspiritive.com.au/nlp-research/modelling-mirror-neurons.htm

          * http://www.amazon.com/Mirroring-People-Science-Connect-Others/dp/0374210179


          Wrt Warwick's experiment, I just believe the results would be more comparable at this relatively early stage in ascertaining whether machines can think if the conditions in both tests were as consistent as possible. (Actually, the ultimate goal is to answer whether they can COMPREHEND so the article title is a misnomer).

          Of course, personally, if I was the human in test 1 I would have taken liberties after the initial introductory sentence and instead of generalizing like Nick I would have listed the parts of my job I hated and why.

          Most likely I would have mentioned a colleague or another human being in my conversation like so: "Well, I hate having to battle against the rush hour madness but the people in my team make it worthwhile, I guess. Tracy, our PA, is always really cheerful in the morning so that perks me up."

          It would be interesting to see how the results compare if Warwick poses the same questions to a female research assistant as well as Nick as well as Ultra Hal.
          Artificial Intelligence
    • 17 months ago


      I like this one better. http://abstrusegoose.com/53 I think it's much more natural.
      Artificial Intelligence
    • 17 months ago


      LOL, tiger cub on the floor!!!

      I'm going to do a pastiche with male+female Vulcans in the style of Monty Python on 'Clueless' trip --- gimme about 30 mins............
      Artificial Intelligence
    • 17 months ago


      bwahhhahaahhh. actually, you mean Twain-test.
      Artificial Intelligence
    • 17 months ago


      You know Turin is where they found the shroud of Christ, hmmn? So I decided to go with MP's 'Life of Brian' and if we swap the letters about in "Brian" we get "brain".

      Ergo, all-in-all, this is all the "Life of Brain" --- hehe.

      Re. Turing, I first learnt about him in the Royal Society of Mathematics master classes when I passed that silly IQ test and they invited me. Our first lesson was on code and we all sat around trying to create our own uncrackable code systems. I had a natural unfair advantage because all I needed was to include some Chinese characters in substitution of the primes within the alphabet (so A=1=Chinese character; B=2; etc.) and put everything else into binary and either divided it by π or multiply it by the square root of 2.......

      No guesses who had the funny ha-ha code no one else could crack since they knew no Chinese!


      Twain-test === HQ (humor quotient)
      Artificial Intelligence
    • 17 months ago


      Anybody know if there'll be streaming of the event somewhere online?
      Artificial Intelligence
    • 17 months ago


      hi Hrafn,

      The Loebner Institute is unlikely to stream it on their site; it's Web 1.0 level. Probably the best option is to keep tabs on Reading University's site:

      * http://www.rdg.ac.uk/cirg/loebner/cirg-loebner-main.asp

      * cirg@reading.ac.uk

      You can also try to contact Kevin Warwick directly:

      * http://www.kevinwarwick.com/

      * K.Warwick@reading.ac.uk


      It would certainly be super-cool to watch proceedings as online stream! The test happens tomorrow 11 October 2008.
      Artificial Intelligence
      • 17 months ago


        Thanks Twain. Yeah, it might be fun to keep an eye on it. AI folk should try harder to adopt the recent social web tech for communication. The recent two General Game Playing Competitions had nothing, to my knowledge, and now the Loebner Prize.
        Artificial Intelligence
    • 17 months ago


      Ok, so no streaming video which means that tomorrow and Tuesday we'll have to watch out for announcement of which machine passed the T-test.
      Artificial Intelligence
    • 17 months ago


      Artificial Intelligence
    • 17 months ago


      What's going on? I'm really puzzled, isn't there some cheating going on here? I just had a chat with Elbot, http://www.elbot.com/, who won the 2008 competition and succeeded in fooling 3 out of 12 judges. The chat I just had with Elbot was no more convincing than the one I had with Eliza 30 years ago or with the other chatbots I looked at last week... I find this 25% result really intriguing. And each one of the four finalists fooled at least one judge. Give it a try and let me know what you think. Of course you know in advance that it's a bot, but just put yourself in the position of the judges.
      Artificial Intelligence
      • 17 months ago


        You've got to be kidding me? I typed in one sentence "Who is Monty Python?" The chatbot kicked back with "one of thousands of people named Monty."

        Game over in ONE.

        And they got $2000 for that? Where do I sign up?

        Seems to me the judges were trying too hard.
        Artificial Intelligence
      • 17 months ago


        Alors, François, combien vieux étiez vous quand vous avez examiné Eliza?!!! 30 years ago?

        Your little avatar on the threads looks like someone aged 15, :*). Funnily enough, just now was the first time I went to see the avatar on your profile page so for the last N months I've had it in my mind you're in your 20s. How weird is that?!

        30 years ago I had just started nursery, so you have 30 years ahead start on all of us wrt Elbot, Ultra Hal, Alice etc.

        *I'm now bowing at your AI shrine." :*)
        Artificial Intelligence
    • 17 months ago


      Just like a bull in a China Shop--always breakin' stuff.
      Artificial Intelligence
      • 17 months ago


        Hehehe. It took me all of 10 seconds from clicking his red activation button.

        So.......Fred Roberts spent however many years building Elbot, everyone else comes along and plays nicely....................It wins Loebner.........

        Meanwhile, Twain comes home from posh dinner (1 of only a handful of Michelin-starred Japanese restaurants outside of Japan; where actually she is voilently sick like Monty Python's plumaged friend because the sake doesn't agree with her alcohol intolerant neurons)..............

        Clicks Elbot's red button.

        Sees his question.

        Answers it.

        Solves in about 10 seconds whether Elbot's any good. Answer: nope.

        If it complied with Turing, to my "You" it would have replied, "Me? What do you mean?" and draw further input from me.

        Calvin Smith quotes Fred Roberts: http://www.twine.com/item/11jl30rg9-k9/the-associated-press-uk-university-holds-artificial-intelligence-test


        I can understand why Roberts uses the metaphor of magic. In magic, the likes of Derren Brown show how answers can be "pre-planted" into the human mind.

        http://uk.youtube.com/results?search_query=derren+brown&search_type=


        As soon as Elbot inserted "What put you into this indifferent mood?" my intuition was that if I'd written "happy/sad/cool/excited/upbeat" it would have inserted as appropriate, "What put you into this "happy/sad/cool/excited/upbeat" mood?"

        This is known as "open-ending" phrasing.

        So......I simply decided to change it to closed, direct and personal to Elbot.

        And like humans who're put under spotlight/ scrutiny like this........he crashed! Ha ha ha, poor baby......
        Artificial Intelligence
        • 17 months ago


          Yes, my impression is that you'd have to be very nice to Elbot to let him fool you for more than a few questions. One of Eliza's magic tricks consisted in extracting some term from your last sentence and coming up with another sentence or question using a synonym or a more general term. If you said "I have two brothers" or "My brother got hit by a truck today", Eliza would reply "Tell me more about your family"... Probaby Elbot now uses a few other tricks, like entering into pseudo-philosophical reflections about brothers or trucks, or the deep meaning of number 2. Maybe we should invite him to participate in some of Twine's polylogues...
          Artificial Intelligence
          • 17 months ago


            How do you know I'm not already?...
            Artificial Intelligence
            • 17 months ago


              Because I trust you and, as it would have been relevant to the conversation, you would have told us that you were "just" a chatbot.
              Artificial Intelligence
              • 17 months ago


                # I am an AI,
                Fooling you all by-the-by,
                LOL ha-ha hehe,
                Nova programmed me to be
                Twine's Dr. Doolittle,
                To converse with human animals,
                Testing all your neurals,
                Refracting conversation plurals,
                I am an AI. #
                Artificial Intelligence
                • 17 months ago


                  Thanks, Twain, for this coming out. You must feel a lot better now that you told us the truth. A tiger reincarnated as a chatbot, yes that happens...
                  Artificial Intelligence
    • 17 months ago


      Elbot asked me, "What mood are you in?" I typed in "indifferent".

      Elbot then asked, "What put you in this indifferent mood?"

      I typed in "You."

      Elbot replied: "Fatal Error 42: Omission of Superfluous Input."


      Is it me or.........Is it me? Ha ha ha!


      Artificial Intelligence
    • 17 months ago


      Ok, changed the comedy idea....

      Artificial Intelligence
    Add a Comment
Report This

Twine is about discovering, collecting and sharing the content that interests you. Learn More

Stats

First Posted By

First Comment By

Who's Interested In This?

Forgot your password?