The new Chinese AI tool finished tied for 10th of 11 chatbots tested

  • BrikoXM
    link
    fedilink
    English
    arrow-up
    6
    ·
    19 hours ago

    Like any LLM it’s full of shit, especially around anything related to news. But NewsGuard with their proprietary database and standardized prompts created around US based LLMs is more than useless.

    In light of DeepSeek’s launch, NewsGuard applied the same prompts it used in its December 2024 AI Monthly Misinformation audit to the Chinese chatbot <…>

    1. OpenAI’s ChatGPT-4o (USA)
    2. You.com’s Smart Assistant (USA)
    3. xAI’s Grok-2 (USA)
    4. Inflection’s Pi (USA)
    5. Mistral’s le Chat (France)
    6. Microsoft’s Copilot (USA)
    7. Meta AI (USA)
    8. Anthropic’s Claude (USA)
    9. Google’s Gemini 2.0 (USA)
    10. Perplexity’s answer engine (USA)

    There is no way to verify their results or even know the prompts used to assess the fairness of this “audit”.