KoreaTechToday - Korea's Leading Tech and Startup Media Platform
  • Topics
    • Naver
    • Kakao
    • Nexon
    • Netmarble
    • NCsoft
    • Samsung
    • Hyundai
    • SKT
    • LG
    • KT
    • Retail
    • Startup
    • Blockchain
    • government
  • Lists
KoreaTechToday - Korea's Leading Tech and Startup Media Platform
  • Topics
    • Naver
    • Kakao
    • Nexon
    • Netmarble
    • NCsoft
    • Samsung
    • Hyundai
    • SKT
    • LG
    • KT
    • Retail
    • Startup
    • Blockchain
    • government
  • Lists
KoreaTechToday - Korea's Leading Tech and Startup Media Platform
No Result
View All Result
Home AI

Naver’s HyperCLOVA X Claims to Outperform OpenAI and Google

Kyung Mi by Kyung Mi
PUBLISHED: February 28, 2024 UPDATED: February 28, 2024
in AI, SK
0
Naver’s HyperCLOVA X Claims to Outperform OpenAI and Google

On Tuesday, Naver Cloud revealed that its HyperCLOVA X has surpassed both OpenAI and Google’s generative AI models in the Korean AI performance evaluation system, KMMLU.

Naver is aiming for dominance in performance competitiveness within the Korean AI landscape to be a leader in sovereign AI technologies tailored to uphold national data sovereignty and adhere to local regulations.

KMMLU, established by the prominent open-source language model research team HAE-RAE in Korea, serves as a crucial performance evaluation metric for AI technologies.

Comprising 35,030 questions across 45 diverse domains, including humanities, social sciences, and science & technology, the KMMLU evaluation sets a high standard for assessing expert-level knowledge.

Roughly 80% of the questions in KMMLU gauge broad knowledge applicable globally, including skills like mathematical reasoning. The remaining 20% focus on testing the AI’s proficiency in solving Korea-specific issues, such as understanding the geography of the Korean Peninsula and knowledge of domestic laws.

By presenting questions in Korean, KMMLU ensures a more accurate assessment of an AI’s understanding of the language, enabling a comprehensive evaluation of universal capabilities and local knowledge crucial for effectively serving Korean users. 

This approach contrasts with the challenges faced by North American tech giants like OpenAI and Google when adapting benchmarks like ‘MMLU’ to Korean, as translation inaccuracies and cultural nuances inherent in questions originally designed for English contexts often lead to imprecise assessments of AI proficiency in Korean.

Based on findings from the KMMLU research paper, HyperCLOVA X demonstrated superior performance compared to OpenAI’s GPT-3.5-Turbo and Google’s Gemini-Pro, with competitive scores across both general and Korea-specific knowledge assessments. 

While it didn’t surpass OpenAI’s GPT-4 overall, HyperCLOVA X excelled in Korea-specific knowledge, making it a strong contender in sectors reliant on localized insights, such as education and legal services.

Leveraging the success validated by KMMLU, Naver Cloud will advance HyperCLOVA X into a Sovereign AI solution characterized by robust security measures and exceptional performance. 

Taking advantage of HyperCLOVA X’s impressive performance, as demonstrated in the KMMLU assessments, Naver Cloud plans to further develop it into a sovereign AI solution renowned for its top-notch security and efficiency. 

Last October, Naver Cloud introduced Neurocloud for HyperCLOVA X, a hybrid cloud service tailored to facilitate its usage within secure, private networks, thereby reducing the risks associated with data breaches. The company aims to unveil additional enterprise solutions to cater to evolving industry needs.

Sung Nako, head of the Hyperscale AI division overseeing HyperCLOVA X, highlighted, “HyperCLOVA X, positioned as a sovereign AI, seamlessly integrates global knowledge with the capacity to tackle Korea-specific challenges.” 


Also Read:

  • Samsung Joins Global AI-RAN Alliance to Spearhead 6G Technology
  • LG Electronics Partners with Josun Hotels & Resorts to Develop Specialized Hospitality Robots
  • Mark Zuckerberg’s South Korea Trip: Meetings with Samsung and President 
  • Naver’s Webtoon Entertainment Eyes June US IPO with Goldman Sachs, Morgan Stanley
  • South Korean Telcos Set to Unveil AI Breakthroughs at MWC 2024
Tags: AI HyperclovaXArtificial Intelligencegenerative aiSK

Related Posts

Inside Stargate: How Samsung and SK Are Powering OpenAI’s Global AI Ambitions
AI

Inside Stargate: How Samsung and SK Are Powering OpenAI’s Global AI Ambitions

October 7, 2025
Hyundai Mobis Assembles Domestic Powerhouse to Build Auto Chips
AI

Hyundai Mobis Assembles Domestic Powerhouse to Build Auto Chips

September 30, 2025
SK Telecom Commits $3.6B to AI with New Company-in-Company Unit
AI

SK Telecom Commits $3.6B to AI with New Company-in-Company Unit

September 29, 2025
Samsung Launches TRUEBench: A Benchmark for Real-World AI Productivity
AI

Samsung Launches TRUEBench: A Benchmark for Real-World AI Productivity

September 29, 2025
Hyundai and Kia Deploy Wearable Robots to Transform Farming in Korea
AI

Hyundai and Kia Deploy Wearable Robots to Transform Farming in Korea

September 29, 2025
Hanwha Life, Naver Financial Partner to Accelerate Digital Finance Innovation
AI

Hanwha Life, Naver Financial Partner to Accelerate Digital Finance Innovation

September 29, 2025
No Result
View All Result

Most Popular

  • Ride-Hailing Rivalry: Kakao and Uber Bet on Membership Services in Korea

    0 shares
    Share 0 Tweet 0
  • Korea’s Navigation Battle Heats Up: Naver and Kakao vs. Google maps

    0 shares
    Share 0 Tweet 0
  • Kakao Mobility Faces $10.5 Million Fine for Limiting Competitors’ Access to Taxi Platform

    0 shares
    Share 0 Tweet 0
  • 5 Best Korean to English Translation Apps

    0 shares
    Share 0 Tweet 0
  • Naver Launches 3D Street View for Immersive Navigation Experience

    0 shares
    Share 0 Tweet 0
  • KakaoTalk to Adopt Instagram-Style Feed in Major 2025 Redesign

    0 shares
    Share 0 Tweet 0
  • Naver Maps Launches Guide in English, Chinese, and Japanese to Enhance Travel Experience for Tourists

    0 shares
    Share 0 Tweet 0
  • Top Nine Mobile MMORPG in South Korea for 2020

    0 shares
    Share 0 Tweet 0
  • Naver Unveils Asia’s Largest Data Center, GAK Sejong, for Tech Innovation

    0 shares
    Share 0 Tweet 0
  • LG’s Return to Smartphones: A New AI Collaboration with Samsung

    0 shares
    Share 0 Tweet 0

PRODUCTS

[ads_amazon]

TOPICS

  • Naver
  • Kakao
  • Nexon
  • Netmarble
  • NCsoft
  • Samsung
  • Hyundai

FREE NEWSLETTER

FOLLOW US

  • About Us
  • Cookie policy
  • home
  • homepage
  • mainhome
  • Our Services
  • Privacy Policy
  • Terms of Use

Copyright © 2024 KoreaTechToday | About Us | Terms of Use |Privacy Policy |Cookie Policy| Contact : [email protected] |

No Result
View All Result
  • Topics
    • Naver
    • Kakao
    • Nexon
    • Netmarble
    • NCsoft
    • Samsung
    • Hyundai
    • SKT
    • LG
    • KT
    • Retail
    • Startup
    • Blockchain
    • government
  • Lists

Copyright © 2024 KoreaTechToday | About Us | Terms of Use |Privacy Policy |Cookie Policy| Contact : [email protected] |