ãšã³ã¿ãŒãã©ã€ãºAIåããªãŒãã³ãœãŒã¹LLMããã5
ãªãŒãã³ãœãŒã¹ã®å€§èŠæš¡èšèªã¢ãã«(LLM)ã¯ã次ã®ãããªåœ¹å²ãæ ã£ãŠããã 2024幎ã®äŒæ¥åã匷åããŒã«.圌ãã¯ä»¥äžãæäŸãããæªæŸæã®ãã£ã³ã¹ AIã«ããèªç¶èšèªåŠçã®å¯èœæ§ã掻çšããããšã§ãäŒæ¥ã¯æ¥åã匷åãã顧客äœéšãåäžãããç«¶äºåãåŸãããšãã§ããŸãã
ãªãŒãã³ãœãŒã¹ã®LLMã䜿çšããäž»ãªå©ç¹ã®1ã€ã¯ãæè»æ§ãšã«ã¹ã¿ãã€ãºæ§ã§ãããããã©ã€ãšã¿ãªãªã¢ãã«ãšã¯ç°ãªãããªãŒãã³ãœãŒã¹ã® LLM ã§ã¯ãäŒæ¥ãç¹å®ã®æ¥çããã¡ã€ã³ããŸãã¯ã¢ããªã±ãŒã·ã§ã³ã®èŠä»¶ã«åãããŠã¢ãã«ã埮調æŽããé©å¿ãããããšãã§ããŸãããã®ã¬ãã«ã®ã«ã¹ã¿ãã€ãºã«ãããèšèªã¢ãã«ãåäŒæ¥åºæã®ããŒãºãç®çã«å®å šã«åèŽããããæ£ç¢ºã§é©åãªã¢ãŠãããããåŸãããããã«ãªããŸãã
ããã«ããªãŒãã³ãœãŒã¹ã®LLMã¯ããããã©ã€ãšã¿ãªãªã¢ãã«ã®éçºãšä¿å®ã«ä»£ããã³ã¹ãå¹çã®é«ãéžæè¢ãæäŸããŸããAIã³ãã¥ããã£ã®ç·åãçµéããããšã§ãäŒæ¥ã¯ç ç©¶éçºã«å€é¡ã®æè³ãããããšãªããæå 端ã®èšèªã¢ãã«ãå©çšããããšãã§ããŸãããã®ãããªAIæè¡ã®æ°äž»åã«ãããããããèŠæš¡ã®äŒæ¥ãå€§èŠæš¡ãªèšèªã¢ãã«ã®ãã¯ãŒã®æ©æµãåããããšãã§ããç«¶äºãæ¿åããåžå Žã§ã®ç«¶äºã®å俵ãå¹³ãã«ããããšãã§ããŸãã
2024幎ã®äŒæ¥åããªãŒãã³ãœãŒã¹LLMããã5ãæ¢ããªããããã®ãŠããŒã¯ãªç¹åŸŽãèœåãæœåšçãªã¢ããªã±ãŒã·ã§ã³ãæãäžããŠãããLlama 3ãClaude 3ãGrok AIãBERTãMistral Largeãå«ããããã®ã¢ãã«ã¯ãåè¶ããæ§èœãæ±çšæ§ãäŒæ¥ã³ãã¥ããã£å ã§ã®æ¡çšã«åºã¥ããŠéžæãããŠããŸããåã¢ãã«ã®é·æãšãŠãŒã¹ã±ãŒã¹ãçè§£ããããšã§ãäŒæ¥ã¯ç¹å®ã®èŠä»¶ã«æãé©ãããªãŒãã³ãœãŒã¹LLMãéžæããéã«ãæ å ±ã«åºã¥ããæææ±ºå®ãè¡ãããšãã§ããŸãã
1. ã©ã 3 by Meta
Meta AIãéçºããLlama 3ã¯ãæå 端ã®ãªãŒãã³ãœãŒã¹å€§èŠæš¡èšèªã¢ãã«ã§ãäŒæ¥ã³ãã¥ããã£ã§å€§ããªæ³šç®ãéããŠããŸããLlama 3ã¯ãLLMã®Llamaãã¡ããªãŒã®ææ°çãšããŠã2024幎ã®ããžãã¹ã«ãããæéèŠéžæè¢ãšãªããããªæ°æ©èœãæ¹è¯ãå°å ¥ããªãããåäœã®æåã«åºã¥ããŠæ§ç¯ãããŠããŸãã
Llama 3ã®éç«ã£ãç¹åŸŽã®ã²ãšã€ã¯ã2ã€ã®ãµã€ãºãçšæãããŠããããšã ïŒãã©ã¡ãŒã¿ã¯80ååãš700ååã§ãããã®æè»æ§ã«ãããäŒæ¥ã¯èªç€Ÿã®èšç®ãªãœãŒã¹ãšæ§èœèŠä»¶ã«æãé©ããã¢ãã«ãéžæããããšãã§ããŸããããã«ãåãµã€ãºã«ã¯ããŒã¹ã»ã¢ãã«ãšã€ã³ã¹ãã©ã¯ ãã»ã¢ãã«ã®2ã€ã®ããªãšãŒã·ã§ã³ããããŸããããŒã¹ã»ã¢ãã«ã¯èšå€§ãªããŒã¿ã»ããã§äºåã«ãã¬ãŒãã³ã°ãããŠãããããäžè¬çãªNLPã¿ã¹ã¯ã«é©ããŠããŸããäžæ¹ãã€ã³ã¹ãã©ã¯ãã»ã¢ãã«ã¯å¯Ÿè©±ãšãã£ããã»ã¢ããªã±ãŒã·ã§ã³å°çšã«åŸ®èª¿æŽãããŠãããããé åçã§æçãªå¯Ÿè©±ãå®çŸããŸãã
Llama 3ã¯ãããã¹ãçæã質åå¿çãèŠçŽãªã©ãããŸããŸãªNLPã¿ã¹ã¯ã«ããã£ãŠåªããããã©ãŒãã³ã¹ãçºæ®ãããããããŸããŸãªãšã³ã¿ãŒãã©ã€ãºã»ã¢ããªã±ãŒã·ã§ã³ã«å¯Ÿå¿ããæ±çšæ§ã®é«ãããŒã«ã§ãããã®åŒ·åãªæ§èœãšç¹åããæ©èœã«ãããäŒæ¥ã¯è€éãªèšèªåŠçã®èª²é¡ã«ç°¡åã«åãçµãããšãã§ããæ¥åã®å¹çãšç²ŸåºŠãåäžããŸãã
Llama 3ã®å±éã®æè»æ§ã¯ãäŒæ¥ã«ãšã£ãŠããã²ãšã€ã®å€§ããªå©ç¹ã ãéååæè¡ã®é²æ©ã«ããããã®ã¢ãã«ã¯éåžžã®æ¶è²»è åãããŒããŠã§ã¢ã§å±éããããšãã§ãããããæè¡ã€ã³ãã©ã«é¢ä¿ãªããå¹ åºãäŒæ¥ãã¢ã¯ã»ã¹ã§ããããã«ãªã£ãããã®å°å ¥ã®å®¹æããšMeta AIã®è²¬ä»»ãã䜿çšã«é¢ããã¬ã€ãã³ã¹ãçµã¿åãããããšã§ãäŒæ¥ã¯AIéçºã«ãããå«çåºæºãšãã¹ããã©ã¯ãã£ã¹ãéµå®ããªãããLlama 3ã®æœåšèœåã广çã«æŽ»çšããããšãã§ããã
2. ã¯ããŒã 3 by Anthropic
ã¯ããŒã3ã¯ããµã³ãã©ã³ã·ã¹ã³ã«æ ç¹ãçœ®ãæ°èäŒæ¥ãéçºãããªãŒãã³ãœãŒã¹ã®å€§èŠæš¡èšèªã¢ãã«ã§ããã ã¢ã³ãœãããã¯ã¯ããã®é«åºŠãªæ©èœãšå€æ§ãªã¢ããªã±ãŒã·ã§ã³ã«ãããAIã³ãã¥ããã£ã§æ¥éã«æ¯æãéããŠããŸãããã®æå 端ã¢ãã«ã¯ãå¹ åºãèªç¶èšèªåŠçã¿ã¹ã¯ãæ¥çç¹æã®èª²é¡ã«åãçµãããã®åŒ·åãªããŒã«ãäŒæ¥ã«æäŸããŸãã
ã¯ããŒã3ã®éç«ã£ãç¹åŸŽã®ã²ãšã€ã¯ã3ã€ã®ç°ãªãããªãšãŒã·ã§ã³ãçšæãããŠããããšã ïŒHaikuãSonnetãOpusã§ããåããªã¢ã³ãã¯ç¹å®ã®ãŠãŒã¹ã±ãŒã¹ãšããã©ãŒãã³ã¹èŠä»¶ã«æé©åãããŠãããäŒæ¥ã¯ããŒãºã«åãããŠæé©ãªã¢ãã«ãæè»ã«éžæã§ãããæãè²»çšå¯Ÿå¹æã®é«ãHaikuã¯ãã«ã¹ã¿ããŒãµããŒãã®ãã£ããããããªã©ã®ã¿ã¹ã¯ã«æé©ã§ãã»ãŒç¬æã®å¿çæéãæäŸããŸãããããã¬ã³ãžã®Sonnetã¯ãã¿ãŒã²ããã»ããŒã±ãã£ã³ã°ãããŒã¿åŠçãã¿ã¹ã¯èªååãã³ãŒãã£ã³ã°ãªã©ã®çšéã«é©ããŠããŸããæããªãœãŒã¹ãå¿ èŠãšããOpusã¯ã財åã¢ããªã³ã°ãåµè¬ãç ç©¶éçºãæŠç¥åæãªã©ã®è€éãªã¿ã¹ã¯ã«å¯Ÿå¿ããŸãã
ã¯ããŒã3ã¯ãæšè«ãå°éç¥èãæ°åŠãæµæ¢ãªèšèªèœåãªã©ãæ§ã ãªèªç¥ã¿ã¹ã¯ã«ãããŠçŽ æŽãããããã©ãŒãã³ã¹ãçºæ®ããç«¶åã¢ãã«ãšã¯äžç·ãç»ããŠããŸããç¹ã«Opusããªã¢ã³ãã¯ãè€éãªã¿ã¹ã¯ã«ãããŠäººéã«è¿ãã¬ãã«ã®çè§£åãšæµæ¢ããå®èšŒããŠãããMMLUãGSM8KãHumanEvalãHellaSwagãªã©ã®ãã³ãããŒã¯ã§GPT-4ã®ãããªæåã¢ãã«ãäžåã£ãŠããŸãããã®åªããæ§èœã«ãããClaude 3ã¯ãæãèŠæ±ã®å³ããã¢ããªã±ãŒã·ã§ã³ã«ãªãŒãã³ãœãŒã¹LLMã®ãã¯ãŒã掻çšããããšããäŒæ¥ã«ãšã£ãŠé åçãªéžæè¢ãšãªã£ãŠããŸãã
3. ã°ããã¯
ã€ãŒãã³ã»ãã¹ã¯ã®xAIã«ãã£ãŠéçºãããGrokã¯ã驿°çãªãªãŒãã³ãœãŒã¹ã®LLMã§ããããã®é«åºŠãªNLPã¢ã«ãŽãªãºã ã«ãã£ãŠããã¹ãã®èŠçŽãšçè§£ã«é©åœããããããã
Grok AIã®äž»ãªåŒ·ã¿ã®1ã€ã¯ãããã¹ãå ã®æèãæå³ãé¢ä¿ãçè§£ããèœåã§ããããã®çµæãæ£ç¢ºã§éŠå°Ÿäžè²«ããèŠçŽãåŸãããŸããGrok AIã¯ãæå 端ã®ãã£ãŒãã©ãŒãã³ã°ã¢ãã«ãåºç€ãšããããšã§ãé·ãææžãã¬ããŒããèšäºããæãé¢é£æ§ã®é«ãæ å ±ãæœåºããäŒæ¥ã®è²ŽéãªæéãšãªãœãŒã¹ãç¯çŽããŸãã
Grok-1.5ã¯ããã®ã¢ãã«ã®ææ°çã§ãé·ãã³ã³ããã¹ãã®çè§£ãé«åºŠãªæšè«æ©èœãªã©ã®ç»æçãªæ©èœãå°å ¥ããŠããŸããGrok-1.5ã¯ãæå€§128KããŒã¯ã³ã®ã³ã³ããã¹ããåŠçããèœåã«ãããå€§å¹ ã«é·ãææžããã®æ å ±ãå©çšããããšãã§ããè€éã§åŸ®åŠãªã¿ã¹ã¯ã容æã«åŠçããããšãã§ããŸããããã«ããã®ã¢ãã«ã¯ã³ãŒãã£ã³ã°ãæ°åŠçãªåé¡è§£æ±ºã«ãããŠçŽ æŽãããæ§èœãçºæ®ããMATHãGSM8KãHumanEvalãªã©ã®ãã³ãããŒã¯ã§é«ãã¹ã³ã¢ãéæããŠããŸãã
4. ã°ãŒã°ã«ã«ããBERT
ããŒã (Bidirectional Encoder Representations from TransformersïŒã¯ã2018幎ã«GoogleãéçºãããªãŒãã³ãœãŒã¹ã®LLMã§ãããNLPåéã®ãã€ãªãã¢ãšããŠãBERTã¯æ©æ¢°ã人éã®èšèªãçè§£ãåŠçããæ¹æ³ã«é©åœããããããäŒæ¥ã«å¹ åºãçšéã®ããã®åŒ·åãªããŒã«ãæäŸããŠããã
BERT ã®éèŠãªé©æ°ã®äžã€ã¯ãèšèªçè§£ãžã®åæ¹åã¢ãããŒãã§ãããããã¹ãã鿬¡çã«åŠçãã以åã®ã¢ãã«ãšã¯ç°ãªããBERT ã¯åæ¹åããã³ã³ããã¹ããèæ ®ããããããããã¥ã¢ã³ã¹ã«å¯ãã æ£ç¢ºãªèšèªè¡šçŸãæããããšãã§ããŸãããã®åæ¹åã®çè§£ã«ãããBERT ã¯ããã¹ãåé¡ãææ åæãååä»ããšã³ãã£ãã£èªèãããã³è³ªåå¿çãªã©ã®ã¿ã¹ã¯ã§åªããèœåãçºæ®ããããšãã§ããŸãã
ã©ãã«ä»ããããŠããªãããã¹ãããŒã¿ã®èšå€§ãªã³ãŒãã¹ã«å¯ŸããBERTã®äºåèšç·Žã¯ãèšèªæ§é ãæå³è«ãããã«ã¯ããçšåºŠã®åžžèçãªæšè«ã«å¯Ÿããæ·±ãçè§£ãBERTã«äžããŠããŸãããã®åºç¯ãªäºååŠç¿ã«ãããBERTã¯äººéã®ãããªããã¹ããçæããæèã«é¢é£ããå¿çãæäŸã§ããããã«ãªããã³ã³ãã³ãäœæã®èªååããã£ããããããšã®å¯Ÿè©±ã®æ¹åã倧éã®ããã¹ãããŒã¿ããã®æŽå¯ã®æœåºãç®æãäŒæ¥ã«ãšã£ãŠè²Žéãªè³ç£ãšãªã£ãŠããŸãã
5. ãã¹ãã©ã«AIã«ãããã¹ãã©ã«ã»ã©ãŒãž
ãã¹ãã©ã«ã»ã©ãŒãžã¯ããªãŒãã³ãœãŒã¹LLMã®ææ°ãã©ãã°ã·ããã¢ãã«ãšããŠéçºãããã ãã¹ãã©ã«AI2024幎2æã«çºè¡šãããMistral Largeã¯ããã®æ¯é¡ãªãæ§èœãšãšã³ã¿ãŒãã©ã€ãºã»ã¢ããªã±ãŒã·ã§ã³ã®ããã®èšå€§ãªå¯èœæ§ã§ãAIã³ãã¥ããã£ã«æé¢šãå·»ãèµ·ãããã2024幎2æã«çºå£²ãããMistral Largeã¯ã3,140åãšããé©ç°çãªãã©ã¡ãŒã¿ãŒãèªãããã®èŠæš¡ãšèœåã¯GPT-4ã®ãããªæ¥çã®å·šäººã«å¹æµããã
Mistral Largeãéç«ãããŠããã®ã¯ãè€éãªæšè«ã¿ã¹ã¯ãç¹æ®ãªã¢ããªã±ãŒã·ã§ã³ã«ãããåè¶ããæ§èœã§ãããã®ã¢ãã«ã¯é«åºŠãªåé¡è§£æ±ºã«åªããŠãããè€éãªè€æ°ã¹ãããã®æšè«èª²é¡ãåŠçããèœåãè©äŸ¡ãããã³ãããŒã¯ã§åªããæ§èœãçºæ®ããŸãããã®ãããMistral Largeã¯ãæææ±ºå®ããã»ã¹ã®èªååãè€éãªããŒã¿ã»ããããã®æŽå¯ã®çæããŸãã¯AIãæŽ»çšããé«åºŠãªãœãªã¥ãŒã·ã§ã³ã®éçºãç®æãäŒæ¥ã«ãšã£ãŠäŸ¡å€ããããŒã«ãšãªããŸãã
Mistral Largeã®ããäžã€ã®å€§ããªåŒ·ã¿ã¯ãè±èªããã©ã³ã¹èªãã¹ãã€ã³èªããã€ãèªãã€ã¿ãªã¢èªã®å€èšèªãµããŒãã§ãããã®å€èšèªæ©èœã«ãããäŒæ¥ã¯ãã®ã¢ãã«ã倿§ãªå°ççãèšèªçã³ã³ãã¯ã¹ãã§å±éããããšãã§ããã°ããŒãã«ã¢ããªã±ãŒã·ã§ã³ãšããŠã®å¯èœæ§ãåºãããŸããããã«ãMistral Largeã®åœä»€è¿œåŸæ©èœãšé¢æ°åŒã³åºãæ©èœã«ãããç¬èªã®ã¢ãã¬ãŒã·ã§ã³ããªã·ãŒãç¹åããã¢ããªã±ãŒã·ã§ã³ãéçºããããšãã§ããæ±çšæ§ãããã«é«ãŸããŸãã
äŒæ¥æåã®ããã®ãªãŒãã³ãœãŒã¹LLMã®å
ãªãŒãã³ãœãŒã¹ã®å€§èŠæš¡èšèªã¢ãã«ã¯ãAIäž»å°ã®èªç¶èšèªåŠçã®ãã¯ãŒã掻çšããããšããäŒæ¥ã«ãšã£ãŠãã²ãŒã ãã§ã³ãžã£ãŒãšããŠç»å Žããããã®ããã°ãã¹ãã§åãäžãããªãŒãã³ãœãŒã¹ã® LLM ã®ããã 5 - Llama 3ãClaude 3ãGrok AIãBERTãMistral Large - ã¯ãå¹ åºãæ©èœãã¢ããªã±ãŒã·ã§ã³ãå©ç¹ãäŒæ¥ã«æäŸããè€éãªèª²é¡ã«åãçµã¿ãããã»ã¹ãèªååããéæ§é åããŒã¿ãã䟡å€ããæŽå¯ãåŸãããšãå¯èœã«ããŸãã
ãããã®ã¢ãã«ã®å¯èœæ§ã掻çšããç¹å®ã®ããŒãºã«åãããŠåŸ®èª¿æŽããããšã§ãäŒæ¥ã¯AIäž»å°ã®æä»£ã«ãããã€ãããŒã·ã§ã³ãå¹çæ§ãæé·ã®ããã®æ°ããªæ©äŒãè§£ãæŸã€ããšãã§ããŸãããªãŒãã³ãœãŒã¹ã®AIã³ãã¥ããã£ãèšèªã¢ãã«ã§å¯èœãªããšã®éçãæŒãåºãç¶ããäžããããã®åŒ·åãªããŒã«ãæ¡çšããäŒæ¥ã¯ãæä»£ã®æå 端ãèµ°ãç¶ããé·æçãªæåãéæããã®ã«æå©ãªç«å Žã«ãªãã§ãããã