
ãGæ€å®ã1,380åã®ããã¯ã§æŽãã ææ°ã·ã©ãã¹ã®æ£äœââ5/9æ¬çªã«åããITã³ã³ãµã«ã®çŽåæŽç
æ£çŽã«èšãã
詊éšãŸã§ãããšæ°æ¥ã ã
Gæ€å®ã®æŒç¿ããã€ãã«1,380åã«éãããITã³ã³ãµã«ãšããŠ20幎çŸå Žããã£ãŠãã人éããAIã³ãŒããšäœµèµ°ããªãããããŸã§ç©ã¿äžããã450åãè¶ ããæ®µéã§ãããååã ããããšæã£ãç¬éãäœåºŠããã£ããããã§ãã·ã©ãã¹ã远ãããç¶ãããã¡ã«ãçæAIæä»£ã«çªå ¥ãã詊éšç¯å²ã®èŒªéãããŸã£ããéã£ãŠèŠããŠããã
ææ°ã®åºé¡åŸåã¯ãåãªãæèšã§ã¯å€ªåæã¡ã§ããªãèšèšã«å€ãã£ãŠãããLLMã®èª¿æŽæè¡ãè©äŸ¡ææšã®äœ¿ãåãã2024幎以éã®AIæ³å¶ããã«ãã¢ãŒãã«ãšAIãšãŒãžã§ã³ããã©ããæ°å¹Žåã®ã·ã©ãã¹ã«ã¯ãªãã£ãããããã¯æ¯éãæ¡éãã«å¢ããŠããé åã ã
çŽè¿ã®æŒç¿ãããªãã¡1,321åãã1,380åãŸã§ã§ç¹ã«éèŠã ãšæããææ°ã·ã©ãã¹ã®ãã¬ã³ããšãå®åã«çŽçµããæ°çã»æ³å¶ã»LLMã®ãã€ã³ãããããã«æ®ãã詊éšãæ§ããŠãã人éã«ãããã§ã«AIãå®åã§æ±ã£ãŠãã人éã«ããäœãããæã¡åž°ããåœ¢ã§æžããã
çæAIæä»£ã®æ°åžžèïŒLLMã®é«åºŠãªå¶åŸ¡
ææ°ã®è©Šéšç¯å²ã§ã¯ãLLMïŒå€§èŠæš¡èšèªã¢ãã«ïŒããç¥ã£ãŠãããã ãã§ã¯éçšããªããLLMãã©ã調æŽããã©ãéçšããããšããåšèŸºæè¡ããæ·±ãåãããã
æç€ºåŠç¿ïŒInstruction TuningïŒã¯ãäºååŠç¿ãçµããLLMãã察話ã§ããç¶æ ãã«åŸ®èª¿æŽããå·¥çšã§ãããçã®LLMã¯æç« çæã¯ã§ããŠãããŠãŒã¶ãŒã®æç€ºã«ç確ã«å¿ãã圢ã«ã¯ãªã£ãŠããªããæç€ºãšå¿çã®ãã¢ã§è¿œå åŠç¿ãããããšã§ã察話AIãšããŠã®åºç€ãäœãããã
RLHFïŒäººéããã®ãã£ãŒãããã¯ã«ãã匷ååŠç¿ïŒã¯ãChatGPTã®æ žãšãªãæè¡ã§ããã人éã®å¥œã¿ãå ±é ¬ãšããŠåŠç¿ãããããšã§ãåºåã®å質ãšå®å šæ§ãåæã«äžãããæç€ºåŠç¿ã§ã察話ã®åœ¢ããäœããRLHFã§ã察話ã®è³ªãã磚ãããã®äºæ®µæ§ãã®çè§£ãã詊éšã§ãå®åã§ãå¹ãã
RAGïŒæ€çŽ¢æ¡åŒµçæïŒã¯ããã«ã·ããŒã·ã§ã³ãããªãã¡ãã£ãšããããåãé²ãããã®å®åçæé©è§£ã§ãããLLMã®å éšç¥èã ãã«é Œãããå€éšã®æ€çŽ¢çµæãåç §ãããããšã§ãææ°æ§ãšæ£ç¢ºæ§ãæ ä¿ãããäŒæ¥ã®AIå°å ¥çŸå Žã§ã¯ããã¡ã€ã³ãã¥ãŒãã³ã°ãããRAGããå§ãã倿ãå§åçã«å€ããã³ã¹ããšé®®åºŠã®ãã©ã³ã¹ããRAGã«æå©ã«åãããã ã
Zero-shot CoTïŒãŒãã·ã§ããæèé£éïŒã¯ããæ®µéçã«èããŠãã ããããšããäžè¡ãå ããã ãã§ãLLMã®æšè«åãåçã«å€ããçŸè±¡ã§ãããããã³ããå·¥åŠã®æ žå¿ãããã®äžç¹ã«åçž®ãããŠããã詊éšã§åãããã ãã§ãªããå®åã§ã¯ã©ã€ã¢ã³ãã«LLM掻çšã説æãããšãã®æåã®æŠåšã«ãªãã
å®åã§å·®ãã€ããæ°çããšãæé©åã
æ°åŒãäžžæèšããã®ã§ã¯ãªãããã®æå³ãšã°ã©ãã®åããçè§£ããããšãåæ Œãžã®è¿éã ã
åŸé ããŒã¹ãã£ã³ã°ïŒGBDTïŒã¯ãåã®ã¢ãã«ãæ®ãããæ®å·®ããæ¬¡ã®ã¢ãã«ãåããŠããæ§é ã§ãããKaggleãªã©ã®å®åã³ã³ãã§å§åçãªæçžŸãåºããŠããææ³ã§ããããã£ãŒãã©ãŒãã³ã°ä»¥åã®æ©æ¢°åŠç¿ã®å°éç¹ãšããŠäœçœ®ã¥ãããããXGBoostãLightGBMãCatBoostãšãã£ãå ·äœçãªå®è£ åãã䜵ããŠæŒãããŠããããã
ãããæ£èŠåã®çœ ã¯ãåŠç¿æãšæšè«æã§æåãéãç¹ã«ãããåŠç¿æã¯ãããããããšã®çµ±èšéã䜿ãããæšè«æã¯åŠç¿äžã«èç©ãããç§»åå¹³åãã䜿ãããã®éããåãåé¡ã¯é »åºã§ãããããªãç§»åå¹³åãªã®ãããäžæã§èª¬æã§ãããããçè§£ã®æ·±ããåããã
L1æ£ååïŒã©ããœååž°ïŒã¯ãéã¿ãå®å šã«ãŒãã«ããããšã§ãç¹åŸŽééžæãã®åœ¹å²ãæãããL2æ£ååïŒãªããžååž°ïŒãéã¿ãå°ããããã®ã«å¯ŸããL1ã¯ãŒããŸã§æŒã蟌ããã¹ããŒã¹ãªã¢ãã«ãå¿ èŠãªå Žé¢ãç¹åŸŽéãèšå€§ã§éèŠãªãã®ã ãæ®ãããå Žé¢ã§éžã°ããã
ROCæ²ç·ãšAUCã¯ãäžåè¡¡ããŒã¿ã®è©äŸ¡ã§å¿ é ã®æŠå¿µã§ãããROCæ²ç·ã®45床ç·ã¯ãåœãŠæšéïŒã©ã³ãã äºæž¬ïŒããæå³ãããAUCã¯ãã®æ²ç·äžã®é¢ç©ã§ããã1.0ã«è¿ãã»ã©åªããã¢ãã«ã0.5ã¯å®å šã«ã©ã³ãã ã0.5æªæºã¯é匵ãããã°åœããã¬ãã«ã®äœæ§èœããšèªã¿è§£ããã
é¿ããŠã¯éããªããAIã¬ããã³ã¹ãšæ³èŠå¶ã
2024幎以éã®ææ°ã¬ã€ãã©ã€ã³ãšåœéçãªåããé »åºããŠãããæè¡åé¡ã ã察çããŠãããšãããã§è¶³å ããããããã
AIäºæ¥è ã¬ã€ãã©ã€ã³ïŒ2024幎ïŒã¯ãAIéçºè ã»æäŸè ã»å©çšè ã®äžè ã«å ±éããæéãšããŠæŽçãããæ¥æ¬ç¬èªã®ãã¬ãŒã ã§ããããããŸã§åæ£ããŠããAIé¢é£ã®åçš®ã¬ã€ãã©ã€ã³ãçµ±åããäœçœ®ã¥ãã«ãããäŒæ¥ã®AIå°å ¥å®åã§ãåç §ãããããšãå¢ããŠããã
åºå³¶AIããã»ã¹ã¯ãG7ã§åæãããåœéçãªè¡åèŠç¯ã§ãããæ¥æ¬äž»å°ã§è°è«ãé²ããããçµç·¯ããããEU AIæ³ã®ãªã¹ã¯ããŒã¹ã»ã¢ãããŒããšäžŠãã§ãAIã®åœéã¬ããã³ã¹ãèªãäžã§å€ããªãã
èäœæš©æ³ã®ãäŸæ æ§ãã¯ãAIçæç©ã®äŸµå®³ãªã¹ã¯ãå€å®ããæ žå¿æŠå¿µã§ãããAIãæ¢åã®èäœç©ããç¥ã£ãŠããïŒäŸæ ããŠããïŒãå Žåãçæç©ãé¡äŒŒããŠããã°äŸµå®³ãªã¹ã¯ãçãããæ¥æ¬ã®èäœæš©æ³30æ¡ã®4ã«ãããæ©æ¢°åŠç¿ãã©ãã€ã¹ãè«ãšäœµããŠãäŸæ æ§ã®è«ç¹ãçè§£ããŠããããšãå¿ é ã§ããã
QA4AIïŒQuality Assurance for AIïŒã¯ãAIç¹æã®å質ãããžã¡ã³ããã¬ãŒã ã§ãããåŸæ¥ã®ãœãããŠã§ã¢å質ä¿èšŒã§ã¯ã«ããŒã§ããªããAIã®éæ±ºå®æ§ã»ããŒã¿äŸåæ§ã»ã¢ãã«å£åãšãã£ãç¹æ§ã«å¯Ÿå¿ããèãæ¹ãšããŠäœçœ®ã¥ããããã
ææ°ã®æè¡ãã¬ã³ãïŒãã«ãã¢ãŒãã«ãšãšãŒãžã§ã³ã
AIã¯ãããã¹ãçæããããè¡åãã®ãã§ãŒãºã«ç§»ã£ãŠãããææ°ã·ã©ãã¹ã¯ããã®ç§»è¡ã確å®ã«è¿œããããŠããã
ViTïŒVision TransformerïŒã¯ãç»åèªèã®äž»åœ¹ãç³ã¿èŸŒã¿ãã¥ãŒã©ã«ãããã¯ãŒã¯ïŒCNNïŒãã奪ã£ãæè¡ã§ãããç»åãå°ããªãããã«åå²ããã¢ãã³ã·ã§ã³æ©æ§ã§åŠçãããç»åã«ãTransformerãå¹ããšããçºèŠãããã®åŸã®ãã«ãã¢ãŒãã«AIã®åºç€ã«ãªã£ãã
ReActãã¬ãŒã ã¯ãŒã¯ã¯ããæšè«ïŒReasoningïŒããšãè¡åïŒActingïŒãã亀äºã«ç¹°ãè¿ãèªåŸåAIãšãŒãžã§ã³ãã®æèåè·¯ã§ãããLLMãåã«çããåºãã®ã§ã¯ãªããèããããŒã«ãåŒã³åºããçµæãèžãŸããŠæ¬¡ãèããããšããæ§é ãå®è£ ãããAIãšãŒãžã§ã³ãæä»£ã®åºç€æŠå¿µã§ãããä»åŸæ°å¹Žã®æè¡ååãèªãäžã§ãå€ããªãã
FlashAttentionã¯ãAttentionèšç®ãIOã¬ãã«ã§é«éåããããšã§ãé·ãæèãæ±ããããã«ããé©åœçæè¡ã§ãããLLMãæ±ããæèé·ïŒã³ã³ããã¹ããŠã£ã³ããŠïŒãäžæ°ã«äŒžã³ãèæ¯ã«ã¯ããã®æè¡ãããã詊éšã§åãããã ãã§ãªããããªãæè¿ã®LLMã¯é·ãæç« ãæ±ããããã«ãªã£ãã®ãããã¯ã©ã€ã¢ã³ãã«èª¬æãããšãã®æ ¹æ ã«ãªãã
çŽåæã«ããã¹ãããš
æ£çŽã«èšãã
è©Šéšæ¬çªãŸã§æ®ãæ°æ¥ã®ã¿ã€ãã³ã°ã§ãæ°ããç¯å²ãè©°ã蟌ãã®ã¯æè³å¹çãæªãã
ããã¹ãã¯ããããŸã§ééããè«ç¹ãäžè¡ã«ã³ãã«ããŠãç¹°ãè¿ãèŠçŽãããšã ãè³ãäžåºŠåŒã£ããã£ãè«ç¹ã¯ãæ¬çªã§ãåŒã£ããããã ãããããèªåã®åŒ±ç¹ãªã¹ããçŽåã«äœåºŠãéèªãããæ°ããç¥èã10åå ¥ãããããéå»ã«ééããè«ç¹ã1å確å®ã«æœ°ãã»ãããæ¬çªã®ã¹ã³ã¢ã«çŽçµããã
ç¹ã«çŽåæã«èŠçŽãããã®ã¯äžã€ã®é åã§ããã第äžã«ãè©äŸ¡ææšã®äœ¿ãåãã§ãããPrecisionãRecallãFå€ãAUCãã©ãããå Žé¢ã§éžã°ãããããèªåã®èšèã§èª¬æã§ããç¶æ ã«ããŠããã第äºã«ãææ°ã®æ³èŠã»ã¬ããã³ã¹ã§ãããAIäºæ¥è ã¬ã€ãã©ã€ã³ãåºå³¶AIããã»ã¹ãEU AIæ³ãèäœæš©æ³30æ¡ã®4ãšäŸæ æ§ã®è«ç¹ããããã¯æè¡åé¡ãšéã£ãŠæèšèŠçŽ ã匷ããçŽåã®è©°ã蟌ã¿ãå¹ãã第äžã«ãçæAIåšèŸºã®çšèªã§ãããæç€ºåŠç¿ãRLHFãRAGãCoTãReActãViTãFlashAttentionãããããäœã解決ããæè¡ããäžèšã§èšãããã確èªããã
Gæ€å®ã¯ãå 蚱蚌ãã§ãã£ãŠããŽãŒã«ãã§ã¯ãªã
1,380åãè§£ããŠåãã£ãã®ã¯ãAIã®äžçã¯æ¥ã é²åããŠãããç¥èã®ã¢ããããŒããæ¢ããŠã¯ãããªããšããããšã ãæ®ã20åã§ã1,400åã«å°éãããè©Šéšæ¬çªãŸã§ã«å®èµ°ããäºå®ã§ããã
Gæ€å®ã¯ãŽãŒã«ã§ã¯ãªããAIãšãã匷åãªæŠåšã䜿ãããªãããã®å 蚱蚌ã«ãããªãã
1,380åã®ããã¯ãçµãŠæã«å ¥ããã®ã¯ãåæ ŒèšŒã§ã¯ãªããæè¡ãšå®åã®éã翻蚳ã§ããèªä¿¡ã§ãããITã³ã³ãµã«ãšããŠã®æŠåšã¯ãAIã䜿ããããšã§ã¯ãªããAIãã¯ã©ã€ã¢ã³ãã®èšèã«ç¿»èš³ã§ããããšã ãæè¡ãšå®åã®éã«ã翻蚳ãå¿ èŠãªå±€ãããããã®å±€ãæ ãã人éã¯ãçŸå Žã§é·ãéå®ãããã
5æ9æ¥ãæ¬çªã«æããåæ Œå ±åãšæ¯ãè¿ãã¯ãå¥èšäºã§æ®ãäºå®ã ã
åãã詊éšãæ§ããŠãã人éã«äŒããããæåŸãŸã§èªåã®åŒ±ç¹ãªã¹ããšåãåãããšãæ°ããç¯å²ã«æãåºããªãããšãæ¬çªã§ã¯èœã¡çããŠãèŠèŠãã®ããè«ç¹ãã確å®ã«æŸãããšã
å¥éãç¥ãã
é¢é£èšäº
ã第1åãAIé¡§åãšã¯äœã -> https://note.com/quiet_emu2080/n/n7cad0b52af08
ã第2åãAIå°å ¥ã§å€±æããçµç¹ã®å ±éç¹ -> https://note.com/quiet_emu2080/n/n0068cc7a20e0
DXå®è·µå®å šã¬ã€ãââ倱æããªãAIå°å ¥ã®ããŒããããïŒææã»Â¥2,480ïŒ -> https://note.com/quiet_emu2080/n/ndb7c9975bf0a
ãã¬ãžã³
AI掻çšå®éšå®€ -> https://note.com/quiet_emu2080/m/m79242a34a2cb
çŸå ŽPMã®å®è·µããŒã -> https://note.com/quiet_emu2080/m/mb3eda5b30688
©shiracoïœPMPããããã®å®è·µããŒãã@NoteCcm42090