
æåèµ·ããã¢ããªã¯AIã«é Œãã°äœããæä»£ã«ãWhisperãšParakeetãä»ã®ããããã¯ã©ã£ã¡ïŒ
ç¡æã§å ¬éãããŠãããªãŒãã³ãªé³å£°èªèã¢ãã«ã䜿ãã°ãä»ã¯èª°ã§ãæåèµ·ããã¢ããªãäœããŸããããããããã°ã©ã ãèªåã§æžãå¿ èŠã¯ãªããAIã«äŸé Œããã°åœ¢ã«ãªããŸããç§ã䜿ã£ãŠããäžã§äžçªä¿¡é Œã§ããã®ã¯OpenAIã®ãWhisperãã§ãããæè¿ã®ããããã¯NVIDIAã®ãParakeetãã§ãããã®èšäºã§ã¯ã2ã€ã®ã¢ãã«ã®éããšãã¢ããªã«çµã¿èŸŒããšãã«ç¥ã£ãŠãããšåœ¹ç«ã€ãã€ã³ãããŸãšããŸãã
æåèµ·ããã¢ããªã¯ãAIã«é Œãã§äœããæä»£ã«ãªã£ã
å°ãåãŸã§ãé³å£°èªèãèªåã®ã¢ããªã«å ¥ããã®ã¯å°éå®¶ã®ä»äºã§ãããä»ã¯ç¶æ³ã倧ããå€ãã£ãŠããŸãã
é«ç²ŸåºŠãªé³å£°èªèã¢ãã«ãç¡æã§å ¬éãããŠãã
Macãããœã³ã³ã®äžã§ããããã«ã€ãªããã«åããã
ã¢ããªã®ã³ãŒãã¯AIã«äŸé Œããã°æžããŠãããã
ã€ãŸããç§ãã¡ãèããã¹ãããšã¯ãã©ãå®è£ ããããããããã©ã®ã¢ãã«ãéžã¶ããã«ãªããŸãããããããã¯ããã®éžã³æ¹ãäžå¿ã«æžããŠãããŸãã
å®çªã¯ãWhisperããä¿¡é Œæ§ã¯ä»ãäžçª
Whisperã¯ãOpenAIã2022幎ã«å ¬éããé³å£°èªèã¢ãã«ã§ããæ¥æ¬èªãå«ãå€ãã®èšèªã«å¯Ÿå¿ããŠããŠãéé³ã®å€ãé³å£°ã«ãæ¯èŒç匷ãã®ãç¹é·ã§ããã³ãŒããšã¢ãã«ã¯MITã©ã€ã»ã³ã¹ã§å ¬éãããŠããŠãå人ã¢ããªã§ã䜿ããããæ¡ä»¶ã§ããç§ã®æèŠã§ã¯ããªãŒãã³ã¢ãã«ã®äžã§äžçªä¿¡é Œæ§ãé«ãã®ã¯ä»ãWhisperã ãšæããŸãã
ãã ããæ°ã«ãªãç¹ã2ã€ãããŸãã
å ¬éããæéããã£ãŠãã
æåã®å ¬éã¯2022幎ã§ã2023幎ã«ç²ŸåºŠãäžãããlarge-v3ãã2024幎ã«é«éåãããturboããåºãŸãããããã§ãåºæ¬ã®èšèšã¯æ°å¹Žåã®ãã®ã§ããã®åŸã«åºãæ°ããã¢ãã«ãšæ¯ã¹ããšãéãã軜ãã®é¢ã§èŠå£ãããå Žé¢ãåºãŠããŸããã
äžçªå€§ããã¢ãã«ã¯éã
Whisperã«ã¯å€§ããã®éãã¢ãã«ãããã粟床ãšéãã®ãã©ã³ã¹ã§éžã³ãŸããå ¬åŒã®è³æã§ã¯æ¬¡ã®ãšããã§ãïŒçžå¯Ÿé床ã¯è±èªé³å£°ã»A100ã§ã®ç®å®ïŒã
tinyïŒ3,900äžãã©ã¡ãŒã¿ãå¿ èŠã¡ã¢ãªçŽ1GB
smallïŒ2å4,400äžãã©ã¡ãŒã¿ãçŽ2GB
mediumïŒ7å6,900äžãã©ã¡ãŒã¿ãçŽ5GB
largeïŒ15å5,000äžãã©ã¡ãŒã¿ãçŽ10GB
turboïŒ8å900äžãã©ã¡ãŒã¿ãçŽ6GBïŒlargeã®çŽ8åéãïŒ
æ¥æ¬èªããããã«èµ·ãããããªã倧ããã¢ãã«ãéžã³ãããªããŸãããlargeã¯ã¹ããã«èŒããã«ã¯éããåŠçã«ãæéãããããŸãã

æè¿ã®ããããã¯ãParakeetãã軜ããŠéã
ããã§æè¿ç§ãããããããŠããã®ããNVIDIAã®ãParakeetãã§ããæ¥æ¬èªåãã«ã¯ãparakeet-tdt_ctc-0.6b-jaããšããã¢ãã«ãå ¬éãããŠããŸãã
倧ããã¯çŽ6åãã©ã¡ãŒã¿ã§ãWhisperã®largeã®åå以äž
æ¥æ¬èªã®é³å£°ã³ãŒãã¹ãReazonSpeechãã®3äž5,000æé以äžã§åŠç¿
å¥èªç¹ãä»ããç¶æ ã§æžãèµ·ãããŠããã
ã©ã€ã»ã³ã¹ã¯CC-BY-4.0ïŒã¯ã¬ãžãã衚èšãããã°åçšã§ã䜿ããïŒ
ã¢ãã«ã«ãŒãã«èŒã£ãŠããè©äŸ¡ã§ã¯ãæ¥æ¬èªã®èªã¿äžãé³å£°ïŒJSUTïŒã§æåã®èª€ãçïŒCERïŒã6.4%ãTEDxã®æ¥æ¬èªè¬æŒã§9.0%ãšãªã£ãŠããŸãã
䜿ã£ãŠã¿ãŠäžçªããããã®ã¯éãã§ãã軜éãªã®ã§ã話ããèšèããªã¢ã«ã¿ã€ã ã«è¿ãéãã§æåã«ã§ããŸããé²é³ãçµãã£ãŠãããŸãšããŠåŠçããã ãã§ãªãã話ããªããæåãåºãŠãããããªã¢ããªãäœãããããªããŸããã
泚æç¹ãšããŠãNVIDIAãåºããŠããå€èšèªçã®ParakeetïŒv3ãªã©ïŒã¯äž»ã«ãšãŒãããã®èšèªåãã§ããæ¥æ¬èªãæ±ããšãã¯ãæ¥æ¬èªå°çšã®ã-jaãã¢ãã«ãéžãã§ãã ããã
ã¢ããªã«çµã¿èŸŒããšãã«ç¥ã£ãŠããããããš
ããããã¯ãå®éã«ã¢ããªã«ããæ®µéã§åœ¹ç«ã€ãã€ã³ãã§ããAIã«äŸé Œãããšããããã®å 容ãäŒããŠãããšè©±ãæ©ããªããŸãã
é³å£°ã¯ã16kHzã»ã¢ãã©ã«ãã«ãããã
ParakeetãWhisperãã16kHzã»ã¢ãã©ã«ã®é³å£°ãåæã«ããŠããŸããiPhoneãMacã®é²é³ã¯44.1kHzã48kHzã®ããšãå€ãã®ã§ãã¢ãã«ã«æž¡ãåã«å€æãå¿ èŠã§ãããããæãããšã粟床ãèœã¡ãããšã©ãŒã«ãªã£ããããŸãã
é·ãé³å£°ã¯åºåã£ãŠåŠçãã
1æéãè¶ ãããããªé·ãé²é³ãäžåºŠã«æž¡ããšãã¡ã¢ãªãè¶³ããªããªã£ãããäžéšããæžãèµ·ããããªãã£ããããŸããç¡é³ã®éšåïŒVADïŒé³å£°åºéæ€åºïŒã§åºåããæ°åç§ããšã«åŠçããŠããã€ãªããã®ãåºæ¬ã§ããåºåãã®ååŸãå°ãéããŠãããšãæã®éäžã§åãããšãã®åãããŒããæžãããŸãã
ç¡é³ãéé³ã§ã®ãäœã話ãã«æ³šæ
Whisperã¯ãç¡é³ãéé³ãããªãåºéã§ãå®éã«ã¯è©±ããŠããªãæç« ãåºåããŠããŸãããšããããŸããç¡é³åºéããããããåãé€ããŠãããšããã®åé¡ãããªãæžãããŸãã
ã©ã€ã»ã³ã¹ã¯æåã«ç¢ºèªãã
ååã®èšäºã§ãæžããŸãããããªãŒãã³ãªã¢ãã«ã§ããåçšå©çšäžå¯ãã®ãã®ããããŸããWhisperã¯MITãParakeetã¯CC-BY-4.0ãªã®ã§ãã©ã¡ããå人ã¢ããªã§äœ¿ããããæ¡ä»¶ã§ããCC-BY-4.0ã¯ã¯ã¬ãžãã衚èšãæ¡ä»¶ãªã®ã§ãã¢ããªã®ããã®ã¢ããªã«ã€ããŠãç»é¢ãªã©ã«ã¢ãã«åãšæäŸå ãæžããŠãããŸãããã

Appleã®æšæºæ©èœãšããéžæè¢ã
iPhoneãMacã®ã¢ããªãªããAppleãçšæããŠããé³å£°èªèæ©èœã䜿ãæããããŸããiOS 26ãšmacOS 26ã§ã¯æ°ãããSpeechAnalyzerããå ããã端æ«å ã§é«éã«æåèµ·ãããã§ããããã«ãªããŸãããã¢ãã«ãèªåã§ã¢ããªã«å梱ããªããŠããã®ã§ãã¢ããªã®ãµã€ãºãå°ããã§ããã®ãå©ç¹ã§ããäžæ¹ã§ã察å¿ããèšèªã现ãã調æŽã¯Appleã®ä»æ§ã«åŸãããšã«ãªããŸãã
ã©ããéžã¶ãã®ç®å®ã¯ã次ã®ããã«èãããšãããããããšæããŸãã
ãšã«ããä¿¡é Œæ§ãéèŠããã â WhisperïŒlargeãturboïŒ
軜ããšéãããªã¢ã«ã¿ã€ã æ§ãéèŠããã â ParakeetïŒæ¥æ¬èªã¯-jaã¢ãã«ïŒ
ã¢ããªãå°ããä¿ã¡ãApple補åã ãã§å®çµããã â Appleã®æšæºæ©èœ
ãŸãšã
æåèµ·ããã¢ããªã¯ãç¡æã®ãªãŒãã³ã¢ãã«ãšAIãžã®äŸé Œã§èª°ã§ãäœããããã«ãªã£ã
ä¿¡é Œæ§ã§éžã¶ãªãWhisperããã ãå ¬éããæéããã¡ã倧ããã¢ãã«ã¯éã
æè¿ã®ããããã¯NVIDIAã®Parakeetã軜éã§æ§èœãããããªã¢ã«ã¿ã€ã ã«è¿ãæåèµ·ãããã§ãã
çµã¿èŸŒããšãã¯ã16kHzã»ã¢ãã©ã«ããé·ãé³å£°ã¯åºåãããã©ã€ã»ã³ã¹ç¢ºèªãã®3ç¹ãæŒããã
ããããæåèµ·ããã¢ããªãäœã£ãŠã¿ããæ¹ã¯ããŸãParakeetã®æ¥æ¬èªã¢ãã«ãã詊ããŠã¿ãŠãã ããã
ãã®èšäºã¯å ¬éãã30æ¥åŸã«ãæ°ã«ãªãAIæ å ±ã®ã¡ã³ããŒã·ãããïŒæ500åã»åæç¡æïŒã®ç¹å žã«ãªããŸããéå»èšäºã¯ã¡ã³ããŒã·ããã§ãŸãšããŠèªããŸãã
é¢é£èšäº
é¡å ¥ãæ¿ãã¢ããªãæå¿µããçç±ã¯ãæè¡ã§ã¯ãªããã¢ãã«ã®ã©ã€ã»ã³ã¹ãã ã£ã
https://note.com/right_ixia336/n/n873c5a829cfb
å€èšèªã¢ããªã®ç³è«äœæ¥ãClaudeã«ä»»ããããèªåã®äœæ¥æéãã»ãŒãŒãã«ãªã£ã