Power Automate Desktopã§Cloud Vision APIã䜿ã£ãOCRãå®çŸ
Power Automate Desktopã®èšäºããŠã§ãäžãèŠãŠããšããŒã¡ãŒã¡åºãŠããŠããŸãããVBAãªã©ã®å Žåããããªã®ã§ããããããã£ããããããªäººã®ç¥èŠãææ³ãªã©ãåºããäºããªãã£ãã®ããããŸã§ã®RPAã®çŸå®ãåºãã£ãŠããŠæ°äž»åãé²ãã§ããã®ãæããŸãã
ããŠãååã®èšäºã§ã¯ãåºæ¬çãªæ©èœã§ã®ã¿Power Automate Desktopã䜿ã£ãææ³ã玹ä»ããŸãããä»åã¯ãOCRã®é ç®ã§ã¹ã«ãŒãããGoogle Cloud Vision APIã䜿ã£ãŠOCRããPower Automate Desktopã§å®çŸããŠã¿ãããšæããŸãã
å³ïŒ4å·¥çšã§å®çŸããŸã
ç®æ¬¡
ä»å䜿çšããã¢ããªãšãµãŒãã¹
äºåæºå
Cloud Vision APIã®æŠèŠ
GoogleãæäŸããŠããæ©æ¢°åŠç¿ãè¡ãç»åèªèAPIãCloud Vision APIã§ããåã«ç»åããæåèµ·ããã ãã§ãªããç»åãèªèããŠåŠçãããããªäºãŸã§å¹ åºãæ åœããŠããAPIã§ãããSpeech APIåæ§èª²é察象ã®APIã§ããã§ãããæéã®ç¡ææ ãããã®ã§ããã®æ å ã§ããã°ãåæã«èª²éããããšãã£ãäºã¯ãããŸãããæéã¯ãã¡ããããçšéå¥ã§å€ãã£ãŠããŸããä»åã¯ãOCRã«ã€ããŠã ãåãäžããŠã¿ãããšæããŸãã
ãŸããããã¹ãæ€åºã«ã€ããŠã®ãµã³ãã«ãªã©ã¯ãã¡ãã®ããŒãžã«çšæãããŠããŸãã
é ç®å | å 容 |
---|---|
ç»åãã¡ã€ã« | JPG圢åŒ, PNG圢åŒïŒäœãã640Ã480以äžã®ãµã€ãºã§ããããšïŒ |
ãã¡ã€ã«ãµã€ãº | 20MBãŸã§ïŒè¿ãå€ã®JSONãªããžã§ã¯ãã¯10MBãŸã§ïŒããŸã1ãªã¯ãšã¹ãããã16æãŸã§ã |
ãªã¯ãšã¹ã | Base64圢åŒã§æž¡ããïŒCloud Storageãžé 眮ããå¿ èŠãããïŒããã°ã©ã ã®å ŽåïŒ |
ç¡åäžéåäœ | 1000ãŠããã/æãŸã§ããã以äžã¯èª²é察象ïŒ1ç»å1ãŠãããïŒ |
æå課é | 1.5ãã«/æ(500äžãŠããããŸã§) |
å¶é | 1åããã1,800æãŸã§ã1ã¶æããã20,000,000 æãŸã§ |
APIããŒã®äœæ
ãã¡ããšè«æ±ã¢ã«ãŠã³ããäœããAPIããŒãäœããVision APIã®äœ¿çšã®æºåãããŠããªããšã403ãšã©ãŒãè¿ã£ãŠããŠããŸããŸãããŸããAPIæ¹åŒãªã®ã§OAuth2.0èªèšŒãªã©ã¯ãããŸãããAPIããŒã¯æŒãããããªãããã«å³éã«ç®¡çããŸãããã
ç»åãã¡ã€ã«ã«ã€ããŠ
ç»åãã¡ã€ã«ã§ãããPower Automate Desktopã®å ŽåãçŽæ¥ãã«ãã¹ã§ã©ããã«æ ŒçŽããŠãjpgãã¡ã€ã«ãªã©ãæå®ããŠéãã€ããäºãå¯èœã«ãªã£ãŠããŸããGoogle Apps Scriptãªã©ã®å Žåã«ã¯Base64ãšã³ã³ãŒããªã©ãå¿ èŠãªã®ã§ããããã®èŸºãã®åŠçã¯Vision APIã䜿ãã³ãã¯ã¿ãåŸãã§è²ã ãããªã«ãã£ãŠãããŠãã®ã ãšæããŸãã
ä»å䜿çšãããã¡ã€ã«ã¯é空æåº«ã®å€ªå®°æ²»ã®ãå¯å¶œçŸæ¯ããç»åãšããŠèªã¿èŸŒãŸããŸããã
å³ïŒå¯å¶œçŸæ¯ã®åé ãåãåã£ãŠç»ååããŠã¿ã
ãããŒãäœæãã
ãããŸã§ã§ãGoogle Cloud Vision APIã®äœ¿çšæºåãæŽããŸããããããããããŒãäœãã®ã§ããããããŒèªäœã¯éåžžã«ã·ã³ãã«ã§ç°¡åã«äœãäºãå¯èœã§ããäžç¹ã ããOCRããçµæã¯JSONã§è¿ã£ãŠããã®ã§ãJSONãããã®éšåãåãåºãç¹ãä»åã®ãã€ã³ãã«ãªããŸãã
äœææé
以äžã®æé ã§äœæããŸãã
- ç¹å¥ãªãã©ã«ãã¢ã¯ã·ã§ã³ã«ãŠããã¹ã¯ãããã®ãã¹ã%desktop%ãšããŠååŸãã
- 倿°ã®èšå®ã¢ã¯ã·ã§ã³ã«ãŠã1.ã®ãã¹ã¯ããããã¹ã«å ããŠãÂ¥ocr.jpgãã€ãªããŠã%fullpath%ãšããŠä¿å
- ã³ã°ããã£ãâGoogleâããžã§ã³âããã¹ãæ€åºã®ã¢ã¯ã·ã§ã³ã远å ãã
- ååŸããŠãããAPIããŒãå ¥åãç»åãã¡ã€ã«ã¯2.ã®å€æ°ãæå®ãã
- 次ã«ããã¹ãããã¡ã€ã«ã«æžã蟌ãã¢ã¯ã·ã§ã³ã远å ããŸã
- ãã¡ã€ã«ãã¹ã¯ã1.ãšÂ¥vision.txtãã€ãªããŠæå®ããŸãã
- ããããã€ã³ãã§ãããOCRçµæã¯ã%JSONResponse%ã«è¿ã£ãŠããŸããã¹ããŒã¿ã¹ã³ãŒãã¯%StatusCode%ã«æåããã°ã200ãè¿ã£ãŠããŸãã
- æžã蟌ãããã¹ãã¯ã7.ã®å 容ããJSONãåãåºãåœ¢ã§æå®ããã%JSONResponse.responses[0].fullTextAnnotation.text%ãšããåœ¢ã§æžã蟌ããšãOCRçµæã®æååãåãåºããŸãã
- æ°ããè¡ã远å ããã¯ãã§ãã¯ãå€ããŸãã
ããã§å®æã§ããè€æ°ã®ãã¡ã€ã«ãåãããå Žåã«ã¯ãfor eachãåä»ãããã¡ã€ã«åãªã©ããªããšãããã°ããã®RPAã®ã¿ã§äžæã«ç»åèªèã§ããã¹ãåãèªååå¯èœã§ãã
å³ïŒããã¹ãæ€åºä»¥å€ã«ããããŸã
å³ïŒããã¹ãæžèŸŒã¿ããã€ã³ã
ãããŒã®ã³ãŒã
1 2 3 4 |
Folder.GetSpecialFolder SpecialFolder: Folder.SpecialFolder.DesktopDirectory SpecialFolderPath=> desktop SET fullpath TO $'''%desktop%\\ocr.jpg''' Cognitive.Google.Vision.TextDetectionFromFile APIKey: $'''ããã«APIããŒãèšè¿°ãã''' ImageFile: fullpath Timeout: 30 Response=> JSONResponse StatusCode=> StatusCode File.WriteText File: $'''%desktop%\\vision.txt''' TextToWrite: JSONResponse.responses[0].fullTextAnnotation.text AppendNewLine: False IfFileExists: File.IfFileExists.Overwrite Encoding: File.FileEncoding.Unicode |
ïŒå·¥çšã®ã¿ã§å®çŸããŠãã®ã§ãã·ã³ãã«ã§ãã
OCRçµæ
Cloud Vision APIã§OCRããŠã¿ãçµæã¯ä»¥äžã®éãã
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 |
å¯ççŸæ¯ 倪宰治 ã²ããã ã¶ããŠã å¯å£«ã®é è§ãåºéã®å¯å£«ã¯å
«åäºåºŠãææã®å¯å£«ãå
«åå床ããããããã©ããéžè»ã®å®æž¬å³ã«ãã€ãŠæ±è¥¿åååã«æé¢å³ãäœã€ãŠã¿ããšãæ±è¥¿çžŠæã¯é è§ãçŸäºåå床ãšãªããååã¯çŸåäžåºŠã§ãããåºéãææã«éããããããŠãã®çµµã®å¯å£«ã¯ãé説è§ã§ãããããã ããã现ããé«ããè¯èã§ãããåæã«ã ãã€ãŠã¯ããã®é è§ãã»ãšãã©äžå床ãããããšããã§ã«éå¡ã®ãããªå¯å£«ãããžæããŠãããããã©ããå®éã®å¯å£«ã¯ãéè§ãéè§ãã®ããããšæ¡ãããæ± 西ãçŸäºåå床ãååã¯çŸåäžåºŠã決ããŠãç§æã®ããããšé«ãå±±ã§ã¯ãªããããšãžã°ç§ããå°åºŠãã©ããã®åœãããçªç¶ãé·²ã«ããã¯ããããšããšæ¥æ¬ã®æ²ŒæŽ¥ ãããã®æµ·å²žã«èœãããŠããµãšããã®å±±ãèŠã€ããŠãããããªã«é©åããªãã ããããããã³ã®ããžã€ããããããããæ§ããŠãããããããã¯ã³ããã«ãªã® ã§ãã€ãŠãããã§ãªããŠããã®ãããªä¿ãªå®£äŒããäžããç¥ãããçŽ æŽãªãçŽç²ã®ããã€ããªå¿ã«ãæããŠãã©ãã ã蚎ãžåŸããããã®ããšã«ãªããšãå€å°ãå¿ çŽ°ãå±±ã§ãããäœãã裟ã®ã²ããã€ãŠããå²ã«ãäœãããããããã®è£Ÿãæã€ãŠããå±±ãªãã°ãå°ããšãããããŒÂ·äºåãé«ããªããã°ãããªãã ååœå³ ããèŠãå¯å£«ã ãã¯ãé«ãã€ããããã¯ãããã€ããã¯ãããé²ã®ããã«ãããã ããèŠãããç§ã¯ããã®è£Ÿã®åŸé
ãã倿ããŠããã¶ããããããã ãããããã ãã§ããããšãé²ã®äžç¹ã«ããããã€ããŠããã®ãã¡ã«ãé²ãåããŠãèŠããšãã¡ãã€ããç§ãããããããå°ãã€ããŠçœ®ãããšããããããã® åãé«ããšããã«ãéãé ããããã€ãšèŠããããã©ãããããšããµãããç§ã¯ããžãã«ãããã€ãããããããç¬ã€ãããã€ãŠããããããšæã€ãã人ã¯ãå® å
šã®ãã®ãããã«æ¥ãããšããŸã¥ãã ãããªãããããç¬ãµãã®ããããå
šèº«ã®ãããã仿ãªããããã§ãä¹ã¯ããããªèšã²ããã§ãããã垯çŽãšããŠç¬ãµ ãšãã€ããããªæãã§ããã諞åããããæäººãšé¢ã€ãŠãé¢ã€ããšããã«ãæäººãããããç¬ã²åºããããæ
¶ç¥ã§ãããå¿
ããæäººã®é瀌ããšãããŠã¯ãªãã¬ã æäººã¯ãåã«é¢ã€ãŠãåã®å®å
šã®ãã®ãããããå
šèº«ã«æµŽã³ãŠããã®ã ã æ±äº¬ã®ãã¢ããŒãã®çªããèŠãå¯å£«ã¯ããããããå¬ã«ã¯ãã¯ã€ãããããèŠãããå°ãããççœãäžè§ããå°å¹³ç·ã«ã¡ããããšåºãŠããŠããããå¯å£«ã ã㪠ãã®ããšã¯ãªããã¯ãªã¹ãã¹ã®é£Ÿãèåã§ããããããå·Šã®ã¯ãã«ãè©ãåŸããŠå¿çްããè¹å°Ÿã®ã¯ãããã ãã ãæ²æ²¡ããããŠããè»èŠã®å§¿ã«äŒŒãŠãããäžå¹ŽãŸ ãžã®å¬ãç§ã¯æã人ãããæå€ã®äºå®ãæã¡æããããéæ¹ã«æ®ããããã®å€ãã¢ããŒãã®äžå®€ã§ãã²ãšãã§ããã¶ãã¶é
ã®ãã ãäžç¡ããããé
ã®ãã ããã ã€ããå°çšã«ç«ã€ãŠãã¢ããŒãã®äŸ¿æã®é網匵ãããåè§ãçªãããå¯å£«ãèŠãããå°ãããççœã§ãå·Šã®ã¯ãã«ã¡ãã€ãšåŸããŠããã®å¯å£«ãå¿ããªããçªã®äž ã®ã¢ã¹ãã¡ã«ãè·¯ãããããªãã®èªè»¢è»ãçŸé§ãããããããã¯ãããã«å¯å£«ãã¯ã€ããèŠããã¢ããããããã€ãœãµå¯ããããªã©å³ãã®ãããŠãç§ã¯ãæã 䟿æã®äžã«ç«ã¡ã€ãããçªã®éç¶²æ«ã§ãªãããããããæ³£ããŠããããªæã²ã¯ãäºåºŠãšç¹°ãããžããããªãã æååäžå¹Žã®åç§ãæã²ããããã«ããèŠæã§ãç§ã¯ããã°ãã²ãšã€ãããŠæ
ã«åºãã ãããã ã€ã³ã ãã ããã ããã ãã³ã²ã ãã€ã ã€ã¶ã ã㪠ã |
以åGoogle Apps Scriptã§Cloud Vision APIã䜿ã£ãæããã粟床ãäžãã£ãŠããã¿ããã§ããæ§ä»®åé£ãã§ãã£ãããæ§æŒ¢åã®èªèãè¯ãæãã§ãã
ã«ããå ¥ã£ãŠããŸã£ãŠãã®ã§ããããã¯ç¬ç«ããè¡ã«ãªã£ãŠããŸã£ãŠããŸãããã«ãã®å ¥ã£ãŠããªãéåžžã®ææžã§ããã°ããªãçŸå®çãªOCRãäœäŸ¡æ Œã§èªåã§çšæã§ããã®ã¯Goodã§ããã
é¢é£ãªã³ã¯
- Google Apps Script ã§ Cloud Vision API ã䜿ã£ãŠã¿ã
- GoogleDriveã®OCRæ©èœãGASã§ååŸããæ¹æ³ããååºç®¡çã¢ããªãäœã£ã話
- LINEããéã£ãç»åãæåèµ·ããããŠãããã¢ããªãäœããšãã®ã¡ã¢â
- Google Cloud Vision APIã®OCRïŒç»åèªèïŒãæ€èšŒãã
- Google Apps Scriptã§ç»åã®æååãæãåºã
- Google Cloud Vision API from Google Apps Script?
- How to Use Google Cloud APIs with Apps Script â Sample Application
- Using a service account â Google Cloud Vision API
- Google Vision API ã§ 400ãšã©ãŒãã§ãã®ã§å®æœãã察å¿ãæžã
- ãLINE Botã§æåèµ·ãããCloud Vision APIãå©çšããOCRãããã®äœææé ãå ¬é
- ãLINE Botã§æåèµ·ãããCloud Vision APIãšComputer Vision APIã§OCRããããäœæããŠã¿ã