{"id":476010,"date":"2023-08-09T07:25:33","date_gmt":"2023-08-09T07:25:33","guid":{"rendered":""},"modified":"2023-09-05T11:11:49","modified_gmt":"2023-09-05T11:11:49","slug":"bidirectional-lstm","status":"publish","type":"wiki","link":"https:\/\/oneproxy.pro\/jp\/wiki\/bidirectional-lstm\/","title":{"rendered":"\u53cc\u65b9\u5411LSTM"},"content":{"rendered":"<p>\u53cc\u65b9\u5411 LSTM \u306f\u3001\u9577\u671f\u4f9d\u5b58\u95a2\u4fc2\u306e\u554f\u984c\u306b\u5bfe\u51e6\u3059\u308b\u3053\u3068\u3067\u9806\u6b21\u30c7\u30fc\u30bf\u3092\u51e6\u7406\u3059\u308b\u3088\u3046\u306b\u8a2d\u8a08\u3055\u308c\u305f\u5f37\u529b\u306a\u30bf\u30a4\u30d7\u306e\u30ea\u30ab\u30ec\u30f3\u30c8 \u30cb\u30e5\u30fc\u30e9\u30eb \u30cd\u30c3\u30c8\u30ef\u30fc\u30af (RNN) \u3067\u3042\u308b Long Short-Term Memory (LSTM) \u306e\u30d0\u30ea\u30a8\u30fc\u30b7\u30e7\u30f3\u3067\u3059\u3002<\/p>\n<h2>\u53cc\u65b9\u5411 LSTM \u306e\u8d77\u6e90\u3068\u6700\u521d\u306e\u8a00\u53ca<\/h2>\n<p>\u53cc\u65b9\u5411 LSTM \u306e\u6982\u5ff5\u306f\u30011997 \u5e74\u306b Schuster \u3068 Paliwal \u306b\u3088\u308b\u8ad6\u6587\u300c\u53cc\u65b9\u5411\u30ea\u30ab\u30ec\u30f3\u30c8 \u30cb\u30e5\u30fc\u30e9\u30eb \u30cd\u30c3\u30c8\u30ef\u30fc\u30af\u300d\u3067\u521d\u3081\u3066\u5c0e\u5165\u3055\u308c\u307e\u3057\u305f\u3002\u305f\u3060\u3057\u3001\u6700\u521d\u306e\u30a2\u30a4\u30c7\u30a2\u306f LSTM \u3067\u306f\u306a\u304f\u3001\u5358\u7d14\u306a RNN \u69cb\u9020\u306b\u9069\u7528\u3055\u308c\u307e\u3057\u305f\u3002<\/p>\n<p>\u53cc\u65b9\u5411 LSTM \u306e\u524d\u8eab\u3067\u3042\u308b LSTM \u81ea\u4f53\u306e\u6700\u521d\u306e\u8a00\u53ca\u306f\u30011997 \u5e74\u306b Sepp Hochreiter \u3068 J\u00fcrgen Schmidhuber \u306b\u3088\u308b\u8ad6\u6587\u300cLong Short-Term Memory\u300d\u3067\u7d39\u4ecb\u3055\u308c\u307e\u3057\u305f\u3002LSTM \u306f\u3001\u9577\u3044\u30b7\u30fc\u30b1\u30f3\u30b9\u306b\u308f\u305f\u3063\u3066\u60c5\u5831\u3092\u5b66\u7fd2\u304a\u3088\u3073\u7dad\u6301\u3059\u308b\u3053\u3068\u304c\u56f0\u96e3\u3067\u3042\u3063\u305f\u5f93\u6765\u306e RNN \u306e\u300c\u52fe\u914d\u6d88\u5931\u300d\u554f\u984c\u3092\u89e3\u6c7a\u3059\u308b\u3053\u3068\u3092\u76ee\u7684\u3068\u3057\u3066\u3044\u307e\u3057\u305f\u3002<\/p>\n<p>LSTM \u3068\u53cc\u65b9\u5411\u69cb\u9020\u306e\u771f\u306e\u7d44\u307f\u5408\u308f\u305b\u306f\u3001\u7814\u7a76\u30b3\u30df\u30e5\u30cb\u30c6\u30a3\u3067\u5f8c\u304b\u3089\u767b\u5834\u3057\u3001\u53cc\u65b9\u5411\u3067\u30b7\u30fc\u30b1\u30f3\u30b9\u3092\u51e6\u7406\u3059\u308b\u6a5f\u80fd\u3092\u63d0\u4f9b\u3057\u3001\u3088\u308a\u67d4\u8edf\u306a\u30b3\u30f3\u30c6\u30ad\u30b9\u30c8\u7406\u89e3\u3092\u5b9f\u73fe\u3057\u307e\u3057\u305f\u3002<\/p>\n<h2>\u30c8\u30d4\u30c3\u30af\u306e\u62e1\u5f35: \u53cc\u65b9\u5411 LSTM<\/h2>\n<p>\u53cc\u65b9\u5411 LSTM \u306f LSTM \u306e\u62e1\u5f35\u6a5f\u80fd\u3067\u3042\u308a\u3001\u30b7\u30fc\u30b1\u30f3\u30b9\u5206\u985e\u554f\u984c\u306b\u304a\u3051\u308b\u30e2\u30c7\u30eb\u306e\u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9\u3092\u5411\u4e0a\u3055\u305b\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002\u5165\u529b\u30b7\u30fc\u30b1\u30f3\u30b9\u306e\u3059\u3079\u3066\u306e\u30bf\u30a4\u30e0\u30b9\u30c6\u30c3\u30d7\u304c\u5229\u7528\u53ef\u80fd\u306a\u554f\u984c\u3067\u306f\u3001\u53cc\u65b9\u5411 LSTM \u306f\u5165\u529b\u30b7\u30fc\u30b1\u30f3\u30b9\u306b\u5bfe\u3057\u3066 1 \u3064\u306e LSTM \u3067\u306f\u306a\u304f 2 \u3064\u306e LSTM \u3092\u30c8\u30ec\u30fc\u30cb\u30f3\u30b0\u3057\u307e\u3059\u30021 \u3064\u76ee\u306f\u5165\u529b\u30b7\u30fc\u30b1\u30f3\u30b9\u3092\u305d\u306e\u307e\u307e\u30c8\u30ec\u30fc\u30cb\u30f3\u30b0\u3057\u30012 \u3064\u76ee\u306f\u5165\u529b\u30b7\u30fc\u30b1\u30f3\u30b9\u306e\u53cd\u8ee2\u30b3\u30d4\u30fc\u3092\u30c8\u30ec\u30fc\u30cb\u30f3\u30b0\u3057\u307e\u3059\u3002\u3053\u308c\u3089 2 \u3064\u306e LSTM \u306e\u51fa\u529b\u306f\u3001\u30cd\u30c3\u30c8\u30ef\u30fc\u30af\u306e\u6b21\u306e\u5c64\u306b\u6e21\u3055\u308c\u308b\u524d\u306b\u30de\u30fc\u30b8\u3055\u308c\u307e\u3059\u3002<\/p>\n<h2>\u53cc\u65b9\u5411LSTM\u306e\u5185\u90e8\u69cb\u9020\u3068\u305d\u306e\u6a5f\u80fd<\/h2>\n<p>\u53cc\u65b9\u5411 LSTM \u306f\u3001\u9806\u65b9\u5411 LSTM \u3068\u9006\u65b9\u5411 LSTM \u3068\u3044\u3046 2 \u3064\u306e\u5225\u3005\u306e LSTM \u3067\u69cb\u6210\u3055\u308c\u307e\u3059\u3002\u9806\u65b9\u5411 LSTM \u306f\u30b7\u30fc\u30b1\u30f3\u30b9\u3092\u6700\u521d\u304b\u3089\u6700\u5f8c\u307e\u3067\u8aad\u307f\u53d6\u308a\u3001\u9006\u65b9\u5411 LSTM \u306f\u30b7\u30fc\u30b1\u30f3\u30b9\u3092\u6700\u5f8c\u304b\u3089\u6700\u521d\u307e\u3067\u8aad\u307f\u53d6\u308a\u307e\u3059\u3002\u4e21\u65b9\u306e LSTM \u304b\u3089\u306e\u60c5\u5831\u304c\u7d44\u307f\u5408\u308f\u3055\u308c\u3066\u6700\u7d42\u7684\u306a\u4e88\u6e2c\u304c\u884c\u308f\u308c\u3001\u30e2\u30c7\u30eb\u306b\u904e\u53bb\u3068\u672a\u6765\u306e\u5b8c\u5168\u306a\u30b3\u30f3\u30c6\u30ad\u30b9\u30c8\u304c\u63d0\u4f9b\u3055\u308c\u307e\u3059\u3002<\/p>\n<p>\u5404 LSTM \u30e6\u30cb\u30c3\u30c8\u306e\u5185\u90e8\u69cb\u9020\u306f\u3001\u6b21\u306e 3 \u3064\u306e\u91cd\u8981\u306a\u30b3\u30f3\u30dd\u30fc\u30cd\u30f3\u30c8\u3067\u69cb\u6210\u3055\u308c\u3066\u3044\u307e\u3059\u3002<\/p>\n<ol>\n<li><strong>\u5fd8\u308c\u305f\u30b2\u30fc\u30c8:<\/strong> \u3053\u308c\u306b\u3088\u308a\u3001\u30bb\u30eb\u72b6\u614b\u304b\u3089\u7834\u68c4\u3059\u308b\u60c5\u5831\u304c\u6c7a\u307e\u308a\u307e\u3059\u3002<\/li>\n<li><strong>\u5165\u529b\u30b2\u30fc\u30c8:<\/strong> \u3053\u308c\u306b\u3088\u308a\u3001\u30bb\u30eb\u306e\u72b6\u614b\u304c\u65b0\u3057\u3044\u60c5\u5831\u3067\u66f4\u65b0\u3055\u308c\u307e\u3059\u3002<\/li>\n<li><strong>\u51fa\u529b\u30b2\u30fc\u30c8:<\/strong> \u3053\u308c\u306b\u3088\u308a\u3001\u73fe\u5728\u306e\u5165\u529b\u3068\u66f4\u65b0\u3055\u308c\u305f\u30bb\u30eb\u306e\u72b6\u614b\u306b\u57fa\u3065\u3044\u3066\u51fa\u529b\u304c\u6c7a\u5b9a\u3055\u308c\u307e\u3059\u3002<\/li>\n<\/ol>\n<h2>\u53cc\u65b9\u5411 LSTM \u306e\u4e3b\u306a\u7279\u5fb4<\/h2>\n<ul>\n<li><strong>\u4e21\u65b9\u5411\u306e\u30b7\u30fc\u30b1\u30f3\u30b9\u51e6\u7406:<\/strong> \u6a19\u6e96\u7684\u306a LSTM \u3068\u306f\u7570\u306a\u308a\u3001\u53cc\u65b9\u5411 LSTM \u306f\u30b7\u30fc\u30b1\u30f3\u30b9\u306e\u4e21\u7aef\u304b\u3089\u30c7\u30fc\u30bf\u3092\u51e6\u7406\u3059\u308b\u305f\u3081\u3001\u30b3\u30f3\u30c6\u30ad\u30b9\u30c8\u3092\u3088\u308a\u9069\u5207\u306b\u7406\u89e3\u3067\u304d\u307e\u3059\u3002<\/li>\n<li><strong>\u9577\u671f\u7684\u306a\u4f9d\u5b58\u95a2\u4fc2\u306e\u5b66\u7fd2:<\/strong> \u53cc\u65b9\u5411 LSTM \u306f\u9577\u671f\u7684\u306a\u4f9d\u5b58\u95a2\u4fc2\u3092\u5b66\u7fd2\u3059\u308b\u3088\u3046\u306b\u8a2d\u8a08\u3055\u308c\u3066\u304a\u308a\u3001\u9806\u6b21\u30c7\u30fc\u30bf\u3092\u542b\u3080\u30bf\u30b9\u30af\u306b\u9069\u3057\u3066\u3044\u307e\u3059\u3002<\/li>\n<li><strong>\u60c5\u5831\u640d\u5931\u3092\u9632\u6b62:<\/strong> \u53cc\u65b9\u5411 LSTM \u306f\u3001\u53cc\u65b9\u5411\u3067\u30c7\u30fc\u30bf\u3092\u51e6\u7406\u3059\u308b\u3053\u3068\u306b\u3088\u308a\u3001\u6a19\u6e96\u306e LSTM \u30e2\u30c7\u30eb\u3067\u306f\u5931\u308f\u308c\u308b\u53ef\u80fd\u6027\u306e\u3042\u308b\u60c5\u5831\u3092\u4fdd\u6301\u3067\u304d\u307e\u3059\u3002<\/li>\n<\/ul>\n<h2>\u53cc\u65b9\u5411 LSTM \u306e\u7a2e\u985e<\/h2>\n<p>\u5927\u307e\u304b\u306b\u8a00\u3048\u3070\u3001\u53cc\u65b9\u5411 LSTM \u306b\u306f\u4e3b\u306b 2 \u3064\u306e\u30bf\u30a4\u30d7\u304c\u3042\u308a\u307e\u3059\u3002<\/p>\n<ol>\n<li>\n<p><strong>\u9023\u7d50\u3055\u308c\u305f\u53cc\u65b9\u5411 LSTM:<\/strong> \u9806\u65b9\u5411 LSTM \u3068\u9006\u65b9\u5411 LSTM \u306e\u51fa\u529b\u304c\u9023\u7d50\u3055\u308c\u3001\u5f8c\u7d9a\u306e\u30ec\u30a4\u30e4\u30fc\u306e LSTM \u30e6\u30cb\u30c3\u30c8\u306e\u6570\u304c\u5b9f\u8cea\u7684\u306b 2 \u500d\u306b\u306a\u308a\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u5408\u8a08\u53cc\u65b9\u5411 LSTM:<\/strong> \u524d\u65b9 LSTM \u3068\u5f8c\u65b9 LSTM \u306e\u51fa\u529b\u304c\u5408\u8a08\u3055\u308c\u3001\u5f8c\u7d9a\u306e\u30ec\u30a4\u30e4\u30fc\u306e LSTM \u30e6\u30cb\u30c3\u30c8\u306e\u6570\u306f\u540c\u3058\u307e\u307e\u306b\u306a\u308a\u307e\u3059\u3002<\/p>\n<\/li>\n<\/ol>\n<table>\n<thead>\n<tr>\n<th>\u30bf\u30a4\u30d7<\/th>\n<th>\u8aac\u660e<\/th>\n<th>\u51fa\u529b<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>\u9023\u7d50<\/td>\n<td>\u524d\u65b9\u51fa\u529b\u3068\u5f8c\u65b9\u51fa\u529b\u304c\u7d50\u5408\u3055\u308c\u307e\u3059\u3002<\/td>\n<td>LSTM\u30e6\u30cb\u30c3\u30c8\u30922\u500d\u306b\u3059\u308b<\/td>\n<\/tr>\n<tr>\n<td>\u5408\u8a08<\/td>\n<td>\u524d\u65b9\u51fa\u529b\u3068\u5f8c\u65b9\u51fa\u529b\u304c\u52a0\u7b97\u3055\u308c\u307e\u3059\u3002<\/td>\n<td>LSTM\u30e6\u30cb\u30c3\u30c8\u3092\u7dad\u6301\u3059\u308b<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<h2>\u53cc\u65b9\u5411 LSTM \u306e\u4f7f\u7528\u3068\u95a2\u9023\u3059\u308b\u8ab2\u984c<\/h2>\n<p>\u53cc\u65b9\u5411 LSTM \u306f\u3001\u611f\u60c5\u5206\u6790\u3001\u30c6\u30ad\u30b9\u30c8\u751f\u6210\u3001\u6a5f\u68b0\u7ffb\u8a33\u3001\u97f3\u58f0\u8a8d\u8b58\u306a\u3069\u306e\u81ea\u7136\u8a00\u8a9e\u51e6\u7406 (NLP) \u3067\u5e83\u304f\u4f7f\u7528\u3055\u308c\u3066\u3044\u307e\u3059\u3002\u307e\u305f\u3001\u6642\u7cfb\u5217\u4e88\u6e2c\u3084\u30b7\u30fc\u30b1\u30f3\u30b9\u5185\u306e\u7570\u5e38\u691c\u51fa\u306b\u3082\u9069\u7528\u3067\u304d\u307e\u3059\u3002<\/p>\n<p>\u53cc\u65b9\u5411 LSTM \u306b\u95a2\u9023\u3059\u308b\u8ab2\u984c\u306f\u6b21\u306e\u3068\u304a\u308a\u3067\u3059\u3002<\/p>\n<ul>\n<li><strong>\u8907\u96d1\u3055\u3068\u8a08\u7b97\u30b3\u30b9\u30c8\u306e\u5897\u52a0:<\/strong> \u53cc\u65b9\u5411 LSTM \u3067\u306f 2 \u3064\u306e LSTM \u3092\u30c8\u30ec\u30fc\u30cb\u30f3\u30b0\u3059\u308b\u5fc5\u8981\u304c\u3042\u308b\u305f\u3081\u3001\u8907\u96d1\u3055\u304c\u5897\u3057\u3001\u8a08\u7b97\u8981\u4ef6\u304c\u5897\u52a0\u3059\u308b\u53ef\u80fd\u6027\u304c\u3042\u308a\u307e\u3059\u3002<\/li>\n<li><strong>\u904e\u5270\u9069\u5408\u306e\u30ea\u30b9\u30af:<\/strong> \u53cc\u65b9\u5411 LSTM \u306f\u8907\u96d1\u3067\u3042\u308b\u305f\u3081\u3001\u7279\u306b\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\u304c\u5c0f\u3055\u3044\u5834\u5408\u306f\u904e\u5270\u9069\u5408\u306b\u306a\u308a\u304c\u3061\u3067\u3059\u3002<\/li>\n<li><strong>\u5b8c\u5168\u306a\u30b7\u30fc\u30b1\u30f3\u30b9\u306e\u8981\u4ef6:<\/strong> \u53cc\u65b9\u5411 LSTM \u3067\u306f\u3001\u30c8\u30ec\u30fc\u30cb\u30f3\u30b0\u3068\u4e88\u6e2c\u306b\u5b8c\u5168\u306a\u30b7\u30fc\u30b1\u30f3\u30b9 \u30c7\u30fc\u30bf\u304c\u5fc5\u8981\u306a\u306e\u3067\u3001\u30ea\u30a2\u30eb\u30bf\u30a4\u30e0 \u30a2\u30d7\u30ea\u30b1\u30fc\u30b7\u30e7\u30f3\u306b\u306f\u9069\u3057\u3066\u3044\u307e\u305b\u3093\u3002<\/li>\n<\/ul>\n<h2>\u985e\u4f3c\u30e2\u30c7\u30eb\u3068\u306e\u6bd4\u8f03<\/h2>\n<table>\n<thead>\n<tr>\n<th>\u30e2\u30c7\u30eb<\/th>\n<th>\u30a2\u30c9\u30d0\u30f3\u30c6\u30fc\u30b8<\/th>\n<th>\u4e0d\u5229\u76ca<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>\u6a19\u6e96LSTM<\/td>\n<td>\u8907\u96d1\u3055\u304c\u5c11\u306a\u304f\u3001\u30ea\u30a2\u30eb\u30bf\u30a4\u30e0\u30a2\u30d7\u30ea\u30b1\u30fc\u30b7\u30e7\u30f3\u306b\u9069\u3057\u3066\u3044\u307e\u3059<\/td>\n<td>\u6587\u8108\u7406\u89e3\u306e\u9650\u754c<\/td>\n<\/tr>\n<tr>\n<td>GRU (\u30b2\u30fc\u30c8\u30fb\u30ea\u30ab\u30ec\u30f3\u30c8\u30fb\u30e6\u30cb\u30c3\u30c8)<\/td>\n<td>LSTM\u3088\u308a\u3082\u8907\u96d1\u3067\u306f\u306a\u304f\u3001\u30c8\u30ec\u30fc\u30cb\u30f3\u30b0\u304c\u901f\u3044<\/td>\n<td>\u975e\u5e38\u306b\u9577\u3044\u30b7\u30fc\u30b1\u30f3\u30b9\u3067\u306f\u82e6\u52b4\u3059\u308b\u53ef\u80fd\u6027\u304c\u3042\u308b<\/td>\n<\/tr>\n<tr>\n<td>\u53cc\u65b9\u5411LSTM<\/td>\n<td>\u512a\u308c\u305f\u30b3\u30f3\u30c6\u30ad\u30b9\u30c8\u7406\u89e3\u3001\u30b7\u30fc\u30b1\u30f3\u30b9\u554f\u984c\u306b\u304a\u3051\u308b\u512a\u308c\u305f\u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9<\/td>\n<td>\u3088\u308a\u8907\u96d1\u3001\u904e\u5270\u9069\u5408\u306e\u30ea\u30b9\u30af<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<h2>\u53cc\u65b9\u5411 LSTM \u306b\u95a2\u9023\u3059\u308b\u5c06\u6765\u306e\u5c55\u671b\u3068\u6280\u8853<\/h2>\n<p>\u53cc\u65b9\u5411 LSTM \u306f\u3001OpenAI \u306e BERT \u304a\u3088\u3073 GPT \u30b7\u30ea\u30fc\u30ba\u306e\u57fa\u76e4\u3068\u306a\u308b Transformer \u30e2\u30c7\u30eb\u3092\u542b\u3080\u3001\u591a\u304f\u306e\u6700\u65b0\u306e NLP \u30a2\u30fc\u30ad\u30c6\u30af\u30c1\u30e3\u306e\u4e2d\u6838\u90e8\u5206\u3092\u5f62\u6210\u3057\u307e\u3059\u3002LSTM \u3068\u30a2\u30c6\u30f3\u30b7\u30e7\u30f3 \u30e1\u30ab\u30cb\u30ba\u30e0\u306e\u7d71\u5408\u306f\u3001\u3055\u307e\u3056\u307e\u306a\u30bf\u30b9\u30af\u3067\u512a\u308c\u305f\u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9\u3092\u793a\u3057\u3001Transformer \u30d9\u30fc\u30b9\u306e\u30a2\u30fc\u30ad\u30c6\u30af\u30c1\u30e3\u306e\u6025\u5897\u306b\u3064\u306a\u304c\u3063\u3066\u3044\u307e\u3059\u3002<\/p>\n<p>\u3055\u3089\u306b\u3001\u7814\u7a76\u8005\u305f\u3061\u306f\u3001\u30b7\u30fc\u30b1\u30f3\u30b9\u51e6\u7406\u306e\u305f\u3081\u306b\u7573\u307f\u8fbc\u307f\u30cb\u30e5\u30fc\u30e9\u30eb \u30cd\u30c3\u30c8\u30ef\u30fc\u30af (CNN) \u306e\u8981\u7d20\u3068 LSTM \u3092\u7d44\u307f\u5408\u308f\u305b\u305f\u30cf\u30a4\u30d6\u30ea\u30c3\u30c9 \u30e2\u30c7\u30eb\u3082\u7814\u7a76\u3057\u3066\u304a\u308a\u3001\u4e21\u65b9\u306e\u9577\u6240\u3092\u7d50\u96c6\u3057\u3066\u3044\u307e\u3059\u3002<\/p>\n<h2>\u30d7\u30ed\u30ad\u30b7\u30b5\u30fc\u30d0\u30fc\u3068\u53cc\u65b9\u5411 LSTM<\/h2>\n<p>\u30d7\u30ed\u30ad\u30b7 \u30b5\u30fc\u30d0\u30fc\u306f\u3001\u53cc\u65b9\u5411 LSTM \u30e2\u30c7\u30eb\u306e\u5206\u6563\u30c8\u30ec\u30fc\u30cb\u30f3\u30b0\u306b\u4f7f\u7528\u3067\u304d\u307e\u3059\u3002\u3053\u308c\u3089\u306e\u30e2\u30c7\u30eb\u306b\u306f\u5927\u91cf\u306e\u8a08\u7b97\u30ea\u30bd\u30fc\u30b9\u304c\u5fc5\u8981\u306a\u305f\u3081\u3001\u30ef\u30fc\u30af\u30ed\u30fc\u30c9\u3092\u8907\u6570\u306e\u30b5\u30fc\u30d0\u30fc\u306b\u5206\u6563\u3067\u304d\u307e\u3059\u3002\u30d7\u30ed\u30ad\u30b7 \u30b5\u30fc\u30d0\u30fc\u306f\u3001\u3053\u306e\u5206\u6563\u3092\u7ba1\u7406\u3057\u3001\u30e2\u30c7\u30eb \u30c8\u30ec\u30fc\u30cb\u30f3\u30b0\u306e\u901f\u5ea6\u3092\u5411\u4e0a\u3055\u305b\u3001\u3088\u308a\u5927\u304d\u306a\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\u3092\u52b9\u7387\u7684\u306b\u51e6\u7406\u3059\u308b\u306e\u306b\u5f79\u7acb\u3061\u307e\u3059\u3002<\/p>\n<p>\u3055\u3089\u306b\u3001LSTM \u30e2\u30c7\u30eb\u3092\u30ea\u30a2\u30eb\u30bf\u30a4\u30e0 \u30a2\u30d7\u30ea\u30b1\u30fc\u30b7\u30e7\u30f3\u7528\u306e\u30af\u30e9\u30a4\u30a2\u30f3\u30c8 \u30b5\u30fc\u30d0\u30fc \u30a2\u30fc\u30ad\u30c6\u30af\u30c1\u30e3\u306b\u5c55\u958b\u3059\u308b\u3068\u3001\u30d7\u30ed\u30ad\u30b7 \u30b5\u30fc\u30d0\u30fc\u306f\u30af\u30e9\u30a4\u30a2\u30f3\u30c8\u8981\u6c42\u3092\u7ba1\u7406\u3057\u3001\u8ca0\u8377\u5206\u6563\u3092\u884c\u3044\u3001\u30c7\u30fc\u30bf\u306e\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3\u3092\u78ba\u4fdd\u3067\u304d\u307e\u3059\u3002<\/p>\n<h2>\u95a2\u9023\u30ea\u30f3\u30af<\/h2>\n<ol>\n<li><a href=\"https:\/\/ieeexplore.ieee.org\/document\/650093\" target=\"_new\" rel=\"noopener nofollow\">\u30b7\u30e5\u30b9\u30bf\u30fc\u3001M.\u3001\u30d1\u30ea\u30ef\u30eb\u3001KK\u30011997\u5e74\u3002\u53cc\u65b9\u5411\u30ea\u30ab\u30ec\u30f3\u30c8\u30cb\u30e5\u30fc\u30e9\u30eb\u30cd\u30c3\u30c8\u30ef\u30fc\u30af<\/a><\/li>\n<li><a href=\"https:\/\/www.mitpressjournals.org\/doi\/abs\/10.1162\/neco.1997.9.8.1735\" target=\"_new\" rel=\"noopener nofollow\">Hochreiter, S., Schmidhuber, J., 1997. \u9577\u671f\u77ed\u671f\u8a18\u61b6<\/a><\/li>\n<li><a href=\"https:\/\/colah.github.io\/posts\/2015-08-Understanding-LSTMs\/\" target=\"_new\" rel=\"noopener nofollow\">LSTM \u30cd\u30c3\u30c8\u30ef\u30fc\u30af\u3092\u7406\u89e3\u3059\u308b<\/a><\/li>\n<li><a href=\"https:\/\/keras.io\/api\/layers\/recurrent_layers\/bidirectional\/\" target=\"_new\" rel=\"noopener nofollow\">Keras \u3067\u306e\u53cc\u65b9\u5411 LSTM<\/a><\/li>\n<li><a href=\"https:\/\/www.researchgate.net\/publication\/327810758_Distributed_Deep_Learning_Model_for_Intelligent_Mobile_Processing\" target=\"_new\" rel=\"noopener nofollow\">\u30d7\u30ed\u30ad\u30b7\u30b5\u30fc\u30d0\u30fc\u3092\u4f7f\u7528\u3057\u305f\u5206\u6563\u578b\u30c7\u30a3\u30fc\u30d7\u30e9\u30fc\u30cb\u30f3\u30b0<\/a><\/li>\n<\/ol>","protected":false},"featured_media":467717,"menu_order":0,"template":"","meta":{"_acf_changed":false,"content-type":"","inline_featured_image":false,"footnotes":""},"class_list":["post-476010","wiki","type-wiki","status-publish","has-post-thumbnail","hentry"],"acf":{"faq_title":"Frequently Asked Questions about <mark>Bidirectional Long Short-Term Memory (Bidirectional LSTM)<\/mark>","faq_items":[{"question":"What is a Bidirectional LSTM?","answer":"<p>A Bidirectional LSTM is an extension of the Long Short-Term Memory (LSTM), a type of Recurrent Neural Network. Unlike standard LSTM, Bidirectional LSTM processes data from both ends of the sequence, enhancing the context understanding of the model.<\/p>"},{"question":"When was the concept of Bidirectional LSTM first introduced?","answer":"<p>The concept of Bidirectional LSTM was initially introduced in a paper titled \"Bidirectional Recurrent Neural Networks\" by Schuster and Paliwal in 1997. However, the initial idea was applied to a simple RNN structure, not LSTM. The first instance of LSTM, the basis of Bidirectional LSTM, was proposed in the same year by Sepp Hochreiter and J\u00fcrgen Schmidhuber.<\/p>"},{"question":"How does a Bidirectional LSTM work?","answer":"<p>A Bidirectional LSTM consists of two separate LSTMs: the forward LSTM and the backward LSTM. The forward LSTM reads the sequence from the start to the end, while the backward LSTM reads it from the end to the start. These two LSTMs then combine their information to make the final prediction, allowing the model to understand the full context of the sequence.<\/p>"},{"question":"What are the key features of Bidirectional LSTM?","answer":"<p>The key features of Bidirectional LSTM include its ability to process sequences in both directions, learn long-term dependencies, and prevent information loss that might occur in a standard LSTM model.<\/p>"},{"question":"What types of Bidirectional LSTM exist?","answer":"<p>There are two main types of Bidirectional LSTM: Concatenated Bidirectional LSTM and Summed Bidirectional LSTM. The Concatenated type combines the outputs of the forward and backward LSTMs, effectively doubling the number of LSTM units for the next layer. The Summed type, on the other hand, adds the outputs together, keeping the number of LSTM units the same.<\/p>"},{"question":"What are some uses and challenges related to Bidirectional LSTM?","answer":"<p>Bidirectional LSTMs are widely used in Natural Language Processing (NLP) for tasks like sentiment analysis, text generation, machine translation, and speech recognition. They can also be applied to time series prediction and anomaly detection in sequences. However, they come with challenges such as increased computational complexity, risk of overfitting, and the requirement for the full sequence data, making them unsuitable for real-time applications.<\/p>"},{"question":"How do Bidirectional LSTM models compare with similar models?","answer":"<p>Compared to standard LSTM, Bidirectional LSTM offers a better understanding of the context but at the cost of increased complexity and a higher risk of overfitting. Compared to Gated Recurrent Units (GRU), they may offer better performance on long sequences but are more complex and may require more time to train.<\/p>"},{"question":"How can proxy servers be associated with Bidirectional LSTM?","answer":"<p>Proxy servers can be used in distributed training of Bidirectional LSTM models. These models require significant computational resources, and the workload can be distributed across multiple servers. Proxy servers can help manage this distribution, improve the speed of model training, and handle larger datasets effectively. They can also manage client requests, load balance, and ensure data security in a client-server architecture.<\/p>"}]},"_links":{"self":[{"href":"https:\/\/oneproxy.pro\/jp\/wp-json\/wp\/v2\/wiki\/476010","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/oneproxy.pro\/jp\/wp-json\/wp\/v2\/wiki"}],"about":[{"href":"https:\/\/oneproxy.pro\/jp\/wp-json\/wp\/v2\/types\/wiki"}],"version-history":[{"count":0,"href":"https:\/\/oneproxy.pro\/jp\/wp-json\/wp\/v2\/wiki\/476010\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/oneproxy.pro\/jp\/wp-json\/wp\/v2\/media\/467717"}],"wp:attachment":[{"href":"https:\/\/oneproxy.pro\/jp\/wp-json\/wp\/v2\/media?parent=476010"}],"curies":[{"name":"\u3046\u30fc\u3093","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}