{"id":477961,"date":"2023-08-09T09:23:08","date_gmt":"2023-08-09T09:23:08","guid":{"rendered":""},"modified":"2023-09-05T11:15:45","modified_gmt":"2023-09-05T11:15:45","slug":"mapreduce","status":"publish","type":"wiki","link":"https:\/\/oneproxy.pro\/jp\/wiki\/mapreduce\/","title":{"rendered":"MapReduce"},"content":{"rendered":"<p>MapReduce \u306f\u3001\u5206\u6563\u30b3\u30f3\u30d4\u30e5\u30fc\u30c6\u30a3\u30f3\u30b0\u74b0\u5883\u3067\u5927\u898f\u6a21\u306a\u30c7\u30fc\u30bf \u30bb\u30c3\u30c8\u3092\u51e6\u7406\u3059\u308b\u305f\u3081\u306b\u8a2d\u8a08\u3055\u308c\u305f\u30d7\u30ed\u30b0\u30e9\u30df\u30f3\u30b0 \u30e2\u30c7\u30eb\u304a\u3088\u3073\u8a08\u7b97\u30d5\u30ec\u30fc\u30e0\u30ef\u30fc\u30af\u3067\u3059\u3002\u30ef\u30fc\u30af\u30ed\u30fc\u30c9\u3092\u5c0f\u3055\u306a\u30bf\u30b9\u30af\u306b\u5206\u5272\u3057\u3001\u30b3\u30f3\u30d4\u30e5\u30fc\u30bf\u30fc \u30af\u30e9\u30b9\u30bf\u30fc\u5168\u4f53\u3067\u4e26\u5217\u306b\u5b9f\u884c\u3059\u308b\u3053\u3068\u3067\u3001\u5927\u91cf\u306e\u30c7\u30fc\u30bf\u3092\u52b9\u7387\u7684\u306b\u51e6\u7406\u3067\u304d\u307e\u3059\u3002MapReduce \u306f\u30d3\u30c3\u30b0 \u30c7\u30fc\u30bf\u306e\u4e16\u754c\u3067\u306f\u57fa\u672c\u7684\u306a\u30c4\u30fc\u30eb\u3068\u306a\u308a\u3001\u4f01\u696d\u3084\u7d44\u7e54\u304c\u81a8\u5927\u306a\u91cf\u306e\u60c5\u5831\u304b\u3089\u8cb4\u91cd\u306a\u6d1e\u5bdf\u3092\u5f15\u304d\u51fa\u3059\u3053\u3068\u3092\u53ef\u80fd\u306b\u3057\u307e\u3059\u3002<\/p>\n<h2>MapReduce\u306e\u8d77\u6e90\u3068\u305d\u306e\u6700\u521d\u306e\u8a00\u53ca\u306e\u6b74\u53f2<\/h2>\n<p>MapReduce \u306e\u6982\u5ff5\u306f\u3001Google \u306e Jeffrey Dean \u6c0f\u3068 Sanjay Ghemawat \u6c0f\u306b\u3088\u3063\u3066 2004 \u5e74\u306b\u767a\u8868\u3055\u308c\u305f\u300cMapReduce: Simplified Data Processing on Large Clusters\u300d\u3068\u3044\u3046\u72ec\u5275\u7684\u306a\u8ad6\u6587\u3067\u7d39\u4ecb\u3055\u308c\u307e\u3057\u305f\u3002\u3053\u306e\u8ad6\u6587\u3067\u306f\u3001\u5927\u898f\u6a21\u306a\u30c7\u30fc\u30bf\u51e6\u7406\u30bf\u30b9\u30af\u3092\u52b9\u7387\u7684\u304b\u3064\u78ba\u5b9f\u306b\u51e6\u7406\u3059\u308b\u305f\u3081\u306e\u5f37\u529b\u306a\u30a2\u30d7\u30ed\u30fc\u30c1\u304c\u6982\u8aac\u3055\u308c\u3066\u3044\u307e\u3059\u3002Google \u306f MapReduce \u3092\u4f7f\u7528\u3057\u3066 Web \u30c9\u30ad\u30e5\u30e1\u30f3\u30c8\u306e\u30a4\u30f3\u30c7\u30c3\u30af\u30b9\u4f5c\u6210\u3068\u51e6\u7406\u3092\u884c\u3044\u3001\u3088\u308a\u9ad8\u901f\u3067\u52b9\u679c\u7684\u306a\u691c\u7d22\u7d50\u679c\u3092\u5b9f\u73fe\u3057\u307e\u3057\u305f\u3002<\/p>\n<h2>MapReduce\u306b\u95a2\u3059\u308b\u8a73\u7d30\u60c5\u5831<\/h2>\n<p>MapReduce \u306f\u3001\u30de\u30c3\u30d7 \u30d5\u30a7\u30fc\u30ba\u3068\u524a\u6e1b\u30d5\u30a7\u30fc\u30ba\u3068\u3044\u3046 2 \u6bb5\u968e\u306e\u7c21\u5358\u306a\u30d7\u30ed\u30bb\u30b9\u306b\u5f93\u3044\u307e\u3059\u3002\u30de\u30c3\u30d7 \u30d5\u30a7\u30fc\u30ba\u3067\u306f\u3001\u5165\u529b\u30c7\u30fc\u30bf\u304c\u5c0f\u3055\u306a\u30c1\u30e3\u30f3\u30af\u306b\u5206\u5272\u3055\u308c\u3001\u30af\u30e9\u30b9\u30bf\u30fc\u5185\u306e\u8907\u6570\u306e\u30ce\u30fc\u30c9\u306b\u3088\u3063\u3066\u4e26\u5217\u51e6\u7406\u3055\u308c\u307e\u3059\u3002\u5404\u30ce\u30fc\u30c9\u306f\u3001\u4e2d\u9593\u51fa\u529b\u3068\u3057\u3066\u30ad\u30fc\u3068\u5024\u306e\u30da\u30a2\u3092\u751f\u6210\u3059\u308b\u30de\u30c3\u30d4\u30f3\u30b0\u95a2\u6570\u3092\u5b9f\u884c\u3057\u307e\u3059\u3002\u524a\u6e1b\u30d5\u30a7\u30fc\u30ba\u3067\u306f\u3001\u3053\u308c\u3089\u306e\u4e2d\u9593\u7d50\u679c\u304c\u30ad\u30fc\u306b\u57fa\u3065\u3044\u3066\u7d71\u5408\u3055\u308c\u3001\u6700\u7d42\u51fa\u529b\u304c\u5f97\u3089\u308c\u307e\u3059\u3002<\/p>\n<p>MapReduce \u306e\u512a\u308c\u305f\u70b9\u306f\u3001\u30d5\u30a9\u30fc\u30eb\u30c8 \u30c8\u30ec\u30e9\u30f3\u30b9\u3068\u30b9\u30b1\u30fc\u30e9\u30d3\u30ea\u30c6\u30a3\u306b\u3042\u308a\u307e\u3059\u3002\u30c7\u30fc\u30bf\u304c\u30ce\u30fc\u30c9\u9593\u3067\u8907\u88fd\u3055\u308c\u308b\u305f\u3081\u3001\u30cf\u30fc\u30c9\u30a6\u30a7\u30a2\u969c\u5bb3\u3092\u9069\u5207\u306b\u51e6\u7406\u3067\u304d\u3001\u30ce\u30fc\u30c9\u969c\u5bb3\u304c\u767a\u751f\u3057\u305f\u5834\u5408\u3067\u3082\u30c7\u30fc\u30bf\u306e\u53ef\u7528\u6027\u304c\u78ba\u4fdd\u3055\u308c\u307e\u3059\u3002<\/p>\n<h2>MapReduce \u306e\u5185\u90e8\u69cb\u9020: MapReduce \u306e\u4ed5\u7d44\u307f<\/h2>\n<p>MapReduce \u306e\u5185\u90e8\u306e\u4ed5\u7d44\u307f\u3092\u3088\u308a\u3088\u304f\u7406\u89e3\u3059\u308b\u305f\u3081\u306b\u3001\u30d7\u30ed\u30bb\u30b9\u3092\u6bb5\u968e\u7684\u306b\u5206\u89e3\u3057\u3066\u307f\u307e\u3057\u3087\u3046\u3002<\/p>\n<ol>\n<li>\n<p>\u5165\u529b\u5206\u5272: \u5165\u529b\u30c7\u30fc\u30bf\u306f\u3001\u5165\u529b\u5206\u5272\u3068\u547c\u3070\u308c\u308b\u3001\u7ba1\u7406\u3057\u3084\u3059\u3044\u5c0f\u3055\u306a\u30c1\u30e3\u30f3\u30af\u306b\u5206\u5272\u3055\u308c\u307e\u3059\u3002\u5404\u5165\u529b\u5206\u5272\u306f\u3001\u4e26\u5217\u51e6\u7406\u306e\u305f\u3081\u306b\u30de\u30c3\u30d1\u30fc\u306b\u5272\u308a\u5f53\u3066\u3089\u308c\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p>\u30de\u30c3\u30d4\u30f3\u30b0: \u30de\u30c3\u30d1\u30fc\u306f\u5165\u529b\u5206\u5272\u3092\u51e6\u7406\u3057\u3001\u4e2d\u9593\u51fa\u529b\u3068\u3057\u3066\u30ad\u30fc\u3068\u5024\u306e\u30da\u30a2\u3092\u751f\u6210\u3057\u307e\u3059\u3002\u3053\u3053\u3067\u3001\u30c7\u30fc\u30bf\u5909\u63db\u3068\u30d5\u30a3\u30eb\u30bf\u30ea\u30f3\u30b0\u304c\u884c\u308f\u308c\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p>\u30b7\u30e3\u30c3\u30d5\u30eb\u3068\u30bd\u30fc\u30c8: \u4e2d\u9593\u306e\u30ad\u30fc\u3068\u5024\u306e\u30da\u30a2\u306f\u30ad\u30fc\u306b\u57fa\u3065\u3044\u3066\u30b0\u30eb\u30fc\u30d7\u5316\u3055\u308c\u3001\u30bd\u30fc\u30c8\u3055\u308c\u3001\u540c\u3058\u30ad\u30fc\u3092\u6301\u3064\u3059\u3079\u3066\u306e\u5024\u304c\u540c\u3058\u30ea\u30c7\u30e5\u30fc\u30b5\u30fc\u306b\u914d\u7f6e\u3055\u308c\u308b\u3088\u3046\u306b\u306a\u308a\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p>\u524a\u6e1b: \u5404\u30ea\u30c7\u30e5\u30fc\u30b5\u30fc\u306f\u4e2d\u9593\u30ad\u30fc\u3068\u5024\u306e\u30da\u30a2\u306e\u30b5\u30d6\u30bb\u30c3\u30c8\u3092\u53d7\u3051\u53d6\u308a\u3001\u524a\u6e1b\u95a2\u6570\u3092\u5b9f\u884c\u3057\u3066\u540c\u3058\u30ad\u30fc\u3092\u6301\u3064\u30c7\u30fc\u30bf\u3092\u7d50\u5408\u304a\u3088\u3073\u96c6\u7d04\u3057\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p>\u6700\u7d42\u51fa\u529b: \u30ea\u30c7\u30e5\u30fc\u30b5\u30fc\u306f\u6700\u7d42\u51fa\u529b\u3092\u751f\u6210\u3057\u307e\u3059\u3002\u3053\u306e\u51fa\u529b\u306f\u4fdd\u5b58\u3057\u305f\u308a\u3001\u3055\u3089\u306b\u5206\u6790\u3059\u308b\u305f\u3081\u306b\u4f7f\u7528\u3057\u305f\u308a\u3067\u304d\u307e\u3059\u3002<\/p>\n<\/li>\n<\/ol>\n<h2>MapReduce\u306e\u4e3b\u8981\u6a5f\u80fd\u306e\u5206\u6790<\/h2>\n<p>MapReduce \u306b\u306f\u3001\u5927\u898f\u6a21\u30c7\u30fc\u30bf\u51e6\u7406\u306e\u305f\u3081\u306e\u5f37\u529b\u306a\u30c4\u30fc\u30eb\u3068\u306a\u308b\u3044\u304f\u3064\u304b\u306e\u91cd\u8981\u306a\u6a5f\u80fd\u304c\u3042\u308a\u307e\u3059\u3002<\/p>\n<ul>\n<li>\n<p>\u30b9\u30b1\u30fc\u30e9\u30d3\u30ea\u30c6\u30a3: MapReduce \u306f\u3001\u5206\u6563\u3055\u308c\u305f\u30de\u30b7\u30f3 \u30af\u30e9\u30b9\u30bf\u30fc\u306e\u8a08\u7b97\u80fd\u529b\u3092\u6d3b\u7528\u3057\u3066\u3001\u5927\u898f\u6a21\u306a\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\u3092\u52b9\u7387\u7684\u306b\u51e6\u7406\u3067\u304d\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p>\u30d5\u30a9\u30fc\u30eb\u30c8 \u30c8\u30ec\u30e9\u30f3\u30b9: \u30c7\u30fc\u30bf\u3092\u8907\u88fd\u3057\u3001\u5931\u6557\u3057\u305f\u30bf\u30b9\u30af\u3092\u4ed6\u306e\u5229\u7528\u53ef\u80fd\u306a\u30ce\u30fc\u30c9\u3067\u518d\u5b9f\u884c\u3059\u308b\u3053\u3068\u3067\u3001\u30ce\u30fc\u30c9\u969c\u5bb3\u3084\u30c7\u30fc\u30bf\u640d\u5931\u306b\u5bfe\u51e6\u3067\u304d\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p>\u67d4\u8edf\u6027: MapReduce \u306f\u3001\u3055\u307e\u3056\u307e\u306a\u30c7\u30fc\u30bf\u51e6\u7406\u30bf\u30b9\u30af\u306b\u9069\u7528\u3067\u304d\u3001\u7279\u5b9a\u306e\u8981\u4ef6\u306b\u5408\u308f\u305b\u3066\u30ab\u30b9\u30bf\u30de\u30a4\u30ba\u3067\u304d\u308b\u3001\u6c4e\u7528\u6027\u306e\u9ad8\u3044\u30d5\u30ec\u30fc\u30e0\u30ef\u30fc\u30af\u3067\u3059\u3002<\/p>\n<\/li>\n<li>\n<p>\u7c21\u7d20\u5316\u3055\u308c\u305f\u30d7\u30ed\u30b0\u30e9\u30df\u30f3\u30b0 \u30e2\u30c7\u30eb: \u958b\u767a\u8005\u306f\u3001\u4f4e\u30ec\u30d9\u30eb\u306e\u4e26\u5217\u5316\u3084\u5206\u6563\u306e\u8907\u96d1\u3055\u3092\u6c17\u306b\u3059\u308b\u3053\u3068\u306a\u304f\u3001\u30de\u30c3\u30d7\u6a5f\u80fd\u3068\u524a\u6e1b\u6a5f\u80fd\u306b\u96c6\u4e2d\u3067\u304d\u307e\u3059\u3002<\/p>\n<\/li>\n<\/ul>\n<h2>MapReduce\u306e\u7a2e\u985e<\/h2>\n<p>MapReduce \u306e\u5b9f\u88c5\u306f\u3001\u57fa\u76e4\u3068\u306a\u308b\u30b7\u30b9\u30c6\u30e0\u306b\u3088\u3063\u3066\u7570\u306a\u308b\u5834\u5408\u304c\u3042\u308a\u307e\u3059\u3002\u4ee5\u4e0b\u306b\u3001MapReduce \u306e\u4e00\u822c\u7684\u306a\u30bf\u30a4\u30d7\u3092\u3044\u304f\u3064\u304b\u793a\u3057\u307e\u3059\u3002<\/p>\n<table>\n<thead>\n<tr>\n<th>\u30bf\u30a4\u30d7<\/th>\n<th>\u8aac\u660e<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Hadoop MapReduce<\/td>\n<td>Apache Hadoop \u30a8\u30b3\u30b7\u30b9\u30c6\u30e0\u306e\u4e00\u90e8\u3067\u3042\u308b\u3001\u30aa\u30ea\u30b8\u30ca\u30eb\u3067\u6700\u3082\u3088\u304f\u77e5\u3089\u308c\u3066\u3044\u308b\u5b9f\u88c5\u3002<\/td>\n<\/tr>\n<tr>\n<td>Google\u30af\u30e9\u30a6\u30c9<\/td>\n<td>Google Cloud \u306f\u3001Google Cloud Dataflow \u306e\u4e00\u90e8\u3068\u3057\u3066\u72ec\u81ea\u306e MapReduce \u30b5\u30fc\u30d3\u30b9\u3092\u63d0\u4f9b\u3057\u3066\u3044\u307e\u3059\u3002<\/td>\n<\/tr>\n<tr>\n<td>\u30a2\u30d1\u30c3\u30c1\u30b9\u30d1\u30fc\u30af<\/td>\n<td>Hadoop MapReduce \u306e\u4ee3\u66ff\u3068\u3057\u3066\u3001Apache Spark \u306f\u3088\u308a\u9ad8\u901f\u306a\u30c7\u30fc\u30bf\u51e6\u7406\u6a5f\u80fd\u3092\u63d0\u4f9b\u3057\u307e\u3059\u3002<\/td>\n<\/tr>\n<tr>\n<td>\u30de\u30a4\u30af\u30ed\u30bd\u30d5\u30c8 HDInsight<\/td>\n<td>MapReduce \u51e6\u7406\u306e\u30b5\u30dd\u30fc\u30c8\u3092\u542b\u3080\u3001Microsoft \u306e\u30af\u30e9\u30a6\u30c9\u30d9\u30fc\u30b9\u306e Hadoop \u30b5\u30fc\u30d3\u30b9\u3002<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<h2>MapReduce\u306e\u4f7f\u3044\u65b9\u3001\u4f7f\u7528\u4e0a\u306e\u554f\u984c\u3068\u305d\u306e\u89e3\u6c7a\u7b56<\/h2>\n<p>MapReduce \u306f\u3001\u6b21\u306e\u3088\u3046\u306a\u3055\u307e\u3056\u307e\u306a\u5206\u91ce\u3067\u5fdc\u7528\u3055\u308c\u3066\u3044\u307e\u3059\u3002<\/p>\n<ol>\n<li>\n<p><strong>\u30c7\u30fc\u30bf\u5206\u6790<\/strong>: \u30ed\u30b0\u51e6\u7406\u3001\u611f\u60c5\u5206\u6790\u3001\u9867\u5ba2\u884c\u52d5\u5206\u6790\u306a\u3069\u3001\u5927\u898f\u6a21\u306a\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\u306b\u5bfe\u3057\u3066\u8907\u96d1\u306a\u30c7\u30fc\u30bf\u5206\u6790\u30bf\u30b9\u30af\u3092\u5b9f\u884c\u3057\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u30b5\u30fc\u30c1\u30a8\u30f3\u30b8\u30f3<\/strong>: \u691c\u7d22\u30a8\u30f3\u30b8\u30f3\u3092\u5f37\u5316\u3057\u3066\u3001\u5927\u91cf\u306e Web \u30c9\u30ad\u30e5\u30e1\u30f3\u30c8\u304b\u3089\u95a2\u9023\u3059\u308b\u7d50\u679c\u3092\u52b9\u7387\u7684\u306b\u30a4\u30f3\u30c7\u30c3\u30af\u30b9\u3057\u3001\u53d6\u5f97\u3067\u304d\u308b\u3088\u3046\u306b\u3057\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u6a5f\u68b0\u5b66\u7fd2<\/strong>: \u5927\u898f\u6a21\u306a\u6a5f\u68b0\u5b66\u7fd2\u30e2\u30c7\u30eb\u306e\u30c8\u30ec\u30fc\u30cb\u30f3\u30b0\u3068\u51e6\u7406\u306b MapReduce \u3092\u6d3b\u7528\u3057\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u30ec\u30b3\u30e1\u30f3\u30c7\u30fc\u30b7\u30e7\u30f3\u30b7\u30b9\u30c6\u30e0<\/strong>: \u30e6\u30fc\u30b6\u30fc\u306e\u597d\u307f\u306b\u57fa\u3065\u3044\u3066\u30d1\u30fc\u30bd\u30ca\u30e9\u30a4\u30ba\u3055\u308c\u305f\u63a8\u5968\u30b7\u30b9\u30c6\u30e0\u3092\u69cb\u7bc9\u3057\u307e\u3059\u3002<\/p>\n<\/li>\n<\/ol>\n<p>MapReduce \u306b\u306f\u591a\u304f\u306e\u5229\u70b9\u304c\u3042\u308a\u307e\u3059\u304c\u3001\u8ab2\u984c\u304c\u306a\u3044\u308f\u3051\u3067\u306f\u3042\u308a\u307e\u305b\u3093\u3002<\/p>\n<ul>\n<li>\n<p><strong>\u30c7\u30fc\u30bf\u30b9\u30ad\u30e5\u30fc<\/strong>: \u30ea\u30c7\u30e5\u30fc\u30b5\u30fc\u9593\u306e\u30c7\u30fc\u30bf\u5206\u6563\u304c\u4e0d\u5747\u8861\u3060\u3068\u3001\u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9\u306e\u554f\u984c\u304c\u767a\u751f\u3059\u308b\u53ef\u80fd\u6027\u304c\u3042\u308a\u307e\u3059\u3002\u30c7\u30fc\u30bf \u30d1\u30fc\u30c6\u30a3\u30b7\u30e7\u30cb\u30f3\u30b0\u3084\u30b3\u30f3\u30d0\u30a4\u30ca\u30fc\u306a\u3069\u306e\u624b\u6cd5\u306f\u3001\u3053\u306e\u554f\u984c\u3092\u8efd\u6e1b\u3059\u308b\u306e\u306b\u5f79\u7acb\u3061\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u30b8\u30e7\u30d6\u306e\u30b9\u30b1\u30b8\u30e5\u30fc\u30eb\u8a2d\u5b9a<\/strong>: \u30af\u30e9\u30b9\u30bf\u30fc \u30ea\u30bd\u30fc\u30b9\u3092\u6700\u9069\u306b\u6d3b\u7528\u3059\u308b\u305f\u3081\u306b\u30b8\u30e7\u30d6\u3092\u52b9\u7387\u7684\u306b\u30b9\u30b1\u30b8\u30e5\u30fc\u30eb\u3059\u308b\u3053\u3068\u306f\u3001\u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9\u306b\u3068\u3063\u3066\u4e0d\u53ef\u6b20\u3067\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u30c7\u30a3\u30b9\u30afI\/O<\/strong>: \u30c7\u30a3\u30b9\u30af I\/O \u304c\u591a\u3059\u304e\u308b\u3068\u30dc\u30c8\u30eb\u30cd\u30c3\u30af\u306b\u306a\u308b\u53ef\u80fd\u6027\u304c\u3042\u308a\u307e\u3059\u3002\u3053\u306e\u554f\u984c\u306f\u3001\u30ad\u30e3\u30c3\u30b7\u30e5\u3001\u5727\u7e2e\u3001\u304a\u3088\u3073\u3088\u308a\u9ad8\u901f\u306a\u30b9\u30c8\u30ec\u30fc\u30b8\u306e\u4f7f\u7528\u306b\u3088\u3063\u3066\u89e3\u6c7a\u3067\u304d\u307e\u3059\u3002<\/p>\n<\/li>\n<\/ul>\n<h2>\u4e3b\u306a\u7279\u5fb4\u3068\u985e\u4f3c\u7528\u8a9e\u3068\u306e\u6bd4\u8f03<\/h2>\n<table>\n<thead>\n<tr>\n<th>\u7279\u6027<\/th>\n<th>MapReduce<\/th>\n<th>\u30cf\u30c9\u30a5\u30fc\u30d7<\/th>\n<th>\u30b9\u30d1\u30fc\u30af<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>\u30c7\u30fc\u30bf\u51e6\u7406\u30e2\u30c7\u30eb<\/td>\n<td>\u30d0\u30c3\u30c1\u51e6\u7406<\/td>\n<td>\u30d0\u30c3\u30c1\u51e6\u7406<\/td>\n<td>\u30a4\u30f3\u30e1\u30e2\u30ea\u51e6\u7406<\/td>\n<\/tr>\n<tr>\n<td>\u30c7\u30fc\u30bf\u30b9\u30c8\u30ec\u30fc\u30b8<\/td>\n<td>HDFS (Hadoop \u5206\u6563\u30d5\u30a1\u30a4\u30eb\u30b7\u30b9\u30c6\u30e0)<\/td>\n<td>HDFS (Hadoop \u5206\u6563\u30d5\u30a1\u30a4\u30eb\u30b7\u30b9\u30c6\u30e0)<\/td>\n<td>HDFS\u304a\u3088\u3073\u305d\u306e\u4ed6\u306e\u30b9\u30c8\u30ec\u30fc\u30b8<\/td>\n<\/tr>\n<tr>\n<td>\u30d5\u30a9\u30fc\u30eb\u30c8\u30c8\u30ec\u30e9\u30f3\u30b9<\/td>\n<td>\u306f\u3044<\/td>\n<td>\u306f\u3044<\/td>\n<td>\u306f\u3044<\/td>\n<\/tr>\n<tr>\n<td>\u51e6\u7406\u901f\u5ea6<\/td>\n<td>\u9069\u5ea6<\/td>\n<td>\u9069\u5ea6<\/td>\n<td>\u9ad8\u3044<\/td>\n<\/tr>\n<tr>\n<td>\u4f7f\u3044\u3084\u3059\u3055<\/td>\n<td>\u9069\u5ea6<\/td>\n<td>\u9069\u5ea6<\/td>\n<td>\u7c21\u5358<\/td>\n<\/tr>\n<tr>\n<td>\u4f7f\u7528\u4e8b\u4f8b<\/td>\n<td>\u5927\u898f\u6a21\u30d0\u30c3\u30c1\u51e6\u7406<\/td>\n<td>\u5927\u898f\u6a21\u30c7\u30fc\u30bf\u51e6\u7406<\/td>\n<td>\u30ea\u30a2\u30eb\u30bf\u30a4\u30e0\u30c7\u30fc\u30bf\u5206\u6790<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<h2>MapReduce\u306b\u95a2\u3059\u308b\u5c06\u6765\u306e\u5c55\u671b\u3068\u6280\u8853<\/h2>\n<p>\u30d3\u30c3\u30b0 \u30c7\u30fc\u30bf\u306e\u5206\u91ce\u304c\u9032\u5316\u3059\u308b\u306b\u3064\u308c\u3066\u3001\u7279\u5b9a\u306e\u30e6\u30fc\u30b9 \u30b1\u30fc\u30b9\u3067 MapReduce \u3092\u88dc\u5b8c\u307e\u305f\u306f\u7f6e\u304d\u63db\u3048\u308b\u65b0\u3057\u3044\u30c6\u30af\u30ce\u30ed\u30b8\u304c\u767b\u5834\u3057\u3066\u3044\u307e\u3059\u3002\u6ce8\u76ee\u3059\u3079\u304d\u30c8\u30ec\u30f3\u30c9\u3068\u30c6\u30af\u30ce\u30ed\u30b8\u306b\u306f\u6b21\u306e\u3082\u306e\u304c\u3042\u308a\u307e\u3059\u3002<\/p>\n<ol>\n<li>\n<p><strong>\u30a2\u30d1\u30c3\u30c1\u30d5\u30ea\u30f3\u30af<\/strong>Flink \u306f\u3001\u4f4e\u30ec\u30a4\u30c6\u30f3\u30b7\u3067\u9ad8\u30b9\u30eb\u30fc\u30d7\u30c3\u30c8\u306e\u30c7\u30fc\u30bf\u51e6\u7406\u3092\u63d0\u4f9b\u3059\u308b\u30aa\u30fc\u30d7\u30f3\u30bd\u30fc\u30b9\u306e\u30b9\u30c8\u30ea\u30fc\u30e0\u51e6\u7406\u30d5\u30ec\u30fc\u30e0\u30ef\u30fc\u30af\u3067\u3042\u308a\u3001\u30ea\u30a2\u30eb\u30bf\u30a4\u30e0\u306e\u30c7\u30fc\u30bf\u5206\u6790\u306b\u9069\u3057\u3066\u3044\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u30a2\u30d1\u30c3\u30c1\u30d3\u30fc\u30e0<\/strong>: Apache Beam \u306f\u3001\u30d0\u30c3\u30c1\u51e6\u7406\u3068\u30b9\u30c8\u30ea\u30fc\u30e0\u51e6\u7406\u306e\u4e21\u65b9\u306b\u7d71\u4e00\u3055\u308c\u305f\u30d7\u30ed\u30b0\u30e9\u30df\u30f3\u30b0 \u30e2\u30c7\u30eb\u3092\u63d0\u4f9b\u3057\u3001\u3055\u307e\u3056\u307e\u306a\u5b9f\u884c\u30a8\u30f3\u30b8\u30f3\u9593\u3067\u306e\u67d4\u8edf\u6027\u3068\u79fb\u690d\u6027\u3092\u5b9f\u73fe\u3057\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u30b5\u30fc\u30d0\u30fc\u30ec\u30b9\u30b3\u30f3\u30d4\u30e5\u30fc\u30c6\u30a3\u30f3\u30b0<\/strong>AWS Lambda \u3084 Google Cloud Functions \u306a\u3069\u306e\u30b5\u30fc\u30d0\u30fc\u30ec\u30b9 \u30a2\u30fc\u30ad\u30c6\u30af\u30c1\u30e3\u306f\u3001\u30a4\u30f3\u30d5\u30e9\u30b9\u30c8\u30e9\u30af\u30c1\u30e3\u3092\u660e\u793a\u7684\u306b\u7ba1\u7406\u3059\u308b\u5fc5\u8981\u306a\u304f\u3001\u30b3\u30b9\u30c8\u52b9\u7387\u304c\u9ad8\u304f\u30b9\u30b1\u30fc\u30e9\u30d6\u30eb\u306a\u65b9\u6cd5\u3067\u30c7\u30fc\u30bf\u3092\u51e6\u7406\u3057\u307e\u3059\u3002<\/p>\n<\/li>\n<\/ol>\n<h2>\u30d7\u30ed\u30ad\u30b7\u30b5\u30fc\u30d0\u30fc\u3092MapReduce\u3067\u4f7f\u7528\u3059\u308b\u65b9\u6cd5\u3084MapReduce\u3068\u95a2\u9023\u4ed8\u3051\u308b\u65b9\u6cd5<\/h2>\n<p>\u30d7\u30ed\u30ad\u30b7 \u30b5\u30fc\u30d0\u30fc\u306f\u3001\u7279\u306b\u5927\u898f\u6a21\u306a\u30a2\u30d7\u30ea\u30b1\u30fc\u30b7\u30e7\u30f3\u306b\u304a\u3044\u3066\u3001\u30a4\u30f3\u30bf\u30fc\u30cd\u30c3\u30c8 \u30c8\u30e9\u30d5\u30a3\u30c3\u30af\u306e\u7ba1\u7406\u3068\u6700\u9069\u5316\u306b\u304a\u3044\u3066\u91cd\u8981\u306a\u5f79\u5272\u3092\u679c\u305f\u3057\u307e\u3059\u3002MapReduce \u306e\u30b3\u30f3\u30c6\u30ad\u30b9\u30c8\u3067\u306f\u3001\u30d7\u30ed\u30ad\u30b7 \u30b5\u30fc\u30d0\u30fc\u306f\u3044\u304f\u3064\u304b\u306e\u65b9\u6cd5\u3067\u5229\u7528\u3067\u304d\u307e\u3059\u3002<\/p>\n<ol>\n<li>\n<p><strong>\u30ed\u30fc\u30c9\u30d0\u30e9\u30f3\u30b7\u30f3\u30b0<\/strong>: \u30d7\u30ed\u30ad\u30b7 \u30b5\u30fc\u30d0\u30fc\u306f\u3001\u53d7\u4fe1\u3057\u305f MapReduce \u30b8\u30e7\u30d6\u8981\u6c42\u3092\u30b5\u30fc\u30d0\u30fc\u306e\u30af\u30e9\u30b9\u30bf\u30fc\u5168\u4f53\u306b\u5206\u6563\u3057\u3001\u30b3\u30f3\u30d4\u30e5\u30fc\u30c6\u30a3\u30f3\u30b0 \u30ea\u30bd\u30fc\u30b9\u3092\u52b9\u7387\u7684\u306b\u5229\u7528\u3067\u304d\u308b\u3088\u3046\u306b\u3057\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u30ad\u30e3\u30c3\u30b7\u30f3\u30b0<\/strong>: \u30d7\u30ed\u30ad\u30b7 \u30b5\u30fc\u30d0\u30fc\u306f\u4e2d\u9593 MapReduce \u7d50\u679c\u3092\u30ad\u30e3\u30c3\u30b7\u30e5\u3067\u304d\u308b\u305f\u3081\u3001\u5197\u9577\u306a\u8a08\u7b97\u304c\u524a\u6e1b\u3055\u308c\u3001\u5168\u4f53\u7684\u306a\u51e6\u7406\u901f\u5ea6\u304c\u5411\u4e0a\u3057\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u5b89\u5168<\/strong>: \u30d7\u30ed\u30ad\u30b7 \u30b5\u30fc\u30d0\u30fc\u306f\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3 \u30ec\u30a4\u30e4\u30fc\u3068\u3057\u3066\u6a5f\u80fd\u3057\u3001\u30ce\u30fc\u30c9\u9593\u306e\u30c7\u30fc\u30bf \u30c8\u30e9\u30d5\u30a3\u30c3\u30af\u3092\u30d5\u30a3\u30eb\u30bf\u30ea\u30f3\u30b0\u304a\u3088\u3073\u76e3\u8996\u3057\u3066\u3001\u4e0d\u6b63\u30a2\u30af\u30bb\u30b9\u3084\u6f5c\u5728\u7684\u306a\u653b\u6483\u3092\u9632\u6b62\u3057\u307e\u3059\u3002<\/p>\n<\/li>\n<\/ol>\n<h2>\u95a2\u9023\u30ea\u30f3\u30af<\/h2>\n<p>MapReduce \u306e\u8a73\u7d30\u306b\u3064\u3044\u3066\u306f\u3001\u6b21\u306e\u30ea\u30bd\u30fc\u30b9\u3092\u53c2\u7167\u3057\u3066\u304f\u3060\u3055\u3044\u3002<\/p>\n<ol>\n<li><a href=\"https:\/\/research.google\/pubs\/pub62\/\" target=\"_new\" rel=\"noopener nofollow\">MapReduce: \u5927\u898f\u6a21\u30af\u30e9\u30b9\u30bf\u3067\u306e\u7c21\u7d20\u5316\u3055\u308c\u305f\u30c7\u30fc\u30bf\u51e6\u7406<\/a><\/li>\n<li><a href=\"https:\/\/hadoop.apache.org\/\" target=\"_new\" rel=\"noopener nofollow\">\u30a2\u30d1\u30c3\u30c1\u30fb\u30cf\u30c9\u30a5\u30fc\u30d7<\/a><\/li>\n<li><a href=\"https:\/\/spark.apache.org\/\" target=\"_new\" rel=\"noopener nofollow\">\u30a2\u30d1\u30c3\u30c1\u30b9\u30d1\u30fc\u30af<\/a><\/li>\n<li><a href=\"https:\/\/flink.apache.org\/\" target=\"_new\" rel=\"noopener nofollow\">\u30a2\u30d1\u30c3\u30c1\u30d5\u30ea\u30f3\u30af<\/a><\/li>\n<li><a href=\"https:\/\/beam.apache.org\/\" target=\"_new\" rel=\"noopener nofollow\">\u30a2\u30d1\u30c3\u30c1\u30d3\u30fc\u30e0<\/a><\/li>\n<\/ol>\n<p>\u7d50\u8ad6\u3068\u3057\u3066\u3001MapReduce \u306f\u5927\u898f\u6a21\u30c7\u30fc\u30bf\u306e\u51e6\u7406\u3068\u5206\u6790\u306e\u65b9\u6cd5\u306b\u9769\u547d\u3092\u3082\u305f\u3089\u3057\u3001\u4f01\u696d\u304c\u81a8\u5927\u306a\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\u304b\u3089\u8cb4\u91cd\u306a\u6d1e\u5bdf\u3092\u5f97\u3089\u308c\u308b\u3088\u3046\u306b\u306a\u308a\u307e\u3057\u305f\u3002\u30d5\u30a9\u30fc\u30eb\u30c8 \u30c8\u30ec\u30e9\u30f3\u30b9\u3001\u30b9\u30b1\u30fc\u30e9\u30d3\u30ea\u30c6\u30a3\u3001\u67d4\u8edf\u6027\u3092\u5099\u3048\u305f MapReduce \u306f\u3001\u30d3\u30c3\u30b0 \u30c7\u30fc\u30bf\u6642\u4ee3\u306e\u5f37\u529b\u306a\u30c4\u30fc\u30eb\u3067\u3042\u308a\u7d9a\u3051\u3066\u3044\u307e\u3059\u3002\u30c7\u30fc\u30bf\u51e6\u7406\u306e\u74b0\u5883\u304c\u9032\u5316\u3059\u308b\u306b\u3064\u308c\u3066\u3001\u30c7\u30fc\u30bf\u99c6\u52d5\u578b\u30bd\u30ea\u30e5\u30fc\u30b7\u30e7\u30f3\u306e\u53ef\u80fd\u6027\u3092\u6700\u5927\u9650\u306b\u5f15\u304d\u51fa\u3059\u306b\u306f\u3001\u65b0\u3057\u3044\u30c6\u30af\u30ce\u30ed\u30b8\u30fc\u3092\u5e38\u306b\u628a\u63e1\u3057\u3066\u304a\u304f\u3053\u3068\u304c\u4e0d\u53ef\u6b20\u3067\u3059\u3002<\/p>","protected":false},"featured_media":468863,"menu_order":0,"template":"","meta":{"_acf_changed":false,"content-type":"","inline_featured_image":false,"footnotes":""},"class_list":["post-477961","wiki","type-wiki","status-publish","has-post-thumbnail","hentry"],"acf":{"faq_title":"Frequently Asked Questions about <mark>MapReduce: A Comprehensive Guide<\/mark>","faq_items":[{"question":"What is MapReduce and how does it work?","answer":"<p>MapReduce is a programming model and computational framework used for processing large-scale data sets in a distributed computing environment. It divides the data processing task into two steps: the map phase and the reduce phase. In the map phase, the input data is processed in parallel by multiple nodes, generating key-value pairs as intermediate output. The reduce phase then consolidates and aggregates the intermediate results based on their keys to produce the final output.<\/p>"},{"question":"How did MapReduce originate?","answer":"<p>The concept of MapReduce was introduced by Jeffrey Dean and Sanjay Ghemawat at Google in their 2004 paper titled \"MapReduce: Simplified Data Processing on Large Clusters.\" It was initially utilized by Google to index and process web documents for more efficient search results.<\/p>"},{"question":"What are the key features of MapReduce?","answer":"<p>MapReduce offers several essential features, including scalability to handle massive datasets, fault tolerance to handle node failures, flexibility for various data processing tasks, and a simplified programming model for developers.<\/p>"},{"question":"What are the different types of MapReduce implementations?","answer":"<p>Some popular types of MapReduce implementations are Hadoop MapReduce, Google Cloud Dataflow, Apache Spark, and Microsoft HDInsight.<\/p>"},{"question":"How is MapReduce used in practice?","answer":"<p>MapReduce finds applications in various domains, such as data analysis, search engines, machine learning, and recommendation systems. It allows businesses to process and analyze large-scale data efficiently.<\/p>"},{"question":"What challenges are associated with using MapReduce?","answer":"<p>Common challenges with MapReduce include data skew, efficient job scheduling, and disk I\/O bottlenecks. Proper techniques like data partitioning and combiners can address these issues.<\/p>"},{"question":"What are the future perspectives and technologies related to MapReduce?","answer":"<p>As big data technology evolves, new technologies like Apache Flink, Apache Beam, and serverless computing are emerging to complement or replace MapReduce for specific use cases.<\/p>"},{"question":"How can proxy servers enhance MapReduce performance?","answer":"<p>Proxy servers can play a vital role in managing and optimizing MapReduce jobs by providing load balancing, caching intermediate results, and adding an extra layer of security for data traffic between nodes.<\/p>"}]},"_links":{"self":[{"href":"https:\/\/oneproxy.pro\/jp\/wp-json\/wp\/v2\/wiki\/477961","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/oneproxy.pro\/jp\/wp-json\/wp\/v2\/wiki"}],"about":[{"href":"https:\/\/oneproxy.pro\/jp\/wp-json\/wp\/v2\/types\/wiki"}],"version-history":[{"count":0,"href":"https:\/\/oneproxy.pro\/jp\/wp-json\/wp\/v2\/wiki\/477961\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/oneproxy.pro\/jp\/wp-json\/wp\/v2\/media\/468863"}],"wp:attachment":[{"href":"https:\/\/oneproxy.pro\/jp\/wp-json\/wp\/v2\/media?parent=477961"}],"curies":[{"name":"\u3046\u30fc\u3093","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}