{"id":475879,"date":"2023-08-09T07:24:43","date_gmt":"2023-08-09T07:24:43","guid":{"rendered":""},"modified":"2023-09-05T11:11:30","modified_gmt":"2023-09-05T11:11:30","slug":"apache-pig","status":"publish","type":"wiki","link":"https:\/\/oneproxy.pro\/jp\/wiki\/apache-pig\/","title":{"rendered":"\u30a2\u30d1\u30c3\u30c1\u30d4\u30c3\u30b0"},"content":{"rendered":"<p>Apache Pig \u306f\u3001\u5206\u6563\u30b3\u30f3\u30d4\u30e5\u30fc\u30c6\u30a3\u30f3\u30b0\u74b0\u5883\u3067\u306e\u5927\u898f\u6a21\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\u306e\u51e6\u7406\u3092\u5bb9\u6613\u306b\u3059\u308b\u30aa\u30fc\u30d7\u30f3\u30bd\u30fc\u30b9 \u30d7\u30e9\u30c3\u30c8\u30d5\u30a9\u30fc\u30e0\u3067\u3059\u3002Yahoo! \u306b\u3088\u3063\u3066\u958b\u767a\u3055\u308c\u3001\u5f8c\u306b Apache Software Foundation \u306b\u63d0\u4f9b\u3055\u308c\u3001Apache Hadoop \u30a8\u30b3\u30b7\u30b9\u30c6\u30e0\u306e\u4e00\u90e8\u3068\u306a\u308a\u307e\u3057\u305f\u3002Apache Pig \u306f\u3001\u8907\u96d1\u306a\u30c7\u30fc\u30bf\u51e6\u7406\u30bf\u30b9\u30af\u3092\u62bd\u8c61\u5316\u3059\u308b Pig Latin \u3068\u547c\u3070\u308c\u308b\u9ad8\u6c34\u6e96\u8a00\u8a9e\u3092\u63d0\u4f9b\u3057\u3001\u958b\u767a\u8005\u304c\u30c7\u30fc\u30bf\u5909\u63db\u30d1\u30a4\u30d7\u30e9\u30a4\u30f3\u3092\u8a18\u8ff0\u3057\u3001\u5927\u898f\u6a21\u306a\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\u3092\u5206\u6790\u3057\u3084\u3059\u304f\u3057\u307e\u3059\u3002<\/p>\n<h2>\u30a2\u30d1\u30c3\u30c1\u30fb\u30d4\u30c3\u30b0\u306e\u6b74\u53f2\u3068\u305d\u306e\u6700\u521d\u306e\u8a00\u53ca<\/h2>\n<p>Apache Pig \u306e\u8d77\u6e90\u306f\u3001Yahoo! \u3067\u884c\u308f\u308c\u305f\u7814\u7a76\u306b\u9061\u308a\u307e\u3059\u3002 2006 \u5e74\u9803\u3002Yahoo! \u306e\u30c1\u30fc\u30e0\u306f\u3001\u81a8\u5927\u306a\u91cf\u306e\u30c7\u30fc\u30bf\u3092\u52b9\u7387\u7684\u306b\u51e6\u7406\u3059\u308b\u969b\u306e\u8ab2\u984c\u3092\u8a8d\u8b58\u3057\u3001Hadoop \u3067\u306e\u30c7\u30fc\u30bf\u64cd\u4f5c\u3092\u7c21\u7d20\u5316\u3059\u308b\u30c4\u30fc\u30eb\u306e\u958b\u767a\u3092\u6a21\u7d22\u3057\u307e\u3057\u305f\u3002\u3053\u308c\u304c\u3001Hadoop \u30d9\u30fc\u30b9\u306e\u30c7\u30fc\u30bf\u51e6\u7406\u7528\u306b\u7279\u5225\u306b\u8a2d\u8a08\u3055\u308c\u305f\u30b9\u30af\u30ea\u30d7\u30c8\u8a00\u8a9e\u3067\u3042\u308b Pig Latin \u306e\u4f5c\u6210\u306b\u3064\u306a\u304c\u308a\u307e\u3057\u305f\u3002 2007\u5e74\u306bYahoo!\u306f Apache Pig \u3092\u30aa\u30fc\u30d7\u30f3\u30bd\u30fc\u30b9 \u30d7\u30ed\u30b8\u30a7\u30af\u30c8\u3068\u3057\u3066\u30ea\u30ea\u30fc\u30b9\u3057\u3001\u5f8c\u306b Apache Software Foundation \u306b\u63a1\u7528\u3055\u308c\u307e\u3057\u305f\u3002<\/p>\n<h2>Apache Pig \u306e\u8a73\u7d30\u60c5\u5831<\/h2>\n<p>Apache Pig \u306f\u3001Apache Hadoop \u30af\u30e9\u30b9\u30bf\u30fc\u4e0a\u306e\u30c7\u30fc\u30bf\u3092\u51e6\u7406\u304a\u3088\u3073\u5206\u6790\u3059\u308b\u305f\u3081\u306e\u9ad8\u30ec\u30d9\u30eb\u306e\u30d7\u30e9\u30c3\u30c8\u30d5\u30a9\u30fc\u30e0\u3092\u63d0\u4f9b\u3059\u308b\u3053\u3068\u3092\u76ee\u7684\u3068\u3057\u3066\u3044\u307e\u3059\u3002Apache Pig \u306e\u4e3b\u306a\u30b3\u30f3\u30dd\u30fc\u30cd\u30f3\u30c8\u306f\u6b21\u306e\u3068\u304a\u308a\u3067\u3059\u3002<\/p>\n<ol>\n<li>\n<p><strong>\u8c5a\u306e\u30e9\u30c6\u30f3\u8a9e:<\/strong> \u3053\u308c\u306f\u3001\u8907\u96d1\u306a Hadoop MapReduce \u30bf\u30b9\u30af\u3092\u30b7\u30f3\u30d7\u30eb\u3067\u7406\u89e3\u3057\u3084\u3059\u3044\u64cd\u4f5c\u306b\u62bd\u8c61\u5316\u3059\u308b\u30c7\u30fc\u30bf \u30d5\u30ed\u30fc\u8a00\u8a9e\u3067\u3059\u3002 Pig Latin \u3092\u4f7f\u7528\u3059\u308b\u3068\u3001\u958b\u767a\u8005\u306f\u30c7\u30fc\u30bf\u5909\u63db\u3068\u5206\u6790\u3092\u7c21\u6f54\u306a\u65b9\u6cd5\u3067\u8868\u73fe\u3057\u3001Hadoop \u306e\u6839\u5e95\u306b\u3042\u308b\u8907\u96d1\u3055\u3092\u96a0\u3059\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u5b9f\u884c\u74b0\u5883:<\/strong> Apache Pig \u306f\u3001\u30ed\u30fc\u30ab\u30eb \u30e2\u30fc\u30c9\u3068 Hadoop \u30e2\u30fc\u30c9\u306e\u4e21\u65b9\u3092\u30b5\u30dd\u30fc\u30c8\u3057\u307e\u3059\u3002\u30ed\u30fc\u30ab\u30eb \u30e2\u30fc\u30c9\u3067\u306f\u3001\u5358\u4e00\u306e\u30de\u30b7\u30f3\u4e0a\u3067\u5b9f\u884c\u3055\u308c\u308b\u305f\u3081\u3001\u30c6\u30b9\u30c8\u3068\u30c7\u30d0\u30c3\u30b0\u306b\u6700\u9069\u3067\u3059\u3002 Hadoop \u30e2\u30fc\u30c9\u3067\u306f\u3001Hadoop \u30af\u30e9\u30b9\u30bf\u30fc\u306e\u80fd\u529b\u3092\u5229\u7528\u3057\u3066\u5927\u898f\u6a21\u306a\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\u3092\u5206\u6563\u51e6\u7406\u3057\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u6700\u9069\u5316\u624b\u6cd5:<\/strong> Pig \u306f\u3001Pig Latin \u30b9\u30af\u30ea\u30d7\u30c8\u306e\u5b9f\u884c\u30d7\u30e9\u30f3\u3092\u81ea\u52d5\u7684\u306b\u6700\u9069\u5316\u3059\u308b\u3053\u3068\u3067\u3001\u30c7\u30fc\u30bf\u51e6\u7406\u30ef\u30fc\u30af\u30d5\u30ed\u30fc\u3092\u6700\u9069\u5316\u3057\u307e\u3059\u3002\u3053\u308c\u306b\u3088\u308a\u3001\u30ea\u30bd\u30fc\u30b9\u304c\u52b9\u7387\u7684\u306b\u4f7f\u7528\u3055\u308c\u3001\u51e6\u7406\u6642\u9593\u304c\u77ed\u7e2e\u3055\u308c\u307e\u3059\u3002<\/p>\n<\/li>\n<\/ol>\n<h2>Apache Pig \u306e\u5185\u90e8\u69cb\u9020\u3068\u305d\u306e\u4ed5\u7d44\u307f<\/h2>\n<p>Apache Pig \u306f\u3001Pig Latin \u30b9\u30af\u30ea\u30d7\u30c8\u3092\u5b9f\u884c\u3059\u308b\u305f\u3081\u306b\u3044\u304f\u3064\u304b\u306e\u30b9\u30c6\u30c3\u30d7\u3092\u542b\u3080\u591a\u6bb5\u968e\u30c7\u30fc\u30bf\u51e6\u7406\u30e2\u30c7\u30eb\u306b\u5f93\u3044\u307e\u3059\u3002<\/p>\n<ol>\n<li>\n<p><strong>\u89e3\u6790\u4e2d:<\/strong> Pig Latin \u30b9\u30af\u30ea\u30d7\u30c8\u304c\u9001\u4fe1\u3055\u308c\u308b\u3068\u3001Pig \u30b3\u30f3\u30d1\u30a4\u30e9\u30fc\u306f\u305d\u308c\u3092\u89e3\u6790\u3057\u3066\u62bd\u8c61\u69cb\u6587\u30c4\u30ea\u30fc (AST) \u3092\u4f5c\u6210\u3057\u307e\u3059\u3002\u3053\u306e AST \u306f\u3001\u30c7\u30fc\u30bf\u5909\u63db\u306e\u8ad6\u7406\u8a08\u753b\u3092\u8868\u3057\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u8ad6\u7406\u7684\u306a\u6700\u9069\u5316:<\/strong> \u8ad6\u7406\u30aa\u30d7\u30c6\u30a3\u30de\u30a4\u30b6\u30fc\u306f AST \u3092\u5206\u6790\u3057\u3001\u3055\u307e\u3056\u307e\u306a\u6700\u9069\u5316\u624b\u6cd5\u3092\u9069\u7528\u3057\u3066\u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9\u3092\u5411\u4e0a\u3055\u305b\u3001\u5197\u9577\u306a\u64cd\u4f5c\u3092\u524a\u6e1b\u3057\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u7269\u7406\u8a08\u753b\u306e\u751f\u6210:<\/strong> \u8ad6\u7406\u7684\u306a\u6700\u9069\u5316\u306e\u5f8c\u3001Pig \u306f\u8ad6\u7406\u8a08\u753b\u306b\u57fa\u3065\u3044\u3066\u7269\u7406\u7684\u306a\u5b9f\u884c\u8a08\u753b\u3092\u751f\u6210\u3057\u307e\u3059\u3002\u7269\u7406\u8a08\u753b\u306f\u3001Hadoop \u30af\u30e9\u30b9\u30bf\u30fc\u4e0a\u3067\u30c7\u30fc\u30bf\u5909\u63db\u304c\u3069\u306e\u3088\u3046\u306b\u5b9f\u884c\u3055\u308c\u308b\u304b\u3092\u5b9a\u7fa9\u3057\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>MapReduce \u306e\u5b9f\u884c:<\/strong> \u751f\u6210\u3055\u308c\u305f\u7269\u7406\u8a08\u753b\u306f\u3001\u4e00\u9023\u306e MapReduce \u30b8\u30e7\u30d6\u306b\u5909\u63db\u3055\u308c\u307e\u3059\u3002\u3053\u308c\u3089\u306e\u30b8\u30e7\u30d6\u306f\u3001\u5206\u6563\u51e6\u7406\u306e\u305f\u3081\u306b Hadoop \u30af\u30e9\u30b9\u30bf\u30fc\u306b\u9001\u4fe1\u3055\u308c\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u7d50\u679c\u306e\u53ce\u96c6:<\/strong> MapReduce \u30b8\u30e7\u30d6\u304c\u5b8c\u4e86\u3059\u308b\u3068\u3001\u7d50\u679c\u304c\u53ce\u96c6\u3055\u308c\u3001\u30e6\u30fc\u30b6\u30fc\u306b\u8fd4\u3055\u308c\u307e\u3059\u3002<\/p>\n<\/li>\n<\/ol>\n<h2>Apache Pig \u306e\u4e3b\u306a\u6a5f\u80fd\u306e\u5206\u6790<\/h2>\n<p>Apache Pig \u306f\u3001\u30d3\u30c3\u30b0 \u30c7\u30fc\u30bf\u51e6\u7406\u3067\u4eba\u6c17\u306e\u3042\u308b\u9078\u629e\u80a2\u3068\u306a\u308b\u3044\u304f\u3064\u304b\u306e\u91cd\u8981\u306a\u6a5f\u80fd\u3092\u63d0\u4f9b\u3057\u307e\u3059\u3002<\/p>\n<ol>\n<li>\n<p><strong>\u62bd\u8c61\u5316:<\/strong> Pig Latin \u306f Hadoop \u3068 MapReduce \u306e\u8907\u96d1\u3055\u3092\u62bd\u8c61\u5316\u3057\u3001\u958b\u767a\u8005\u304c\u5b9f\u88c5\u306e\u8a73\u7d30\u3067\u306f\u306a\u304f\u30c7\u30fc\u30bf\u51e6\u7406\u30ed\u30b8\u30c3\u30af\u306b\u96c6\u4e2d\u3067\u304d\u308b\u3088\u3046\u306b\u3057\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u62e1\u5f35\u6027:<\/strong> Pig \u3092\u4f7f\u7528\u3059\u308b\u3068\u3001\u958b\u767a\u8005\u306f Java\u3001Python\u3001\u307e\u305f\u306f\u305d\u306e\u4ed6\u306e\u8a00\u8a9e\u3067\u30e6\u30fc\u30b6\u30fc\u5b9a\u7fa9\u95a2\u6570 (UDF) \u3092\u4f5c\u6210\u3067\u304d\u308b\u305f\u3081\u3001Pig \u306e\u6a5f\u80fd\u304c\u62e1\u5f35\u3055\u308c\u3001\u30ab\u30b9\u30bf\u30e0 \u30c7\u30fc\u30bf\u51e6\u7406\u30bf\u30b9\u30af\u304c\u5bb9\u6613\u306b\u306a\u308a\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u30b9\u30ad\u30fc\u30de\u306e\u67d4\u8edf\u6027:<\/strong> \u5f93\u6765\u306e\u30ea\u30ec\u30fc\u30b7\u30e7\u30ca\u30eb \u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u3068\u306f\u7570\u306a\u308a\u3001Pig \u306f\u53b3\u5bc6\u306a\u30b9\u30ad\u30fc\u30de\u3092\u5f37\u5236\u3057\u306a\u3044\u305f\u3081\u3001\u534a\u69cb\u9020\u5316\u30c7\u30fc\u30bf\u304a\u3088\u3073\u975e\u69cb\u9020\u5316\u30c7\u30fc\u30bf\u306e\u51e6\u7406\u306b\u9069\u3057\u3066\u3044\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u30b3\u30df\u30e5\u30cb\u30c6\u30a3\u30b5\u30dd\u30fc\u30c8:<\/strong> Pig \u306f Apache \u30a8\u30b3\u30b7\u30b9\u30c6\u30e0\u306e\u4e00\u90e8\u3067\u3042\u308b\u305f\u3081\u3001\u5927\u898f\u6a21\u3067\u6d3b\u767a\u306a\u958b\u767a\u8005\u30b3\u30df\u30e5\u30cb\u30c6\u30a3\u306e\u6069\u6075\u3092\u53d7\u3051\u3001\u7d99\u7d9a\u7684\u306a\u30b5\u30dd\u30fc\u30c8\u3068\u7d99\u7d9a\u7684\u306a\u6539\u5584\u3092\u4fdd\u8a3c\u3057\u307e\u3059\u3002<\/p>\n<\/li>\n<\/ol>\n<h2>Apache Pig \u306e\u7a2e\u985e<\/h2>\n<p>Apache Pig \u306f\u4e3b\u306b 2 \u7a2e\u985e\u306e\u30c7\u30fc\u30bf\u3092\u63d0\u4f9b\u3057\u307e\u3059\u3002<\/p>\n<ol>\n<li>\n<p><strong>\u30ea\u30ec\u30fc\u30b7\u30e7\u30ca\u30eb\u30c7\u30fc\u30bf:<\/strong> Apache Pig \u306f\u3001\u5f93\u6765\u306e\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9 \u30c6\u30fc\u30d6\u30eb\u3068\u540c\u69d8\u306b\u3001\u69cb\u9020\u5316\u30c7\u30fc\u30bf\u3092\u51e6\u7406\u3067\u304d\u307e\u3059\u3002 <code data-no-translation=\"\">RELATION<\/code> \u30c7\u30fc\u30bf\u30fb\u30bf\u30a4\u30d7\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u30cd\u30b9\u30c8\u3055\u308c\u305f\u30c7\u30fc\u30bf:<\/strong> Pig \u306f\u3001JSON \u3084 XML \u306a\u3069\u306e\u534a\u69cb\u9020\u5316\u30c7\u30fc\u30bf\u3092\u30b5\u30dd\u30fc\u30c8\u3057\u307e\u3059\u3002 <code data-no-translation=\"\">BAG<\/code>, <code data-no-translation=\"\">TUPLE<\/code>\u3001 \u305d\u3057\u3066 <code data-no-translation=\"\">MAP<\/code> \u5165\u308c\u5b50\u69cb\u9020\u3092\u8868\u3059\u30c7\u30fc\u30bf\u578b\u3002<\/p>\n<\/li>\n<\/ol>\n<p>Apache Pig \u306e\u30c7\u30fc\u30bf\u578b\u3092\u307e\u3068\u3081\u305f\u8868\u306f\u6b21\u306e\u3068\u304a\u308a\u3067\u3059\u3002<\/p>\n<table>\n<thead>\n<tr>\n<th>\u30c7\u30fc\u30bf\u30fb\u30bf\u30a4\u30d7<\/th>\n<th>\u8aac\u660e<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td><code data-no-translation=\"\">int<\/code><\/td>\n<td>\u6574\u6570<\/td>\n<\/tr>\n<tr>\n<td><code data-no-translation=\"\">long<\/code><\/td>\n<td>\u9577\u6574\u6570<\/td>\n<\/tr>\n<tr>\n<td><code data-no-translation=\"\">float<\/code><\/td>\n<td>\u5358\u7cbe\u5ea6\u6d6e\u52d5\u5c0f\u6570\u70b9\u6570<\/td>\n<\/tr>\n<tr>\n<td><code data-no-translation=\"\">double<\/code><\/td>\n<td>\u500d\u7cbe\u5ea6\u6d6e\u52d5\u5c0f\u6570\u70b9\u6570<\/td>\n<\/tr>\n<tr>\n<td><code data-no-translation=\"\">chararray<\/code><\/td>\n<td>\u6587\u5b57\u914d\u5217\uff08\u6587\u5b57\u5217\uff09<\/td>\n<\/tr>\n<tr>\n<td><code data-no-translation=\"\">bytearray<\/code><\/td>\n<td>\u30d0\u30a4\u30c8\u914d\u5217\uff08\u30d0\u30a4\u30ca\u30ea\u30c7\u30fc\u30bf\uff09<\/td>\n<\/tr>\n<tr>\n<td><code data-no-translation=\"\">boolean<\/code><\/td>\n<td>\u30d6\u30fc\u30eb\u5024 (true\/false)<\/td>\n<\/tr>\n<tr>\n<td><code data-no-translation=\"\">datetime<\/code><\/td>\n<td>\u65e5\u6642<\/td>\n<\/tr>\n<tr>\n<td><code data-no-translation=\"\">RELATION<\/code><\/td>\n<td>\u69cb\u9020\u5316\u30c7\u30fc\u30bf\u3092\u8868\u3057\u307e\u3059 (\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u306b\u4f3c\u3066\u3044\u307e\u3059)<\/td>\n<\/tr>\n<tr>\n<td><code data-no-translation=\"\">BAG<\/code><\/td>\n<td>\u30bf\u30d7\u30eb\u306e\u30b3\u30ec\u30af\u30b7\u30e7\u30f3 (\u5165\u308c\u5b50\u69cb\u9020) \u3092\u8868\u3057\u307e\u3059\u3002<\/td>\n<\/tr>\n<tr>\n<td><code data-no-translation=\"\">TUPLE<\/code><\/td>\n<td>\u30d5\u30a3\u30fc\u30eb\u30c9\u3092\u6301\u3064\u30ec\u30b3\u30fc\u30c9\uff08\u30bf\u30d7\u30eb\uff09\u3092\u8868\u3057\u307e\u3059<\/td>\n<\/tr>\n<tr>\n<td><code data-no-translation=\"\">MAP<\/code><\/td>\n<td>\u30ad\u30fc\u3068\u5024\u306e\u30da\u30a2\u3092\u8868\u3057\u307e\u3059<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<h2>Apache Pig \u306e\u4f7f\u7528\u65b9\u6cd5\u3001\u554f\u984c\u3068\u305d\u306e\u89e3\u6c7a\u7b56<\/h2>\n<p>Apache Pig \u306f\u3001\u6b21\u306e\u3088\u3046\u306a\u3055\u307e\u3056\u307e\u306a\u30b7\u30ca\u30ea\u30aa\u3067\u5e83\u304f\u4f7f\u7528\u3055\u308c\u3066\u3044\u307e\u3059\u3002<\/p>\n<ol>\n<li>\n<p><strong>ETL (\u62bd\u51fa\u3001\u5909\u63db\u3001\u30ed\u30fc\u30c9):<\/strong> Pig \u306f\u3001ETL \u30d7\u30ed\u30bb\u30b9\u306e\u30c7\u30fc\u30bf\u6e96\u5099\u30bf\u30b9\u30af\u306b\u3088\u304f\u4f7f\u7528\u3055\u308c\u307e\u3059\u3002ETL \u30d7\u30ed\u30bb\u30b9\u3067\u306f\u3001\u8907\u6570\u306e\u30bd\u30fc\u30b9\u304b\u3089\u30c7\u30fc\u30bf\u3092\u62bd\u51fa\u3057\u3001\u76ee\u7684\u306e\u5f62\u5f0f\u306b\u5909\u63db\u3057\u3066\u304b\u3089\u3001\u30c7\u30fc\u30bf \u30a6\u30a7\u30a2\u30cf\u30a6\u30b9\u307e\u305f\u306f\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u306b\u30ed\u30fc\u30c9\u3057\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u30c7\u30fc\u30bf\u5206\u6790\uff1a<\/strong> Pig \u306f\u3001\u30e6\u30fc\u30b6\u30fc\u304c\u81a8\u5927\u306a\u91cf\u306e\u30c7\u30fc\u30bf\u3092\u52b9\u7387\u7684\u306b\u51e6\u7406\u304a\u3088\u3073\u5206\u6790\u3067\u304d\u308b\u3088\u3046\u306b\u3059\u308b\u3053\u3068\u3067\u30c7\u30fc\u30bf\u5206\u6790\u3092\u5bb9\u6613\u306b\u3057\u3001\u30d3\u30b8\u30cd\u30b9 \u30a4\u30f3\u30c6\u30ea\u30b8\u30a7\u30f3\u30b9\u3084\u30c7\u30fc\u30bf \u30de\u30a4\u30cb\u30f3\u30b0 \u30bf\u30b9\u30af\u306b\u9069\u3057\u305f\u3082\u306e\u306b\u3057\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u30c7\u30fc\u30bf\u30af\u30ec\u30f3\u30b8\u30f3\u30b0:<\/strong> Pig \u306f\u3001\u751f\u30c7\u30fc\u30bf\u306e\u30af\u30ea\u30fc\u30f3\u30a2\u30c3\u30d7\u3068\u524d\u51e6\u7406\u3001\u6b20\u640d\u5024\u306e\u51e6\u7406\u3001\u7121\u95a2\u4fc2\u306a\u30c7\u30fc\u30bf\u306e\u9664\u53bb\u3001\u30c7\u30fc\u30bf\u306e\u9069\u5207\u306a\u5f62\u5f0f\u3078\u306e\u5909\u63db\u306b\u4f7f\u7528\u3067\u304d\u307e\u3059\u3002<\/p>\n<\/li>\n<\/ol>\n<p>Apache Pig \u306e\u4f7f\u7528\u4e2d\u306b\u30e6\u30fc\u30b6\u30fc\u304c\u906d\u9047\u3059\u308b\u53ef\u80fd\u6027\u306e\u3042\u308b\u8ab2\u984c\u306f\u6b21\u306e\u3068\u304a\u308a\u3067\u3059\u3002<\/p>\n<ol>\n<li>\n<p><strong>\u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9\u306e\u554f\u984c\uff1a<\/strong> \u975e\u52b9\u7387\u7684\u306a Pig Latin \u30b9\u30af\u30ea\u30d7\u30c8\u3092\u4f7f\u7528\u3059\u308b\u3068\u3001\u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9\u304c\u6700\u9069\u5316\u3055\u308c\u306a\u3044\u53ef\u80fd\u6027\u304c\u3042\u308a\u307e\u3059\u3002\u9069\u5207\u306a\u6700\u9069\u5316\u3068\u52b9\u7387\u7684\u306a\u30a2\u30eb\u30b4\u30ea\u30ba\u30e0\u8a2d\u8a08\u306f\u3001\u3053\u306e\u554f\u984c\u3092\u89e3\u6c7a\u3059\u308b\u306e\u306b\u5f79\u7acb\u3061\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u8907\u96d1\u306a\u30d1\u30a4\u30d7\u30e9\u30a4\u30f3\u306e\u30c7\u30d0\u30c3\u30b0:<\/strong> \u8907\u96d1\u306a\u30c7\u30fc\u30bf\u5909\u63db\u30d1\u30a4\u30d7\u30e9\u30a4\u30f3\u306e\u30c7\u30d0\u30c3\u30b0\u306f\u56f0\u96e3\u306a\u5834\u5408\u304c\u3042\u308a\u307e\u3059\u3002 Pig \u306e\u30ed\u30fc\u30ab\u30eb \u30e2\u30fc\u30c9\u3092\u30c6\u30b9\u30c8\u3068\u30c7\u30d0\u30c3\u30b0\u306b\u6d3b\u7528\u3059\u308b\u3068\u3001\u554f\u984c\u306e\u7279\u5b9a\u3068\u89e3\u6c7a\u306b\u5f79\u7acb\u3061\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u30c7\u30fc\u30bf\u306e\u504f\u308a:<\/strong> \u4e00\u90e8\u306e\u30c7\u30fc\u30bf \u30d1\u30fc\u30c6\u30a3\u30b7\u30e7\u30f3\u304c\u4ed6\u306e\u30c7\u30fc\u30bf \u30d1\u30fc\u30c6\u30a3\u30b7\u30e7\u30f3\u3088\u308a\u3082\u5927\u5e45\u306b\u5927\u304d\u3044\u30c7\u30fc\u30bf \u30b9\u30ad\u30e5\u30fc\u306f\u3001Hadoop \u30af\u30e9\u30b9\u30bf\u30fc\u3067\u8ca0\u8377\u306e\u4e0d\u5747\u8861\u3092\u5f15\u304d\u8d77\u3053\u3059\u53ef\u80fd\u6027\u304c\u3042\u308a\u307e\u3059\u3002\u30c7\u30fc\u30bf\u306e\u518d\u5206\u5272\u3084\u7d50\u5408\u5668\u306e\u4f7f\u7528\u306a\u3069\u306e\u624b\u6cd5\u306b\u3088\u308a\u3001\u3053\u306e\u554f\u984c\u3092\u8efd\u6e1b\u3067\u304d\u307e\u3059\u3002<\/p>\n<\/li>\n<\/ol>\n<h2>\u4e3b\u306a\u7279\u5fb4\u3068\u985e\u4f3c\u7528\u8a9e\u3068\u306e\u6bd4\u8f03<\/h2>\n<table>\n<thead>\n<tr>\n<th>\u7279\u5fb4<\/th>\n<th>\u30a2\u30d1\u30c3\u30c1\u30d4\u30c3\u30b0<\/th>\n<th>\u30a2\u30d1\u30c3\u30c1\u30cf\u30a4\u30d6<\/th>\n<th>\u30a2\u30d1\u30c3\u30c1\u30b9\u30d1\u30fc\u30af<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>\u51e6\u7406\u30e2\u30c7\u30eb<\/td>\n<td>\u624b\u7d9a\u304d\u578b (\u8c5a\u30e9\u30c6\u30f3\u8a9e)<\/td>\n<td>\u5ba3\u8a00\u578b (Hive QL)<\/td>\n<td>\u30a4\u30f3\u30e1\u30e2\u30ea\u51e6\u7406\uff08RDD\uff09<\/td>\n<\/tr>\n<tr>\n<td>\u4f7f\u7528\u4e8b\u4f8b<\/td>\n<td>\u30c7\u30fc\u30bf\u5909\u63db<\/td>\n<td>\u30c7\u30fc\u30bf\u30a6\u30a7\u30a2\u30cf\u30a6\u30b8\u30f3\u30b0<\/td>\n<td>\u60c5\u5831\u51e6\u7406<\/td>\n<\/tr>\n<tr>\n<td>\u8a00\u8a9e\u30b5\u30dd\u30fc\u30c8<\/td>\n<td>Pig Latin\u3001\u30e6\u30fc\u30b6\u30fc\u5b9a\u7fa9\u95a2\u6570 (Java\/Python)<\/td>\n<td>Hive QL\u3001\u30e6\u30fc\u30b6\u30fc\u5b9a\u7fa9\u95a2\u6570 (Java)<\/td>\n<td>Spark SQL\u3001Scala\u3001Java\u3001Python<\/td>\n<\/tr>\n<tr>\n<td>\u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9<\/td>\n<td>\u30d0\u30c3\u30c1\u51e6\u7406\u306b\u9069\u3057\u3066\u3044\u307e\u3059<\/td>\n<td>\u30d0\u30c3\u30c1\u51e6\u7406\u306b\u9069\u3057\u3066\u3044\u307e\u3059<\/td>\n<td>\u30a4\u30f3\u30e1\u30e2\u30ea\u306e\u30ea\u30a2\u30eb\u30bf\u30a4\u30e0\u51e6\u7406<\/td>\n<\/tr>\n<tr>\n<td>Hadoop\u3068\u306e\u7d71\u5408<\/td>\n<td>\u306f\u3044<\/td>\n<td>\u306f\u3044<\/td>\n<td>\u306f\u3044<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<h2>Apache Pig \u306b\u95a2\u9023\u3059\u308b\u5c55\u671b\u3068\u5c06\u6765\u306e\u30c6\u30af\u30ce\u30ed\u30b8\u30fc<\/h2>\n<p>Apache Pig \u306f\u3001\u30d3\u30c3\u30b0 \u30c7\u30fc\u30bf\u51e6\u7406\u306b\u3068\u3063\u3066\u95a2\u9023\u6027\u304c\u3042\u308a\u4fa1\u5024\u306e\u3042\u308b\u30c4\u30fc\u30eb\u3067\u3042\u308a\u7d9a\u3051\u3066\u3044\u307e\u3059\u3002\u30c6\u30af\u30ce\u30ed\u30b8\u304c\u9032\u6b69\u3059\u308b\u306b\u3064\u308c\u3066\u3001\u3044\u304f\u3064\u304b\u306e\u30c8\u30ec\u30f3\u30c9\u3068\u958b\u767a\u304c\u305d\u306e\u5c06\u6765\u306b\u5f71\u97ff\u3092\u4e0e\u3048\u308b\u53ef\u80fd\u6027\u304c\u3042\u308a\u307e\u3059\u3002<\/p>\n<ol>\n<li>\n<p><strong>\u30ea\u30a2\u30eb\u30bf\u30a4\u30e0\u51e6\u7406:<\/strong> Pig \u306f\u30d0\u30c3\u30c1\u51e6\u7406\u306b\u512a\u308c\u3066\u3044\u307e\u3059\u304c\u3001\u5c06\u6765\u306e\u30d0\u30fc\u30b8\u30e7\u30f3\u306b\u306f\u30ea\u30a2\u30eb\u30bf\u30a4\u30e0\u51e6\u7406\u6a5f\u80fd\u304c\u7d44\u307f\u8fbc\u307e\u308c\u3001\u30ea\u30a2\u30eb\u30bf\u30a4\u30e0 \u30c7\u30fc\u30bf\u5206\u6790\u306e\u9700\u8981\u306b\u5bfe\u5fdc\u3059\u308b\u53ef\u80fd\u6027\u304c\u3042\u308a\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u4ed6\u306e Apache \u30d7\u30ed\u30b8\u30a7\u30af\u30c8\u3068\u306e\u7d71\u5408:<\/strong> Pig \u306f\u3001\u30b9\u30c8\u30ea\u30fc\u30df\u30f3\u30b0\u304a\u3088\u3073\u7d71\u5408\u30d0\u30c3\u30c1\/\u30b9\u30c8\u30ea\u30fc\u30df\u30f3\u30b0\u51e6\u7406\u6a5f\u80fd\u3092\u6d3b\u7528\u3059\u308b\u305f\u3081\u306b\u3001Apache Flink \u3084 Apache Beam \u306a\u3069\u306e\u4ed6\u306e Apache \u30d7\u30ed\u30b8\u30a7\u30af\u30c8\u3068\u306e\u7d71\u5408\u3092\u5f37\u5316\u3059\u308b\u53ef\u80fd\u6027\u304c\u3042\u308a\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u5f37\u5316\u3055\u308c\u305f\u6700\u9069\u5316:<\/strong> Pig \u306e\u6700\u9069\u5316\u6280\u8853\u3092\u6539\u5584\u3059\u308b\u305f\u3081\u306e\u7d99\u7d9a\u7684\u306a\u53d6\u308a\u7d44\u307f\u306b\u3088\u308a\u3001\u30c7\u30fc\u30bf\u51e6\u7406\u304c\u3055\u3089\u306b\u9ad8\u901f\u304b\u3064\u52b9\u7387\u7684\u306b\u884c\u308f\u308c\u308b\u53ef\u80fd\u6027\u304c\u3042\u308a\u307e\u3059\u3002<\/p>\n<\/li>\n<\/ol>\n<h2>\u30d7\u30ed\u30ad\u30b7 \u30b5\u30fc\u30d0\u30fc\u306e\u4f7f\u7528\u65b9\u6cd5\u307e\u305f\u306f Apache Pig \u3068\u306e\u95a2\u9023\u4ed8\u3051\u65b9\u6cd5<\/h2>\n<p>\u30d7\u30ed\u30ad\u30b7 \u30b5\u30fc\u30d0\u30fc\u306f\u3001Apache Pig \u3092\u3055\u307e\u3056\u307e\u306a\u76ee\u7684\u3067\u4f7f\u7528\u3059\u308b\u5834\u5408\u306b\u6709\u76ca\u3067\u3059\u3002<\/p>\n<ol>\n<li>\n<p><strong>\u30c7\u30fc\u30bf\u53ce\u96c6\uff1a<\/strong> \u30d7\u30ed\u30ad\u30b7 \u30b5\u30fc\u30d0\u30fc\u306f\u3001Pig \u30b9\u30af\u30ea\u30d7\u30c8\u3068\u5916\u90e8 Web \u30b5\u30fc\u30d0\u30fc\u9593\u306e\u4ef2\u4ecb\u5f79\u3068\u3057\u3066\u52d5\u4f5c\u3059\u308b\u3053\u3068\u3067\u3001\u30a4\u30f3\u30bf\u30fc\u30cd\u30c3\u30c8\u304b\u3089\u30c7\u30fc\u30bf\u3092\u53ce\u96c6\u3059\u308b\u306e\u306b\u5f79\u7acb\u3061\u307e\u3059\u3002\u3053\u308c\u306f\u3001Web \u30b9\u30af\u30ec\u30a4\u30d4\u30f3\u30b0\u3084\u30c7\u30fc\u30bf\u53ce\u96c6\u30bf\u30b9\u30af\u306b\u7279\u306b\u5f79\u7acb\u3061\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u30ad\u30e3\u30c3\u30b7\u30e5\u3068\u9ad8\u901f\u5316:<\/strong> \u30d7\u30ed\u30ad\u30b7 \u30b5\u30fc\u30d0\u30fc\u306f\u983b\u7e41\u306b\u30a2\u30af\u30bb\u30b9\u3055\u308c\u308b\u30c7\u30fc\u30bf\u3092\u30ad\u30e3\u30c3\u30b7\u30e5\u3067\u304d\u308b\u305f\u3081\u3001\u5197\u9577\u306a\u51e6\u7406\u306e\u5fc5\u8981\u6027\u304c\u6e1b\u308a\u3001Pig \u30b8\u30e7\u30d6\u306e\u30c7\u30fc\u30bf\u53d6\u5f97\u304c\u9ad8\u901f\u5316\u3055\u308c\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u533f\u540d\u6027\u3068\u30d7\u30e9\u30a4\u30d0\u30b7\u30fc:<\/strong> \u30d7\u30ed\u30ad\u30b7 \u30b5\u30fc\u30d0\u30fc\u306f\u3001Pig \u30b8\u30e7\u30d6\u306e\u30bd\u30fc\u30b9\u3092\u30de\u30b9\u30af\u3059\u308b\u3053\u3068\u3067\u533f\u540d\u6027\u3092\u63d0\u4f9b\u3057\u3001\u30c7\u30fc\u30bf\u51e6\u7406\u4e2d\u306e\u30d7\u30e9\u30a4\u30d0\u30b7\u30fc\u3068\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3\u3092\u78ba\u4fdd\u3067\u304d\u307e\u3059\u3002<\/p>\n<\/li>\n<\/ol>\n<h2>\u95a2\u9023\u30ea\u30f3\u30af<\/h2>\n<p>Apache Pig \u306b\u3064\u3044\u3066\u3055\u3089\u306b\u8a73\u3057\u304f\u77e5\u308b\u306b\u306f\u3001\u6b21\u306e\u8cb4\u91cd\u306a\u30ea\u30bd\u30fc\u30b9\u3092\u53c2\u7167\u3057\u3066\u304f\u3060\u3055\u3044\u3002<\/p>\n<ul>\n<li><a href=\"https:\/\/pig.apache.org\/\" target=\"_new\" rel=\"noopener nofollow\">\u30a2\u30d1\u30c3\u30c1\u30d4\u30c3\u30b0\u516c\u5f0f\u30a6\u30a7\u30d6\u30b5\u30a4\u30c8<\/a><\/li>\n<li><a href=\"https:\/\/cwiki.apache.org\/confluence\/display\/PIG\/Index\" target=\"_new\" rel=\"noopener nofollow\">Apache Pig Wiki<\/a><\/li>\n<li><a href=\"https:\/\/www.tutorialspoint.com\/apache_pig\/index.htm\" target=\"_new\" rel=\"noopener nofollow\">Apache Pig \u30c1\u30e5\u30fc\u30c8\u30ea\u30a2\u30eb<\/a><\/li>\n<li><a href=\"https:\/\/www.apache.org\/\" target=\"_new\" rel=\"noopener nofollow\">Apache \u30bd\u30d5\u30c8\u30a6\u30a7\u30a2\u8ca1\u56e3<\/a><\/li>\n<\/ul>\n<p>\u30d3\u30c3\u30b0 \u30c7\u30fc\u30bf\u51e6\u7406\u7528\u306e\u591a\u76ee\u7684\u30c4\u30fc\u30eb\u3067\u3042\u308b Apache Pig \u306f\u3001Hadoop \u30a8\u30b3\u30b7\u30b9\u30c6\u30e0\u5185\u3067\u52b9\u7387\u7684\u306a\u30c7\u30fc\u30bf\u64cd\u4f5c\u3068\u5206\u6790\u3092\u6c42\u3081\u308b\u4f01\u696d\u3084\u30c7\u30fc\u30bf\u611b\u597d\u5bb6\u306b\u3068\u3063\u3066\u3001\u4f9d\u7136\u3068\u3057\u3066\u4e0d\u53ef\u6b20\u306a\u8cc7\u7523\u3067\u3059\u3002\u7d99\u7d9a\u7684\u306a\u958b\u767a\u3068\u65b0\u8208\u6280\u8853\u3068\u306e\u7d71\u5408\u306b\u3088\u308a\u3001Pig \u306f\u9032\u5316\u3057\u7d9a\u3051\u308b\u30d3\u30c3\u30b0 \u30c7\u30fc\u30bf\u51e6\u7406\u306e\u5206\u91ce\u3067\u3082\u5f15\u304d\u7d9a\u304d\u91cd\u8981\u306a\u5b58\u5728\u3067\u3042\u308a\u7d9a\u3051\u307e\u3059\u3002<\/p>","protected":false},"featured_media":467618,"menu_order":0,"template":"","meta":{"_acf_changed":false,"content-type":"","inline_featured_image":false,"footnotes":""},"class_list":["post-475879","wiki","type-wiki","status-publish","has-post-thumbnail","hentry"],"acf":{"faq_title":"Frequently Asked Questions about <mark>Apache Pig: Streamlining Big Data Processing<\/mark>","faq_items":[{"question":"What is Apache Pig?","answer":"Apache Pig is an open-source platform that simplifies the processing of large-scale data sets in a distributed computing environment. It provides a high-level language called Pig Latin, which abstracts complex data processing tasks on Apache Hadoop clusters."},{"question":"How did Apache Pig originate?","answer":"The origins of Apache Pig can be traced back to research conducted at Yahoo! around 2006. The team at Yahoo! developed Pig to address the challenges of processing vast amounts of data efficiently on Hadoop. It was later released as an open-source project in 2007."},{"question":"How does Apache Pig work?","answer":"Apache Pig follows a multi-stage data processing model. It starts with parsing the Pig Latin script, followed by logical optimization, physical plan generation, MapReduce execution, and result collection. This process streamlines data processing on Hadoop clusters."},{"question":"What are the key features of Apache Pig?","answer":"Apache Pig offers several key features, including abstraction through Pig Latin, execution in both local and Hadoop modes, and automatic optimization of data processing workflows."},{"question":"What types of data does Apache Pig support?","answer":"Apache Pig supports two main types of datrelational data (structured) and nested data (semi-structured), such as JSON or XML. It provides data types like <code>int<\/code>, <code>float<\/code>, <code>chararray<\/code>, <code>BAG<\/code>, <code>TUPLE<\/code>, and more."},{"question":"How can I use Apache Pig?","answer":"Apache Pig is commonly used for ETL (Extract, Transform, Load) processes, data analysis, and data cleansing tasks. It simplifies data preparation and analysis on big data sets."},{"question":"What are the common challenges while using Apache Pig?","answer":"Users may face performance issues due to inefficient Pig Latin scripts. Debugging complex pipelines and handling data skew in Hadoop clusters are also common challenges."},{"question":"How does Apache Pig compare to other similar technologies?","answer":"Apache Pig differs from Apache Hive and Apache Spark in terms of its processing model, use cases, language support, and performance characteristics. While Pig is good for batch processing, Spark offers in-memory and real-time processing capabilities."},{"question":"What does the future hold for Apache Pig?","answer":"The future of Apache Pig may involve enhanced optimization techniques, real-time processing capabilities, and closer integration with other Apache projects like Flink and Beam."},{"question":"How can proxy servers be associated with Apache Pig?","answer":"Proxy servers can be beneficial in data collection, caching, and ensuring anonymity while using Apache Pig. They act as intermediaries between Pig scripts and external web servers, facilitating various data processing tasks.\r\n\r\nFor more information about Apache Pig, check out the official Apache Pig website, tutorials, and resources from the Apache Software Foundation."}]},"_links":{"self":[{"href":"https:\/\/oneproxy.pro\/jp\/wp-json\/wp\/v2\/wiki\/475879","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/oneproxy.pro\/jp\/wp-json\/wp\/v2\/wiki"}],"about":[{"href":"https:\/\/oneproxy.pro\/jp\/wp-json\/wp\/v2\/types\/wiki"}],"version-history":[{"count":0,"href":"https:\/\/oneproxy.pro\/jp\/wp-json\/wp\/v2\/wiki\/475879\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/oneproxy.pro\/jp\/wp-json\/wp\/v2\/media\/467618"}],"wp:attachment":[{"href":"https:\/\/oneproxy.pro\/jp\/wp-json\/wp\/v2\/media?parent=475879"}],"curies":[{"name":"\u3046\u30fc\u3093","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}