{"id":475878,"date":"2023-08-09T07:24:43","date_gmt":"2023-08-09T07:24:43","guid":{"rendered":""},"modified":"2023-09-05T11:11:30","modified_gmt":"2023-09-05T11:11:30","slug":"apache-hive","status":"publish","type":"wiki","link":"https:\/\/oneproxy.pro\/jp\/wiki\/apache-hive\/","title":{"rendered":"\u30a2\u30d1\u30c3\u30c1\u30cf\u30a4\u30d6"},"content":{"rendered":"

Apache Hive \u306f\u3001Apache Hadoop \u4e0a\u306b\u69cb\u7bc9\u3055\u308c\u305f\u30aa\u30fc\u30d7\u30f3\u30bd\u30fc\u30b9\u306e\u30c7\u30fc\u30bf \u30a6\u30a7\u30a2\u30cf\u30a6\u30b8\u30f3\u30b0\u304a\u3088\u3073 SQL \u306b\u4f3c\u305f\u30af\u30a8\u30ea\u8a00\u8a9e\u30c4\u30fc\u30eb\u3067\u3059\u3002\u3053\u308c\u306f\u3001Hadoop \u306e\u5206\u6563\u30d5\u30a1\u30a4\u30eb \u30b7\u30b9\u30c6\u30e0 (HDFS) \u306b\u4fdd\u5b58\u3055\u308c\u3066\u3044\u308b\u5927\u898f\u6a21\u306a\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\u3092\u7ba1\u7406\u304a\u3088\u3073\u30af\u30a8\u30ea\u3059\u308b\u305f\u3081\u306e\u30e6\u30fc\u30b6\u30fc \u30d5\u30ec\u30f3\u30c9\u30ea\u30fc\u306a\u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30a4\u30b9\u3092\u63d0\u4f9b\u3059\u308b\u305f\u3081\u306b\u958b\u767a\u3055\u308c\u307e\u3057\u305f\u3002 Hive \u306f Hadoop \u30a8\u30b3\u30b7\u30b9\u30c6\u30e0\u306e\u91cd\u8981\u306a\u30b3\u30f3\u30dd\u30fc\u30cd\u30f3\u30c8\u3067\u3042\u308a\u3001\u30a2\u30ca\u30ea\u30b9\u30c8\u3084\u30c7\u30fc\u30bf \u30b5\u30a4\u30a8\u30f3\u30c6\u30a3\u30b9\u30c8\u304c\u8907\u96d1\u306a\u5206\u6790\u30bf\u30b9\u30af\u3092\u52b9\u7387\u7684\u306b\u5b9f\u884c\u3067\u304d\u308b\u3088\u3046\u306b\u3057\u307e\u3059\u3002<\/p>\n

Apache Hive \u306e\u8d77\u6e90\u306e\u6b74\u53f2\u3068\u305d\u306e\u6700\u521d\u306e\u8a00\u53ca<\/h2>\n

Apache Hive \u306e\u59cb\u307e\u308a\u306f\u3001Jeff Hammerbacher \u3068 Facebook \u306e\u30c7\u30fc\u30bf \u30a4\u30f3\u30d5\u30e9\u30b9\u30c8\u30e9\u30af\u30c1\u30e3 \u30c1\u30fc\u30e0\u306b\u3088\u3063\u3066\u6700\u521d\u306b\u8003\u6848\u3055\u308c\u305f 2007 \u5e74\u306b\u9061\u308a\u307e\u3059\u3002Hadoop \u306e\u81a8\u5927\u306a\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\u3092\u64cd\u4f5c\u3059\u308b\u305f\u3081\u306e\u9ad8\u30ec\u30d9\u30eb \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30a4\u30b9\u306b\u5bfe\u3059\u308b\u30cb\u30fc\u30ba\u306e\u9ad8\u307e\u308a\u306b\u5bfe\u5fdc\u3059\u308b\u305f\u3081\u306b\u4f5c\u6210\u3055\u308c\u307e\u3057\u305f\u3002Hammerbacher \u306e\u4f5c\u696d\u306b\u3088\u3063\u3066 Hive \u306e\u57fa\u790e\u304c\u7bc9\u304b\u308c\u3001\u305d\u306e\u5f8c\u3059\u3050\u306b Facebook \u306f 2008 \u5e74\u306b\u30d7\u30ed\u30b8\u30a7\u30af\u30c8\u3092 Apache Software Foundation (ASF) \u306b\u5f15\u304d\u6e21\u3057\u307e\u3057\u305f\u3002\u305d\u308c\u4ee5\u6765\u3001\u4e16\u754c\u4e2d\u306e\u3055\u307e\u3056\u307e\u306a\u958b\u767a\u8005\u3084\u7d44\u7e54\u304b\u3089\u306e\u8ca2\u732e\u306b\u3088\u308a\u3001\u6d3b\u767a\u306a\u30aa\u30fc\u30d7\u30f3 \u30bd\u30fc\u30b9 \u30d7\u30ed\u30b8\u30a7\u30af\u30c8\u3068\u3057\u3066\u6025\u901f\u306b\u9032\u5316\u3057\u307e\u3057\u305f\u3002<\/p>\n

Apache Hive \u306b\u95a2\u3059\u308b\u8a73\u7d30\u60c5\u5831: \u30c8\u30d4\u30c3\u30af\u306e\u5c55\u958b<\/h2>\n

Apache Hive \u306f\u3001Hive Query Language (HQL) \u3068\u3057\u3066\u77e5\u3089\u308c\u308b SQL \u306e\u3088\u3046\u306a\u30af\u30a8\u30ea\u3092 MapReduce \u30b8\u30e7\u30d6\u306b\u5909\u63db\u3059\u308b\u3053\u3068\u3067\u52d5\u4f5c\u3057\u3001\u30e6\u30fc\u30b6\u30fc\u304c\u4f7f\u3044\u6163\u308c\u305f SQL \u69cb\u6587\u3092\u901a\u3058\u3066 Hadoop \u3068\u5bfe\u8a71\u3067\u304d\u308b\u3088\u3046\u306b\u3057\u307e\u3059\u3002\u3053\u306e\u62bd\u8c61\u5316\u306b\u3088\u308a\u3001\u30e6\u30fc\u30b6\u30fc\u306f\u5206\u6563\u30b3\u30f3\u30d4\u30e5\u30fc\u30c6\u30a3\u30f3\u30b0\u306e\u8907\u96d1\u3055\u304b\u3089\u4fdd\u8b77\u3055\u308c\u3001\u4f4e\u30ec\u30d9\u30eb\u306e MapReduce \u30b3\u30fc\u30c9\u3092\u8a18\u8ff0\u305b\u305a\u306b\u5206\u6790\u30bf\u30b9\u30af\u3092\u5b9f\u884c\u3067\u304d\u308b\u3088\u3046\u306b\u306a\u308a\u307e\u3059\u3002<\/p>\n

Apache Hive \u306e\u30a2\u30fc\u30ad\u30c6\u30af\u30c1\u30e3\u306f\u3001\u6b21\u306e 3 \u3064\u306e\u4e3b\u8981\u30b3\u30f3\u30dd\u30fc\u30cd\u30f3\u30c8\u3067\u69cb\u6210\u3055\u308c\u307e\u3059\u3002<\/p>\n

    \n
  1. \n

    HiveQL<\/strong>: Hive Query Language\u3002\u30e6\u30fc\u30b6\u30fc\u304c\u4f7f\u3044\u6163\u308c\u305f\u65b9\u6cd5\u3067\u30c7\u30fc\u30bf\u64cd\u4f5c\u3084\u5206\u6790\u30bf\u30b9\u30af\u3092\u8868\u73fe\u3067\u304d\u308b SQL \u306b\u4f3c\u305f\u8a00\u8a9e\u3067\u3059\u3002<\/p>\n<\/li>\n

  2. \n

    \u30e1\u30bf\u30b9\u30c8\u30a2<\/strong>: \u30c6\u30fc\u30d6\u30eb \u30b9\u30ad\u30fc\u30de\u3001\u30d1\u30fc\u30c6\u30a3\u30b7\u30e7\u30f3\u60c5\u5831\u3001\u304a\u3088\u3073\u305d\u306e\u4ed6\u306e\u30e1\u30bf\u30c7\u30fc\u30bf\u3092\u4fdd\u5b58\u3059\u308b\u30e1\u30bf\u30c7\u30fc\u30bf \u30ea\u30dd\u30b8\u30c8\u30ea\u3002 Apache Derby\u3001MySQL\u3001PostgreSQL \u306a\u3069\u306e\u3055\u307e\u3056\u307e\u306a\u30b9\u30c8\u30ec\u30fc\u30b8 \u30d0\u30c3\u30af\u30a8\u30f3\u30c9\u3092\u30b5\u30dd\u30fc\u30c8\u3057\u307e\u3059\u3002<\/p>\n<\/li>\n

  3. \n

    \u5b9f\u884c\u30a8\u30f3\u30b8\u30f3<\/strong>: HiveQL \u30af\u30a8\u30ea\u306e\u51e6\u7406\u3092\u62c5\u5f53\u3057\u307e\u3059\u3002\u5f53\u521d\u3001Hive \u306f\u5b9f\u884c\u30a8\u30f3\u30b8\u30f3\u3068\u3057\u3066 MapReduce \u3092\u4f7f\u7528\u3057\u3066\u3044\u307e\u3057\u305f\u3002\u305f\u3060\u3057\u3001Hadoop \u306e\u9032\u6b69\u306b\u3088\u308a\u3001Tez \u3084 Spark \u306a\u3069\u306e\u4ed6\u306e\u5b9f\u884c\u30a8\u30f3\u30b8\u30f3\u304c\u7d71\u5408\u3055\u308c\u3001\u30af\u30a8\u30ea\u306e\u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9\u304c\u5927\u5e45\u306b\u5411\u4e0a\u3057\u307e\u3057\u305f\u3002<\/p>\n<\/li>\n<\/ol>\n

    Apache Hive \u306e\u5185\u90e8\u69cb\u9020: Apache Hive \u306e\u4ed5\u7d44\u307f<\/h2>\n

    \u30e6\u30fc\u30b6\u30fc\u304c Hive \u7d4c\u7531\u3067\u30af\u30a8\u30ea\u3092\u9001\u4fe1\u3059\u308b\u3068\u3001\u6b21\u306e\u624b\u9806\u304c\u5b9f\u884c\u3055\u308c\u307e\u3059\u3002<\/p>\n

      \n
    1. \n

      \u89e3\u6790\u4e2d<\/strong>: \u30af\u30a8\u30ea\u306f\u89e3\u6790\u3055\u308c\u3001\u62bd\u8c61\u69cb\u6587\u30c4\u30ea\u30fc (AST) \u306b\u5909\u63db\u3055\u308c\u307e\u3059\u3002<\/p>\n<\/li>\n

    2. \n

      \u610f\u5473\u89e3\u6790<\/strong>: AST \u306f\u3001\u6b63\u78ba\u6027\u3068\u30e1\u30bf\u30b9\u30c8\u30a2\u3067\u5b9a\u7fa9\u3055\u308c\u305f\u30b9\u30ad\u30fc\u30de\u3078\u306e\u6e96\u62e0\u3092\u4fdd\u8a3c\u3059\u308b\u305f\u3081\u306b\u691c\u8a3c\u3055\u308c\u307e\u3059\u3002<\/p>\n<\/li>\n

    3. \n

      \u30af\u30a8\u30ea\u306e\u6700\u9069\u5316<\/strong>: \u30af\u30a8\u30ea \u30aa\u30d7\u30c6\u30a3\u30de\u30a4\u30b6\u30fc\u306f\u3001\u30c7\u30fc\u30bf\u5206\u6563\u3084\u5229\u7528\u53ef\u80fd\u306a\u30ea\u30bd\u30fc\u30b9\u306a\u3069\u306e\u8981\u7d20\u3092\u8003\u616e\u3057\u3066\u3001\u30af\u30a8\u30ea\u306e\u6700\u9069\u306a\u5b9f\u884c\u30d7\u30e9\u30f3\u3092\u751f\u6210\u3057\u307e\u3059\u3002<\/p>\n<\/li>\n

    4. \n

      \u5b9f\u884c<\/strong>: \u9078\u629e\u3055\u308c\u305f\u5b9f\u884c\u30a8\u30f3\u30b8\u30f3 (MapReduce\u3001Tez\u3001Spark \u306e\u3044\u305a\u308c\u304b) \u306f\u3001\u6700\u9069\u5316\u3055\u308c\u305f\u30af\u30a8\u30ea\u3092\u51e6\u7406\u3057\u3001\u4e2d\u9593\u30c7\u30fc\u30bf\u3092\u751f\u6210\u3057\u307e\u3059\u3002<\/p>\n<\/li>\n

    5. \n

      \u30d5\u30a1\u30a4\u30ca\u30e9\u30a4\u30ba<\/strong>: \u6700\u7d42\u51fa\u529b\u306f HDFS \u307e\u305f\u306f\u5225\u306e\u30b5\u30dd\u30fc\u30c8\u3055\u308c\u3066\u3044\u308b\u30b9\u30c8\u30ec\u30fc\u30b8 \u30b7\u30b9\u30c6\u30e0\u306b\u4fdd\u5b58\u3055\u308c\u307e\u3059\u3002<\/p>\n<\/li>\n<\/ol>\n

      Apache Hive \u306e\u4e3b\u306a\u6a5f\u80fd\u306e\u5206\u6790<\/h2>\n

      Apache Hive \u306f\u3001\u30d3\u30c3\u30b0 \u30c7\u30fc\u30bf\u5206\u6790\u3067\u4eba\u6c17\u306e\u3042\u308b\u9078\u629e\u80a2\u3068\u306a\u308b\u3044\u304f\u3064\u304b\u306e\u91cd\u8981\u306a\u6a5f\u80fd\u3092\u63d0\u4f9b\u3057\u307e\u3059\u3002<\/p>\n

        \n
      1. \n

        \u30b9\u30b1\u30fc\u30e9\u30d3\u30ea\u30c6\u30a3<\/strong>: Hive \u306f\u5927\u898f\u6a21\u306a\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\u3092\u51e6\u7406\u3067\u304d\u308b\u305f\u3081\u3001\u5927\u898f\u6a21\u306a\u30c7\u30fc\u30bf\u51e6\u7406\u306b\u9069\u3057\u3066\u3044\u307e\u3059\u3002<\/p>\n<\/li>\n

      2. \n

        \u4f7f\u3044\u3084\u3059\u3055<\/strong>: SQL \u306b\u4f3c\u305f\u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30a4\u30b9\u306b\u3088\u308a\u3001SQL \u306e\u77e5\u8b58\u304c\u3042\u308b\u30e6\u30fc\u30b6\u30fc\u306f\u3059\u3050\u306b Hive \u306e\u64cd\u4f5c\u3092\u958b\u59cb\u3067\u304d\u307e\u3059\u3002<\/p>\n<\/li>\n

      3. \n

        \u62e1\u5f35\u6027<\/strong>: Hive \u306f\u30e6\u30fc\u30b6\u30fc\u5b9a\u7fa9\u95a2\u6570 (UDF) \u3092\u30b5\u30dd\u30fc\u30c8\u3057\u3066\u304a\u308a\u3001\u30e6\u30fc\u30b6\u30fc\u306f\u7279\u5b9a\u306e\u30c7\u30fc\u30bf\u51e6\u7406\u30cb\u30fc\u30ba\u306b\u5408\u308f\u305b\u3066\u30ab\u30b9\u30bf\u30e0\u95a2\u6570\u3092\u4f5c\u6210\u3067\u304d\u307e\u3059\u3002<\/p>\n<\/li>\n

      4. \n

        \u30d1\u30fc\u30c6\u30a3\u30b7\u30e7\u30cb\u30f3\u30b0<\/strong>: Hive \u5185\u3067\u30c7\u30fc\u30bf\u3092\u5206\u5272\u3067\u304d\u308b\u305f\u3081\u3001\u52b9\u7387\u7684\u306a\u30af\u30a8\u30ea\u3068\u5206\u6790\u304c\u53ef\u80fd\u306b\u306a\u308a\u307e\u3059\u3002<\/p>\n<\/li>\n

      5. \n

        \u30c7\u30fc\u30bf\u5f62\u5f0f<\/strong>: Hive \u306f\u3001TextFile\u3001SequenceFile\u3001ORC\u3001Parquet \u306a\u3069\u306e\u3055\u307e\u3056\u307e\u306a\u30c7\u30fc\u30bf\u5f62\u5f0f\u3092\u30b5\u30dd\u30fc\u30c8\u3057\u3001\u30c7\u30fc\u30bf \u30b9\u30c8\u30ec\u30fc\u30b8\u306b\u67d4\u8edf\u6027\u3092\u63d0\u4f9b\u3057\u307e\u3059\u3002<\/p>\n<\/li>\n<\/ol>\n

        Apache Hive \u306e\u7a2e\u985e<\/h2>\n

        Apache Hive \u306f\u3001\u30c7\u30fc\u30bf\u306e\u51e6\u7406\u65b9\u6cd5\u306b\u57fa\u3065\u3044\u3066\u3001\u4e3b\u306b 2 \u3064\u306e\u30bf\u30a4\u30d7\u306b\u5206\u985e\u3067\u304d\u307e\u3059\u3002<\/p>\n

          \n
        1. \n

          \u30d0\u30c3\u30c1\u51e6\u7406<\/strong>: \u3053\u308c\u306f\u3001MapReduce \u3092\u4f7f\u7528\u3057\u3066\u30c7\u30fc\u30bf\u304c\u30d0\u30c3\u30c1\u3067\u51e6\u7406\u3055\u308c\u308b\u5f93\u6765\u306e\u30a2\u30d7\u30ed\u30fc\u30c1\u3067\u3059\u3002\u5927\u898f\u6a21\u306a\u5206\u6790\u306b\u306f\u9069\u3057\u3066\u3044\u307e\u3059\u304c\u3001\u30ea\u30a2\u30eb\u30bf\u30a4\u30e0 \u30af\u30a8\u30ea\u306e\u5f85\u3061\u6642\u9593\u304c\u9577\u304f\u306a\u308b\u53ef\u80fd\u6027\u304c\u3042\u308a\u307e\u3059\u3002<\/p>\n<\/li>\n

        2. \n

          \u30a4\u30f3\u30bf\u30e9\u30af\u30c6\u30a3\u30d6\u51e6\u7406<\/strong>: Hive \u306f\u3001Tez \u3084 Spark \u306a\u3069\u306e\u6700\u65b0\u306e\u5b9f\u884c\u30a8\u30f3\u30b8\u30f3\u3092\u6d3b\u7528\u3057\u3066\u3001\u30a4\u30f3\u30bf\u30e9\u30af\u30c6\u30a3\u30d6\u306a\u30af\u30a8\u30ea\u51e6\u7406\u3092\u5b9f\u73fe\u3057\u307e\u3059\u3002\u3053\u308c\u306b\u3088\u308a\u3001\u30af\u30a8\u30ea\u306e\u5fdc\u7b54\u6642\u9593\u304c\u5927\u5e45\u306b\u77ed\u7e2e\u3055\u308c\u3001\u5168\u4f53\u7684\u306a\u30e6\u30fc\u30b6\u30fc \u30a8\u30af\u30b9\u30da\u30ea\u30a8\u30f3\u30b9\u304c\u5411\u4e0a\u3057\u307e\u3059\u3002<\/p>\n<\/li>\n<\/ol>\n

          \u4ee5\u4e0b\u306f\u3001\u3053\u308c\u3089 2 \u3064\u306e\u30bf\u30a4\u30d7\u3092\u6bd4\u8f03\u3057\u305f\u8868\u3067\u3059\u3002<\/p>\n\n\n\n\n\n\n\n\n
          \u7279\u5fb4<\/th>\n\u30d0\u30c3\u30c1\u51e6\u7406<\/th>\n\u30a4\u30f3\u30bf\u30e9\u30af\u30c6\u30a3\u30d6\u51e6\u7406<\/th>\n<\/tr>\n<\/thead>\n
          \u30ec\u30a4\u30c6\u30f3\u30b7<\/td>\n\u3088\u308a\u9ad8\u3044<\/td>\n\u3088\u308a\u4f4e\u3044<\/td>\n<\/tr>\n
          \u30af\u30a8\u30ea\u306e\u5fdc\u7b54\u6642\u9593<\/td>\n\u3088\u308a\u9577\u3044\u3067\u3059<\/td>\n\u3082\u3063\u3068\u65e9\u304f<\/td>\n<\/tr>\n
          \u4f7f\u7528\u4f8b<\/td>\n\u30aa\u30d5\u30e9\u30a4\u30f3\u5206\u6790<\/td>\n\u30a2\u30c9\u30db\u30c3\u30af\u30af\u30a8\u30ea\u3068\u30ea\u30a2\u30eb\u30bf\u30a4\u30e0\u30af\u30a8\u30ea<\/td>\n<\/tr>\n
          \u5b9f\u884c\u30a8\u30f3\u30b8\u30f3<\/td>\nMapReduce<\/td>\n\u30c6\u30ba\u307e\u305f\u306f\u30b9\u30d1\u30fc\u30af<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

          Apache Hive \u306e\u4f7f\u7528\u65b9\u6cd5\u3001\u554f\u984c\u3068\u305d\u306e\u89e3\u6c7a\u7b56<\/h2>\n

          Apache Hive \u306f\u3001\u6b21\u306e\u3088\u3046\u306a\u3055\u307e\u3056\u307e\u306a\u30c9\u30e1\u30a4\u30f3\u306e\u30a2\u30d7\u30ea\u30b1\u30fc\u30b7\u30e7\u30f3\u3092\u898b\u3064\u3051\u307e\u3059\u3002<\/p>\n

            \n
          1. \n

            \u30d3\u30c3\u30b0\u30c7\u30fc\u30bf\u5206\u6790<\/strong>: Hive \u3092\u4f7f\u7528\u3059\u308b\u3068\u3001\u30a2\u30ca\u30ea\u30b9\u30c8\u306f\u81a8\u5927\u306a\u91cf\u306e\u30c7\u30fc\u30bf\u304b\u3089\u8cb4\u91cd\u306a\u6d1e\u5bdf\u3092\u62bd\u51fa\u3067\u304d\u307e\u3059\u3002<\/p>\n<\/li>\n

          2. \n

            \u30d3\u30b8\u30cd\u30b9\u30fb\u30a4\u30f3\u30c6\u30ea\u30b8\u30a7\u30f3\u30b9<\/strong>: \u7d44\u7e54\u306f Hive \u3092\u4f7f\u7528\u3057\u3066\u30a2\u30c9\u30db\u30c3\u30af \u30af\u30a8\u30ea\u3092\u5b9f\u884c\u3057\u3001\u30ec\u30dd\u30fc\u30c8\u3092\u4f5c\u6210\u3067\u304d\u307e\u3059\u3002<\/p>\n<\/li>\n

          3. \n

            \u30c7\u30fc\u30bf\u30a6\u30a7\u30a2\u30cf\u30a6\u30b8\u30f3\u30b0<\/strong>: Hive \u306f\u3001\u305d\u306e\u30b9\u30b1\u30fc\u30e9\u30d3\u30ea\u30c6\u30a3\u306b\u3088\u308a\u3001\u30c7\u30fc\u30bf \u30a6\u30a7\u30a2\u30cf\u30a6\u30b8\u30f3\u30b0 \u30bf\u30b9\u30af\u306b\u9069\u3057\u3066\u3044\u307e\u3059\u3002<\/p>\n<\/li>\n<\/ol>\n

            \u305f\u3060\u3057\u3001Hive \u3092\u52b9\u679c\u7684\u306b\u4f7f\u7528\u3059\u308b\u306b\u306f\u3001\u6b21\u306e\u3088\u3046\u306a\u8ab2\u984c\u304c\u4f34\u3044\u307e\u3059\u3002<\/p>\n

              \n
            1. \n

              \u30ec\u30a4\u30c6\u30f3\u30b7<\/strong>\u6ce8: Hive \u306f\u30c7\u30d5\u30a9\u30eb\u30c8\u3067\u30d0\u30c3\u30c1\u51e6\u7406\u306b\u4f9d\u5b58\u3057\u3066\u3044\u308b\u305f\u3081\u3001\u30ea\u30a2\u30eb\u30bf\u30a4\u30e0 \u30af\u30a8\u30ea\u3067\u306f\u5f85\u3061\u6642\u9593\u304c\u9577\u304f\u306a\u308b\u53ef\u80fd\u6027\u304c\u3042\u308a\u307e\u3059\u3002<\/p>\n<\/li>\n

            2. \n

              \u8907\u96d1\u306a\u30af\u30a8\u30ea<\/strong>: \u4e00\u90e8\u306e\u8907\u96d1\u306a\u30af\u30a8\u30ea\u306f\u52b9\u7387\u7684\u306b\u6700\u9069\u5316\u3055\u308c\u305a\u3001\u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9\u306e\u554f\u984c\u306b\u3064\u306a\u304c\u308b\u53ef\u80fd\u6027\u304c\u3042\u308a\u307e\u3059\u3002<\/p>\n<\/li>\n<\/ol>\n

              \u3053\u308c\u3089\u306e\u8ab2\u984c\u306b\u5bfe\u51e6\u3059\u308b\u305f\u3081\u306b\u3001\u30e6\u30fc\u30b6\u30fc\u306f\u6b21\u306e\u30bd\u30ea\u30e5\u30fc\u30b7\u30e7\u30f3\u3092\u691c\u8a0e\u3067\u304d\u307e\u3059\u3002<\/p>\n

                \n
              1. \n

                \u30a4\u30f3\u30bf\u30e9\u30af\u30c6\u30a3\u30d6\u306a\u30af\u30a8\u30ea<\/strong>: Tez \u3084 Spark \u306a\u3069\u306e\u5bfe\u8a71\u578b\u51e6\u7406\u30a8\u30f3\u30b8\u30f3\u3092\u6d3b\u7528\u3059\u308b\u3053\u3068\u3067\u3001\u30e6\u30fc\u30b6\u30fc\u306f\u30af\u30a8\u30ea\u5fdc\u7b54\u6642\u9593\u3092\u77ed\u7e2e\u3067\u304d\u307e\u3059\u3002<\/p>\n<\/li>\n

              2. \n

                \u30af\u30a8\u30ea\u306e\u6700\u9069\u5316<\/strong>: \u6700\u9069\u5316\u3055\u308c\u305f HiveQL \u30af\u30a8\u30ea\u3092\u4f5c\u6210\u3057\u3001\u9069\u5207\u306a\u30c7\u30fc\u30bf\u5f62\u5f0f\u3068\u30d1\u30fc\u30c6\u30a3\u30b7\u30e7\u30cb\u30f3\u30b0\u3092\u4f7f\u7528\u3059\u308b\u3068\u3001\u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9\u304c\u5927\u5e45\u306b\u5411\u4e0a\u3057\u307e\u3059\u3002<\/p>\n<\/li>\n

              3. \n

                \u30ad\u30e3\u30c3\u30b7\u30f3\u30b0<\/strong>: \u4e2d\u9593\u30c7\u30fc\u30bf\u3092\u30ad\u30e3\u30c3\u30b7\u30e5\u3059\u308b\u3068\u3001\u7e70\u308a\u8fd4\u3057\u5b9f\u884c\u3055\u308c\u308b\u30af\u30a8\u30ea\u306e\u5197\u9577\u306a\u8a08\u7b97\u3092\u524a\u6e1b\u3067\u304d\u307e\u3059\u3002<\/p>\n<\/li>\n<\/ol>\n

                \u4e3b\u306a\u7279\u5fb4\u3068\u985e\u4f3c\u7528\u8a9e\u3068\u306e\u6bd4\u8f03<\/h2>\n

                \u4ee5\u4e0b\u306f\u3001Apache Hive \u3068\u4ed6\u306e\u540c\u69d8\u306e\u30c6\u30af\u30ce\u30ed\u30b8\u30fc\u3068\u306e\u6bd4\u8f03\u3067\u3059\u3002<\/p>\n\n\n\n\n\n\n\n
                \u30c6\u30af\u30ce\u30ed\u30b8\u30fc<\/th>\n\u8aac\u660e<\/th>\nApache Hive \u3068\u306e\u5dee\u5225\u5316<\/th>\n<\/tr>\n<\/thead>\n
                \u30a2\u30d1\u30c3\u30c1\u30fb\u30cf\u30c9\u30a5\u30fc\u30d7<\/td>\n\u5206\u6563\u30b3\u30f3\u30d4\u30e5\u30fc\u30c6\u30a3\u30f3\u30b0\u306e\u305f\u3081\u306e\u30d3\u30c3\u30b0\u30c7\u30fc\u30bf \u30d5\u30ec\u30fc\u30e0\u30ef\u30fc\u30af<\/td>\nHive \u306f\u3001Hadoop \u3067\u30c7\u30fc\u30bf\u306e\u30af\u30a8\u30ea\u3068\u7ba1\u7406\u3092\u884c\u3046\u305f\u3081\u306e SQL \u306b\u4f3c\u305f\u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30a4\u30b9\u3092\u63d0\u4f9b\u3057\u3001SQL \u306b\u7cbe\u901a\u3057\u305f\u30e6\u30fc\u30b6\u30fc\u306b\u3068\u3063\u3066\u30a2\u30af\u30bb\u30b9\u3057\u3084\u3059\u304f\u3057\u3066\u3044\u307e\u3059\u3002<\/td>\n<\/tr>\n
                \u30a2\u30d1\u30c3\u30c1\u30d4\u30c3\u30b0<\/td>\nMapReduce \u30d7\u30ed\u30b0\u30e9\u30e0\u3092\u4f5c\u6210\u3059\u308b\u305f\u3081\u306e\u9ad8\u30ec\u30d9\u30eb\u306e\u30d7\u30e9\u30c3\u30c8\u30d5\u30a9\u30fc\u30e0<\/td>\nHive \u306f\u4f7f\u3044\u6163\u308c\u305f SQL \u306b\u4f3c\u305f\u8a00\u8a9e\u3092\u4f7f\u7528\u3057\u3066\u30c7\u30fc\u30bf\u51e6\u7406\u3092\u62bd\u8c61\u5316\u3057\u307e\u3059\u304c\u3001Pig \u306f\u30c7\u30fc\u30bf \u30d5\u30ed\u30fc\u8a00\u8a9e\u3092\u4f7f\u7528\u3057\u307e\u3059\u3002 Hive \u306f\u3001SQL \u306b\u7cbe\u901a\u3057\u305f\u30a2\u30ca\u30ea\u30b9\u30c8\u306b\u9069\u3057\u3066\u3044\u307e\u3059\u3002<\/td>\n<\/tr>\n
                \u30a2\u30d1\u30c3\u30c1\u30b9\u30d1\u30fc\u30af<\/td>\n\u9ad8\u901f\u304b\u3064\u6c4e\u7528\u7684\u306a\u30af\u30e9\u30b9\u30bf\u30b3\u30f3\u30d4\u30e5\u30fc\u30c6\u30a3\u30f3\u30b0\u30b7\u30b9\u30c6\u30e0<\/td>\nHive \u306f\u3053\u308c\u307e\u3067\u3001\u5b9f\u884c\u306b MapReduce \u306b\u4f9d\u5b58\u3057\u3066\u3044\u307e\u3057\u305f\u304c\u3001Spark \u3068\u6bd4\u8f03\u3057\u3066\u30ec\u30a4\u30c6\u30f3\u30b7\u304c\u9ad8\u304b\u3063\u305f\u306e\u3067\u3059\u3002\u305f\u3060\u3057\u3001\u5b9f\u884c\u30a8\u30f3\u30b8\u30f3\u3068\u3057\u3066 Spark \u3092\u7d71\u5408\u3059\u308b\u3053\u3068\u306b\u3088\u308a\u3001Hive \u306f\u5f85\u3061\u6642\u9593\u306e\u77ed\u7e2e\u3068\u51e6\u7406\u306e\u9ad8\u901f\u5316\u3092\u5b9f\u73fe\u3067\u304d\u307e\u3059\u3002<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

                Apache Hive \u306b\u95a2\u9023\u3059\u308b\u5c06\u6765\u306e\u5c55\u671b\u3068\u30c6\u30af\u30ce\u30ed\u30b8\u30fc<\/h2>\n

                \u30d3\u30c3\u30b0\u30c7\u30fc\u30bf\u304c\u5897\u3048\u7d9a\u3051\u308b\u306b\u3064\u308c\u3066\u3001Apache Hive \u306e\u5c06\u6765\u306f\u6709\u671b\u306b\u898b\u3048\u307e\u3059\u3002Hive \u306b\u95a2\u9023\u3059\u308b\u91cd\u8981\u306a\u5c55\u671b\u3068\u65b0\u8208\u6280\u8853\u306b\u306f\u3001\u6b21\u306e\u3082\u306e\u304c\u3042\u308a\u307e\u3059\u3002<\/p>\n

                  \n
                1. \n

                  \u30ea\u30a2\u30eb\u30bf\u30a4\u30e0\u51e6\u7406<\/strong>: \u30af\u30a8\u30ea\u306e\u5fdc\u7b54\u6642\u9593\u3092\u3055\u3089\u306b\u77ed\u7e2e\u3057\u3001\u5373\u6642\u306e\u6d1e\u5bdf\u3092\u5f97\u308b\u305f\u3081\u306e\u30ea\u30a2\u30eb\u30bf\u30a4\u30e0\u51e6\u7406\u3092\u53ef\u80fd\u306b\u3059\u308b\u3053\u3068\u306b\u91cd\u70b9\u304c\u7f6e\u304b\u308c\u307e\u3059\u3002<\/p>\n<\/li>\n

                2. \n

                  \u6a5f\u68b0\u5b66\u7fd2\u306e\u7d71\u5408<\/strong>: \u6a5f\u68b0\u5b66\u7fd2\u30e9\u30a4\u30d6\u30e9\u30ea\u3092 Hive \u3068\u7d71\u5408\u3057\u3066\u3001\u30d7\u30e9\u30c3\u30c8\u30d5\u30a9\u30fc\u30e0\u5185\u3067\u76f4\u63a5\u30c7\u30fc\u30bf\u5206\u6790\u3068\u4e88\u6e2c\u30e2\u30c7\u30ea\u30f3\u30b0\u3092\u5b9f\u884c\u3057\u307e\u3059\u3002<\/p>\n<\/li>\n

                3. \n

                  \u7d71\u5408\u51e6\u7406\u30a8\u30f3\u30b8\u30f3<\/strong>: \u6700\u9069\u306a\u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9\u3068\u30ea\u30bd\u30fc\u30b9\u4f7f\u7528\u7387\u3092\u5b9f\u73fe\u3059\u308b\u305f\u3081\u306b\u3001\u8907\u6570\u306e\u5b9f\u884c\u30a8\u30f3\u30b8\u30f3\u3092\u30b7\u30fc\u30e0\u30ec\u30b9\u306b\u7d71\u5408\u3059\u308b\u65b9\u6cd5\u3092\u691c\u8a0e\u3057\u3066\u3044\u307e\u3059\u3002<\/p>\n<\/li>\n<\/ol>\n

                  \u30d7\u30ed\u30ad\u30b7 \u30b5\u30fc\u30d0\u30fc\u3092 Apache Hive \u3067\u4f7f\u7528\u3059\u308b\u65b9\u6cd5\u307e\u305f\u306f Apache Hive \u3068\u95a2\u9023\u4ed8\u3051\u308b\u65b9\u6cd5<\/h2>\n

                  OneProxy \u306e\u3088\u3046\u306a\u30d7\u30ed\u30ad\u30b7 \u30b5\u30fc\u30d0\u30fc\u306f\u3001Apache Hive \u306e\u30b3\u30f3\u30c6\u30ad\u30b9\u30c8\u3067\u91cd\u8981\u306a\u5f79\u5272\u3092\u679c\u305f\u3057\u307e\u3059\u3002\u5927\u898f\u6a21\u306a\u5206\u6563\u30b7\u30b9\u30c6\u30e0\u3092\u64cd\u4f5c\u3059\u308b\u5834\u5408\u3001\u30c7\u30fc\u30bf\u306e\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3\u3001\u30d7\u30e9\u30a4\u30d0\u30b7\u30fc\u3001\u30a2\u30af\u30bb\u30b9\u5236\u5fa1\u304c\u91cd\u8981\u306a\u5074\u9762\u3068\u306a\u308a\u307e\u3059\u3002\u30d7\u30ed\u30ad\u30b7 \u30b5\u30fc\u30d0\u30fc\u306f\u30af\u30e9\u30a4\u30a2\u30f3\u30c8\u3068 Hive \u30af\u30e9\u30b9\u30bf\u30fc\u306e\u9593\u306e\u4ef2\u4ecb\u8005\u3068\u3057\u3066\u6a5f\u80fd\u3057\u3001\u8ffd\u52a0\u306e\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3\u5c64\u3068\u533f\u540d\u6027\u3092\u63d0\u4f9b\u3057\u307e\u3059\u3002\u5f7c\u3089\u306f\u6b21\u306e\u3053\u3068\u304c\u3067\u304d\u307e\u3059:<\/p>\n

                    \n
                  1. \n

                    \u30bb\u30ad\u30e5\u30ea\u30c6\u30a3\u306e\u5f37\u5316<\/strong>: \u30d7\u30ed\u30ad\u30b7 \u30b5\u30fc\u30d0\u30fc\u306f\u3001Hive \u30af\u30e9\u30b9\u30bf\u30fc\u3078\u306e\u76f4\u63a5\u30a2\u30af\u30bb\u30b9\u3092\u5236\u9650\u3057\u3001\u6a29\u9650\u306e\u306a\u3044\u30e6\u30fc\u30b6\u30fc\u304b\u3089\u30af\u30e9\u30b9\u30bf\u30fc\u3092\u4fdd\u8b77\u3059\u308b\u306e\u306b\u5f79\u7acb\u3061\u307e\u3059\u3002<\/p>\n<\/li>\n

                  2. \n

                    \u30ed\u30fc\u30c9\u30d0\u30e9\u30f3\u30b7\u30f3\u30b0<\/strong>: \u30d7\u30ed\u30ad\u30b7 \u30b5\u30fc\u30d0\u30fc\u306f\u3001\u30af\u30e9\u30a4\u30a2\u30f3\u30c8\u306e\u30ea\u30af\u30a8\u30b9\u30c8\u3092\u8907\u6570\u306e Hive \u30af\u30e9\u30b9\u30bf\u30fc\u306b\u5206\u6563\u3057\u3066\u3001\u30ea\u30bd\u30fc\u30b9\u306e\u52b9\u7387\u7684\u306a\u5229\u7528\u3092\u78ba\u4fdd\u3067\u304d\u307e\u3059\u3002<\/p>\n<\/li>\n

                  3. \n

                    \u30ad\u30e3\u30c3\u30b7\u30f3\u30b0<\/strong>: \u30d7\u30ed\u30ad\u30b7 \u30b5\u30fc\u30d0\u30fc\u306f\u30af\u30a8\u30ea\u7d50\u679c\u3092\u30ad\u30e3\u30c3\u30b7\u30e5\u3067\u304d\u308b\u305f\u3081\u3001\u7e70\u308a\u8fd4\u3055\u308c\u308b\u30af\u30a8\u30ea\u306b\u5bfe\u3059\u308b Hive \u30af\u30e9\u30b9\u30bf\u30fc\u306e\u30ef\u30fc\u30af\u30ed\u30fc\u30c9\u304c\u8efd\u6e1b\u3055\u308c\u307e\u3059\u3002<\/p>\n<\/li>\n

                  4. \n

                    \u533f\u540d<\/strong>: \u30d7\u30ed\u30ad\u30b7 \u30b5\u30fc\u30d0\u30fc\u306f\u30e6\u30fc\u30b6\u30fc\u306e IP \u30a2\u30c9\u30ec\u30b9\u3092\u533f\u540d\u5316\u3057\u3001\u8ffd\u52a0\u306e\u30d7\u30e9\u30a4\u30d0\u30b7\u30fc\u5c64\u3092\u63d0\u4f9b\u3057\u307e\u3059\u3002<\/p>\n<\/li>\n<\/ol>\n

                    \u95a2\u9023\u30ea\u30f3\u30af<\/h2>\n

                    Apache Hive \u306e\u8a73\u7d30\u306b\u3064\u3044\u3066\u306f\u3001\u6b21\u306e\u30ea\u30bd\u30fc\u30b9\u3092\u53c2\u7167\u3057\u3066\u304f\u3060\u3055\u3044\u3002<\/p>\n

                      \n
                    1. Apache Hive \u516c\u5f0f\u30a6\u30a7\u30d6\u30b5\u30a4\u30c8<\/a><\/li>\n
                    2. Apache Hive \u30c9\u30ad\u30e5\u30e1\u30f3\u30c8<\/a><\/li>\n
                    3. Apache \u30bd\u30d5\u30c8\u30a6\u30a7\u30a2\u8ca1\u56e3<\/a><\/li>\n<\/ol>\n

                      \u7d50\u8ad6\u3068\u3057\u3066\u3001Apache Hive \u306f Hadoop \u30a8\u30b3\u30b7\u30b9\u30c6\u30e0\u306e\u91cd\u8981\u306a\u30b3\u30f3\u30dd\u30fc\u30cd\u30f3\u30c8\u3067\u3042\u308a\u3001\u30e6\u30fc\u30b6\u30fc \u30d5\u30ec\u30f3\u30c9\u30ea\u30fc\u306a SQL \u306e\u3088\u3046\u306a\u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30a4\u30b9\u3068\u30b9\u30b1\u30fc\u30e9\u30d3\u30ea\u30c6\u30a3\u3067\u30d3\u30c3\u30b0 \u30c7\u30fc\u30bf\u5206\u6790\u3092\u5f37\u5316\u3057\u307e\u3059\u3002\u5b9f\u884c\u30a8\u30f3\u30b8\u30f3\u306e\u9032\u5316\u3068\u6700\u65b0\u30c6\u30af\u30ce\u30ed\u30b8\u30fc\u306e\u7d71\u5408\u306b\u3088\u308a\u3001Hive \u306f\u6210\u9577\u3092\u7d9a\u3051\u3001\u30d3\u30c3\u30b0 \u30c7\u30fc\u30bf\u51e6\u7406\u306e\u8ab2\u984c\u306b\u5bfe\u51e6\u3057\u3066\u3044\u307e\u3059\u3002\u30c7\u30fc\u30bf\u304c\u5897\u5927\u3057\u7d9a\u3051\u308b\u306b\u3064\u308c\u3066\u3001Hive \u306e\u5c06\u6765\u306f\u6709\u671b\u306b\u898b\u3048\u3001\u5927\u898f\u6a21\u306a\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\u304b\u3089\u8cb4\u91cd\u306a\u6d1e\u5bdf\u3092\u5c0e\u304d\u51fa\u305d\u3046\u3068\u52aa\u3081\u3066\u3044\u308b\u30c7\u30fc\u30bf \u30a2\u30ca\u30ea\u30b9\u30c8\u3084\u7d44\u7e54\u306b\u3068\u3063\u3066\u3001Hive \u306f\u4eca\u5f8c\u3082\u91cd\u8981\u306a\u30c4\u30fc\u30eb\u3067\u3042\u308a\u7d9a\u3051\u308b\u3067\u3057\u3087\u3046\u3002<\/p>","protected":false},"featured_media":467616,"menu_order":0,"template":"","meta":{"_acf_changed":false,"content-type":"","inline_featured_image":false,"footnotes":""},"class_list":["post-475878","wiki","type-wiki","status-publish","has-post-thumbnail","hentry"],"acf":{"faq_title":"Frequently Asked Questions about Apache Hive: Empowering Big Data Analytics<\/mark>","faq_items":[{"question":"Question: What is Apache Hive?","answer":"

                      Answer: Apache Hive is an open-source data warehousing and SQL-like query language tool built on top of Apache Hadoop. It provides a user-friendly interface for managing and querying large-scale datasets stored in Hadoop's distributed file system (HDFS).<\/p>"},{"question":"Question: Who developed Apache Hive, and when was it created?","answer":"

                      Answer: Apache Hive was initially conceived by Jeff Hammerbacher and Facebook's Data Infrastructure Team in 2007. It was later handed over to the Apache Software Foundation (ASF) in 2008, evolving as an open-source project with contributions from developers worldwide.<\/p>"},{"question":"Question: How does Apache Hive work, and what is its internal structure?","answer":"

                      Answer: Apache Hive translates SQL-like queries (Hive Query Language or HQL) into MapReduce, Tez, or Spark jobs to interact with Hadoop's distributed data. It consists of three main components: HiveQL (SQL-like language), Metastore (metadata repository), and Execution Engine (processing the queries).<\/p>"},{"question":"Question: What are the key features of Apache Hive?","answer":"

                      Answer: Apache Hive offers scalability for handling large datasets, ease of use with its SQL-like interface, extensibility with user-defined functions (UDFs), partitioning for efficient querying, and support for various data formats like TextFile, SequenceFile, ORC, and Parquet.<\/p>"},{"question":"Question: What are the types of Apache Hive, and how do they differ?","answer":"

                      Answer: Apache Hive can be categorized into Batch Processing and Interactive Processing. Batch Processing uses MapReduce and is suitable for offline analytics, while Interactive Processing leverages Tez or Spark, offering faster query response times and real-time queries.<\/p>"},{"question":"Question: How can I use Apache Hive, and what challenges might I face?","answer":"

                      Answer: Apache Hive finds applications in big data analytics, business intelligence, and data warehousing. Challenges may include higher latency for real-time queries and complexities with certain queries. Solutions involve leveraging interactive processing, query optimization, and caching.<\/p>"},{"question":"Question: How does Apache Hive compare with similar technologies like Apache Hadoop, Apache Pig, and Apache Spark?","answer":"

                      Answer: Apache Hive provides a SQL-like interface for querying and managing data in Hadoop, making it more accessible to SQL-savvy users compared to Hadoop. It differs from Apache Pig by using a SQL-like language instead of a data flow language. With the integration of Spark, Hive achieves lower latency compared to its historical reliance on MapReduce.<\/p>"},{"question":"Question: What can we expect for the future of Apache Hive?","answer":"

                      Answer: The future of Apache Hive looks promising with a focus on real-time processing, machine learning integration, and unified processing engines to optimize performance and resource utilization.<\/p>"},{"question":"Question: How can proxy servers like OneProxy be associated with Apache Hive?","answer":"

                      Answer: Proxy servers like OneProxy can enhance security, load balancing, caching, and anonymity when working with Hive clusters, providing an additional layer of protection and privacy for users.<\/p>"},{"question":"Question: Where can I find more information about Apache Hive?","answer":"

                      Answer: For more information about Apache Hive, visit the official Apache Hive website (https:\/\/hive.apache.org\/<\/a>), the Apache Hive documentation (https:\/\/cwiki.apache.org\/confluence\/display\/Hive\/Home<\/a>), or the Apache Software Foundation website (https:\/\/www.apache.org\/<\/a>).<\/p>"}]},"_links":{"self":[{"href":"https:\/\/oneproxy.pro\/jp\/wp-json\/wp\/v2\/wiki\/475878","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/oneproxy.pro\/jp\/wp-json\/wp\/v2\/wiki"}],"about":[{"href":"https:\/\/oneproxy.pro\/jp\/wp-json\/wp\/v2\/types\/wiki"}],"version-history":[{"count":0,"href":"https:\/\/oneproxy.pro\/jp\/wp-json\/wp\/v2\/wiki\/475878\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/oneproxy.pro\/jp\/wp-json\/wp\/v2\/media\/467616"}],"wp:attachment":[{"href":"https:\/\/oneproxy.pro\/jp\/wp-json\/wp\/v2\/media?parent=475878"}],"curies":[{"name":"\u3046\u30fc\u3093","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}