{"id":476653,"date":"2023-08-09T07:31:20","date_gmt":"2023-08-09T07:31:20","guid":{"rendered":""},"modified":"2023-09-05T11:13:11","modified_gmt":"2023-09-05T11:13:11","slug":"data-lake","status":"publish","type":"wiki","link":"https:\/\/oneproxy.pro\/jp\/wiki\/data-lake\/","title":{"rendered":"\u30c7\u30fc\u30bf\u30ec\u30a4\u30af"},"content":{"rendered":"<p>\u30c7\u30fc\u30bf \u30ec\u30a4\u30af\u306f\u3001\u5927\u91cf\u306e\u751f\u30c7\u30fc\u30bf\u3092\u5fc5\u8981\u306a\u3068\u304d\u307e\u3067\u30cd\u30a4\u30c6\u30a3\u30d6\u5f62\u5f0f\u3067\u4fdd\u5b58\u3067\u304d\u308b\u96c6\u4e2d\u578b\u30b9\u30c8\u30ec\u30fc\u30b8\u304a\u3088\u3073\u30c7\u30fc\u30bf\u7ba1\u7406\u30d1\u30e9\u30c0\u30a4\u30e0\u3067\u3059\u3002\u3053\u308c\u3089\u306e\u30b7\u30b9\u30c6\u30e0\u306f\u3055\u307e\u3056\u307e\u306a\u30bd\u30fc\u30b9\u304b\u3089\u306e\u30c7\u30fc\u30bf\u3092\u4fdd\u5b58\u3057\u3001\u69cb\u9020\u5316\u30c7\u30fc\u30bf\u3001\u534a\u69cb\u9020\u5316\u30c7\u30fc\u30bf\u3001\u975e\u69cb\u9020\u5316\u30c7\u30fc\u30bf\u306a\u3069\u3001\u3055\u307e\u3056\u307e\u306a\u30c7\u30fc\u30bf \u30bf\u30a4\u30d7\u3092\u30b5\u30dd\u30fc\u30c8\u3057\u307e\u3059\u3002\u7d44\u7e54\u5168\u4f53\u306e\u30e6\u30fc\u30b6\u30fc\u306f\u3001\u30c7\u30fc\u30bf\u63a2\u7d22\u3001\u30c7\u30fc\u30bf \u30b5\u30a4\u30a8\u30f3\u30b9\u3001\u30c7\u30fc\u30bf \u30a6\u30a7\u30a2\u30cf\u30a6\u30b9\u3001\u30ea\u30a2\u30eb\u30bf\u30a4\u30e0\u5206\u6790\u306a\u3069\u306e\u3055\u307e\u3056\u307e\u306a\u30bf\u30b9\u30af\u306e\u305f\u3081\u306b\u3053\u306e\u30c7\u30fc\u30bf\u306b\u30a2\u30af\u30bb\u30b9\u3067\u304d\u307e\u3059\u3002<\/p>\n<h2>\u30c7\u30fc\u30bf\u30ec\u30a4\u30af\u306e\u6b74\u53f2\u3068\u51fa\u73fe<\/h2>\n<p>\u300c\u30c7\u30fc\u30bf \u30ec\u30a4\u30af\u300d\u3068\u3044\u3046\u7528\u8a9e\u306f\u3001\u30c7\u30fc\u30bf\u7d71\u5408\u4f1a\u793e Pentaho \u306e CTO \u3067\u3042\u308b James Dixon \u6c0f\u306b\u3088\u3063\u3066 2010 \u5e74\u306b\u521d\u3081\u3066\u5c0e\u5165\u3055\u308c\u307e\u3057\u305f\u3002\u5f7c\u306f\u3001\u30c7\u30fc\u30bf \u30de\u30fc\u30c8 (\u30d3\u30b8\u30cd\u30b9\u306e\u5358\u4e00\u306e\u6a5f\u80fd\u9818\u57df\u306b\u91cd\u70b9\u3092\u7f6e\u3044\u305f\u3001\u30c7\u30fc\u30bf \u30a6\u30a7\u30a2\u30cf\u30a6\u30b9\u306e\u30b7\u30f3\u30d7\u30eb\u306a\u5f62\u5f0f) \u3092\u300c\u7c21\u5358\u306b\u6d88\u8cbb\u3067\u304d\u308b\u3088\u3046\u306b\u6d17\u6d44\u3001\u30d1\u30c3\u30b1\u30fc\u30b8\u5316\u3001\u69cb\u9020\u5316\u3055\u308c\u305f\u300d\u30dc\u30c8\u30eb\u5165\u308a\u306e\u6c34\u306b\u4f8b\u3048\u307e\u3057\u305f\u3002\u4e00\u65b9\u3001\u30c7\u30fc\u30bf \u30ec\u30a4\u30af\u306f\u3001\u81ea\u7136\u306e\u307e\u307e\u306e\u6c34\u57df\u306b\u4f3c\u3066\u3044\u307e\u3059\u3002\u30c7\u30fc\u30bf\u306f\u3001\u30b9\u30c8\u30ea\u30fc\u30e0 (\u30bd\u30fc\u30b9 \u30b7\u30b9\u30c6\u30e0) \u304b\u3089\u30ec\u30a4\u30af\u306b\u6d41\u308c\u8fbc\u307f\u3001\u305d\u306e\u5143\u306e\u7279\u6027\u3092\u3059\u3079\u3066\u4fdd\u6301\u3057\u307e\u3059\u3002<\/p>\n<h2>\u30c7\u30fc\u30bf\u30ec\u30a4\u30af\u306e\u6982\u5ff5\u3092\u89e3\u660e\u3059\u308b<\/h2>\n<p>\u30c7\u30fc\u30bf \u30ec\u30a4\u30af\u306f\u3001\u672a\u51e6\u7406\u306e\u5f62\u5f0f\u3067\u30c7\u30fc\u30bf\u3092\u4fdd\u6301\u3057\u3001\u751f\u30c7\u30fc\u30bf \u30c0\u30f3\u30d7\u3092\u542b\u307f\u307e\u3059\u3002\u3053\u308c\u306f\u3001\u901a\u5e38\u3001\u4fdd\u5b58\u3059\u308b\u524d\u306b\u30c7\u30fc\u30bf\u3092\u51e6\u7406\u3057\u3066\u69cb\u9020\u5316\u3059\u308b\u5fc5\u8981\u304c\u3042\u308b\u5f93\u6765\u306e\u30c7\u30fc\u30bf\u4fdd\u5b58\u65b9\u6cd5\u304b\u3089\u306e\u5927\u304d\u306a\u9038\u8131\u3067\u3059\u3002\u672a\u51e6\u7406\u30c7\u30fc\u30bf\u3092\u4fdd\u5b58\u3067\u304d\u308b\u3053\u306e\u6a5f\u80fd\u306b\u3088\u308a\u3001\u4f01\u696d\u306f\u30d3\u30c3\u30b0 \u30c7\u30fc\u30bf\u3092\u6d3b\u7528\u3057\u3001\u8907\u96d1\u306a\u5206\u6790\u3068\u6a5f\u68b0\u5b66\u7fd2\u304c\u53ef\u80fd\u306b\u306a\u308a\u3001\u4eca\u65e5\u306e\u30c7\u30fc\u30bf\u4e3b\u5c0e\u306e\u4e16\u754c\u3067\u306f\u91cd\u8981\u306a\u30c4\u30fc\u30eb\u306b\u306a\u308a\u307e\u3059\u3002<\/p>\n<p>\u30c7\u30fc\u30bf \u30ec\u30a4\u30af\u306b\u306f\u3001\u30ea\u30ec\u30fc\u30b7\u30e7\u30ca\u30eb \u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u304b\u3089\u306e\u69cb\u9020\u5316\u30c7\u30fc\u30bf\u3001CSV \u3084 JSON \u30d5\u30a1\u30a4\u30eb\u306a\u3069\u306e\u534a\u69cb\u9020\u5316\u30c7\u30fc\u30bf\u3001\u96fb\u5b50\u30e1\u30fc\u30eb\u3084\u30c9\u30ad\u30e5\u30e1\u30f3\u30c8\u306a\u3069\u306e\u975e\u69cb\u9020\u5316\u30c7\u30fc\u30bf\u3001\u3055\u3089\u306b\u306f\u753b\u50cf\u3001\u97f3\u58f0\u3001\u30d3\u30c7\u30aa\u306a\u3069\u306e\u30d0\u30a4\u30ca\u30ea \u30c7\u30fc\u30bf\u306a\u3069\u3001\u3042\u3089\u3086\u308b\u7a2e\u985e\u306e\u30c7\u30fc\u30bf\u304c\u4fdd\u5b58\u3055\u308c\u307e\u3059\u3002\u591a\u69d8\u306a\u30c7\u30fc\u30bf \u30bf\u30a4\u30d7\u3092\u51e6\u7406\u3067\u304d\u308b\u305f\u3081\u3001\u4f01\u696d\u306f\u3053\u308c\u307e\u3067\u306f\u3067\u304d\u306a\u304b\u3063\u305f\u3055\u307e\u3056\u307e\u306a\u30c7\u30fc\u30bf \u30bd\u30fc\u30b9\u304b\u3089\u6d1e\u5bdf\u3092\u5f97\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/p>\n<h2>\u30c7\u30fc\u30bf\u30ec\u30a4\u30af\u306e\u5185\u90e8\u69cb\u9020\u3068\u52d5\u4f5c<\/h2>\n<p>\u30c7\u30fc\u30bf \u30ec\u30a4\u30af\u306e\u5185\u90e8\u69cb\u9020\u306f\u3001\u81a8\u5927\u306a\u91cf\u306e\u751f\u30c7\u30fc\u30bf\u3092\u4fdd\u5b58\u3059\u308b\u3088\u3046\u306b\u8a2d\u8a08\u3055\u308c\u3066\u3044\u307e\u3059\u3002\u30c7\u30fc\u30bf \u30ec\u30a4\u30af\u306e\u30c7\u30fc\u30bf\u306f\u3001\u901a\u5e38\u3001\u5230\u7740\u6642\u3068\u540c\u3058\u5f62\u5f0f\u3067\u4fdd\u5b58\u3055\u308c\u307e\u3059\u3002\u3053\u306e\u30c7\u30fc\u30bf\u306f\u3001\u4e00\u9023\u306e\u30aa\u30d6\u30b8\u30a7\u30af\u30c8 BLOB \u307e\u305f\u306f\u30d5\u30a1\u30a4\u30eb\u306b\u4fdd\u5b58\u3055\u308c\u308b\u3053\u3068\u304c\u3088\u304f\u3042\u308a\u307e\u3059\u3002\u3053\u308c\u3089\u306e\u30aa\u30d6\u30b8\u30a7\u30af\u30c8 BLOB \u306f\u3001\u30b9\u30b1\u30fc\u30e9\u30d6\u30eb\u306a\u30b9\u30c8\u30ec\u30fc\u30b8 \u30a4\u30f3\u30d5\u30e9\u30b9\u30c8\u30e9\u30af\u30c1\u30e3\u5168\u4f53\u306b\u9ad8\u5ea6\u306b\u5206\u6563\u3055\u308c\u305f\u65b9\u6cd5\u3067\u4fdd\u5b58\u3067\u304d\u307e\u3059\u3002\u3053\u306e\u30a4\u30f3\u30d5\u30e9\u30b9\u30c8\u30e9\u30af\u30c1\u30e3\u306f\u3001\u591a\u304f\u306e\u5834\u5408\u3001\u8907\u6570\u306e\u30b5\u30fc\u30d0\u30fc\u307e\u305f\u306f\u8907\u6570\u306e\u5834\u6240\u306b\u307e\u305f\u304c\u308a\u307e\u3059\u3002<\/p>\n<p>\u30c7\u30fc\u30bf \u30ec\u30a4\u30af \u30a2\u30fc\u30ad\u30c6\u30af\u30c1\u30e3\u306f\u3001\u30c7\u30fc\u30bf\u3092\u683c\u7d0d\u3059\u308b\u305f\u3081\u306e\u975e\u5e38\u306b\u30b9\u30b1\u30fc\u30e9\u30d6\u30eb\u3067\u67d4\u8edf\u306a\u65b9\u6cd5\u3067\u3059\u3002\u30c7\u30fc\u30bf\u306f\u3001\u521d\u671f\u51e6\u7406\u3084\u30b9\u30ad\u30fc\u30de\u8a2d\u8a08\u3092\u5fc5\u8981\u3068\u305b\u305a\u306b\u3001\u751f\u6210\u3055\u308c\u305f\u6642\u70b9\u3067\u30ec\u30a4\u30af\u306b\u8ffd\u52a0\u3067\u304d\u307e\u3059\u3002\u3053\u308c\u306b\u3088\u308a\u3001\u30ea\u30a2\u30eb\u30bf\u30a4\u30e0\u306e\u30c7\u30fc\u30bf\u53d6\u308a\u8fbc\u307f\u3068\u5206\u6790\u304c\u53ef\u80fd\u306b\u306a\u308a\u307e\u3059\u3002\u305d\u306e\u5f8c\u3001\u30e6\u30fc\u30b6\u30fc\u306f\u30ec\u30a4\u30af\u5185\u306e\u751f\u30c7\u30fc\u30bf\u306b\u30a2\u30af\u30bb\u30b9\u3057\u3001\u51e6\u7406\u3057\u3066\u3001\u7279\u5b9a\u306e\u30cb\u30fc\u30ba\u306b\u5fdc\u3058\u3066\u69cb\u9020\u5316\u3059\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002\u3053\u308c\u306f\u901a\u5e38\u3001Apache Hadoop \u3084 Spark \u306a\u3069\u306e\u5206\u6563\u51e6\u7406\u30d5\u30ec\u30fc\u30e0\u30ef\u30fc\u30af\u3092\u4f7f\u7528\u3057\u3066\u884c\u308f\u308c\u307e\u3059\u3002<\/p>\n<h2>\u30c7\u30fc\u30bf\u30ec\u30a4\u30af\u306e\u4e3b\u306a\u7279\u5fb4<\/h2>\n<p>\u30c7\u30fc\u30bf \u30ec\u30a4\u30af\u306e\u91cd\u8981\u306a\u6a5f\u80fd\u306e\u4e00\u90e8\u3092\u4ee5\u4e0b\u306b\u793a\u3057\u307e\u3059\u3002<\/p>\n<ul>\n<li>\n<p><strong>\u30b9\u30b1\u30fc\u30e9\u30d3\u30ea\u30c6\u30a3<\/strong>\u30c7\u30fc\u30bf \u30ec\u30a4\u30af\u306f\u3001\u30c6\u30e9\u30d0\u30a4\u30c8\u304b\u3089\u30da\u30bf\u30d0\u30a4\u30c8\u3001\u3055\u3089\u306b\u305d\u308c\u4ee5\u4e0a\u306e\u898f\u6a21\u307e\u3067\u3001\u81a8\u5927\u306a\u91cf\u306e\u30c7\u30fc\u30bf\u3092\u51e6\u7406\u3067\u304d\u307e\u3059\u3002\u305d\u306e\u305f\u3081\u3001\u30d3\u30c3\u30b0 \u30c7\u30fc\u30bf\u306e\u4fdd\u5b58\u306b\u6700\u9069\u3067\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u67d4\u8edf\u6027<\/strong>\u30c7\u30fc\u30bf \u30ec\u30a4\u30af\u306b\u306f\u3001\u69cb\u9020\u5316\u30c7\u30fc\u30bf\u3001\u534a\u69cb\u9020\u5316\u30c7\u30fc\u30bf\u3001\u975e\u69cb\u9020\u5316\u30c7\u30fc\u30bf\u306a\u3069\u3001\u3042\u3089\u3086\u308b\u7a2e\u985e\u306e\u30c7\u30fc\u30bf\u3092\u4fdd\u5b58\u3067\u304d\u307e\u3059\u3002\u3053\u308c\u306b\u3088\u308a\u3001\u7d44\u7e54\u306f\u3055\u307e\u3056\u307e\u306a\u30c7\u30fc\u30bf \u30bf\u30a4\u30d7\u3092 1 \u304b\u6240\u306b\u4fdd\u5b58\u3057\u3066\u5206\u6790\u3067\u304d\u308b\u3088\u3046\u306b\u306a\u308a\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u6a5f\u654f<\/strong>\u30c7\u30fc\u30bf \u30ec\u30a4\u30af\u3092\u4f7f\u7528\u3059\u308b\u3068\u3001\u4fdd\u5b58\u524d\u306b\u30c7\u30fc\u30bf\u3092\u51e6\u7406\u3059\u308b\u5fc5\u8981\u304c\u306a\u3044\u305f\u3081\u3001\u30c7\u30fc\u30bf\u306e\u53d6\u308a\u8fbc\u307f\u3092\u9ad8\u901f\u5316\u3067\u304d\u307e\u3059\u3002\u307e\u305f\u3001\u30e6\u30fc\u30b6\u30fc\u304c\u751f\u30c7\u30fc\u30bf\u3092\u76f4\u63a5\u64cd\u4f5c\u3067\u304d\u308b\u305f\u3081\u3001\u30c7\u30fc\u30bf\u306e\u63a2\u7d22\u3068\u767a\u898b\u3082\u8fc5\u901f\u5316\u3055\u308c\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3\u3068\u30ac\u30d0\u30ca\u30f3\u30b9<\/strong>: \u6700\u65b0\u306e\u30c7\u30fc\u30bf \u30ec\u30a4\u30af\u306b\u306f\u3001\u30c7\u30fc\u30bf\u3078\u306e\u30a2\u30af\u30bb\u30b9\u3092\u5236\u5fa1\u3057\u3001\u30c7\u30fc\u30bf\u306e\u54c1\u8cea\u3092\u78ba\u4fdd\u3057\u3001\u30c7\u30fc\u30bf\u4f7f\u7528\u306e\u76e3\u67fb\u8a3c\u8de1\u3092\u7dad\u6301\u3059\u308b\u305f\u3081\u306e\u5f37\u529b\u306a\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3\u5bfe\u7b56\u3068\u30ac\u30d0\u30ca\u30f3\u30b9 \u30e1\u30ab\u30cb\u30ba\u30e0\u304c\u7d44\u307f\u8fbc\u307e\u308c\u3066\u3044\u307e\u3059\u3002<\/p>\n<\/li>\n<\/ul>\n<h2>\u30c7\u30fc\u30bf\u30ec\u30a4\u30af\u306e\u7a2e\u985e<\/h2>\n<p>\u30c7\u30fc\u30bf \u30ec\u30a4\u30af\u306b\u306f\u4e3b\u306b\u6b21\u306e 2 \u3064\u306e\u7a2e\u985e\u304c\u3042\u308a\u307e\u3059\u3002<\/p>\n<ol>\n<li>\n<p><strong>\u30aa\u30f3\u30d7\u30ec\u30df\u30b9\u30c7\u30fc\u30bf\u30ec\u30a4\u30af<\/strong>: \u3053\u308c\u3089\u306f\u7d44\u7e54\u306e\u30ed\u30fc\u30ab\u30eb \u30b5\u30fc\u30d0\u30fc \u30a4\u30f3\u30d5\u30e9\u30b9\u30c8\u30e9\u30af\u30c1\u30e3\u306b\u5c55\u958b\u3055\u308c\u307e\u3059\u3002\u30c7\u30fc\u30bf\u306e\u5236\u5fa1\u304c\u5f37\u5316\u3055\u308c\u307e\u3059\u304c\u3001\u30bb\u30c3\u30c8\u30a2\u30c3\u30d7\u3068\u30e1\u30f3\u30c6\u30ca\u30f3\u30b9\u306b\u591a\u5927\u306a\u30ea\u30bd\u30fc\u30b9\u304c\u5fc5\u8981\u306b\u306a\u308a\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u30af\u30e9\u30a6\u30c9\u30d9\u30fc\u30b9\u306e\u30c7\u30fc\u30bf\u30ec\u30a4\u30af<\/strong>: \u3053\u308c\u3089\u306f\u3001Amazon S3\u3001Azure Data Lake Storage\u3001Google Cloud Storage \u306a\u3069\u306e\u30af\u30e9\u30a6\u30c9 \u30d7\u30e9\u30c3\u30c8\u30d5\u30a9\u30fc\u30e0\u3067\u30db\u30b9\u30c8\u3055\u308c\u307e\u3059\u3002\u30b9\u30b1\u30fc\u30e9\u30d3\u30ea\u30c6\u30a3\u3001\u67d4\u8edf\u6027\u3001\u30b3\u30b9\u30c8\u52b9\u7387\u306b\u512a\u308c\u3066\u3044\u307e\u3059\u304c\u3001\u30af\u30e9\u30a6\u30c9 \u30b5\u30fc\u30d3\u30b9 \u30d7\u30ed\u30d0\u30a4\u30c0\u30fc\u306e\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3\u3068\u4fe1\u983c\u6027\u306b\u4f9d\u5b58\u3057\u307e\u3059\u3002<\/p>\n<\/li>\n<\/ol>\n<table>\n<thead>\n<tr>\n<th>\u30bf\u30a4\u30d7<\/th>\n<th>\u9577\u6240<\/th>\n<th>\u77ed\u6240<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>\u30aa\u30f3\u30d7\u30ec\u30df\u30b9\u30c7\u30fc\u30bf\u30ec\u30a4\u30af<\/td>\n<td>\u30c7\u30fc\u30bf\u306e\u5b8c\u5168\u306a\u5236\u5fa1\u3001\u7279\u5b9a\u306e\u30cb\u30fc\u30ba\u306b\u5408\u308f\u305b\u3066\u30ab\u30b9\u30bf\u30de\u30a4\u30ba\u53ef\u80fd<\/td>\n<td>\u30bb\u30c3\u30c8\u30a2\u30c3\u30d7\u3068\u30e1\u30f3\u30c6\u30ca\u30f3\u30b9\u306e\u30b3\u30b9\u30c8\u304c\u9ad8\u304f\u3001\u30ea\u30bd\u30fc\u30b9\u3092\u5927\u91cf\u306b\u6d88\u8cbb\u3059\u308b<\/td>\n<\/tr>\n<tr>\n<td>\u30af\u30e9\u30a6\u30c9\u30d9\u30fc\u30b9\u306e\u30c7\u30fc\u30bf\u30ec\u30a4\u30af<\/td>\n<td>\u9ad8\u3044\u62e1\u5f35\u6027\u3001\u30b3\u30b9\u30c8\u52b9\u7387<\/td>\n<td>\u30af\u30e9\u30a6\u30c9\u30b5\u30fc\u30d3\u30b9\u30d7\u30ed\u30d0\u30a4\u30c0\u30fc\u306e\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3\u3068\u4fe1\u983c\u6027\u306b\u4f9d\u5b58\u3059\u308b<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<h2>\u30c7\u30fc\u30bf\u30ec\u30a4\u30af\u306e\u6d3b\u7528: \u8ab2\u984c\u3068\u89e3\u6c7a\u7b56<\/h2>\n<p>\u30c7\u30fc\u30bf \u30ec\u30a4\u30af\u306b\u3088\u308a\u3001\u7d44\u7e54\u306f\u30c7\u30fc\u30bf\u304b\u3089\u8cb4\u91cd\u306a\u6d1e\u5bdf\u3092\u5f15\u304d\u51fa\u3059\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002\u305f\u3060\u3057\u3001\u305d\u306e\u5b9f\u88c5\u3068\u4f7f\u7528\u306b\u306f\u8ab2\u984c\u304c\u306a\u3044\u308f\u3051\u3067\u306f\u3042\u308a\u307e\u305b\u3093\u3002\u4e00\u822c\u7684\u306a\u8ab2\u984c\u306b\u306f\u6b21\u306e\u3088\u3046\u306a\u3082\u306e\u304c\u3042\u308a\u307e\u3059\u3002<\/p>\n<ul>\n<li><strong>\u30c7\u30fc\u30bf\u54c1\u8cea<\/strong>\u30c7\u30fc\u30bf \u30ec\u30a4\u30af\u306b\u306f\u3001\u4f4e\u54c1\u8cea\u306e\u30c7\u30fc\u30bf\u3084\u7121\u95a2\u4fc2\u306a\u30c7\u30fc\u30bf\u3082\u542b\u3081\u3001\u3059\u3079\u3066\u306e\u30c7\u30fc\u30bf\u304c\u683c\u7d0d\u3055\u308c\u307e\u3059\u3002\u3053\u308c\u306b\u5bfe\u51e6\u3057\u306a\u3044\u3068\u3001\u5206\u6790\u7d50\u679c\u304c\u60aa\u304f\u306a\u308b\u53ef\u80fd\u6027\u304c\u3042\u308a\u307e\u3059\u3002<\/li>\n<li><strong>\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3\u3068\u30ac\u30d0\u30ca\u30f3\u30b9<\/strong>\u30c7\u30fc\u30bf \u30ec\u30a4\u30af\u3067\u306f\u3001\u672a\u51e6\u7406\u306e\u751f\u30c7\u30fc\u30bf\u3092\u4fdd\u5b58\u3059\u308b\u3068\u3044\u3046\u6027\u8cea\u4e0a\u3001\u30c7\u30fc\u30bf\u3078\u306e\u30a2\u30af\u30bb\u30b9\u306e\u7ba1\u7406\u3084\u76e3\u67fb\u8a3c\u8de1\u306e\u7dad\u6301\u304c\u8907\u96d1\u306b\u306a\u308b\u53ef\u80fd\u6027\u304c\u3042\u308a\u307e\u3059\u3002<\/li>\n<li><strong>\u8907\u96d1<\/strong>\u30c7\u30fc\u30bf \u30ec\u30a4\u30af\u5185\u306e\u672a\u51e6\u7406\u306e\u30c7\u30fc\u30bf\u304c\u81a8\u5927\u306b\u5b58\u5728\u3059\u308b\u3068\u3001\u30e6\u30fc\u30b6\u30fc\u306b\u3068\u3063\u3066\u51e6\u7406\u304c\u56f0\u96e3\u306b\u306a\u308a\u3001\u6df7\u4e71\u3092\u62db\u304f\u53ef\u80fd\u6027\u304c\u3042\u308a\u307e\u3059\u3002<\/li>\n<\/ul>\n<p>\u3053\u308c\u3089\u306e\u8ab2\u984c\u306e\u89e3\u6c7a\u7b56\u3068\u3057\u3066\u306f\u3001\u30e1\u30bf\u30c7\u30fc\u30bf\u7ba1\u7406\u30c4\u30fc\u30eb\u3001\u30c7\u30fc\u30bf\u30ab\u30bf\u30ed\u30b0\u4f5c\u6210\u30c4\u30fc\u30eb\u3001\u5805\u7262\u306a\u30c7\u30fc\u30bf\u30ac\u30d0\u30ca\u30f3\u30b9\u30d5\u30ec\u30fc\u30e0\u30ef\u30fc\u30af\u3001\u30e6\u30fc\u30b6\u30fc\u30c8\u30ec\u30fc\u30cb\u30f3\u30b0\u3068\u6559\u80b2\u306e\u4f7f\u7528\u306a\u3069\u304c\u3042\u308a\u307e\u3059\u3002<\/p>\n<h2>\u30c7\u30fc\u30bf\u30ec\u30a4\u30af\u3068\u985e\u4f3c\u306e\u6982\u5ff5<\/h2>\n<p>\u30c7\u30fc\u30bf \u30ec\u30a4\u30af\u306f\u3001\u30c7\u30fc\u30bf \u30a6\u30a7\u30a2\u30cf\u30a6\u30b9\u3084\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u3068\u6bd4\u8f03\u3055\u308c\u308b\u3053\u3068\u304c\u3088\u304f\u3042\u308a\u307e\u3059\u3002\u6bd4\u8f03\u3059\u308b\u3068\u6b21\u306e\u3088\u3046\u306b\u306a\u308a\u307e\u3059\u3002<\/p>\n<table>\n<thead>\n<tr>\n<th>\u7279\u5fb4<\/th>\n<th>\u30c7\u30fc\u30bf\u30ec\u30a4\u30af<\/th>\n<th>\u30c7\u30fc\u30bf\u30a6\u30a7\u30a2\u30cf\u30a6\u30b9<\/th>\n<th>\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>\u30c7\u30fc\u30bf\u30fb\u30bf\u30a4\u30d7<\/td>\n<td>\u975e\u69cb\u9020\u5316\u3001\u534a\u69cb\u9020\u5316\u3001\u69cb\u9020\u5316<\/td>\n<td>\u69cb\u9020\u5316\u3055\u308c\u305f<\/td>\n<td>\u69cb\u9020\u5316\u3055\u308c\u305f<\/td>\n<\/tr>\n<tr>\n<td>\u30b9\u30ad\u30fc\u30de<\/td>\n<td>\u30b9\u30ad\u30fc\u30de\u30aa\u30f3\u30ea\u30fc\u30c9<\/td>\n<td>\u30b9\u30ad\u30fc\u30de\u30aa\u30f3\u30e9\u30a4\u30c8<\/td>\n<td>\u30b9\u30ad\u30fc\u30de\u30aa\u30f3\u30e9\u30a4\u30c8<\/td>\n<\/tr>\n<tr>\n<td>\u51e6\u7406<\/td>\n<td>\u30d0\u30c3\u30c1\u3068\u30ea\u30a2\u30eb\u30bf\u30a4\u30e0<\/td>\n<td>\u30d0\u30c3\u30c1<\/td>\n<td>\u30ea\u30a2\u30eb\u30bf\u30a4\u30e0<\/td>\n<\/tr>\n<tr>\n<td>\u30b9\u30c8\u30ec\u30fc\u30b8<\/td>\n<td>\u5927\u5bb9\u91cf\u3001\u5b89\u4fa1<\/td>\n<td>\u9650\u5b9a\u7684\u3001\u9ad8\u4fa1<\/td>\n<td>\u9650\u5b9a\u7684\u3001\u9ad8\u4fa1<\/td>\n<\/tr>\n<tr>\n<td>\u30e6\u30fc\u30b6\u30fc<\/td>\n<td>\u30c7\u30fc\u30bf \u30b5\u30a4\u30a8\u30f3\u30c6\u30a3\u30b9\u30c8\u3001\u30c7\u30fc\u30bf\u958b\u767a\u8005<\/td>\n<td>\u30d3\u30b8\u30cd\u30b9\u30a2\u30ca\u30ea\u30b9\u30c8<\/td>\n<td>\u30a2\u30d7\u30ea\u30b1\u30fc\u30b7\u30e7\u30f3\u30e6\u30fc\u30b6\u30fc<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<h2>\u30c7\u30fc\u30bf\u30ec\u30a4\u30af\u306e\u5c06\u6765\u5c55\u671b\u3068\u65b0\u8208\u6280\u8853<\/h2>\n<p>\u30c7\u30fc\u30bf \u30ec\u30a4\u30af\u306e\u5c06\u6765\u306b\u306f\u3001\u81ea\u52d5\u5316\u306e\u5f37\u5316\u3001\u9ad8\u5ea6\u306a\u5206\u6790\u304a\u3088\u3073\u6a5f\u68b0\u5b66\u7fd2\u30c4\u30fc\u30eb\u3068\u306e\u7d71\u5408\u3001\u30c7\u30fc\u30bf \u30ac\u30d0\u30ca\u30f3\u30b9\u306e\u6539\u5584\u304c\u542b\u307e\u308c\u307e\u3059\u3002\u81ea\u52d5\u30e1\u30bf\u30c7\u30fc\u30bf \u30bf\u30b0\u4ed8\u3051\u3001\u62e1\u5f35\u30c7\u30fc\u30bf \u30ab\u30bf\u30ed\u30b0\u3001AI \u3092\u6d3b\u7528\u3057\u305f\u30c7\u30fc\u30bf\u54c1\u8cea\u7ba1\u7406\u306a\u3069\u306e\u30c6\u30af\u30ce\u30ed\u30b8\u306b\u3088\u308a\u3001\u30c7\u30fc\u30bf \u30ec\u30a4\u30af\u306e\u7ba1\u7406\u65b9\u6cd5\u3068\u4f7f\u7528\u65b9\u6cd5\u304c\u518d\u5b9a\u7fa9\u3055\u308c\u308b\u3053\u3068\u306b\u306a\u308a\u307e\u3059\u3002<\/p>\n<p>\u30c7\u30fc\u30bf \u30ec\u30a4\u30af\u3092\u9ad8\u5ea6\u306a\u5206\u6790\u304a\u3088\u3073\u6a5f\u68b0\u5b66\u7fd2\u30d7\u30e9\u30c3\u30c8\u30d5\u30a9\u30fc\u30e0\u3068\u7d71\u5408\u3059\u308b\u3053\u3068\u3067\u3001\u3088\u308a\u9ad8\u5ea6\u306a\u30c7\u30fc\u30bf\u5206\u6790\u6a5f\u80fd\u304c\u5b9f\u73fe\u3057\u307e\u3059\u3002\u3053\u308c\u306b\u3088\u308a\u3001\u81a8\u5927\u306a\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\u304b\u3089\u5b9f\u7528\u7684\u306a\u6d1e\u5bdf\u3092\u30ea\u30a2\u30eb\u30bf\u30a4\u30e0\u3067\u62bd\u51fa\u3067\u304d\u308b\u3088\u3046\u306b\u306a\u308a\u3001\u3088\u308a\u30a4\u30f3\u30c6\u30ea\u30b8\u30a7\u30f3\u30c8\u306a\u30c7\u30fc\u30bf\u99c6\u52d5\u578b\u306e\u30a2\u30d7\u30ea\u30b1\u30fc\u30b7\u30e7\u30f3\u3084\u30b5\u30fc\u30d3\u30b9\u306e\u958b\u767a\u304c\u4fc3\u9032\u3055\u308c\u307e\u3059\u3002<\/p>\n<h2>\u30d7\u30ed\u30ad\u30b7\u30b5\u30fc\u30d0\u30fc\u3068\u30c7\u30fc\u30bf\u30ec\u30a4\u30af<\/h2>\n<p>\u30d7\u30ed\u30ad\u30b7 \u30b5\u30fc\u30d0\u30fc\u306f\u3001\u30c7\u30fc\u30bf\u8ee2\u9001\u306e\u9ad8\u901f\u5316\u3092\u4fc3\u9032\u3057\u3001\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3\u306e\u5c64\u3092\u8ffd\u52a0\u3059\u308b\u3053\u3068\u3067\u3001\u30c7\u30fc\u30bf \u30ec\u30a4\u30af\u306e\u5b9f\u88c5\u3092\u5f37\u5316\u3059\u308b\u305f\u3081\u306b\u4f7f\u7528\u3067\u304d\u307e\u3059\u3002\u30d7\u30ed\u30ad\u30b7 \u30b5\u30fc\u30d0\u30fc\u306f\u3001\u4ed6\u306e\u30b5\u30fc\u30d0\u30fc\u304b\u3089\u30ea\u30bd\u30fc\u30b9\u3092\u6c42\u3081\u308b\u30af\u30e9\u30a4\u30a2\u30f3\u30c8\u304b\u3089\u306e\u8981\u6c42\u306e\u4ef2\u4ecb\u5f79\u3068\u3057\u3066\u6a5f\u80fd\u3059\u308b\u3053\u3068\u3067\u3001\u8ca0\u8377\u306e\u30d0\u30e9\u30f3\u30b9\u3092\u53d6\u308a\u3001\u30c7\u30fc\u30bf\u8ee2\u9001\u901f\u5ea6\u3092\u5411\u4e0a\u3055\u305b\u3001\u30c7\u30fc\u30bf \u30ec\u30a4\u30af\u304b\u3089\u306e\u30c7\u30fc\u30bf\u306e\u53d6\u308a\u8fbc\u307f\u3068\u62bd\u51fa\u3092\u3088\u308a\u52b9\u7387\u7684\u306b\u3057\u307e\u3059\u3002<\/p>\n<p>\u3055\u3089\u306b\u3001\u30d7\u30ed\u30ad\u30b7 \u30b5\u30fc\u30d0\u30fc\u306f\u30c7\u30fc\u30bf \u30bd\u30fc\u30b9\u306b\u533f\u540d\u6027\u3092\u63d0\u4f9b\u3057\u3001\u30c7\u30fc\u30bf \u30bb\u30ad\u30e5\u30ea\u30c6\u30a3\u306e\u5c64\u3092\u8ffd\u52a0\u3059\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002\u3053\u308c\u306f\u3001\u5927\u91cf\u306e\u672a\u52a0\u5de5\u306e\u3001\u591a\u304f\u306e\u5834\u5408\u6a5f\u5bc6\u6027\u306e\u9ad8\u3044\u30c7\u30fc\u30bf\u304c\u4fdd\u5b58\u3055\u308c\u3066\u3044\u308b\u3053\u3068\u3092\u8003\u3048\u308b\u3068\u3001\u30c7\u30fc\u30bf \u30ec\u30a4\u30af\u306e\u30b3\u30f3\u30c6\u30ad\u30b9\u30c8\u3067\u306f\u975e\u5e38\u306b\u91cd\u8981\u3067\u3059\u3002<\/p>\n<h2>\u95a2\u9023\u30ea\u30f3\u30af<\/h2>\n<p>\u30c7\u30fc\u30bf \u30ec\u30a4\u30af\u306e\u8a73\u7d30\u306b\u3064\u3044\u3066\u306f\u3001\u6b21\u306e\u30ea\u30bd\u30fc\u30b9\u3092\u53c2\u7167\u3057\u3066\u304f\u3060\u3055\u3044\u3002<\/p>\n<ul>\n<li><a href=\"https:\/\/aws.amazon.com\/big-data\/datalakes-and-analytics\/what-is-a-data-lake\/\" target=\"_new\" rel=\"noopener nofollow\">\u30c7\u30fc\u30bf\u30ec\u30a4\u30af\u3068\u306f\u4f55\u3067\u3059\u304b?<\/a> \u2013 \u30a2\u30de\u30be\u30f3AWS<\/li>\n<li><a href=\"https:\/\/towardsdatascience.com\/data-lake-a-brief-introduction-4fb1fad6d2df\" target=\"_new\" rel=\"noopener nofollow\">\u30c7\u30fc\u30bf\u30ec\u30a4\u30af \u2013 \u7c21\u5358\u306a\u7d39\u4ecb<\/a> \u2013 \u30c7\u30fc\u30bf\u30b5\u30a4\u30a8\u30f3\u30b9\u306b\u5411\u3051\u3066<\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/architecture\/data-guide\/big-data\/\" target=\"_new\" rel=\"noopener nofollow\">\u30c7\u30fc\u30bf\u30ec\u30a4\u30af\u5165\u9580<\/a> \u2013 Microsoft Azure \u30c9\u30ad\u30e5\u30e1\u30f3\u30c8<\/li>\n<li><a href=\"https:\/\/www.oreilly.com\/library\/view\/what-is-data\/9781491973890\/\" target=\"_new\" rel=\"noopener nofollow\">\u30c7\u30fc\u30bf \u30ec\u30a4\u30af\u3068\u306f\u4f55\u3067\u3059\u304b? \u306a\u305c\u91cd\u8981\u306a\u306e\u3067\u3059\u304b?<\/a> \u2013 \u30aa\u30e9\u30a4\u30ea\u30fc\u30e1\u30c7\u30a3\u30a2<\/li>\n<li><a href=\"https:\/\/www.dataversity.net\/data-lakes-purposes-practices-patterns-platforms\/\" target=\"_new\" rel=\"noopener nofollow\">\u30c7\u30fc\u30bf\u30ec\u30a4\u30af: \u76ee\u7684\u3001\u5b9f\u8df5\u3001\u30d1\u30bf\u30fc\u30f3\u3001\u30d7\u30e9\u30c3\u30c8\u30d5\u30a9\u30fc\u30e0<\/a> \u2013 \u30c7\u30fc\u30bf\u30d0\u30fc\u30b7\u30c6\u30a3<\/li>\n<\/ul>","protected":false},"featured_media":468113,"menu_order":0,"template":"","meta":{"_acf_changed":false,"content-type":"","inline_featured_image":false,"footnotes":""},"class_list":["post-476653","wiki","type-wiki","status-publish","has-post-thumbnail","hentry"],"acf":{"faq_title":"Frequently Asked Questions about <mark>Data Lake: A Comprehensive Overview<\/mark>","faq_items":[{"question":"What is a Data Lake?","answer":"<p>A Data Lake is a centralized storage system that allows for the storage of large amounts of raw data in its native format until it is needed. These systems can store data from different sources and support different data types, including structured, semi-structured, and unstructured data.<\/p>"},{"question":"Who first introduced the term \"Data Lake\"?","answer":"<p>The term \"Data Lake\" was first introduced by James Dixon, the CTO of Pentaho, a data integration company, in 2010.<\/p>"},{"question":"How does a Data Lake work?","answer":"<p>Data lakes store data in an unprocessed format, often as a series of object blobs or files. Users can then access the raw data in the lake, process it, and structure it as required for their specific needs. This is typically done through the use of distributed processing frameworks such as Apache Hadoop or Spark.<\/p>"},{"question":"What are the key features of Data Lakes?","answer":"<p>Data Lakes are scalable, flexible, and agile. They can handle massive amounts of data, store all types of data - structured, semi-structured, and unstructured, and enable fast data ingestion. They also incorporate robust security measures and governance mechanisms.<\/p>"},{"question":"What are the two primary types of Data Lakes?","answer":"<p>The two primary types of Data Lakes are On-Premises Data Lakes and Cloud-Based Data Lakes.<\/p>"},{"question":"What are the challenges in implementing and using Data Lakes?","answer":"<p>Some common challenges include ensuring data quality, managing security and governance, and dealing with the complexity of navigating vast amounts of unprocessed data.<\/p>"},{"question":"How do Data Lakes compare with Data Warehouses and Databases?","answer":"<p>Data Lakes can store unstructured, semi-structured, and structured data, while Data Warehouses and Databases typically store only structured data. Data Lakes use a schema-on-read approach, while Data Warehouses and Databases use a schema-on-write approach.<\/p>"},{"question":"How can Proxy Servers be used with Data Lakes?","answer":"<p>Proxy Servers can enhance data lake implementation by facilitating faster data transfer and providing an additional layer of security. They can help balance loads and improve data transfer speeds, making data ingestion and extraction from the data lake more efficient.<\/p>"},{"question":"What are the future perspectives and emerging technologies in Data Lakes?","answer":"<p>The future of data lakes involves increased automation, integration with advanced analytics and machine learning tools, and improved data governance. Technologies such as automated metadata tagging, augmented data cataloging, and AI-powered data quality management are set to redefine how data lakes are managed and used.<\/p>"}]},"_links":{"self":[{"href":"https:\/\/oneproxy.pro\/jp\/wp-json\/wp\/v2\/wiki\/476653","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/oneproxy.pro\/jp\/wp-json\/wp\/v2\/wiki"}],"about":[{"href":"https:\/\/oneproxy.pro\/jp\/wp-json\/wp\/v2\/types\/wiki"}],"version-history":[{"count":0,"href":"https:\/\/oneproxy.pro\/jp\/wp-json\/wp\/v2\/wiki\/476653\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/oneproxy.pro\/jp\/wp-json\/wp\/v2\/media\/468113"}],"wp:attachment":[{"href":"https:\/\/oneproxy.pro\/jp\/wp-json\/wp\/v2\/media?parent=476653"}],"curies":[{"name":"\u3046\u30fc\u3093","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}