{"id":478342,"date":"2023-08-09T09:31:27","date_gmt":"2023-08-09T09:31:27","guid":{"rendered":""},"modified":"2023-09-05T11:16:35","modified_gmt":"2023-09-05T11:16:35","slug":"parquet","status":"publish","type":"wiki","link":"https:\/\/oneproxy.pro\/kr\/wiki\/parquet\/","title":{"rendered":"\ucabd\ub9e4 \uc138\uacf5"},"content":{"rendered":"<p>Parquet\uc740 \ub300\ub7c9\uc758 \ub370\uc774\ud130\ub97c \ud6a8\uc728\uc801\uc73c\ub85c \uc800\uc7a5\ud558\uace0 \ucc98\ub9ac\ud558\ub3c4\ub85d \uc124\uacc4\ub41c \uc5f4 \uae30\ubc18 \uc800\uc7a5 \ud30c\uc77c \ud615\uc2dd\uc785\ub2c8\ub2e4. 2013\ub144 Cloudera\uc640 Twitter\uac00 \uc624\ud508 \uc18c\uc2a4 \ud504\ub85c\uc81d\ud2b8\ub85c \uac1c\ubc1c\ud588\uc2b5\ub2c8\ub2e4. Parquet\uc758 \uc8fc\uc694 \ubaa9\ud45c\ub294 \ube45 \ub370\uc774\ud130 \ubd84\uc11d\uc744 \uc704\ud55c \ub370\uc774\ud130 \uc800\uc7a5 \ubc0f \ucc98\ub9ac\ub97c \ucd5c\uc801\ud654\ud558\uc5ec \ub370\uc774\ud130 \uc6e8\uc5b4\ud558\uc6b0\uc9d5, \ub370\uc774\ud130 \ub808\uc774\ud06c \ubc0f Apache\uc758 \uc0ac\uc6a9 \uc0ac\ub840\uc5d0 \uc774\uc0c1\uc801\uc778 \ud615\uc2dd\uc744 \ub9cc\ub4dc\ub294 \uac83\uc785\ub2c8\ub2e4. \ud558\ub461 \uc0dd\ud0dc\uacc4.<\/p>\n<h2>\ucabd\ubaa8\uc774 \uc138\uacf5\uc758 \uae30\uc6d0\uacfc \uccab \ubc88\uc9f8 \uc5b8\uae09\uc758 \uc5ed\uc0ac<\/h2>\n<p>Parquet\uc758 \uae30\uc6d0\uc740 \ube45 \ub370\uc774\ud130\uc758 \ud6a8\uc728\uc801\uc778 \uc800\uc7a5 \ubc0f \ucc98\ub9ac\uc5d0 \ub300\ud55c \ud544\uc694\uc131\uc73c\ub85c \uac70\uc2ac\ub7ec \uc62c\ub77c\uac11\ub2c8\ub2e4. \ube45\ub370\uc774\ud130 \uae30\uc220\uc774 \ubc1c\uc804\ud558\uba74\uc11c \uae30\uc874 \uc2a4\ud1a0\ub9ac\uc9c0 \ud615\uc2dd\uc740 \ub300\uaddc\ubaa8 \ub370\uc774\ud130\uc138\ud2b8\ub97c \ucc98\ub9ac\ud558\ub294 \ub370 \uc5b4\ub824\uc6c0\uc744 \uacaa\uc5c8\uc2b5\ub2c8\ub2e4. Parquet\uc758 \uac1c\ubc1c\uc740 \uae30\ub465\ud615 \uc2a4\ud1a0\ub9ac\uc9c0 \uc811\uadfc \ubc29\uc2dd\uc744 \ub3c4\uc785\ud558\uc5ec \uc774\ub7ec\ud55c \ubb38\uc81c\ub97c \ud574\uacb0\ud558\ub294 \uac83\uc744 \ubaa9\ud45c\ub85c \ud588\uc2b5\ub2c8\ub2e4.<\/p>\n<p>Parquet\uc5d0 \ub300\ud55c \uccab \ubc88\uc9f8 \uc5b8\uae09\uc740 2013\ub144 SOSP(\uc6b4\uc601 \uccb4\uc81c \uc6d0\ub9ac \uc2ec\ud3ec\uc9c0\uc5c4)\uc5d0\uc11c Twitter \uc5d4\uc9c0\ub2c8\uc5b4\uac00 \ubc1c\ud45c\ud55c \uc5f0\uad6c \ub17c\ubb38\uc5d0\uc11c \ucc3e\uc744 \uc218 \uc788\uc2b5\ub2c8\ub2e4. \uc774 \ub17c\ubb38\uc5d0\uc11c \uadf8\ub4e4\uc740 Parquet \ud615\uc2dd\uc744 \uc18c\uac1c\ud558\uace0 \ub354 \ub098\uc740 \uc555\ucd95, \uac1c\uc120\ub41c \ucffc\ub9ac\uc640 \uac19\uc740 \uc774\uc810\uc744 \uac15\uc870\ud588\uc2b5\ub2c8\ub2e4. \uc131\ub2a5 \ubc0f \ubcf5\uc7a1\ud55c \ub370\uc774\ud130 \uc720\ud615 \uc9c0\uc6d0.<\/p>\n<h2>\ucabd\ubaa8\uc774 \uc138\uacf5\uc5d0 \ub300\ud55c \uc790\uc138\ud55c \uc815\ubcf4: \uc8fc\uc81c \ud655\uc7a5<\/h2>\n<p>Parquet\ub294 \ub370\uc774\ud130\uac00 \ud589\uc774 \uc544\ub2cc \uc5f4\ub85c \uc800\uc7a5\ub418\uace0 \uad6c\uc131\ub418\ub294 \uc5f4\ud615 \uc2a4\ud1a0\ub9ac\uc9c0 \uc811\uadfc \ubc29\uc2dd\uc744 \ub530\ub985\ub2c8\ub2e4. \uc774 \uc124\uacc4\ub294 \ub2e4\uc591\ud55c \uc131\ub2a5 \ucd5c\uc801\ud654\ub97c \uac00\ub2a5\ud558\uac8c \ud558\uba70 \ud2b9\ud788 \ubd84\uc11d \uc6cc\ud06c\ub85c\ub4dc\uc5d0 \uc720\ub9ac\ud569\ub2c8\ub2e4. Parquet\uc758 \uc8fc\uc694 \ud2b9\uc9d5\uc740 \ub2e4\uc74c\uacfc \uac19\uc2b5\ub2c8\ub2e4.<\/p>\n<ol>\n<li>\n<p><strong>\uae30\ub465\ud615 \uc800\uc7a5\uc18c:<\/strong> Parquet\ub294 \uac01 \uc5f4\uc744 \ubcc4\ub3c4\ub85c \uc800\uc7a5\ud558\ubbc0\ub85c \uc555\ucd95\uc774 \ud5a5\uc0c1\ub418\uace0 \ucffc\ub9ac \uc2e4\ud589 \uc911\uc5d0 \ud544\uc694\ud55c \uc5f4\ub9cc \uc77d\uc744 \uc218 \uc788\uc2b5\ub2c8\ub2e4.<\/p>\n<\/li>\n<li>\n<p><strong>\uc555\ucd95 \uae30\uc220:<\/strong> Parquet\uc740 Snappy, Gzip, Zstandard \ub4f1 \ub2e4\uc591\ud55c \uc555\ucd95 \uc54c\uace0\ub9ac\uc998\uc744 \uc0ac\uc6a9\ud558\uc5ec \uc800\uc7a5 \uacf5\uac04\uc744 \uc904\uc774\uace0 \ub370\uc774\ud130 \uc77d\uae30 \uc131\ub2a5\uc744 \ud5a5\uc0c1\uc2dc\ud0b5\ub2c8\ub2e4.<\/p>\n<\/li>\n<li>\n<p><strong>\ub370\uc774\ud130 \uc720\ud615 \uc9c0\uc6d0:<\/strong> \uae30\ubcf8 \uc720\ud615(\uc608: \uc815\uc218, \ubb38\uc790\uc5f4, \ubd80\uc6b8) \ubc0f \ubcf5\ud569 \uc720\ud615(\uc608: \ubc30\uc5f4, \ub9f5, \uad6c\uc870\uccb4)\uc744 \ud3ec\ud568\ud55c \ub2e4\uc591\ud55c \ub370\uc774\ud130 \uc720\ud615\uc5d0 \ub300\ud55c \uad11\ubc94\uc704\ud55c \uc9c0\uc6d0\uc744 \uc81c\uacf5\ud569\ub2c8\ub2e4.<\/p>\n<\/li>\n<li>\n<p><strong>\uc2a4\ud0a4\ub9c8 \uc9c4\ud654:<\/strong> Parquet\ub294 \uc2a4\ud0a4\ub9c8 \ubc1c\uc804\uc744 \uc9c0\uc6d0\ud558\ubbc0\ub85c \uc0ac\uc6a9\uc790\ub294 \uae30\uc874 \ub370\uc774\ud130\uc640\uc758 \ud638\ud658\uc131\uc744 \uc720\uc9c0\ud558\uba74\uc11c \uc2dc\uac04\uc774 \uc9c0\ub0a8\uc5d0 \ub530\ub77c \uc5f4\uc744 \ucd94\uac00, \uc81c\uac70 \ub610\ub294 \uc218\uc815\ud560 \uc218 \uc788\uc2b5\ub2c8\ub2e4.<\/p>\n<\/li>\n<li>\n<p><strong>\uc870\uac74\uc790 \ud478\uc2dc\ub2e4\uc6b4:<\/strong> \uc774 \uae30\ub2a5\uc740 \ucffc\ub9ac \uc870\uac74\uc790\ub97c \uc2a4\ud1a0\ub9ac\uc9c0 \uacc4\uce35\uc73c\ub85c \ud478\uc2dc\ud558\uc5ec \ucffc\ub9ac \uc2e4\ud589 \uc911\uc5d0 \uc77d\uc5b4\uc57c \ud558\ub294 \ub370\uc774\ud130 \uc591\uc744 \uc904\uc785\ub2c8\ub2e4.<\/p>\n<\/li>\n<li>\n<p><strong>\ubcd1\ub82c \ucc98\ub9ac:<\/strong> Parquet \ud30c\uc77c\uc744 \ub354 \uc791\uc740 \ud589 \uadf8\ub8f9\uc73c\ub85c \ubd84\ud560\ud558\uc5ec Hadoop\uacfc \uac19\uc740 \ubd84\uc0b0 \ud658\uacbd\uc5d0\uc11c \ubcd1\ub82c \ucc98\ub9ac\ub97c \uc218\ud589\ud560 \uc218 \uc788\uc2b5\ub2c8\ub2e4.<\/p>\n<\/li>\n<li>\n<p><strong>\ud50c\ub7ab\ud3fc \uac04 \ud638\ud658\uc131:<\/strong> Parquet\ub294 \ud50c\ub7ab\ud3fc \ub3c5\ub9bd\uc801\uc73c\ub85c \uc124\uacc4\ub418\uc5b4 \uc11c\ub85c \ub2e4\ub978 \uc2dc\uc2a4\ud15c \uac04\uc5d0 \uc6d0\ud65c\ud55c \ub370\uc774\ud130 \uad50\ud658\uc774 \uac00\ub2a5\ud569\ub2c8\ub2e4.<\/p>\n<\/li>\n<\/ol>\n<h2>\ucabd\ubaa8\uc774 \uc138\uacf5\uc758 \ub0b4\ubd80 \uad6c\uc870: \ucabd\ubaa8\uc774 \uc138\uacf5\uc758 \uc791\ub3d9 \ubc29\uc2dd<\/h2>\n<p>Parquet \ud30c\uc77c\uc740 \ud6a8\uc728\uc801\uc778 \uc800\uc7a5 \ubc0f \ucc98\ub9ac \uae30\ub2a5\uc5d0 \uae30\uc5ec\ud558\ub294 \uc5ec\ub7ec \uad6c\uc131 \uc694\uc18c\ub85c \uad6c\uc131\ub429\ub2c8\ub2e4.<\/p>\n<ol>\n<li>\n<p><strong>\ud30c\uc77c \uba54\ud0c0\ub370\uc774\ud130:<\/strong> \ud30c\uc77c\uc758 \uc2a4\ud0a4\ub9c8, \uc0ac\uc6a9\ub41c \uc555\ucd95 \uc54c\uace0\ub9ac\uc998 \ubc0f \uae30\ud0c0 \uc18d\uc131\uc5d0 \ub300\ud55c \uc815\ubcf4\uac00 \ud3ec\ud568\ub418\uc5b4 \uc788\uc2b5\ub2c8\ub2e4.<\/p>\n<\/li>\n<li>\n<p><strong>\ud589 \uadf8\ub8f9:<\/strong> \uac01 Parquet \ud30c\uc77c\uc740 \ud589 \uadf8\ub8f9\uc73c\ub85c \ub098\ub204\uc5b4\uc9c0\uace0, \uc774 \uadf8\ub8f9\uc740 \ub2e4\uc2dc \uc5f4\ub85c \ub098\ub269\ub2c8\ub2e4. \ud589 \uadf8\ub8f9\uc740 \ubcd1\ub82c \ucc98\ub9ac \ubc0f \ub370\uc774\ud130 \uc555\ucd95\uc5d0 \ub3c4\uc6c0\uc774 \ub429\ub2c8\ub2e4.<\/p>\n<\/li>\n<li>\n<p><strong>\uc5f4 \uba54\ud0c0\ub370\uc774\ud130:<\/strong> \uac01 \uc5f4\uc5d0 \ub300\ud574 Parquet\ub294 \ub370\uc774\ud130 \uc720\ud615, \uc555\ucd95 \ucf54\ub371, \uc778\ucf54\ub529 \uc815\ubcf4\uc640 \uac19\uc740 \uba54\ud0c0\ub370\uc774\ud130\ub97c \uc800\uc7a5\ud569\ub2c8\ub2e4.<\/p>\n<\/li>\n<li>\n<p><strong>\ub370\uc774\ud130 \ud398\uc774\uc9c0:<\/strong> \ub370\uc774\ud130 \ud398\uc774\uc9c0\ub294 \uc2e4\uc81c \uc5f4 \ud615\uc2dd \ub370\uc774\ud130\ub97c \uc800\uc7a5\ud558\uace0 \uac1c\ubcc4\uc801\uc73c\ub85c \uc555\ucd95\ub418\uc5b4 \uc800\uc7a5 \ud6a8\uc728\uc131\uc744 \uadf9\ub300\ud654\ud569\ub2c8\ub2e4.<\/p>\n<\/li>\n<li>\n<p><strong>\uc0ac\uc804 \ud398\uc774\uc9c0(\uc120\ud0dd \uc0ac\ud56d):<\/strong> \ubc18\ubcf5\ub418\ub294 \uac12\uc774 \uc788\ub294 \uc5f4\uc758 \uacbd\uc6b0 Parquet\ub294 \uc0ac\uc804 \uc778\ucf54\ub529\uc744 \uc0ac\uc6a9\ud558\uc5ec \uace0\uc720\ud55c \uac12\uc744 \uc800\uc7a5\ud558\uace0 \ub370\uc774\ud130 \ud398\uc774\uc9c0 \ub0b4\uc5d0\uc11c \uc774\ub97c \ucc38\uc870\ud569\ub2c8\ub2e4.<\/p>\n<\/li>\n<li>\n<p><strong>\ud1b5\uacc4:<\/strong> Parquet\ub294 \ucffc\ub9ac \ucd5c\uc801\ud654\uc5d0 \ud65c\uc6a9\ud560 \uc218 \uc788\ub294 \ucd5c\uc18c\uac12 \ubc0f \ucd5c\ub300\uac12\uacfc \uac19\uc740 \uac01 \uc5f4\uc5d0 \ub300\ud55c \ud1b5\uacc4\ub3c4 \uc800\uc7a5\ud560 \uc218 \uc788\uc2b5\ub2c8\ub2e4.<\/p>\n<\/li>\n<\/ol>\n<h2>\ucabd\ubaa8\uc774 \uc138\uacf5\uc758 \uc8fc\uc694 \ud2b9\uc9d5 \ubd84\uc11d<\/h2>\n<p>Parquet\uc758 \uc8fc\uc694 \uae30\ub2a5\uc740 \ube45 \ub370\uc774\ud130 \ucc98\ub9ac \ubd84\uc57c\uc5d0\uc11c Parquet\uc758 \uad11\ubc94\uc704\ud55c \ucc44\ud0dd\uacfc \uc778\uae30\uc5d0 \uae30\uc5ec\ud569\ub2c8\ub2e4. \ub2e4\uc74c \uae30\ub2a5 \uc911 \uc77c\ubd80\ub97c \ubd84\uc11d\ud574 \ubcf4\uaca0\uc2b5\ub2c8\ub2e4.<\/p>\n<ol>\n<li>\n<p><strong>\ud6a8\uc728\uc801\uc778 \uc555\ucd95:<\/strong> Parquet\uc758 \uceec\ub7fc\ud615 \uc800\uc7a5 \ubc0f \uc555\ucd95 \uae30\uc220\uc744 \ud1b5\ud574 \ud30c\uc77c \ud06c\uae30\uac00 \uc791\uc544\uc9c0\uace0 \uc800\uc7a5 \ube44\uc6a9\uc774 \uc808\uac10\ub418\uba70 \ub370\uc774\ud130 \uc804\uc1a1 \uc18d\ub3c4\uac00 \ud5a5\uc0c1\ub429\ub2c8\ub2e4.<\/p>\n<\/li>\n<li>\n<p><strong>\uc131\ub2a5 \ucd5c\uc801\ud654:<\/strong> Parquet\ub294 \ucffc\ub9ac \uc911\uc5d0 \ud544\uc694\ud55c \uc5f4\ub9cc \uc77d\uc5b4\uc11c I\/O \uc791\uc5c5\uc744 \ucd5c\uc18c\ud654\ud558\uc5ec \ucffc\ub9ac \ucc98\ub9ac \uc18d\ub3c4\ub97c \ub192\uc785\ub2c8\ub2e4.<\/p>\n<\/li>\n<li>\n<p><strong>\uc2a4\ud0a4\ub9c8 \uc720\uc5f0\uc131:<\/strong> \uc2a4\ud0a4\ub9c8 \uc9c4\ud654 \uc9c0\uc6d0\uc744 \ud1b5\ud574 \uae30\uc874 \ub370\uc774\ud130\ub97c \uc190\uc0c1\uc2dc\ud0a4\uc9c0 \uc54a\uace0 \ubbfc\ucca9\ud558\uac8c \ub370\uc774\ud130 \uc2a4\ud0a4\ub9c8\ub97c \ubcc0\uacbd\ud560 \uc218 \uc788\uc2b5\ub2c8\ub2e4.<\/p>\n<\/li>\n<li>\n<p><strong>\uad50\ucc28 \uc5b8\uc5b4 \uc9c0\uc6d0:<\/strong> Parquet \ud30c\uc77c\uc740 Java, Python, C++ \ub4f1\uc744 \ud3ec\ud568\ud55c \ub2e4\uc591\ud55c \ud504\ub85c\uadf8\ub798\ubc0d \uc5b8\uc5b4\uc5d0\uc11c \uc0ac\uc6a9\ud560 \uc218 \uc788\uc73c\ubbc0\ub85c \ub2e4\uc591\ud55c \ub370\uc774\ud130 \ucc98\ub9ac \uc6cc\ud06c\ud50c\ub85c\ub97c \uc704\ud55c \ub2e4\ubaa9\uc801 \ud615\uc2dd\uc785\ub2c8\ub2e4.<\/p>\n<\/li>\n<li>\n<p><strong>\ub370\uc774\ud130 \uc720\ud615\uc758 \ud48d\ubd80\ud568:<\/strong> \ub2e4\uc591\ud55c \ub370\uc774\ud130 \uc720\ud615\uc5d0 \ub300\ud55c \uad11\ubc94\uc704\ud55c \uc9c0\uc6d0\uc740 \ube45 \ub370\uc774\ud130 \ubd84\uc11d\uc5d0\uc11c \ud754\ud788 \ubcfc \uc218 \uc788\ub294 \ubcf5\uc7a1\ud55c \ub370\uc774\ud130 \uad6c\uc870\ub97c \uc218\uc6a9\ud558\uc5ec \uad11\ubc94\uc704\ud55c \uc0ac\uc6a9 \uc0ac\ub840\ub97c \ucda9\uc871\ud569\ub2c8\ub2e4.<\/p>\n<\/li>\n<li>\n<p><strong>\uc0c1\ud638 \uc6b4\uc6a9\uc131:<\/strong> \uc798 \uc815\uc758\ub41c \uc0ac\uc591\uc744 \uac16\ucd98 \uc624\ud508 \uc18c\uc2a4 \ud504\ub85c\uc81d\ud2b8\uc778 Parquet\ub294 \ub2e4\uc591\ud55c \ub3c4\uad6c\uc640 \uc2dc\uc2a4\ud15c \uac04\uc758 \uc0c1\ud638 \uc6b4\uc6a9\uc131\uc744 \ucd09\uc9c4\ud569\ub2c8\ub2e4.<\/p>\n<\/li>\n<\/ol>\n<h2>\ub9c8\ub8e8\uc758 \uc885\ub958\uc640 \ud2b9\uc9d5<\/h2>\n<p>Parquet\ub294 \ub450 \uac00\uc9c0 \uc8fc\uc694 \ubc84\uc804\uc73c\ub85c \uc81c\uacf5\ub429\ub2c8\ub2e4. <strong>\ub9c8\ub8e8-1.0<\/strong> \uadf8\ub9ac\uace0 <strong>\ucabd\ubaa8\uc774 \uc138\uacf5-2.0<\/strong>. \ud6c4\uc790\ub294 \ub2e4\uc74c\uacfc \uac19\uc774 \uc54c\ub824\uc838 \uc788\uc2b5\ub2c8\ub2e4. <strong>\uc544\ud30c\uce58 \uc560\ub85c\uc6b0 \ucabd\ubaa8\uc774 \uc138\uacf5 \ub9c8\ub8e8<\/strong> Arrow \ub370\uc774\ud130 \ud615\uc2dd\uc744 \uae30\ubc18\uc73c\ub85c \ud569\ub2c8\ub2e4. \ub450 \ubc84\uc804 \ubaa8\ub450 \ub3d9\uc77c\ud55c \uae30\ubcf8 \uac1c\ub150\uacfc \uc7a5\uc810\uc744 \uacf5\uc720\ud558\uc9c0\ub9cc \ud638\ud658\uc131\uacfc \uae30\ub2a5 \uc138\ud2b8 \uce21\uba74\uc5d0\uc11c \ub2e4\ub985\ub2c8\ub2e4. \uc544\ub798\ub294 \ub450 \ubc84\uc804\uc744 \ube44\uad50\ud55c \uac83\uc785\ub2c8\ub2e4.<\/p>\n<table>\n<thead>\n<tr>\n<th>\ud2b9\uc9d5<\/th>\n<th>\ub9c8\ub8e8-1.0<\/th>\n<th>Parquet-2.0 (Apache Arrow Parquet)<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>\uc2a4\ud0a4\ub9c8 \uc9c4\ud654<\/td>\n<td>\uc9c0\uc6d0\ub428<\/td>\n<td>\uc9c0\uc6d0\ub428<\/td>\n<\/tr>\n<tr>\n<td>\uae30\ub465\ud615 \uc555\ucd95<\/td>\n<td>\uc9c0\uc6d0\ub428(Gzip, Snappy \ub4f1)<\/td>\n<td>\uc9c0\uc6d0\ub428(Gzip, Snappy, LZ4, Zstd)<\/td>\n<\/tr>\n<tr>\n<td>\uc0ac\uc804 \uc778\ucf54\ub529<\/td>\n<td>\uc9c0\uc6d0\ub428<\/td>\n<td>\uc9c0\uc6d0\ub428<\/td>\n<\/tr>\n<tr>\n<td>\uc911\ucca9 \ub370\uc774\ud130 \uc9c0\uc6d0<\/td>\n<td>\ubcf5\ud569 \uc720\ud615\uc5d0 \ub300\ud55c \uc81c\ud55c\ub41c \uc9c0\uc6d0<\/td>\n<td>\ubcf5\ud569 \uc720\ud615\uc5d0 \ub300\ud55c \uc644\ubcbd\ud55c \uc9c0\uc6d0<\/td>\n<\/tr>\n<tr>\n<td>\ud638\ud658\uc131<\/td>\n<td>\ub300\ubd80\ubd84\uc758 \ub3c4\uad6c\uc640 \ud638\ud658 \uac00\ub2a5<\/td>\n<td>Arrow\ub97c \ud1b5\ud55c \ud638\ud658\uc131 \ud5a5\uc0c1<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<h2>\ucabd\ubaa8\uc774 \uc138\uacf5 \ub9c8\ub8e8\ub97c \uc0ac\uc6a9\ud558\ub294 \ubc29\ubc95, \ubb38\uc81c \ubc0f \uc194\ub8e8\uc158<\/h2>\n<h3>\ub9c8\ub8e8\ub97c \uc0ac\uc6a9\ud558\ub294 \ubc29\ubc95<\/h3>\n<p>Parquet\ub294 \ub2e4\uc74c\uacfc \uac19\uc740 \ub2e4\uc591\ud55c \ub370\uc774\ud130 \uc9d1\uc57d\uc801 \uc2dc\ub098\ub9ac\uc624\uc5d0\uc11c \uc560\ud50c\ub9ac\ucf00\uc774\uc158\uc744 \ucc3e\uc2b5\ub2c8\ub2e4.<\/p>\n<ol>\n<li>\n<p><strong>\ub370\uc774\ud130 \uc6e8\uc5b4\ud558\uc6b0\uc9d5:<\/strong> Parquet\ub294 \ube60\ub978 \ucffc\ub9ac \uc131\ub2a5\uacfc \ud6a8\uc728\uc801\uc778 \uc800\uc7a5\uc73c\ub85c \uc778\ud574 \ub370\uc774\ud130 \uc6e8\uc5b4\ud558\uc6b0\uc9d5\uc5d0 \uc77c\ubc18\uc801\uc73c\ub85c \uc0ac\uc6a9\ub429\ub2c8\ub2e4.<\/p>\n<\/li>\n<li>\n<p><strong>\ube45\ub370\uc774\ud130 \ucc98\ub9ac:<\/strong> Hadoop \ubc0f \uae30\ud0c0 \ube45 \ub370\uc774\ud130 \ucc98\ub9ac \ud504\ub808\uc784\uc6cc\ud06c\uc5d0\uc11c Parquet \ud30c\uc77c\uc740 \ubcd1\ub82c \ucc98\ub9ac \uae30\ub2a5\uc744 \uc704\ud574 \uc120\ud638\ub418\ub294 \uc120\ud0dd\uc785\ub2c8\ub2e4.<\/p>\n<\/li>\n<li>\n<p><strong>\ub370\uc774\ud130 \ub808\uc774\ud06c:<\/strong> Parquet\ub294 \ub370\uc774\ud130 \ub808\uc774\ud06c\uc5d0 \ub2e4\uc591\ud55c \ub370\uc774\ud130 \uc720\ud615\uc744 \uc800\uc7a5\ud558\ub294 \ub370 \ub110\ub9ac \uc0ac\uc6a9\ub418\ub294 \ud615\uc2dd\uc73c\ub85c, \uc774\ub97c \ud1b5\ud574 \ud1b5\ucc30\ub825\uc744 \ub354 \uc27d\uac8c \ubd84\uc11d\ud558\uace0 \ucd94\ucd9c\ud560 \uc218 \uc788\uc2b5\ub2c8\ub2e4.<\/p>\n<\/li>\n<li>\n<p><strong>\uc2a4\ud2b8\ub9ac\ubc0d \ub370\uc774\ud130:<\/strong> \uc2a4\ud0a4\ub9c8 \uc9c4\ud654\ub97c \uc9c0\uc6d0\ud558\ub294 Parquet\ub294 \uc9c4\ud654\ud558\ub294 \ub370\uc774\ud130 \uc2a4\ud2b8\ub9bc\uc744 \ucc98\ub9ac\ud558\ub294 \ub370 \uc801\ud569\ud569\ub2c8\ub2e4.<\/p>\n<\/li>\n<\/ol>\n<h3>\ubb38\uc81c \ubc0f \ud574\uacb0 \ubc29\ubc95<\/h3>\n<ol>\n<li>\n<p><strong>\ud638\ud658\uc131 \ubb38\uc81c:<\/strong> \uc77c\ubd80 \uc624\ub798\ub41c \ub3c4\uad6c\ub294 Parquet-2.0\uc5d0 \ub300\ud55c \uc9c0\uc6d0\uc774 \uc81c\ud55c\ub420 \uc218 \uc788\uc2b5\ub2c8\ub2e4. \ud574\uacb0\ucc45\uc740 Parquet-1.0\uc744 \uc0ac\uc6a9\ud558\uac70\ub098 \ucd5c\uc2e0 \ubc84\uc804\uc744 \uc9c0\uc6d0\ud558\ub3c4\ub85d \ub3c4\uad6c\ub97c \uc5c5\ub370\uc774\ud2b8\ud558\ub294 \uac83\uc785\ub2c8\ub2e4.<\/p>\n<\/li>\n<li>\n<p><strong>\uc2a4\ud0a4\ub9c8 \uc124\uacc4 \ubcf5\uc7a1\uc131:<\/strong> \uc720\uc5f0\ud55c \uc2a4\ud0a4\ub9c8\ub97c \uc124\uacc4\ud558\ub824\uba74 \uc2e0\uc911\ud55c \uace0\ub824\uac00 \ud544\uc694\ud569\ub2c8\ub2e4. \ub370\uc774\ud130 \uc18c\uc2a4 \uc804\ubc18\uc5d0 \uac78\uccd0 \ud1b5\ud569 \uc2a4\ud0a4\ub9c8\ub97c \uc0ac\uc6a9\ud558\uba74 \ub370\uc774\ud130 \ud1b5\ud569\uc774 \ub2e8\uc21c\ud654\ub420 \uc218 \uc788\uc2b5\ub2c8\ub2e4.<\/p>\n<\/li>\n<li>\n<p><strong>\ub370\uc774\ud130 \ud488\uc9c8 \ubb38\uc81c:<\/strong> \uc798\ubabb\ub41c \ub370\uc774\ud130 \uc720\ud615\uc774\ub098 \uc2a4\ud0a4\ub9c8 \ubcc0\uacbd\uc73c\ub85c \uc778\ud574 \ub370\uc774\ud130 \ud488\uc9c8 \ubb38\uc81c\uac00 \ubc1c\uc0dd\ud560 \uc218 \uc788\uc2b5\ub2c8\ub2e4. \ub370\uc774\ud130 \uac80\uc99d \ubc0f \uc2a4\ud0a4\ub9c8 \ubc1c\uc804 \ubc29\uc2dd\uc744 \ud1b5\ud574 \uc774\ub7ec\ud55c \ubb38\uc81c\ub97c \uc644\ud654\ud560 \uc218 \uc788\uc2b5\ub2c8\ub2e4.<\/p>\n<\/li>\n<li>\n<p><strong>\ucf5c\ub4dc \uc2a4\ud0c0\ud2b8 \uc624\ubc84\ud5e4\ub4dc:<\/strong> \uba54\ud0c0\ub370\uc774\ud130 \uad6c\ubb38 \ubd84\uc11d\uc73c\ub85c \uc778\ud574 Parquet \ud30c\uc77c\uc758 \ucc98\uc74c \uba87 \ud589\uc744 \uc77d\ub294 \uc18d\ub3c4\uac00 \ub290\ub824\uc9c8 \uc218 \uc788\uc2b5\ub2c8\ub2e4. \uc0ac\uc804 \uce90\uc2f1 \ub610\ub294 \ucd5c\uc801\ud654\ub41c \ud30c\uc77c \uad6c\uc870\ub97c \uc0ac\uc6a9\ud558\uba74 \uc774\ub7ec\ud55c \uc624\ubc84\ud5e4\ub4dc\ub97c \uc904\uc77c \uc218 \uc788\uc2b5\ub2c8\ub2e4.<\/p>\n<\/li>\n<\/ol>\n<h2>\uc8fc\uc694 \ud2b9\uc9d5 \ubc0f \uae30\ud0c0 \ube44\uad50<\/h2>\n<table>\n<thead>\n<tr>\n<th>\ud2b9\uc131<\/th>\n<th>\uc124\uba85<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>\uc800\uc7a5 \ud615\uc2dd<\/td>\n<td>\uc6d0\uc8fc\ud615<\/td>\n<\/tr>\n<tr>\n<td>\uc555\ucd95 \uc635\uc158<\/td>\n<td>Gzip, Snappy, LZ4, Z\ud45c\uc900<\/td>\n<\/tr>\n<tr>\n<td>\ud50c\ub7ab\ud3fc \ub3c5\ub9bd\uc131<\/td>\n<td>\uc608<\/td>\n<\/tr>\n<tr>\n<td>\ub370\uc774\ud130 \uc720\ud615 \uc9c0\uc6d0<\/td>\n<td>\uae30\ubcf8 \ubc0f \ubcf5\ud569 \ub370\uc774\ud130 \uc720\ud615\uc5d0 \ub300\ud55c \uad11\ubc94\uc704\ud55c \uc9c0\uc6d0<\/td>\n<\/tr>\n<tr>\n<td>\uc2a4\ud0a4\ub9c8 \uc9c4\ud654<\/td>\n<td>\uc9c0\uc6d0\ub428<\/td>\n<\/tr>\n<tr>\n<td>\uc220\uc5b4 \ud478\uc2dc\ub2e4\uc6b4<\/td>\n<td>\uc9c0\uc6d0\ub428<\/td>\n<\/tr>\n<tr>\n<td>\ubcd1\ub82c \ucc98\ub9ac<\/td>\n<td>\ud589 \uadf8\ub8f9\uc744 \ud1b5\ud574 \ud65c\uc131\ud654\ub428<\/td>\n<\/tr>\n<tr>\n<td>\uc0c1\ud638 \uc6b4\uc6a9\uc131<\/td>\n<td>Apache Hadoop, Apache Spark \ubc0f Apache Drill\uacfc \uac19\uc740 \ub2e4\uc591\ud55c \ube45 \ub370\uc774\ud130 \ud504\ub808\uc784\uc6cc\ud06c\uc640 \uc791\ub3d9\ud569\ub2c8\ub2e4.<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<h2>\ub9c8\ub8e8\uc5d0 \uad00\ud55c \ubbf8\ub798\uc758 \uad00\uc810\uacfc \uae30\uc220<\/h2>\n<p>\uae30\ub2a5\uacfc \ud1b5\ud569\uc744 \uac1c\uc120\ud558\uae30 \uc704\ud55c \uc9c0\uc18d\uc801\uc778 \ub178\ub825\uc744 \ud1b5\ud574 Parquet\uc758 \ubbf8\ub798\ub294 \uc720\ub9dd\ud574 \ubcf4\uc785\ub2c8\ub2e4. \uac1c\ubc1c \ubc0f \ucc44\ud0dd\uc758 \uc77c\ubd80 \uc8fc\uc694 \uc601\uc5ed\uc740 \ub2e4\uc74c\uacfc \uac19\uc2b5\ub2c8\ub2e4.<\/p>\n<ol>\n<li>\n<p><strong>\ucd5c\uc801\ud654\ub41c \ucffc\ub9ac \uc5d4\uc9c4:<\/strong> Apache Arrow, Apache Drill \ubc0f Presto\uc640 \uac19\uc740 \ucffc\ub9ac \uc5d4\uc9c4\uc758 \uc9c0\uc18d\uc801\uc778 \ubc1c\uc804\uc73c\ub85c Parquet\uc758 \ucffc\ub9ac \uc131\ub2a5\uc774 \ub354\uc6b1 \ud5a5\uc0c1\ub420 \uac83\uc785\ub2c8\ub2e4.<\/p>\n<\/li>\n<li>\n<p><strong>\uc2a4\ud2b8\ub9ac\ubc0d \uc9c0\uc6d0:<\/strong> Parquet\uc740 Apache Kafka \ubc0f Apache Flink\uc640 \uac19\uc740 \uc0c8\ub85c\uc6b4 \uae30\uc220\uc744 \ud1b5\ud574 \uc2e4\uc2dc\uac04 \ub370\uc774\ud130 \uc2a4\ud2b8\ub9ac\ubc0d \ubc0f \ubd84\uc11d\uc5d0\uc11c \uc911\uc694\ud55c \uc5ed\ud560\uc744 \ud560 \uac83\uc73c\ub85c \uc608\uc0c1\ub429\ub2c8\ub2e4.<\/p>\n<\/li>\n<li>\n<p><strong>\ud074\ub77c\uc6b0\ub4dc \ub370\uc774\ud130 \ub808\uc774\ud06c:<\/strong> Amazon S3 \ubc0f Azure Data Lake Storage\uc640 \uac19\uc740 \ud50c\ub7ab\ud3fc\uc744 \ud1b5\ud574 \ucd09\uc9c4\ub41c \ud074\ub77c\uc6b0\ub4dc \ub370\uc774\ud130 \ub808\uc774\ud06c\uc758 \uc99d\uac00\ub294 \ube44\uc6a9 \ud6a8\uc728\uc131\uacfc \ud655\uc7a5 \uac00\ub2a5\ud55c \uc131\ub2a5\uc73c\ub85c \uc778\ud574 Parquet\uc758 \ucc44\ud0dd\uc744 \ucd09\uc9c4\ud560 \uac83\uc785\ub2c8\ub2e4.<\/p>\n<\/li>\n<li>\n<p><strong>AI \ubc0f ML \ud1b5\ud569:<\/strong> Parquet\uc740 \ub300\uaddc\ubaa8 \ub370\uc774\ud130 \uc138\ud2b8\ub97c \ud6a8\uc728\uc801\uc73c\ub85c \uc800\uc7a5\ud558\ubbc0\ub85c \uae30\uacc4 \ud559\uc2b5 \ubc0f \uc778\uacf5 \uc9c0\ub2a5 \ud504\ub85c\uc81d\ud2b8\uc5d0\uc11c \ub370\uc774\ud130 \uc900\ube44 \ubc0f \uad50\uc721 \ud30c\uc774\ud504\ub77c\uc778\uc758 \ud544\uc218\uc801\uc778 \ubd80\ubd84\uc73c\ub85c \ub0a8\uc744 \uac83\uc785\ub2c8\ub2e4.<\/p>\n<\/li>\n<\/ol>\n<h2>\ud504\ub85d\uc2dc \uc11c\ubc84\ub97c \uc0ac\uc6a9\ud558\uac70\ub098 Parquet\uc640 \uc5f0\uacb0\ud558\ub294 \ubc29\ubc95<\/h2>\n<p>\ud504\ub85d\uc2dc \uc11c\ubc84\ub294 \uc5ec\ub7ec \uac00\uc9c0 \ubc29\ubc95\uc73c\ub85c Parquet\uc758 \uc774\uc810\uc744 \ub204\ub9b4 \uc218 \uc788\uc2b5\ub2c8\ub2e4.<\/p>\n<ol>\n<li>\n<p><strong>\uce90\uc2f1 \ubc0f \ub370\uc774\ud130 \uc555\ucd95:<\/strong> \ud504\ub85d\uc2dc \uc11c\ubc84\ub294 Parquet\ub97c \uc0ac\uc6a9\ud558\uc5ec \uc790\uc8fc \uc561\uc138\uc2a4\ud558\ub294 \ub370\uc774\ud130\ub97c \ud6a8\uc728\uc801\uc73c\ub85c \uce90\uc2dc\ud558\uc5ec \ud6c4\uc18d \uc694\uccad\uc5d0 \ub300\ud55c \uc751\ub2f5 \uc2dc\uac04\uc744 \uc904\uc77c \uc218 \uc788\uc2b5\ub2c8\ub2e4.<\/p>\n<\/li>\n<li>\n<p><strong>\ub85c\uadf8 \ucc98\ub9ac \ubc0f \ubd84\uc11d:<\/strong> Parquet \ud615\uc2dd\uc73c\ub85c \uc218\uc9d1\ub41c \ud504\ub85d\uc2dc \uc11c\ubc84 \ub85c\uadf8\ub294 \ube45\ub370\uc774\ud130 \ucc98\ub9ac \ub3c4\uad6c\ub97c \uc0ac\uc6a9\ud558\uc5ec \ubd84\uc11d\ud558\uc5ec \ub124\ud2b8\uc6cc\ud06c \ucd5c\uc801\ud654 \ubc0f \ubcf4\uc548\uc5d0 \ub300\ud55c \uadc0\uc911\ud55c \ud1b5\ucc30\ub825\uc744 \uc5bb\uc744 \uc218 \uc788\uc2b5\ub2c8\ub2e4.<\/p>\n<\/li>\n<li>\n<p><strong>\ub370\uc774\ud130 \uad50\ud658 \ubc0f \ud1b5\ud569:<\/strong> \ub2e4\uc591\ud55c \uc18c\uc2a4\uc758 \ub370\uc774\ud130\ub97c \ucc98\ub9ac\ud558\ub294 \ud504\ub85d\uc2dc \uc11c\ubc84\ub294 \ub370\uc774\ud130\ub97c Parquet \ud615\uc2dd\uc73c\ub85c \ubcc0\ud658\ud558\uace0 \uc800\uc7a5\ud560 \uc218 \uc788\uc73c\ubbc0\ub85c \ube45\ub370\uc774\ud130 \ud50c\ub7ab\ud3fc \ubc0f \ubd84\uc11d \uc2dc\uc2a4\ud15c\uacfc\uc758 \uc6d0\ud65c\ud55c \ud1b5\ud569\uc774 \uac00\ub2a5\ud569\ub2c8\ub2e4.<\/p>\n<\/li>\n<li>\n<p><strong>\uc790\uc6d0 \ucd5c\uc801\ud654:<\/strong> Parquet\uc758 \uceec\ub7fc\ud615 \uc2a4\ud1a0\ub9ac\uc9c0\uc640 \uc870\uac74\uc790 \ud478\uc2dc\ub2e4\uc6b4 \uae30\ub2a5\uc744 \ud65c\uc6a9\ud558\uc5ec \ud504\ub85d\uc2dc \uc11c\ubc84\ub294 \ub9ac\uc18c\uc2a4 \uc0ac\uc6a9\uc744 \ucd5c\uc801\ud654\ud558\uace0 \uc804\ubc18\uc801\uc778 \uc131\ub2a5\uc744 \ud5a5\uc0c1\uc2dc\ud0ac \uc218 \uc788\uc2b5\ub2c8\ub2e4.<\/p>\n<\/li>\n<\/ol>\n<h2>\uad00\ub828\ub41c \ub9c1\ud06c\ub4e4<\/h2>\n<p>Parquet\uc5d0 \ub300\ud55c \uc790\uc138\ud55c \ub0b4\uc6a9\uc740 \ub2e4\uc74c \ub9ac\uc18c\uc2a4\ub97c \ucc38\uc870\ud558\uc138\uc694.<\/p>\n<ol>\n<li><a href=\"https:\/\/parquet.apache.org\/\" target=\"_new\" rel=\"noopener nofollow\">Apache Parquet \uacf5\uc2dd \uc6f9\uc0ac\uc774\ud2b8<\/a><\/li>\n<li><a href=\"https:\/\/github.com\/apache\/parquet-format\" target=\"_new\" rel=\"noopener nofollow\">\ub9c8\ub8e8 \ud615\uc2dd \uc0ac\uc591<\/a><\/li>\n<li><a href=\"https:\/\/blog.cloudera.com\/parquet\/\" target=\"_new\" rel=\"noopener nofollow\">Parquet\uc5d0 \ub300\ud55c Cloudera \uc5d4\uc9c0\ub2c8\uc5b4\ub9c1 \ube14\ub85c\uadf8<\/a><\/li>\n<li><a href=\"https:\/\/arrow.apache.org\/\" target=\"_new\" rel=\"noopener nofollow\">\uc544\ud30c\uce58 \uc560\ub85c\uc6b0 \uacf5\uc2dd \uc6f9\uc0ac\uc774\ud2b8<\/a> (Parquet-2.0\uc5d0 \ub300\ud55c \uc815\ubcf4)<\/li>\n<\/ol>","protected":false},"featured_media":0,"menu_order":0,"template":"","meta":{"_acf_changed":false,"content-type":"","inline_featured_image":false,"footnotes":""},"class_list":["post-478342","wiki","type-wiki","status-publish","hentry"],"acf":{"faq_title":"Frequently Asked Questions about <mark>Parquet: A Comprehensive Guide<\/mark>","faq_items":[{"question":"What is Parquet?","answer":"<p>Parquet is a columnar storage file format designed for efficient storage and processing of large datasets. It is particularly well-suited for big data analytics, data warehousing, and Apache Hadoop environments.<\/p>"},{"question":"How did Parquet originate, and when was it first mentioned?","answer":"<p>Parquet was developed as an open-source project by Cloudera and Twitter in 2013. It was first mentioned in a research paper presented by Twitter engineers at the Symposium on Operating Systems Principles (SOSP) in the same year.<\/p>"},{"question":"What are the key features of Parquet?","answer":"<p>Parquet offers several key features, including columnar storage, efficient compression techniques, support for various data types (primitive and complex), schema evolution, predicate pushdown, and parallel processing.<\/p>"},{"question":"How does Parquet work internally?","answer":"<p>Internally, Parquet files consist of file metadata, row groups, column metadata, data pages, and optional dictionary pages. This design allows for optimized storage, fast query processing, and support for various data types.<\/p>"},{"question":"What are the different types of Parquet versions, and how do they differ?","answer":"<p>Parquet comes in two main versions: Parquet-1.0 and Parquet-2.0 (Apache Arrow Parquet). While both versions share core concepts, Parquet-2.0 offers improved compatibility with Arrow-based systems and additional compression options.<\/p>"},{"question":"In what ways can Parquet be used, and what problems does it solve?","answer":"<p>Parquet finds applications in data warehousing, big data processing, data lakes, and handling streaming data. It solves challenges related to efficient storage, fast query performance, schema evolution, and cross-platform compatibility.<\/p>"},{"question":"What are the main characteristics of Parquet compared to other storage formats?","answer":"<p>Compared to other formats, Parquet stands out for its columnar storage, efficient compression options, extensive data type support, schema evolution capabilities, and the ability to enable predicate pushdown for query optimization.<\/p>"},{"question":"What are the perspectives and future technologies related to Parquet?","answer":"<p>The future of Parquet is promising, with ongoing improvements in query engines, support for real-time data streaming, and its growing role in cloud data lakes and AI\/ML integration.<\/p>"},{"question":"How can proxy servers benefit from Parquet?","answer":"<p>Proxy servers can utilize Parquet for caching, data compression, log processing, and seamless data integration. Parquet's resource optimization features can improve overall proxy server performance.<\/p>"},{"question":"Where can I find more information about Parquet?","answer":"<p>For more information about Parquet, you can visit the <a href=\"https:\/\/parquet.apache.org\/\" target=\"_new\">Apache Parquet Official Website<\/a> or refer to the Parquet Format Specification on <a href=\"https:\/\/github.com\/apache\/parquet-format\" target=\"_new\">GitHub<\/a>. Additionally, you can explore Cloudera's Engineering Blog for insightful articles on Parquet. For information on Parquet-2.0, you can visit the <a href=\"https:\/\/arrow.apache.org\/\" target=\"_new\">Apache Arrow Official Website<\/a>.<\/p>"}]},"_links":{"self":[{"href":"https:\/\/oneproxy.pro\/kr\/wp-json\/wp\/v2\/wiki\/478342","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/oneproxy.pro\/kr\/wp-json\/wp\/v2\/wiki"}],"about":[{"href":"https:\/\/oneproxy.pro\/kr\/wp-json\/wp\/v2\/types\/wiki"}],"version-history":[{"count":0,"href":"https:\/\/oneproxy.pro\/kr\/wp-json\/wp\/v2\/wiki\/478342\/revisions"}],"wp:attachment":[{"href":"https:\/\/oneproxy.pro\/kr\/wp-json\/wp\/v2\/media?parent=478342"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}