{"id":479722,"date":"2023-08-09T10:43:48","date_gmt":"2023-08-09T10:43:48","guid":{"rendered":""},"modified":"2023-09-05T11:19:26","modified_gmt":"2023-09-05T11:19:26","slug":"xgboost","status":"publish","type":"wiki","link":"https:\/\/oneproxy.pro\/jp\/wiki\/xgboost\/","title":{"rendered":"XG\u30d6\u30fc\u30b9\u30c8"},"content":{"rendered":"<p>XGBoost (Extreme Gradient Boosting \u306e\u7565) \u306f\u3001\u4e88\u6e2c\u30e2\u30c7\u30ea\u30f3\u30b0\u3068\u30c7\u30fc\u30bf\u5206\u6790\u306e\u5206\u91ce\u306b\u9769\u547d\u3092\u3082\u305f\u3089\u3057\u305f\u6700\u5148\u7aef\u306e\u6a5f\u68b0\u5b66\u7fd2\u30a2\u30eb\u30b4\u30ea\u30ba\u30e0\u3067\u3059\u3002\u3053\u308c\u306f\u52fe\u914d\u30d6\u30fc\u30b9\u30c6\u30a3\u30f3\u30b0 \u30a2\u30eb\u30b4\u30ea\u30ba\u30e0\u306e\u30ab\u30c6\u30b4\u30ea\u306b\u5c5e\u3057\u3001\u56de\u5e30\u3001\u5206\u985e\u3001\u30e9\u30f3\u30ad\u30f3\u30b0\u306a\u3069\u306e\u30bf\u30b9\u30af\u306e\u3055\u307e\u3056\u307e\u306a\u5206\u91ce\u3067\u5e83\u304f\u4f7f\u7528\u3055\u308c\u3066\u3044\u307e\u3059\u3002\u5f93\u6765\u306e\u30d6\u30fc\u30b9\u30c6\u30a3\u30f3\u30b0\u624b\u6cd5\u306e\u9650\u754c\u3092\u514b\u670d\u3059\u308b\u305f\u3081\u306b\u958b\u767a\u3055\u308c\u305f XGBoost \u306f\u3001\u52fe\u914d\u30d6\u30fc\u30b9\u30c6\u30a3\u30f3\u30b0\u3068\u6b63\u5247\u5316\u624b\u6cd5\u306e\u9577\u6240\u3092\u7d44\u307f\u5408\u308f\u305b\u3066\u3001\u512a\u308c\u305f\u4e88\u6e2c\u7cbe\u5ea6\u3092\u5b9f\u73fe\u3057\u307e\u3059\u3002<\/p>\n<h2>XGBoost \u306e\u8a95\u751f\u306e\u6b74\u53f2<\/h2>\n<p>XGBoost \u306e\u65c5\u306f\u3001\u30ef\u30b7\u30f3\u30c8\u30f3\u5927\u5b66\u306e\u7814\u7a76\u8005 Tianqi Chen \u304c\u30aa\u30fc\u30d7\u30f3\u30bd\u30fc\u30b9 \u30d7\u30ed\u30b8\u30a7\u30af\u30c8\u3068\u3057\u3066\u30a2\u30eb\u30b4\u30ea\u30ba\u30e0\u3092\u958b\u767a\u3057\u305f 2014 \u5e74\u306b\u59cb\u307e\u308a\u307e\u3057\u305f\u3002 XGBoost \u306b\u3064\u3044\u3066\u521d\u3081\u3066\u8a00\u53ca\u3055\u308c\u305f\u306e\u306f\u30012016 \u5e74\u306e ACM SIGKDD \u30ab\u30f3\u30d5\u30a1\u30ec\u30f3\u30b9\u3067\u767a\u8868\u3055\u308c\u305f\u300cXGBoost: A Scalable Tree Boosting System\u300d\u3068\u3044\u3046\u30bf\u30a4\u30c8\u30eb\u306e\u7814\u7a76\u8ad6\u6587\u3067\u3059\u3002\u3053\u306e\u8ad6\u6587\u3067\u306f\u3001\u3055\u307e\u3056\u307e\u306a\u6a5f\u68b0\u5b66\u7fd2\u30b3\u30f3\u30c6\u30b9\u30c8\u306b\u304a\u3051\u308b\u3053\u306e\u30a2\u30eb\u30b4\u30ea\u30ba\u30e0\u306e\u512a\u308c\u305f\u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9\u3092\u7d39\u4ecb\u3057\u3001\u5927\u898f\u6a21\u306a\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\u3092\u52b9\u7387\u7684\u306b\u51e6\u7406\u3059\u308b\u80fd\u529b\u3092\u5f37\u8abf\u3057\u307e\u3057\u305f\u3002<\/p>\n<h2>XGBoost\u306e\u8a73\u7d30\u60c5\u5831<\/h2>\n<p>XGBoost \u306e\u6210\u529f\u306f\u3001\u30d6\u30fc\u30b9\u30c6\u30a3\u30f3\u30b0\u6280\u8853\u3068\u6b63\u5247\u5316\u6280\u8853\u306e\u72ec\u81ea\u306e\u7d44\u307f\u5408\u308f\u305b\u306b\u8d77\u56e0\u3059\u308b\u3068\u8003\u3048\u3089\u308c\u307e\u3059\u3002\u3053\u308c\u306f\u3001\u5f31\u3044\u5b66\u7fd2\u8005 (\u901a\u5e38\u306f\u6c7a\u5b9a\u6728) \u304c\u9806\u756a\u306b\u30c8\u30ec\u30fc\u30cb\u30f3\u30b0\u3055\u308c\u308b\u9010\u6b21\u30c8\u30ec\u30fc\u30cb\u30f3\u30b0 \u30d7\u30ed\u30bb\u30b9\u3092\u63a1\u7528\u3057\u3066\u304a\u308a\u3001\u65b0\u3057\u3044\u5b66\u7fd2\u8005\u306f\u305d\u308c\u305e\u308c\u3001\u524d\u306e\u5b66\u7fd2\u8005\u306e\u30a8\u30e9\u30fc\u3092\u4fee\u6b63\u3059\u308b\u3053\u3068\u3092\u76ee\u6307\u3057\u307e\u3059\u3002\u3055\u3089\u306b\u3001XGBoost \u306b\u306f\u3001\u30e2\u30c7\u30eb\u306e\u8907\u96d1\u3055\u3092\u5236\u5fa1\u3057\u3001\u904e\u5b66\u7fd2\u3092\u9632\u3050\u305f\u3081\u306e\u6b63\u5247\u5316\u9805\u304c\u7d44\u307f\u8fbc\u307e\u308c\u3066\u3044\u307e\u3059\u3002\u3053\u306e\u4e8c\u91cd\u306e\u30a2\u30d7\u30ed\u30fc\u30c1\u306b\u3088\u308a\u3001\u4e88\u6e2c\u7cbe\u5ea6\u304c\u5411\u4e0a\u3059\u308b\u3060\u3051\u3067\u306a\u304f\u3001\u904e\u5270\u9069\u5408\u306e\u30ea\u30b9\u30af\u3082\u6700\u5c0f\u9650\u306b\u6291\u3048\u3089\u308c\u307e\u3059\u3002<\/p>\n<h2>XGBoost\u306e\u5185\u90e8\u69cb\u9020<\/h2>\n<p>XGBoost \u306e\u5185\u90e8\u69cb\u9020\u306f\u3001\u6b21\u306e\u4e3b\u8981\u30b3\u30f3\u30dd\u30fc\u30cd\u30f3\u30c8\u306b\u5206\u985e\u3067\u304d\u307e\u3059\u3002<\/p>\n<ol>\n<li>\n<p><strong>\u76ee\u7684\u95a2\u6570:<\/strong> XGBoost \u306f\u3001\u30c8\u30ec\u30fc\u30cb\u30f3\u30b0\u4e2d\u306b\u6700\u9069\u5316\u3059\u308b\u5fc5\u8981\u304c\u3042\u308b\u76ee\u7684\u95a2\u6570\u3092\u5b9a\u7fa9\u3057\u307e\u3059\u3002\u4e00\u822c\u7684\u306a\u76ee\u7684\u306b\u306f\u3001\u56de\u5e30\u30bf\u30b9\u30af (\u5e73\u5747\u4e8c\u4e57\u8aa4\u5dee\u306a\u3069) \u304a\u3088\u3073\u5206\u985e\u30bf\u30b9\u30af (\u5bfe\u6570\u640d\u5931\u306a\u3069) \u304c\u542b\u307e\u308c\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u5b66\u7fd2\u80fd\u529b\u304c\u4f4e\u3044\u4eba:<\/strong> XGBoost \u306f\u3001\u5f31\u5b66\u7fd2\u5668\u3068\u3057\u3066\u30c7\u30b7\u30b8\u30e7\u30f3 \u30c4\u30ea\u30fc\u3092\u4f7f\u7528\u3057\u307e\u3059\u3002\u3053\u308c\u3089\u306e\u30c4\u30ea\u30fc\u306f\u6d45\u304f\u3001\u6df1\u3055\u304c\u5236\u9650\u3055\u308c\u3066\u3044\u308b\u305f\u3081\u3001\u30aa\u30fc\u30d0\u30fc\u30d5\u30a3\u30c3\u30c6\u30a3\u30f3\u30b0\u306e\u30ea\u30b9\u30af\u304c\u8efd\u6e1b\u3055\u308c\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u52fe\u914d\u30d6\u30fc\u30b9\u30c6\u30a3\u30f3\u30b0:<\/strong> XGBoost \u306f\u52fe\u914d\u30d6\u30fc\u30b9\u30c6\u30a3\u30f3\u30b0\u3092\u63a1\u7528\u3057\u3066\u304a\u308a\u3001\u4ee5\u524d\u306e\u30c4\u30ea\u30fc\u306e\u4e88\u6e2c\u306b\u5bfe\u3059\u308b\u640d\u5931\u95a2\u6570\u306e\u52fe\u914d\u3092\u6700\u5c0f\u5316\u3059\u308b\u3088\u3046\u306b\u65b0\u3057\u3044\u30c4\u30ea\u30fc\u304c\u69cb\u7bc9\u3055\u308c\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u6b63\u5247\u5316:<\/strong> \u30e2\u30c7\u30eb\u306e\u8907\u96d1\u3055\u3092\u5236\u5fa1\u3059\u308b\u305f\u3081\u306b\u3001\u76ee\u7684\u95a2\u6570\u306b\u6b63\u5247\u5316\u9805\u304c\u8ffd\u52a0\u3055\u308c\u307e\u3059\u3002\u3053\u308c\u306b\u3088\u308a\u3001\u30a2\u30eb\u30b4\u30ea\u30ba\u30e0\u304c\u30c7\u30fc\u30bf\u306b\u30ce\u30a4\u30ba\u3092\u5f53\u3066\u306f\u3081\u308b\u3053\u3068\u304c\u3067\u304d\u306a\u304f\u306a\u308a\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u6728\u306e\u526a\u5b9a:<\/strong> XGBoost \u306b\u306f\u3001\u30c8\u30ec\u30fc\u30cb\u30f3\u30b0\u4e2d\u306b\u30c4\u30ea\u30fc\u304b\u3089\u679d\u3092\u524a\u9664\u3059\u308b\u679d\u5208\u308a\u30b9\u30c6\u30c3\u30d7\u304c\u7d44\u307f\u8fbc\u307e\u308c\u3066\u304a\u308a\u3001\u30e2\u30c7\u30eb\u306e\u4e00\u822c\u5316\u304c\u3055\u3089\u306b\u5f37\u5316\u3055\u308c\u307e\u3059\u3002<\/p>\n<\/li>\n<\/ol>\n<h2>XGBoost \u306e\u4e3b\u8981\u6a5f\u80fd\u306e\u5206\u6790<\/h2>\n<p>XGBoost \u306f\u3001\u4e88\u6e2c\u30e2\u30c7\u30ea\u30f3\u30b0\u306b\u304a\u3051\u308b\u512a\u4f4d\u6027\u306b\u8ca2\u732e\u3059\u308b\u3044\u304f\u3064\u304b\u306e\u91cd\u8981\u306a\u6a5f\u80fd\u3092\u8a87\u308a\u307e\u3059\u3002<\/p>\n<ol>\n<li>\n<p><strong>\u30cf\u30a4\u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9\uff1a<\/strong> XGBoost \u306f\u52b9\u7387\u3068\u62e1\u5f35\u6027\u3092\u8003\u616e\u3057\u3066\u8a2d\u8a08\u3055\u308c\u3066\u3044\u307e\u3059\u3002\u5927\u898f\u6a21\u306a\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\u3092\u51e6\u7406\u3057\u3001\u4e26\u5217\u8a08\u7b97\u3092\u5b9f\u884c\u3057\u3066\u30c8\u30ec\u30fc\u30cb\u30f3\u30b0\u3092\u52a0\u901f\u3067\u304d\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u67d4\u8edf\u6027:<\/strong> \u3053\u306e\u30a2\u30eb\u30b4\u30ea\u30ba\u30e0\u306f\u3055\u307e\u3056\u307e\u306a\u76ee\u6a19\u3068\u8a55\u4fa1\u6307\u6a19\u3092\u30b5\u30dd\u30fc\u30c8\u3057\u3066\u304a\u308a\u3001\u3055\u307e\u3056\u307e\u306a\u30bf\u30b9\u30af\u306b\u9069\u5fdc\u3067\u304d\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u6b63\u5247\u5316:<\/strong> XGBoost \u306e\u6b63\u5247\u5316\u6280\u8853\u306f\u3001\u904e\u5b66\u7fd2\u3092\u9632\u6b62\u3057\u3001\u4fe1\u983c\u6027\u306e\u9ad8\u3044\u30e2\u30c7\u30eb\u306e\u4e00\u822c\u5316\u3092\u4fdd\u8a3c\u3057\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u6a5f\u80fd\u306e\u91cd\u8981\u6027:<\/strong> XGBoost \u306f\u7279\u5fb4\u306e\u91cd\u8981\u6027\u306b\u95a2\u3059\u308b\u6d1e\u5bdf\u3092\u63d0\u4f9b\u3057\u3001\u30e6\u30fc\u30b6\u30fc\u304c\u4e88\u6e2c\u3092\u63a8\u9032\u3059\u308b\u5909\u6570\u3092\u7406\u89e3\u3067\u304d\u308b\u3088\u3046\u306b\u3057\u307e\u3059\u3002<\/p>\n<\/li>\n<li>\n<p><strong>\u6b20\u640d\u30c7\u30fc\u30bf\u306e\u51e6\u7406:<\/strong> XGBoost \u306f\u3001\u30c8\u30ec\u30fc\u30cb\u30f3\u30b0\u304a\u3088\u3073\u4e88\u6e2c\u4e2d\u306b\u6b20\u640d\u30c7\u30fc\u30bf\u3092\u81ea\u52d5\u7684\u306b\u51e6\u7406\u3057\u3001\u524d\u51e6\u7406\u306e\u52b4\u529b\u3092\u524a\u6e1b\u3057\u307e\u3059\u3002<\/p>\n<\/li>\n<\/ol>\n<h2>XGBoost\u306e\u7a2e\u985e<\/h2>\n<p>XGBoost \u306b\u306f\u3001\u7279\u5b9a\u306e\u30bf\u30b9\u30af\u306b\u5408\u308f\u305b\u3066\u8abf\u6574\u3055\u308c\u305f\u3055\u307e\u3056\u307e\u306a\u30d0\u30ea\u30a8\u30fc\u30b7\u30e7\u30f3\u304c\u3042\u308a\u307e\u3059\u3002<\/p>\n<ul>\n<li><strong>XGBoost \u56de\u5e30:<\/strong> \u9023\u7d9a\u3057\u305f\u6570\u5024\u3092\u4e88\u6e2c\u3059\u308b\u305f\u3081\u306b\u4f7f\u7528\u3055\u308c\u307e\u3059\u3002<\/li>\n<li><strong>XGBoost \u5206\u985e:<\/strong> \u30d0\u30a4\u30ca\u30ea\u304a\u3088\u3073\u30de\u30eb\u30c1\u30af\u30e9\u30b9\u5206\u985e\u30bf\u30b9\u30af\u306b\u4f7f\u7528\u3055\u308c\u307e\u3059\u3002<\/li>\n<li><strong>XGBoost\u30e9\u30f3\u30ad\u30f3\u30b0:<\/strong> \u30a4\u30f3\u30b9\u30bf\u30f3\u30b9\u3092\u91cd\u8981\u5ea6\u306b\u3088\u3063\u3066\u9806\u5e8f\u4ed8\u3051\u3059\u308b\u3053\u3068\u3092\u76ee\u7684\u3068\u3057\u305f\u30bf\u30b9\u30af\u306e\u30e9\u30f3\u30af\u4ed8\u3051\u7528\u306b\u8a2d\u8a08\u3055\u308c\u3066\u3044\u307e\u3059\u3002<\/li>\n<\/ul>\n<p>\u8868\u5f62\u5f0f\u3067\u307e\u3068\u3081\u305f\u3082\u306e\u306f\u6b21\u306e\u3068\u304a\u308a\u3067\u3059\u3002<\/p>\n<table>\n<thead>\n<tr>\n<th>\u30bf\u30a4\u30d7<\/th>\n<th>\u8aac\u660e<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>XGBoost \u56de\u5e30<\/td>\n<td>\u9023\u7d9a\u3057\u305f\u6570\u5024\u3092\u4e88\u6e2c\u3057\u307e\u3059\u3002<\/td>\n<\/tr>\n<tr>\n<td>XGBoost \u306e\u5206\u985e<\/td>\n<td>\u30d0\u30a4\u30ca\u30ea\u304a\u3088\u3073\u30de\u30eb\u30c1\u30af\u30e9\u30b9\u5206\u985e\u3092\u51e6\u7406\u3057\u307e\u3059\u3002<\/td>\n<\/tr>\n<tr>\n<td>XG\u30d6\u30fc\u30b9\u30c8\u30e9\u30f3\u30ad\u30f3\u30b0<\/td>\n<td>\u30a4\u30f3\u30b9\u30bf\u30f3\u30b9\u3092\u91cd\u8981\u5ea6\u306b\u3088\u3063\u3066\u30e9\u30f3\u30af\u4ed8\u3051\u3057\u307e\u3059\u3002<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<h2>XGBoost \u306e\u4f7f\u7528\u65b9\u6cd5\u3001\u554f\u984c\u3001\u304a\u3088\u3073\u89e3\u6c7a\u7b56<\/h2>\n<p>XGBoost \u306f\u3001\u91d1\u878d\u3001\u30d8\u30eb\u30b9\u30b1\u30a2\u3001\u30de\u30fc\u30b1\u30c6\u30a3\u30f3\u30b0\u306a\u3069\u3092\u542b\u3080\u5e45\u5e83\u3044\u30c9\u30e1\u30a4\u30f3\u3067\u30a2\u30d7\u30ea\u30b1\u30fc\u30b7\u30e7\u30f3\u3092\u898b\u3064\u3051\u307e\u3059\u3002\u305f\u3060\u3057\u3001\u30e6\u30fc\u30b6\u30fc\u306f\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u306e\u8abf\u6574\u3084\u30c7\u30fc\u30bf\u306e\u4e0d\u5747\u8861\u306a\u3069\u306e\u8ab2\u984c\u306b\u906d\u9047\u3059\u308b\u53ef\u80fd\u6027\u304c\u3042\u308a\u307e\u3059\u3002\u76f8\u4e92\u691c\u8a3c\u3084\u30cf\u30a4\u30d1\u30fc\u30d1\u30e9\u30e1\u30fc\u30bf\u306e\u6700\u9069\u5316\u306a\u3069\u306e\u624b\u6cd5\u3092\u63a1\u7528\u3059\u308b\u3068\u3001\u3053\u308c\u3089\u306e\u554f\u984c\u3092\u8efd\u6e1b\u3067\u304d\u307e\u3059\u3002<\/p>\n<h2>\u4e3b\u306a\u7279\u5fb4\u3068\u6bd4\u8f03<\/h2>\n<p>XGBoost \u3068\u985e\u4f3c\u306e\u7528\u8a9e\u3092\u7c21\u5358\u306b\u6bd4\u8f03\u3059\u308b\u3068\u3001\u6b21\u306e\u3088\u3046\u306b\u306a\u308a\u307e\u3059\u3002<\/p>\n<table>\n<thead>\n<tr>\n<th>\u7279\u6027<\/th>\n<th>XG\u30d6\u30fc\u30b9\u30c8<\/th>\n<th>\u30e9\u30f3\u30c0\u30e0\u30d5\u30a9\u30ec\u30b9\u30c8<\/th>\n<th>\u30e9\u30a4\u30c8GBM<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>\u30d6\u30fc\u30b9\u30c8\u30c6\u30af\u30cb\u30c3\u30af<\/td>\n<td>\u52fe\u914d\u30d6\u30fc\u30b9\u30c6\u30a3\u30f3\u30b0<\/td>\n<td>\u888b\u8a70\u3081<\/td>\n<td>\u52fe\u914d\u30d6\u30fc\u30b9\u30c6\u30a3\u30f3\u30b0<\/td>\n<\/tr>\n<tr>\n<td>\u6b63\u5247\u5316<\/td>\n<td>\u306f\u3044 (L1 \u304a\u3088\u3073 L2)<\/td>\n<td>\u3044\u3044\u3048<\/td>\n<td>\u306f\u3044\uff08\u30d2\u30b9\u30c8\u30b0\u30e9\u30e0\u30d9\u30fc\u30b9\uff09<\/td>\n<\/tr>\n<tr>\n<td>\u6b20\u640d\u30c7\u30fc\u30bf\u306e\u51e6\u7406<\/td>\n<td>\u306f\u3044 (\u81ea\u52d5)<\/td>\n<td>\u3044\u3044\u3048\uff08\u524d\u51e6\u7406\u304c\u5fc5\u8981\uff09<\/td>\n<td>\u306f\u3044 (\u81ea\u52d5)<\/td>\n<\/tr>\n<tr>\n<td>\u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9<\/td>\n<td>\u9ad8\u3044<\/td>\n<td>\u9069\u5ea6<\/td>\n<td>\u9ad8\u3044<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<h2>\u5c55\u671b\u3068\u5c06\u6765\u306e\u30c6\u30af\u30ce\u30ed\u30b8\u30fc<\/h2>\n<p>XGBoost \u306e\u5c06\u6765\u306b\u306f\u3001\u30a8\u30ad\u30b5\u30a4\u30c6\u30a3\u30f3\u30b0\u306a\u53ef\u80fd\u6027\u304c\u79d8\u3081\u3089\u308c\u3066\u3044\u307e\u3059\u3002\u7814\u7a76\u8005\u3068\u958b\u767a\u8005\u306f\u30a2\u30eb\u30b4\u30ea\u30ba\u30e0\u3092\u7d99\u7d9a\u7684\u306b\u6539\u826f\u3057\u3001\u305d\u306e\u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9\u3092\u5411\u4e0a\u3055\u305b\u308b\u305f\u3081\u306e\u65b0\u3057\u3044\u6280\u8853\u3092\u6a21\u7d22\u3057\u3066\u3044\u307e\u3059\u3002\u6f5c\u5728\u7684\u306a\u958b\u767a\u5206\u91ce\u306b\u306f\u3001\u3088\u308a\u52b9\u7387\u7684\u306a\u4e26\u5217\u5316\u3001\u6df1\u5c64\u5b66\u7fd2\u30d5\u30ec\u30fc\u30e0\u30ef\u30fc\u30af\u3068\u306e\u7d71\u5408\u3001\u30ab\u30c6\u30b4\u30ea\u7279\u5fb4\u306e\u51e6\u7406\u306e\u6539\u5584\u306a\u3069\u304c\u542b\u307e\u308c\u307e\u3059\u3002<\/p>\n<h2>XGBoost \u304a\u3088\u3073\u30d7\u30ed\u30ad\u30b7 \u30b5\u30fc\u30d0\u30fc<\/h2>\n<p>\u30d7\u30ed\u30ad\u30b7 \u30b5\u30fc\u30d0\u30fc\u306f\u3001Web \u30b9\u30af\u30ec\u30a4\u30d4\u30f3\u30b0\u3001\u30c7\u30fc\u30bf\u306e\u533f\u540d\u5316\u3001\u30aa\u30f3\u30e9\u30a4\u30f3 \u30d7\u30e9\u30a4\u30d0\u30b7\u30fc\u306a\u3069\u306e\u3055\u307e\u3056\u307e\u306a\u30a2\u30d7\u30ea\u30b1\u30fc\u30b7\u30e7\u30f3\u3067\u91cd\u8981\u306a\u5f79\u5272\u3092\u679c\u305f\u3057\u307e\u3059\u3002 XGBoost \u306f\u3001\u7279\u306b\u30ec\u30fc\u30c8\u5236\u9650\u306e\u3042\u308b API \u3092\u51e6\u7406\u3059\u308b\u5834\u5408\u306b\u52b9\u7387\u7684\u306a\u30c7\u30fc\u30bf\u53ce\u96c6\u3092\u53ef\u80fd\u306b\u3059\u308b\u3053\u3068\u3067\u3001\u30d7\u30ed\u30ad\u30b7 \u30b5\u30fc\u30d0\u30fc\u304b\u3089\u9593\u63a5\u7684\u306b\u6069\u6075\u3092\u53d7\u3051\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002\u30d7\u30ed\u30ad\u30b7 \u30ed\u30fc\u30c6\u30fc\u30b7\u30e7\u30f3\u306f\u30ea\u30af\u30a8\u30b9\u30c8\u3092\u5747\u7b49\u306b\u5206\u6563\u3057\u3001IP \u7981\u6b62\u3092\u9632\u304e\u3001XGBoost \u30e2\u30c7\u30eb\u306e\u30c8\u30ec\u30fc\u30cb\u30f3\u30b0\u3068\u30c6\u30b9\u30c8\u306e\u305f\u3081\u306e\u5b89\u5b9a\u3057\u305f\u30c7\u30fc\u30bf \u30b9\u30c8\u30ea\u30fc\u30e0\u3092\u78ba\u4fdd\u3059\u308b\u306e\u306b\u5f79\u7acb\u3061\u307e\u3059\u3002<\/p>\n<h2>\u95a2\u9023\u30ea\u30f3\u30af<\/h2>\n<p>XGBoost \u306e\u8a73\u7d30\u306b\u3064\u3044\u3066\u306f\u3001\u6b21\u306e\u30ea\u30bd\u30fc\u30b9\u3092\u53c2\u7167\u3057\u3066\u304f\u3060\u3055\u3044\u3002<\/p>\n<ul>\n<li><a href=\"https:\/\/xgboost.readthedocs.io\/en\/latest\/\" target=\"_new\" rel=\"noopener nofollow\">XGBoost \u30c9\u30ad\u30e5\u30e1\u30f3\u30c8<\/a><\/li>\n<li><a href=\"https:\/\/github.com\/dmlc\/xgboost\" target=\"_new\" rel=\"noopener nofollow\">XGBoost GitHub \u30ea\u30dd\u30b8\u30c8\u30ea<\/a><\/li>\n<li><a href=\"https:\/\/homes.cs.washington.edu\/~tqchen\/pdf\/BoostedTree.pdf\" target=\"_new\" rel=\"noopener nofollow\">Tianqi Chen \u306b\u3088\u308b XGBoost \u306e\u7d39\u4ecb<\/a><\/li>\n<\/ul>\n<p>XGBoost \u306f\u3001\u6a5f\u68b0\u5b66\u7fd2\u5b9f\u8df5\u8005\u306e\u6b66\u5668\u5eab\u306b\u304a\u3051\u308b\u5f37\u529b\u306a\u30c4\u30fc\u30eb\u3068\u3057\u3066\u3001\u3055\u307e\u3056\u307e\u306a\u9818\u57df\u306b\u308f\u305f\u3063\u3066\u6b63\u78ba\u306a\u4e88\u6e2c\u3068\u8cb4\u91cd\u306a\u6d1e\u5bdf\u3092\u63d0\u4f9b\u3057\u7d9a\u3051\u3066\u3044\u307e\u3059\u3002\u30d6\u30fc\u30b9\u30c6\u30a3\u30f3\u30b0\u3068\u6b63\u898f\u5316\u306e\u624b\u6cd5\u3092\u72ec\u81ea\u306b\u7d44\u307f\u5408\u308f\u305b\u308b\u3053\u3068\u3067\u5805\u7262\u6027\u3068\u7cbe\u5ea6\u304c\u4fdd\u8a3c\u3055\u308c\u3001\u73fe\u4ee3\u306e\u30c7\u30fc\u30bf \u30b5\u30a4\u30a8\u30f3\u30b9 \u30ef\u30fc\u30af\u30d5\u30ed\u30fc\u306e\u5b9a\u756a\u3068\u306a\u3063\u3066\u3044\u307e\u3059\u3002<\/p>","protected":false},"featured_media":0,"menu_order":0,"template":"","meta":{"_acf_changed":false,"content-type":"","inline_featured_image":false,"footnotes":""},"class_list":["post-479722","wiki","type-wiki","status-publish","hentry"],"acf":{"faq_title":"Frequently Asked Questions about <mark>XGBoost: Enhancing Predictive Power with Extreme Gradient Boosting<\/mark>","faq_items":[{"question":"What is XGBoost and how does it work?","answer":"<p>XGBoost, or Extreme Gradient Boosting, is a state-of-the-art machine learning algorithm that combines gradient boosting and regularization techniques. It sequentially trains weak learners (often decision trees) to correct errors made by previous learners, enhancing predictive accuracy. Regularization is employed to prevent overfitting, resulting in robust and accurate models.<\/p>"},{"question":"How did XGBoost originate?","answer":"<p>XGBoost was developed by Tianqi Chen in 2014 and gained recognition through a research paper presented in 2016. This paper, titled \"XGBoost: A Scalable Tree Boosting System,\" highlighted the algorithm's exceptional performance in machine learning competitions and its ability to handle large datasets effectively.<\/p>"},{"question":"What are the key features of XGBoost?","answer":"<p>XGBoost boasts high performance, scalability, and flexibility. It utilizes shallow decision trees as weak learners and employs gradient boosting to optimize the objective function. Regularization techniques control model complexity, and the algorithm provides insights into feature importance. It can handle missing data and is applicable to various tasks like regression, classification, and ranking.<\/p>"},{"question":"How does XGBoost compare with other algorithms like Random Forests and LightGBM?","answer":"<p>In comparison with Random Forests and LightGBM, XGBoost uses gradient boosting, supports L1 and L2 regularization, and can handle missing data automatically. It generally exhibits higher performance and flexibility, making it a preferred choice in many scenarios.<\/p>"},{"question":"What types of XGBoost are available?","answer":"<p>XGBoost comes in three main types:<\/p><ul><li>XGBoost Regression: Predicts continuous numerical values.<\/li><li>XGBoost Classification: Handles binary and multiclass classification tasks.<\/li><li>XGBoost Ranking: Ranks instances by importance.<\/li><\/ul>"},{"question":"How can proxy servers be associated with XGBoost?","answer":"<p>Proxy servers can indirectly benefit XGBoost by enabling efficient data collection, particularly when dealing with APIs that have rate limits. Proxy rotation can help distribute requests evenly, preventing IP bans and ensuring a consistent stream of data for training and testing XGBoost models.<\/p>"},{"question":"What are the future prospects of XGBoost?","answer":"<p>The future of XGBoost holds promise in areas like improved parallelization, integration with deep learning frameworks, and enhanced handling of categorical features. Ongoing research and development are likely to lead to further advancements and applications.<\/p>"},{"question":"Where can I find more information about XGBoost?","answer":"<p>For more information about XGBoost, you can explore the following resources:<\/p><ul><li><a href=\"https:\/\/xgboost.readthedocs.io\/en\/latest\/\" target=\"_new\">XGBoost Documentation<\/a><\/li><li><a href=\"https:\/\/github.com\/dmlc\/xgboost\" target=\"_new\">XGBoost GitHub Repository<\/a><\/li><li><a href=\"https:\/\/homes.cs.washington.edu\/~tqchen\/pdf\/BoostedTree.pdf\" target=\"_new\">Introduction to XGBoost by Tianqi Chen<\/a><\/li><\/ul>"}]},"_links":{"self":[{"href":"https:\/\/oneproxy.pro\/jp\/wp-json\/wp\/v2\/wiki\/479722","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/oneproxy.pro\/jp\/wp-json\/wp\/v2\/wiki"}],"about":[{"href":"https:\/\/oneproxy.pro\/jp\/wp-json\/wp\/v2\/types\/wiki"}],"version-history":[{"count":0,"href":"https:\/\/oneproxy.pro\/jp\/wp-json\/wp\/v2\/wiki\/479722\/revisions"}],"wp:attachment":[{"href":"https:\/\/oneproxy.pro\/jp\/wp-json\/wp\/v2\/media?parent=479722"}],"curies":[{"name":"\u3046\u30fc\u3093","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}