{"id":479386,"date":"2023-08-09T10:35:54","date_gmt":"2023-08-09T10:35:54","guid":{"rendered":""},"modified":"2023-09-05T11:18:41","modified_gmt":"2023-09-05T11:18:41","slug":"transformer-xl","status":"publish","type":"wiki","link":"https:\/\/oneproxy.pro\/ar\/wiki\/transformer-xl\/","title":{"rendered":"\u0645\u062d\u0648\u0644-XL"},"content":{"rendered":"<p>\u0645\u0639\u0644\u0648\u0645\u0627\u062a \u0645\u0648\u062c\u0632\u0629 \u0639\u0646 Transformer-XL<\/p>\n<p>\u064a\u0639\u062f Transformer-XL\u060c \u0648\u0647\u0648 \u0627\u062e\u062a\u0635\u0627\u0631 \u0644\u0640 Transformer Extra Long\u060c \u0646\u0645\u0648\u0630\u062c\u064b\u0627 \u0645\u062a\u0637\u0648\u0631\u064b\u0627 \u0644\u0644\u062a\u0639\u0644\u0645 \u0627\u0644\u0639\u0645\u064a\u0642 \u064a\u0639\u062a\u0645\u062f \u0639\u0644\u0649 \u0628\u0646\u064a\u0629 Transformer \u0627\u0644\u0623\u0635\u0644\u064a\u0629. \u064a\u0634\u064a\u0631 &quot;XL&quot; \u0641\u064a \u0627\u0633\u0645\u0647 \u0625\u0644\u0649 \u0642\u062f\u0631\u0629 \u0627\u0644\u0646\u0645\u0648\u0630\u062c \u0639\u0644\u0649 \u0627\u0644\u062a\u0639\u0627\u0645\u0644 \u0645\u0639 \u062a\u0633\u0644\u0633\u0644\u0627\u062a \u0623\u0637\u0648\u0644 \u0645\u0646 \u0627\u0644\u0628\u064a\u0627\u0646\u0627\u062a \u0645\u0646 \u062e\u0644\u0627\u0644 \u0622\u0644\u064a\u0629 \u062a\u0639\u0631\u0641 \u0628\u0627\u0633\u0645 \u0627\u0644\u062a\u0643\u0631\u0627\u0631. \u0625\u0646\u0647 \u064a\u0639\u0632\u0632 \u0627\u0644\u062a\u0639\u0627\u0645\u0644 \u0645\u0639 \u0627\u0644\u0645\u0639\u0644\u0648\u0645\u0627\u062a \u0627\u0644\u062a\u0633\u0644\u0633\u0644\u064a\u0629\u060c \u0645\u0645\u0627 \u064a\u0648\u0641\u0631 \u0648\u0639\u064a\u064b\u0627 \u0623\u0641\u0636\u0644 \u0628\u0627\u0644\u0633\u064a\u0627\u0642 \u0648\u0641\u0647\u0645 \u0627\u0644\u062a\u0628\u0639\u064a\u0627\u062a \u0641\u064a \u0627\u0644\u062a\u0633\u0644\u0633\u0644\u0627\u062a \u0627\u0644\u0637\u0648\u064a\u0644\u0629.<\/p>\n<h2>\u062a\u0627\u0631\u064a\u062e \u0623\u0635\u0644 Transformer-XL \u0648\u0623\u0648\u0644 \u0630\u0643\u0631 \u0644\u0647<\/h2>\n<p>\u062a\u0645 \u062a\u0642\u062f\u064a\u0645 Transformer-XL \u0645\u0646 \u0642\u0628\u0644 \u0627\u0644\u0628\u0627\u062d\u062b\u064a\u0646 \u0641\u064a Google Brain \u0641\u064a \u0648\u0631\u0642\u0629 \u0628\u062d\u062b\u064a\u0629 \u0628\u0639\u0646\u0648\u0627\u0646 &quot;Transformer-XL: \u0646\u0645\u0627\u0630\u062c \u0627\u0644\u0644\u063a\u0629 \u0627\u0644\u064a\u0642\u0638\u0629 \u0648\u0631\u0627\u0621 \u0633\u064a\u0627\u0642 \u062b\u0627\u0628\u062a \u0627\u0644\u0637\u0648\u0644&quot;\u060c \u0648\u0627\u0644\u062a\u064a \u062a\u0645 \u0646\u0634\u0631\u0647\u0627 \u0641\u064a \u0639\u0627\u0645 2019. \u0628\u0646\u0627\u0621\u064b \u0639\u0644\u0649 \u0646\u062c\u0627\u062d \u0646\u0645\u0648\u0630\u062c Transformer \u0627\u0644\u0630\u064a \u0627\u0642\u062a\u0631\u062d\u0647 Vaswani et al. \u0641\u064a \u0639\u0627\u0645 2017\u060c \u0633\u0639\u0649 Transformer-XL \u0625\u0644\u0649 \u0627\u0644\u062a\u063a\u0644\u0628 \u0639\u0644\u0649 \u0642\u064a\u0648\u062f \u0627\u0644\u0633\u064a\u0627\u0642 \u0630\u064a \u0627\u0644\u0637\u0648\u0644 \u0627\u0644\u062b\u0627\u0628\u062a\u060c \u0648\u0628\u0627\u0644\u062a\u0627\u0644\u064a \u062a\u062d\u0633\u064a\u0646 \u0642\u062f\u0631\u0629 \u0627\u0644\u0646\u0645\u0648\u0630\u062c \u0639\u0644\u0649 \u0627\u0644\u062a\u0642\u0627\u0637 \u0627\u0644\u062a\u0628\u0639\u064a\u0627\u062a \u0637\u0648\u064a\u0644\u0629 \u0627\u0644\u0645\u062f\u0649.<\/p>\n<h2>\u0645\u0639\u0644\u0648\u0645\u0627\u062a \u062a\u0641\u0635\u064a\u0644\u064a\u0629 \u062d\u0648\u0644 Transformer-XL: \u062a\u0648\u0633\u064a\u0639 \u0645\u0648\u0636\u0648\u0639 Transformer-XL<\/h2>\n<p>\u064a\u062a\u0645\u064a\u0632 Transformer-XL \u0628\u0642\u062f\u0631\u062a\u0647 \u0639\u0644\u0649 \u0627\u0644\u062a\u0642\u0627\u0637 \u0627\u0644\u062a\u0628\u0639\u064a\u0627\u062a \u0639\u0628\u0631 \u062a\u0633\u0644\u0633\u0644\u0627\u062a \u0645\u0645\u062a\u062f\u0629\u060c \u0645\u0645\u0627 \u064a\u0639\u0632\u0632 \u0641\u0647\u0645 \u0627\u0644\u0633\u064a\u0627\u0642 \u0641\u064a \u0645\u0647\u0627\u0645 \u0645\u062b\u0644 \u0625\u0646\u0634\u0627\u0621 \u0627\u0644\u0646\u0635 \u0648\u0627\u0644\u062a\u0631\u062c\u0645\u0629 \u0648\u0627\u0644\u062a\u062d\u0644\u064a\u0644. \u064a\u0642\u062f\u0645 \u0627\u0644\u062a\u0635\u0645\u064a\u0645 \u0627\u0644\u062c\u062f\u064a\u062f \u0627\u0644\u062a\u0643\u0631\u0627\u0631 \u0639\u0628\u0631 \u0627\u0644\u0645\u0642\u0627\u0637\u0639 \u0648\u0646\u0638\u0627\u0645 \u0627\u0644\u062a\u0631\u0645\u064a\u0632 \u0627\u0644\u0645\u0648\u0636\u0639\u064a \u0627\u0644\u0646\u0633\u0628\u064a. \u0648\u0647\u0630\u0627 \u064a\u0633\u0645\u062d \u0644\u0644\u0646\u0645\u0648\u0630\u062c \u0628\u062a\u0630\u0643\u0631 \u0627\u0644\u062d\u0627\u0644\u0627\u062a \u0627\u0644\u0645\u062e\u0641\u064a\u0629 \u0639\u0628\u0631 \u0627\u0644\u0623\u062c\u0632\u0627\u0621 \u0627\u0644\u0645\u062e\u062a\u0644\u0641\u0629\u060c \u0645\u0645\u0627 \u064a\u0645\u0647\u062f \u0627\u0644\u0637\u0631\u064a\u0642 \u0644\u0641\u0647\u0645 \u0623\u0639\u0645\u0642 \u0644\u0644\u062a\u0633\u0644\u0633\u0644\u0627\u062a \u0627\u0644\u0646\u0635\u064a\u0629 \u0627\u0644\u0637\u0648\u064a\u0644\u0629.<\/p>\n<h2>\u0627\u0644\u0647\u064a\u0643\u0644 \u0627\u0644\u062f\u0627\u062e\u0644\u064a \u0644\u0644\u0645\u062d\u0648\u0644-XL: \u0643\u064a\u0641 \u064a\u0639\u0645\u0644 \u0627\u0644\u0645\u062d\u0648\u0644-XL<\/h2>\n<p>\u064a\u062a\u0643\u0648\u0646 Transformer-XL \u0645\u0646 \u0639\u062f\u0629 \u0637\u0628\u0642\u0627\u062a \u0648\u0645\u0643\u0648\u0646\u0627\u062a\u060c \u0628\u0645\u0627 \u0641\u064a \u0630\u0644\u0643:<\/p>\n<ol>\n<li><strong>\u062a\u0643\u0631\u0627\u0631 \u0627\u0644\u0645\u0642\u0637\u0639:<\/strong> \u064a\u0633\u0645\u062d \u0628\u0625\u0639\u0627\u062f\u0629 \u0627\u0633\u062a\u062e\u062f\u0627\u0645 \u0627\u0644\u062d\u0627\u0644\u0627\u062a \u0627\u0644\u0645\u062e\u0641\u064a\u0629 \u0645\u0646 \u0627\u0644\u0645\u0642\u0627\u0637\u0639 \u0627\u0644\u0633\u0627\u0628\u0642\u0629 \u0641\u064a \u0627\u0644\u0645\u0642\u0627\u0637\u0639 \u0627\u0644\u062a\u0627\u0644\u064a\u0629.<\/li>\n<li><strong>\u0627\u0644\u062a\u0631\u0645\u064a\u0632\u0627\u062a \u0627\u0644\u0645\u0648\u0636\u0639\u064a\u0629 \u0627\u0644\u0646\u0633\u0628\u064a\u0629:<\/strong> \u064a\u0633\u0627\u0639\u062f \u0627\u0644\u0646\u0645\u0648\u0630\u062c \u0639\u0644\u0649 \u0641\u0647\u0645 \u0627\u0644\u0645\u0648\u0627\u0636\u0639 \u0627\u0644\u0646\u0633\u0628\u064a\u0629 \u0644\u0644\u0631\u0645\u0648\u0632 \u0636\u0645\u0646 \u0627\u0644\u062a\u0633\u0644\u0633\u0644\u060c \u0628\u063a\u0636 \u0627\u0644\u0646\u0638\u0631 \u0639\u0646 \u0645\u0648\u0627\u0636\u0639\u0647\u0627 \u0627\u0644\u0645\u0637\u0644\u0642\u0629.<\/li>\n<li><strong>\u0637\u0628\u0642\u0627\u062a \u0627\u0644\u0627\u0647\u062a\u0645\u0627\u0645:<\/strong> \u062a\u0645\u0643\u0646 \u0647\u0630\u0647 \u0627\u0644\u0637\u0628\u0642\u0627\u062a \u0627\u0644\u0646\u0645\u0648\u0630\u062c \u0645\u0646 \u0627\u0644\u062a\u0631\u0643\u064a\u0632 \u0639\u0644\u0649 \u0623\u062c\u0632\u0627\u0621 \u0645\u062e\u062a\u0644\u0641\u0629 \u0645\u0646 \u062a\u0633\u0644\u0633\u0644 \u0627\u0644\u0625\u062f\u062e\u0627\u0644 \u062d\u0633\u0628 \u0627\u0644\u062d\u0627\u062c\u0629.<\/li>\n<li><strong>\u0637\u0628\u0642\u0627\u062a \u0627\u0644\u062a\u063a\u0630\u064a\u0629 \u0627\u0644\u0623\u0645\u0627\u0645\u064a\u0629:<\/strong> - \u0645\u0633\u0624\u0648\u0644 \u0639\u0646 \u062a\u062d\u0648\u064a\u0644 \u0627\u0644\u0628\u064a\u0627\u0646\u0627\u062a \u0623\u062b\u0646\u0627\u0621 \u0645\u0631\u0648\u0631\u0647\u0627 \u0639\u0628\u0631 \u0627\u0644\u0634\u0628\u0643\u0629.<\/li>\n<\/ol>\n<p>\u064a\u0633\u0645\u062d \u0627\u0644\u062c\u0645\u0639 \u0628\u064a\u0646 \u0647\u0630\u0647 \u0627\u0644\u0645\u0643\u0648\u0646\u0627\u062a \u0644\u0640 Transformer-XL \u0628\u0627\u0644\u062a\u0639\u0627\u0645\u0644 \u0645\u0639 \u0627\u0644\u062a\u0633\u0644\u0633\u0644\u0627\u062a \u0627\u0644\u0623\u0637\u0648\u0644 \u0648\u0627\u0644\u062a\u0642\u0627\u0637 \u0627\u0644\u062a\u0628\u0639\u064a\u0627\u062a \u0627\u0644\u062a\u064a \u064a\u0635\u0639\u0628 \u0639\u0644\u0649 \u0646\u0645\u0627\u0630\u062c Transformer \u0627\u0644\u0642\u064a\u0627\u0633\u064a\u0629.<\/p>\n<h2>\u062a\u062d\u0644\u064a\u0644 \u0627\u0644\u0633\u0645\u0627\u062a \u0627\u0644\u0631\u0626\u064a\u0633\u064a\u0629 \u0644\u0644\u0645\u062d\u0648\u0644-XL<\/h2>\n<p>\u062a\u062a\u0636\u0645\u0646 \u0628\u0639\u0636 \u0627\u0644\u0645\u064a\u0632\u0627\u062a \u0627\u0644\u0631\u0626\u064a\u0633\u064a\u0629 \u0644\u0628\u0631\u0646\u0627\u0645\u062c Transformer-XL \u0645\u0627 \u064a\u0644\u064a:<\/p>\n<ul>\n<li><strong>\u0627\u0644\u0630\u0627\u0643\u0631\u0629 \u0627\u0644\u0633\u064a\u0627\u0642\u064a\u0629 \u0627\u0644\u0623\u0637\u0648\u0644:<\/strong> \u064a\u0644\u062a\u0642\u0637 \u0627\u0644\u062a\u0628\u0639\u064a\u0627\u062a \u0637\u0648\u064a\u0644\u0629 \u0627\u0644\u0645\u062f\u0649 \u0628\u0627\u0644\u062a\u0633\u0644\u0633\u0644.<\/li>\n<li><strong>\u0632\u064a\u0627\u062f\u0629 \u0627\u0644\u0643\u0641\u0627\u0621\u0629:<\/strong> \u0625\u0639\u0627\u062f\u0629 \u0627\u0633\u062a\u062e\u062f\u0627\u0645 \u0627\u0644\u062d\u0633\u0627\u0628\u0627\u062a \u0645\u0646 \u0627\u0644\u0642\u0637\u0627\u0639\u0627\u062a \u0627\u0644\u0633\u0627\u0628\u0642\u0629\u060c \u0648\u062a\u062d\u0633\u064a\u0646 \u0627\u0644\u0643\u0641\u0627\u0621\u0629.<\/li>\n<li><strong>\u062a\u0639\u0632\u064a\u0632 \u0627\u0633\u062a\u0642\u0631\u0627\u0631 \u0627\u0644\u062a\u062f\u0631\u064a\u0628:<\/strong> \u064a\u0642\u0644\u0644 \u0645\u0646 \u0645\u0634\u0643\u0644\u0629 \u0627\u062e\u062a\u0641\u0627\u0621 \u0627\u0644\u062a\u062f\u0631\u062c\u0627\u062a \u0641\u064a \u062a\u0633\u0644\u0633\u0644\u0627\u062a \u0623\u0637\u0648\u0644.<\/li>\n<li><strong>\u0627\u0644\u0645\u0631\u0648\u0646\u0629:<\/strong> \u064a\u0645\u0643\u0646 \u062a\u0637\u0628\u064a\u0642\u0647 \u0639\u0644\u0649 \u0627\u0644\u0639\u062f\u064a\u062f \u0645\u0646 \u0627\u0644\u0645\u0647\u0627\u0645 \u0627\u0644\u0645\u062a\u0633\u0644\u0633\u0644\u0629\u060c \u0628\u0645\u0627 \u0641\u064a \u0630\u0644\u0643 \u0625\u0646\u0634\u0627\u0621 \u0627\u0644\u0646\u0635 \u0648\u0627\u0644\u062a\u0631\u062c\u0645\u0629 \u0627\u0644\u0622\u0644\u064a\u0629.<\/li>\n<\/ul>\n<h2>\u0623\u0646\u0648\u0627\u0639 \u0627\u0644\u0645\u062d\u0648\u0644\u0627\u062a-XL<\/h2>\n<p>\u0647\u0646\u0627\u0643 \u0628\u0634\u0643\u0644 \u0623\u0633\u0627\u0633\u064a \u0628\u0646\u064a\u0629 \u0648\u0627\u062d\u062f\u0629 \u0644\u0640 Transformer-XL\u060c \u0648\u0644\u0643\u0646 \u064a\u0645\u0643\u0646 \u062a\u062e\u0635\u064a\u0635\u0647\u0627 \u0644\u0645\u0647\u0627\u0645 \u0645\u062e\u062a\u0644\u0641\u0629\u060c \u0645\u062b\u0644:<\/p>\n<ol>\n<li><strong>\u0646\u0645\u0630\u062c\u0629 \u0627\u0644\u0644\u063a\u0629:<\/strong> \u0641\u0647\u0645 \u0648\u0625\u0646\u0634\u0627\u0621 \u0646\u0635 \u0627\u0644\u0644\u063a\u0629 \u0627\u0644\u0637\u0628\u064a\u0639\u064a\u0629.<\/li>\n<li><strong>\u0627\u0644\u062a\u0631\u062c\u0645\u0629 \u0627\u0644\u0622\u0644\u064a\u0629:<\/strong> \u062a\u0631\u062c\u0645\u0629 \u0627\u0644\u0646\u0635 \u0628\u064a\u0646 \u0627\u0644\u0644\u063a\u0627\u062a \u0627\u0644\u0645\u062e\u062a\u0644\u0641\u0629.<\/li>\n<li><strong>\u062a\u0644\u062e\u064a\u0635 \u0627\u0644\u0646\u0635:<\/strong> \u062a\u0644\u062e\u064a\u0635 \u0623\u062c\u0632\u0627\u0621 \u0643\u0628\u064a\u0631\u0629 \u0645\u0646 \u0627\u0644\u0646\u0635.<\/li>\n<\/ol>\n<h2>\u0637\u0631\u0642 \u0627\u0633\u062a\u062e\u062f\u0627\u0645 Transformer-XL \u0648\u0627\u0644\u0645\u0634\u0643\u0644\u0627\u062a \u0648\u062d\u0644\u0648\u0644\u0647\u0627 \u0627\u0644\u0645\u062a\u0639\u0644\u0642\u0629 \u0628\u0627\u0644\u0627\u0633\u062a\u062e\u062f\u0627\u0645<\/h2>\n<p><strong>\u0637\u0631\u0642 \u0627\u0644\u0627\u0633\u062a\u062e\u062f\u0627\u0645:<\/strong><\/p>\n<ul>\n<li>\u0641\u0647\u0645 \u0627\u0644\u0644\u063a\u0629 \u0627\u0644\u0637\u0628\u064a\u0639\u064a\u0629<\/li>\n<li>\u062a\u0648\u0644\u064a\u062f \u0627\u0644\u0646\u0635<\/li>\n<li>\u0627\u0644\u062a\u0631\u062c\u0645\u0629 \u0627\u0644\u0622\u0644\u064a\u0629<\/li>\n<\/ul>\n<p><strong>\u0627\u0644\u0645\u0634\u0627\u0643\u0644 \u0648\u0627\u0644\u062d\u0644\u0648\u0644:<\/strong><\/p>\n<ul>\n<li><strong>\u0645\u0634\u0643\u0644\u0629:<\/strong> \u0627\u0633\u062a\u0647\u0644\u0627\u0643 \u0627\u0644\u0630\u0627\u0643\u0631\u0629\n<ul>\n<li><strong>\u062d\u0644:<\/strong> \u0627\u0633\u062a\u062e\u062f\u0645 \u0627\u0644\u062a\u0648\u0627\u0632\u064a \u0627\u0644\u0646\u0645\u0648\u0630\u062c\u064a \u0623\u0648 \u062a\u0642\u0646\u064a\u0627\u062a \u0627\u0644\u062a\u062d\u0633\u064a\u0646 \u0627\u0644\u0623\u062e\u0631\u0649.<\/li>\n<\/ul>\n<\/li>\n<li><strong>\u0645\u0634\u0643\u0644\u0629:<\/strong> \u0627\u0644\u062a\u0639\u0642\u064a\u062f \u0641\u064a \u0627\u0644\u062a\u062f\u0631\u064a\u0628\n<ul>\n<li><strong>\u062d\u0644:<\/strong> \u0627\u0633\u062a\u062e\u062f\u0645 \u0627\u0644\u0646\u0645\u0627\u0630\u062c \u0627\u0644\u0645\u062f\u0631\u0628\u0629 \u0645\u0633\u0628\u0642\u064b\u0627 \u0623\u0648 \u0642\u0645 \u0628\u0636\u0628\u0637 \u0645\u0647\u0627\u0645 \u0645\u062d\u062f\u062f\u0629.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<h2>\u0627\u0644\u062e\u0635\u0627\u0626\u0635 \u0627\u0644\u0631\u0626\u064a\u0633\u064a\u0629 \u0648\u0645\u0642\u0627\u0631\u0646\u0627\u062a \u0623\u062e\u0631\u0649 \u0645\u0639 \u0645\u0635\u0637\u0644\u062d\u0627\u062a \u0645\u0645\u0627\u062b\u0644\u0629<\/h2>\n<table>\n<thead>\n<tr>\n<th>\u0645\u064a\u0632\u0629<\/th>\n<th>\u0645\u062d\u0648\u0644-XL<\/th>\n<th>\u0645\u062d\u0648\u0644 \u0623\u0635\u0644\u064a<\/th>\n<th>LSTM<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>\u0627\u0644\u0630\u0627\u0643\u0631\u0629 \u0627\u0644\u0633\u064a\u0627\u0642\u064a\u0629<\/td>\n<td>\u0645\u0645\u062a\u062f<\/td>\n<td>\u0637\u0648\u0644 \u062b\u0627\u0628\u062a<\/td>\n<td>\u0642\u0635\u064a\u0631<\/td>\n<\/tr>\n<tr>\n<td>\u0627\u0644\u0643\u0641\u0627\u0621\u0629 \u0627\u0644\u062d\u0633\u0627\u0628\u064a\u0629<\/td>\n<td>\u0623\u0639\u0644\u0649<\/td>\n<td>\u0648\u0627\u0633\u0637\u0629<\/td>\n<td>\u0623\u062f\u0646\u0649<\/td>\n<\/tr>\n<tr>\n<td>\u0627\u0633\u062a\u0642\u0631\u0627\u0631 \u0627\u0644\u062a\u062f\u0631\u064a\u0628<\/td>\n<td>\u062a\u062d\u0633\u064a\u0646<\/td>\n<td>\u0645\u0639\u064a\u0627\u0631<\/td>\n<td>\u0623\u062f\u0646\u0649<\/td>\n<\/tr>\n<tr>\n<td>\u0627\u0644\u0645\u0631\u0648\u0646\u0629<\/td>\n<td>\u0639\u0627\u0644\u064a<\/td>\n<td>\u0648\u0627\u0633\u0637\u0629<\/td>\n<td>\u0648\u0627\u0633\u0637\u0629<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<h2>\u0648\u062c\u0647\u0627\u062a \u0646\u0638\u0631 \u0648\u062a\u0642\u0646\u064a\u0627\u062a \u0627\u0644\u0645\u0633\u062a\u0642\u0628\u0644 \u0627\u0644\u0645\u062a\u0639\u0644\u0642\u0629 \u0628\u0627\u0644\u0645\u062d\u0648\u0644-XL<\/h2>\n<p>\u064a\u0645\u0647\u062f Transformer-XL \u0627\u0644\u0637\u0631\u064a\u0642 \u0644\u0646\u0645\u0627\u0630\u062c \u0623\u0643\u062b\u0631 \u062a\u0642\u062f\u0645\u064b\u0627 \u064a\u0645\u0643\u0646\u0647\u0627 \u0641\u0647\u0645 \u0648\u0625\u0646\u0634\u0627\u0621 \u062a\u0633\u0644\u0633\u0644\u0627\u062a \u0646\u0635\u064a\u0629 \u0637\u0648\u064a\u0644\u0629. \u0642\u062f \u062a\u0631\u0643\u0632 \u0627\u0644\u0623\u0628\u062d\u0627\u062b \u0627\u0644\u0645\u0633\u062a\u0642\u0628\u0644\u064a\u0629 \u0639\u0644\u0649 \u062a\u0642\u0644\u064a\u0644 \u0627\u0644\u062a\u0639\u0642\u064a\u062f \u0627\u0644\u062d\u0633\u0627\u0628\u064a\u060c \u0648\u0632\u064a\u0627\u062f\u0629 \u062a\u0639\u0632\u064a\u0632 \u0643\u0641\u0627\u0621\u0629 \u0627\u0644\u0646\u0645\u0648\u0630\u062c\u060c \u0648\u062a\u0648\u0633\u064a\u0639 \u062a\u0637\u0628\u064a\u0642\u0627\u062a\u0647 \u0644\u062a\u0634\u0645\u0644 \u0645\u062c\u0627\u0644\u0627\u062a \u0623\u062e\u0631\u0649 \u0645\u062b\u0644 \u0645\u0639\u0627\u0644\u062c\u0629 \u0627\u0644\u0641\u064a\u062f\u064a\u0648 \u0648\u0627\u0644\u0635\u0648\u062a.<\/p>\n<h2>\u0643\u064a\u0641 \u064a\u0645\u0643\u0646 \u0627\u0633\u062a\u062e\u062f\u0627\u0645 \u0627\u0644\u062e\u0648\u0627\u062f\u0645 \u0627\u0644\u0648\u0643\u064a\u0644\u0629 \u0623\u0648 \u0631\u0628\u0637\u0647\u0627 \u0628\u0640 Transformer-XL<\/h2>\n<p>\u064a\u0645\u0643\u0646 \u0627\u0633\u062a\u062e\u062f\u0627\u0645 \u0627\u0644\u062e\u0648\u0627\u062f\u0645 \u0627\u0644\u0648\u0643\u064a\u0644\u0629 \u0645\u062b\u0644 OneProxy \u0641\u064a \u062c\u0645\u0639 \u0627\u0644\u0628\u064a\u0627\u0646\u0627\u062a \u0644\u062a\u062f\u0631\u064a\u0628 \u0646\u0645\u0627\u0630\u062c Transformer-XL. \u0645\u0646 \u062e\u0644\u0627\u0644 \u0625\u062e\u0641\u0627\u0621 \u0647\u0648\u064a\u0629 \u0637\u0644\u0628\u0627\u062a \u0627\u0644\u0628\u064a\u0627\u0646\u0627\u062a\u060c \u064a\u0645\u0643\u0646 \u0644\u0644\u062e\u0648\u0627\u062f\u0645 \u0627\u0644\u0648\u0643\u064a\u0644\u0629 \u062a\u0633\u0647\u064a\u0644 \u062c\u0645\u0639 \u0645\u062c\u0645\u0648\u0639\u0627\u062a \u0627\u0644\u0628\u064a\u0627\u0646\u0627\u062a \u0627\u0644\u0643\u0628\u064a\u0631\u0629 \u0648\u0627\u0644\u0645\u062a\u0646\u0648\u0639\u0629. \u064a\u0645\u0643\u0646 \u0623\u0646 \u064a\u0633\u0627\u0639\u062f \u0630\u0644\u0643 \u0641\u064a \u062a\u0637\u0648\u064a\u0631 \u0646\u0645\u0627\u0630\u062c \u0623\u0643\u062b\u0631 \u0642\u0648\u0629 \u0648\u062a\u0646\u0648\u0639\u064b\u0627\u060c \u0645\u0645\u0627 \u064a\u0639\u0632\u0632 \u0627\u0644\u0623\u062f\u0627\u0621 \u0639\u0628\u0631 \u0627\u0644\u0645\u0647\u0627\u0645 \u0648\u0627\u0644\u0644\u063a\u0627\u062a \u0627\u0644\u0645\u062e\u062a\u0644\u0641\u0629.<\/p>\n<h2>\u0631\u0648\u0627\u0628\u0637 \u0630\u0627\u062a \u0639\u0644\u0627\u0642\u0629<\/h2>\n<ol>\n<li><a href=\"https:\/\/arxiv.org\/abs\/1901.02860\" target=\"_new\" rel=\"noopener nofollow\">\u0648\u0631\u0642 Transformer-XL \u0627\u0644\u0623\u0635\u0644\u064a<\/a><\/li>\n<li><a href=\"https:\/\/ai.googleblog.com\/2019\/01\/transformer-xl-unleashing-potential-of.html\" target=\"_new\" rel=\"noopener nofollow\">\u0645\u0646\u0634\u0648\u0631 \u0645\u062f\u0648\u0646\u0629 Google AI \u0639\u0644\u0649 Transformer-XL<\/a><\/li>\n<li><a href=\"https:\/\/github.com\/tensorflow\/tensor2tensor\/tree\/master\/tensor2tensor\/models\/research\/transformer_xl\" target=\"_new\" rel=\"noopener nofollow\">\u062a\u0646\u0641\u064a\u0630 TensorFlow \u0644\u0644\u0645\u062d\u0648\u0644-XL<\/a><\/li>\n<li><a href=\"https:\/\/oneproxy.pro\/ar\/\" target=\"_new\" rel=\"noopener\">\u0645\u0648\u0642\u0639 OneProxy<\/a><\/li>\n<\/ol>\n<p>\u064a\u0639\u062f Transformer-XL \u062a\u0642\u062f\u0645\u064b\u0627 \u0643\u0628\u064a\u0631\u064b\u0627 \u0641\u064a \u0627\u0644\u062a\u0639\u0644\u0645 \u0627\u0644\u0639\u0645\u064a\u0642\u060c \u062d\u064a\u062b \u064a\u0648\u0641\u0631 \u0625\u0645\u0643\u0627\u0646\u0627\u062a \u0645\u062d\u0633\u0646\u0629 \u0641\u064a \u0641\u0647\u0645 \u0648\u0625\u0646\u0634\u0627\u0621 \u062a\u0633\u0644\u0633\u0644\u0627\u062a \u0637\u0648\u064a\u0644\u0629. \u062a\u0637\u0628\u064a\u0642\u0627\u062a\u0647\u0627 \u0648\u0627\u0633\u0639\u0629 \u0627\u0644\u0646\u0637\u0627\u0642\u060c \u0648\u0645\u0646 \u0627\u0644\u0645\u0631\u062c\u062d \u0623\u0646 \u064a\u0624\u062b\u0631 \u062a\u0635\u0645\u064a\u0645\u0647\u0627 \u0627\u0644\u0645\u0628\u062a\u0643\u0631 \u0639\u0644\u0649 \u0627\u0644\u0623\u0628\u062d\u0627\u062b \u0627\u0644\u0645\u0633\u062a\u0642\u0628\u0644\u064a\u0629 \u0641\u064a \u0645\u062c\u0627\u0644 \u0627\u0644\u0630\u0643\u0627\u0621 \u0627\u0644\u0627\u0635\u0637\u0646\u0627\u0639\u064a \u0648\u0627\u0644\u062a\u0639\u0644\u0645 \u0627\u0644\u0622\u0644\u064a.<\/p>","protected":false},"featured_media":470729,"menu_order":0,"template":"","meta":{"_acf_changed":false,"content-type":"","inline_featured_image":false,"footnotes":""},"class_list":["post-479386","wiki","type-wiki","status-publish","has-post-thumbnail","hentry"],"acf":{"faq_title":"Frequently Asked Questions about <mark>Transformer-XL: An In-Depth Exploration<\/mark>","faq_items":[{"question":"What is Transformer-XL?","answer":"<p>Transformer-XL, or Transformer Extra Long, is a deep learning model that builds upon the original Transformer architecture. It's designed to handle longer sequences of data by using a mechanism known as recurrence. This allows for better understanding of context and dependencies in long sequences, particularly useful in natural language processing tasks.<\/p>"},{"question":"What are the key features of Transformer-XL?","answer":"<p>The key features of Transformer-XL include longer contextual memory, increased efficiency, enhanced training stability, and flexibility. These features enable it to capture long-term dependencies in sequences, reuse computations, reduce vanishing gradients in longer sequences, and be applied to various sequential tasks.<\/p>"},{"question":"How does the Transformer-XL work?","answer":"<p>The Transformer-XL consists of several components including segment recurrence, relative positional encodings, attention layers, and feed-forward layers. These components work together to allow Transformer-XL to handle longer sequences, improve efficiency, and capture dependencies that are otherwise difficult for standard Transformer models.<\/p>"},{"question":"How is Transformer-XL different from other models like the original Transformer and LSTM?","answer":"<p>Transformer-XL is known for its extended contextual memory, higher computational efficiency, improved training stability, and high flexibility. This contrasts with the original Transformer's fixed-length context and LSTM's shorter contextual memory. The comparative table in the main article provides a detailed comparison.<\/p>"},{"question":"What types of Transformer-XL exist and what are its applications?","answer":"<p>There is mainly one architecture for Transformer-XL, but it can be tailored for different tasks such as language modeling, machine translation, and text summarization.<\/p>"},{"question":"What problems might arise with Transformer-XL and how can they be solved?","answer":"<p>Some challenges include memory consumption and complexity in training. These can be addressed through techniques like model parallelism, optimization techniques, using pre-trained models, or fine-tuning on specific tasks.<\/p>"},{"question":"How can proxy servers like OneProxy be associated with Transformer-XL?","answer":"<p>Proxy servers like OneProxy can be used in data gathering for training Transformer-XL models. They facilitate the collection of large, diverse datasets by anonymizing data requests, aiding in the development of robust and versatile models.<\/p>"},{"question":"What are the future perspectives related to Transformer-XL?","answer":"<p>The future of Transformer-XL may focus on reducing computational complexity, enhancing efficiency, and expanding its applications to domains like video and audio processing. It's paving the way for advanced models that can understand and generate long textual sequences.<\/p>"},{"question":"Where can I find more information about Transformer-XL?","answer":"<p>You can find more detailed information through the original Transformer-XL paper, Google's AI blog post on Transformer-XL, the TensorFlow implementation of Transformer-XL, and the OneProxy website. Links to these resources are provided in the related links section of the article.<\/p>"}]},"_links":{"self":[{"href":"https:\/\/oneproxy.pro\/ar\/wp-json\/wp\/v2\/wiki\/479386","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/oneproxy.pro\/ar\/wp-json\/wp\/v2\/wiki"}],"about":[{"href":"https:\/\/oneproxy.pro\/ar\/wp-json\/wp\/v2\/types\/wiki"}],"version-history":[{"count":0,"href":"https:\/\/oneproxy.pro\/ar\/wp-json\/wp\/v2\/wiki\/479386\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/oneproxy.pro\/ar\/wp-json\/wp\/v2\/media\/470729"}],"wp:attachment":[{"href":"https:\/\/oneproxy.pro\/ar\/wp-json\/wp\/v2\/media?parent=479386"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}