{"id":475960,"date":"2023-08-09T07:24:43","date_gmt":"2023-08-09T07:24:43","guid":{"rendered":""},"modified":"2023-09-05T11:11:42","modified_gmt":"2023-09-05T11:11:42","slug":"backpropagation","status":"publish","type":"wiki","link":"https:\/\/oneproxy.pro\/in\/wiki\/backpropagation\/","title":{"rendered":"\u092a\u0936\u094d\u091a\u092a\u094d\u0930\u091a\u093e\u0930"},"content":{"rendered":"<p>\u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928 \u090f\u0915 \u092e\u094c\u0932\u093f\u0915 \u090f\u0932\u094d\u0917\u094b\u0930\u093f\u0925\u094d\u092e \u0939\u0948 \u091c\u093f\u0938\u0915\u093e \u0909\u092a\u092f\u094b\u0917 \u0915\u0943\u0924\u094d\u0930\u093f\u092e \u0924\u0902\u0924\u094d\u0930\u093f\u0915\u093e \u0928\u0947\u091f\u0935\u0930\u094d\u0915 (ANN) \u092e\u0947\u0902 \u092a\u094d\u0930\u0936\u093f\u0915\u094d\u0937\u0923 \u0914\u0930 \u0905\u0928\u0941\u0915\u0942\u0932\u0928 \u0909\u0926\u094d\u0926\u0947\u0936\u094d\u092f\u094b\u0902 \u0915\u0947 \u0932\u093f\u090f \u0915\u093f\u092f\u093e \u091c\u093e\u0924\u093e \u0939\u0948\u0964 \u092f\u0939 ANN \u0915\u094b \u0921\u0947\u091f\u093e \u0938\u0947 \u0938\u0940\u0916\u0928\u0947 \u0914\u0930 \u0938\u092e\u092f \u0915\u0947 \u0938\u093e\u0925 \u0905\u092a\u0928\u0947 \u092a\u094d\u0930\u0926\u0930\u094d\u0936\u0928 \u0915\u094b \u092c\u0947\u0939\u0924\u0930 \u092c\u0928\u093e\u0928\u0947 \u092e\u0947\u0902 \u0938\u0915\u094d\u0937\u092e \u092c\u0928\u093e\u0928\u0947 \u092e\u0947\u0902 \u092e\u0939\u0924\u094d\u0935\u092a\u0942\u0930\u094d\u0923 \u092d\u0942\u092e\u093f\u0915\u093e \u0928\u093f\u092d\u093e\u0924\u093e \u0939\u0948\u0964 \u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928 \u0915\u0940 \u0905\u0935\u0927\u093e\u0930\u0923\u093e \u0915\u0943\u0924\u094d\u0930\u093f\u092e \u092c\u0941\u0926\u094d\u0927\u093f\u092e\u0924\u094d\u0924\u093e \u0905\u0928\u0941\u0938\u0902\u0927\u093e\u0928 \u0915\u0947 \u0936\u0941\u0930\u0941\u0906\u0924\u0940 \u0926\u093f\u0928\u094b\u0902 \u0938\u0947 \u091a\u0932\u0940 \u0906 \u0930\u0939\u0940 \u0939\u0948 \u0914\u0930 \u0924\u092c \u0938\u0947 \u092f\u0939 \u0906\u0927\u0941\u0928\u093f\u0915 \u092e\u0936\u0940\u0928 \u0932\u0930\u094d\u0928\u093f\u0902\u0917 \u0914\u0930 \u0921\u0940\u092a \u0932\u0930\u094d\u0928\u093f\u0902\u0917 \u0924\u0915\u0928\u0940\u0915\u094b\u0902 \u0915\u0940 \u0906\u0927\u093e\u0930\u0936\u093f\u0932\u093e \u092c\u0928 \u0917\u0908 \u0939\u0948\u0964<\/p>\n<h2>\u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928 \u0915\u0940 \u0909\u0924\u094d\u092a\u0924\u094d\u0924\u093f \u0915\u093e \u0907\u0924\u093f\u0939\u093e\u0938 \u0914\u0930 \u0907\u0938\u0915\u093e \u092a\u0939\u0932\u093e \u0909\u0932\u094d\u0932\u0947\u0916<\/h2>\n<p>\u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928 \u0915\u0940 \u0909\u0924\u094d\u092a\u0924\u094d\u0924\u093f \u0915\u093e \u092a\u0924\u093e 1960 \u0915\u0947 \u0926\u0936\u0915 \u092e\u0947\u0902 \u0932\u0917\u093e\u092f\u093e \u091c\u093e \u0938\u0915\u0924\u093e \u0939\u0948, \u091c\u092c \u0936\u094b\u0927\u0915\u0930\u094d\u0924\u093e\u0913\u0902 \u0928\u0947 \u0915\u0943\u0924\u094d\u0930\u093f\u092e \u0924\u0902\u0924\u094d\u0930\u093f\u0915\u093e \u0928\u0947\u091f\u0935\u0930\u094d\u0915 \u0915\u094b \u0938\u094d\u0935\u091a\u093e\u0932\u093f\u0924 \u0930\u0942\u092a \u0938\u0947 \u092a\u094d\u0930\u0936\u093f\u0915\u094d\u0937\u093f\u0924 \u0915\u0930\u0928\u0947 \u0915\u0947 \u0924\u0930\u0940\u0915\u094b\u0902 \u0915\u0940 \u0916\u094b\u091c \u0936\u0941\u0930\u0942 \u0915\u0940\u0964 1961 \u092e\u0947\u0902, \u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928 \u0915\u0947 \u0938\u092e\u093e\u0928 \u092a\u094d\u0930\u0915\u094d\u0930\u093f\u092f\u093e \u0915\u0947 \u092e\u093e\u0927\u094d\u092f\u092e \u0938\u0947 \u0924\u0902\u0924\u094d\u0930\u093f\u0915\u093e \u0928\u0947\u091f\u0935\u0930\u094d\u0915 \u0915\u094b \u092a\u094d\u0930\u0936\u093f\u0915\u094d\u0937\u093f\u0924 \u0915\u0930\u0928\u0947 \u0915\u093e \u092a\u0939\u0932\u093e \u092a\u094d\u0930\u092f\u093e\u0938 \u0938\u094d\u091f\u0941\u0905\u0930\u094d\u091f \u0921\u094d\u0930\u0947\u092b\u0938 \u0928\u0947 \u0905\u092a\u0928\u0947 \u092a\u0940\u090f\u091a\u0921\u0940 \u0925\u0940\u0938\u093f\u0938 \u092e\u0947\u0902 \u0915\u093f\u092f\u093e \u0925\u093e\u0964 \u0939\u093e\u0932\u093e\u0901\u0915\u093f, 1970 \u0915\u0947 \u0926\u0936\u0915 \u0924\u0915 &quot;\u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928&quot; \u0936\u092c\u094d\u0926 \u0915\u093e \u0907\u0938\u094d\u0924\u0947\u092e\u093e\u0932 \u092a\u0939\u0932\u0940 \u092c\u093e\u0930 \u092a\u0949\u0932 \u0935\u0930\u094d\u092c\u094b\u0938 \u0928\u0947 ANN \u092e\u0947\u0902 \u0938\u0940\u0916\u0928\u0947 \u0915\u0940 \u092a\u094d\u0930\u0915\u094d\u0930\u093f\u092f\u093e \u0915\u094b \u0905\u0928\u0941\u0915\u0942\u0932\u093f\u0924 \u0915\u0930\u0928\u0947 \u0915\u0947 \u0905\u092a\u0928\u0947 \u0915\u093e\u092e \u092e\u0947\u0902 \u0915\u093f\u092f\u093e \u0925\u093e\u0964 1980 \u0915\u0947 \u0926\u0936\u0915 \u092e\u0947\u0902 \u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928 \u0928\u0947 \u092e\u0939\u0924\u094d\u0935\u092a\u0942\u0930\u094d\u0923 \u0927\u094d\u092f\u093e\u0928 \u0906\u0915\u0930\u094d\u0937\u093f\u0924 \u0915\u093f\u092f\u093e \u091c\u092c \u0930\u0941\u092e\u0947\u0932\u0939\u093e\u0930\u094d\u091f, \u0939\u093f\u0902\u091f\u0928 \u0914\u0930 \u0935\u093f\u0932\u093f\u092f\u092e\u094d\u0938 \u0928\u0947 \u090f\u0932\u094d\u0917\u094b\u0930\u093f\u0926\u092e \u0915\u093e \u0905\u0927\u093f\u0915 \u0915\u0941\u0936\u0932 \u0938\u0902\u0938\u094d\u0915\u0930\u0923 \u092a\u0947\u0936 \u0915\u093f\u092f\u093e, \u091c\u093f\u0938\u0928\u0947 \u0924\u0902\u0924\u094d\u0930\u093f\u0915\u093e \u0928\u0947\u091f\u0935\u0930\u094d\u0915 \u092e\u0947\u0902 \u0930\u0941\u091a\u093f \u0915\u0947 \u092a\u0941\u0928\u0930\u0941\u0924\u094d\u0925\u093e\u0928 \u0915\u094b \u092c\u0922\u093c\u093e\u0935\u093e \u0926\u093f\u092f\u093e\u0964<\/p>\n<h2>\u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928 \u0915\u0947 \u092c\u093e\u0930\u0947 \u092e\u0947\u0902 \u0935\u093f\u0938\u094d\u0924\u0943\u0924 \u091c\u093e\u0928\u0915\u093e\u0930\u0940: \u0935\u093f\u0937\u092f \u0915\u093e \u0935\u093f\u0938\u094d\u0924\u093e\u0930<\/h2>\n<p>\u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928 \u090f\u0915 \u0938\u0941\u092a\u0930\u0935\u093e\u0907\u091c\u094d\u0921 \u0932\u0930\u094d\u0928\u093f\u0902\u0917 \u090f\u0932\u094d\u0917\u094b\u0930\u093f\u0926\u092e \u0939\u0948 \u091c\u093f\u0938\u0915\u093e \u0909\u092a\u092f\u094b\u0917 \u092e\u0941\u0916\u094d\u092f \u0930\u0942\u092a \u0938\u0947 \u092e\u0932\u094d\u091f\u0940-\u0932\u0947\u092f\u0930 \u0928\u094d\u092f\u0942\u0930\u0932 \u0928\u0947\u091f\u0935\u0930\u094d\u0915 \u0915\u094b \u092a\u094d\u0930\u0936\u093f\u0915\u094d\u0937\u093f\u0924 \u0915\u0930\u0928\u0947 \u0915\u0947 \u0932\u093f\u090f \u0915\u093f\u092f\u093e \u091c\u093e\u0924\u093e \u0939\u0948\u0964 \u0907\u0938\u092e\u0947\u0902 \u0928\u0947\u091f\u0935\u0930\u094d\u0915 \u0915\u0947 \u092e\u093e\u0927\u094d\u092f\u092e \u0938\u0947 \u0907\u0928\u092a\u0941\u091f \u0921\u0947\u091f\u093e \u0915\u094b \u0906\u0917\u0947 \u092b\u0940\u0921 \u0915\u0930\u0928\u0947, \u092a\u0942\u0930\u094d\u0935\u093e\u0928\u0941\u092e\u093e\u0928\u093f\u0924 \u0906\u0909\u091f\u092a\u0941\u091f \u0914\u0930 \u0935\u093e\u0938\u094d\u0924\u0935\u093f\u0915 \u0906\u0909\u091f\u092a\u0941\u091f \u0915\u0947 \u092c\u0940\u091a \u0924\u094d\u0930\u0941\u091f\u093f \u092f\u093e \u0939\u093e\u0928\u093f \u0915\u0940 \u0917\u0923\u0928\u093e \u0915\u0930\u0928\u0947 \u0914\u0930 \u092b\u093f\u0930 \u0928\u0947\u091f\u0935\u0930\u094d\u0915 \u0915\u0947 \u092d\u093e\u0930 \u0915\u094b \u0905\u092a\u0921\u0947\u091f \u0915\u0930\u0928\u0947 \u0915\u0947 \u0932\u093f\u090f \u092a\u0930\u0924\u094b\u0902 \u0915\u0947 \u092e\u093e\u0927\u094d\u092f\u092e \u0938\u0947 \u0907\u0938 \u0924\u094d\u0930\u0941\u091f\u093f \u0915\u094b \u092a\u0940\u091b\u0947 \u0915\u0940 \u0913\u0930 \u092a\u094d\u0930\u0938\u093e\u0930\u093f\u0924 \u0915\u0930\u0928\u0947 \u0915\u0940 \u092a\u0941\u0928\u0930\u093e\u0935\u0943\u0924\u094d\u0924 \u092a\u094d\u0930\u0915\u094d\u0930\u093f\u092f\u093e \u0936\u093e\u092e\u093f\u0932 \u0939\u0948\u0964 \u092f\u0939 \u092a\u0941\u0928\u0930\u093e\u0935\u0943\u0924\u094d\u0924 \u092a\u094d\u0930\u0915\u094d\u0930\u093f\u092f\u093e \u0924\u092c \u0924\u0915 \u091c\u093e\u0930\u0940 \u0930\u0939\u0924\u0940 \u0939\u0948 \u091c\u092c \u0924\u0915 \u0915\u093f \u0928\u0947\u091f\u0935\u0930\u094d\u0915 \u0909\u0938 \u0938\u094d\u0925\u093f\u0924\u093f \u092e\u0947\u0902 \u0928\u0939\u0940\u0902 \u092a\u0939\u0941\u0902\u091a \u091c\u093e\u0924\u093e \u091c\u0939\u093e\u0902 \u0924\u094d\u0930\u0941\u091f\u093f \u0928\u094d\u092f\u0942\u0928\u0924\u092e \u0939\u094b \u091c\u093e\u0924\u0940 \u0939\u0948, \u0914\u0930 \u0928\u0947\u091f\u0935\u0930\u094d\u0915 \u0928\u090f \u0907\u0928\u092a\u0941\u091f \u0921\u0947\u091f\u093e \u0915\u0947 \u0932\u093f\u090f \u0935\u093e\u0902\u091b\u093f\u0924 \u0906\u0909\u091f\u092a\u0941\u091f \u0915\u093e \u0938\u091f\u0940\u0915 \u0930\u0942\u092a \u0938\u0947 \u0905\u0928\u0941\u092e\u093e\u0928 \u0932\u0917\u093e \u0938\u0915\u0924\u093e \u0939\u0948\u0964<\/p>\n<h2>\u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928 \u0915\u0940 \u0906\u0902\u0924\u0930\u093f\u0915 \u0938\u0902\u0930\u091a\u0928\u093e: \u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928 \u0915\u0948\u0938\u0947 \u0915\u093e\u092e \u0915\u0930\u0924\u093e \u0939\u0948<\/h2>\n<p>\u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928 \u0915\u0940 \u0906\u0902\u0924\u0930\u093f\u0915 \u0938\u0902\u0930\u091a\u0928\u093e \u0915\u094b \u0915\u0908 \u092a\u094d\u0930\u092e\u0941\u0916 \u091a\u0930\u0923\u094b\u0902 \u092e\u0947\u0902 \u0935\u093f\u092d\u093e\u091c\u093f\u0924 \u0915\u093f\u092f\u093e \u091c\u093e \u0938\u0915\u0924\u093e \u0939\u0948:<\/p>\n<ol>\n<li>\n<p>\u092b\u0949\u0930\u0935\u0930\u094d\u0921 \u092a\u093e\u0938: \u092b\u0949\u0930\u0935\u0930\u094d\u0921 \u092a\u093e\u0938 \u0915\u0947 \u0926\u094c\u0930\u093e\u0928, \u0907\u0928\u092a\u0941\u091f \u0921\u0947\u091f\u093e \u0915\u094b \u092a\u0930\u0924 \u0926\u0930 \u092a\u0930\u0924 \u0928\u094d\u092f\u0942\u0930\u0932 \u0928\u0947\u091f\u0935\u0930\u094d\u0915 \u0915\u0947 \u092e\u093e\u0927\u094d\u092f\u092e \u0938\u0947 \u092b\u0940\u0921 \u0915\u093f\u092f\u093e \u091c\u093e\u0924\u093e \u0939\u0948, \u092a\u094d\u0930\u0924\u094d\u092f\u0947\u0915 \u092a\u0930\u0924 \u092a\u0930 \u092d\u093e\u0930\u093f\u0924 \u0915\u0928\u0947\u0915\u094d\u0936\u0928 \u0914\u0930 \u0938\u0915\u094d\u0930\u093f\u092f\u0923 \u092b\u093c\u0902\u0915\u094d\u0936\u0928 \u0915\u093e \u090f\u0915 \u0938\u0947\u091f \u0932\u093e\u0917\u0942 \u0915\u093f\u092f\u093e \u091c\u093e\u0924\u093e \u0939\u0948\u0964 \u092a\u094d\u0930\u093e\u0930\u0902\u092d\u093f\u0915 \u0924\u094d\u0930\u0941\u091f\u093f \u0915\u0940 \u0917\u0923\u0928\u093e \u0915\u0930\u0928\u0947 \u0915\u0947 \u0932\u093f\u090f \u0928\u0947\u091f\u0935\u0930\u094d\u0915 \u0915\u0947 \u0906\u0909\u091f\u092a\u0941\u091f \u0915\u0940 \u0924\u0941\u0932\u0928\u093e \u0917\u094d\u0930\u093e\u0909\u0902\u0921 \u091f\u094d\u0930\u0941\u0925 \u0938\u0947 \u0915\u0940 \u091c\u093e\u0924\u0940 \u0939\u0948\u0964<\/p>\n<\/li>\n<li>\n<p>\u092c\u0948\u0915\u0935\u0930\u094d\u0921 \u092a\u093e\u0938: \u092c\u0948\u0915\u0935\u0930\u094d\u0921 \u092a\u093e\u0938 \u092e\u0947\u0902, \u0924\u094d\u0930\u0941\u091f\u093f \u0906\u0909\u091f\u092a\u0941\u091f \u0932\u0947\u092f\u0930 \u0938\u0947 \u0907\u0928\u092a\u0941\u091f \u0932\u0947\u092f\u0930 \u0924\u0915 \u092a\u0940\u091b\u0947 \u0915\u0940 \u0913\u0930 \u092a\u094d\u0930\u0938\u093e\u0930\u093f\u0924 \u0939\u094b\u0924\u0940 \u0939\u0948\u0964 \u092f\u0939 \u0928\u0947\u091f\u0935\u0930\u094d\u0915 \u092e\u0947\u0902 \u092a\u094d\u0930\u0924\u094d\u092f\u0947\u0915 \u092d\u093e\u0930 \u0915\u0947 \u0938\u0902\u092c\u0902\u0927 \u092e\u0947\u0902 \u0924\u094d\u0930\u0941\u091f\u093f \u0915\u0947 \u0917\u094d\u0930\u0947\u0921\u093f\u090f\u0902\u091f \u0915\u0940 \u0917\u0923\u0928\u093e \u0915\u0930\u0928\u0947 \u0915\u0947 \u0932\u093f\u090f \u0915\u0948\u0932\u0915\u0941\u0932\u0938 \u0915\u0947 \u091a\u0947\u0928 \u0928\u093f\u092f\u092e \u0915\u094b \u0932\u093e\u0917\u0942 \u0915\u0930\u0915\u0947 \u092a\u094d\u0930\u093e\u092a\u094d\u0924 \u0915\u093f\u092f\u093e \u091c\u093e\u0924\u093e \u0939\u0948\u0964<\/p>\n<\/li>\n<li>\n<p>\u0935\u091c\u093c\u0928 \u0905\u092a\u0921\u0947\u091f: \u0917\u094d\u0930\u0947\u0921\u093f\u090f\u0902\u091f \u092a\u094d\u0930\u093e\u092a\u094d\u0924 \u0915\u0930\u0928\u0947 \u0915\u0947 \u092c\u093e\u0926, \u0928\u0947\u091f\u0935\u0930\u094d\u0915 \u0915\u0947 \u0935\u091c\u093c\u0928 \u0915\u094b \u0911\u092a\u094d\u091f\u093f\u092e\u093e\u0907\u091c\u093c\u0947\u0936\u0928 \u090f\u0932\u094d\u0917\u094b\u0930\u093f\u0926\u092e, \u091c\u0948\u0938\u0947 \u0915\u093f \u0938\u094d\u091f\u094b\u0915\u0947\u0938\u094d\u091f\u093f\u0915 \u0917\u094d\u0930\u0947\u0921\u093f\u090f\u0902\u091f \u0921\u093f\u0938\u0947\u0902\u091f (SGD) \u092f\u093e \u0907\u0938\u0915\u0947 \u0915\u093f\u0938\u0940 \u090f\u0915 \u0935\u0947\u0930\u093f\u090f\u0902\u091f \u0915\u093e \u0909\u092a\u092f\u094b\u0917 \u0915\u0930\u0915\u0947 \u0905\u092a\u0921\u0947\u091f \u0915\u093f\u092f\u093e \u091c\u093e\u0924\u093e \u0939\u0948\u0964 \u0907\u0928 \u0905\u092a\u0921\u0947\u091f \u0915\u093e \u0909\u0926\u094d\u0926\u0947\u0936\u094d\u092f \u0924\u094d\u0930\u0941\u091f\u093f \u0915\u094b \u0915\u092e \u0915\u0930\u0928\u093e \u0939\u0948, \u092c\u0947\u0939\u0924\u0930 \u092a\u0942\u0930\u094d\u0935\u093e\u0928\u0941\u092e\u093e\u0928 \u092c\u0928\u093e\u0928\u0947 \u0915\u0947 \u0932\u093f\u090f \u0928\u0947\u091f\u0935\u0930\u094d\u0915 \u0915\u0947 \u092e\u093e\u092a\u0926\u0902\u0921\u094b\u0902 \u0915\u094b \u0938\u092e\u093e\u092f\u094b\u091c\u093f\u0924 \u0915\u0930\u0928\u093e \u0939\u0948\u0964<\/p>\n<\/li>\n<li>\n<p>\u092a\u0941\u0928\u0930\u093e\u0935\u0943\u0924\u094d\u0924\u0940\u092f \u092a\u094d\u0930\u0915\u094d\u0930\u093f\u092f\u093e: \u0905\u0917\u094d\u0930 \u0914\u0930 \u092a\u0936\u094d\u091a \u092a\u093e\u0938 \u0915\u094b \u0928\u093f\u0936\u094d\u091a\u093f\u0924 \u092f\u0941\u0917\u094b\u0902 \u0924\u0915 \u092f\u093e \u0905\u092d\u093f\u0938\u0930\u0923 \u0924\u0915 \u092a\u0941\u0928\u0930\u093e\u0935\u0943\u0924\u094d\u0924\u0940\u092f \u0930\u0942\u092a \u0938\u0947 \u0926\u094b\u0939\u0930\u093e\u092f\u093e \u091c\u093e\u0924\u093e \u0939\u0948, \u091c\u093f\u0938\u0938\u0947 \u0928\u0947\u091f\u0935\u0930\u094d\u0915 \u0915\u0947 \u092a\u094d\u0930\u0926\u0930\u094d\u0936\u0928 \u092e\u0947\u0902 \u0915\u094d\u0930\u092e\u093f\u0915 \u0938\u0941\u0927\u093e\u0930 \u0939\u094b\u0924\u093e \u0939\u0948\u0964<\/p>\n<\/li>\n<\/ol>\n<h2>\u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928 \u0915\u0940 \u092a\u094d\u0930\u092e\u0941\u0916 \u0935\u093f\u0936\u0947\u0937\u0924\u093e\u0913\u0902 \u0915\u093e \u0935\u093f\u0936\u094d\u0932\u0947\u0937\u0923<\/h2>\n<p>\u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928 \u0915\u0908 \u092a\u094d\u0930\u092e\u0941\u0916 \u0935\u093f\u0936\u0947\u0937\u0924\u093e\u090f\u0902 \u092a\u094d\u0930\u0926\u093e\u0928 \u0915\u0930\u0924\u093e \u0939\u0948 \u091c\u094b \u0907\u0938\u0947 \u0924\u0902\u0924\u094d\u0930\u093f\u0915\u093e \u0928\u0947\u091f\u0935\u0930\u094d\u0915 \u0915\u0947 \u092a\u094d\u0930\u0936\u093f\u0915\u094d\u0937\u0923 \u0915\u0947 \u0932\u093f\u090f \u090f\u0915 \u0936\u0915\u094d\u0924\u093f\u0936\u093e\u0932\u0940 \u090f\u0932\u094d\u0917\u094b\u0930\u093f\u0926\u092e \u092c\u0928\u093e\u0924\u0940 \u0939\u0948\u0902:<\/p>\n<ul>\n<li>\n<p><strong>\u092c\u0939\u0941\u092e\u0941\u0916\u0940 \u092a\u094d\u0930\u0924\u093f\u092d\u093e<\/strong>\u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928 \u0915\u093e \u0909\u092a\u092f\u094b\u0917 \u0935\u093f\u092d\u093f\u0928\u094d\u0928 \u092a\u094d\u0930\u0915\u093e\u0930 \u0915\u0947 \u0924\u0902\u0924\u094d\u0930\u093f\u0915\u093e \u0928\u0947\u091f\u0935\u0930\u094d\u0915 \u0906\u0930\u094d\u0915\u093f\u091f\u0947\u0915\u094d\u091a\u0930 \u0915\u0947 \u0938\u093e\u0925 \u0915\u093f\u092f\u093e \u091c\u093e \u0938\u0915\u0924\u093e \u0939\u0948, \u091c\u093f\u0938\u092e\u0947\u0902 \u092b\u0940\u0921\u092b\u0949\u0930\u0935\u0930\u094d\u0921 \u0928\u094d\u092f\u0942\u0930\u0932 \u0928\u0947\u091f\u0935\u0930\u094d\u0915, \u0930\u093f\u0915\u0930\u0947\u0902\u091f \u0928\u094d\u092f\u0942\u0930\u0932 \u0928\u0947\u091f\u0935\u0930\u094d\u0915 (\u0906\u0930\u090f\u0928\u090f\u0928) \u0914\u0930 \u0915\u0928\u094d\u0935\u094b\u0932\u094d\u092f\u0942\u0936\u0928\u0932 \u0928\u094d\u092f\u0942\u0930\u0932 \u0928\u0947\u091f\u0935\u0930\u094d\u0915 (\u0938\u0940\u090f\u0928\u090f\u0928) \u0936\u093e\u092e\u093f\u0932 \u0939\u0948\u0902\u0964<\/p>\n<\/li>\n<li>\n<p><strong>\u0915\u094d\u0937\u092e\u0924\u093e<\/strong>\u0915\u092e\u094d\u092a\u094d\u092f\u0942\u091f\u0947\u0936\u0928\u0932 \u0930\u0942\u092a \u0938\u0947 \u0917\u0939\u0928 \u0939\u094b\u0928\u0947 \u0915\u0947 \u092c\u093e\u0935\u091c\u0942\u0926, \u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928 \u0915\u094b \u092a\u093f\u091b\u0932\u0947 \u0915\u0941\u091b \u0935\u0930\u094d\u0937\u094b\u0902 \u092e\u0947\u0902 \u0905\u0928\u0941\u0915\u0942\u0932\u093f\u0924 \u0915\u093f\u092f\u093e \u0917\u092f\u093e \u0939\u0948, \u091c\u093f\u0938\u0938\u0947 \u092f\u0939 \u092c\u0921\u093c\u0947 \u0921\u0947\u091f\u093e\u0938\u0947\u091f \u0914\u0930 \u091c\u091f\u093f\u0932 \u0928\u0947\u091f\u0935\u0930\u094d\u0915 \u0915\u094b \u0915\u0941\u0936\u0932\u0924\u093e\u092a\u0942\u0930\u094d\u0935\u0915 \u0938\u0902\u092d\u093e\u0932\u0928\u0947 \u092e\u0947\u0902 \u0938\u0915\u094d\u0937\u092e \u0939\u0948\u0964<\/p>\n<\/li>\n<li>\n<p><strong>\u0905\u0928\u0941\u092e\u093e\u092a\u0915\u0924\u093e<\/strong>\u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928 \u0915\u0940 \u0938\u092e\u093e\u0928\u093e\u0902\u0924\u0930 \u092a\u094d\u0930\u0915\u0943\u0924\u093f \u0907\u0938\u0947 \u0938\u094d\u0915\u0947\u0932\u0947\u092c\u0932 \u092c\u0928\u093e\u0924\u0940 \u0939\u0948, \u091c\u093f\u0938\u0938\u0947 \u092f\u0939 \u0906\u0927\u0941\u0928\u093f\u0915 \u0939\u093e\u0930\u094d\u0921\u0935\u0947\u092f\u0930 \u0914\u0930 \u0935\u093f\u0924\u0930\u093f\u0924 \u0915\u0902\u092a\u094d\u092f\u0942\u091f\u093f\u0902\u0917 \u0938\u0902\u0938\u093e\u0927\u0928\u094b\u0902 \u0915\u093e \u0932\u093e\u092d \u0909\u0920\u093e\u0928\u0947 \u092e\u0947\u0902 \u0938\u0915\u094d\u0937\u092e \u0939\u094b \u091c\u093e\u0924\u093e \u0939\u0948\u0964<\/p>\n<\/li>\n<li>\n<p><strong>\u0917\u0948\u0930 linearity<\/strong>\u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928 \u0915\u0940 \u0917\u0948\u0930-\u0930\u0948\u0916\u093f\u0915 \u0938\u0915\u094d\u0930\u093f\u092f\u0923 \u0915\u093e\u0930\u094d\u092f\u094b\u0902 \u0915\u094b \u0938\u0902\u092d\u093e\u0932\u0928\u0947 \u0915\u0940 \u0915\u094d\u0937\u092e\u0924\u093e, \u0924\u0902\u0924\u094d\u0930\u093f\u0915\u093e \u0928\u0947\u091f\u0935\u0930\u094d\u0915 \u0915\u094b \u0921\u0947\u091f\u093e \u0915\u0947 \u092d\u0940\u0924\u0930 \u091c\u091f\u093f\u0932 \u0938\u0902\u092c\u0902\u0927\u094b\u0902 \u0915\u094b \u092e\u0949\u0921\u0932 \u0915\u0930\u0928\u0947 \u0915\u0940 \u0905\u0928\u0941\u092e\u0924\u093f \u0926\u0947\u0924\u0940 \u0939\u0948\u0964<\/p>\n<\/li>\n<\/ul>\n<h2>\u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928 \u0915\u0947 \u092a\u094d\u0930\u0915\u093e\u0930<\/h2>\n<table>\n<thead>\n<tr>\n<th>\u092a\u094d\u0930\u0915\u093e\u0930<\/th>\n<th>\u0935\u093f\u0935\u0930\u0923<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>\u092e\u093e\u0928\u0915 \u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928<\/td>\n<td>\u092e\u0942\u0932 \u090f\u0932\u094d\u0917\u094b\u0930\u093f\u0925\u094d\u092e \u091c\u094b \u092a\u094d\u0930\u0924\u094d\u092f\u0947\u0915 \u092d\u093e\u0930 \u0915\u0947 \u0938\u0902\u092c\u0902\u0927 \u092e\u0947\u0902 \u0924\u094d\u0930\u0941\u091f\u093f \u0915\u0947 \u092a\u0942\u0930\u094d\u0923 \u0917\u094d\u0930\u0947\u0921\u093f\u090f\u0902\u091f \u0915\u093e \u0909\u092a\u092f\u094b\u0917 \u0915\u0930\u0915\u0947 \u092d\u093e\u0930 \u0915\u094b \u0905\u092a\u0921\u0947\u091f \u0915\u0930\u0924\u093e \u0939\u0948\u0964 \u092f\u0939 \u092c\u0921\u093c\u0947 \u0921\u0947\u091f\u093e\u0938\u0947\u091f \u0915\u0947 \u0932\u093f\u090f \u0915\u092e\u094d\u092a\u094d\u092f\u0942\u091f\u0947\u0936\u0928\u0932 \u0930\u0942\u092a \u0938\u0947 \u092e\u0939\u0902\u0917\u093e \u0939\u094b \u0938\u0915\u0924\u093e \u0939\u0948\u0964<\/td>\n<\/tr>\n<tr>\n<td>\u0938\u094d\u091f\u094b\u0915\u0947\u0938\u094d\u091f\u093f\u0915 \u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928<\/td>\n<td>\u092e\u093e\u0928\u0915 \u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928 \u0915\u093e \u090f\u0915 \u0905\u0928\u0941\u0915\u0942\u0932\u0928 \u091c\u094b \u092a\u094d\u0930\u0924\u094d\u092f\u0947\u0915 \u0935\u094d\u092f\u0915\u094d\u0924\u093f\u0917\u0924 \u0921\u0947\u091f\u093e \u092c\u093f\u0902\u0926\u0941 \u0915\u0947 \u092c\u093e\u0926 \u092d\u093e\u0930 \u0915\u094b \u0905\u0926\u094d\u092f\u0924\u0928 \u0915\u0930\u0924\u093e \u0939\u0948, \u091c\u093f\u0938\u0938\u0947 \u0915\u092e\u094d\u092a\u094d\u092f\u0942\u091f\u0947\u0936\u0928\u0932 \u0906\u0935\u0936\u094d\u092f\u0915\u0924\u093e\u090f\u0902 \u0915\u092e \u0939\u094b \u091c\u093e\u0924\u0940 \u0939\u0948\u0902, \u0932\u0947\u0915\u093f\u0928 \u092d\u093e\u0930 \u0905\u0926\u094d\u092f\u0924\u0928 \u092e\u0947\u0902 \u0905\u0927\u093f\u0915 \u092f\u093e\u0926\u0943\u091a\u094d\u091b\u093f\u0915\u0924\u093e \u0906 \u091c\u093e\u0924\u0940 \u0939\u0948\u0964<\/td>\n<\/tr>\n<tr>\n<td>\u092e\u093f\u0928\u0940-\u092c\u0948\u091a \u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928<\/td>\n<td>\u092e\u093e\u0928\u0915 \u0914\u0930 \u0938\u094d\u091f\u094b\u0915\u0947\u0938\u094d\u091f\u093f\u0915 \u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928 \u0915\u0947 \u092c\u0940\u091a \u090f\u0915 \u0938\u092e\u091d\u094c\u0924\u093e, \u0921\u0947\u091f\u093e \u092c\u093f\u0902\u0926\u0941\u0913\u0902 \u0915\u0947 \u092c\u0948\u091a\u094b\u0902 \u092e\u0947\u0902 \u0935\u091c\u093c\u0928 \u0915\u094b \u0905\u092a\u0921\u0947\u091f \u0915\u0930\u0928\u093e\u0964 \u092f\u0939 \u0935\u091c\u093c\u0928 \u0905\u092a\u0921\u0947\u091f \u092e\u0947\u0902 \u0915\u092e\u094d\u092a\u094d\u092f\u0942\u091f\u0947\u0936\u0928\u0932 \u0926\u0915\u094d\u0937\u0924\u093e \u0914\u0930 \u0938\u094d\u0925\u093f\u0930\u0924\u093e \u0915\u0947 \u092c\u0940\u091a \u0938\u0902\u0924\u0941\u0932\u0928 \u092c\u0928\u093e\u0924\u093e \u0939\u0948\u0964<\/td>\n<\/tr>\n<tr>\n<td>\u092c\u0948\u091a \u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928<\/td>\n<td>\u090f\u0915 \u0935\u0948\u0915\u0932\u094d\u092a\u093f\u0915 \u0926\u0943\u0937\u094d\u091f\u093f\u0915\u094b\u0923 \u091c\u094b \u0935\u091c\u093c\u0928 \u0915\u094b \u0905\u092a\u0921\u0947\u091f \u0915\u0930\u0928\u0947 \u0938\u0947 \u092a\u0939\u0932\u0947 \u092a\u0942\u0930\u0947 \u0921\u0947\u091f\u093e\u0938\u0947\u091f \u0915\u0947 \u0932\u093f\u090f \u0917\u094d\u0930\u0947\u0921\u093f\u090f\u0902\u091f \u0915\u0940 \u0917\u0923\u0928\u093e \u0915\u0930\u0924\u093e \u0939\u0948\u0964 \u0907\u0938\u0915\u093e \u0909\u092a\u092f\u094b\u0917 \u092e\u0941\u0916\u094d\u092f \u0930\u0942\u092a \u0938\u0947 \u0938\u092e\u093e\u0928\u093e\u0902\u0924\u0930 \u0915\u0902\u092a\u094d\u092f\u0942\u091f\u093f\u0902\u0917 \u0935\u093e\u0924\u093e\u0935\u0930\u0923 \u092e\u0947\u0902 GPU \u092f\u093e TPU \u0915\u093e \u0915\u0941\u0936\u0932\u0924\u093e\u092a\u0942\u0930\u094d\u0935\u0915 \u0932\u093e\u092d \u0909\u0920\u093e\u0928\u0947 \u0915\u0947 \u0932\u093f\u090f \u0915\u093f\u092f\u093e \u091c\u093e\u0924\u093e \u0939\u0948\u0964<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<h2>\u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928 \u0915\u093e \u0909\u092a\u092f\u094b\u0917 \u0915\u0930\u0928\u0947 \u0915\u0947 \u0924\u0930\u0940\u0915\u0947, \u0938\u092e\u0938\u094d\u092f\u093e\u090f\u0902 \u0914\u0930 \u0909\u0928\u0915\u0947 \u0938\u092e\u093e\u0927\u093e\u0928<\/h2>\n<p><strong>\u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928 \u0915\u093e \u0909\u092a\u092f\u094b\u0917 \u0915\u0930\u0928\u093e<\/strong><\/p>\n<ul>\n<li>\u091b\u0935\u093f \u092a\u0939\u091a\u093e\u0928: \u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928 \u0915\u093e \u0909\u092a\u092f\u094b\u0917 \u0935\u094d\u092f\u093e\u092a\u0915 \u0930\u0942\u092a \u0938\u0947 \u091b\u0935\u093f \u092a\u0939\u091a\u093e\u0928 \u0915\u093e\u0930\u094d\u092f\u094b\u0902 \u092e\u0947\u0902 \u0915\u093f\u092f\u093e \u091c\u093e\u0924\u093e \u0939\u0948, \u091c\u0939\u093e\u0902 \u0915\u0928\u094d\u0935\u094b\u0932\u094d\u092f\u0942\u0936\u0928\u0932 \u0928\u094d\u092f\u0942\u0930\u0932 \u0928\u0947\u091f\u0935\u0930\u094d\u0915 (\u0938\u0940\u090f\u0928\u090f\u0928) \u0915\u094b \u091b\u0935\u093f\u092f\u094b\u0902 \u0915\u0947 \u092d\u0940\u0924\u0930 \u0935\u0938\u094d\u0924\u0941\u0913\u0902 \u0914\u0930 \u092a\u0948\u091f\u0930\u094d\u0928 \u0915\u0940 \u092a\u0939\u091a\u093e\u0928 \u0915\u0930\u0928\u0947 \u0915\u0947 \u0932\u093f\u090f \u092a\u094d\u0930\u0936\u093f\u0915\u094d\u0937\u093f\u0924 \u0915\u093f\u092f\u093e \u091c\u093e\u0924\u093e \u0939\u0948\u0964<\/li>\n<li>\u092a\u094d\u0930\u093e\u0915\u0943\u0924\u093f\u0915 \u092d\u093e\u0937\u093e \u092a\u094d\u0930\u0938\u0902\u0938\u094d\u0915\u0930\u0923: \u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928 \u0915\u093e \u0909\u092a\u092f\u094b\u0917 \u092d\u093e\u0937\u093e \u092e\u0949\u0921\u0932\u093f\u0902\u0917, \u092e\u0936\u0940\u0928 \u0905\u0928\u0941\u0935\u093e\u0926 \u0914\u0930 \u092d\u093e\u0935\u0928\u093e \u0935\u093f\u0936\u094d\u0932\u0947\u0937\u0923 \u0915\u0947 \u0932\u093f\u090f \u0906\u0935\u0930\u094d\u0924\u0915 \u0924\u0902\u0924\u094d\u0930\u093f\u0915\u093e \u0928\u0947\u091f\u0935\u0930\u094d\u0915 (\u0906\u0930\u090f\u0928\u090f\u0928) \u0915\u094b \u092a\u094d\u0930\u0936\u093f\u0915\u094d\u0937\u093f\u0924 \u0915\u0930\u0928\u0947 \u0915\u0947 \u0932\u093f\u090f \u0915\u093f\u092f\u093e \u091c\u093e \u0938\u0915\u0924\u093e \u0939\u0948\u0964<\/li>\n<li>\u0935\u093f\u0924\u094d\u0924\u0940\u092f \u092a\u0942\u0930\u094d\u0935\u093e\u0928\u0941\u092e\u093e\u0928: \u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928 \u0915\u093e \u0909\u092a\u092f\u094b\u0917 \u0938\u092e\u092f \u0936\u094d\u0930\u0943\u0902\u0916\u0932\u093e \u0921\u0947\u091f\u093e \u0915\u093e \u0909\u092a\u092f\u094b\u0917 \u0915\u0930\u0915\u0947 \u0938\u094d\u091f\u0949\u0915 \u0915\u0940 \u0915\u0940\u092e\u0924\u094b\u0902, \u092c\u093e\u091c\u093e\u0930 \u0915\u0947 \u0930\u0941\u091d\u093e\u0928 \u0914\u0930 \u0905\u0928\u094d\u092f \u0935\u093f\u0924\u094d\u0924\u0940\u092f \u0938\u0902\u0915\u0947\u0924\u0915\u094b\u0902 \u0915\u0940 \u092d\u0935\u093f\u0937\u094d\u092f\u0935\u093e\u0923\u0940 \u0915\u0930\u0928\u0947 \u0915\u0947 \u0932\u093f\u090f \u0915\u093f\u092f\u093e \u091c\u093e \u0938\u0915\u0924\u093e \u0939\u0948\u0964<\/li>\n<\/ul>\n<p><strong>\u091a\u0941\u0928\u094c\u0924\u093f\u092f\u093e\u0901 \u0914\u0930 \u0938\u092e\u093e\u0927\u093e\u0928<\/strong><\/p>\n<ul>\n<li><strong>\u0932\u0941\u092a\u094d\u0924 \u0939\u094b \u0930\u0939\u0940 \u0917\u094d\u0930\u0947\u0921\u093f\u090f\u0902\u091f \u0938\u092e\u0938\u094d\u092f\u093e<\/strong>: \u0921\u0940\u092a \u0928\u094d\u092f\u0942\u0930\u0932 \u0928\u0947\u091f\u0935\u0930\u094d\u0915 \u092e\u0947\u0902, \u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928 \u0915\u0947 \u0926\u094c\u0930\u093e\u0928 \u0917\u094d\u0930\u0947\u0921\u093f\u090f\u0902\u091f \u092c\u0939\u0941\u0924 \u091b\u094b\u091f\u0947 \u0939\u094b \u0938\u0915\u0924\u0947 \u0939\u0948\u0902, \u091c\u093f\u0938\u0938\u0947 \u0915\u0928\u094d\u0935\u0930\u094d\u091c\u0947\u0902\u0938 \u0927\u0940\u092e\u093e \u0939\u094b \u0938\u0915\u0924\u093e \u0939\u0948 \u092f\u093e \u0938\u0940\u0916\u0928\u0947 \u0915\u0940 \u092a\u094d\u0930\u0915\u094d\u0930\u093f\u092f\u093e \u092d\u0940 \u0930\u0941\u0915 \u0938\u0915\u0924\u0940 \u0939\u0948\u0964 \u0938\u092e\u093e\u0927\u093e\u0928 \u092e\u0947\u0902 ReLU \u091c\u0948\u0938\u0947 \u090f\u0915\u094d\u091f\u093f\u0935\u0947\u0936\u0928 \u092b\u093c\u0902\u0915\u094d\u0936\u0928 \u0914\u0930 \u092c\u0948\u091a \u0928\u0949\u0930\u094d\u092e\u0932\u093e\u0907\u091c\u093c\u0947\u0936\u0928 \u091c\u0948\u0938\u0940 \u0924\u0915\u0928\u0940\u0915\u094b\u0902 \u0915\u093e \u0909\u092a\u092f\u094b\u0917 \u0915\u0930\u0928\u093e \u0936\u093e\u092e\u093f\u0932 \u0939\u0948\u0964<\/li>\n<li><strong>\u0913\u0935\u0930\u092b\u093f\u091f\u093f\u0902\u0917<\/strong>\u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928 \u0915\u0947 \u092a\u0930\u093f\u0923\u093e\u092e\u0938\u094d\u0935\u0930\u0942\u092a \u0913\u0935\u0930\u092b\u093f\u091f\u093f\u0902\u0917 \u0939\u094b \u0938\u0915\u0924\u0940 \u0939\u0948, \u091c\u0939\u093e\u0902 \u0928\u0947\u091f\u0935\u0930\u094d\u0915 \u092a\u094d\u0930\u0936\u093f\u0915\u094d\u0937\u0923 \u0921\u0947\u091f\u093e \u092a\u0930 \u0905\u091a\u094d\u091b\u093e \u092a\u094d\u0930\u0926\u0930\u094d\u0936\u0928 \u0915\u0930\u0924\u093e \u0939\u0948 \u0932\u0947\u0915\u093f\u0928 \u0905\u0928\u0926\u0947\u0916\u0947 \u0921\u0947\u091f\u093e \u092a\u0930 \u0916\u0930\u093e\u092c \u092a\u094d\u0930\u0926\u0930\u094d\u0936\u0928 \u0915\u0930\u0924\u093e \u0939\u0948\u0964 L1 \u0914\u0930 L2 \u0930\u0947\u0917\u094d\u092f\u0942\u0932\u0930\u093e\u0907\u091c\u0947\u0936\u0928 \u091c\u0948\u0938\u0940 \u0930\u0947\u0917\u094d\u092f\u0942\u0932\u0930\u093e\u0907\u091c\u0947\u0936\u0928 \u0924\u0915\u0928\u0940\u0915\u0947\u0902 \u0913\u0935\u0930\u092b\u093f\u091f\u093f\u0902\u0917 \u0915\u094b \u0915\u092e \u0915\u0930\u0928\u0947 \u092e\u0947\u0902 \u092e\u0926\u0926 \u0915\u0930 \u0938\u0915\u0924\u0940 \u0939\u0948\u0902\u0964<\/li>\n<li><strong>\u0915\u092e\u094d\u092a\u094d\u092f\u0942\u091f\u0947\u0936\u0928\u0932 \u0924\u0940\u0935\u094d\u0930\u0924\u093e<\/strong>\u0921\u0940\u092a \u0928\u094d\u092f\u0942\u0930\u0932 \u0928\u0947\u091f\u0935\u0930\u094d\u0915 \u0915\u094b \u092a\u094d\u0930\u0936\u093f\u0915\u094d\u0937\u093f\u0924 \u0915\u0930\u0928\u093e \u0915\u092e\u094d\u092a\u094d\u092f\u0942\u091f\u0947\u0936\u0928\u0932 \u0930\u0942\u092a \u0938\u0947 \u0917\u0939\u0928 \u0939\u094b \u0938\u0915\u0924\u093e \u0939\u0948, \u0916\u093e\u0938\u0915\u0930 \u092c\u0921\u093c\u0947 \u0921\u0947\u091f\u093e\u0938\u0947\u091f \u0915\u0947 \u0938\u093e\u0925\u0964 \u0928\u0947\u091f\u0935\u0930\u094d\u0915 \u0906\u0930\u094d\u0915\u093f\u091f\u0947\u0915\u094d\u091a\u0930 \u0915\u094b \u0917\u0924\u093f \u0926\u0947\u0928\u0947 \u0914\u0930 \u0905\u0928\u0941\u0915\u0942\u0932\u093f\u0924 \u0915\u0930\u0928\u0947 \u0915\u0947 \u0932\u093f\u090f GPU \u092f\u093e TPU \u0915\u093e \u0909\u092a\u092f\u094b\u0917 \u0915\u0930\u0915\u0947 \u0907\u0938 \u0938\u092e\u0938\u094d\u092f\u093e \u0915\u094b \u0915\u092e \u0915\u093f\u092f\u093e \u091c\u093e \u0938\u0915\u0924\u093e \u0939\u0948\u0964<\/li>\n<\/ul>\n<h2>\u092e\u0941\u0916\u094d\u092f \u0935\u093f\u0936\u0947\u0937\u0924\u093e\u090f\u0901 \u0914\u0930 \u0938\u092e\u093e\u0928 \u0936\u092c\u094d\u0926\u094b\u0902 \u0915\u0947 \u0938\u093e\u0925 \u0905\u0928\u094d\u092f \u0924\u0941\u0932\u0928\u093e\u090f\u0901<\/h2>\n<table>\n<thead>\n<tr>\n<th>\u0935\u093f\u0936\u0947\u0937\u0924\u093e<\/th>\n<th>\u092a\u0936\u094d\u091a\u092a\u094d\u0930\u091a\u093e\u0930<\/th>\n<th>\u0922\u0924\u0932\u093e \u0939\u0941\u0906 \u0935\u0902\u0936<\/th>\n<th>\u0938\u094d\u091f\u094b\u091a\u0948\u0938\u094d\u091f\u093f\u0915 \u0917\u094d\u0930\u0947\u0921\u093f\u090f\u0902\u091f \u0921\u093f\u0938\u0947\u0902\u091f<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>\u092a\u094d\u0930\u0915\u093e\u0930<\/td>\n<td>\u0915\u0932\u0928 \u0935\u093f\u0927\u093f<\/td>\n<td>\u0905\u0928\u0941\u0915\u0942\u0932\u0928 \u090f\u0932\u094d\u0917\u094b\u0930\u093f\u0925\u094d\u092e<\/td>\n<td>\u0905\u0928\u0941\u0915\u0942\u0932\u0928 \u090f\u0932\u094d\u0917\u094b\u0930\u093f\u0925\u094d\u092e<\/td>\n<\/tr>\n<tr>\n<td>\u0909\u0926\u094d\u0926\u0947\u0936\u094d\u092f<\/td>\n<td>\u0924\u0902\u0924\u094d\u0930\u093f\u0915\u093e \u0928\u0947\u091f\u0935\u0930\u094d\u0915 \u092a\u094d\u0930\u0936\u093f\u0915\u094d\u0937\u0923<\/td>\n<td>\u092b\u093c\u0902\u0915\u094d\u0936\u0928 \u0905\u0928\u0941\u0915\u0942\u0932\u0928<\/td>\n<td>\u092b\u093c\u0902\u0915\u094d\u0936\u0928 \u0905\u0928\u0941\u0915\u0942\u0932\u0928<\/td>\n<\/tr>\n<tr>\n<td>\u0906\u0935\u0943\u0924\u094d\u0924\u093f \u0905\u0926\u094d\u092f\u0924\u0928 \u0915\u0930\u0947\u0902<\/td>\n<td>\u092a\u094d\u0930\u0924\u094d\u092f\u0947\u0915 \u092c\u0948\u091a \u0915\u0947 \u092c\u093e\u0926<\/td>\n<td>\u092a\u094d\u0930\u0924\u094d\u092f\u0947\u0915 \u0921\u0947\u091f\u093e \u092c\u093f\u0902\u0926\u0941 \u0915\u0947 \u092c\u093e\u0926<\/td>\n<td>\u092a\u094d\u0930\u0924\u094d\u092f\u0947\u0915 \u0921\u0947\u091f\u093e \u092c\u093f\u0902\u0926\u0941 \u0915\u0947 \u092c\u093e\u0926<\/td>\n<\/tr>\n<tr>\n<td>\u0915\u092e\u094d\u092a\u094d\u092f\u0942\u091f\u0947\u0936\u0928\u0932 \u0926\u0915\u094d\u0937\u0924\u093e<\/td>\n<td>\u092e\u0927\u094d\u092f\u092e<\/td>\n<td>\u0909\u091a\u094d\u091a<\/td>\n<td>\u092e\u0927\u094d\u092f\u092e \u0938\u0947 \u0909\u091a\u094d\u091a<\/td>\n<\/tr>\n<tr>\n<td>\u0936\u094b\u0930 \u0915\u0947 \u092a\u094d\u0930\u0924\u093f \u0926\u0943\u0922\u093c\u0924\u093e<\/td>\n<td>\u092e\u0927\u094d\u092f\u092e<\/td>\n<td>\u0915\u092e<\/td>\n<td>\u092e\u0927\u094d\u092f\u092e \u0938\u0947 \u0928\u093f\u092e\u094d\u0928<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<h2>\u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928 \u0938\u0947 \u0938\u0902\u092c\u0902\u0927\u093f\u0924 \u092d\u0935\u093f\u0937\u094d\u092f \u0915\u0947 \u092a\u0930\u093f\u092a\u094d\u0930\u0947\u0915\u094d\u0937\u094d\u092f \u0914\u0930 \u092a\u094d\u0930\u094c\u0926\u094d\u092f\u094b\u0917\u093f\u0915\u093f\u092f\u093e\u0902<\/h2>\n<p>\u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928 \u0915\u093e \u092d\u0935\u093f\u0937\u094d\u092f \u0939\u093e\u0930\u094d\u0921\u0935\u0947\u092f\u0930 \u0914\u0930 \u090f\u0932\u094d\u0917\u094b\u0930\u093f\u0926\u092e \u092e\u0947\u0902 \u092a\u094d\u0930\u0917\u0924\u093f \u0938\u0947 \u0928\u093f\u0915\u091f\u0924\u093e \u0938\u0947 \u091c\u0941\u0921\u093c\u093e \u0939\u0941\u0906 \u0939\u0948\u0964 \u091c\u0948\u0938\u0947-\u091c\u0948\u0938\u0947 \u0915\u092e\u094d\u092a\u094d\u092f\u0942\u091f\u0947\u0936\u0928\u0932 \u0936\u0915\u094d\u0924\u093f \u092c\u0922\u093c\u0924\u0940 \u091c\u093e \u0930\u0939\u0940 \u0939\u0948, \u092c\u0921\u093c\u0947 \u0914\u0930 \u0905\u0927\u093f\u0915 \u091c\u091f\u093f\u0932 \u0924\u0902\u0924\u094d\u0930\u093f\u0915\u093e \u0928\u0947\u091f\u0935\u0930\u094d\u0915 \u0915\u094b \u092a\u094d\u0930\u0936\u093f\u0915\u094d\u0937\u093f\u0924 \u0915\u0930\u0928\u093e \u0905\u0927\u093f\u0915 \u0935\u094d\u092f\u0935\u0939\u093e\u0930\u094d\u092f \u0939\u094b\u0924\u093e \u091c\u093e\u090f\u0917\u093e\u0964 \u0907\u0938\u0915\u0947 \u0905\u0924\u093f\u0930\u093f\u0915\u094d\u0924, \u0936\u094b\u0927\u0915\u0930\u094d\u0924\u093e \u092a\u093e\u0930\u0902\u092a\u0930\u093f\u0915 \u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928 \u0915\u0947 \u0935\u093f\u0915\u0932\u094d\u092a, \u091c\u0948\u0938\u0947 \u0915\u093f \u0935\u093f\u0915\u093e\u0938\u0935\u093e\u0926\u0940 \u090f\u0932\u094d\u0917\u094b\u0930\u093f\u0926\u092e \u0914\u0930 \u091c\u0948\u0935\u093f\u0915 \u0930\u0942\u092a \u0938\u0947 \u092a\u094d\u0930\u0947\u0930\u093f\u0924 \u0936\u093f\u0915\u094d\u0937\u0923 \u0935\u093f\u0927\u093f\u092f\u093e\u0901, \u0938\u0915\u094d\u0930\u093f\u092f \u0930\u0942\u092a \u0938\u0947 \u0916\u094b\u091c \u0930\u0939\u0947 \u0939\u0948\u0902\u0964<\/p>\n<p>\u0907\u0938\u0915\u0947 \u0905\u0932\u093e\u0935\u093e, \u091f\u094d\u0930\u093e\u0902\u0938\u092b\u0949\u0930\u094d\u092e\u0930 \u0914\u0930 \u0905\u091f\u0947\u0902\u0936\u0928 \u092e\u0948\u0915\u0947\u0928\u093f\u091c\u094d\u092e \u091c\u0948\u0938\u0947 \u0928\u090f \u0928\u094d\u092f\u0942\u0930\u0932 \u0928\u0947\u091f\u0935\u0930\u094d\u0915 \u0906\u0930\u094d\u0915\u093f\u091f\u0947\u0915\u094d\u091a\u0930 \u0928\u0947 \u092a\u094d\u0930\u093e\u0915\u0943\u0924\u093f\u0915 \u092d\u093e\u0937\u093e \u092a\u094d\u0930\u0938\u0902\u0938\u094d\u0915\u0930\u0923 \u0915\u093e\u0930\u094d\u092f\u094b\u0902 \u0915\u0947 \u0932\u093f\u090f \u0932\u094b\u0915\u092a\u094d\u0930\u093f\u092f\u0924\u093e \u0939\u093e\u0938\u093f\u0932 \u0915\u0940 \u0939\u0948 \u0914\u0930 \u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928 \u0924\u0915\u0928\u0940\u0915\u094b\u0902 \u0915\u0947 \u0935\u093f\u0915\u093e\u0938 \u0915\u094b \u092a\u094d\u0930\u092d\u093e\u0935\u093f\u0924 \u0915\u0930 \u0938\u0915\u0924\u0947 \u0939\u0948\u0902\u0964 \u0907\u0928 \u0928\u090f \u0906\u0930\u094d\u0915\u093f\u091f\u0947\u0915\u094d\u091a\u0930 \u0915\u0947 \u0938\u093e\u0925 \u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928 \u0915\u0947 \u0938\u0902\u092f\u094b\u091c\u0928 \u0938\u0947 \u0935\u093f\u092d\u093f\u0928\u094d\u0928 \u0921\u094b\u092e\u0947\u0928 \u092e\u0947\u0902 \u0914\u0930 \u092d\u0940 \u0905\u0927\u093f\u0915 \u092a\u094d\u0930\u092d\u093e\u0935\u0936\u093e\u0932\u0940 \u092a\u0930\u093f\u0923\u093e\u092e \u092e\u093f\u0932\u0928\u0947 \u0915\u0940 \u0938\u0902\u092d\u093e\u0935\u0928\u093e \u0939\u0948\u0964<\/p>\n<h2>\u092a\u094d\u0930\u0949\u0915\u094d\u0938\u0940 \u0938\u0930\u094d\u0935\u0930 \u0915\u093e \u0909\u092a\u092f\u094b\u0917 \u0915\u0948\u0938\u0947 \u0915\u093f\u092f\u093e \u091c\u093e \u0938\u0915\u0924\u093e \u0939\u0948 \u092f\u093e \u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928 \u0915\u0947 \u0938\u093e\u0925 \u0915\u0948\u0938\u0947 \u0938\u0902\u092c\u0926\u094d\u0927 \u0915\u093f\u092f\u093e \u091c\u093e \u0938\u0915\u0924\u093e \u0939\u0948<\/h2>\n<p>\u092a\u094d\u0930\u0949\u0915\u094d\u0938\u0940 \u0938\u0930\u094d\u0935\u0930 \u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928 \u0915\u093e\u0930\u094d\u092f\u094b\u0902 \u0915\u093e \u0938\u092e\u0930\u094d\u0925\u0928 \u0915\u0930\u0928\u0947 \u092e\u0947\u0902 \u092e\u0939\u0924\u094d\u0935\u092a\u0942\u0930\u094d\u0923 \u092d\u0942\u092e\u093f\u0915\u093e \u0928\u093f\u092d\u093e \u0938\u0915\u0924\u0947 \u0939\u0948\u0902, \u0935\u093f\u0936\u0947\u0937 \u0930\u0942\u092a \u0938\u0947 \u092c\u0921\u093c\u0947 \u092a\u0948\u092e\u093e\u0928\u0947 \u092a\u0930 \u0935\u093f\u0924\u0930\u093f\u0924 \u092a\u094d\u0930\u0936\u093f\u0915\u094d\u0937\u0923 \u0915\u0947 \u0938\u0902\u0926\u0930\u094d\u092d \u092e\u0947\u0902\u0964 \u091a\u0942\u0902\u0915\u093f \u0921\u0940\u092a \u0932\u0930\u094d\u0928\u093f\u0902\u0917 \u092e\u0949\u0921\u0932 \u0915\u0947 \u0932\u093f\u090f \u092c\u0921\u093c\u0940 \u092e\u093e\u0924\u094d\u0930\u093e \u092e\u0947\u0902 \u0921\u0947\u091f\u093e \u0914\u0930 \u0915\u092e\u094d\u092a\u094d\u092f\u0942\u091f\u0947\u0936\u0928\u0932 \u092a\u093e\u0935\u0930 \u0915\u0940 \u0906\u0935\u0936\u094d\u092f\u0915\u0924\u093e \u0939\u094b\u0924\u0940 \u0939\u0948, \u0907\u0938\u0932\u093f\u090f \u0936\u094b\u0927\u0915\u0930\u094d\u0924\u093e \u0905\u0915\u094d\u0938\u0930 \u0924\u0947\u091c\u093c \u0921\u0947\u091f\u093e \u092a\u0941\u0928\u0930\u094d\u092a\u094d\u0930\u093e\u092a\u094d\u0924\u093f, \u0915\u0948\u0936 \u0938\u0902\u0938\u093e\u0927\u0928\u094b\u0902 \u0914\u0930 \u0928\u0947\u091f\u0935\u0930\u094d\u0915 \u091f\u094d\u0930\u0948\u092b\u093c\u093f\u0915 \u0915\u094b \u0905\u0928\u0941\u0915\u0942\u0932\u093f\u0924 \u0915\u0930\u0928\u0947 \u0915\u0947 \u0932\u093f\u090f \u092a\u094d\u0930\u0949\u0915\u094d\u0938\u0940 \u0938\u0930\u094d\u0935\u0930 \u0915\u093e \u0932\u093e\u092d \u0909\u0920\u093e\u0924\u0947 \u0939\u0948\u0902\u0964 \u092a\u094d\u0930\u0949\u0915\u094d\u0938\u0940 \u0938\u0930\u094d\u0935\u0930 \u0915\u093e \u0909\u092a\u092f\u094b\u0917 \u0915\u0930\u0915\u0947, \u0936\u094b\u0927\u0915\u0930\u094d\u0924\u093e \u0921\u0947\u091f\u093e \u090f\u0915\u094d\u0938\u0947\u0938 \u0915\u094b \u092c\u0922\u093c\u093e \u0938\u0915\u0924\u0947 \u0939\u0948\u0902 \u0914\u0930 \u0935\u093f\u0932\u0902\u092c\u0924\u093e \u0915\u094b \u0915\u092e \u0915\u0930 \u0938\u0915\u0924\u0947 \u0939\u0948\u0902, \u091c\u093f\u0938\u0938\u0947 \u0924\u0902\u0924\u094d\u0930\u093f\u0915\u093e \u0928\u0947\u091f\u0935\u0930\u094d\u0915 \u0915\u0947 \u0938\u093e\u0925 \u0905\u0927\u093f\u0915 \u0915\u0941\u0936\u0932 \u092a\u094d\u0930\u0936\u093f\u0915\u094d\u0937\u0923 \u0914\u0930 \u092a\u094d\u0930\u092f\u094b\u0917 \u0915\u0940 \u0905\u0928\u0941\u092e\u0924\u093f \u092e\u093f\u0932\u0924\u0940 \u0939\u0948\u0964<\/p>\n<h2>\u0938\u092e\u094d\u092c\u0902\u0927\u093f\u0924 \u0932\u093f\u0902\u0915\u094d\u0938<\/h2>\n<ul>\n<li><a href=\"https:\/\/www.analyticsvidhya.com\/blog\/2021\/05\/understanding-backpropagation-in-neural-networks\/\" target=\"_new\" rel=\"noopener nofollow\">\u0928\u094d\u092f\u0942\u0930\u0932 \u0928\u0947\u091f\u0935\u0930\u094d\u0915 \u092e\u0947\u0902 \u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928 \u0915\u094b \u0938\u092e\u091d\u0928\u093e<\/a><\/li>\n<li><a href=\"https:\/\/towardsdatascience.com\/backpropagation-improving-neural-networks-23b1b3ea4d28\" target=\"_new\" rel=\"noopener nofollow\">\u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928: \u0928\u094d\u092f\u0942\u0930\u0932 \u0928\u0947\u091f\u0935\u0930\u094d\u0915 \u092e\u0947\u0902 \u0938\u0941\u0927\u093e\u0930<\/a><\/li>\n<li><a href=\"https:\/\/machinelearningmastery.com\/gentle-introduction-backpropagation-time\/\" target=\"_new\" rel=\"noopener nofollow\">\u092c\u0948\u0915\u092a\u094d\u0930\u094b\u092a\u0947\u0917\u0947\u0936\u0928 \u0915\u093e \u090f\u0915 \u0938\u0930\u0932 \u092a\u0930\u093f\u091a\u092f<\/a><\/li>\n<li><a href=\"http:\/\/neuralnetworksanddeeplearning.com\/chap2.html\" target=\"_new\" rel=\"noopener nofollow\">\u0924\u0902\u0924\u094d\u0930\u093f\u0915\u093e \u0928\u0947\u091f\u0935\u0930\u094d\u0915 \u0914\u0930 \u0917\u0939\u0928 \u0936\u093f\u0915\u094d\u0937\u0923<\/a><\/li>\n<\/ul>","protected":false},"featured_media":475755,"menu_order":0,"template":"","meta":{"_acf_changed":false,"content-type":"","inline_featured_image":false,"footnotes":""},"class_list":["post-475960","wiki","type-wiki","status-publish","has-post-thumbnail","hentry"],"acf":{"faq_title":"Frequently Asked Questions about <mark>Backpropagation: A Comprehensive Guide<\/mark>","faq_items":[{"question":"What is Backpropagation?","answer":"<p>Backpropagation is a fundamental algorithm used in artificial neural networks (ANNs) for training and optimization. It enables ANNs to learn from data and improve their performance over time.<\/p>"},{"question":"How did Backpropagation originate?","answer":"<p>The concept of backpropagation dates back to the 1960s, with early attempts made by Stuart Dreyfus in his Ph.D. thesis. The term \"backpropagation\" was first used by Paul Werbos in the 1970s. It gained significant attention in the 1980s when Rumelhart, Hinton, and Williams introduced a more efficient version of the algorithm.<\/p>"},{"question":"How does Backpropagation work?","answer":"<p>Backpropagation involves a forward pass, where input data is fed through the network, followed by a backward pass, where the error is propagated backward from the output to the input layer. This iterative process updates the network's weights until the error is minimized.<\/p>"},{"question":"What are the key features of Backpropagation?","answer":"<p>Backpropagation is versatile, efficient, scalable, and capable of handling non-linear activation functions. These features make it a powerful algorithm for training neural networks.<\/p>"},{"question":"What types of Backpropagation exist?","answer":"<p>There are several types of backpropagation, including Standard Backpropagation, Stochastic Backpropagation, Mini-batch Backpropagation, and Batch Backpropagation. Each has its advantages and trade-offs.<\/p>"},{"question":"How can Backpropagation be used?","answer":"<p>Backpropagation finds application in various domains, such as image recognition, natural language processing, and financial forecasting.<\/p>"},{"question":"What challenges are associated with Backpropagation, and how can they be solved?","answer":"<p>Backpropagation faces challenges like the vanishing gradient problem and overfitting. Solutions include using activation functions like ReLU, regularization techniques, and optimizing the network architecture.<\/p>"},{"question":"How does Backpropagation compare to Gradient Descent and Stochastic Gradient Descent?","answer":"<p>Backpropagation is an algorithm used in neural network training, while Gradient Descent and Stochastic Gradient Descent are optimization algorithms for function optimization. They differ in update frequency and computational efficiency.<\/p>"},{"question":"What does the future hold for Backpropagation?","answer":"<p>The future of backpropagation lies in advancements in hardware and algorithms, as well as exploring alternatives and combining it with novel neural network architectures.<\/p>"},{"question":"How are Proxy Servers associated with Backpropagation?","answer":"<p>Proxy servers support backpropagation tasks, particularly in large-scale distributed training, by enhancing data access and minimizing latency, leading to more efficient training with neural networks.<\/p>"}]},"_links":{"self":[{"href":"https:\/\/oneproxy.pro\/in\/wp-json\/wp\/v2\/wiki\/475960","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/oneproxy.pro\/in\/wp-json\/wp\/v2\/wiki"}],"about":[{"href":"https:\/\/oneproxy.pro\/in\/wp-json\/wp\/v2\/types\/wiki"}],"version-history":[{"count":0,"href":"https:\/\/oneproxy.pro\/in\/wp-json\/wp\/v2\/wiki\/475960\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/oneproxy.pro\/in\/wp-json\/wp\/v2\/media\/475755"}],"wp:attachment":[{"href":"https:\/\/oneproxy.pro\/in\/wp-json\/wp\/v2\/media?parent=475960"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}