These values don’t seem to be quite large, I am attaching the logs of max/min values of input and output to torch.exp
Number of training examples: 12907
Number of validation examples: 5
Number of testing examples: 25
Unique tokens in source (en) vocabulary: 2804
Unique tokens in target (hi) vocabulary: 3501
The model has 214,411 trainable parameters
Before applying exponential
max 0.0 min -0.01930026337504387
After applying exponential
max 1.0 min 0.9808847904205322
Before applying exponential
max 0.0 min -0.018911730498075485
After applying exponential
max 1.0 min 0.9812659621238708
Before applying exponential
max 0.0 min -0.019006941467523575
After applying exponential
max 1.0 min 0.9811725616455078
Before applying exponential
max 0.0 min -0.018911048769950867
After applying exponential
max 1.0 min 0.9812666177749634
Before applying exponential
max 0.0 min -0.019007515162229538
After applying exponential
max 1.0 min 0.9811719655990601
Before applying exponential
max 0.0 min -0.01864556595683098
After applying exponential
max 1.0 min 0.9815271496772766
Before applying exponential
max 0.0 min -0.02009735256433487
After applying exponential
max 1.0 min 0.9801031947135925
Before applying exponential
max 0.0 min -0.018839091062545776
After applying exponential
max 1.0 min 0.9813372492790222
Before applying exponential
max 0.0 min -0.018604880198836327
After applying exponential
max 1.0 min 0.9815670251846313
Before applying exponential
max 0.0 min -0.020035836845636368
After applying exponential
max 1.0 min 0.9801635146141052
Before applying exponential
max 0.0 min -0.019339684396982193
After applying exponential
max 1.0 min 0.980846107006073
Before applying exponential
max 0.0 min -0.020187072455883026
After applying exponential
max 1.0 min 0.9800152778625488
Before applying exponential
max 0.0 min -0.01930253952741623
After applying exponential
max 1.0 min 0.9808825254440308
Before applying exponential
max 0.0 min -0.018910178914666176
After applying exponential
max 1.0 min 0.981267511844635
Before applying exponential
max 0.0 min -0.01948946714401245
After applying exponential
max 1.0 min 0.9806991815567017
Before applying exponential
max 0.0 min -0.01900828257203102
After applying exponential
max 1.0 min 0.981171190738678
Before applying exponential
max 0.0 min -0.020097119733691216
After applying exponential
max 1.0 min 0.9801034331321716
Before applying exponential
max 0.0 min -0.01883871853351593
After applying exponential
max 1.0 min 0.9813375473022461
Before applying exponential
max 0.0 min -0.01860380545258522
After applying exponential
max 1.0 min 0.9815680980682373
Before applying exponential
max 0.0 min -0.020035073161125183
After applying exponential
max 1.0 min 0.9801642894744873
Before applying exponential
max 0.0 min -0.019338484853506088
After applying exponential
max 1.0 min 0.9808472394943237
Before applying exponential
max 0.0 min -0.020188473165035248
After applying exponential
max 1.0 min 0.980013906955719
Before applying exponential
max 0.0 min -0.019300060346722603
After applying exponential
max 1.0 min 0.9808849096298218
Before applying exponential
max 0.0 min -0.018910465762019157
After applying exponential
max 1.0 min 0.9812671542167664
Before applying exponential
max 0.0 min -0.019487164914608
After applying exponential
max 1.0 min 0.9807014465332031
Before applying exponential
max 0.0 min -0.01900639571249485
After applying exponential
max 1.0 min 0.981173038482666
Before applying exponential
max 0.0 min -0.01883944869041443
After applying exponential
max 1.0 min 0.9813368916511536
Before applying exponential
max 0.0 min -0.018602870404720306
After applying exponential
max 1.0 min 0.9815691113471985
Before applying exponential
max 0.0 min -0.020035918802022934
After applying exponential
max 1.0 min 0.9801634550094604
Before applying exponential
max 0.0 min -0.019340507686138153
After applying exponential
max 1.0 min 0.9808453321456909
Before applying exponential
max 0.0 min -0.020190240815281868
After applying exponential
max 1.0 min 0.9800121784210205
Before applying exponential
max 0.0 min -0.019304800778627396
After applying exponential
max 1.0 min 0.9808803200721741
Before applying exponential
max 0.0 min -0.018909433856606483
After applying exponential
max 1.0 min 0.9812682271003723
Before applying exponential
max 0.0 min -0.019489070400595665
After applying exponential
max 1.0 min 0.9806995987892151
Before applying exponential
max 0.0 min -0.01900819130241871
After applying exponential
max 1.0 min 0.9811713099479675
Before applying exponential
max 0.0 min -0.018603935837745667
After applying exponential
max 1.0 min 0.9815680384635925
Before applying exponential
max 0.0 min -0.02003599889576435
After applying exponential
max 1.0 min 0.9801633954048157
Before applying exponential
max 0.0 min -0.019340313971042633
After applying exponential
max 1.0 min 0.9808454513549805
Before applying exponential
max 0.0 min -0.0201878622174263
After applying exponential
max 1.0 min 0.9800145030021667
Before applying exponential
max 0.0 min -0.019302817061543465
After applying exponential
max 1.0 min 0.9808822870254517
Before applying exponential
max 0.0 min -0.018910393118858337
After applying exponential
max 1.0 min 0.9812672734260559
Before applying exponential
max 0.0 min -0.019486038014292717
After applying exponential
max 1.0 min 0.9807025790214539
Before applying exponential
max 0.0 min -0.019006924703717232
After applying exponential
max 1.0 min 0.9811725616455078
Before applying exponential
max 0.0 min -0.020037759095430374
After applying exponential
max 1.0 min 0.9801616072654724
Before applying exponential
max 0.0 min -0.019339915364980698
After applying exponential
max 1.0 min 0.9808458685874939
Before applying exponential
max 0.0 min -0.020188800990581512
After applying exponential
max 1.0 min 0.9800136685371399
Before applying exponential
max 0.0 min -0.01930314116179943
After applying exponential
max 1.0 min 0.980881929397583
Before applying exponential
max 0.0 min -0.018910465762019157
After applying exponential
max 1.0 min 0.9812671542167664
Before applying exponential
max 0.0 min -0.019486617296934128
After applying exponential
max 1.0 min 0.9807019233703613
Before applying exponential
max 0.0 min -0.019006475806236267
After applying exponential
max 1.0 min 0.9811729788780212
Before applying exponential
max 0.0 min -0.01933939754962921
After applying exponential
max 1.0 min 0.9808463454246521
Before applying exponential
max 0.0 min -0.020187366753816605
After applying exponential
max 1.0 min 0.9800150394439697
Before applying exponential
max 0.0 min -0.019302254542708397
After applying exponential
max 1.0 min 0.9808828234672546
Before applying exponential
max 0.0 min -0.018910422921180725
After applying exponential
max 1.0 min 0.9812672734260559
Before applying exponential
max 0.0 min -0.0194871723651886
After applying exponential
max 1.0 min 0.9807014465332031
Before applying exponential
max 0.0 min -0.01900804415345192
After applying exponential
max 1.0 min 0.9811714291572571
Before applying exponential
max 0.0 min -0.02018953673541546
After applying exponential
max 1.0 min 0.9800128936767578
Before applying exponential
max 0.0 min -0.01930280774831772
After applying exponential
max 1.0 min 0.9808822870254517
Before applying exponential
max 0.0 min -0.0189106035977602
After applying exponential
max 1.0 min 0.9812670946121216
Before applying exponential
max 0.0 min -0.01948753371834755
After applying exponential
max 1.0 min 0.9807010293006897
Before applying exponential
max 0.0 min -0.019007209688425064
After applying exponential
max 1.0 min 0.9811722040176392
Before applying exponential
max 0.0 min -0.019301380962133408
After applying exponential
max 1.0 min 0.9808836579322815
Before applying exponential
max 0.0 min -0.018910270184278488
After applying exponential
max 1.0 min 0.9812673926353455
Before applying exponential
max 0.0 min -0.019488558173179626
After applying exponential
max 1.0 min 0.9807000756263733
Before applying exponential
max 0.0 min -0.01900819130241871
After applying exponential
max 1.0 min 0.9811713099479675
Before applying exponential
max 0.0 min -0.018910503014922142
After applying exponential
max 1.0 min 0.9812671542167664
Before applying exponential
max 0.0 min -0.019488057121634483
After applying exponential
max 1.0 min 0.9807005524635315
Before applying exponential
max 0.0 min -0.019006900489330292
After applying exponential
max 1.0 min 0.9811725616455078
Before applying exponential
max 0.0 min -0.019488198682665825
After applying exponential
max 1.0 min 0.9807004332542419
Before applying exponential
max 0.0 min -0.01900586299598217
After applying exponential
max 1.0 min 0.981173574924469
Before applying exponential
max 0.0 min -0.018645640462636948
After applying exponential
max 1.0 min 0.9815270900726318
Before applying exponential
max 0.0 min -0.020098166540265083
After applying exponential
max 1.0 min 0.9801024198532104
Before applying exponential
max 0.0 min -0.018839359283447266
After applying exponential
max 1.0 min 0.9813370108604431
Before applying exponential
max 0.0 min -0.018604330718517303
After applying exponential
max 1.0 min 0.9815676212310791
Before applying exponential
max 0.0 min -0.020036987960338593
After applying exponential
max 1.0 min 0.9801623821258545
Before applying exponential
max 0.0 min -0.019339658319950104
After applying exponential
max 1.0 min 0.980846107006073
Before applying exponential
max 0.0 min -0.02018718235194683
After applying exponential
max 1.0 min 0.9800151586532593
Before applying exponential
max 0.0 min -0.019302602857351303
After applying exponential
max 1.0 min 0.9808824062347412
Before applying exponential
max 0.0 min -0.01891184411942959
After applying exponential
max 1.0 min 0.9812658429145813
Before applying exponential
max 0.0 min -0.019488999620079994
After applying exponential
max 1.0 min 0.9806996583938599
Before applying exponential
max 0.0 min -0.01982579194009304
After applying exponential
max 1.0 min 0.9803694486618042
Before applying exponential
max 0.0 min -0.019007962197065353
After applying exponential
max 1.0 min 0.9811714887619019
Before applying exponential
max 0.0 min -0.02009640820324421
After applying exponential
max 1.0 min 0.9801041483879089
Before applying exponential
max 0.0 min -0.01883961260318756
After applying exponential
max 1.0 min 0.9813367128372192
Before applying exponential
max 0.0 min -0.01860237866640091
After applying exponential
max 1.0 min 0.9815695881843567
Before applying exponential
max 0.0 min -0.02003667876124382
After applying exponential
max 1.0 min 0.9801627397537231
Before applying exponential
max 0.0 min -0.0193393062800169
After applying exponential
max 1.0 min 0.9808464646339417
Before applying exponential
max 0.0 min -0.020189685747027397
After applying exponential
max 1.0 min 0.9800127744674683
Before applying exponential
max 0.0 min -0.01930147223174572
After applying exponential
max 1.0 min 0.9808835387229919
Before applying exponential
max 0.0 min -0.0189093928784132
After applying exponential
max 1.0 min 0.9812682271003723
Before applying exponential
max 0.0 min -0.01948663219809532
After applying exponential
max 1.0 min 0.9807019233703613
Before applying exponential
max 0.0 min -0.019825227558612823
After applying exponential
max 1.0 min 0.9803699851036072
Before applying exponential
max 0.0 min -0.01900714449584484
After applying exponential
max 1.0 min 0.9811723232269287
Before applying exponential
max 0.0 min -0.018840152770280838
After applying exponential
max 1.0 min 0.9813361763954163
Before applying exponential
max 0.0 min -0.018603524193167686
After applying exponential
max 1.0 min 0.981568455696106
Before applying exponential
max 0.0 min -0.020036067813634872
After applying exponential
max 1.0 min 0.9801632761955261
Before applying exponential
max 0.0 min -0.019339565187692642
After applying exponential
max 1.0 min 0.9808462262153625
Before applying exponential
max 0.0 min -0.020190367475152016
After applying exponential
max 1.0 min 0.9800121188163757
Before applying exponential
max 0.0 min -0.019302181899547577
After applying exponential
max 1.0 min 0.9808829426765442
Before applying exponential
max 0.0 min -0.018910503014922142
After applying exponential
max 1.0 min 0.9812671542167664
Before applying exponential
max 0.0 min -0.01948685571551323
After applying exponential
max 1.0 min 0.9807018041610718
Before applying exponential
max 0.0 min -0.019825518131256104
After applying exponential
max 1.0 min 0.9803696870803833
Before applying exponential
max 0.0 min -0.019008396193385124
After applying exponential
max 1.0 min 0.9811710715293884
Before applying exponential
max 0.0 min -0.01860380545258522
After applying exponential
max 1.0 min 0.9815680980682373
Before applying exponential
max 0.0 min -0.020034171640872955
After applying exponential
max 1.0 min 0.9801651835441589
Before applying exponential
max 0.0 min -0.01933983899652958
After applying exponential
max 1.0 min 0.9808459281921387
Before applying exponential
max 0.0 min -0.020188678056001663
After applying exponential
max 1.0 min 0.9800137281417847
Before applying exponential
max 0.0 min -0.01930253580212593
After applying exponential
max 1.0 min 0.9808825254440308
Before applying exponential
max 0.0 min -0.018911192193627357
After applying exponential
max 1.0 min 0.981266438961029
Before applying exponential
max 0.0 min -0.019490612670779228
After applying exponential
max 1.0 min 0.9806980490684509
Before applying exponential
max 0.0 min -0.019825948402285576
After applying exponential
max 1.0 min 0.9803692698478699
Before applying exponential
max 0.0 min -0.01900610886514187
After applying exponential
max 1.0 min 0.9811733365058899
Before applying exponential
max 0.0 min -0.02003747597336769
After applying exponential
max 1.0 min 0.9801619052886963
Before applying exponential
max 0.0 min -0.019340286031365395
After applying exponential
max 1.0 min 0.9808454513549805
Before applying exponential
max 0.0 min -0.02018577791750431
After applying exponential
max 1.0 min 0.9800165295600891
Before applying exponential
max 0.0 min -0.019299039617180824
After applying exponential
max 1.0 min 0.9808859825134277
Before applying exponential
max 0.0 min -0.018910575658082962
After applying exponential
max 1.0 min 0.9812670946121216
Before applying exponential
max 0.0 min -0.019486989825963974
After applying exponential
max 1.0 min 0.9807016253471375
Before applying exponential
max 0.0 min -0.01982567459344864
After applying exponential
max 1.0 min 0.980369508266449
Before applying exponential
max 0.0 min -0.019006211310625076
After applying exponential
max 1.0 min 0.9811732172966003
Before applying exponential
max 0.0 min -0.019340457394719124
After applying exponential
max 1.0 min 0.9808453321456909
Before applying exponential
max 0.0 min -0.020189344882965088
After applying exponential
max 1.0 min 0.9800130724906921
Before applying exponential
max 0.0 min -0.01930450275540352
After applying exponential
max 1.0 min 0.9808805584907532
Before applying exponential
max 0.0 min -0.01891041174530983
After applying exponential
max 1.0 min 0.9812672734260559
Before applying exponential
max 0.0 min -0.019486669450998306
After applying exponential
max 1.0 min 0.9807019233703613
Before applying exponential
max 0.0 min -0.019827280193567276
After applying exponential
max 1.0 min 0.9803679585456848
Before applying exponential
max 0.0 min -0.019005414098501205
After applying exponential
max 1.0 min 0.9811739921569824
Before applying exponential
max 0.0 min -0.02018619142472744
After applying exponential
max 1.0 min 0.9800161719322205
Before applying exponential
max 0.0 min -0.019303616136312485
After applying exponential
max 1.0 min 0.9808814525604248
Before applying exponential
max 0.0 min -0.0189113337546587
After applying exponential
max 1.0 min 0.9812663793563843
Before applying exponential
max 0.0 min -0.019487900659441948
After applying exponential
max 1.0 min 0.9807007312774658
Before applying exponential
max 0.0 min -0.019827045500278473
After applying exponential
max 1.0 min 0.9803681969642639
Before applying exponential
max 0.0 min -0.019005149602890015
After applying exponential
max 1.0 min 0.9811742305755615
Before applying exponential
max 0.0 min -0.01930542290210724
After applying exponential
max 1.0 min 0.9808796644210815
Before applying exponential
max 0.0 min -0.018911056220531464
After applying exponential
max 1.0 min 0.9812666177749634
Before applying exponential
max 0.0 min -0.019487980753183365
After applying exponential
max 1.0 min 0.980700671672821
Before applying exponential
max 0.0 min -0.019826088100671768
After applying exponential
max 1.0 min 0.9803690910339355
Before applying exponential
max 0.0 min -0.019005481153726578
After applying exponential
max 1.0 min 0.9811739325523376
Before applying exponential
max 0.0 min -0.018912117928266525
After applying exponential
max 1.0 min 0.9812655448913574
Before applying exponential
max 0.0 min -0.019485829398036003
After applying exponential
max 1.0 min 0.9807027578353882
Before applying exponential
max 0.0 min -0.019825410097837448
After applying exponential
max 1.0 min 0.9803697466850281
Before applying exponential
max 0.0 min -0.019007179886102676
After applying exponential
max 1.0 min 0.9811723232269287
Before applying exponential
max 0.0 min -0.019486064091324806
After applying exponential
max 1.0 min 0.9807025194168091
Before applying exponential
max 0.0 min -0.019826460629701614
After applying exponential
max 1.0 min 0.9803687930107117
Before applying exponential
max 0.0 min -0.019005997106432915
After applying exponential
max 1.0 min 0.9811734557151794
Before applying exponential
max 0.0 min -0.01982627622783184
After applying exponential
max 1.0 min 0.980368971824646
loss is tensor(97.8701, device='cuda:0', grad_fn=<NegBackward>)